KR102373951B1 - Multi human interface device having text input unit and pointer location information input unit - Google Patents

Abstract

A human interface device comprising: receiving a first gesture from a user through a text input area; generating first text-related information according to the first gesture; and transferring the first text information to the human interface device by wire or Transmitting to a wirelessly connected digital device, receiving a second gesture from a user, switching the human interface device to a pointing location information input mode according to the second gesture, through a pointing location information input area from the user Receiving a third gesture, generating information related to the pointer location information according to the third gesture, and transmitting the generated information related to the pointer location information to a digital device connected to the human interface device by wire or wirelessly Step, receiving a fourth gesture from a user, and switching the human interface device to a text input mode according to the fourth gesture, wherein the text input area and the pointing location information input area have at least a part in common Characterized Human Interface Device

Description

Complex human interface device equipped with a text input device and a pointer location information input device

The present invention relates to a human interface for receiving text information or pointing location information from a user to a digital device capable of receiving text or pointing location information, such as a computer, laptop computer, tablet PC, or mobile phone, and transmitting the text information or pointing location information to the digital device.

A text input device such as a keyboard for inputting text in a personal computer or a portable digital device has been disclosed. Also, a pointing device such as a mouse device for controlling a pointing position of a pointer for controlling the digital device and performing a function has been disclosed.

The conventional text input device and the pointing device are provided as separate devices, or the pointing input area is configured at a separate location from the text input area of the text input device. Accordingly, in a work environment in which text input, pointing location information input, and pointer execution command input are frequently switched, the user's hand moves more than necessary, thereby reducing work efficiency.

In the present invention, a switching unit for switching between a text input mode and a pointing location information input mode is provided with a pointing position information input region of a pointing device on the upper surface of the text input region plane of the text input device, so that input mode switching during text input is simple Through this, it is possible to improve work efficiency by enabling pointing input while minimizing the movement of the user's hand.

By integrating the separately provided text input device and pointing device into one human interface device, the unit price and size of the product can be reduced, and work efficiency can be improved by eliminating unnecessary operations of the user.

1 is an exemplary diagram of a complex human interface device provided with a pointing device and a text input device.
2 is a flowchart illustrating an example of an operation sequence according to mode switching between a pointing device and a text device.
3 is an example of a configuration of a text input device and a pointing device.
4 is an embodiment of a pointer execution command unit integrated mode switching unit.
5 is an example of a structure of a pointer location information input device.
6 is a block diagram of an infrared laser sensor module.
7 is an embodiment of displaying a pointer location information input area.
8 is a first embodiment of a pointer location information input device that can be separated from a text input device.
9 is a second embodiment of a pointer location information input device that can be separated from a text input device.
10 is a third embodiment of a pointer location information input device that can be separated from a text input device.
11 is a front view and a perspective view of a human interface device to which a lower position type pointer position information input device is applied.
12 is an embodiment of a pointer execution command unit integrated mode switching unit.
13 is an embodiment using a cover of a human interface device to which a lower position type pointer position information input device is applied.
14 is an embodiment of a human interface device applied to a portable electronic device.

The present invention relates to a complex human interface for receiving text information or pointing location information from a user to a digital device capable of receiving text or pointing location information, such as a computer, laptop computer, tablet PC, or mobile phone, and transmitting the text information or pointing location information to the digital device.

As an existing text information input device, a keyboard composed of an elastic body and a plurality of physical buttons connected to a switch is widely used.

In addition, in a digital device equipped with a touch interface, a virtual keyboard is displayed on the display, and when a part of the user's body is touched on the virtual keyboard displayed on the display, the user's gesture or electrical signal is sensed and the user's touch is performed. A method of inputting text on the virtual keyboard displayed on the part is also used.

The touch interface recognizes the movement of a part of the user's body, recognizes contact with a specific contact surface, detects the flow of current through the user's body, or detects that light or sound waves are blocked or interfered with by a part of the user's body The user's touch may be recognized by sensing or the like.

Examples of the touch interface include a pressure-sensitive touch screen, a capacitive touch screen, an optical touch screen, and an ultrasonic touch screen.

A resistive touch screen or a pressure-sensitive touch screen is a touch screen that operates by recognizing pressure.

Resistive touch screens are inexpensive and have the advantage of being able to write or write in small spaces with a stylus pen. This is known as a disadvantage.

Resistive touch screens are made up of several layers.

Among these layers is a conductive layer, in which two layers face each other with an air layer in the middle.

When the outer screen is pressed, the two conductive layers come into contact with each other, which causes the resistance and current to change, so that a touch is recognized.

A capacitive sensing or capacitive touch method is a method of sensing a motion using a capacitive coupling effect.

Unlike pressure-sensitive touch screens that use pressure, capacitive touch screens are made of highly conductive glass called indium tin oxide.

As sensors are attached to the four corners of the glass, current flows through the surface of the glass.

Recognizing the change in current through this is the principle of the electrostatic type.

At this time, the electrons that flowed through the glass the moment you put your finger on the screen flow into the body through your finger, and the sensor detects the location of the change and operates.

It is known that the capacitive touch screen is characterized by smooth operation and scrolling compared to the pressure-sensitive touch screen because it is recognized by just touching the screen rather than applying force to the screen.

In addition, the capacitive touch method enables multi-touch that can touch several places.

Since the capacitive touch method is operated using a change in current, it may not be operated with a fingernail or a stylus pen or wearing leather gloves that do not conduct current.

However, if you use a separate capacitive stylus pen, you can touch the screen.

Because the sensor is sensitive, it may be affected by peripheral devices.

The optical touch screen works by measuring the coordinates of an infrared camera mounted on the vertex of the touch screen and an infrared light using the shadow of an object to touch the screen.

The ultrasonic touch screen operates by emitting ultrasonic waves on the screen, detecting the interference effect caused by the user's touch, and measuring the coordinates.

In addition, various touch input technologies that can be used to control the location information of the pointer by recognizing the location information of a part of the user's body by sensing the user's touch or movement may be used in the present invention.

1 is an exemplary diagram of a complex human interface device provided with a pointing device and a text input device.

The pointing device-integrated text input device may have a housing 100 for supporting the text input device and the pointer location information input area.

The housing has the strength to withstand the pressure of the user input, receives text input information and pointer location information input information, and transmits the information to a digital device connected to the pointing device integrated text input device by wire or wirelessly. It may be composed of a control unit, a memory unit, a battery unit, an encoding unit, a transmitter, and the like.

The pointing device integrated text input device may include a plurality of buttons 109 for receiving text input information from a user.

The plurality of buttons 109 may be configured as physical buttons or virtual buttons.

The physical button may be composed of a button connected to an elastic body, or the button itself may have elasticity so that it moves when a user input is received and returns to its original position when the user's pressure is removed.

Since the physical button is connected to the electrical switch, the user's pressure is applied to the button to move the position, so that the phase of the switch is changed to generate a text input value of the corresponding button.

The physical button has a structure that has elasticity without an electrical switch, moves to a position under the user's pressure, and returns to its original position when the user's pressure is removed. Text input information may be generated based on location information where the user's pressure or gesture is recognized.

The virtual button may be configured by displaying a text input button on a display device.

The virtual button may display an arbitrary button by projecting light onto a transparent, translucent, or opaque object.

The virtual button is not recognized by the user's eyes and has unique location information for each text, and may generate corresponding text input information based on the user's pressure or gesture information.

The complex human interface device may have a text input area 107 and pointing location information input areas 108a and 108b having at least a portion as a common area.

The pointing location information input areas 108a and 108b are areas located on the surface, upper or lower part of the button for text input, and as shown in FIG. 1 , the pointing location information input area may have at least a portion in common with the text input area. there is.

The pointing location information input area may include the text input area, or the text input area may include the pointing location information input area.

At least part of the pointing location information input area and the text input area have in common, and at least part of it is used as a pointing location information input area but is not used as a text input area, and at least part of it is used as a text input area but a pointing location information input area may not be used as

The complex human interface device includes a pointer location information input device 105 for forming a virtual text input area or a virtual pointing location information input area for text input or pointing location information input or for text input and pointing location information input. It may be configured on the complex human interface device or outside the complex human interface device.

The pointer location information input device 105 includes devices such as an infrared generator and an infrared receiver or an RGB camera or an ultrasonic generator and an ultrasonic receiver or an infrared generator and an infrared camera, and the surface of the housing 100 or the housing 100 ) by detecting a part of the user's body in the air, it is possible to receive location information and gesture information.

The pointer location information input device may be modularized to expand the pointer location information input area or to improve accuracy and sensitivity, and may be composed of a plurality of modules.

For example, it may have a pointer location information input device 105b for configuring the text input or pointing location information input area 108b of the right hand.

Alternatively, it may have a pointer location information input device 105a for configuring the left hand text input or pointing location information input area 108a.

The text input area or the pointing location information input area 108b for the right hand may include an area of a J button of a standard English keyboard.

The text input area or the pointing location information input area 108a for the left hand may include an area of an F button of an English standard keyboard.

The pointer location information input device may include both areas of the J (J) and F (F) buttons of the English standard keyboard when there is no division for the left hand and the right hand.

The pointing location information input area may be characterized in that when the complex human interface device is connected to a plurality of digital devices having a display unit, the pointing location information input area may move a pointer on the plurality of display units.

For example, dividing the area so that the pointer location information input area matches each display unit, or manipulating a separate button instructing the display unit to transmit pointer position information from the display unit, or to transmit the pointer position information from a plurality of display units to a virtual single By recognizing the display unit, pointer location information may be transmitted so that the pointer can move on a single virtual display unit.

The complex human interface device includes a pointing location information input device that configures a pointing input area and receives pointer location information from a user, and inputs a button, image, space, icon, or text in which the pointer moved by the pointing location information input device is located. It may have pointer execution command units 101 and 102 for executing at least one function on the window.

The pointer execution command unit may be composed of one or two buttons, each having a first function and a second function, and may be located on the left side, the right side, or the center of the housing.

The first function may function as, for example, a left click of a computer mouse, and the second function may function as, for example, a right click of a computer mouse.

The pointer execution command unit composed of the one or two buttons may be provided on both the left side and the right side of the housing.

The pointer execution command unit may be configured to operate by recognizing a touch or light blocking of a user's body part, interference of ultrasonic waves, or a shadow of a user's body part using the above-described touch technology.

The pointer execution command unit may be configured as a physical button with elasticity.

The pointer execution command unit may operate by using at least one button of a text button located in the text input area other than the pointing location information input area.

The pointer execution command unit may operate by selecting a physical or virtual text button on the pointing location information input area.

For example, when a virtual input device capable of inputting location information in space is used as the pointing location information input device and a physical button is used as a text input device, the pointer position on the virtual pointing location information input area in the pointing location information input mode Pointer execution commands can be issued by entering information and pressing a physical text button positioned in place.

The pointer execution command unit may receive pointer location information through a user's first gesture in the pointing location information input area and generate a pointer execution command at the same location by a user's second gesture.

The pointer execution command unit may be configured to execute a first function by a first gesture of the user's body, a first voice, a first blink, a first mouth shape, or the like.

The pointer execution command unit may be configured to execute a second function by a second gesture of the user's body, a second voice, a second blink, a second mouth shape, or the like.

The complex human interface device may be configured in a text input mode for receiving text information through the text input device and a pointing location information input mode for receiving pointing location information through the pointing location information input device.

The text input mode and the pointing location information input mode may be switched by the mode switching unit 103 .

The mode conversion unit 103 may be configured as a switch separately located on the housing.

The mode switching unit 103 may perform mode switching by detecting that at least one text input button included in the text input device or a plurality of text inputs are simultaneously received.

The mode conversion unit 103 may receive control information from a digital device connected to the complex human interface device by wire or wirelessly to perform mode conversion.

The mode switching unit 103 may be configured integrally with the pointer execution command unit 102 .

For example, by a first gesture such as contacting a part of the user's body on a first button that has a primary response to a first touch or first pressure and a secondary response to a second touch or second pressure. It can be configured to change the mode by sensing the touch or the first pressure and respond to the second touch or the second pressure by a second gesture such as pressing a button to generate a pointer execution command.

The mode switching unit 103 may be configured as a temporary mode switching mode and a permanent mode switching mode.

For example, in response to the first touch or first pressure, switching from the text input mode to the pointing location information input mode and returning to the text input mode when the first touch or the first pressure is removed can be set as a temporary switching mode. there is.

Alternatively, in response to the first touch or first pressure, switching from the pointing location information input mode to the text input mode and returning to the pointing location information input mode when the first touch or the first pressure is removed may be set as a temporary switching mode. .

Permanent switching mode can be configured to switch from text input mode to pointing location information input mode in response to a second touch or second pressure or toggle switch, and maintain the pointing location information input mode even when the second touch or second pressure is removed. can

Temporary mode conversion may be performed according to the first control information received from the digital device connected to the complex human interface device by wire or wirelessly.

Permanent mode conversion can be performed according to the second control information received from the digital device connected to the complex human interface device by wire or wirelessly.

The mode switching unit 103 may be configured integrally with the pointer execution command unit.

For example, when a first touch or first pressure is sensed on the pointer execution command unit, the temporary mode is switched from the text input mode to the pointer location information input mode, and when the second touch or the second pressure is detected, the pointer execution command is executed. When the third touch or third pressure is applied, a permanent switching mode may be set to operate in the pointer location information input mode even if the third touch or third pressure is removed.

At this time, it can be configured so that pointer execution command input is possible even during permanent conversion mode.

The mode switching unit may be configured on the left or right side of the housing (106a, 106b)

The mode switching units 106a and 106b configured on the left or right side of the housing or on the left and right sides of the housing are configured as virtual buttons or physical buttons, and may be configured to operate by sensing a user's touch input or pressure.

The mode switching units 106a and 106b configured on the left or right side of the housing or on the left and right sides of the housing may be configured to have an input area of 3 cm or more and less than 15 cm along the side of the housing.

When the length of the mode switching part is less than 5 centimeters, it is preferable to set the position of the mode switching part to include the space on the left side of the left tab key of the Windows standard keyboard.

The complex human interface device may have a transmission unit 104 that transmits data by wire or wirelessly to an external or digital device including the complex human interface device.

The digital device may receive text input or may receive pointer location information.

2 is a flowchart illustrating an example of an operation sequence according to mode switching between a pointing device and a text device.

The complex human interface device may have a separate power supply unit or may receive power from the outside by wire or wirelessly, and may have a separate switch for controlling the power supply unit.

When power is supplied to the complex human interface device by the switch controlling the power supply unit, it may be determined whether the complex human interface device is currently in a text input mode or a pointing location information input mode ( 200 ).

As a result of the determination, when the text input mode is set, the text input device may be activated and text input may be received from the user ( 201 ).

The user's text input may be transmitted to a digital device connected by wire or wirelessly ( 202 ).

* If the mode conversion to the pointing location information input mode occurs during the text input mode, the text input mode may be switched to the pointing location information input mode.

Alternatively, it can be configured so that pointing location information can be input at the same time as text input.

When the mode is switched to the pointing location information input mode, the pointing location information may be input by the user's input ( 204 ).

The received pointer location information may be transmitted to a digital device connected by wire or wirelessly ( 205 ).

When the complex human interface device receives the pointer first execution command ( 206 ), it may transmit the pointer first execution command to a digital device connected by wire or wirelessly ( 207 ).

When the complex human interface device receives the pointer second execution command ( 208 ), it may transmit the pointer first execution command to a digital device connected by wire or wirelessly ( 209 ).

When the temporary mode switch is released or the permanent mode switch is released, the complex human interface device may switch to the text input mode.

When the power of the complex human interface device is cut off at the power switch of the power unit, there is no connected digital device or the connection is cut off, or when there is no user input for a certain period of time, or when there is no input from the user for a certain period of time, or the control of the wired or wirelessly connected digital device can be terminated.

3 is an example of a configuration of a text input device and a pointing device.

The complex human interface device may include a first housing 301 including a power supply unit, a control unit or a communication unit, and a second housing 302 for configuring a text input area and a pointing location information input area.

The complex human interface device may have a text input device for receiving text input from a user and a text input area 303 .

In this case, the text input area 303 may be configured as a virtual button or a physical button.

The pointing location information input device may be configured in the form of a pressure-sensitive or capacitive touch pad and positioned on a physical button of the text input device ( 304 ).

At this time, if the text input device is configured in a physical touch pad type such as a pressure-sensitive type or capacitive type, the touch pad can be used as a text input device and a pointing location information input device, and the mode can be switched and used by the mode switching unit.

In this case, a physical touchpad such as a pressure-sensitive or capacitive type may be configured as a large-area touchpad-type complex human interface device 300 including a touchpad 304 including a plurality of text button regions of the text input unit.

Alternatively, a pressure-sensitive or capacitive physical touchpad may be configured as a plurality of touchpad-type complex human interface devices 310 including a plurality of touchpads 311 including one text button area of the text input unit.

Or the upper camera type complex human interface device 320 constituting the pointer location information input area 321 by the infrared camera or RGB (RGB) camera 222 located at the upper end of the pointing location information input area to input the pointing location information. can be configured as

In this case, the upper camera type complex human interface device 320 may configure the virtual text input button 303 using the upper camera.

The camera may be configured as a lower camera 332 type complex human interface device 330 configured to be positioned at the lower end of the second housing to form a pointing location information input area 331 .

In this case, the lower camera type complex human interface device 330 may configure a virtual text input button 303 that replaces the physical text button by using the lower camera.

Alternatively, a virtual pointing location information input area ( It can be configured as a transmission/reception type complex human interface device 340 that is received through 341).

In this case, the paired virtual pointing location information input area may be used as a virtual text button input means instead of a physical text button by the mode switching unit.

4 is an example of a pointer execution command unit integrated mode switching unit.

When the position is moved by the user's pressure and the elastic body 403 returns to the original position when the pressure is removed, and the button 402 that receives the user's pressure and the user's pressure is moved and joined, the pointer execution command In the button-type pointer execution command unit having switches 404 and 405 for generating It is possible to configure the pointer execution command unit-integrated mode switching unit 400 using

When the position is moved by the user's pressure and the pressure is removed, the elastic body 403 and the button 402 that receives the user's pressure to return to the original position when the pressure is removed are moved and joined by the user's first pressure, the pointer In the button-type pointer execution command unit having the first switches 404 and 405 to generate an execution command, the second switch unit 411 is joined by the user's second pressure smaller than the user's first pressure to generate the mode change execution command. 412), it can be configured as a pressure-sensitive pointer execution command unit-integrated mode switching unit 410 .

In the pressure-sensitive pointer execution command unit-integrated mode switching unit 410 , the button unit 402 may be moved to prevent returning to its original position by the elastic body 403 .

At this time, the position at which the button is fixed is set to a position where the second switches 411 and 412 are bonded and the first switches 404 and 405 are not bonded, so that when the button is fixed, it can be configured to operate in a permanent mode switching mode. .

In the pointer execution command unit-integrated mode switching unit 400 using a touch input, it can be configured to operate the permanent mode changeover switch 414 through position movement, such as sliding the button, and the permanent mode changeover switch 414 is When additional pressure is applied in the operated state, the pointer execution command switches 404 and 405 may be configured to operate.

The pointer execution command unit-integrated mode switching unit 410 is configured as a touchpad 421 and operates as a mode switching unit when the contact area of a portion of the user's body in contact with the touchpad is within a first predetermined range, and operates as a second predetermined range. You can make it work as a pointer execution instruction.

5 is an example of a structure of a pointer location information input device.

The pointer location information input device of the human interface device of the present invention may include a sensor module 501 including a light emitter and a camera.

In the light emitter of the sensor module 501, the path of light is blocked by an obstacle, for example, a user's finger, on the pointing location information input area 108 configured on a light plane composed of light emitted from the light emitter. It serves to configure the light plane to be reflected.

The camera of the sensor module includes an optical sensor that detects light blocked or reflected by the obstacle.

The optical sensor may use a line camera capable of recognizing a line image.

In the line camera, the image sensor is preferably composed of 400 to 1000 elements in a line form, and preferably 500 to 700 elements are ideal.

The line camera may include a plurality of line image sensors smaller than 1 to 7 quarters of the 500 to 700 elements.

The light emitter is composed of a light emitting element for forming a light plane on the upper end of the character input button 303 close to about 1 millimeter.

The pointing location information input area 108 is composed of a part of the light plane.

The light emitting device may be, for example, an infrared emitter, an infrared laser emitter, a laser emitter, an ultraviolet emitter, a visible light emitter, or the like.

It is ideal to use an infrared laser emitter that does not require the installation of a reflector on the edge of the light emitting device.

It is suitable for the infrared laser emitter to drive a laser having a laser wavelength of 800 to 850 nanometers at 0.3 to 1 milliwatt.

The light emitter passes through the line lens so that the light of the infrared emitter can spread in a plane.

A line lens may be further included in the light emitting part of the light emitter so that the light emitted from the light emitting device may constitute a light plane.

The line lens is positioned so that the light emitted from the light emitting device can constitute a light plane substantially parallel to the character input unit.

The pointer location information input device may further configure the optical filter 504 to transmit light of a light emitter only in a specific wavelength band.

The optical filter 504 is installed so that light emitted from the light emitter passes through, and in front of the camera to prevent light not emitted from the light emitter from being received when light reflected or blocked by an obstacle is received by the camera. can also be installed.

The optical filter for the light emitter and the camera may be configured separately, but it is preferable to design the light emitter and the camera to be close to each other so that both the transmitted light and the received light can be filtered through one optical filter. .

The optical filter may be installed to be perpendicular to the traveling direction of the light of the light emitter.

The optical filter may be installed so as to be 30 degrees to 60 degrees or 120 degrees to 150 degrees in the traveling direction of the light emitter in consideration of the design aspect.

The sensor module 501 may be installed so that the light of the light emitter is directly radiated to the light plane. (510)

The sensor module 501 may further include a single reflector 503 so that the light of the light emitter is refracted once and radiated to the light plane. (520)

In this case, even light blocked or reflected by the obstacle may be refracted once by the reflector 503 and received by the camera.

The sensor module 501 may include two reflectors 503a and 503b so that the light of the light emitter is refracted twice and radiated to the light plane. (530)

At this time, even light blocked or reflected by the obstacle may be refracted twice by the two reflectors 503a and 503b and received by the camera.

In this way, the sensor module can be installed inside the first housing 301 .

In this case, the optical filter may be coated on the reflection plate 503 to replace the separate optical filter 504 .

When the pointing location information input area 108 is activated by the sensor module 501 , the user uses a finger to move over the plurality of text input buttons 303 to input pointing location information.

At this time, in order not to interfere with the movement of the user's finger due to the distance between the text input buttons 303, the distance between the text input buttons 303 is ideally 0.1 to 1 millimeter.

In addition, the plurality of text input buttons 303 located below the pointing location information input area 108 are preferably positioned on a flat top surface of the plurality of text input buttons.

The light source emitted from the sensor module 501 is reflected by a reflector or an obstacle, and the light source received by the camera again passes through the light tunnel 502 .

In this case, if the upper surface of the light tunnel is replaced with a part of the first housing 301 , the thickness of the housing can be reduced.

The lower end and side surfaces of the light tunnel may be designed as a structure separate from the first housing.

6 is a block diagram of an infrared laser sensor module.

The infrared sensor module basically uses the light source 601 to emit light that covers the pointing location information area, and analyzes the light reflected or blocked by the obstacle to determine the location of the obstacle with one or two cameras 603. It is a calculation principle.

In this case, the line lens 602 that scatters the light so that the light emitted from the light source 601 can be emitted to a desired area may be used.

A camera for recognizing a state in which a light source is reflected or blocked by an obstacle preferably uses a line camera.

The camera can install a guide light tunnel in front of the camera that helps the incoming light to receive light in the desired area.

In the present invention, the light source may be infrared, ultraviolet, laser, or the like.

* The light source and camera can be replaced with ultrasonic waves and ultrasonic receivers.

In the present invention, it is preferable to use an infrared laser as a light source in order not to install a reflector on the edge of the keyboard.

If you want to use infrared light, you can install a reflector on the edge of the keyboard, double the output of the light source compared to the optical touch module for a general screen, or additionally install an auxiliary light source.

The sensor module may have an auxiliary control board 604 that controls the light source and the camera and transmits the received signal of the camera to the main control board.

The pointer location information input unit may be positioned to include a part of an extended surface of a plane of the text input unit.

The text input unit includes a plurality of buttons for receiving at least one text input, and the buttons generate a text selection signal while moving from a first position to a second position by the pressure applied by the user, and move to the first position by an elastic body. It can be configured in the form of a physical button that returns to .

The text input unit includes F4 (F4) and F5 (F5) buttons on the Windows standard keyboard, and the pointer location information input unit has two cameras, and the camera on the left of the two cameras and the text input unit It can be designed so that the button closest to the button becomes the f4 or f5 button.

Alternatively, the camera on the left may be located above the space in which the distance between the F4 and F5 buttons is moved downward in parallel under the space bar of the Windows standard keyboard.

In this way, when the position of the index finger of the right hand is at position F among the text input buttons, it is possible to reduce the phenomenon that the index finger of the left hand covers the camera when inputting pointer position information with the right hand.

If the pointer execution command unit is set to a button with the widest area among the text input units, for example, a space bar, it is convenient to execute the pointer execution command unit with the left hand while inputting mouse location information with the right hand, for example.

At this time, since the left hand may be operating the mode switching unit, it is preferable that the shortest distance between the mode switching unit and the pointer execution command unit is 8 to 15 centimeters.

* The mode switching unit may be provided separately from the button of the text input unit, and recognizes that a part of the user's body is touched on a part of the human interface body and switches to the text input mode and the pointer location information input mode when touched It can be operated in the pointer location information mode in the case of non-touch and in the text input mode when not in touch.

The pointer execution command unit is composed of two buttons to perform a first function when the first button is pressed, for example, left click of the mouse, and a second function when the second button is pressed, for example, right click of the mouse, However, the first button is a button with the largest area among the text input unit buttons, for example, a space bar button, and the second button is the first button located on the left or right side of the first button. It is convenient to control with your thumb and provides an easy user experience.

When the text input mode or the pointer location information input mode is switched to the text input mode or the pointer location information input mode by the mode switching unit, a display indicating the text input mode or the pointer location information input mode may be displayed.

Displaying the pointer location information input mode is to display the pointer location information input area temporarily from the moment when the touch of the mode switching unit occurs, or display the pointer location information input area from the time when the touch of the mode switching unit occurs to the time when the touch is released, but sound, text, or writing ( lighting) signal.

In this way, there is an advantage in that the user can recognize the current state of the keyboard and can easily know at which position to input the pointer location information in the pointer location information input mode.

The text input area of the text input unit may be designed to be the same as the pointer location information input area of the pointer location information input unit or to include a pointer location information input area of the pointer location information input unit as shown in FIG. 1 .

As an embodiment of configuring the pointer location information input unit, one or two optical emitters and a camera may be used.

The optical signal received by the camera may pass through a light tunnel to block an external noise light source.

The light tunnel may be configured before the optical signal from the optical emitter is emitted to the pointer location information input area, and may be installed in front of the camera that receives the user's input signal from the pointer location information input area.

In this case, a reflector may be disposed to refract the optical signal emitted from the optical emitter or the optical signal received by the camera.

Through the reflector, a degree of freedom is given to the installation position and direction of the pointer location information input unit, so that space utilization and design benefits can be obtained in design.

The pointer location information input unit may be configured such that the pointer location information input area is configured at least 0.1 to 5 millimeters above the text input unit by the optical emitter and the camera.

Through this, pointer location information can be input only when there is a clear intention of the user to touch.

When an infrared laser having a wavelength of 800 to 850 nanometers is used as the optical emitter and designed to be driven at 0.3 to 1 milliwatt, it exhibits excellent characteristics in terms of power consumption, cost, stability, safety, and visual appearance.

The optical emitter may further include a line lens for scattering the optical signal so that the optical signal constitutes a pointer position information input area parallel to the text input unit.

The pointer location information input unit may be designed to block optical external noise by using an optical filter that transmits only optical signals in the infrared region.

When the text input unit is designed to have an interval of 0.1 millimeter to 1 millimeter between the physical buttons, it is possible to provide a sufficiently soft and flat feel to the user while inputting the pointer location information.

7 is an embodiment of displaying a pointer location information input area.

The human interface device of the present invention may be designed to further include pointer location information input area display units 701 and 702 for visually displaying the pointer location information input area in the pointer location information input mode.

The mode switching unit is provided separately from the button of the text input unit, and recognizes that a part of the user's body has been touched on a part of the complex human interface housing and switches to the text input mode and the pointer location information input mode, but when touched, the pointer It can be designed to operate in the location information input mode and to operate in the text input mode when not touched.

In this case, when the part of the body used for the mode change is the right hand (106b), the hand that inputs the pointer location information 108a may be designed to be the left hand.

In this case, it is preferable to design the pointer location information input area to be closer to the opposite edge of the edge where the mode switching unit is located, and the same principle can be applied when using the left hand and the right hand in reverse. (106a, 108b)

On the other hand, it is possible to design that the part of the body used for the mode change is the right hand, and the hand for inputting the pointer location information is also the right hand.

In this case, it is preferable to design the pointer location information input area to be closer to the edge where the mode switching unit is located than to the opposite edge of the edge where the mode switching unit is located, and the left hand can be designed in the same way.

The mode conversion unit may determine the text input mode and the pointer location information input mode according to the number or positions of the user's fingers recognized by the pointer location information input unit.

The number of the recognized user's fingers when determining in the pointer location information input mode is smaller than the recognized number of user's fingers when determining in the text input mode.

For example, while controlling the mode switching unit with the left hand, the finger of the left hand is not touched from the text input button, and the index finger of the right hand may be touched to input the pointer location information. At this time, the recognized user's finger number becomes one.

On the other hand, when the fingers of the left and right hands are touched on the keyboard for text input, 2 to 8 or less of the recognized user's fingers are recognized.

The pointer location information input mode display unit temporarily displays the pointer location information input mode when the mode switching unit switches to the pointer location information input mode, or displays the pointer location information input area from the time the pointer location information input mode is switched to the time it is released. can be displayed visually.

The pointer position information input mode display unit may be displayed by a visible light generator from the text input button or by reflected light by the text input button or through an interval between the text input buttons.

In this case, the input mode may be displayed even in the text input mode, and the text input mode and the pointer location information input mode may be displayed to be distinguished.

The pointer location information input mode display unit is composed of invisible light generators 701a, 701b or dyes coated with dyes emitting visible light in response to optically invisible light 702a and 702b, and the dye is the text. It can be applied to an input button or a space between the text input buttons.

The mode switching unit may further include a hand-side determination unit that determines whether the user inputs the pointer location information with the left hand or the right hand.

The display of the pointer location information input display unit may be changed according to the hand side determination unit.

It is possible to flexibly switch the button arrangement and operation of the pointer execution command unit according to the hand side determination unit.

For example, when the pointer execution command unit includes a right-click and a left-click of the mouse, the buttons for performing the right-click and the left-click may be switched according to the determination of the hand-side determination unit.

The pointer location information input area display unit may display different pointer location information input areas 702a and 702b according to the determination result of the hand side determination unit.

The mode switching unit may be designed to automatically switch to the text input mode when the pointer location information input is not input for a predetermined time from the user in the pointer location information input mode or when an input is received through a text input button.

The pointer location information input area display unit can be applied to the text input button or a part of the text input area with dye to be visually displayed regardless of the mode of the mode switching unit so that the pointer input area can be recognized even in the text input mode. .

8 is a first embodiment of a pointer location information input device that can be separated from a text input device.

The pointer location information input device 810 of the present invention is designed to be separated from the text input device 800 and can be combined with the text input device (801) or separated from the text input device (802).

In this case, the power connector 820 included in the pointer location information input device may receive power from the power source of the text input device 800 .

The pointer location information input device 801 includes at least one pointer location information input device 105a and 105b, and may further include a controller and an optical filter 504 .

The detachable pointer location information input device 810 may be coupled to form a pointing location information input area on a plane parallel to the text input area (801), and is located on the left side (803) or right side (804) of the text input device. It is positioned so that a pointing location information input area can be configured on the bottom surface where the text input device is placed.

In this case, the pointing location information input device and the power connection unit 820 are designed to be flexibly deformed in response to the location change of the pointing location information input device.

9 is a second embodiment of a pointer location information input device that can be separated from a text input device.

The pointer location information input device 900 includes a built-in power supply.

When the pointer location information input device 900 is in the first location information input mode 902, the pointer location information input region The housing can be designed.

When the pointer location information input device 900 is in the second location information input mode 904, input the pointer location information at a certain height and angle so that the pointer location information input area is parallel to the floor on which the pointer location information input device 900 is placed. The housing of the device 900 may be designed.

At this time, preferably, the height of the optical filter 504 in the first position information input mode is higher than the height of the optical filter 504 in the second position information input mode.

When the pointer location information input device 900 is in the third location information input mode 906, the pointer location information input area is perpendicular to the floor surface on which the pointer location information input device 900 is placed. The housing of the input device 900 may be designed.

The pointer location information input device 900 is a location information input mode so that at least two of the first location information input mode, the second location information input mode, and the third location information input mode can be distinguished according to a state of being placed on the floor. It may include a sensor unit.

The location information input mode sensor unit may be composed of a sensor utilizing gravity, a sensor detecting a surface placed on the floor, or a switch.

10 is a third embodiment of a pointer location information input device that can be separated from a text input device.

The pointer location information input device 1000 may have a housing 1001 that surrounds at least two surfaces of the text input device so that the text input device 800 can be mounted thereon.

The pointer location information input device 1000 includes pointer location information input devices 105a and 105b, a mode switching unit 106, a control unit 1001, a housing 1002, and an optical filter 907 (1010).

After the text input device 800 is mounted on the pointer location information input device 1000 (1020) through the optical filter 907 to configure a pointing location information input area parallel to the upper end of the text input device 800 input area The optical filter is positioned higher than the text input device 800 so that the light source can be transmitted.

At least one surface 1003 surrounding the text input device of the housing 1002 is a surface so that the light source emitted from the pointer location information input device 105 can be reflected, transmitted, or absorbed according to the type of the pointer location information input device. Each of the materials of the mirror, transparent glass or plastic, can be treated with a black light absorber.

8, 9, and 10 show the following components as an embodiment of a pointing location information input device that is separable from a text input device.

It has a pointer position information input unit that receives information related to the pointer position from a user.

The pointer location information input unit receives the user's pointing location information input through the pointing location information input area configured by the pointer location information input device.

and a pointer execution command receiving unit that receives a signal from the pointer execution command unit that receives a user's command to perform at least one function at a location where the pointer is located.

The pointer execution command unit may be composed of a button or a touch switch included in the pointer location information input unit, or a control unit that converts to a pointer execution command when a predefined input among user inputs received from a text input device is received.

It has a mode change command receiving unit that receives a signal of the mode change unit to switch to the pointer position information input mode.

The mode switching unit may be configured in a pointing location information input device, a text input device, or a separate device.

It has a power supply unit for transmitting power to the pointer location information input unit, the pointer execution command receiving unit, and the mode switching command receiving unit.

The power supply unit may be a power supply unit having its own battery or a contactor receiving power from the outside.

and a pointer location information transmitter for transmitting information related to the pointer location input through the pointer location information input section to a digital device connected to the human interface device by wire or wirelessly.

The pointer location information input area of the pointer location information input unit has a predetermined height and angle so that the pointer location information input area can be positioned parallel to an upper end of at least a portion of the text input area of the text input device including a plurality of physical buttons. is set

When the mode switching unit is provided separately from the text input button of the text input device, it can be fixed to at least one side of the text input device, and the mode switching unit recognizes that a user input has been received, indicating that the pointer location information input mode is It can be transmitted by wire or wirelessly to the mode change command receiving unit.

The pointer location information input unit includes an optical emitter and a camera, and an optical signal received by the camera may be designed to pass through a light tunnel through an optical filter.

It may have a position state recognition unit for recognizing position state information about the direction of gravity of the human interface, position state information about a floor on which the human interface is placed, or position state information of the human interface through a user input.

The position state consists of at least two types, and in the case of the first position state, it is switched to the first pointer position information input mode, and in the case of the second position state, it is switched to the second pointer position information input mode.

In the first position state, the pointer location information input area is positioned parallel to at least a portion of the text input area of the text input device.

The pointer location information input area in the second location state is positioned parallel to the floor on which the pointing location information input device is placed.

In the first pointer location information input mode, the upper surface of the pointing location information input device is positioned so as to be on the floor, and when switching to the second pointer location information input mode, the calculation of the ordinate of the pointing location information input is the same, but the calculation of the abscissa is increased or decreased. change direction and count.

The pointer execution command unit may use a space bar among text input buttons of the text input device, and may additionally use another button adjacent to the space bar as a pointer execution command unit.

The power unit may receive power from the text input device.

The predefined height and angle of the pointer position input area in the first position state may be defined by an adjuster enabling adjustment within a predefined range by a user.

The adjuster may adjust the angle by adjusting the joint angle of at least one surface of the housing of the pointing location information input device with the adjacent surface.

The adjuster may adjust the height by adjusting the height of at least one surface of the housing of the pointing location information input device.

The adjuster may adjust the predefined height and angle by adjusting the height and angle of the optical module of the pointing position information input unit of the pointing position information input device.

11 is a front view of a human interface device to which a lower location type pointer location information input device is applied.

The human interface device includes a text input unit composed of a plurality of physical buttons, a pointer position information input unit for receiving information related to a pointer position from a user, and a pointer execution command for receiving a user command to perform at least one function at a location where the pointer is located. Power is supplied to the pointer execution command receiving unit for receiving a negative signal, a mode switching command receiving unit for receiving a signal from the mode switching unit for switching to the pointer position information input mode, the pointer position information input unit, the pointer execution command receiving unit, and the mode switching command receiving unit A power supply unit that transmits, a pointer position information transmitter that transmits information related to a pointer position input through the pointer position information input unit to a digital device connected to the human interface device by wire or wirelessly, and a pointer position information input area of the pointer position information input unit The text input unit composed of the plurality of physical buttons is positioned parallel to an upper end of at least a portion of a text input area (321), and the pointer location information input unit is composed of at least two sensor modules, and the at least two sensor modules are the human It is characterized in that it is located in the lower left (1102) and right (1103) of the interface device.

The pointer location information input unit is composed of an optical emitter and a camera, and the optical signal received by the camera passes through a light tunnel.

The mode switching unit may be provided separately from the text input button of the text input device.

The mode switching unit is located on the left side of the text input area of the text input device, and the mode switching unit recognizes that a user input is received and transmits the pointer location information input mode to the mode switching command receiving unit.

The physical button is characterized in that it is composed of an upper part of the button that receives pressure from the user's finger and an elastic body that applies a physical force so that the upper part of the button returns to its original position when the user's finger pressure is removed.

The complex human interface device includes a reflector or an absorber 1101 that reflects the light source generated from the pointer location information input unit on the left, right, and upper sides of the text input area, and at least a part of the lower portion is not provided. do it with

The reflector is used when the light source generated from the pointer location information input unit is infrared, and an absorber is used when the light source is an infrared laser.

The at least two sensor modules (1102, 1103) of the pointer location information input unit are positioned to include at least a portion at the lower end of the left outer area and the right outer area of the text input area. That is, the left sensor includes at least a part on the left side of the control button of the standard window keyboard, and is characterized in that it is lower than the control button, that is, further down toward the corner of the housing where there is no key button. Accordingly, the sensor module enables the configuration of a complex human interface device with a minimum volume to maximize the aesthetic effect of the complex human interface.

In addition, by positioning the sensor near the vertex of the text input area ( 1110 ), directing the sensor in the diagonal direction of the text input area is better than placing the sensor in the corner area and oriented in the horizontal and vertical directions of the text input area. A pointer location information input area having a wider area can be configured. In addition, it is possible to maximize the pointer location information input area at the top of the text input area as a whole by moving the position of the portion having a relatively low location information detection accuracy of the pointer location information input area between the sensor and the sensor.

In addition, the position of the sensor may be located at the lower end of the space bar of the standard keyboard and narrower than the width of the keyboard ( 1120 ). The width between the sensor and the sensor determines the width of the pointer location information input area, and thus the area of the pointer location information input area is reduced compared to the location 1110 at the corner, but a relatively high pointer location information detex resolution is obtained.

Between the sensor and the sensor, the reflector or absorber of the light source is eliminated and the height of the housing is lowered to prevent the thumb from being caught by the housing when pressing the space bar of a standard keyboard with the thumb.

12 is an embodiment of a pointer execution command unit integrated mode switching unit.

When performing an input operation in which frequent switching between the text input mode and the pointer location information input mode is performed, the number of mode switching and pointer execution commands is increased.

For example, in the case of a right-handed person, when you want to input pointer location information while text input is in the text input mode, you must switch the mode with your left or right hand, input the pointer location information, and then use your left hand to enter the pointer location information. do.

In general, during fast work, the user inputs text and pointer location information and pointer execution commands while keeping their eyes on the monitor. It can be cumbersome to perform functions properly because it cannot find the exact location, or to look at the keyboard with your eyes.

To solve this, for example, in the case of a right-handed person, if a user puts his or her hand on the mode switching unit with the left hand after inputting text in the text input mode, a mode switching command is generated and the mode switching mode is changed to the pointer input mode. In addition, if the pointer position information is input with the right hand while the hand is placed on the mode conversion unit and pressure is applied to the mode conversion unit, the pointer execution command unit may receive the user's input.

Accordingly, the user can share the position of the mode change unit for mode conversion and the position of the pointer execution command unit for the pointer execution command.

In one embodiment for this, the mode switching unit is composed of a touch switch capable of accepting a touch input of a user's hand, and the pointer execution command unit is composed of a switch that responds to pressure, such as a tekt switch, and is located under the mode changing unit.

At this time, the first pointer execution command unit 1104 and the second pointer execution command unit 1105 are connected to each other with a conductive material capable of recognizing a touch from the user's hand or are commonly connected to the mode conversion unit 1201. Thus, whether the user touches the first pointer execution command unit or the second pointer execution command unit is configured to perform the same mode conversion.

*At this time, the mode conversion operates in the pointer location information input mode while the touch is being made, and operates in the text input mode when the touch is released.

In addition to touch, mode switching by touch can be configured with another switch that operates with a pressure smaller than the pressure for a pointer execution command or a sensor capable of sensing the position of a user's finger.

In this case, the mode change and pointer execution command unit may be located in an area distinct from the text input area.

Preferably, in the case of a right-handed person, it is located in the left outer area of the text input area.

If the mode switching unit and the pointer execution command unit are positioned outside the text input area, the possibility of the pointer location information input unit being confused with the pointer location information input disappears and the pointer location information input area can be expanded.

The complex human interface device of the present invention may include a second mode switching unit 1202 . The second mode switching unit is a switch that operates like a toggle switch, and is converted into a text input mode and a pointer location information input mode whenever an input is received from the user. Accordingly, even if the user is not touching the mode switching unit with his left hand, it is possible to input pointer location information with only his right hand.

At this time, when a mode change command by touch is received when the complex human interface apparatus is in text mode by the second mode conversion unit, the complex human interface apparatus of the present invention operates in the pointer location information input mode. In addition, when a mode switching command by touch is received when the complex human interface device by the second mode switching unit is in the pointer location information input mode, the pointer location information input mode is maintained, but the mode switching command by touch is canceled or When a text input is received through the text input unit, the text input mode is changed.

In this case, when the text input mode is switched to the text input mode by the text input, at least the first text input may be ignored, and when at least two or more text inputs are received, the text input mode may be switched.

At this time, when at least two text inputs are received and the text input mode is switched to the text input mode, the complex human interface device transmits the text input including the ignored first text to the digital device and then transmits the newly input text input information to the digital device. send to

13 is an embodiment using a cover of a complex human interface device.

The complex human interface device requires a space of at least 1 millimeter to 2 millimeters above the plane of the text input device comprising a physical device for the pointer location information input device to form a pointer location information input area, and an absorber for absorbing or reflecting an optical signal. Alternatively, a border for locating the reflector may be required at the corners of at least three sides surrounding the text input area.

In this case, a difference of at least 1 to 2 millimeters occurs between the height of the edge of the corners of at least three surfaces and the height of the text input area plane, and a substantially rectangular-shaped space is formed at the top of the text input area.

The complex human interface device of the present invention may further include a multipurpose cover 1322 for protecting the text input area from external impact in the substantially rectangular parallelepiped space ( 1310 ).

The multi-purpose cover 1322 is separated from the complex human interface device (1320) and can be combined and separated by a magnet or a physical structure.

The multi-purpose cover 1322 may have a structure that is folded over several times. Preferably, the width of at least one region of the divided region of the multi-purpose cover with a double-folding structure may be smaller than the width of the other region (1341).

This can further reduce the inclination of the complex human interface device when the multipurpose cover is mounted at the bottom to adjust the inclination of the complex human interface device after being folded.

When the multipurpose cover is folded and mounted on the bottom surface of the complex human interface device, a portion of the folded surface that comes into contact with the ground may include an inclined surface 1342 so that the contact area with the ground can be increased.

The inclination of the complex human interface device desired by the user may be adjusted by the number of folds of the multi-purpose cover 1322 .

The multi-purpose cover may have a rechargeable battery 1323 inside the cover.

The electrode of the power source of the rechargeable battery 1323 may be located at the lower end of the multi-purpose cover, and may be located in a portion of the area protruding from the portion covering the text input area (1331), and the multi-purpose cover covers the text input device. If there is ( 1310 ), it is connected to the electrode provided on the upper end of the complex human interface device.

In addition, when the multi-purpose cover is folded and mounted on the lower end to adjust the inclination of the complex human interface device, it may be connected to the electrode provided on the bottom of the complex human interface device.

The complex human interface device may be connected to an external power source to supply power to the rechargeable battery 1323 inside the multi-purpose cover or to separately charge the multi-purpose cover.

At this time, the bottom of the complex human interface device has a magnet or a physical coupling device or a magnetic or physical coupling device or A groove into which the cover is inserted may be provided.

The edge of the multi-purpose cover is coated with a material that can remove fine dust, oil, moisture, etc., so whenever it is attached to or detached from the complex human interface device, it is possible to remove foreign substances from the absorber, reflector, optical emitter, and front of the camera. there is.

When the multi-purpose cover covers the text input area, it is detected and the power of the complex human interface device can be turned off.

When the multi-purpose cover is mounted on the bottom of the complex human interface device, the power of the complex human interface device can be turned on.

In addition, if there is no user input for a certain period of time after the power is turned on, the power may be cut off or converted to a standby mode.

When the multi-purpose cover covers the text input area (1310), the complex human interface device 1321 has a substantially thin plate-shaped rectangular parallelepiped shape and does not have an inclination when placed on the ground or when the multi-purpose cover is mounted on the lower side By designing it to be smaller, the aesthetic effect can be maximized and portability can be increased.

On the other hand, if the multipurpose cover is folded and installed under the complex human interface device, it can be tilted like a general keyboard.

The multi-purpose cover may be configured in a detachable manner, but it may be designed in a way that it folds down from the top to the bottom of the complex human interface device by a hinge.

14 is an embodiment of a human interface device applied to a portable electronic device or a portable electronic device such as a tablet personal computer.

The complex human interface device 1420 of the present invention can be used as an input device of a portable electronic device.

In a portable electronic device having a complex human interface device of the present invention, a display unit including a display panel 1411 and a frame 1410 supporting the display panel is bound to the complex human interface device of the present invention by a hinge 1427 It can be designed to be covered and opened.

At this time, the display unit is inserted into the substantially hexahedral space formed by the text input area and the reflector or absorber 1424 of the human interface device of the present invention. Then, the thickness of the portable electronic device using the human interface device of the present invention can be minimized.

To this end, the display unit of the portable electronic device should be designed to have a width smaller than the width of the human interface device 1420 of the present invention by at least twice the thickness of the reflector or absorber plates 1423 and 1424 .

In other words, it should be designed so that the display unit can enter the place where the multipurpose cover is inserted in FIG. 13 .

The display unit has a feature 1413 that allows both corners to be rounded or cut diagonally.

The pointer location information input devices 1421 and 1422 are characterized in that when the display unit is folded, it is positioned toward the outer edge of the rounded or diagonally cut portion.

This is to fold the portable electronic device to maintain a thin thickness without being disturbed by the pointer location information input devices 1421 and 1422 when the portable electronic device is folded.

At this time, the mode switching unit and the pointer execution command unit are located outside the text input area on the side of the human interface device as described above, or the mode switching unit is located on the outside of the text input area, and the pointer execution command unit is at least one of text input buttons or mode switching Both the part and the pointer command execution unit may operate as at least one of the text input buttons.

In addition, more preferably, it can be positioned outside and below the text input area (1425, 1426).

At this time, it is preferable that the mode switching unit and the pointer execution command unit are integrally configured as shown in FIG. 12, but it is also possible to separate them.

At this time, when the mode switching unit or the pointer execution command unit is located at the lower outside of the text input area, when the user places a finger to control the mode switching unit or the pointer execution command unit, the pointer location information input devices 1421 and 1422 The pointer location information input area should be set except for the area in which the mode switching unit or the pointer execution command unit is located so that the user does not malfunction when the user inputs the pointer location information.

To this end, it is possible to adjust the area covered by the optical signal generated from the pointer location information input device to prevent the optical signal from reaching the mode switching unit or the pointer execution command unit.

Or adjust the optical signal reception angle of the camera to prevent the camera from receiving the optical signal generated by reflection, interference, or blocking between the user's finger and the optical signal located in the mode conversion unit or the pointer execution command unit, or Optical signals can be ignored.

The portable electronic device is designed to have an absorption plate or a reflection plate for absorbing or reflecting the light source generated by the pointer location information input device at at least three corner portions.

At this time, two surfaces are located on the side of the human interface device (1423, 1424), and the other surface is on the surface where the display unit is in contact with the human interface device. , 1422 may be positioned in a certain area 1412 of the edge of the display unit so that the light source generated by the reflector or absorber is sufficiently reflected or absorbed.

In FIG. 14 , the display unit may be configured as a flexible display unit, may cover the text input area of the complex human interface device, be bent, and be wound around the bottom surface of the complex human interface device to be fixed.

In addition, in FIG. 14 , the display unit may be replaced with the multipurpose cover described in FIG. 13 , and an absorber or reflector may be positioned at the edge portion joined to the complex human interface device of the multipurpose cover, and the multipurpose cover may be tilted to the back by a hinge It can also be used for adjusting the height of the interface device.

1 to 14 illustrate an example of a complex human interface device to be described in the present invention, and the types of text input device pointing location information input device and technology used can be changed or replaced by those skilled in the art without changing the basic purpose include that

Claims (19)

A complex human interface device comprising:
a plurality of buttons;
a plurality of switches for sensing vertical movement of the plurality of buttons, each of the plurality of switches respectively corresponding to each of the plurality of buttons;
a touch sensor for sensing a touch input to the upper surfaces of the plurality of buttons;
a communication unit capable of communicating with a digital device; and
When operating in the first mode, key input values are generated based on signals received according to operations of the plurality of switches, and when operating in the second mode, pointer position information is generated according to the sensing value of the touch sensor, a control unit for transmitting the generated key input values or the pointer location information to the digital device through the communication unit;
The control unit is
generating a pointer execution command when detecting a specific gesture in the second mode, and transmitting the generated pointer execution command to the digital device;
Complex Human Interface Device.
According to claim 1,
The specific gesture includes a touch input for a specific button,
Complex Human Interface Device.
According to claim 1,
The specific gesture includes pressing a specific button,
Complex Human Interface Device.
According to claim 1,
The plurality of buttons includes a first button corresponding to a first switch,
The control unit operates in the first mode when receiving a signal according to the operation of the first switch in the second mode,
Complex Human Interface Device.
According to claim 1,
The plurality of buttons includes a first button corresponding to a first switch and a second button corresponding to a second switch,
The control unit is
generating a first pointer execution command when detecting a first gesture with respect to the first button in the second mode, and generating a second pointer execution command when detecting a second gesture with respect to the second button;
Complex Human Interface Device.
According to claim 1,
When the control unit detects the specific gesture in the first mode, it operates in the second mode,
Complex Human Interface Device.
According to claim 1,
Further comprising a display unit for providing a notification,
The display unit provides a visual notification when the specific gesture is detected in at least some of the plurality of physical buttons,
Complex Human Interface Device.
According to claim 1,
The digital device receives the pointer execution command and performs a specific function at the location of the pointer displayed on the digital device,
The specific function is a left-click function of a computer mouse or a right-click function of a computer mouse.
Complex Human Interface Device.
A complex human interface device comprising:
a plurality of buttons;
a plurality of switches for sensing vertical movement of the plurality of buttons, each of the plurality of switches respectively corresponding to each of the plurality of buttons;
a touch sensor for sensing a touch input to the upper surfaces of the plurality of buttons;
a communication unit capable of communicating with a digital device; and
When operating in the first mode, key input values are generated based on signals received according to operations of the plurality of switches, and when operating in the second mode, pointer position information is generated according to the sensing value of the touch sensor, a control unit for transmitting the generated key input values or the pointer location information to the digital device through the communication unit;
The plurality of buttons includes a first button corresponding to a first switch,
The control unit is
generating a first key input value based on a first signal received according to an operation of the first switch in the first mode;
Further generating a first pointer execution command based on the first signal received according to the operation of the first switch in the second mode,
Complex Human Interface Device.
10. The method of claim 9,
When the control unit detects a specific gesture for the first button in the first mode, it operates in the second mode,
Complex Human Interface Device.
10. The method of claim 9,
The plurality of buttons includes a second button corresponding to a second switch,
The control unit is
generating a second key input value based on a second signal received according to an operation of the second switch in the first mode;
Further generating a second pointer execution command based on the second signal received according to the operation of the second switch in the second mode,
Complex Human Interface Device.
12. The method of claim 11,
The digital device is
receiving the first pointer execution command and performing a first function at the location of the pointer displayed on the digital device;
receiving the second pointer execution command and performing a second function different from the first function at the position of the pointer displayed on the digital device;
Complex Human Interface Device.
13. The method of claim 12,
wherein the first function is a left-click function of a computer mouse, and the second function is a right-click function of a computer mouse;
Complex Human Interface Device. 10. The method of claim 9,
Overlapping some of the plurality of buttons, including a pointing location information input area provided by the touch sensor,
Complex Human Interface Device.
15. The method of claim 14,
The first button is disposed in the pointing location information input area,
Complex Human Interface Device.
15. The method of claim 14,
The first button is disposed outside the pointing location information input area,
Complex Human Interface Device.
A digital device equipped with a complex human interface device, comprising:
a plurality of buttons;
a plurality of switches for sensing vertical movement of the plurality of buttons, each of the plurality of switches respectively corresponding to each of the plurality of buttons;
a touch sensor for sensing a touch input to the upper surfaces of the plurality of buttons;
When operating in the first mode, key input values are generated based on signals received according to operations of the plurality of switches, and when operating in the second mode, pointer position information is generated according to the sensing value of the touch sensor. 1 control unit; and
The plurality of buttons includes a first button corresponding to a first switch,
The first control unit,
generating a first key input value based on a first signal received according to an operation of the first switch in the first mode;
Further generating a first pointer execution command based on the first signal received according to the operation of the first switch in the second mode,
A digital device equipped with a complex human interface device.
18. The method of claim 17,
display unit; and
A second control unit that displays text on the display unit using the generated key input value and moves the pointer displayed on the display unit using the pointer location information; further comprising:
A digital device equipped with a complex human interface device.
19. The method of claim 18,
wherein the first control unit communicates by wire with the second control unit and transmits the generated key input value or the pointer position information to the second control unit;
A digital device equipped with a complex human interface device.

Images