KR20200019637A - Multi human interface device having text input unit and pointer location information input unit - Google Patents

Abstract

The present invention relates to a composite human interface device including a text input device and a pointer position information input device, which is capable of increasing working efficiency. According to the present invention, the human interface device executes the steps of: receiving a first gesture from a user through a text input region; generating information related to a first text in accordance with the first gesture; transmitting first text information to a digital device connected to the human interface device through a wire or wirelessly; receiving a second gesture from the user; switching the human interface device into a pointing position information input mode in accordance with the second gesture; receiving a third gesture from the user through the pointing position information input region; generating information related to pointer position information in accordance with the third gesture; transmitting the generated information related to the pointer position information to the digital device connected to the human interface device through a wire or wirelessly; receiving a fourth gesture from the user; and switching the human interface device into the text input mode in accordance with the fourth gesture. The text input region and the pointing position information input region have at least one portion in common.

Description

MULTI HUMAN INTERFACE DEVICE HAVING TEXT INPUT UNIT AND POINTER LOCATION INFORMATION INPUT UNIT}

The present invention relates to a human interface for receiving text information or pointing location information from a user on a digital device capable of receiving text or pointing location-related information such as a computer, a laptop, a tablet PC, a mobile phone, and transmitting the same to the digital device.

Text input devices such as keyboards for text input in personal computers and portable digital devices have been disclosed. In addition, pointing devices such as a mouse device for controlling a pointing position of a pointer for controlling the digital device and performing a function have been disclosed.

Conventionally, the text input device and the pointing device are provided as separate devices or have a pointing input area configured at a separate location separate from the text input area of the text input device. As a result, the user's hand is moved more than necessary in a work environment in which text input, pointing location information input and pointer execution command input are frequently switched, thereby reducing work efficiency.

According to the present invention, a pointing position information input area of the pointing device is provided on the top of the text input area plane of the text input device, and a switching unit for switching the text input mode and the pointing position information input mode is used to easily change the input mode during text input. This improves work efficiency by enabling pointing input with minimal user hand movement.

By integrating the text input device and the pointing device provided separately in one human interface device, the unit cost and size of the product can be reduced, and work efficiency can be improved by eliminating unnecessary operations of the user's operation.

1 is an exemplary diagram of a complex human interface device having a pointing device and a text input device.
2 is a flowchart illustrating an example of an operation procedure according to mode switching between a pointing device and a text device.
3 illustrates embodiments of a text input device and a pointing device.
4 illustrates exemplary embodiments of a pointer execution command unit integrated mode switching unit.
5 illustrates embodiments of a structure of a pointer location information input device.
6 is a configuration diagram of an infrared laser sensor module.
7 is a diagram illustrating an example of displaying a pointer location information input area.
8 is a first embodiment of a pointer location information input device that can be separated from a text input device.
9 is a second embodiment of a pointer location information input device that can be separated from a text input device.
FIG. 10 is a third embodiment of a pointer location information input device that can be separated from a text input device.
FIG. 11 is a front view and a perspective view of a human interface device to which a bottom positional pointer location information input device is applied.
12 is an embodiment of a pointer execution command unit integrated mode switching unit.
FIG. 13 illustrates an embodiment using a cover of a human interface device to which a lower position pointer type location information input device is applied.
14 is an embodiment of a human interface device applied to a portable electronic device.

The present invention relates to a complex human interface for receiving text information or pointing location information from a user on a digital device capable of receiving text or pointing location related information such as a computer, a laptop, a tablet PC, a mobile phone, and transmitting the same to the digital device.

As a conventional text information input device, a keyboard composed of a plurality of physical buttons connected to an elastic body and a switch is widely used.

In addition, in a digital device having a touch interface, a virtual keyboard is displayed on a display, and when a part of the user's body is touched by the virtual keyboard displayed on the display, a user's gesture or electrical signal is sensed. The method of inputting text on the virtual keyboard displayed in the portion is also used.

The touch interface recognizes movement of a part of the user's body, recognizes that the user has touched a specific contact surface, detects the flow of current through the user's body, or blocks light or sound waves from being blocked or interfered with by a part of the user's body. The user's touch can be recognized by sensing.

Examples of the touch interface include a pressure sensitive touch screen, a capacitive touch screen, an optical touch screen, and an ultrasonic touch screen.

The resistive touch screen or the pressure sensitive touch screen is a touch screen that operates by sensing pressure.

Resistive touch screens are inexpensive and can be written in small spaces with a stylus pen, but because they use pressure, they are hard to recognize when pressed harder, and they are slightly less dull than the capacitive touch method. It is known to be a disadvantage.

Resistive touchscreens consist of multiple layers.

Among these several layers is the conductive layer, which has two layers facing the air layer.

When the outer screen is pressed, the two conductive layers come into contact with each other, which causes a change in resistance and current to recognize the touch.

Capacitive sensing or capacitive touch is a method of sensing an operation using a capacitive coupling effect.

Capacitive touchscreens are made of highly conductive glass called indium tin oxide, unlike pressure-sensitive touchscreens.

Sensors are attached to the four corners of the glass so that a current flows through the glass surface.

It is the principle of the electrostatic that recognizes the change of current through this.

At this point, when the finger touches the screen, the electrons that flowed on the glass flow into the body through the finger, and the sensor detects the position where the change occurred.

The capacitive touch method is known to have a smooth feeling of operation and scrolling compared to a pressure sensitive touch screen because the capacitive touch method is recognized by simply touching the screen instead of pressing it with force.

In addition, the capacitive touch method is multi-touch capable of touching several places.

Since the capacitive touch method is operated by using a change amount of current, the capacitive touch method may be worn with a non-current leather glove or may not be operated with a fingernail or a stylus pen.

However, if you use a separate capacitive stylus pen, you can touch the screen.

The sensor is sensitive and may be affected by peripherals.

Optical touchscreens work by using infrared cameras mounted at the vertices of the touchscreen and infrared light to measure coordinates with the shadows of the objects that will touch the screen.

The ultrasonic touch screen operates by measuring coordinates by detecting an interference effect of a user's touch by emitting ultrasonic waves on the screen.

In addition, various touch input technologies may be used in the present invention, which may be used to control the location information of the pointer by recognizing the location information of a part of the user's body by sensing the contact or movement of the user.

1 is an exemplary diagram of a complex human interface device having a pointing device and a text input device.

The pointing device integrated text input device may have a housing 100 for supporting the text input device and the pointer location information input area.

The housing has a strength that can withstand the pressure of the user input, and receives the text input information and the pointer position information input information and transmits the information to a digital device connected to the pointing device integrated text input device by wire or wirelessly. The controller may include a memory unit, a battery unit, an encoding unit, a transmitter, and the like.

The pointing device integrated text input device may include a plurality of buttons 109 for receiving text input information from a user.

The plurality of buttons 109 may be configured as physical buttons or virtual buttons.

The physical button may be composed of a button that is connected to the elastic body or the button itself is elastic, it may be characterized by moving to a position when receiving the user's input and returning to its original position when the user's pressure is removed.

The physical button is connected to an electrical switch, the user's pressure is applied to move the position of the button can be configured to have a structure in which the phase of the switch is changed to generate a text input value of the button.

The physical button has an elastic structure without an electrical switch to move the position under the pressure of the user and return to its original position when the pressure of the user is removed, and the user's text input information is controlled by the touch input device. The text input information may be generated based on the location information on which the user's pressure or gesture is recognized.

The virtual button may be configured by displaying a text input button on a display device.

The virtual button may display an arbitrary button by projecting light onto a transparent, translucent, or opaque object.

The virtual button may generate the corresponding text input information based on the user's pressure or gesture information with the unique location information for each text without being recognized by the user's eyes.

The complex human interface device may have a pointing location information input area 108a, 108b having at least a portion of the text input area 107 as a common area.

The pointing location information input areas 108a and 108b are areas located at the top or bottom or bottom of the button for text input. As shown in FIG. 1, the pointing location information input areas may have at least a part of the text input area in common. have.

The pointing location information input area may include the text input area or the text input area may include a pointy location information input area.

The pointing location information input area and the text input area are at least partially in common, and at least some of them are used as the pointing location information input area but are not used as the text input area and at least some are used as the text input area. May not be used.

The complex human interface device includes a pointer location information input device 105 for text input or for pointing location information input or for forming a virtual text input area or a virtual pointing location information input area for text input and pointing location information input. It may be configured on the composite human interface device or external to the composite human interface device.

The pointer location information input device 105 is composed of a device such as an infrared generator and an infrared receiver or an RGB camera or an ultrasonic generator and an ultrasonic receiver or an infrared generator and an infrared camera, and the surface or the housing 100 of the housing 100. A part of the user's body may be sensed in the air to receive location information and gesture information.

The pointer location information input device may be modularized and configured as a plurality of modules to expand the pointer location information input area or to improve accuracy and sensitivity.

For example, it may have a pointer location information input device 105b for configuring a text input or pointing location information input area 108b of the right hand.

Alternatively, the device may have a pointer location information input device 105a for configuring a text input or pointing location information input area 108a of the left hand.

The text input area or the pointing location information input area 108b for the right hand may include an area of the J button of the English standard keyboard.

The text input area or the pointing position information input area 108a for the left hand may include an area of the F button of the English standard keyboard.

The pointer location information input device may include both the J and F buttons of the English standard keyboard when there is no division for the left hand and the right hand.

The pointing location information input area may be a pointer position movement on the plurality of display parts when the complex human interface device is connected to a plurality of digital devices having a display part.

For example, the pointer location information input area may be divided to match each display unit, or a separate button indicating a display unit may be operated to transmit pointer position information from the corresponding display unit, or a plurality of display units may be virtually single. The pointer position information may be transmitted to recognize the display unit and to move the pointer on the virtual single display unit.

The composite human interface device includes a pointing location information input device that configures a pointing input area and receives pointer location information from a user, and inputs a button or an image, a space, an icon, or a text where a pointer moved by the pointing location information input device is located. It may have a pointer execution command unit (101, 102) for executing at least one function on the window.

The pointer execution command unit may be composed of one or two buttons, respectively, and may serve as a first function and a second function, and may be located at the left side, the post, or the center of the housing.

The first function may, for example, function as a left click of a computer mouse and the second function may, for example, function as a right click of a computer mouse.

The pointer execution command unit consisting of the one or two buttons may be provided on both the left side and the post of the housing.

The pointer execution command unit may be configured to be operated by recognizing a touch or light blocking of the user's body part or interference of ultrasonic waves or a shadow of the user's body part using the above-described touch technology.

The pointer execution command unit may be configured of an elastic physical button.

The pointer execution command unit may operate by using at least one button of the text button located in the text input area in addition to the pointing position information input area.

The pointer execution command unit may operate by selecting a physical or virtual text button on a pointing location information input area.

For example, when using a virtual input device that can input location information in space as a pointing location information input device and using a physical button as a text input device, the position of the pointer on the virtual pointing location information input area in the pointing location information input mode. You can issue a pointer execution command by entering information and pressing the physical text button at that location.

The pointer execution command unit may receive pointer position information by a user first gesture in a pointing position information input area and generate a pointer execution command by a user second gesture at the same position.

The pointer execution command unit may be configured to execute the first function by a first gesture or a first voice of the user's body, a first blink, a first mouth shape, or the like.

The pointer execution command unit may be configured to execute a second function by a second gesture or a second voice of the user's body, a second blink, a second mouth shape, or the like.

The complex human interface device may include a text input mode for receiving text information through the text input device and a pointing location information input mode for receiving pointing location information through the pointing location information input device.

The text input mode and the pointing position information input mode may be switched by the mode switching unit 103.

The mode switching unit 103 may be configured as a switch located separately on the housing.

The mode switching unit 103 may perform mode switching by sensing that at least one text input button or a plurality of text inputs included in the text input device are simultaneously received.

The mode switching unit 103 may switch the mode by receiving control information from a digital device connected to the composite human interface device by wire or wirelessly.

The mode switching unit 103 may be integrally formed with the pointer execution command unit 102.

For example, by a first gesture such as contacting a part of the user's body on a first button that first reacts to a first touch or first pressure and second response to a second touch or second pressure. It may be configured to generate a pointer execution command in response to the second touch or the second pressure by a second gesture such as sensing a touch or the first pressure to switch modes and pressing a button.

The mode switching unit 103 may be configured of a temporary mode switching mode and a permanent mode switching mode.

For example, in response to the first touch or the first pressure, switching from the text input mode to the pointing position information input mode and returning to the text input mode when the first touch or the first pressure is removed may be set as the temporary switching mode. have.

Alternatively, the switching from the pointing position information input mode to the text input mode in response to the first touch or the first pressure and returning to the pointing position information input mode when the first touch or the first pressure is removed may be set as a temporary switching mode. .

Switch from text input mode to pointing position information input mode in response to the second touch or second pressure or toggle switch and configure the permanent switching mode to maintain the pointing position information input mode even when the second touch or second pressure is removed. Can be.

Temporary mode switching may be performed by first control information received from a digital device connected to the composite human interface device by wire or wirelessly.

Permanent mode switching may be performed by the second control information received from the digital device connected to the composite human interface device by wire or wirelessly.

The mode switching unit 103 may be integrated with the pointer execution command unit.

For example, when the first touch or the first pressure is detected on the pointer execution command unit, the temporary mode is switched from the text input mode to the pointer position information input mode, and when the second touch or the second pressure is detected, the pointer execution command is executed. When the third touch or the third pressure is generated, the touch switch may be set to the permanent switching mode to operate in the pointer position information input mode even when the third touch or the third pressure is removed.

At this time, the pointer execution command input can be configured even during the permanent switching mode.

The mode switching unit may be configured on the left or right side of the housing (106a, 106b)

The mode switching units 106a and 106b configured on the left side or the right side or the left side and the right side of the housing may be configured as virtual buttons or physical buttons to sense and operate a user's touch input or pressure.

The mode switching units 106a and 106b configured on the left side or the right side or the left side and the right side of the housing may be configured to have an input area of 3 centimeters or more and less than 15 centimeters along the side of the housing.

When the length of the mode switch is less than 5 centimeters, it is preferable to set the position of the mode switch to include the left space of the left tab key of the window standard keyboard.

The composite human interface device may have a transmitter 104 for transmitting data by wire or wirelessly to a digital device including an external or composite human interface device.

The digital device may receive a text input or receive pointer location information.

2 is a flowchart illustrating an example of an operation procedure according to mode switching between a pointing device and a text device.

The composite human interface device may have a separate power supply unit or may receive power from the outside in a wired or wireless manner and may have a separate switch for controlling the power supply unit.

When power is supplied to the composite human interface device by the switch controlling the power supply unit, it may be determined whether the composite human interface device is currently in the text input mode or the pointing location information input mode (200).

As a result of the determination, in the text input mode, the text input device may be activated and a text input may be received from the user (201).

The input text input of the user may be transmitted to a digital device connected by wire or wirelessly (202).

When a mode change occurs to the pointing position information input mode during the text input mode, the text input mode may be switched to the pointing position information input mode.

Alternatively, it may be configured to input pointing position information simultaneously with text input.

When the mode is switched to the pointing location information input mode, the pointing location information may be received by the user's input (204).

The input pointer position information may be transmitted to a digital device connected by wire or wirelessly (205).

When the composite human interface device receives the pointer first execution command 206, the composite human interface device may transmit the pointer first execution command to a digital device that is connected by wire or wirelessly (207).

When the composite human interface device receives the pointer second execution command 208, the composite human interface device may transmit the pointer first execution command to a digital device that is connected by wire or wirelessly (209).

When the temporary mode switch is released or the permanent mode switch is released, the composite human interface device may switch to the text input mode.

The power switch of the power supply unit may be terminated when the power supply of the complex human interface device is disconnected or there is no connected digital device, or when the connection is lost, or when there is no user input for a predetermined time or by control of a digital device connected by wire or wirelessly.

3 illustrates embodiments of a text input device and a pointing device.

The complex human interface device may include a first housing 301 including a power supply unit, a controller, or a communication unit, and a second housing 302 for configuring a text input area and a pointing location information input area.

The composite human interface device may have a text input device and a text input area 303 that receive text input from a user.

In this case, the text input area 303 may be configured as a virtual button or a physical button.

The pointing location information input device may be configured in a pressure sensitive or capacitive touch pad type and positioned on a physical button of the text input device (304).

In this case, when the text input device is configured in the form of a physical touch pad such as a pressure sensitive or capacitive touch panel, the touch pad may be used as the text input device and the pointing location information input device, and the mode switch may be used to switch modes.

In this case, a physical touch pad such as a pressure sensitive or capacitive touch panel may be configured as a large-area touch pad-type complex human interface device 300 including a touch pad 304 including a plurality of text button regions of a text input unit.

Alternatively, a physical touch pad such as a pressure sensitive or capacitive touch panel may be configured as a plurality of touch pad type human interface devices 310 including a plurality of touch pads 311 including one text button area of the text input unit.

Alternatively, the upper camera type human interface device 320 constituting the pointer location information input area 321 by an infrared camera or an RGB camera 222 positioned at an upper end of the pointing location information input area. It can be configured as.

In this case, the upper camera type complex human interface device 320 may configure the virtual text input button 303 using the upper camera.

The camera may be configured as a bottom camera 332 type complex human interface device 330 configured to be positioned at the bottom of the second housing to form a pointing position information input area 331.

In this case, the lower camera type complex human interface device 330 may configure a virtual text input button 303 to replace the physical text button using the lower camera.

Or a virtual pointing location information input area composed of a pair of infrared receivers or ultrasound receivers for receiving information from which infrared or ultrasonic waves transmitted by an infrared transmitter or an ultrasonic transmitter are blocked or interfered with by a part of the user's body. 341 may be configured as a transmit / receive composite human interface device 340.

In this case, the pair of virtual pointing location information input areas may be used as a virtual text button input means in place of the physical text button by the mode switching unit.

4 illustrates embodiments of the pointer execution command unit integrated mode switching unit.

When the user moves the position by the pressure of the user and the pressure is removed, the elastic body 403 returns to the original position and the button 402 receives the user's pressure and the user moves the position by the user's pressure. In the button type pointer execution command unit having switches 404 and 405 for generating a touch input, a touch input located at the top of the button detects a user's touch input and switches a mode switching unit 401 to switch between a text mode and a pointing location information input mode. Using the pointer execution command unit integrated mode switching unit 400 can be configured.

When the position is moved by the user's pressure and the pressure is removed, the elastic body 403 returns to the original position and the button 402 receiving the user's pressure and the user's first pressure move the position to join the pointer. A second switch section 411, which is joined by a user second pressure less than the user first pressure in the button type pointer execution command section with the first switches 404 and 405 for generating an execution command, to generate a mode switch execution command; The pressure-sensitive pointer execution command unit integrated mode switching unit 410 configured as 412 may be configured.

 In the pressure-sensitive pointer execution command unit integrated mode switching unit 410, the button unit 402 may be moved to fix the button unit 402 so as not to return to its original position by the elastic body 403.

At this time, the position where the button is fixed may be configured to operate in the permanent mode switching mode when the button is fixed by setting the position where the second switches 411 and 412 are bonded and the first switches 404 and 405 not bonded. .

 In the pointer execution command unit integrated mode switching unit 400 using a touch input, the permanent mode switching switch 414 may be configured to operate the permanent mode switching switch 414 by moving a position such as sliding the button unit. The pointer execution command switches 404 and 405 may be configured to operate when additional pressure is applied in the operated state.

The pointer execution command unit-integrated mode switching unit 410 is configured as a touch pad 421 to operate as a mode switching unit when the contact area of a part of the user's body in contact with the touch pad is within the first predetermined range and is within the second predetermined range. Can act as a pointer execution command.

5 illustrates embodiments of a structure of a pointer location information input device.

The pointer location information input device of the human interface device of the present invention may include a sensor module 501 including a light emitter and a camera.

The light emitter of the sensor module 501 is blocked by the obstacle, for example, a user's finger, on the pointing position information input area 108 configured on the light plane composed of the light emitted from the light emitter. It serves to configure the light plane to be reflected.

 The camera of the sensor module includes an optical sensor for detecting the light blocked or reflected by the obstacle.

The optical sensor may use a line camera that can recognize a line image.

The line camera is suitable that the image sensor is composed of 400 to 1000 elements in the form of a line, it is ideal that preferably consists of 500 to 700 elements.

The line camera may include a plurality of line image sensors that are less than five quarters one to seven quarters less than the 500-700 elements.

The light emitter is composed of a light emitting element for constructing a light plane on the upper end of the character input button 303 approximately 1 millimeter.

The pointing location information input area 108 is composed of a part of the light plane.

As the light emitting device, for example, an infrared emitter, an infrared laser emitter, a laser emitter, an ultraviolet emitter, a visible light emitter, or the like can be used.

Ideally, the light emitting device uses an infrared laser emitter that does not require a reflector on the edge.

Infrared laser emitters are suitable for driving lasers having a laser wavelength of 800 to 850 nanometers at 0.3 to 1 milliwatt.

The light emitter lets the light from the infrared emitter pass through the line lens to spread out in a plane.

A line lens may be further included in the light emitter of the light emitter so that the light emitted from the light emitting device may form a light plane.

The line lens is positioned so that the light emitted from the light emitting device may form a light plane substantially parallel to the character input unit.

The pointer location information input device may further configure an optical filter 504 to transmit light of the light emitter to only light of a specific wavelength band.

The optical filter 504 is installed to allow the light emitted from the light emitter to pass through and to prevent the light emitted from the light emitter from being received by the camera when light reflected or blocked by an obstacle is received by the camera. Can also be installed.

The optical filter for the light emitter and the camera may be separately configured, but it is preferable to design the light emitter and the camera in close proximity so as to filter both the light transmitted and the received light with one optical filter. .

The optical filter may be installed to be perpendicular to the traveling direction of the light of the light emitter.

The optical filter may be installed to be 30 degrees to 60 degrees or 120 degrees to 150 degrees in the advancing direction of the light emitter in consideration of design.

The sensor module 501 may be installed so that the light of the light emitter is directly radiated to the light plane.

The sensor module 501 may further include one reflector 503 such that the light of the light emitter is refracted once and radiated to the light plane.

In this case, light blocked or reflected by an obstacle may be refracted by the reflector 503 and received by the camera.

The sensor module 501 may include two reflecting plates 503a and 503b such that the light of the light emitter is refracted twice and radiated to the light plane.

In this case, light blocked or reflected by an obstacle may be refracted twice by the two reflecting plates 503a and 503b and received by the camera.

In this way, the sensor module may be installed in the first housing 301.

In this case, an optical filter may be coated on the reflecting plate 503 to replace a separate optical filter 504.

When the pointing location information input area 108 is activated by the sensor module 501, the user moves the text input button 303 by swiping with his or her finger to input the pointing location information.

In this case, the distance between the text input buttons 303 is ideally 0.1 millimeter to 1 millimeter so that the user's finger is not disturbed by the distance between the text input buttons 303.

In addition, the plurality of text input buttons 303 positioned below the pointing location information input region 108 may be positioned on a plane where the top surfaces of the plurality of text input buttons are flat.

The light source emitted from the sensor module 501 is reflected by a reflector or an obstacle and the light source received by the camera passes through the light tunnel 502.

At this time, if the upper surface of the light tunnel is replaced with a portion of the first housing 301 can reduce the thickness of the housing.

The lower surface and the side surface of the light tunnel may be designed as a separate structure from the first housing.

6 is a configuration diagram of an infrared laser sensor module.

The infrared sensor module basically emits the light covering the pointing location information area using the light source 601 and analyzes the light reflected or blocked by the obstacle to locate the obstacle to one or two cameras 603. Calculation principle.

In this case, a line lens 602 may be used to scatter light so that light emitted from the light source 601 may be emitted to a desired area.

It is preferable to use a line camera as a camera for recognizing a state in which the light source is reflected or blocked by an obstacle.

The camera may install a guide light tunnel in front of the camera to help the incoming light to receive light in a desired area.

In the present invention, the light source may be infrared rays, ultraviolet rays, lasers, or the like.

* Light source and camera can be replaced by ultrasonic and ultrasonic receiver.

In the present invention, it is preferable to use an infrared laser as a light source in order not to provide a reflector on the edge of the keyboard.

If you want to use infrared light, you can install a reflector on the edge of the keyboard, increase the output of the light source more than twice as much as the optical touch module for the general screen, or install additional auxiliary light sources.

The sensor module may have an auxiliary control board 604 that controls the light source and the camera and transmits the received signal of the camera to the main control board.

The pointer location information input unit may be positioned to include a portion of an extended surface of the text input unit plane.

The text input unit includes a plurality of buttons for receiving at least one text, wherein the buttons generate a text selection signal while moving from the first position to the second position by the pressure applied by the user, and the first position by the elastic body. It can be configured in the form of a physical button returning to.

The text input unit includes F4 and F5 buttons on a Windows standard keyboard, and the camera includes two cameras of the pointer position information input unit. One of the buttons can be designed to be the F4 or F5 button at the closest distance.

Alternatively, the camera on the left side may be positioned below the space bar of the standard Windows keyboard, above the space where the space between the F4 and F5 buttons is moved in parallel.

In this way, when the position of the index finger of the right hand is located in the F position of the text input button, the index finger of the left hand obstructs the camera when inputting the pointer position information with the right hand.

When the pointer execution command unit is set to a button having the largest area among the text input units, for example, a space bar, it is convenient to execute the pointer execution command unit with the left hand while inputting mouse position information with the right hand, for example.

At this time, since the left hand may be operating the mode switching unit, the mode switching unit and the pointer execution command unit preferably have a shortest distance of 8 to 15 centimeters.

The mode switching unit may be provided separately from a button of the text input unit and recognizes that a part of the user's body is touched by a part of the human interface body to switch to the text input mode and the pointer position information input mode, but when touched. It operates in the pointer position information mode and in the text input mode when it is not touched.

The pointer execution command unit includes two buttons to perform a first function when a first button is pressed, for example, a left click of a mouse, and a second function when a second button is pressed, for example, a right click of a mouse, The first button is a button having the largest area among the text input buttons, for example, a space bar button, and the second button is the first button located at the left or right side of the first button. The thumb's thumb is convenient to control and provides an easy user experience.

When the mode switching unit is switched to the text input mode or the pointer location information input mode, a display indicating the text input mode or the pointer location information input mode may be displayed.

The pointer position information input mode may be displayed by temporarily displaying a moment when a touch occurs in the mode switching unit or displaying the pointer position information input region from the time when the touch of the mode switch is released to a release point. lighting) signal.

By doing this, the user recognizes which mode the keyboard is currently in, and in the pointer position information input mode, it is easy to know at which position the pointer position information should be input.

The text input area of the text input part may be designed to be the same as the pointer location information input area of the pointer location information input part or to include a pointer location information input area of the pointer location information input part as shown in FIG. 1.

In one embodiment of configuring the pointer position information input unit, one or two optical emitters and a camera may be configured.

The optical signal received by the camera may pass through a light tunnel to block an external noise light source.

The light tunnel may be configured before the optical signal is emitted from the optical emitter to the pointer location information input area, and may be installed in front of a camera that receives a user input signal from the pointer location information input area.

At this time, it is possible to arrange a reflector for refracting the optical signal emitted from the optical emitter or the optical signal received by the camera.

The reflection plate provides freedom to the installation position and the direction of the pointer position information input unit, thereby obtaining space utilization and design benefits.

The pointer location information input unit may configure the pointer location information input area at least 0.1 to 5 millimeters above the text input unit by the optical emitter and the camera.

Through this, the pointer location information can be received only when there is a clear touch intention of the user.

When used as an optical emitter using an infrared laser having a wavelength of 800 to 850 nanometers and designed to operate at 0.3 to 1 milliwatt, the optical emitter exhibits excellent power consumption, cost, stability, safety, and visual characteristics.

The optical emitter may further include a line lens for scattering the optical signal so that the optical signal constitutes a pointer location information input area parallel to the text input unit.

The pointer location information input unit may be designed to block optical external noise by using an optical filter that transmits only an optical signal in an infrared region.

When the text input unit is designed to have a distance between 0.1 mm and 1 mm between physical buttons, the text input unit may provide a user with a soft enough and flat feeling during input of the pointer location information.

7 is a diagram illustrating an example of displaying a pointer location information input area.

The human interface device of the present invention may be designed to further include pointer location information input area display units 701 and 702 for visually displaying the pointer location information input area in the pointer location information input mode.

The mode switching unit is provided separately from the button of the text input unit and recognizes that a part of the user's body is touched by a part of the complex human interface housing to switch to the text input mode and the pointer position information input mode, but when the touch is performed, the pointer is touched. It can be designed to operate in location information input mode and to operate in text input mode when non-touch.

In this case, when the part of the body used for the mode switching is the right hand (106b), the hand for the pointer position information input 108a may be designed to be the left hand.

In this case, it is preferable that the pointer location information input area is designed to be closer to the opposite edge of the corner where the mode switching unit is located, and the same principle can be used when the left hand and the right hand are used in reverse. (106a, 108b)

On the other hand, a part of the body used for the mode switch is the right hand, and the hand for inputting the pointer position information may be designed to be the right hand.

In this case, it is preferable that the pointer location information input area is designed to be closer to the corner where the mode switching part is located than the opposite corner of the corner where the mode switching part is located, and the left hand may be designed in the same principle.

The mode switching unit may determine the text input mode and the pointer location information input mode based on the number or positions of user fingers recognized by the pointer location information input unit.

The number of recognized user fingers when determined as the pointer location information input mode is smaller than the number of recognized user fingers when determined as the text input mode.

For example, while controlling the mode switch with the left hand, the finger of the left hand may be non-touched from the text input button and the index finger of the right hand may be touched to input the pointer location information, wherein the recognized user's finger The number of is one.

On the other hand, when the fingers of the left hand and the right hand are touched on the keyboard for text input, the number of fingers of the recognized user of 2 to 8 or less is recognized.

The pointer location information input mode display unit temporarily displays the pointer location information input area when the mode switch is switched to the pointer location information input mode or when the pointer location information input mode is switched to the pointer location information input mode. Can be displayed visually.

The pointer location information input mode display unit may be displayed by the visible light generator from the text input button, reflected light by the text input button, or through the interval between the text input buttons.

At this time, the input mode may be displayed even in the text input mode, and the text input mode and the pointer location information input mode may be displayed to be distinguished.

The pointer position information input mode display unit includes invisible light generators 701a and 701b or surfaces 702a and 702b coated with dyes that optically respond to the invisible light and emit visible light, and the dye is the text. It can be applied to the interval between the input button or the text input button.

The mode switching unit may further include a handside determination unit that determines whether the user uses the pointer position information input with the left hand or the right hand.

The display of the pointer location information input display unit may be changed according to the handside determination unit.

According to the handside determination unit, it is possible to flexibly switch the button arrangement and operation of the pointer execution command unit.

For example, when the pointer execution command unit includes right-click and left-click, the button for performing right-click and left-click may be switched according to the determination of the handside determiner.

The pointer location information input area display unit may display different pointer location information input areas according to the determination result of the handside determination unit 702a, 702b.

The mode switching unit may be designed to automatically switch to the text input mode when the pointer location information input is not input from the user for a predetermined time or when an input is received through a text input button in the pointer location information input mode.

The pointer location information input area display unit may apply a dye to the text input button or a portion of the text input area so as to be visually displayed regardless of the mode of the mode switching unit so that the pointer input area may be recognized even during the text input mode. .

8 is a first embodiment of a pointer location information input device that can be separated from a text input device.

The pointer location information input device 810 of the present invention is designed to be separated from the text input device 800 and may be combined (801) or separated from the text input device (802).

In this case, the power connection unit 820 included in the pointer location information input device may receive power from a power source of the text input device 800.

The pointer location information input device 801 includes at least one pointer location information input device 105a, 105b, and may further include a controller and an optical filter 504.

The detachable pointer position information input device 810 may be combined to form a pointing position information input area on a plane parallel to the text input area (801), and on the left side 803 or the right side 804 of the text input device. In this case, the pointing location information input area may be configured on the bottom surface of the text input device.

At this time, the pointing position information input device and the power connection unit 820 are designed to be flexibly changed in the positional change of the pointing position information input device.

9 is a second embodiment of a pointer location information input device that can be separated from a text input device.

The pointer location information input device 900 includes a built-in power supply.

When the pointer location information input device 900 is in the first location information input mode 902, the pointer location information input device 900 has a constant height and an angle such that the pointer location information input area is parallel to the text input area of the text input device. The housing can be designed.

  When the pointer location information input device 900 is in the second location information input mode 904, the pointer location information input area is input at a constant height and angle so that the pointer location information input area is parallel to the bottom surface on which the pointer location information input device 900 is placed. The housing of the device 900 can be designed.

At this time, preferably, the height of the optical filter 504 in the first positional information input mode is higher than the height of the optical filter 504 in the second positional information input mode.

When the pointer location information input device 900 is in the third location information input mode 906, the pointer location information is positioned at a predetermined height and angle so that the pointer location information input area is perpendicular to the floor on which the pointer location information input device 900 is placed. The housing of the input device 900 can be designed.

The pointer location information input apparatus 900 may distinguish between at least two modes of the first location information input mode, the second location information input mode, and the third location information input mode according to the state placed on the floor. It may include a sensor unit.

The position information input mode sensor unit may include a sensor utilizing gravity, a sensor detecting a surface placed on the floor, or a switch.

FIG. 10 is a third embodiment of a pointer location information input device that can be separated from a text input device.

The pointer location information input apparatus 1000 may have a housing 1001 surrounding at least two sides of the text input apparatus so that the text input apparatus 800 may be mounted.

The pointer location information input device 1000 includes a pointer location information input device 105a, 105b, a mode switching unit 106, a controller 1001, a housing 1002, and an optical filter 907 (1010).

After the text input device 800 is mounted on the pointer location information input device 1000 (1020), an optical filter 907 may be used to configure a pointing location information input area that is parallel to an upper end of the text input device 800 input area. The optical filter is positioned higher than the text input device 800 so that the light source can pass therethrough.

At least one surface 1003 surrounding the text input device of the housing 1002 may be a surface such that a light source emitted from the pointer location information input device 105 may be reflected, transmitted, or absorbed according to the type of the pointer location information input device. Each material can be treated with a mirror, transparent glass or plastic, or a black light absorber.

8, 9, and 10 are exemplary embodiments of a pointing position information input apparatus detachable from a text input apparatus, and have the following components.

A pointer location information input unit receives information related to a pointer location from a user.

The pointer location information input unit receives the pointing location information of the user input through the pointing location information input area configured by the pointer location information input device.

The pointer execution command receiving unit receives a signal of a pointer execution command unit that receives a user's command to perform at least one function where the pointer is located.

The pointer execution command unit may be configured as a button or a touch switch included in the pointer location information input unit, or may be configured as a control unit that switches to a pointer execution command when a predetermined input among user inputs received from the text input device is received.

And a mode switching command receiver for receiving a signal of a mode switching unit for switching to the pointer position information input mode.

The mode switching unit may be configured in a pointing location information input device, a text input device, or may be configured as a separate device.

And a power supply unit configured to transfer power to the pointer location information input unit, the pointer execution command receiver, and the mode change command receiver.

The power supply unit may be a power supply unit having its own battery or a contactor that receives power from an external source.

And a pointer location information transmitter for transmitting information related to the pointer location input to the pointer location information input unit to a digital device connected to the human interface device by wire or wirelessly.

The pointer location information input area of the pointer location information input unit may be positioned at a predetermined height and angle so that the pointer location information input area may be parallel to an upper end of at least a portion of the text input area of the text input device including a plurality of physical buttons. Is set.

When the mode switch is provided separately from the text input button of the text input device, the mode switch may be fixed to at least one surface of the text input device and recognize that the user input is received in the mode switch to input the pointer position information. The mode change command receiver may be transmitted by wire or wirelessly.

The pointer location information input unit includes an optical emitter and a camera, and the optical signal received by the camera may be designed to pass through an optical filter through a light tunnel.

It may have a position state recognition unit for recognizing the position state information on the gravity direction of the human interface, the position state information on the floor on which the human interface is placed, or the position state information of the human interface through a user input.

The position state is composed of at least two types, and when the first position state is switched to the first pointer position information input mode, and when the second position state is switched to the second pointer position information input mode.

The pointer location information input area in the first location state refers to a position parallel to at least a portion of the text input area of the text input device.

The pointer position information input area in the second position state means that the pointer position information input area is parallel to the bottom surface on which the pointing position information input device is placed.

Pointing in the first pointer positional information input mode The upper surface of the positional information input device is placed on the floor, and when the second pointer positional information input mode is switched, the ordinate coordinates of the pointing positional information input are the same but the calculation of the abscissa is increased or decreased. Calculate by changing direction.

The pointer execution command unit may use a space bar among the text input buttons of the text input device, and another button adjacent to the space bar may be used as the pointer execution command unit.

The power supply unit may receive power from the text input device.

The predefined height and angle of the pointer position input area in the first position state may be defined by an adjuster to enable adjustment within a predefined range by the user.

The controller may adjust the angle by adjusting a bonding angle of at least one surface of the housing of the pointing position information input device with an adjacent surface.

The adjuster may adjust the height by adjusting the height of at least one surface of the housing of the pointing position information input device.

The controller may adjust the predefined height and angle by adjusting the height and angle of the optical module of the pointing location information input unit of the pointing location information input device.

FIG. 11 is a front view of a human interface device to which a bottom positional pointer location information input device is applied.

The human interface device may include a text input unit including a plurality of physical buttons, a pointer location information input unit for receiving information regarding a pointer position from a user, and a pointer execution command for receiving a user's command to perform at least one function at a location of the pointer. A pointer execution command receiving unit for receiving a negative signal, a mode switching command receiving unit for receiving a signal of a mode switching unit for switching to a pointer position information input mode, the pointer position information input unit, the pointer execution command receiving unit, and a mode switching command receiving unit A power supply unit for transmitting a pointer position information transmitter for transmitting information related to the pointer position inputted to the pointer position information input unit to a digital device connected to the human interface device by wire or wirelessly, on a pointer of the pointer position information input unit The information input area is positioned parallel to the top of at least a portion of the text input area of the text input part including the plurality of physical buttons, and the pointer location information input part is composed of at least two sensor modules and the at least two sensors. The module is located on the lower left side 1102 and the right side 1103 of the human interface device.

The pointer position information input unit includes an optical emitter and a camera, and the optical signal received by the camera passes through a light tunnel.

The mode switching unit may be provided separately from a text input button of the text input device.

The mode switching unit is located on the left side of the text input area of the text input device, and recognizes that the user input is received in the mode switching unit, and transmits the pointer position information input mode to the mode switching command receiving unit.

The physical button is characterized by consisting of an elastic body for applying a physical force to return the upper part of the button and the upper part of the button when the user's finger pressure is removed from the user's finger pressure.

The complex human interface device may include a reflector or an absorber 1101 that reflects a light source generated by the pointer location information input unit at left, right, and top sides of the text input area, but not at least partially below. It is done.

The reflector is used when the light source generated by the pointer position information input unit is an infrared ray, and an absorber when an infrared laser is used.

At least two sensor modules 1102 and 1103 of the pointer location information input unit may be positioned to include at least a portion of the left outer region and the right outer region of the text input region. In other words, the left sensor includes at least a part of the left side of the control button of the standard window keyboard, and is lowered downward toward the housing corner without the key button. In this way, the sensor module enables the configuration of the minimum volume of the complex human interface device to maximize the aesthetic effect of the complex human interface.

Also, by positioning the sensor near a vertex of the text input area (1110), directing the sensor in the diagonal direction of the text input area is more than directing the sensor in the corner area to the horizontal and vertical direction of the text input area. A wider area of pointer location information input area can be constructed. In addition, it is possible to maximize the pointer location information input area at the top of the text input area by moving the position of the location where the position information detection accuracy of the pointer location information input area between the sensor and the sensor is relatively low.

In addition, the position of the sensor may be positioned 1120 narrower than the width of the keyboard below the space bar of the standard keyboard. The width between the sensor and the sensor determines the width of the pointer location information input area, thereby reducing the area of the pointer location information input area, but obtaining a relatively high pointer location information detex resolution than the location 1110 at the corner.

The sensor eliminates the reflector or absorber of the light source and lowers the height of the housing to prevent the thumb from being caught by the housing when the thumb presses the space bar of a standard keyboard with the thumb.

12 is an embodiment of a pointer execution command unit integrated mode switching unit.

In the input operation in which the frequent switching between the text input mode and the pointer position information input mode is performed, the number of times of mode switching and pointer execution command is inputted.

For example, in the case of right-handed operation, if you want to enter the pointer position information while text input in text input mode, you need to switch the mode with your left or right hand, enter the pointer position information, and then enter the pointer real name command unit with your left hand. do.

In general, during quick operation, the user inputs text and pointer position information and pointer execution command while keeping an eye on the monitor. When a mode switching unit and a pointer execution command input unit are separately provided, hand movements frequently occur. It can be cumbersome, for example, because it can't find the exact location and can't perform the function properly or stare at the keyboard.

To solve this problem, for example, in the case of a right-handed hand, if the user puts his hand to the mode switching unit with his left hand after entering text in the text input mode, a mode change command is generated and the pointer input mode is changed. The pointer execution command unit may receive a user input by inputting the pointer position information with the right hand with the hand on the mode switching unit and applying pressure to the mode switching unit.

Thus, the user can share the position of the mode switch unit for the mode switch and the pointer execution command unit for the pointer execution command.

In one embodiment for this purpose, the mode switching unit is configured as a touch switch that can accept the touch input of the user's hand and the pointer execution command unit is configured as a switch that responds to the pressure, such as a text switch is located below the mode switching unit.

In this case, the first pointer execution command unit 1104 and the second pointer execution command unit 1105 are connected to each other by a conductor material capable of recognizing a touch from a user's hand, or commonly connected to the mode switching unit 1201. Therefore, whether the user touches the first pointer execution command unit or the second pointer execution command unit is configured to perform the same mode switching.

* At this time, the mode switch operates in the pointer location information input mode while the touch is being made and in the text input mode when the touch is released.

Mode switching by touch may be configured as a sensor that can sense the position of the user's finger or another switch operating at a pressure less than the pressure for the pointer execution command in addition to the touch.

In this case, the mode switch and pointer execution command unit may be located in an area distinct from the text input area.

Preferably, in the case of the right-handed, it is located in the outer left area of the text input area.

If the mode switching unit and the pointer execution command unit are located outside the text input area, the possibility of confusion with the pointer position information input unit disappears and the pointer position information input area can be expanded.

The complex human interface device of the present invention may include a second mode switch 1202. The second mode switching unit is a switch which operates like a toggle switch, and switches to a text input mode and a pointer position information input mode whenever an input from a user is received. Thus, even if the user does not touch the left hand with the mode switching unit, the pointer position information can be input with only the right hand.

At this time, when the mode change command by touch is received when the composite human interface device is in the text mode by the second mode switching unit, the composite human interface device of the present invention operates in the pointer position information input mode. In addition, when the composite human interface device by the second mode switching unit is in the pointer position information input mode, when the mode switch command by touch is received, the pointer position information input mode is maintained, but the mode switch command by the touch is released. When text input is received through the text input unit, the text input mode is switched.

In this case, when the text input mode is switched by the text input, at least the first text input may be ignored, and when at least two text inputs are received, the text input mode may be switched.

In this case, when at least two text inputs are received and the text input mode is switched, the composite human interface device transmits the text input including the disregarded at least first text to the digital device and sends the newly input text input information to the digital device. To send.

13 illustrates an embodiment utilizing a cover of the composite human interface device.

The composite human interface device requires at least one millimeter to two millimeters of space on top of a text input device plane composed of physical devices for the pointer position input device to form a pointer position input area, and an absorber for absorbing or reflecting an optical signal. Alternatively, a border for positioning the reflector may be required at least three edges surrounding the text input area.

At this time, a difference of at least 1 to 2 millimeters occurs between the height of the edge of at least three sides of the edge and the height of the text input area plane, and a substantially rectangular parallelepiped type space is formed at the top of the text input area.

The composite human interface device of the present invention may further include a multi-purpose cover 1322 for protecting the text input area from external impact in the substantially rectangular parallelepiped type space (1310).

The multipurpose cover 1322 is separated from the composite human interface device 1320, and may be combined and separated by a magnet or a physical structure.

The multipurpose cover 1322 may be a structure folded over several times. Preferably, the width of at least one region of the divided region of the utility cover in a double folding structure may be smaller than the width of the other region (1341).

This can further reduce the inclination of the composite human interface device when the multi-purpose cover is folded at the bottom to adjust the inclination of the composite human interface device.

When the multi-purpose cover is folded and then mounted on the bottom of the composite human interface device, a portion of the folded surface that comes into contact with the ground may include an inclined surface 1342 so as to widen the area of contact with the ground.

The inclination of the multi-purpose cover 1322 can be adjusted by the user to the desired tilt of the composite human interface device.

The multipurpose cover may include a rechargeable battery 1323 in the cover.

An electrode of a power source of the rechargeable battery 1323 may be positioned at a lower end of the multipurpose cover, and may be located at a portion of the protruding region rather than a portion covering the text input area (1331) and the multipurpose cover covers the text input device. If present (1310) is connected to the electrode provided on the top of the composite human interface device.

In addition, when the multi-purpose cover is folded and mounted on the lower end to adjust the tilt of the composite human interface device, the cover may be connected to an electrode provided on the bottom of the composite human interface device.

The composite human interface device may be connected to an external power source to supply power to the rechargeable battery 1323 inside the multipurpose cover or to separately charge the multipurpose cover.

At this time, the bottom surface of the composite human interface device is a magnet or a physical coupling device or the like so as to be able to check at an accurate position with the area 1332 covering the protruding edge area where the electrode 1331 is located and the text input area having a height difference therebetween. It may have a groove into which the cover is inserted.

The edge of the multi-purpose cover is coated with a material capable of removing fine dust, oil, moisture, etc., so that foreign matters on the absorber plate, reflector plate, optical emitter, or the front of the camera can be removed whenever it is attached to the composite human interface device. have.

If the multi-purpose cover covers the text input area, the multi-purpose cover can detect the power supply of the composite human interface device.

When the multipurpose cover is mounted on the bottom of the composite human interface device, the composite human interface device may be turned on.

In addition, if there is no user input for a certain time after the power is turned on, the power can be turned off or the standby mode can be switched.

When the multipurpose cover covers the text input area (1310) The composite human interface device 1321 has a substantially rectangular parallelepiped shape and has no inclination when placed on the ground, or when the multipurpose cover is mounted below. Designed to be smaller, it can maximize aesthetic effect and increase portability.

On the other hand, when the multi-purpose cover is folded and mounted under several composite human interface devices, it can be tilted like a normal keyboard.

The multi-purpose cover may be configured to be detachable, but may be designed in such a way that the hinge is returned from the top to the bottom of the composite human interface device by folding.

14 is an embodiment of a human interface device applied to a portable electronic device such as a portable electronic device or a tablet personal computer.

The composite human interface device 1420 of the present invention can be utilized as an input device for a portable electronic device.

In the portable electronic device having the composite human interface device of the present invention, a display unit composed of the display panel 1411 and the frame 1410 supporting the display panel is bound by the composite human interface device and the hinge 1427 of the present invention. Can be designed as a covered and open structure.

At this time, the display unit is inserted into the substantially hexahedral space formed by the text input area and the reflector or absorber plate 1424 of the human interface device of the present invention. Then, the thickness of the portable electronic device using the human interface device of the present invention can be minimized.

To this end, the display unit of the portable electronic device must be designed to have a width smaller than the width of the human interface device 1420 of the present invention by at least twice the thickness of the reflector plates or the absorbing plates 1423 and 1424.

In other words, it should be designed so that the display unit can be placed in place of the multipurpose cover in FIG. 13.

The display unit has a feature 1413 that allows both corners to be rounded or diagonally cut.

When the display unit is folded, the pointer location information input devices 1421 and 1422 may be positioned toward the outer edge of the rounded or diagonally cut portion.

This is to fold the portable electronic device so that it can be kept thin without being disturbed by the pointer position information input devices 1421 and 1422.

At this time, the mode switching unit and the pointer execution command unit are located outside the side text input area of the human interface device as described above, the mode switching unit is located outside the text input area, and the pointer execution command unit is at least one of the text input buttons, or the mode switch. Both the negative and pointer command execution units may operate as at least one of the text input buttons.

In addition, it may be more preferably located below the outside of the text input area (1425, 1426).

At this time, the mode switching unit and the pointer execution command unit are preferably integrally formed as shown in FIG. 12, but may be separately separated.

At this time, when the mode switching unit or the pointer execution command unit is located outside the text input area, when the user places a finger to control the mode switching unit or the pointer execution command unit, the pointer location information input devices 1421 and 1422 The pointer location information input area should be set except the area where the mode switching unit or the pointer execution command unit is located so that the user does not malfunction by inputting the location information of the pointer.

To this end, the optical signal generated from the pointer position information input device may be adjusted so that the optical signal does not reach the mode switching unit or the pointer execution command unit.

Alternatively, the optical signal reception angle of the camera may be adjusted or received in a corresponding direction so that the camera does not receive an optical signal generated by reflection, interference, or blocking between the user's finger and the optical signal located in the mode switching unit or the pointer execution command unit. The optical signal can be ignored.

The portable electronic device is designed to have at least three corner portions of an absorbing plate or a reflecting plate for absorbing or reflecting a light source generated by the pointer position information input device.

At this time, the two surfaces are located on the side of the human interface device (1423, 1424) and the other surface is the pointer position information input device (1421) when the display unit is open within a predetermined angle on the surface where the display unit is in contact with the human interface device. 1422, the reflector or absorber may be positioned in a constant region 1412 of the edge of the display unit so that the light source generated by 1422 is sufficiently reflected or absorbed.

In FIG. 14, the display unit may be configured as a flexible display unit. The display unit may be curved to cover the text input area of the complex human interface device and be wound around the bottom surface of the complex human interface device.

In addition, in FIG. 14, the display unit may be replaced with the multipurpose cover described in FIG. 13, and the absorber or reflector may be positioned at a corner portion of the multipurpose cover that is joined to the composite human interface device. It can also be used to adjust the height of the interface device.

1 to 14 illustrate an example of a complex human interface device to be described in the present invention, and the type of the text input device pointing location information input device and the technology used may be changed or replaced by those skilled in the art without changing the basic purpose. It includes.

Claims (13)

In the composite human interface device,
A text input unit including a plurality of physical buttons;
A touch pad for forming a pointer position information input area above the physical button, the position of the pointer displayed on a digital device connected to the composite human interface device by wire or wirelessly from a user's operation received through the touch pad; A pointer position information input unit for obtaining pointer position information regarding
And a communication unit configured to provide the pointer location information to the digital device.
The composite human interface device,
Operate in at least one of a text input mode for transmitting information corresponding to text input to the text input unit to the digital device and a pointer position information input mode in which the position of the pointer is set in correspondence to the pointer position information,
The text input unit may include a first button for providing first information to the digital device when external pressure is applied in the text input mode.
Providing second information to the digital device when a user touch is applied to the first button in the pointer position information input mode;
Composite human interface device.
According to claim 1,
Wherein the first information is information corresponding to a first text, and the second information includes a pointer execution command to perform a first function at the pointer location.
Composite human interface device.
According to claim 1,
The first button includes an elastic body for changing the height of the first button according to the external pressure and a switch operated by the first pressure,
When the switch is operated in the pointer position information input mode, the text input mode is activated, and when the first touch is applied to the first button, the second information is provided to the digital device.
Composite human interface device.
The method of claim 3, wherein
When the first touch is applied to the first button, the switch does not operate.
Composite human interface device.
According to claim 1,
The text input unit may include a second button that provides information corresponding to the second text different from the first text to the digital device when external pressure is applied in the text input mode.
When the user touch is applied to the second button in the pointer position information input mode, the apparatus provides a pointer execution command to the digital device to perform a second function different from the first function at the position of the pointer.
Composite human interface device.
According to claim 1,
When the user touch is applied to the text input unit while the text input mode is activated, the pointer location information input mode is activated.
Composite human interface device.
According to claim 1,
Including a display unit for providing a notification to the user,
The display unit provides a visual notification when the user touch is applied to the text input unit,
Composite human interface device.
The method of claim 7, wherein
The visual notification is stopped when the pointer location information input mode is released.
Composite human interface device.
In the composite human interface device,
A text input unit including a plurality of physical buttons;
A touch pad for forming a pointer position information input area above the physical button, the position of the pointer displayed on a digital device connected to the composite human interface device by wire or wirelessly from a user's operation received through the touch pad; A pointer position information input unit for obtaining pointer position information regarding
And a communication unit configured to provide the pointer location information to the digital device.
Operate in at least one of a text input mode for transmitting information corresponding to text input to the text input unit to the digital device and a pointer position information input mode in which the position of the pointer is set in correspondence to the pointer position information,
The text input unit may include a first button for providing first information to the digital device when external pressure is applied in the text input mode.
When the external pressure is applied to the first button in the pointer position information input mode, providing the second information to the digital device,
Composite human interface device.
The method of claim 9,
The first button includes an elastic body for changing the height of the first button according to the external pressure and a switch operated by the external pressure,
The first information is provided to the digital device when the switch is operated in the text input mode, and the second information is provided to the digital device when the switch is operated in the pointer position information input mode.
The first information is information corresponding to a first text, and the second information includes a pointer execution command to perform a first function at a position of the pointer.
Composite human interface device.
The method of claim 10,
The text input mode is not activated even when the switch is operated in the pointer position information input mode.
Composite human interface device.
The method of claim 10,
The text input unit may include a second button that provides information corresponding to the second text different from the first text to the digital device when external pressure is applied in the text input mode.
When the external pressure is applied to the second button in the pointer position information input mode, providing a pointer execution command to the digital device to perform a second function different from the first function at the position of the pointer.
Composite human interface device.
The method of claim 12,
The first function is a left click function of a computer mouse, and the second function is a right click function of a computer mouse.
Composite human interface device.

Images