KR20150032950A - Digital device having multi human interface devide - Google Patents

Abstract

The present invention relates to a digital device having a complex human interface device comprising a text inputting unit which comprises a plurality of physical buttons; a pointer position information inputting unit which receives information related to a pointer position from a user; a display device which comprises a display unit and displays a pointer which changes a position by using the information related to the pointer position; a pointer execution command unit which receives a command of the user in order to perform one or more functions in the pointer position; a mode converting unit which converts a mode into a pointer position information input mode; and a pointer position information transmitting unit which transmits the information related to the pointer position inputted to the pointer position information inputting unit to the display device. A pointer position information inputting area of the pointer position information inputting unit is positioned on at least upper part of the text inputting area of the text inputting unit comprising the physical buttons to be parallel with the text inputting unit. A first side which surrounds the text inputting unit comprises the pointer execution command unit. The pointer position information inputting unit comprises a sensor module. The height of the sensor module is changed and comprises a first mode and a second mode.

Description

[0001] DIGITAL DEVICE HAVING MULTI HUMAN INTERFACE DEVIDE [0002]

The present invention relates to a human interface for receiving text information or pointing position information from a user in a digital device capable of receiving text or pointing position related information such as a computer, a notebook, a tablet PC, a mobile phone, and the like, and transmitting the text information or the pointing position information to the digital device.

A text input device such as a keyboard for text input has been disclosed in personal computers and portable digital devices. Also, a pointing device such as a mouse device for controlling the pointing position of the pointer for controlling the digital device and performing the function has been disclosed.

US 5734375 B US 5864334 B US 20110006991 A1

The conventional text input device and the pointing device are provided as separate devices or the pointing input area is formed at a separate position different from the text input area of the text input device. Therefore, the movement of the user's hand is more than necessary in the work environment in which the text input, the pointing position information input, and the pointer execution command input are frequently changed, thereby lowering the work efficiency.

A pointing position information input area of the pointing device at a top of a text input area of the text input device and a switching part for switching between a text input mode and a pointing position information input mode, It is possible to improve the work efficiency by enabling the pointing input while minimizing the movement.

By integrating the separately provided text input device and the pointing device into one human interface device, it is possible to reduce the unit price and the size of the product, and eliminate the unnecessary operation of the user operation, thereby improving the work efficiency.

1 is an exemplary view of a composite human interface device having a pointing device and a text input device.
2 is a flowchart for explaining an example of the operation sequence according to the mode switching of the pointing device and the text device.
3 is an example of a configuration of a text input device and a pointing device.
Fig. 4 shows examples of the pointer execution command unit integral mode switching unit.
Fig. 5 shows an example of the structure of the pointer position information input device.
6 is a configuration diagram of an infrared laser sensor module.
Fig. 7 shows an embodiment for displaying the pointer position information input area.
8 is a first embodiment of a pointer position information input device which can be separated from a text input device.
9 is a second embodiment of a pointer position information input device which can be separated from the text input device.
10 is a third embodiment of a pointer position information input device which can be separated from a text input device.
11 is a front view and a perspective view of a human interface apparatus to which the lower-positioned pointer position information input device is applied.
12 is an embodiment of the pointer execution command unit integral mode switching unit.
13 is an embodiment utilizing a cover of a human interface device to which a lower-positioned pointer positional information input device is applied.
14 is an embodiment of a human interface device applied to a portable electronic device.
FIG. 15 shows an embodiment in which the lower position pointer type position information input device and the lower position type pointer execution command portion are applied.
16 shows an example of a digital device using a sensor module whose height is changed.
17 is a conceptual diagram illustrating a change in the position of the sensor module depending on whether or not the display device is engaged.

The present invention relates to a composite human interface for receiving text information or pointing position information from a user and transmitting the text information or pointing position information to a digital device capable of receiving text or pointing position related information such as a computer, a notebook, a tablet PC,

As a conventional text information input device, a keyboard composed of an elastic body and a plurality of physical buttons connected to a switch is widely used.

In a digital device having a touch interface, a virtual keyboard is displayed on a display. When a part of a user's body is touched with a virtual keyboard displayed on the display, a gesture or an electrical signal of the user is sensed, A method of inputting text on a virtual keyboard displayed in a portion is also used.

The touch interface recognizes the movement of a part of the user's body or recognizes the contact with a specific contact surface, senses the flow of current through the user's body, or intercepts or interferes with light or sound waves by a part of the user's body The touch of the user can be recognized by sensing or the like.

Examples of touch interfaces include a pressure sensitive touch screen, an electrostatic touch screen, an optical touch screen, and an ultrasonic touch screen.

A resistive touch screen or a pressure sensitive touch screen is a pressure sensitive touch screen.

Resistive touchscreen is cheap, and it is advantageous to write in handwriting or small cell with stylus pen. However, because it uses pressure, it is not recognized by pressing hard, and touch feeling is slightly duller than electrostatic touch method. It is known as a disadvantage.

The resistive touchscreen consists of several layers.

Among these several layers are conductive layers, with the two layers facing the air layer.

Pressing the outer screen will cause the two conductive layers to touch each other, which causes the resistance and current to change and recognize the touch.

Capacitive sensing or electrostatic touching is a type of sensing operation using a capacitive coupling effect.

The electrostatic touchscreen is made of highly conductive glass, indium tin oxide, unlike pressure-sensitive touchscreens that use pressure.

By attaching the sensor to the four corners of the glass, current flows through the glass surface.

It is the electrostatic principle to recognize the change of current through this.

At this moment, the moment the finger moves on the screen, the electrons that flowed through the glass flow into the body through the finger, and the sensor senses the position where the change occurred.

The electrostatic touch method is known to have a feeling of operation and smoothness compared with a pressure sensitive touch screen because the touch is recognized by touching the screen rather than pressing the screen by force.

In addition, the electrostatic touch method enables multi-touch that can touch various places.

Since the electrostatic touch method is a method of operating by using a change in electric current, it may not be used with a leather glove which does not communicate with electric current, or may not be operated with a nail or a stylus pen.

However, you can touch the screen with a separate electrostatic stylus pen.

Sensors are sensitive and may be affected by peripheral devices.

The optical touch screen operates by measuring coordinates with the infrared camera mounted on the apex of the touch screen and the infrared light illuminates with the shadow of the object to be touched.

The ultrasonic touch screen emits ultrasonic waves on the screen, detects the interference effect by the user's touch, and operates by measuring the coordinates.

Various touch input techniques that can be used to detect positional information of a part of a user's body by sensing contact or movement of another user and controlling position information of the pointer can be used in the present invention.

1 is an exemplary view of a composite human interface device having a pointing device and a text input device.

The pointing device-integrated text input device may have a housing (100) for supporting a text input device and a pointer location information input area.

The housing has a strength enough to withstand the pressure of a user input and receives text input information and pointer position information input information and transmits the information to a digital device connected to the pointing device integrated text input device by wire or wireless A control unit, a memory unit, a battery unit, an encoding unit, and a transmission unit.

The pointing device-integrated text input device may include a plurality of buttons 109 for receiving text input information from a user.

The plurality of buttons 109 may be configured as physical buttons or virtual buttons.

The physical button may include a button connected to the elastic body, or may have a feature that the button itself is elastic and moves to the position when the user receives the input, and returns to the original position when the pressure of the user is removed.

The physical button is connected to the electrical switch, and the user's pressure is applied to the physical button, so that the position of the button is shifted and the phase of the switch is changed, so that the text input value of the corresponding button is generated.

The physical button is structured to have elasticity without an electrical switch, and moves to a position when the user's pressure is removed. The user's text input information is input by the touch input device The user's pressure or gesture can generate textual input information based on the recognized location information.

The virtual button may be configured by displaying a text input button on a display device.

The virtual button can display an arbitrary button by projecting light onto a transparent, semi-transparent or opaque object.

The virtual button is not perceived by the user's eyes but can generate corresponding text input information based on user's pressure or gesture information with unique position information per text.

The compound human interface device may have a text input area 107 and pointing location information input areas 108a and 108b having at least a part thereof as a common area.

The pointing position information input areas 108a and 108b are areas located at the upper or lower end of the button for text input. The pointing position information input area 108a and 108b may have at least a part of the pointing position information input area common to the text input area have.

The pointing location information input area may include the text input area or the text input area may include a point location information input area.

The pointing position information input area and the text input area are at least partially common and at least partially used as the pointing position information input area but not used as the text input area and at least partially used as the text input area, May not be used.

The complex human interface device includes a pointer position information input device 105 for forming a virtual text input area or a virtual pointing position information input area for inputting text, for inputting pointing position information, or for inputting text and pointing position information And may be configured on the composite human interface device or outside the composite human interface device.

The pointer position information input device 105 includes an infrared ray generator, an infrared ray receiver, an RGB camera, an ultrasonic generator, an ultrasonic receiver, an infrared ray generator, and an infrared camera. ), The user can receive a part of the user's body and input the position information and the gesture information.

The pointer location information input device may be configured as a plurality of modules so as to improve the accuracy or sensitivity of the pointer location information input area.

For example, a pointer position information input device 105b for configuring a text input or pointing position information input area 108b of the right hand.

Or a pointer position information input device 105a for configuring the left hand text input or pointing position information input area 108a.

The text input area or the pointing position information input area 108b for the right hand may include an area of the J button of the English standard keyboard.

The text input area or the pointing position information input area 108a for the left hand may include an area of an F (F) button of an English standard keyboard.

The pointer position information input device may include both the J and F buttons of the English standard keyboard if there is no division for the left hand and the right hand.

The pointing position information input area is capable of moving the pointer position on the plurality of display units when the compound human interface apparatus is connected to a plurality of digital devices having a display unit.

For example, the pointer position information input region may be divided into regions so as to be matched with the respective display portions, or a separate button indicating the display portion may be operated to transmit pointer position information on the display portion, or a plurality of display portions may be referred to as a virtual single The pointer position information can be transmitted so that the pointer can be moved on the virtual single display unit.

The composite human interface apparatus includes a pointing position information input device for constructing a pointing input area and receiving pointer position information from a user, and the pointer is moved to a position where the pointer moved by the pointing position information input device is located, And a pointer execution instruction unit 101 or 102 for executing at least one function on the window.

The pointer execution command section can be composed of one or two buttons, which are responsible for the first function and the second function, respectively, and can be located on the left side of the housing, in the mail, or in the center.

The first function may function as a left click of a computer mouse and the second function may function as a right click of a computer mouse, for example.

The pointer execution command unit including the one or two buttons may be provided on both the left side and the postal side of the housing.

The pointer execution command unit may be configured to be operated by touching or light interception of a part of the user's body, interference of ultrasonic waves, or shadow of a part of the user's body using the above-described touch technology.

The pointer execution command unit may be configured as an elastic physical button.

The pointer execution command unit may operate using at least one button of a text button located in the text input area in addition to the pointing position information input area.

The pointer execution command unit can operate by selecting a physical or virtual text button on the pointing position information input area.

For example, when using a virtual input device capable of inputting position information in space with a pointing position information input device and using a physical button as a text input device, the position of the pointer on the virtual pointing position information input area in the pointing position information input mode You can issue a pointer execution command by entering information and pressing the physical text button at that location.

The pointer execution command unit may receive the pointer position information by the user first gesture in the pointing position information input area and may generate the pointer execution command by the user second gesture at the same position.

The pointer execution command unit may be configured to perform a first function by a first gesture of the user's body, a first voice, a first blink, a first mouth shape, or the like.

The pointer execution command unit may be configured to perform a second function by a second gesture of the user's body, a second voice, a second blink, a second mouth shape, or the like.

The composite human interface device may be configured as a text input mode for inputting text information through the text input device and a pointing position information input mode for inputting pointing position information through the pointing position information input device.

The text input mode and the pointing position information input mode can be switched by the mode switching unit 103.

The mode switching unit 103 may be a switch located separately on the housing.

The mode switching unit 103 may detect the simultaneous reception of at least one text input button or a plurality of text inputs included in the text input device and perform mode switching.

The mode switching unit 103 can switch modes by receiving control information from the digital human machine connected to the composite human interface apparatus by wire or wirelessly.

The mode switching unit 103 may be integrated with the pointer execution command unit 102.

For example, a first gesture, such as a first touch on a first touch or a first pressure, and a second touch on a first touch or a second touch on a second pressure, And to generate a pointer execution command by reacting to a second touch or a second pressure by a second gesture such as switching a mode by sensing a touch or a first pressure and pressing a button.

The mode switching unit 103 may be configured as a temporary mode switching mode and a permanent mode switching mode.

For example, in response to a first touch or a first pressure, a mode is changed from a text input mode to a pointing position information input mode, and when a first touch or a first pressure is removed, have.

Alternatively, in the pointing position information input mode in response to the first touch or the first pressure, the mode may be switched to the text input mode, and when the first touch or the first pressure is removed, the mode may be set to return to the pointing position information input mode. .

The permanent switching mode is configured so as to switch from the text input mode to the pointing position information input mode in response to the second touch or the second pressure or the toggle switch and to maintain the pointing position information input mode even if the second touch or the second pressure is removed .

The temporary mode can be switched by the first control information received from the digital device connected to the complex human interface device by wire or wirelessly.

The permanent mode can be switched by the second control information received from the composite human interface device and the wired or wirelessly connected digital device.

The mode switching unit 103 may be integrated with the pointer execution command unit.

For example, when the first touch or first pressure is detected on the pointer execution command unit, the pointer mode is switched from the text input mode to the pointer position information input mode. When the second touch or the second pressure is detected, And when the third touch or the third pressure is applied, it is set to the permanent switching mode that operates in the pointer position information input mode even if the third touch or the third pressure is removed.

At this time, it is possible to configure to be able to input a pointer execution command even in the permanent switching mode.

The mode switching unit may be formed on the left or right side of the housing (106a, 106b)

The mode switching units 106a and 106b formed on the left side, right side, left side, and right side of the housing may be configured to include a virtual button or a physical button, and configured to operate by sensing a user's touch input or pressure.

The mode switching units 106a and 106b formed on the left, right, left, and right sides of the housing may have an input area of 3 centimeters or more and less than 15 centimeters along the side surface of the housing.

And when the length of the mode switching unit is less than 5 centimeters, the position of the mode switching unit is set to include the left space of the left tab key of the window standard keyboard.

The complex human interface device may have a transmission unit 104 for transmitting data wired or wirelessly to a digital device including an external or complex human interface device.

The digital device can receive text input or receive pointer location information.

2 is a flowchart for explaining an example of the operation sequence according to the mode switching of the pointing device and the text device.

The complex human interface device may have a separate power source, receive power from the outside by wire or wireless, and may have a switch for controlling the power source.

If the composite human interface unit is powered by the switch for controlling the power unit, it can be determined whether the compound human interface unit is in the text input mode or the pointing position information input mode (200).

As a result of the determination, if the text input mode is selected, the text input device may be activated and a text input may be received from the user (201).

The text input of the input user can be transmitted to a digital device connected by wire or wireless (202).

When the mode is switched to the pointing position information input mode during the text input mode, the text input mode can be switched to the pointing position information input mode.

Or the pointing position information can be input simultaneously with the text input.

When the mode is switched to the pointing position information input mode, the pointing position information may be received by the user (204).

The input pointer location information may be transmitted to a digital device connected by wire or wireless connection (205).

When the compound human interface device receives the pointer first execution command (206), the pointer first execution command can be transmitted to the digital device connected by wire or wireless (207).

When the compound human interface device receives (208) the pointer second execution command, it can transmit the pointer first execution command to the digital device connected by wire or wireless (209).

When the temporary mode changeover is canceled or the permanent mode changeover is canceled, the composite human interface apparatus can switch to the text input mode.

If the power switch of the power source unit is turned off or the digital device is not connected or disconnected, or if there is no input by the user for a certain period of time, or by control of a wired or wirelessly connected digital device

3 is an example of a configuration of a text input device and a pointing device.

The complex human interface device may include a first housing 301 including a power unit, a control unit, or a communication unit, and a second housing 302 for configuring a text input area and a pointing location information input area.

The composite human interface device may have a text input device and a text input area 303 for receiving text input from a user.

At this time, the text input area 303 may be composed of a virtual button or a physical button.

The pointing location information input device may be configured as a pressure sensitive or capacitive touch pad type and may be located 304 above the physical buttons of the text input device.

At this time, if the text input device is constituted by a physical touch pad type such as a pressure sensitive type or capacitive type, the touch pad can be used as a text input device and a pointing position information input device.

In this case, a physical touch pad such as a depressurizing type or capacitive type can be configured as a large area touch pad type compound human interface device 300 including a touch pad 304 including a plurality of text button areas of a text input part.

Or a physical touch pad such as a depressurizing type or a capacitive touch type can be constituted by a plurality of touch pad type compound human interface devices 310 including a plurality of touch pads 311 including a text button area of a text input part.

Alternatively, the pointing position information input may be performed by an upper camera type composite human interface device 320 constituting a pointer position information input area 321 by an infrared camera or an RGB camera 222 located at the upper end of the pointing position information input area, .

At this time, the upper camera type composite human interface apparatus 320 can configure the virtual text input button 303 using the upper camera.

And a lower camera 332 type composite human interface device 330 configured to locate the pointing position information input area 331 at the lower end of the second housing.

At this time, the lower camera-type compound human interface device 330 may configure a virtual text input button 303 to replace the physical text button using the lower camera.

Or a pointing position information input by an infrared ray transmitter or an ultrasonic wave transmitter or an infrared ray receiver or an ultrasonic receiver which receives interfered information by a part of the user's body, Reception type multi-function human interface apparatus 340 that receives the data through the transmission / reception type multi-

At this time, the virtual pointing position information input area formed as a pair can be used as a virtual text button input means in place of the physical text button by the mode switching unit.

Fig. 4 shows examples of the pointer execution command unit integral mode switching unit.

An elastic body 403 for returning the position to the original position when the pressure is removed, a button 402 for receiving the pressure of the user, and a pointer operation command A mode switching unit 401 for switching between a text mode and a pointing position information input mode by detecting a user's touch input at an upper portion of a button in a button-type pointer execution command unit having switches 404 and 405 for generating a touch input The pointer execution command unit integrated mode switching unit 400 can be configured.

An elastic body 403 for returning to the original position when the pressure is removed, a button 402 for receiving the pressure of the user, and a pressure sensor A second switch unit 411 which is connected by a user second pressure smaller than the user first pressure to generate a mode switching execution command in a button-type pointer execution instruction unit having first switches 404 and 405 for causing execution commands to be generated, 412), and a pressure discriminating pointer execution command unit integrated mode switching unit 410.

 The pressure difference type pointer execution command unit integrated mode switching unit 410 moves the button unit 402 and fixes the button unit 402 so that the elastic unit 403 does not return to the original position.

In this case, the position where the button is fixed can be configured to be set to the position where the second switches 411 and 412 are joined and the first switches 404 and 405 are not joined, and to operate in the permanent mode switching mode when the button is fixed .

 The pointer execution instruction unit integrated mode switching unit 400 using the touch input can be configured to operate the permanent mode changeover switch 414 through position shifting such as slipping the button unit and the permanent mode changeover switch 414 The pointer execution command switches 404 and 405 can be configured to operate when additional pressure is applied in the operated state.

When the contact area of a part of the user body which is composed of the touch pad 421 and touches the touch pad is in the first predetermined range, the pointer execution command instruction part integrated mode switching part 410 operates as the mode switching part, It can be operated as a pointer execution command section.

Fig. 5 shows an example of the structure of the pointer position information input device.

The pointer position information input device of the human interface device may include a sensor module 501 including a light emitter and a camera.

The light emitter of the sensor module 501 is blocked by an obstacle such as a user's finger on the pointing position information input area 108 formed on the light plane composed of light emitted from the light emitter And serves to construct the light plane to be reflected.

 The camera of the sensor module includes an optical sensor that detects light blocked or reflected by the obstacle.

The optical sensor may use a line camera capable of recognizing a line image.

It is preferable that the line camera is configured such that the image sensor is composed of 400 to 1000 elements in a line form, and preferably 500 to 700 elements.

The line camera may include a plurality of line image sensors that are less than 1 to 7, but less than 1, 5, 5, or more than the 500 to 700 elements.

The light emitter is constituted by a light emitting element for constituting a light plane on the upper end close to the letter input button 303 by about 1 millimeter.

The pointing position information input area 108 is composed of a part of the light plane.

As the light emitting element, for example, an infrared emitter, an infrared laser emitter, a laser emitter, an ultraviolet emitter, a visible light emitter, or the like can be used.

Ideally, the light emitting device should use an infrared laser emitter that does not require a reflector to be attached to the rim.

The infrared laser emitter is suitable for driving a laser with a laser wavelength of 800 to 850 nanometers at 0.3 to 1 milliwatts.

The light emitter allows the light from the infrared emitter to pass through the line lens so that it can spread in a flat plane.

The light emitter may further include a line lens in the light emitting portion so that the light emitted from the light emitting element can constitute the light plane.

The line lens positions the light emitted from the light emitting element so as to constitute a light plane substantially parallel to the character input section.

The pointer position information input device may further configure the optical filter 504 to transmit light of the light emitter only through light of a specific wavelength band.

The optical filter 504 is installed so as to allow light emitted from the light emitter to pass therethrough and to prevent the light emitted from the light emitter from being received when light reflected or blocked by the obstacle is received by the camera Can also be installed.

The light emitter and the optical filter for the camera may be separately configured, but it is preferable to design the light emitter and the camera in close proximity so that the light transmitted to one optical filter and the received light can be filtered .

The optical filter may be arranged to be perpendicular to the light traveling direction of the light emitter.

The optical filter may be installed in a range of 30 to 60 degrees or 120 to 150 degrees in the traveling direction of the light emitter in consideration of design.

The sensor module 501 may be installed such that the light of the light emitter is radiated directly to the light plane.

The sensor module 501 may further include one reflector 503 to refract the light of the light emitter once and radiate to the light plane.

At this time, light blocked or reflected by the obstacle may be refracted once by the reflection plate 503 and received by the camera.

The sensor module 501 may include two reflectors 503a and 503b to refract the light of the light emitter twice and radiate to the light plane.

At this time, light blocked or reflected by the obstacle can be refracted twice by the two reflectors 503a and 503b and received by the camera.

In this way, the sensor module can be installed inside the first housing 301.

At this time, an optical filter may be coated on the reflection plate 503 to replace the optical filter 504.

When the pointing position information input area 108 is activated by the sensor module 501, the user moves his / her finger over the plurality of text input buttons 303 to enter pointing position information.

In this case, the interval between the text input buttons 303 is ideally 0.1 millimeter to 1 millimeter so that the movement of the finger is not disturbed due to the interval of the text input button 303 of the user's finger.

The plurality of text input buttons 303 located below the pointing position information input area 108 may be positioned on a flat plane with the top surfaces of the plurality of text input buttons.

A light source, which is emitted from the sensor module 501, is reflected by a reflector or an obstacle and is received by the camera, passes through the light tunnel 502.

At this time, if the top surface of the light tunnel is replaced with a portion of the first housing 301, the thickness of the housing can be reduced.

The lower surface and the side surface of the light tunnel can be designed as a separate structure from the first housing.

6 is a configuration diagram of an infrared laser sensor module.

The infrared sensor module basically emits light covering the pointing position information area using the light source 601 and analyzes the light reflected or blocked by the obstacle to detect the position of the obstacle by one or two cameras 603 It is the principle of calculation.

At this time, a line lens 602 that scatters light so that the light emitted from the light source 601 can be diverted to a desired area can be used.

It is preferable to use a line camera for the camera to recognize the state where the light source is reflected or blocked by the obstacle.

The camera can be equipped with a guide light tunnel in front of the camera to help the received light receive the desired area of light.

The light source may be infrared, ultraviolet, laser, or the like.

Light sources and cameras can be replaced by ultrasonic and ultrasonic receivers.

It is preferable to use an infrared laser as a light source in order not to install a reflector on the edge of the keyboard.

If you want to use infrared light, you can install a reflector on the keyboard's edge, or you can increase the light output more than twice as much as an optical touch module for a regular screen, or install an auxiliary light source.

The sensor module may have an auxiliary control board 604 for controlling the light source and the camera and transmitting the received signal of the camera to the main control board.

The pointer position information input unit may be positioned to include a part of the extended surface of the text input unit plane.

Wherein the text input unit comprises a plurality of buttons for receiving at least one text and the button moves from a first position to a second position by a pressure applied by a user to generate a text selection signal, Lt; RTI ID = 0.0 > a < / RTI > physical button.

Wherein the text input unit includes F4 and F5 buttons on a window standard keyboard, and the camera of the pointer position information input unit includes two cameras, and the camera and the text input unit It is possible to design so that the button closest to the button is the F4 or F5 button.

Alternatively, the camera on the left side may be positioned above the space where the space between the EF 4 and EF 5 buttons is moved downward under the space bar of the Windows standard keyboard.

In this way, when the position of the index finger of the right hand is at the position of the F (F) of the text input button, it is possible to reduce the phenomenon that the index finger of the left hand obscures the camera when the pointer position information is inputted with the right hand.

If the pointer execution command unit is set to a button having the largest area of the text input unit, for example, a space bar, it is convenient to execute the pointer execution command unit with the left hand while inputting the mouse position information with the right hand, for example.

At this time, since the left hand may be operating the mode switching unit, it is preferable that the shortest distance between the mode switching unit and the pointer execution command unit is 8 to 15 centimeters.

The mode switching unit may be provided separately from the button of the text input unit, and recognizes that a part of the user's body is touched on a part of the human interface body, and switches the mode to the text input mode and the pointer position information input mode. It operates in the pointer position information mode and can operate in the text input mode when it is not in touch.

The pointer execution command unit is composed of two buttons and performs a first function when the first button is pressed, for example, a left click of the mouse, and a second function when the second button is pressed, for example, And the first button is a button having the largest area of the text input unit buttons, for example, a space bar button. When the second button is set as the first button located on the left or right of the first button, It's easy to control with the thumb of the thumb and provides an easy user experience.

When the mode switching unit is switched to the text input mode or the pointer position information input mode, the text input mode or the pointer position information input mode can be displayed.

Wherein the pointer position information input mode is displayed by temporarily displaying the pointer position information input mode at a moment when the touch of the mode switching unit occurs or until the touch point of the mode switching unit is released, lighting signal.

By doing so, the user can recognize which mode the keyboard is currently in, and can easily know at which position the pointer position information should be input in the pointer position information input mode.

The text input area of the text input unit may be the same as the pointer location information input area of the pointer location information input unit or may include the pointer location information input area of the pointer location information input unit as shown in FIG.

In an embodiment constituting the pointer position information input unit, one or two optical emitters and a camera may be used.

The optical signal received by the camera may pass through a light tunnel to block an external noise source.

The light tunnel may be configured before the optical signal is emitted from the optical emitter to the pointer location information input area, and may be installed on the front surface of the camera receiving the user input signal from the pointer location information input area.

At this time, an optical signal emitted from the optical emitter or a reflector for refracting an optical signal received by the camera can be disposed.

A degree of freedom is provided to the installation position and direction of the pointer position information input unit through the reflection plate, thereby achieving space utilization and design benefit in design.

The pointer position information input unit may configure the pointer position information input area at least 0.1 to 5 millimeters above the text input unit by the optical emitter and the camera.

Thus, the pointer position information can be input only when there is a clear touch intention of the user.

When the optical emitter is designed to operate at 0.3 to 1 milliwatt using an infrared laser having a wavelength of 800 to 850 nanometers, it exhibits excellent power consumption, cost, stability, safety, and visual characteristics.

The optical emitter may further include a line lens that scatters the optical signal so that the optical signal constitutes a pointer position information input area parallel to the text input part.

The pointer position information input unit may be designed to block optical external noise using an optical filter that transmits only the optical signal in the infrared region.

If the interval between the physical buttons is designed to be 0.1 millimeter to 1 millimeter, the text input unit can provide the user with a feeling of sufficiently smooth and flat feeling during the input of the pointer position information.

Fig. 7 shows an embodiment for displaying the pointer position information input area.

The human interface apparatus may further include pointer position information input area display units 701 and 702 for visually displaying the pointer position information input area in the pointer position information input mode.

Wherein the mode switching unit is provided separately from the button of the text input unit and recognizes that a part of the user's body is touched to a part of the composite human interface housing to switch to the text input mode and the pointer position information input mode, It can be designed to operate in the position information input mode and to operate in the text input mode in non-touch.

At this time, when a part of the body used for the mode switching is the right hand (106b), the hand which performs the pointer position information input 108a can be designed to be a left hand.

In this case, it is desirable that the pointer position information input region is designed to be closer to the opposite corner of the corner where the mode switching unit is located, and the same principle can be also applied when the left and right hands are reversed. (106a, 108b)

On the other hand, a part of the body used for the mode switching may be a right hand, and a hand for inputting the pointer position information may be designed to be a right hand.

In this case, it is preferable that the pointer position information input area is designed to be closer to the corner where the mode switching part is located than the opposite corner of the corner where the mode switching part is located, and the left hand can be designed on the same principle.

The mode switching unit may determine the text input mode and the pointer position information input mode by the number or position of the user's finger recognized by the pointer position information input unit.

The number of the recognized user fingers when determining the pointer position information input mode is smaller than the number of the recognized user fingers when determining the text input mode.

For example, while controlling the mode switching unit with the left hand, the finger of the left hand may be untouched from the text input button, and the index of the right hand may be touched for inputting the pointer position information, Is one.

On the other hand, when the finger of the left hand and the right hand are touched on the keyboard for text input, the number of the fingers of two to eight recognized users is recognized.

The pointer position information input mode display unit displays the pointer position information input area from the point of time when the mode switching unit is switched to the pointer position information input mode to the time point when the mode is switched to the pointer position information input mode, It can be displayed visually.

The pointer position information input mode display unit may be displayed by the visible light generator from the text input button or the reflected light by the text input button or through the space between the text input buttons.

At this time, the input mode can be displayed even in the text input mode, and the text input mode and the pointer position information input mode can be distinguished from each other.

The pointer position information input mode display unit includes non-visible light generators 701a and 701b or surfaces 702a and 702b coated with a dye that optically reacts with the non-visible light to emit visible light, Can be applied to the interval between the input button or the text input button.

The mode switching unit may further include a hand side determining unit for determining whether the user inputs the pointer position information with a left hand or a right hand.

The display of the pointer position information input display unit can be changed according to the hand side determination unit.

It is possible to flexibly switch the button arrangement and operation of the pointer execution command unit according to the hand side judgment unit.

For example, when the pointer execution command includes a right-click and a left-click, the hand-side determination unit may switch the button to perform the right-click and left-click operations.

The pointer position information input area display unit may display (702a, 702b) different pointer position information input areas according to the determination result of the hand side determination unit.

The mode switching unit may be designed to automatically switch to the text input mode when the pointer position information input from the user is not input for a predetermined time in the pointer position information input mode or when the input is received by the text input button.

The pointer position information input area display unit may apply a dye to a part of the text input button or the text input area so that the pointer input area is visually displayed irrespective of the mode of the mode switching unit so that the pointer input area can be recognized even in the text input mode .

8 is a first embodiment of a pointer position information input device which can be separated from a text input device.

The pointer location information input device 810 is designed to be separated from the text input device 800 and may be combined 801 with the text input device 802 (802).

At this time, the power connection unit 820 included in the pointer location information input device can receive power from the power source of the text input device 800.

The pointer position information input device 801 includes at least one pointer position information input device 105a and 105b and may further include a control unit and an optical filter 504. [

The detachable pointer location information input device 810 may be combined 801 to constitute a pointing location information input area on a plane parallel to the text input area and may be coupled to the left 803 or right 804 of the text input device And the pointing position information input area can be configured on the bottom surface of the text input device.

At this time, the pointing position information input device and the power connection part 820 are designed to be flexibly deformed according to the positional change of the pointing position information input device.

9 is a second embodiment of a pointer position information input device which can be separated from the text input device.

The pointer location information input device 900 includes a built-in power source and receives power from an external or self-contained battery.

When the pointer position information input device 900 is in the first position information input mode 902, the pointer position information input area is parallel to the text input area of the text input device, The housing can be designed.

Or a first position information input mode adjusting device that can adjust the height and tilt of the housing so that the user can arbitrarily adjust the height and angle of the position information input area.

  When the pointer position information input device 900 is in the second position information input mode 904, the pointer position information input area is input with pointer position information at a predetermined height and angle so that the pointer position information input device 900 is parallel to the bottom surface on which the pointer position information input device 900 is placed The housing of the device 900 can be designed.

At this time, preferably, the height of the optical filter 504 in the first position information input mode is higher than the height of the optical filter 504 in the second position information input mode.

When the pointer position information input device 900 is in the third position information input mode 906, the pointer position information input area is formed to include a region perpendicular to the bottom surface on which the pointer position information input device 900 is placed, It is possible to design the housing of the pointer position information input device 900 at an angle with the angle.

The pointer position information input device 900 may include a position information input mode, a second position information input mode, and a third position information input mode so as to distinguish at least two of the first position information input mode, And a sensor unit.

The position information input mode sensor unit may be composed of a sensor utilizing gravity, a sensor detecting a bottom surface, or a switch.

The pointer position information input device 900 may have at least one of the first to third position information input modes.

In particular, in the case of the third position information input mode 906, the mode switching for switching between the text input mode and the pointer position information input mode is replaced with the position information input device 900 whether or not the user's hand or finger is detected .

That is, when the user is entering text, the user's hand or finger is not detected by the location information input apparatus 900 in the third location information input mode.

When the user places a hand or a finger at the top of the position information input device in the third position information input mode 906 to input the position information of the pointer, the position information input device 900 inputs the pointer position information Mode.

Alternatively, a digital device connected to the text input unit 800 and the positional information input device 900 in a wired or wireless manner may display a text input mode And the pointer position information input mode.

Alternatively, when the text input unit 800 connected to the positional information input device 900 by wired or wireless receives the status information of the positional information input device 900 and performs mode switching or the digital device can perform mode switching The information can also be transmitted.

At this time, when the text input is in progress, the position information input apparatus 900 can be switched to the first power saving mode which consumes less power than the pointer position information input mode.

It is possible to switch from the first power saving mode to the active mode during the first first interval after the text input is interrupted.

When the user's hand or finger is not detected during the first first interval after the text input is interrupted, the second power saving mode consumes less power than the first power saving mode.

In the first power save mode, the sensor can be periodically controlled with less power than the active mode to determine the presence or absence of a user's hand or finger.

When the user's hand or finger is detected in the first power saving mode, the mode can be switched to the active mode.

 In the activation mode, the mode can be switched to the pointer position information input mode.

In the pointer position information input mode, the pointer execution instruction unit for executing the pointer execution instruction may be configured to use a button provided in the text input device or to generate a pointer execution instruction based on the position or shape change of the detected user's hand or finger .

The location information input apparatus 900 can be activated by the mode switching unit on the text input apparatus 800. [

10 is a third embodiment of a pointer position information input device which can be separated from a text input device.

The pointer location information input apparatus 1000 may have a housing 1001 that encloses at least two sides of the text input apparatus so that the text input apparatus 800 can be mounted.

The pointer position information input apparatus 1000 includes pointer position information input devices 105a and 105b and a mode switching unit 106, a control unit 1001, a housing 1002, and an optical filter 907 (1010).

After the text input device 800 is mounted on the pointer position information input device 1000 in step 1020 and the pointing position information input area on the top of the input area of the text input device 800 through the optical filter 907 The optical filter is positioned higher than the text input device 800 so that the light source can be transmitted.

At least one surface 1003 surrounding the text input device of the housing 1002 is disposed on the surface 1003 so that the light source emitted from the pointer position information input device 105 can be reflected, transmitted or absorbed depending on the type of the pointer position information input device. Can be treated with mirrors, transparent glass or plastic, or black light absorbers, respectively.

8, 9 and 10 illustrate the following components in an embodiment of a pointing-position-information inputting apparatus that can be detached from a text inputting apparatus.

And a pointer location information input unit for receiving information related to the pointer location from the user.

The pointer position information input unit receives the pointing position information of the user input through the pointing position information input area formed by the pointer position information input device.

And a pointer execution command receiving unit that receives a signal of a pointer execution command unit that receives a user command to perform at least one function in a place where the pointer is located.

The pointer execution command unit may be constituted by a button or a touch switch included in the pointer position information input unit or a control unit for switching to a pointer execution instruction when a predetermined input of the user input received from the text input device is received.

And a mode switching instruction receiving unit for receiving a signal of a mode switching unit for switching to a pointer position information input mode.

The mode switching unit may be configured in a pointing position information input device, or configured in a text input device, or may be configured as a separate device.

And a power unit for transmitting power to the pointer position information input unit, the pointer execution command receiving unit, and the mode switching command receiving unit.

The power source unit may be a power source unit having a self-powered battery or a power source supplied from the outside.

And a pointer position information transmitter for transmitting information related to the pointer position input to the pointer position information input unit to a digital device connected to the human interface device by wire or wirelessly.

Wherein the pointer position information input area of the pointer position information input unit is positioned at a predetermined angle with the predetermined height so that the pointer position information input area can be positioned to be parallel to the upper end of at least a part of a text input area of a text input device composed of a plurality of physical buttons Is set.

Wherein the mode switching unit can be fixed to at least one side of the text input device when the mode switching unit is provided separately from the text input button of the text input device and recognizes that the user input is received in the mode switching unit, And can be transmitted to the mode switching command receiving unit by wire or wirelessly.

The pointer position information input unit may include an optical emitter and a camera, and the optical signal received by the camera may be designed to pass through an optical filter through a light tunnel.

A position state recognition unit for recognizing the position state information about the gravity direction of the human interface or the position state information about the floor on which the human interface is placed or the position information of the human interface through the input of the user.

The position state is composed of at least two kinds, and when the first position state is selected, the mode is switched to the first pointer position information input mode and when the second position state is entered, the mode is switched to the second pointer position information input mode

And the pointer position information input area in the first position state is located in parallel with at least a part of the text input area of the text input device.

The pointer position information input area in the second position state is located so as to be parallel to the floor surface on which the pointing position information input device is placed.

The upper surface of the pointing position information input device in the first pointer position information input mode is positioned to face the bottom surface. When switching to the second pointer position information input mode, the calculation of the ordinate of the pointing position information input is the same, Calculate by changing direction.

The pointer execution command unit may use a space bar among text input buttons of the text input device and may further use another button adjacent to the space bar as a pointer execution command unit.

The power supply unit may receive power from the text input device.

The predefined height and angle of the pointer location input area in the first positional state may be defined by a controller that allows adjustment within a predefined range by the user.

The adjuster can adjust the angle by adjusting the joining angle of the at least one surface of the housing of the pointing position information input device with the adjacent surface.

The controller adjusts the height of at least one surface of the housing of the pointing position information input device.

The controller adjusts the height and angle of the pointing position information input unit by adjusting the height and angle of the optical module of the pointing position information input unit.

11 is a front view of a human interface device to which a lower-positioned pointer positional information input device is applied.

The human interface apparatus includes a text input unit configured by a plurality of physical buttons, a pointer position information input unit for inputting information related to a pointer position from a user, a pointer execution command for inputting a user command to perform at least one function, A mode switching instruction receiving unit for receiving a signal of a mode switching unit for switching to a pointer position information input mode; a power supply unit for supplying power to the pointer position information input unit, the pointer execution command receiving unit, and the mode switching instruction receiving unit; A pointer position information transmitting unit for transmitting information related to a pointer position input to the pointer position information inputting unit to a digital device connected to the human interface device by wire or wirelessly, The information input area is positioned so as to be parallel to the upper end of at least a part of the text input area of the text input part composed of the plurality of physical buttons and the pointer position information input part comprises at least two sensor modules, And the module is located on the lower left 1102 and the right 1103 of the human interface device.

Wherein the pointer position information input unit comprises an optical emitter and a camera, and the optical signal received by the camera passes through a light tunnel.

And the mode switching unit is provided separately from the text input button of the text input device.

The mode switching unit is located on the left side of the text input area of the text input device and recognizes that the user input is received by the mode switching unit and transmits the pointer position information input mode to the mode switching instruction receiving unit.

The physical button is composed of an upper portion of a button receiving pressure from the user's finger and an elastic member applying a physical force to return the upper portion of the button to the original position when the user's finger pressure is removed.

The composite human interface device has a reflector or absorber 1101 for reflecting a light source generated from the pointer position information input unit on the left, right, and upper sides of the text input area, .

The reflector is used when the light source generated from the pointer position information input unit is an infrared ray, and when an infrared ray laser is used, an absorber is used.

The at least two sensor modules 1102 and 1103 of the pointer location information input unit are located at least partially in the left outer area of the text input area and the lower right area of the right outer area. That is, the left sensor includes at least a part of the left side of the control button of the standard window keyboard and is further lowered below the control button, that is, toward the housing corner without the key button. In this way, the sensor module enables the configuration of a minimal volume composite human interface device to maximize the aesthetic effect of the composite human interface.

Also, by orienting the sensor in the diagonal direction of the text input area by locating the sensor near the vertex of the text input area (1110), it is better to position the sensor in the corner area and face the transverse direction of the text input area The pointer position information input area having a wider area can be constituted. In addition, it is possible to maximize the pointer position information input area at the upper part of the text input area by moving the position of the portion where the position information detection accuracy of the pointer position information input area between the sensor and the sensor is relatively low.

In addition, the position of the sensor can be positioned 1120 below the space bar of the standard keyboard to be narrower than the width of the keyboard. The width between the sensor and the sensor determines the width of the pointer position information input area and thereby obtains relatively high pointer position information descriptive resolution although the area of the pointer position information input area is reduced rather than positioned at the corner (1110).

Between the sensor and the sensor, the reflector or absorber is removed, and the height of the housing is lowered to prevent the thumb from being caught by the housing when the user presses the space bar of the standard keyboard with his / her thumb.

12 is an embodiment of the pointer execution command unit integral mode switching unit.

When the input operation in which the text input mode and the pointer position information input mode are frequently changed is performed, the number of times the mode switching and the pointer execution command are input is increased.

For example, in case of right-handed person, when you want to input pointer position information while text input mode is being performed in text input mode, you need to input the pointer position information after inputting to pointer real name command with left hand after switching mode with left or right hand do.

In general, while performing a quick operation, the user is required to input text and pointer position information and a pointer execution command while keeping a gaze on the monitor. If a mode switching unit and a pointer execution command input unit are provided separately, hand movement frequently occurs It is not possible to find the exact position, so it may not be able to perform properly, or it may be troublesome to look at the keyboard with eyes.

In order to solve this problem, for example, in the case of a right-handed person, when a hand is placed on the mode switching unit with the left hand after inputting text in the text input mode, a mode switching command is generated and the mode is changed to the pointer input mode. When the pointer position information is inputted with the right hand while the hand is placed on the mode switching unit, when the pressure is applied to the mode switching unit, the pointer execution command unit can receive the user's input.

Thereby, the user can share the position of the mode switching unit for mode switching and the position of the pointer execution command unit for the pointer execution command.

For example, the mode switching unit may include a touch switch capable of accepting a touch input of a user's hand, and the pointer execution command unit may be disposed under the mode switching unit, which includes a switch responsive to a pressure such as a tact switch.

In this case, the first pointer execution command unit 1104 and the second pointer execution command unit 1105 are connected to each other by a conductor material capable of recognizing a touch from the user's hand or commonly connected to the mode switching unit 1201 So that the user can perform the same mode switching regardless of whether the user touches the first pointer execution command unit or touches the second pointer execution command unit.

At this time, the mode switching is operated in the pointer position information input mode while the touch is being performed, and in the text input mode when the touch is released.

The mode switching by the touch may be composed of another switch operating at a pressure smaller than the pressure for executing the pointer execution command, or a sensor capable of sensing the position of the user's finger.

At this time, the mode switching and pointer execution command unit may be located in an area distinguished from the text input area.

Preferably, in the case of right handedness, it is located in the left outer area of the text input area.

If the mode switching unit and the pointer execution command unit are located outside the text input area, the possibility that the pointer position information input unit is confused with the pointer position information input disappears and the pointer position information input area can be expanded.

The complex human interface apparatus may include a second mode switching unit 1202. The second mode switching unit switches to a text input mode and a pointer position information input mode each time an input is received from a user with a switch operating as a toggle switch. Thus, even if the user does not touch the mode switching unit with the left hand, the pointer position information can be input with only the right hand.

At this time, when the compound human interface apparatus is in the text mode by the second mode switching unit, when the mode switching command by touch is received, the compound human interface apparatus operates in the pointer position information input mode. In addition, when the compound human interface apparatus by the second mode switching unit is in the pointer position information input mode, when the mode switching command by touch is received, the pointer position information input mode is maintained but the mode switching command by touch is released When a text input is received by the text input unit, the mode is switched to the text input mode.

At this time, if the text input mode is switched to the text input mode, at least the first text input is ignored, and when at least two or more text inputs are received, the mode can be switched to the text input mode.

In this case, when at least two or more text inputs are received and the mode is switched to the text input mode, the composite human interface device transmits the text input including at least the first text, which has been ignored, to the digital device, Lt; / RTI >

13 is an embodiment utilizing a lid of a composite human interface device.

The composite human interface device requires space of at least 1 millimeter to 2 millimeters on the top of the text input device plane in which the pointer position information input device is constituted by the physical device to form the pointer position information input area, Or a border for locating the reflector may be required at the edges of at least three sides surrounding the text entry area.

At this time, a difference of at least 1 to 2 millimeters occurs between the height of the edge of at least three corners and the height of the plane of the text input area, and a substantially rectangular space is formed at the upper end of the text input area.

The composite human interface device may further include a multi-purpose cover 1322 for protecting the text input area from an external impact in a space of the substantially rectangular parallelepiped type.

The multi-purpose lid 1322 is separated from the composite human interface device 1320 and can be coupled and separated by a magnet or a physical structure.

The multipurpose cover 1322 may be folded several times. Preferably, the width of at least one area of the divided area of the multipurpose cover may be less than the width of the other area (1341).

This can further reduce the slope of the composite human interface device when the multipurpose cover is folded down and then mounted to adjust the inclination of the composite human interface device.

When the multipurpose cover is folded and then mounted on the bottom surface of the composite human interface device, a part of the folded surface that is in contact with the ground surface may be provided with an inclined surface 1342 so that an area contacting with the ground surface can be widened.

The slope of the composite human interface device desired by the user can be adjusted by the number of times of folding of the multipurpose cover 1322.

The multi-purpose lid may have a built-in rechargeable battery 1323 inside the lid.

An electrode of the power source of the rechargeable battery 1323 may be located at a lower end portion of the multipurpose lid and may be located in a part of a region protruding from a portion covering the text input region 1331. The multipurpose lid covers the text input device (1310), it is connected to the electrode provided at the upper end of the composite human interface apparatus.

Also, when the multipurpose lid is folded and mounted on the lower end to adjust the inclination of the composite human interface device, it can be connected to the electrode provided on the bottom surface of the composite human interface device.

The composite human interface device may be connected to an external power source to supply power to the rechargeable battery 1323 inside the multipurpose lid or separately charge the multipurpose lid.

At this time, the bottom surface of the composite human interface device has a region 1332 covering a protruding edge area where the electrode 1331 is located and a text input area having a height difference, and a magnet or a physical coupling device And a groove into which the cover is inserted.

The rim of the multi-purpose lid is coated with a substance that can remove minute dust, oil, and moisture, and can remove foreign substances from the absorption plate, the reflector, the optical emitter, and the front surface of the camera have.

If the versatile cover covers the text input area, it can detect the text input area and turn off the power of the composite human interface device.

When the multipurpose lid is mounted on the underside of the composite human interface device, the composite human interface device can be powered on.

Also, if there is no input by the user for a certain period of time after the power is turned on, the power can be cut off or the apparatus can be switched to the standby mode.

When the multi-purpose lid covers the text input area (1310), the composite human interface device 1321 has a substantially thin plate-like rectangular parallelepiped shape. When the multi-purpose lid does not have a slope when placed on the ground or when the multi- So that aesthetic effects can be maximized and portability can be enhanced.

On the other hand, if the multipurpose cover is folded and mounted on the bottom of a composite human interface device, the inclination can be secured like a general keyboard.

The multipurpose lid can be constructed in a removable manner, but it can be designed in such a way that it is folded down from the upper surface to the lower surface of the composite human interface device by the hinge.

14 is an embodiment of a human interface device applied to a portable electronic device or a portable electronic device such as a tablet personal computer.

The composite human interface device 1420 can be utilized as an input device of a portable electronic device.

The portable electronic device having the composite human interface device has a structure in which the display unit composed of the display panel 1411 and the frame 1410 supporting the display panel is bundled and opened by the composite human interface device and the hinge 1427 Can be designed.

At this time, the display unit is inserted into the text input area of the human interface device and the substantial hexahedral space formed by the reflection plate or absorbing plate 1424. Thus, the thickness of the portable electronic device using the human interface device can be minimized.

To this end, the display unit of the portable electronic device should be designed to have a width smaller than the width of the human interface device 1420 and at least twice as wide as the thickness of the reflector or absorbing plates 1423 and 1424.

In other words, in Fig. 13, the display unit must be designed so that the multipurpose cover can be inserted into the place.

The display unit has a feature 1413 that allows both corners to be rounded or cut into oblique lines.

The pointer position information input devices 1421 and 1422 are characterized in that when the display unit is folded, the pointer position information input devices 1421 and 1422 are positioned toward the outer edge of the rounded or obliquely cut portion.

This is to collapse the portable electronic device so as to maintain a thin thickness without being disturbed by the pointer position information input devices 1421 and 1422 when the portable electronic device is folded.

At this time, the mode switching unit and the pointer execution command unit are located outside the side text input area of the human interface unit, the mode switching unit is located at the outer side of the text input area, and the pointer execution command unit is at least one of the text input buttons, Both the part and the pointer instruction execution part can be made to operate as at least one of the text input buttons.

(1425, 1426), and more preferably, can be located outside the text input area.

At this time, it is preferable that the mode switching unit and the pointer execution command unit are integrally formed as shown in FIG. 12, but they may be separately disposed.

In this case, when the mode switching unit or the pointer execution command unit is located outside the text input area, when the user places a finger to control the mode switching unit or the pointer execution command unit, the pointer position information input devices 1421 and 1422 The pointer position information input area must be set excluding the area where the mode switching unit or the pointer execution command unit is located so that the user does not malfunction by inputting the position information of the pointer.

For this purpose, it is possible to design an optical signal to be prevented from reaching the mode switching unit or the pointer execution command unit by adjusting an area covered by the optical signal generated from the pointer position information input device.

Or an optical signal receiving angle of the camera is adjusted so that the camera does not receive an optical signal generated by reflection, interference, or blocking between the user's finger and the optical signal located in the mode switching unit or the pointer execution command unit, The optical signal can be ignored.

The portable electronic device is designed to have at least three corners of an absorption plate or a reflection plate for absorbing or reflecting a light source generated in the pointer position information input device.

At this time, the two faces are located on the side of the human interface device (1423, 1424), and the other face is on the face where the display unit is in contact with the human interface device, the pointer position information input device 1421 , 1422 can be placed in a certain area 1412 of the display unit edge so that the light source generated by the display unit 1422 is sufficiently reflected or absorbed.

In Fig. 14, the display unit may be constituted by a flexible display unit, and may be wound around the text input area of the composite human interface device and bent and fixed to the bottom surface of the composite human interface device.

14, the display unit can be replaced with the multipurpose cover described in FIG. 13, and an absorber or a reflector can be positioned at a corner portion bonded to the composite human interface device of the multipurpose cover. The display unit is folded backward by the hinge, It can also be used to adjust the height of the interface device.

FIG. 15 shows an embodiment in which the lower position pointer type position information input device and the lower position type pointer execution command portion are applied.

The human interface apparatus includes a text input unit 1501 including a plurality of physical buttons, a pointer position information input unit for inputting information related to the pointer position from a user, a pointer for inputting a user command to perform at least one function, A pointer execution command receiving unit for receiving a signal of the execution command units 1505 and 1506, a mode switching command receiving unit for receiving a signal of a mode switching unit for switching to a pointer position information input mode, A pointer position information input unit for transmitting pointer information to a digital device connected to the human interface device through a wired or wireless connection; and a pointer position information input area for inputting pointer position information of at least a part of a text input area of the text input unit, Of And the pointer position information input unit may include optical signal reflectors or absorbers 1503a, 1503b, and 1503c formed on the first to third surfaces 1502a, 1502b, and 1502c that are higher than the height of the text input unit, And the fourth surface 1502d surrounding the tex-ins input unit is formed to be lower than the height of the first to third surfaces and the fourth surface may include the pointer execution command units 1505 and 1506 have.

The first surface and the third surface may be located on the left and right sides of the text input unit, the second surface may be on the upper side of the text input unit, and the fourth surface may be on the lower side of the text input unit.

The pointer location information input unit may include at least two sensor modules, and the two sensor modules may be located at a lower left corner and a lower right corner of the text input unit, respectively. Wherein the mode switching unit is operated by a first input of a user inputted to a first button and the pointer execution command receiving unit is operated by a second input of a user inputted to the first button,

The first button may be formed of a material capable of sensing an electrical signal generated by a finger touch, and the first input may be generated by recognizing the electrical signal.

The pointer position information input mode is released while the first input is released and the first input is generated by the physical pressure when the first input is released.

The mode switching unit may be operated by a second input of the user inputting to the second button, and when the second input is inputted once, it is activated when the pointer position information input mode is released and the pointer position information input mode If it is activated, it can be released.

16 is an embodiment of a digital device using a sensor module whose height is changed.

17 is a conceptual diagram illustrating a change in the position of the sensor module depending on whether or not the display device is engaged.

The display device 1606 including the display portion 1608 may bind the display device and the human interface device to easily carry the human interface device.

Also, the user can tilt the human interface device for use so that the user can view the display unit.

The sensor modules 1601a and 1601b for obtaining pointer position information are formed higher than the height of the keyboard 1603. Therefore, when the height of the sensor module is reduced, the thickness of the display device can be reduced when the display device is bound to the human interface device for carrying.

The pointer position information input unit includes a sensor module, and the sensor module may have a first mode 1710 and a second mode 1720 due to a change in height.

The first mode is a mode in which the height of the sensor module is higher than that of the second mode and is generally operated.

In the first mode, the pointer position information input mode is activated or deactivated according to the input state of the mode switching unit 1604, but the second mode is a state in which the pointer position is closed or the pointer position information input unit is disabled The information input mode can be set to be always released.

The sensor module may be automatically switched to the second mode when the display device is mounted on the human interface device.

The display device can be switched from the first mode to the second mode by the power by recognizing that the display device is changed from the first mode to the second mode or the display device is covered while the height is changed by the pressure pressed by the display device.

And a binding apparatus which binds the human interface apparatus and the display apparatus to be fixed when the display apparatus is mounted on the human interface apparatus.

When the sensor module is switched from the first mode to the second mode when the sensor module is switched to the second mode due to the pressure of the display device, the elastic body 1712 may be compressed to lift the display device by a certain amount.

At this time, it is possible to prevent the display device from being lifted up by the binding device, and when the user tries to use the digital device and releases the binding device, the display device lifts up a certain amount,

The sensor module may require a reflector 1602 that reflects or reflects an absorber 1602 that absorbs an optical signal emitted from the sensor module on at least three sides of the tebri of the pointer position information input area.

The absorber or the reflector on one of the at least three sides may be included in a first side of the display device that is abutted when the display device is bound for use with the human interface device (1602d).

Or may be configured outside the text input area of the human interface device (1602b) and the height may be changed in a manner similar to the sensor module.

The absorber or the reflector on the other two sides may be located on two sides outside the text input area of the human interface device (1602a, 1602c).

The sensor module may be located outside the text input area on the same line as the bottom line where the space bar 1603 is located as a standard keyboard in the text input area.

In this case, it becomes easy to distinguish the non-pointer position information input recognized from the user's finger operating the mode switching unit, the pointer execution command unit, and the like. However, there is a disadvantage that the width of the human interface device is widened.

When the sensor module 1601 is positioned at the left and right edges of the lower line of the line where the space bar 1603 is located by the standard keyboard in the text input area and the pointer execution command unit 1604 is disposed therebetween, The width can be reduced and the operation can be facilitated, thereby improving usability.

The mode switching unit 1604 is operated by the first input of the user input to the first button 1604 and the pointer execution command receiving unit 1604 receives the second input of the user input to the first button 1604 As shown in Fig.

Wherein the first input applied to the first button is configured to be generated by sensing a touch of a user's finger and operates in the pointer position information input mode while the first input is maintained and when the first input is released, The input mode can be released.

The second input may be generated by a physical pressure.

The second input may be generated by a double tap or a signal swiping up or down or right and left.

The first button may operate as the mode switching unit or the pointer execution command unit.

The first button may be formed to have a lower contact surface than the surface of the human interface body surrounding the first button so that the user can be touched or pressed by mistake while the user is operating in the text input mode and mode switching is performed or a pointer execution command is not generated have.

The rim of the first button and the body of the human interface are rounded and smoothly connected so that the user can easily operate the first button and have a good feel.

The digital device may further include a function key or a text input key for use in the pointer position information input mode separately from the text input area.

For example, you can add additional function keys such as control keys, shift keys, alt keys, and other frequently used keys, such as the English alphabet or Apabbet of text input.

Or a single key having the same function as pressing a plurality of keys at the same time. For example, you can add a separate copy or paste key to achieve the same effect as pressing a control key and an alphabetic letter, usually a copy or paste, or an alphabetic letter V or control key at the same time.

The additional configuration key may be located outside the text input area on the side where the mode switching unit or the pointer execution command unit is provided.

The additional configuration key may be configured to perform a function by a second input of a user to cause a mode change to be made by the first input of the user in the same format as the first button.

1 to 17 illustrate an example of a composite human interface device or a digital device to be described in the present specification, and the respective embodiments are not limited to the techniques described in the respective embodiments, and the technical features described in the above- It can be applied to other embodiments. Also, the type of the text input device pointing position information input device and the technique used include those capable of being changed or replaced without departing from the basic purpose or function by a person skilled in the art.

Claims (16)

In a digital device connected to a human interface device by wire or wirelessly,
A text input unit configured by a plurality of physical buttons,
A pointer position information input unit for receiving information related to the pointer position from the user,
A display device having a display unit and displaying a pointer whose position is changed by information related to the pointer position,
A pointer execution command unit that receives a user command to perform at least one function in a location where the pointer is located,
A mode switching unit for switching to a pointer position information input mode,
A pointer position information transmission unit for transmitting information related to a pointer position input to the pointer position information input unit to the display device,
Wherein the pointer position information input area of the pointer position information inputting part is located at a top of at least a part of a text input area of the text input part composed of the plurality of physical buttons so as to be in parallel with the text input part, Wherein the pointer location information input unit includes a sensor module, and the sensor module has a first mode and a second mode with a change in height. The digital device as claimed in claim 1, wherein an absorber or reflector for absorbing an optical signal generated by the sensor module is included in the second side and the third side and the fourth side that surround the text input part. The digital device according to claim 2, wherein the absorber or the reflector on at least one side of the second side, the third side, and the fourth side is included in the first side of the display device. The digital device according to claim 1, wherein the mode switching unit is located outside a text input area of the text input device. [2] The apparatus of claim 1, wherein the physical button comprises an upper portion of a button for receiving pressure from a user's finger and an elastic member for applying a physical force to return the upper portion of the button to a home position when the user's finger pressure is removed. device. The digital device as claimed in claim 1, wherein the first side is located below the text input unit. The digital device as claimed in claim 1, wherein the pointer position information input unit includes at least two sensor modules, and the two sensor modules are positioned at a lower left corner and a lower right corner of the text input unit, respectively. The apparatus of claim 1, wherein the mode switching unit is operated by a first input of a user input to a first button, and the pointer execution command receiving unit is operated by a second input of a user input to the first button A digital device. 9. The method of claim 8, wherein the first input applied to the first button is generated by sensing finger touch of a user, wherein the first input is operated in the pointer position information input mode while the first input is maintained, And releases the pointer position information input mode when the input is released, wherein the second input is an input signal generated by physical pressure. The apparatus of claim 8, wherein the mode switching unit is operated by a second input of a user input to the second button. When the pointer input mode is released when the second input is input once And when the pointer position information input mode is activated, the digital device is released. 2. The method according to claim 1, wherein the first mode is higher in height than the second mode, wherein the pointer position information input mode is activated or deactivated in the first mode and the pointer position information And the input mode is always released. The digital device according to claim 1, wherein the sensor module is switched to a second mode when the display device is mounted on the human interface device. The display device according to claim 1, further comprising a binding device for binding the human interface device and the display device when the display device is mounted on the human interface device, wherein when the binding device is released, And the display device is audible by a predetermined amount. The digital device as claimed in claim 8, wherein the first button is formed lower than the surface of the human interface body surrounding the first button. [2] The apparatus according to claim 1, wherein the digital device further comprises an auxiliary button located outside the text input unit, the auxiliary button being overlapped with a text input button or a function button of the text input unit, device. A method for processing information in a digital device connected to a human interface device by wire or wireless,
Receiving text input from a text input comprising a plurality of physical buttons,
Receiving pointer position information from a pointer position information input unit receiving information related to a pointer position from a user,
Displaying a pointer on a display device having a display unit whose position changes according to information related to the pointer position,
Receiving a pointer execution instruction from a pointer execution instruction unit that receives a user instruction to perform at least one function at a location of the pointer,
Receiving a mode switching command from a mode switching unit for switching to a pointer position information input mode,
And transmitting information related to the pointer position input to the pointer position information input unit to the display device
Wherein the pointer position information input area of the pointer position information inputting part is located at a top of at least a part of a text input area of the text input part composed of the plurality of physical buttons so as to be in parallel with the text input part, Wherein the pointer location information input unit includes a sensor module, and the sensor module has a first mode and a second mode with a change in height.

Images