TWI690839B - Electrical device and process to operate an electrical device - Google Patents

Abstract

An information appliance (1) including a module (2), wherein the module (2) is adapted to provide a human-machine interface for the information appliance (1), wherein the information appliance (1) has a display member (1' ), wherein the display member (1′) mainly extends along the display surface (100′), wherein the module (2) is adapted to position the object (4) in the positioning area (30, 30′), wherein the The module (2) is suitable for generating a primary beam (3), wherein the module (2) has a scanning mirror structure (7, 7'), wherein the scanning mirror structure (7, 7') can be in some way Is controlled so that the primary beam (3) performs a scanning movement substantially along the irradiation surface (30) located in the positioning area (30, 30'), characterized in that the irradiation surface (30) is parallel to the display member The display surface (100') of (1') extends, wherein the illuminated surface (30) and the display surface (100') at least partially overlap.

Description

Information appliances and methods of operating information appliances

The starting point of the present invention is an information appliance as described in the quotation of item 1 of the patent application scope.

Information appliances that include a human-machine interface are known to me.

The purpose of the present invention is to propose an information appliance including a human-machine interface, wherein the information appliance can both improve user experience and detect user gestures relatively accurately.

Compared with the prior art, the advantage of the information appliance of the present invention and the method of the present invention as described in the parallel item is that it provides a relatively compact and simple-structured information appliance including a virtual human-machine interface for a display member, wherein the Information appliances can identify user commands relatively quickly, but accurately and reliably. In addition, the object can be positioned very quickly, especially the finger, so as to realize a module that can be applied very flexibly and recognize user commands by collecting user gestures. Therefore, the user experience is improved compared to the previous technology. Due to the modular structure, it is possible to adjust each component or the entire module more flexibly according to the specific requirements of each information appliance. The human-machine interface is also referred to herein as Human-Machine-Interface (HMI), and the module is also referred to as an HMI module. In particular, the human-machine interface is a virtual interface, that is, a user interface that inputs user gestures and/or commands through non-contact detection of objects.

In particular, the human-machine interface refers to a user interface through which the user can interact with or input commands to the information appliances and/or modules in some way to control the information appliances and/or modules And/or operation. This module is especially used as a command transmitter for information appliances. The object is preferably a finger, a pen, or another object placed and/or moved by the user in the positioning area. In particular, positioning here refers to the detection of the distance between the object and the module and/or the position of the object relative to the module when the primary beam and the secondary signal are used, wherein, The secondary signal is generated by the interaction of the primary beam and the object, and the secondary signal returns to the module. In particular, interaction here refers to the reflection of the primary beam on the object. The light source is preferably suitable for generating the primary beam entering the positioning area, wherein the primary beam includes, for example, a visible beam and/or an infrared beam. In particular, the scanning movement of the primary beam substantially along the irradiation surface refers to the periodic offset movement of the primary beam between the two positioning limits of the positioning zone, even when a pulsed beam is used It involves scanning movement. The module is preferably suitable for detecting the secondary signal, wherein when the object is in the irradiated surface, the secondary signal is generated particularly by the interaction of the primary beam and the object, so that Detect this secondary signal. According to a preferred embodiment, the illuminated surface is at least partially (ie within the partition of the display plane) or completely (ie within the entire display plane) along a projection direction that is substantially perpendicular to the display plane of the display member The display planes overlap. In particular, the display plane refers to a display device with limited space, especially with a solid, flat display surface, such as a screen. In particular, the module adopts a certain configuration scheme to provide a touch screen function for the display member. Here, providing a touch screen function means, for example, that a touch screen is generated on a non-touch-sensitive display member (that is, a display member without a touch screen function) by the module, wherein the display member can be displayed on the display member through contact The display area on the Control. The display area includes, for example, image elements, menu elements, text elements, or another display element.

For advantageous design schemes and improvement schemes of the present invention, please refer to the attached items and the description made in conjunction with the drawings.

According to a preferred improvement, the illumination surface and the display plane are separated by 0.1 to 4 mm, preferably by 0.5 to 2 mm, and optimally by 1 mm.

This will ensure reliable detection of user commands. The distance between the display plane and the illuminated surface is relatively small, so for example, when the object comes into contact with the display member in the display plane, the user instruction is recognized.

According to another preferred improvement, the module is adapted to provide a touch screen function for the display member of the information appliance.

In this way, the manufacturing complexity of the display member can be reduced because the display member itself can be non-touch sensitive. However, user gestures can still be detected relatively accurately and reliably.

According to another preferred improvement, the module is adapted to generate another primary beam incident into the positioning area, wherein the module adopts a certain configuration scheme such that the other primary beam is located substantially along the positioning area The other illuminating plane inside performs another scanning movement, wherein the other illuminating surface extends parallel to the display surface of the display member, wherein the illuminating surface, the other illuminating surface, and the display surface at least partially overlap.

In this way, the object can be positioned with relatively high accuracy, thereby generating the signal for deriving the command information. By implementing more precise positioning, the commands entered by the user can be identified more accurately. In this way, a reliable human-machine interface can be provided even if the entire module (for example, in a mobile application) vibrates or oscillates.

According to another preferred improvement, the module is adapted to generate a positioning signal, which is used to derive a command information according to the user gesture detected by the module.

Therefore, the module and/or the information appliance may adopt a certain configuration scheme to derive the instruction information from the signal. The module is, for example, an independent device, a module integrated in the information appliance, or a module connected to the information appliance.

According to another preferred improvement, the irradiation surface and the other irradiation surface are substantially parallel to each other and spaced apart by an irradiation distance, wherein the irradiation distance is preferably 0 to 50 mm, particularly preferably 1 to 5 mm, and most preferably 3 Mm.

In this way, it is also possible to detect the movement of the object along the projection direction substantially perpendicular to the illuminated surface, so as to reliably click and/or touch the movement of one or more objects, and/or to multiple points, for example Touch motion to recognize.

According to another preferred improvement, the module is integrated in the information appliance, or the module is an additional device connected to the information appliance.

In this way, a module with a modular structure can be provided, which can be flexibly adjusted for multiple information appliances and/or various applications according to the modular concept, for example. For example, multiple existing information appliances can use this module.

According to another preferred improvement, the information appliance is a notebook computer, a personal computer, a tablet computer and/or a TV, wherein the display member is a screen, especially a liquid crystal screen, a cathode ray tube display, a plasma screen or a light-emitting two Polar body (LED) screen.

In this way, information appliances matching multiple applications can be provided.

According to a preferred improvement of the method of the present invention, in the fourth operation step, a positioning information is generated based on the detected secondary signal, wherein in the fifth operation step, a use is generated In order to derive the positioning signal of the command information based on the positioning information, in particular, the module transmits the positioning signal for controlling the information appliance to the information appliance.

In this way, user instructions can be relatively reliably and accurately identified, thereby improving user experience.

According to another preferred improvement of the method of the present invention, the command information is derived from the positioning signal in a manner such that the command information includes information about the movement of the object relative to the illuminated surface.

In this way, a human-machine interface with improved user experience can be provided, in which the module improves the recognition of user commands.

For the embodiments of the present invention, refer to the drawings, and these embodiments will be further described below.

1': display widget

1": input widget

2: Module

2': the bottom of the module, another module

3: primary beam

3': primary beam

3": primary beam

4: Object

5: secondary signal

5': Another secondary signal

6: Light source

6': another light source

7: Scanning mirror structure, scanning mirror element

7': another scanning mirror element

8: Wide-angle optical system

8': Mirror element

8": Another mirror element

9: Optical detection element

9': Optical detection element

10: base, bearing surface

11: Irradiation distance

12: Offset distance

13: Irradiation distance

14: cable connection

21: The first sub-module, optical module

22: Second sub-module, scanning module

23: Third sub-module, first control and/or detection module

24: Fourth sub-module, analysis module

25: Fifth sub-module, second control and/or detection module

26: Sixth sub-module, control module

27: The seventh sub-module, camera module

28: Eighth sub-module, communication module

30: Irradiation surface, positioning area

30': Another illuminated surface, positioning area

100: main extension plane

100': display surface

100": input surface

101: Irradiation direction

101': the first irradiation direction, the first positioning limit

101": Second irradiation direction, second positioning limit

103: Projection direction

500': time

500": positioning signal value

501: first time interval

502: second time interval

503: third time interval

504: Fourth time interval

505: Fifth time interval

506: sixth time interval

1 to 7 show modules in different embodiments of the present invention, FIGS. 8 to 12 show information appliances in different embodiments of the present invention, and FIG. 13 is a signal curve of signals in one embodiment of the present invention .

In the drawings, the same components are always indicated by the same element symbols, so these components are usually named or mentioned only once.

FIG. 1 is a schematic diagram of a module 2 for providing a human-machine interface in an embodiment of the present invention. According to this embodiment, the module 2 is suitable for positioning the object 4 arranged in the irradiation surface 30. The module 2 adopts a certain configuration scheme, so that the primary beam 3 is generally along the irradiation surface 30 A scanning motion is carried out in which the secondary signal 5 is detected when the primary beam 3 interacts with the object 4 in the irradiation surface 30 in such a way as to generate the secondary signal 5. For example, when the primary beam 3 is emitted along the irradiation direction 101 and is incident on the object 4, and when the object viewed from the module 2 is in the irradiation surface 30 along the irradiation direction 101, the primary beam 3 is transmitted The reflection on the object 4 generates the secondary signal 5.

The module 2 is suitable for positioning the object 4 by detecting the secondary signal 5, wherein the object 4 is positioned according to distance detection and/or intensity detection, in particular distance detection by time-of-flight method and /Or intensity detection through intensity measurement, wherein the intensity detection includes comparing the intensity of the measured secondary signal 5 with the reference intensity. For example, the reference intensity is measured in the reference measurement, and the reference intensity is stored in the module 2.

The positioning of the object 4 here refers to: determining the position of the whole object or only a part of the object (for example, the projection point generated by the primary beam 3 on the surface of the object 4), wherein the position determination is based on the module 2 Determining the distance or spacing from the object 4 (or object part), and/or based on the position of the projection point (associated with the object part) relative to another (associated with another object part) projection point In particular, the projection point and another projection point are generated at different time points during the scanning motion.

The module 2 preferably has a first submodule 21, a second submodule 22, a third submodule 23, a fourth submodule 24, a fifth submodule 25, a sixth submodule 26, a seventh Submodule 27, eighth submodule 28 and/or other submodules. In this way, a module 2 with a modular structure can be provided, which can be adjusted in a way that matches multiple different information appliances and/or application instances according to the modular concept.

According to an exemplary embodiment of the module 2, the first sub-module 21 is suitable for The optical module 21 generating the primary beam 3 and/or another primary beam, and/or the second sub-module 22 is suitable for generating the scanning motion of the primary beam 3 and/or another primary beam The scanning module 22 of another scanning motion, and/or the third sub-module 23 is a first control and/or detection module adapted to generate a detection signal regarding the secondary signal 5 and/or another secondary signal Group 23, and/or, the fourth submodule 24 is an analysis module 24 for generating positioning information, and/or, the fifth submodule 25 is a second control and/or detection module 25, and/or Alternatively, the sixth sub-module 26 is a control module 26 for controlling the power supply, and/or, the seventh sub-module 27 is a camera module, and/or, the eighth sub-module 28 is suitable for A communication module 28 for information appliances to communicate and/or transmit data to the information appliances.

FIG. 2 shows the module 2 in an embodiment of the present invention. The module 2 has a light source 6 for generating the primary beam 3. The light source is preferably a laser diode, such as a surface-emitting laser. In particular, the primary beam 3 generated by the light source 6 is a visible beam 3 (ie, light with a wavelength of 380 nanometers (nm) to 780 nanometers) or an infrared (IR) beam 3.

According to this embodiment, the module 2 has a scanning mirror structure 7 including microelectromechanical scanning mirror elements 7. Specifically, the module 2 adopts the following configuration scheme: the primary beam 3 is deflected by the scanning mirror structure 7 so that the primary beam 3 extends substantially along the (flat) irradiation surface 30. The micromechanical scanning mirror element 7 can be adjusted to a plurality of deflection positions between the two maximum deflection positions (of the scanning mirror element 7 or another scanning mirror element). In the first maximum deflection position among the two maximum deflection positions, the primary beam 3 is emitted along the irradiation surface 30 through the scanning mirror structure 7 in the first irradiation direction 101 ′. In the second maximum deflection position among the two maximum deflection positions, the primary beam 3 is emitted along the irradiation surface 30 through the scanning mirror structure 7 along the second irradiation direction 101". Here, the first irradiation direction 101' and the first Two irradiation directions 101" to define the positioning limit of the positioning area 30 101', 101". Specifically, in this embodiment, "positioning area 30" and "irradiation surface 30" have the same meaning. In particular, the micromechanical scanning mirror element 7 adopts a certain configuration scheme, so that when a control signal is applied to the scanning mirror element 7, the scanning mirror element 7 performs a deflection movement between the two maximum deflection positions. In particular, the primary beam 3 is a laser beam 3, such as a continuous laser beam 3 or a pulsed laser beam 3.

In particular, the primary beam 3 is moved by a scanning frequency during the scanning movement, wherein the scanning frequency is related to the scanning period of the scanning movement. In particular, during the scan period, the primary beam 3 reaches the second positioning limit 101" (from the element symbol as "from the first positioning limit 101' (shown by the elementary beam with element symbol 3')" The 3" primary beam is shown) and then scanned or shifted back to the first positioning limit 101'. The scanning frequency is preferably 1 to 2000 Hertz (Hz), particularly preferably 5 to 500 Hertz, and most preferably 10 to 200 Hertz.

In the deflection position between the maximum deflection positions of the scanning mirror element 7, the primary beam 3 is emitted in the irradiation direction 101. When the object 4 (for example, the user's finger 4) is arranged or located in the irradiation surface 30 in such a way that the object 4 contacts or intersects with the irradiation surface 30, the interaction (eg reflection) of the object 4 through the primary beam 3 To generate secondary signal 5. For example, through the movement of the object 4, the object 4 moves into the irradiation surface 30 along the projection direction 103 perpendicular to the irradiation surface 30, so that the object 4 is arranged on or in the irradiation surface 30. In this case, when the primary beam 3 is emitted along the irradiation direction 101 (during the scanning movement), the secondary signal 5 is generated.

The module 2 includes an optical detection mechanism 9 suitable for detecting the secondary signal 5, which includes, for example, an optical detection element 9 in the form of a photodiode. According to an alternative embodiment, especially when the light source is a VCSEL, the optical detection element 9 including the light source function is integrated. The module 2 is preferably adapted to be generated based on the secondary signal 5 detected by the optical detection element 9 One detection signal. In particular, the module 2 is adapted to generate positioning information according to the detection signal. Preferably, the module 2 is adapted to generate position detection regarding one deflection position of the scanning mirror element 7 and/or another deflection position of another scanning mirror element during the detection of the secondary signal 5 Signal to generate the positioning information in a time-resolved manner based on the detection signal and the position detection signal. Specifically, the positioning information includes distance information about the distance between the object 4 and the module 2, and/or orientation information about the orientation direction of the object 4 relative to the module 2, and/or about the projection point on the object surface of the object 4 Position coordinates on the coordinates. In particular, the module 2 is suitable for positioning the object through time-of-flight (English: Time-of-Flight, TOF, Detection) and/or through intensity comparison through time-resolved analysis.

FIG. 3 shows the module 2 in an embodiment of the invention. The figure shows a system including a module 2 and a base 10, wherein the module 2 has a module bottom surface 2', which bottom surface is abutted against a base 10 (support surface) such as a workbench. In this embodiment, the support surface 10 mainly extends along the plane 100. In particular, the module 2 adopts a certain configuration scheme, so that when the module 2 abuts on the support surface 10 through the module bottom surface 2', the irradiation surface 30 and the main extension plane 100 are substantially parallel to each other, and There is an irradiation distance 11 (in the projection direction 103 perpendicular to the irradiation surface 30) between the support surface 10 and the irradiation surface 30. The irradiation distance 11 is preferably 0.1 to 10 millimeters (mm), particularly preferably 0.5 to 5 mm, and most preferably about 1 mm.

According to another preferred improvement, the module 2 has a wide-angle optical system 8, wherein the wide-angle optical system 8 or the extended optical system 8 has a convex mirror optical system, a concave mirror optical system, and a DOE (Diffractive Optical Element) and/or a lens or lens system. Preferably, the primary beam 3 toward the scanning mirror structure 7 is deflected in some way and toward the wide-angle optical system 8 so that the wide-angle optical system 8 passes through The primary beam 3 is deflected to the irradiation surface 30. According to the present invention, the wide-angle optical system 8 can select the angle through which the primary beam 3 passes is larger than the scan angle of the scan mirror 7. The beam shaping optical system of the light source 6 is preferably matched with the wide-angle optical system 8 in a manner such that the diameter of the beam shaping of the primary beam 3 after the wide-angle optical system 8 does not exceed 5 mm, preferably does not exceed 3 mm, preferably not more than 1 mm, and best not more than 0.5 mm.

In the embodiment shown in FIG. 3, the light source 6, the scanning mirror element 7 and the optical detection element 9 are generally arranged in the first module plane, and the wide-angle optical system 8 is arranged in the second module plane, wherein The first and second module planes are substantially parallel and spaced apart from each other by a certain distance. In this way, a module 2 with a very compact structure can be provided. As an alternative, according to the present invention, the light source 6, the scanning mirror element 7, the optical detection element 9, and the wide-angle optical system 8 may be arranged in a common module plane.

FIG. 4 shows the module 2 in an embodiment of the invention. The figure shows an offset distance 12, where the offset distance extends from the first position of module 2 (module 2 emits the primary beam 3 at the first position) to the second position of module 2 (module Group 2 detects the secondary signal 5 at the second position). The first position corresponds to, for example, the beam output area 34 (see FIG. 3) of the module 2, and the second position corresponds to, for example, the detection area of the module 2, in which the optical detection element 9 is arranged . In the present invention, the offset distance 12 is less than 5 cm, preferably less than 2 cm, and most preferably less than 1 cm.

FIG. 5 shows the module 2 in an embodiment of the present invention. In this embodiment, the module 2 includes a light source 6 and another light source 6'. The further light source 6'is suitable for generating another primary beam 3'. Here, the scanning mirror configuration 7 is suitable for generating another scanning movement of the further primary beam 3'substantially along the other irradiation surface 30'. Here, the irradiated surface 30 and the other irradiated surface 30' form a positioning area 30, 30'. In particular, the other scanning motion of the other primary beam 3'and the scanning motion of the primary beam 3 can be implemented by the same or different scanning frequencies, and/or in a synchronous or asynchronous manner. The wide-angle optical system 8 here has a mirror element 8 ′ and another mirror element 8 ″. Through the scanning mirror element 7, the primary beam 3 is directed toward the mirror element 8 ′, and the other primary beam 3 ′ is directed toward the other mirror element 8". Here, the mirror element 8 ′ and the other mirror element 8 ″ adopt a certain configuration scheme, so that the primary beam 3 is emitted along the irradiation surface 30 during the scanning movement, and along the other irradiation during the other scanning movement The surface 30' emits another primary beam 3'. Here, the irradiation surface 30 is separated from the other irradiation surface 30' by an irradiation distance 13 along the projection direction.

When the object 4 is arranged in the irradiation surface 30 and the primary beam 3 interacts with the object 4, a secondary signal 5 is generated and detected by the optical detection element 9. When the object 4 is arranged in another irradiation surface 30', and the other primary beam 3'interacts with the object 4, another secondary signal 5'is generated and passes through the optical detection element 9 to the other secondary Signal detection. According to an alternative embodiment (not shown), especially when the light source 6 and the other light source 6'are VCSELs, the secondary signal 5 is detected through the light source 6, and the other light source 6' Primary signal 5'is detected. By using two (flat and parallel) irradiation surfaces 30, 30', the object 4 can have a relatively high positioning accuracy.

FIG. 6 shows the module 2 in an embodiment of the present invention. The difference between the embodiment shown in this figure and the embodiment shown in FIG. 5 is that the light source 6 and another light source 6'adopt the following layout or arrangement scheme: the primary beam 3 and another primary beam 3'are carried out in some way Guidance so that the primary beam 3 is emitted substantially along the irradiation surface 30 and another primary beam 3'is emitted generally along the other irradiation surface 30', wherein the primary beam 3 and the other primary beam 3'are from the light source 6 or another light source 6'is incident on the scanning mirror structure 7 at approximately the same point. The wide-angle optical system 8 uses, for example, a free-form body.

FIG. 7 shows the module 2 in an embodiment of the present invention. In this embodiment, the module 2 has a scanning mirror structure 7, 7 ′, which includes a microelectromechanical scanning mirror element 7, another microelectromechanical scanning mirror element 7 ′, and a wide-angle optical system 8. Here, the irradiation surface 30 and the other irradiation surface 30' are arranged in the same plane, wherein the scanning beam element 7 causes the primary beam 3 to perform a scanning movement substantially along the irradiation surface 30, and, through the other scanning mirror element 7'causes another primary beam 3'to perform a scanning movement substantially along the other irradiation surface 30'. In this way, a relatively high angular resolution can be achieved when positioning the object 4.

FIG. 8 shows an information appliance 1 in an embodiment of the present invention. Specifically, the information appliance 1 is a portable computer (such as a laptop computer, a notebook computer, or a tablet computer) or a personal computer.

In this embodiment, the information appliance 1 has a display member 1 ′, an input member, and a module 2. The display member 1'is, for example, a screen, especially a liquid crystal screen, a cathode ray tube display, a plasma screen, or a light emitting diode (LED) screen. The display member 1 ′ mainly extends along the display surface 100 ′. Specifically, the display surface 100 ′ is a space-restricted surface 100 ′ of the display member 1 ′. The input member here includes an input area for inputting user instructions. The input member mainly extends along the input surface 100", in particular, the input surface 100" is another space-restricted surface 100" of the input member. The input member preferably includes an input area of the information appliance 1 for inputting user instructions According to this embodiment, the module 2 is integrated in the information appliance 1 in such a way that the irradiation surfaces 30, 30' including the irradiation surface 30 (and in particular the other irradiation surface 30') are substantially parallel to the information appliance 1 The input surface extends 100". This point means, for example, that the module provides a human-machine interface used here as a keyboard and/or mouse replacement. In this embodiment, the irradiation surface 30 (and in particular the other irradiation surface 30') is preferably spaced from the input member by a certain distance. In addition, the irradiation surface 30 (and the other irradiation surface 30') is perpendicular to the input The input plane 100" and/or the projection direction of the irradiation surface 30 overlaps the input surface 100", so the irradiation surfaces 30, 30' and the input surface 100" at least partially or completely overlap. Specifically, the module 2 is a monolithic integration In (ie, loaded into) the information appliance 1, or as an alternative, the module is connected to the information appliance in a reversible (removable) manner or inserted into the slot of the information appliance 1.

FIG. 9 shows an information appliance 1 in an embodiment of the present invention, where this embodiment generally corresponds to the embodiment shown in FIG. 8, where the module 2 is arranged on the device 1 in a certain manner so that the display A touch screen function (Touchscreen function) is provided on the component 1'. This point means, for example, that the display device 1 ′ of the information appliance 1 (especially a non-touch-sensitive type that does not have a touch screen function by itself) has touch-sensitive characteristics through the module 2. Preferably, the display member 1'in the form of a touch screen is generated through the module 2, wherein when the object approaches the display area, and thus the object 4 is positioned through the module 2, the display on the display member 1'is displayed through the display When the area is in contact, the information appliance 1 (possible) is controlled. The display area has, for example, image elements, menu elements, text elements, or another display element.

FIG. 10 shows an information appliance 1 in an embodiment of the present invention, where this embodiment generally corresponds to the embodiment shown in FIG. 9. In this embodiment, the module 2 is not integrated in the device 1 but is installed on the information appliance 1 in a reversible release manner through a cable connection 14 (for example, a USB cable connection 14).

FIG. 11 shows an information appliance 1 in one embodiment of the present invention, where this embodiment generally corresponds to other embodiments of the present invention. The information appliance 1 here is a portable tablet computer, in which the display member 1 ′ itself is non-touch sensitive, that is, the touch screen function is provided on the tablet computer only through the module 2 or through the human-machine interface. In particular, the information appliance 1 has a module 2 and/or another module 2 (not shown here).

FIG. 12 shows an information appliance 1 in an embodiment of the present invention, where this embodiment generally corresponds to other embodiments of the present invention. According to this embodiment, the information appliance 1 is, for example, a television with one module 2 and/or another module 2'. By adopting at least two modules 2, 2', multi-touch gesture recognition can be realized. In particular, a multi-touch screen can be advantageously provided on the information appliance, that is, a screen with multi-finger gesture recognition function, wherein the module 2 and/or another module 2'can be displayed on the screen The component 1'performs touch-sensitive input of data by gestures. The multi-touch function here refers to: simultaneously identifying multiple contacts of the display member 1'and the object 4 (for example, the finger 4 of the user), rather than collecting only a single contact point. In particular, the user can touch the elements displayed on the screen, move these elements, or select multiple elements at the same time. An example of application is the enlargement and rotation of an image, the specific way is to make two fingers move away from or rotate relative to each other.

13 is a signal curve of a positioning signal curve of a positioning signal according to an embodiment of the invention. Here, a method for identifying user commands through the module 2 of the present invention will be described. Here, the module 2 is adapted to generate a positioning signal for deriving command information, wherein the figure shows the positioning signal value (component symbol 500") in conjunction with time (component symbol 500'). For example, the user makes an object 4 (such as a finger or a pen) moves, thereby inputting a user command, wherein the positioning signal is generated according to the movement of the object 4 through the module 2. In this case, a plurality of sub-motions of the object 4 are detected, where, for example, the object 4 Move into an inactive position (where the object 4 in the inactive position is outside the illuminated surface 30) or move into an active position (where the object 4 in the active position is within the illuminated surface 30). This point means, for example: When the object 4 moves parallel to the irradiation surface 30, when the distance between the positions of the detected object 4 is greater than the reference distance, another active position independent of the active position is detected.

In addition, the movement of the object from the inactive position to the active position is called an activation movement, and the movement of the object from the active position to the inactive position is called a deactivation movement. With respect to the positioning signal shown in FIG. 12, the inactive position of the object 4 is first detected at a first time interval (see component symbol 501), and then the first activation motion of the object 4 is detected, in which the following The first time interval 501 detects the active position of the object 4 within the second time interval 502, wherein the first deactivation motion of the object 4 is subsequently detected, wherein the second time interval 502 follows the third time interval In 503, the inactive position of the object 4 is detected.

When the inactive position of the object 4 is detected within a preset time period immediately following the third time interval 503, it is preferable to derive instruction information including information about the click operation from the positioning signal. Otherwise (for example, as shown in FIG. 12), the second activation motion of the object 4 is detected in the third time interval 503, in which the active position of the object 4 is performed in the fourth time interval 504 immediately following the third time interval 503 Detect. Subsequently, the second deactivation motion of the object 4 is detected, so that the inactive position of the object 4 is detected within the fifth time interval 505 immediately following the second deactivation motion. Therefore, after the third activation motion of the object 4, the active position of the object 4 is detected within the sixth time interval 506.

Especially when the inactive position of the object 4 is detected within a preset time period immediately following the fifth time interval 505, it is preferable to derive from the positioning signal that includes instructions about the user (here, for example, about double-click operations ) Command information.

1: Information appliances

1': display widget

1": input widget

2: Module

30: Irradiation surface, positioning area

30': Another illuminated surface, positioning area

100': display surface

Claims (10)

An information appliance (1) including a module (2), wherein the module (2) is adapted to provide a human-machine interface for the information appliance (1), wherein the information appliance (1) has a display member (1' ), wherein the display member (1′) mainly extends along the display surface (100′), wherein the module (2) is adapted to position the object (4) in the positioning area (30, 30′), wherein the The module (2) is suitable for generating a primary beam (3), wherein the module (2) has a scanning mirror structure (7, 7'), wherein the scanning mirror structure (7, 7') can be in some way Is controlled so that the primary beam (3) performs a scanning movement substantially along the irradiation surface (30) located in the positioning area (30, 30'), characterized in that the irradiation surface (30) is parallel to the display member The display surface (100') of (1') extends, wherein the illumination surface (30) and the display surface (100') at least partially overlap the module (2) is integrated in the information appliance (1), or, The module is an additional device connected to the information appliance (1). For example, the information appliance (1) of the first patent application, wherein the irradiation surface (30) and the display surface (100') are separated by 0.1 to 4 mm. For example, the information appliance (1) according to item 1 of the patent application, wherein the module (2) is adapted to provide a touch screen function for the display member (1') of the information appliance (1). The information appliance (1) according to any one of the items 1 to 3 of the aforementioned patent application scope, wherein the module (2) is adapted to generate another primary beam ( 3'), wherein the module (2) adopts a certain configuration scheme so that the other primary beam (3) generally follows another irradiation surface (30') located in the positioning area (30, 30') Perform another scanning movement, wherein the other irradiation surface (30) extends parallel to the display surface (100') of the display member (1'), wherein the irradiation surface (30), the other irradiation surface (30') And the display surface (100') to A small amount overlaps. For example, the information appliance (1) according to item 4 of the patent application, wherein the module (2) is adapted to generate a positioning signal, and the positioning signal is used to derive a position based on the user gesture detected by the module (2) Command information. For example, the information appliance (1) of claim 5 in which the one irradiation surface (30) and the other irradiation surface (30') are substantially parallel to each other and are separated by an irradiation distance (13), wherein the irradiation distance (13 ) 0 to 50 mm. The information appliance (1) according to any one of the items 1 to 3 of the patent application scope, wherein the information appliance (1) is a notebook computer, a personal computer, a tablet computer and/or a TV, and the display component (1 ') is the screen. A method for operating an information appliance (1) as described in any one of items 1 to 7 of the patent application scope, wherein a human machine for the information appliance (1) is provided by the module (2) Interface, wherein a primary beam (3) is generated by the module (2) in the first operation step, wherein the primary beam (3) is incident on the irradiation surface (30, 30'), wherein the second The scanning motion of the primary beam (3) is generated in the operation step, wherein the primary beam (3) generally performs a scanning motion along the irradiation surface (30) located in the positioning plane (30, 30'), wherein the third In the operation step, when the object (4) is placed in the irradiated surface (30), through the module (2), the secondary generated according to the interaction between the primary beam (3) and the object (4) Level signal (5) for detection. A method as claimed in item 8 of the patent application, wherein in the fourth operation step, a positioning information is generated based on the detected secondary signal (5), and in the fifth operation step, a position information is generated for derivation based on the positioning information A positioning signal for command information is issued, in which The module (2) transmits the positioning signal for controlling the information appliance (1) to the information appliance (1). For example, the method of claim 8 or 9, wherein the command information is derived from the positioning signal in a manner such that the command information includes a motion about the object (4) relative to the irradiation surface (30) News.

Images