CN106462297B - Electrical device and method for operating an electrical device - Google Patents

Electrical device and method for operating an electrical device Download PDF

Info

Publication number
CN106462297B
CN106462297B CN201580022465.XA CN201580022465A CN106462297B CN 106462297 B CN106462297 B CN 106462297B CN 201580022465 A CN201580022465 A CN 201580022465A CN 106462297 B CN106462297 B CN 106462297B
Authority
CN
China
Prior art keywords
module
electrical device
radiation
primary beam
display unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201580022465.XA
Other languages
Chinese (zh)
Other versions
CN106462297A (en
Inventor
N·迪特里希
F·施密特
L·劳舍尔
F·菲舍尔
G·姆鲁泽克
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Robert Bosch GmbH
Original Assignee
Robert Bosch GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Robert Bosch GmbH filed Critical Robert Bosch GmbH
Publication of CN106462297A publication Critical patent/CN106462297A/en
Application granted granted Critical
Publication of CN106462297B publication Critical patent/CN106462297B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0421Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
    • G06F3/0423Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen using sweeping light beams, e.g. using rotating or vibrating mirror
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04104Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

An electrical device (1) having a module (2) is proposed, wherein the module (2) is configured to provide a human-machine interface for the electrical device (1), wherein the electrical device (1) has a display unit (V), wherein the display unit (V) extends predominantly along a display surface (100 '), wherein the module (2) is configured to locate an object (4) positioned in a location finding region (30, 30 '), wherein the module (2) is configured to generate a primary beam (3), wherein the module (2) has a scanning mirror structure (7, 7 '), wherein the scanning mirror structure (7, 7 ') can be controlled in such a way that a scanning movement within the location finding region (30, 30 ') substantially along a radiation plane (30) is carried out by the primary beam (3), characterized in that the radiation plane (30) extends parallel to the display surface (100 ') of the display unit (1 '), wherein the radiation surface (30) at least partially overlaps the display surface (100').

Description

Electrical device and method for operating an electrical device
Background
The invention proceeds from an electrical apparatus according to the preamble of claim 1. Electrical devices with a human-machine interface are well known.
Disclosure of Invention
The object of the present invention is to provide an electrical device with a human-machine interface, in which the user comfort is increased and nevertheless a relatively precise detection of the user's posture can be achieved.
The electrical device according to the invention and the method according to the invention according to the appended claims have the following advantages over the prior art: an electrical device of relatively compact and simple design is provided, having a virtual human-machine interface for a display unit, wherein a relatively fast, but nevertheless precise and reliable recognition of user commands can be achieved. Furthermore, a particularly rapid localization of the object, in particular of the finger, is possible, so that a module with very flexible application possibilities, in particular a module for recognizing user commands by detecting user gestures, is realized. Thereby improving user comfort over the prior art. The modular-based construction allows individual components or the entire module to be adapted more flexibly to the requirements of the respective electrical device. The Human-Machine interface is also referred to herein as a Human-Machine-interface (HMI), and the module is also referred to herein as an HMI module. The human-machine interface is in particular a virtual interface, that is to say a user interface for inputting user gestures and/or commands by means of contactless detection of objects.
A human-machine interface is to be understood in particular as a user interface: the user can interact with the electrical device and/or the module via the user interface in such a way or can enter commands that the electrical device and/or the module is controlled and/or operated by the user. The module serves in particular as a command input device for an electrical apparatus. Preferably, the object is a finger, a pen or another object which is positioned in the positioning area by the user and/or moved in the positioning area by the user. The localization means, in particular, that the distance between the object and the module and/or the position of the object relative to the module is detected using a primary beam and a secondary signal, wherein the secondary signal is generated by the interaction of the primary beam with the object and is returned to the module. Interaction here means, in particular, a reflection of the primary beam on the object. Preferably, the light source is configured to generate a primary beam of radiation into the location area, wherein the primary beam is, for example, a beam of visible light or a beam of infrared light. The scanning movement of the primary beam substantially along the radiation surface is to be understood in particular as a periodic pivoting movement between two position-finding boundaries of the position-finding region, wherein here, in the case of pulsed light beams, the scanning movement is also referred to. Preferably, the module is configured to detect the secondary signal, wherein the secondary signal is generated in particular by an interaction of the primary beam with the object and is thus detectable when the object is positioned in the radiation surface. According to a preferred embodiment, the radiation surface overlaps the display plane of the display unit at least partially, i.e. in a partial region of the display plane, or completely, i.e. across the entire display plane, in a projection direction substantially perpendicular to the display plane. The display plane is to be understood to mean, in particular, a spatially limited, in particular solid, flat display surface of the display unit, for example a display area of a screen. The module is especially configured such that touch screen functionality is provided for the display unit. Here, providing a touch screen function means, for example: on a touch-insensitive display unit, i.e. a display unit without touch screen functionality, a touch screen is produced by the module, in which touch screen the electrical device can be controlled by touching the display area displayed on the display unit. The display area has, for example, image elements, menu elements, text elements or other display elements.
Advantageous embodiments and embodiments of the invention are apparent from the dependent claims and the description with reference to the drawings.
According to a preferred embodiment, the radiation area and the display area are spaced apart from one another by between 0.1 mm and 4 mm, preferably between 0.5 mm and 2 mm, and very particularly preferably approximately 1 mm.
It is thereby advantageously possible to ensure reliable detection of user commands. Based on the relatively small separation between the display plane and the radiating surface, user commands are only recognized when, for example, the object touches the display unit in the display plane.
According to a further preferred embodiment, the module is configured to provide a touchscreen function for a display unit of the electrical device.
This advantageously makes it possible to reduce the manufacturing effort of the display unit, since the display unit itself can be touch-sensitive. Nevertheless, a relatively accurate and reliable detection of the user's posture can be achieved.
According to a further preferred embodiment, provision is made for: the module is configured to generate a further primary beam radiated into the location area, wherein the module is configured such that a further scanning movement of the further primary beam takes place substantially along a further radiation plane within the location area, wherein the further radiation plane extends parallel to a display surface of the display unit, wherein the radiation plane, the further radiation plane and the display surface at least partially overlap.
It is thereby advantageously possible to position the object with a relatively high degree of accuracy in order to generate a signal for deriving the command information therefrom. A more precise recognition of the commands entered by the user can be achieved by means of a more precise position finding. It is thereby advantageously possible to provide a reliable man-machine interface also in the event of vibrations or vibrations of the entire module, for example in the case of mobile applications.
According to a further preferred embodiment, the module is configured to generate a position-finding signal for deriving command information from a user gesture detected by the module.
It is thereby advantageously possible for the module and/or the electrical device to be configured such that the command information is derived from the signal. The module is, for example, a separate device, a module integrated in the electrical device or a module connected to the electrical device.
According to a further preferred embodiment, the radiation surface and the further radiation surface are arranged substantially parallel to one another and have a radiation distance, wherein the radiation distance is preferably between 0 and 50 mm, particularly preferably between 1 mm and 5 mm, and very particularly preferably 3 mm.
It is thereby also advantageously possible to detect a movement of the object in a projection direction substantially perpendicular to the radiation surface, so that for example a click movement and/or a tap movement and/or a multi-touch movement of one or more objects can be recognized in a reliable manner.
According to a further preferred embodiment, the module is integrated in the electrical device or is an additional device connected to the electrical device.
It is thereby advantageously possible to provide a module of modular design which can be flexibly adapted to a plurality of different electrical devices and/or to the most diverse application scenarios, for example, according to the combined component principle (baukastenseprinzip). Thus, for example, the module can be used with a plurality of already existing electrical devices.
According to a further preferred embodiment, the electrical device is a laptop, a personal computer, a tablet computer and/or a television, wherein the display unit is a screen, in particular a liquid crystal screen, a picture tube monitor
Figure BDA0001141480750000031
Plasma screens or Light Emitting Diode (LED) screens.
It is thereby advantageously possible to provide a plurality of electrical devices which are suitable for different applications.
According to a preferred embodiment of the method according to the invention, it is provided that positioning information is generated in a fourth operating step from the detected secondary signals, wherein a positioning signal for deriving command information from the positioning information is generated in a fifth operating step, wherein the positioning signal is transmitted by the module to the electrical device, in particular for controlling the electrical device.
It is thereby advantageously possible to achieve a relatively reliable and precise recognition of the user command and thus to increase the user comfort.
According to a further preferred embodiment of the method according to the invention, the command information is derived from the locating signal in such a way that the command information contains information about the movement of the object relative to the radiation surface.
It is thereby advantageously possible to provide a human-machine interface with increased user comfort, wherein the module improves the recognition of user commands.
Embodiments of the invention are illustrated in the drawings and are set forth in greater detail in the description that follows.
Drawings
The figures show:
figures 1 to 7 show modules according to different embodiments of the invention;
figures 8 to 12 show electrical devices according to different embodiments of the present invention;
fig. 13 shows a signal variation process of a signal according to an embodiment of the present invention.
Detailed Description
Identical parts in the different figures are always provided with the same reference numerals and are therefore generally also named or referred to, respectively, only once.
Fig. 1 shows a schematic view of a module 2 according to an embodiment of the invention. The module 2 is configured here for determining the position of the object 4 arranged in the radiation surface 30. The module 2 is configured such that the primary beam 3 executes a scanning movement substantially along the radiation surface 30, wherein the secondary signal 5 is detected if the primary beam 3 interacts with an object 4 positioned in the radiation surface 30 such that the secondary signal 5 is generated. For example, if the primary beam 3 radiates in the radiation direction 101 and impinges on the object 4 and if the object is positioned in the radiation plane 30 in the radiation direction 101 as seen by the module 2, the secondary signal 5 is generated by reflection of the primary beam 3 on the object 4.
The module 2 is configured to locate the object 4 by detecting the secondary signal 5, wherein the locating of the object 4 is carried out by means of a distance detection and/or an intensity detection, wherein the distance detection is carried out in particular by means of a time-of-flight method and/or the intensity detection is carried out by means of an intensity detection, wherein the intensity detection comprises an intensity comparison between the measured intensity of the secondary signal 5 and a reference intensity. For example in a reference measurement and storing the reference intensity in the module 2.
The localization position of the object 4 represents a position determination of the entire object or of only one object part (for example, a projection point on the object surface of the object 4 produced by the primary beam 3), wherein the position determination relates to a determination of the distance or spacing between the module 2 and the object 4 or the object part and/or to a determination of the position of the projection point (associated with the object part) relative to a further projection point (associated with a further object part), wherein the projection point and the further projection point are produced in particular at different times during the scanning movement.
Preferably, the module 2 has a first submodule 21, a second submodule 22, a third submodule 23, a fourth submodule 24, a fifth submodule 25, a sixth submodule 26, a seventh submodule 27, an eighth submodule 28 and/or further submodules. This provides a modularly constructed module 2 which can be flexibly adapted to a plurality of different electrical devices 1 and/or applications, for example, according to the combined component principle.
In an exemplary embodiment of the module 2, the first sub-module 21 is a light module 21 configured for generating the primary beam 3 and/or the further primary beam 3'; and/or the second sub-module 22 is a scanning module 22 configured for generating a scanning motion of the primary beam 3 and/or a further scanning motion of a further primary beam 3'; and/or the third submodule 23 is a first control and/or detection module 23 configured for generating a detection signal depending on the secondary signal 5 and/or the further secondary signal 5'; and/or the fourth submodule 24 is an analysis processing module 24 for generating positioning information; and/or, the fifth submodule 25 is a second control and/or detection module 25; and/or, the sixth submodule 26 is a control module 26 for controlling the energy supply; and/or, the seventh submodule 27 is a camera module; and/or the eighth submodule 28 is a communication module 28 configured for communication with the electrical device 1 and/or data transmission to the electrical device 1.
Fig. 2 shows a module 2 according to an embodiment of the invention. The module 2 has a light source 6 for generating the primary beam 3. The light source is preferably a laser diode, for example in the form of a surface emitting laser. The primary beam 3 generated by the light source 6 is in particular a beam of visible light 3, i.e. light of a wavelength of about 380 nanometers (nm) to 780nm, or a beam of Infrared (IR) light 3.
The module 2 has a scanning mirror structure 7, which has a microelectromechanical scanning mirror element 7. The module 2 is configured in particular such that the primary beam 3 is deflected by the scanning mirror arrangement 7 in such a way that the primary beam 3 extends substantially along the (planar) radiation surface 30. The micromechanical scanning mirror element 7 can be adjusted into a plurality of deflection positions in the region between the two maximum deflection positions (of the scanning mirror element 7 or of the further scanning mirror element 7'). In the first of the two maximum deflection positions, the primary beam 3 is radiated by the scanning mirror arrangement 7 along the radiation surface 30 in the first radiation direction 101'. In a second of the two maximum deflection positions, the primary beam 3 is radiated by the scanning mirror arrangement 7 along the radiation surface 30 in a second radiation direction 101'. The localization boundaries 101 ', 101 ″ of the localization zone 30 are defined by the first radiation direction 101' and the second radiation direction 101 ″. In particular, in this embodiment, the terms positioning region 30 and radiation surface 30 have the same meaning. The micromechanical scanning mirror element 7 is configured in particular such that, when the scanning mirror element 7 is loaded with a control signal, the scanning mirror element 7 executes a deflection movement between the two maximum deflection positions. The primary beam 3 is in particular a laser beam 3, for example a continuous laser beam 3 or a pulsed laser beam 3.
In particular, the primary beam 3 is moved during a scanning movement having a scanning frequency, wherein the scanning frequency is associated with a scanning period of the scanning movement. In particular, the primary beam 3 is scanned or swung during the scanning cycle from a first position-finding boundary 101 '(indicated by the primary beam with the reference numeral 3') to a second position-finding boundary 101 '(indicated by the primary beam with the reference numeral 3 ") and back again to the first position-finding boundary 101'. The scanning frequency is preferably between 1 and 2000 hertz (Hz), particularly preferably between 5 and 500 Hz, very particularly preferably between 10 and 200 Hz.
In deflection positions in the region between the maximum deflection positions of the scanning mirror element 7, the primary beam 3 is radiated in the radiation direction 101. If an object 4, for example a user's finger 4, is arranged or positioned in the radiation area 30 in such a way that the object 4 touches the radiation area 30 or intersects the radiation area 30, a secondary signal 5 is generated by the interaction, i.e. for example reflection, of the primary beam 3 with the object 4. For example, the object 4 is moved into the radiation surface 30 by an object movement of the object 4 in a projection direction 103 perpendicular to the radiation surface 30, so that the object 4 is arranged or positioned in the radiation surface 30. Here, a secondary signal 5 is generated if the primary beam 3 (during the scanning movement) radiates in the radiation direction 101.
The module 2 comprises optical detection means 9, 9' configured for detecting the secondary signal 5, said optical detection means having an optical detection element 9, for example a photodiode 9. In an alternative embodiment, the optical detection element 9 is monolithically integrated with the light source 9, in particular if the light source is a VCSEL. Preferably, the module 2 is configured for generating a detection signal depending on the secondary signal 5 detected by the optical detection element 9. The module 2 is configured in particular to generate position-finding information from the probe signal. Preferably, the module 2 is configured to generate a position detection signal with respect to the deflected position of the scanning mirror element 7 and/or a further deflected position of the further scanning mirror element 7' during the detection of the secondary signal 5 in such a way that the position-finding information is generated in a time-resolved manner from the detection signal and the position detection signal. The position-finding information comprises, in particular, distance information about the distance of the object 4 from the module 2 and/or orientation information about the orientation direction of the object 4 relative to the module 2 and/or position coordinates about the position of the projected point on the object surface of the object 4. The module 2 is configured in particular for locating objects by means of a Time-of-Flight method (TOF), and/or by means of intensity comparison, in each case by means of a Time-resolved evaluation process.
In fig. 3, a module 2 according to an embodiment of the invention is shown. A system with a module 2 and a base 10 is shown here, wherein the module 2 has a module underside 2' which rests on the base 10 (support surface), for example a table. The support surface 10 extends here mainly along a plane 100. The module 2 is configured in particular such that, with the module 2 supported with the module underside 2' on the support surface 10, the radiation surface 30 and the main extension plane 100 are arranged substantially parallel to one another and have a radiation distance 11 between the support surface 10 and the radiation surface 100 in a projection direction 100 perpendicular to the radiation surface 30. Preferably, the radiation distance 11 is between 0.1 and 10 millimeters (mm), particularly preferably between 0.5 and 5 mm, very particularly preferably about 1 mm.
According to a further preferred embodiment, the module 2 has a wide-angle optics 8, wherein the wide-angle optics 8 or the expansion optics (aufweitungsotik) comprise convex mirror optics, concave mirror optics, DOEs (differential Optical Element) and/or lenses or lens systems. The primary beam 3 directed toward the scanning mirror arrangement 7 is preferably deflected and directed toward the wide-angle optics 8 in such a way that the primary beam 3 is deflected by the wide-angle optics 8 into the radiation surface 30. By means of the wide-angle optics 8, it is advantageously possible according to the invention to select the angle of the sweep of the primary beam 3 to be greater than the scan angle of the scanning mirror 7. The beam-shaping optics of light source 6 are preferably matched to wide-angle optics 8 in such a way that the beam-shaping of primary beam 3 after wide-angle optics 8 does not exceed a diameter of 5 mm, preferably 3 mm, more preferably 1 mm, and very particularly preferably 0.5 mm.
In the embodiment shown in fig. 3, the light source 6, the scanning mirror element 7 and the optical detection element 9 are arranged substantially in a first module plane and the wide-angle optics 8 are arranged in a second module plane, wherein the first and second module planes are substantially plane-parallel and spaced apart from one another. It is thereby advantageously possible to provide a module 2 which is particularly compact in design. Alternatively, it can be provided according to the invention that the light source 6, the scanning mirror element 7, the optical detection element 9 and the wide-angle optics 8 are arranged in a common module plane.
In fig. 4, a module 2 according to an embodiment of the invention is shown. Here, a misalignment distance (versatzabdhold) 12 is shown, wherein the misalignment distance extends from a first position of the module 2, in which the primary beam 3 is radiated by the module 2, to a second position of the module 2, in which the secondary signal 5 is detected by the module 2. The first position corresponds, for example, to a beam output region of the module 2 (see fig. 3), while the second position corresponds, for example, to a detection region of the module 2, in which the optical detection element 9 is arranged. According to the invention, the offset distance 12 is less than 5 cm, preferably less than 2 cm, very particularly preferably less than 1 cm.
In fig. 5, a module 2 according to an embodiment of the invention is shown. Here, the module 2 comprises a light source 6 and a further light source 6'. A further light source 6 'is arranged for generating a further primary beam 3'. The scanning mirror arrangement 7 is configured to generate a further scanning movement of the further primary beam 3 'substantially along the further radiation surface 30'. The measuring areas 30, 30 'are formed by the radiation surface 30 and the further radiation surface 30'. The further scanning movement of the further primary beam 3' and the scanning movement of the primary beam 3 are realized in particular at the same scanning frequency or at different scanning frequencies and/or synchronously or asynchronously. The wide-angle optics 8 here has a mirror element 8' and a further mirror element 8 ″. The primary beam 3 is directed by the scanning mirror element 7 toward the mirror element 8 'and the other primary beam 3' is directed toward the other mirror element 8 ″. The mirror element 8 ' and the further mirror element 8 ″ are configured such that the primary beam 3 radiates during a scanning movement along the radiation surface 30 and the further primary beam 3 ' radiates during a further scanning movement along the further radiation surface 30 '. In this case, the radiation surface 30 and the further radiation surface 30' have a radiation distance 13 in the projection direction 103.
If the object 4 is arranged in the radiation surface 30 and the primary beam 3 interacts with the object 4, a secondary signal 5 is generated and detected by the optical detection element 9. If the object 4 is arranged in a further radiation surface 30 ' and the further primary beam 3 ' interacts with the object 4, a further secondary signal 5 ' is generated and detected by the optical detection element 9. In an alternative embodiment (not shown), the secondary signal 5 is detected by the light source 6 and the further secondary signal 5 ' is detected by the further light source 6 ', in particular if the light source 6 and the further light source 6 ' are VCSELs. By using two (planar and mutually parallel) radiation surfaces 30, 30', it is advantageously possible to position the object 4 with a relatively high degree of accuracy.
In fig. 6, a module 2 according to an embodiment of the invention is shown. The embodiment shown here differs from the embodiment shown in fig. 5 in that the light source 6 and the further light source 6 'are positioned or arranged such that the primary beam 3 and the further primary beam 3' are directed such that the primary beam 3 substantially follows the radiation surface 30 and the further primary beam 3 'substantially follows the further radiation surface 30', wherein the primary beam 3 and the further primary beam 3 'impinge on the scanning mirror structure 7 at substantially the same point from the light source 6 or the further light source 6'. The wide-angle optics 8 are, for example, of the free type.
In fig. 7, a module 2 according to an embodiment of the invention is shown. Here, the module 2 has a scanning mirror structure 7, 7 'with a microelectromechanical scanning mirror element 7 and a further microelectromechanical scanning mirror element 7', and a wide-angle optics 8. The radiation surface 30 and the further radiation surface 30 ' are arranged in the same plane 30, 30 ', the scanning movement of the primary beam 3 taking place substantially along the radiation surface 30 by means of the scanning mirror element 7, and the further scanning movement of the further primary beam 3 ' taking place substantially along the further radiation surface 30 ' by means of the further scanning mirror element 7 '. This advantageously makes it possible to achieve a relatively high angular resolution for the localization of the object 4.
Fig. 8 shows an electrical device 1 according to an embodiment of the invention. The electrical device 1 is in particular a portable computer device, such as a laptop, a notebook or a tablet computer, or a personal computer device.
In the embodiment shown here, the electrical device 1 has a display unit 1', an input unit 1 ″ and a module 2. The display unit 1' is, for example, a screen, in particular a liquid crystal screen, a picture tube monitor, a plasma screen or a Light Emitting Diode (LED) screen. The display unit 1 ' extends mainly along the display surface 100 ', wherein the display surface 100 ' is in particular a spatially limited surface 100 ' of the display unit 1 '. The input unit 1 "here comprises an input area for inputting user commands. The input unit 1 "extends mainly along an input surface 100", wherein the input surface 100 "is in particular a spatially limited surface 100" of the input unit 1 ". The input unit 1 ″ preferably comprises an input area of the electrical apparatus 1 for inputting user commands. In the embodiment shown here, the module 2 is integrated in the electrical device 1 in such a way that the radiation zone 30, 30 'with the radiation area 30 (and in particular the further radiation area 30') extends predominantly parallel to the input area 100 ″ of the electrical device 1. This means, for example, that the module provides a human-machine interface which here acts as a keyboard and/or mouse substitute. The radiation surface 30 (and in particular also the further radiation surface 30') is preferably spaced apart from the input unit 1 ″. Furthermore, the radiation surface 30 (and the further radiation surface 30 ') overlap the input surface 100 "in a projection direction perpendicular to the input plane 100" and/or the radiation surface 30, such that the radiation areas 30, 30' at least partially or completely overlap the input surface 100 ". The module 2 is integrated in the electrical device 1, in particular monolithically, i.e. is inserted therein, or alternatively is connected (detachably) reversibly to said electrical device or is inserted into a plug-in position of the device 1.
Fig. 9 shows an electrical device 1 according to an embodiment of the invention, wherein this embodiment corresponds substantially to the embodiment according to fig. 8, wherein the module 2 is arranged in the device 1 such that a touch screen function (touchscreen function) is provided on the display unit 1'. This means for example: the display unit 1' of the electrical device 1, which is particularly touch-insensitive or does not have its own touch screen function, is only touch-sensitive by means of the module 2. Preferably, a display unit 1 'in the form of a touch screen is generated by means of the module 2, in which case the electrical device 1 is controlled or can be controlled by touching a display area displayed on the display unit 1' when the object has reached the vicinity of the display area in such a way that the object 4 is positioned by means of the module 2. The display area has, for example, image elements, menu elements, text elements or other display elements.
Fig. 10 shows an electrical device 1 according to an embodiment of the invention, wherein this embodiment substantially corresponds to the embodiment according to fig. 9. The module 2 is not integrated in the device 1, but is reversibly detachably mounted on the electrical device 1 by means of a cable connection 14, for example a USB cable connection.
Fig. 11 shows an electrical device 1 according to an embodiment of the invention, which substantially corresponds to a further embodiment according to the invention. The electrical device 1 is here a portable tablet computer, wherein the display unit 1' itself is touch insensitive, that is to say the touch screen functionality on said tablet computer is provided solely by means of the module 2 or by means of a man-machine interface. The device 1 has in particular a module 2 and/or a further module 2 (not shown here).
Fig. 12 shows an electrical device 1 according to an embodiment of the invention, which substantially corresponds to a further embodiment according to the invention. The electrical device 1 is, for example, a television set 1, which has, in particular, a module 2 and/or a further module 2'. By using at least two modules 2, 2', it is advantageously possible to implement multi-touch gesture recognition. In particular, a multi-touch display screen, that is to say a screen with multi-finger gesture recognition, is thereby advantageously provided on the electrical device, wherein the module 2 and/or the further module 2 'on the display unit 1' enable gesture-based touch-sensitive data input. The multi-touch function here means that simultaneous multi-touches of the display unit 1' by means of the object 4, for example by means of a finger 4 of a user, are recognized, instead of detecting only one single touch point at the same time. The user can, in particular, tap on elements displayed on the screen, move them or select a plurality of them simultaneously. An application example is the enlargement and rotation of an image by moving two fingers away from each other or rotating them relative to each other.
Fig. 13 shows a signal change process of a positioning signal change process according to an embodiment of the present invention. A method for recognizing a user command by means of the module 2 according to the invention is described here. The module 2 is configured to generate a locating signal for deriving the command information, wherein a locating signal value (reference 500 ") as a function of time (reference 500') is shown here. The user moves, for example, an object 4 (for example a finger or a pen) in order to enter a user command, wherein the position-finding signal is generated by the module 2 in dependence on the movement of the object 4. In this case, a plurality of partial movements of the object 4 are detected, wherein, for example, the object 4 is moved into an inactive position, wherein the object 4 is positioned outside the radiation surface 30 in the inactive position; or to move the object 4 into an activated position, in which the object 4 is positioned in the radiation surface 30. This means, for example, that, in the case of a movement of the object 4 parallel to the radiation surface 30, a further activated state which is independent of the activated state is detected when the distance between the respective detected positions of the object 4 is greater than a reference distance.
In this case, the movement of an object from the inactive position into the active position is referred to as an active movement and the movement of an object from the active position into the inactive position is referred to as a deactivated movement. In the position-finding signal shown in fig. 12, firstly the inactive state of the object 4 is detected during a first time interval (see reference numeral 501), wherein subsequently a first active movement of the object 4 is detected, wherein subsequently the active state of the object 4 is detected during a second time interval 502 in the first time interval 501, wherein subsequently a first inactive movement of the object 4 is detected, wherein subsequently the inactive state of the object 4 is detected during a third time interval 503 in the second time interval 502.
Preferably, when the inactive position of the object 4 is detected during a defined time period directly following the third time interval 503, the command information with information about the single click is derived from the position finding signal. Otherwise (for example, as shown in fig. 12), a second activation movement of the object 4 is detected in a third time interval 503, wherein an activation state of the object 4 is detected during a fourth time interval 504 following the third time interval 503. Thereafter, a second deactivation movement of the object 4 is detected, so that during a fifth time interval 505 following the second deactivation movement the inactive bit state of the object 4 is detected. In this case, the active state of the object 4 is detected during a sixth time interval 506 after the third activation movement of the object 4.
In this case, preferably, the command information with information about the user command (for example, in this case about a double click) is derived from the position-finding signal, in particular when an inactive position of the object 4 is detected during a predetermined time period directly following the fifth time interval 505.

Claims (16)

1. An electrical device (1) having a module (2), wherein the module (2) is configured to provide a human-machine interface for the electrical device (1), wherein the electrical device (1) has a display unit (1 '), wherein the display unit (1 ') extends predominantly along a display surface (100 '), wherein the module (2) is configured to locate an object (4) positioned in a location finding region (30, 30 '), wherein the module (2) is configured to generate a primary beam (3), wherein the module (2) has a scanning mirror structure (7, 7 '), wherein the scanning mirror structure (7, 7 ') can be controlled in such a way that a scanning movement substantially along a radiation plane (30) within the location finding region (30, 30 ') is carried out by the primary beam (3), wherein the radiation plane (30) extends parallel to the display surface (100 ') of the display unit (1 '), wherein the radiation surface (30) at least partially overlaps the display surface (100 '), wherein the module (2) is configured to generate a further primary beam (3 ') radiated into the location area (30, 30 '), wherein the module (2) is configured such that a further scanning movement of the further primary beam (3 ') takes place substantially along a further radiation surface (30 ') within the location area (30, 30 '), wherein the further radiation surface (30 ') extends parallel to the display surface (100 ') of the display unit (1 '), wherein the radiation surface (30), the further radiation surface (30 ') and the display surface (100 ') at least partially overlap.
2. An electric device (1) as claimed in claim 1, characterized in that the radiation surface (30) and the display surface (100') are spaced from each other by between 0.1 mm and 4 mm.
3. The electrical device (1) according to claim 1, characterized in that the module (2) is configured for providing a touch screen functionality for a display unit (1') of the electrical device (1).
4. The electrical apparatus (1) according to any one of claims 1 to 3, characterized in that the module (2) is configured for generating a position finding signal for deriving command information from a user gesture detected by the module (2).
5. An electric device (1) as claimed in any one of claims 1 to 3, characterized in that the radiating face (30) and the further radiating face (30') are arranged substantially parallel to one another and have a radiating spacing (13).
6. The electrical device (1) according to any one of claims 1 to 3, characterized in that the module (2) is integrated in the electrical device (1) or is an additional device connected to the electrical device (1).
7. The electrical device (1) according to any of claims 1 to 3, characterized in that the electrical device (1) is a laptop, a personal computer, a tablet computer and/or a television, wherein the display unit (1') is a screen.
8. An electric device (1) as claimed in claim 1, characterized in that the radiation surface (30) and the display surface (100') are spaced from each other by between 0.5 mm and 2 mm.
9. An electric device (1) as claimed in claim 1, characterized in that the radiation surface (30) and the display surface (100') are spaced from each other by 1 millimeter.
10. An electric device (1) as claimed in claim 5, characterized in that the radiation spacing (13) is between 0 and 50 mm.
11. An electric device (1) according to claim 5, characterized in that the radiation spacing (13) is between 1 and 5 mm.
12. An electric device (1) as claimed in claim 5, characterized in that the radiation spacing (13) is 3 mm.
13. An electric device (1) as claimed in claim 7, characterized in that the display unit (1) is a liquid crystal screen, a picture tube monitor, a plasma screen or a light-emitting diode screen.
14. A method for operating an electrical device (1) according to one of the preceding claims, characterized in that a human-machine interface for the electrical device (1) is provided by the module (2), wherein a primary beam (3) is generated by the module (2) in a first operating step, wherein the primary beam (3) is radiated into the localization area (30, 30 '), wherein a scanning movement of the primary beam (3) is generated in a second operating step, wherein the scanning movement of the primary beam (3) takes place substantially along the radiation plane (30) within the localization area (30, 30'), wherein in a third operating step, a secondary signal (5) generated from the interaction of the primary beam (3) with the object (4) is detected by the module (2) when the object (4) is positioned in the radiation plane (30),
wherein a further primary beam (3 ') radiated into the location area (30, 30') is generated by the module (2), wherein a further scanning movement of the further primary beam (3) takes place within the location area (30, 30 ') substantially along a further radiation plane (30'), wherein the further radiation plane (30) extends parallel to a display plane (100 ') of a display unit (1') of the electrical device (1), wherein the radiation plane (30), the further radiation plane (30 ') and the display plane (100') at least partially overlap.
15. Method according to claim 14, characterized in that in a fourth operating step a locating signal is generated from the detected secondary signal (5), in that in a fifth operating step a locating signal is generated for deriving command information from the locating information, and in that for controlling the electrical device (1) the locating signal is transmitted by the module (2) to the electrical device (1).
16. Method according to claim 15, characterized in that the command information is derived from the locating signal in such a way that it comprises information about the movement of the object (4) relative to the radiation surface (30).
CN201580022465.XA 2014-04-28 2015-03-04 Electrical device and method for operating an electrical device Expired - Fee Related CN106462297B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102014207920.9 2014-04-28
DE102014207920.9A DE102014207920A1 (en) 2014-04-28 2014-04-28 Electrical device and method for operating an electrical device
PCT/EP2015/054468 WO2015165620A1 (en) 2014-04-28 2015-03-04 Electrical device and method for operating an electrical device

Publications (2)

Publication Number Publication Date
CN106462297A CN106462297A (en) 2017-02-22
CN106462297B true CN106462297B (en) 2020-08-18

Family

ID=52633259

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201580022465.XA Expired - Fee Related CN106462297B (en) 2014-04-28 2015-03-04 Electrical device and method for operating an electrical device

Country Status (5)

Country Link
KR (1) KR20160146744A (en)
CN (1) CN106462297B (en)
DE (1) DE102014207920A1 (en)
TW (1) TWI690839B (en)
WO (1) WO2015165620A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101825971A (en) * 2009-03-02 2010-09-08 林志雄 Laser scanning input device
CN202306000U (en) * 2011-09-29 2012-07-04 上海富伸光电有限公司 Scanning light source module and touch control screen
CN103038664A (en) * 2010-07-29 2013-04-10 Iee国际电子工程股份公司 Active illumination scanning imager
CN103677445A (en) * 2012-09-19 2014-03-26 船井电机株式会社 Position detection apparatus and image display apparatus
CN103713755A (en) * 2012-09-29 2014-04-09 北京汇冠新技术股份有限公司 Touch recognizing device and recognizing method

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5525764A (en) * 1994-06-09 1996-06-11 Junkins; John L. Laser scanning graphic input system
JP4033582B2 (en) * 1998-06-09 2008-01-16 株式会社リコー Coordinate input / detection device and electronic blackboard system
US6710770B2 (en) * 2000-02-11 2004-03-23 Canesta, Inc. Quasi-three-dimensional method and apparatus to detect and localize interaction of user-object and virtual transfer device
CN1701351A (en) * 2000-09-07 2005-11-23 卡尼斯塔公司 Quasi-three-dimensional method and apparatus to detect and localize interaction of user-object and virtual transfer device
EP1352303A4 (en) * 2001-01-08 2007-12-12 Vkb Inc A data input device
US7078672B2 (en) * 2004-01-16 2006-07-18 Tong Xie Method and system for optically tracking a target using interferometric technique
US20100245264A1 (en) * 2009-03-31 2010-09-30 Arima Lasers Corp. Optical Detection Apparatus and Method
US8405639B1 (en) * 2009-09-03 2013-03-26 Advanced Numicro Systems, Inc. Scanning mirror touch screen with minimum bezel height
CN102402277B (en) * 2010-09-16 2014-11-05 联想(北京)有限公司 Electronic terminal and information input processing method
US8669966B2 (en) * 2011-02-25 2014-03-11 Jonathan Payne Touchscreen displays incorporating dynamic transmitters
JP2012208926A (en) * 2011-03-15 2012-10-25 Nikon Corp Detection device, input device, projector and electronic apparatus
TWI490733B (en) * 2011-11-01 2015-07-01 Pixart Imaging Inc Handwriting system and sensing method thereof
TW201327324A (en) * 2011-12-23 2013-07-01 Azurewave Technologies Inc Optical touch control module
TW201342137A (en) * 2012-04-10 2013-10-16 Pixart Imaging Inc Optical operation system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101825971A (en) * 2009-03-02 2010-09-08 林志雄 Laser scanning input device
CN103038664A (en) * 2010-07-29 2013-04-10 Iee国际电子工程股份公司 Active illumination scanning imager
CN202306000U (en) * 2011-09-29 2012-07-04 上海富伸光电有限公司 Scanning light source module and touch control screen
CN103677445A (en) * 2012-09-19 2014-03-26 船井电机株式会社 Position detection apparatus and image display apparatus
CN103713755A (en) * 2012-09-29 2014-04-09 北京汇冠新技术股份有限公司 Touch recognizing device and recognizing method

Also Published As

Publication number Publication date
CN106462297A (en) 2017-02-22
KR20160146744A (en) 2016-12-21
WO2015165620A1 (en) 2015-11-05
TW201546689A (en) 2015-12-16
DE102014207920A1 (en) 2015-10-29
TWI690839B (en) 2020-04-11

Similar Documents

Publication Publication Date Title
US20110242054A1 (en) Projection system with touch-sensitive projection image
RU2579952C2 (en) Camera-based illumination and multi-sensor interaction method and system
US8681124B2 (en) Method and system for recognition of user gesture interaction with passive surface video displays
US8614669B2 (en) Touchless tablet method and system thereof
US10303276B2 (en) Touch control system, touch control display system and touch control interaction method
US20120019488A1 (en) Stylus for a touchscreen display
US8723800B2 (en) Virtual projecting input system and input detecting method thereof
US8456648B2 (en) Optical detection device, electronic apparatus, and optical detection method
KR20030038732A (en) Quasi-three-dimensional method and apparatus to detect and localize interaction of user-object and virtual transfer device
US10042464B2 (en) Display apparatus including touchscreen device for detecting proximity touch and method for controlling the same
Cassinelli et al. Smart laser-scanner for 3D human-machine interface
US20110096031A1 (en) Position detecting function-added projection display apparatus
CN106462298B (en) Module and method for operating a module
KR20100066671A (en) Touch display apparatus
TWI604360B (en) Optical imaging system capable of detecting moving direction of a touch object and imaging processing method for optical imaging system
US9007346B2 (en) Handwriting system and sensing method thereof
US20120218185A1 (en) Non-directional mouse
CN106462297B (en) Electrical device and method for operating an electrical device
WO2009114821A9 (en) Apparatus and method of finger-motion based navigation using optical sensing
KR101646562B1 (en) Touchscreen device and method for comtrolling the same and display apparatus
US20230111346A1 (en) Touch Control System And Method
KR101409818B1 (en) Optical Device for Display and Driving Method thereof
JP2001084108A (en) Device for inputting and detecting and displaying coordinate
US11885642B2 (en) Laser leveling tool with gesture control
KR20170114443A (en) Touch position recognition system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200818

CF01 Termination of patent right due to non-payment of annual fee