CN101405177A - Interactive operating device and method for operating the interactive operating device - Google Patents
Interactive operating device and method for operating the interactive operating device Download PDFInfo
- Publication number
- CN101405177A CN101405177A CNA2007800098830A CN200780009883A CN101405177A CN 101405177 A CN101405177 A CN 101405177A CN A2007800098830 A CNA2007800098830 A CN A2007800098830A CN 200780009883 A CN200780009883 A CN 200780009883A CN 101405177 A CN101405177 A CN 101405177A
- Authority
- CN
- China
- Prior art keywords
- information
- manipulation
- posture
- read out
- out instrument
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention relates to an interactive operating device (100) comprising a display device (35; 43; 59; 72; 102; 150; 170; 180) and to a method for operating the interactive operating device (100). Said method comprises the following steps: graphical information is displayed on the display device (35; 43; 59; 72; 102; 150; 170; 180); sensor information is captured; an operating action is activated when it is determined, using the sensor information, that a body part (36) of a user is located within an activation range that is defined three-dimensionally in relation to the representation area of an operating element (33; 61; 151; 161-169; 181 - 186) on a display device (35; 43; 59; 72; 102; 150; 170; 180), said operating element being assigned to the operating action; ; the captured sensor information comprises user information which is evaluated for determining an operating intent for the at least one operating element (33; 61; 151; 161-169; 181-186) prior to the operating action being activated; and the information represented on the display device (35; 43; 59; 72; 102; 150; 170; 180) is adapted in accordance with the determined operating intent such that the at least one operating element (33; 61; 151; 161-169; 181-186) is optimised for activating the operating action which is assigned to the operating element (33; 61; 151; 161-169; 181-186). The operating device (100) is preferably configured as a component of a motor vehicle console in order to allow the execution of the operating method.
Description
Technical field
The present invention relates to a kind of by claim 1 method that is used to move interactive operating control as described in the preamble and a kind of by claim 16 operating control with read out instrument as described in the preamble with read out instrument.
Background technology
Often handle automobile function in the vehicle drive cabin by so-called interactive operating control.Interactive operating control comprises read out instrument, demonstrates one or more manipulation elements with graphic form on this read out instrument.Each automobile function is attached troops to a unit to described manipulation element.The user shifts to the plotting table of described manipulation element with body part such as the finger of hand, activates or trigger the action that is called control action below with this.Whether described body part must touch and be arranged in described read out instrument fwd or be integrated in the sensor unit (such as the film to touch-sensitive) in this read out instrument or whether only to the control action of handling element depend on the structure of the sensor unit of described operating control near the corresponding element of handling with regard to being enough to activate attach troops to a unit with certain spacing.
Be necessary to touch to trigger control action on some interactive operating controls, so interactive operating control is called touch-screen-operating control.The interactive operating control that can contactlessly activate is such as comprising the sensor that can detect the high-frequency signal that transmits by human body.Be necessary in this case to arrange high frequency transmitter near health or with Body contact ground.In automobile, such as such high frequency transmitter can being integrated in the automotive seat.Such as in open source literature WO 2004/078536, being illustrated by means of passing the method and apparatus that high-frequency signal that human body transmits transmits information to being used for.
Body part must be in the specific zone, and to activate described control action, this zone is called active region.On touch-screen-operating control, described active region is the face in the lip-deep two dimension of described touch-screen-operating control.Described activated surface is consistent with the display surface of the manipulation element that remains to be handled usually.On the operating control that can contactlessly handle, described active region normally is close to the surface of described read out instrument or is close to the zone of three-dimensional on the surface of this read out instrument.Described active region is consistent along the display surface of common with the affiliated manipulation element of the projection of plane vertical line on described read out instrument on the surface of described read out instrument.
The demonstration of the information on the read out instrument of so interactive operating control is not that the resolution capability with human eye is as the criterion in the prior art, but mainly with user's finger knock reliability and power operated particularity is as the criterion.
The manipulation element that shows on read out instrument is also referred to as virtual manipulation element, and these handle element comprising menu, button etc.But they also can have the shape such as the graphic object in being designed to interactively navigation map.Usually so virtual manipulation element is also referred to as window member (Widget).Described manipulation element illustrates with sizable size on interactive operating control at present usually, so as the user can be comfortable and easily with finger with its activation.Consequently, the viewing area of described manipulation element usually covers sizable part of the display surface of described read out instrument, and described display surface otherwise can be used to show extra information.Described viewing area often hides " being in the back " graphical information.If dwindle the displayed map on described read out instrument of described manipulation element, that just can obtain to be used for the position that information shows, but handling comfort also decreases, because significantly strengthen with the difficulty of finger " knocking " described manipulation element.
From known in the state of the art, as the scale of replying the described manipulation element of convergent-divergent to first control action.On such operating control, need at least twice control action to activate and carry out desired control action.
A kind of read out instrument with digitalisation pallet (Digitalisiertablett) of electromagnetism is disclosed from open source literature US 5,579,037, utilize described digitalisation pallet can import shown in the Japanese character that shows on the read out instrument.Described digitalisation pallet comprises the recorder pen that is connected with this digitalisation pallet by lead.If recorder pen is placed first spacing with respect to described read out instrument, that just will amplify round the shown zone, position that described recorder pen be in the top and illustrate.As long as the spacing of described recorder pen and described read out instrument is less than described first spacing and greater than than described first closely spaced second spacing, the zone of so described amplification just is complementary with the change in location that is parallel to read out instrument of described recorder pen.If be lower than described second spacing, that adjusts the zone of described amplification with regard to being no longer dependent on the described motion that is parallel to display surface, thereby can importing a character in the character that a plurality of amplifications show by go up touching described read out instrument in place, on described suitable position, demonstrating the character of corresponding amplification.Like this only can be improper for many applications with the operating control that recorder pen is handled, such as the interactive operating control that is not suitable for use in the vehicle drive cabin.In addition, in traveling automobile, be difficult to obtain amplifying the correct intercepting part that illustrates at described read out instrument front moving recording pen abreast with spacing given in advance.
From DE 10 2,004 045 885 A1, disclose a kind of preferable configuration that is used for automobile and be and revolved-press-operating element of La button, this operating element is especially by pushing on this operating element, the touch of this operating element, the function of automobile is handled in the rotation of this operating element and/or the drawing of this operating element, wherein is used for illumination equipment that this operating element is thrown light on for this operating element has set, be used for to the operator of this operating element near the proximity transducer of discerning and be used to depend on the illumination control apparatus that the output signal of described proximity transducer is regulated the illumination of this operating element.
Thus, be worth pursuing so interactive operating control, this operating control realizes correspondingly that on the one hand best information shows, and simultaneously owing to handling the handling comfort that element can activate easily provides height.
Summary of the invention
Therefore, technical assignment of the present invention is, a kind of operating control and a kind of method that is used to move interactive operating control are provided, utilize described operating control and method can realize that not only the information of the best of being complementary with human eye transmits, and can cosily activate the manipulation element simultaneously.
By the present invention, this task is resolved by a kind of method and a kind of device with the described feature of claim 16 with the described feature of claim 1.Basis of the present invention is to depend on concrete situation and be adjusted at the information that shows on the described read out instrument.At this, can optimally design demonstration for the visually-perceptible of shown information.But if detect user's manipulation intention, that just changes shown information, thereby can correspondingly be intended to activate best described manipulation element according to detected for the manipulation of handling element.
By the present invention, a kind of method that is used for moving especially at the interactive operating control of automobile is proposed, the information that wherein said operating control has read out instrument and shows on described read out instrument and/or can show with manipulation element, this method may further comprise the steps:
-detection is intended to for the manipulation of at least one the manipulation element in the manipulation element that shows on read out instrument,
-depend on detected manipulation to be intended to be adjusted at the information that shows on the read out instrument, thus optimally demonstrate described at least one manipulation element that is intended to handle for the activation of described manipulation element.
According to of the present invention preferred embodiment a kind of, for detecting manipulation intention at least one the manipulation element in the manipulation element that on read out instrument, shows, whether exploration operation personnel's body part is in the active region, and this active region is spatially determined with respect at least one the manipulation element display space on described read out instrument in the described manipulation element.
According to another kind of embodiment, before activating described control action, detect manipulation intention in time for described at least one manipulation element by method of the present invention.
A kind of preferred embodiment in, the method that is used for moving especially at the interactive operating control with read out instrument of automobile may further comprise the steps:
-display graphics information on read out instrument;
-receiving sensor information;
-activation control action, if detect user's body part is in the active region by means of described sensor information, this active region spatially determines that with respect to handling the display space of element on described read out instrument control action is attached troops to a unit to this manipulation element;
Wherein stipulate,
-received sensor information comprises user's information, in order to transmit before activating described control action in time for the manipulation intention of described at least one manipulation element described user's information is analyzed; And
-depend on detected manipulation intention the information that shows on read out instrument is adjusted, thus optimally demonstrate described at least one manipulation element for activate the control action of attaching troops to a unit with body part to described manipulation element.
In the time will being replaced by the sense of touch layout that manipulation is optimized, such as going out terrain gradually or described manipulation element being shown enlargedly to the visual layout of information perception optimization.When identifying the manipulation intention, the less manipulation element that illustrates is shown such as amplification.Realized this point thus,, can cosily handle at any time as long as just should handle though promptly can on described read out instrument, show high information density.User's information is meant those explanation users' behavior or describes user's sensor information itself.Described user's information detects and is the component part of described sensor information by means of sensor unit, at this described sensor information is analyzed to detect and handled intention.
Handle intention in order to detect reliably, of the present invention a kind of preferred embodiment in, described sensor information comprises the information about user's body action.Body action is such as the motion of the person's of being to use arm or hand or finger.The Another Body action is such as being the orientation that eyes are used to be captured in the information that shows on the described read out instrument.
Therefore, in a kind of particularly preferred embodiment, described user's information comprises the information about user's direction of observation.That is to say that the user often is to handle a prerequisite of handling element towards the sight of described read out instrument.
Such as the direction of observation that can survey the user by means of camera sensor.Therefore, according to of the present invention preferred embodiment a kind of, survey described user's information by means of camera arrangement at least in part.Utilize such camera arrangement, also can detect movements of parts of the body reliably usually.
According to another preferred embodiment of the present invention, survey described user's information by means of ultrasonic sensor system at least in part.Ultrasonic sensor system is suitable for especially accurately and reliably determining the position of body part.Utilize thus ultrasonic sensor system as far back as from described interactive operating control greatly apart from the time just can identify motion reliably towards this interactive mode operating control.Can in the near zone of described operating control, carry out accurate position measurement equally, stretch and measure and velocity measurement.Ultrasonic sensor system can be used as replacement scheme and uses or use jointly with other sensing system.
In a kind of particularly preferred embodiment of the present invention, detect the movements of parts of the body direction by means of user's information.This sense of motion can be individually or such as jointly with out of Memory, especially user's information, preferred view direction are used, be used for handling element and find one or more users to want the manipulation element of usually handling as next manipulator from one group.Therefore in a kind of improvement project of the present invention, when detect handling intention, detect for the dirigibility of described manipulation element and detect in case of necessity for other handle element other dirigibility and shown information adjusted, thereby according to its dirigibility be the activation of control action under corresponding or other control action optimally show described at least one handle element or described other handled element.Can realize a kind of " handling focal area (Bedienungsspotlight) " thus.Depend on distance, its sense of motion and/or the kinematic velocity of body part and other user's information, can detect a zone on described read out instrument, the described manipulation element that remains to be handled is in this zone probably.The zone that this detection obtains is called handles the focal area.Described manipulation focal area is also considerably unintelligible when far away and kinematic velocity is very little at the described read out instrument of operator distance, and along with the described read out instrument of distance more and more closely also becomes more clear.Unintelligiblely mean, aspect the target location, have unreliability at this, described body part on described read out instrument towards this target location motion.This target location is as the center of described manipulation focal area.Unreliability shows the area of described manipulation focal area on described read out instrument.Described manipulation focal area is configured to circular usually, and feasible indistinctness or unreliability about described target location shows on the radius of described manipulation focal area that described body part moves towards this target location on described read out instrument.Unreliability big more (described manipulation focal area is unintelligible more), it is just big more that this handles the focal area.Unreliability about described target location more little (described manipulation focal area is clear more), it is just more little that this handles the focal area.Preferably stipulate at this, described manipulation element have by its surface on the described read out instrument that much parts are in the zone of described manipulation focal area on convergent-divergent specification given in advance, described manipulation focal area how clear and/or described manipulation element from the position (center) of described manipulation focal area spacing have much carry out convergent-divergent in other words in other mode such as serving as but that simple activity is optimized by means of the expansion of animation, menu bar etc.
In a kind of particularly preferred embodiment, repeatedly and/or continuously detect described manipulation and be intended to and shown information is adjusted accordingly.Thus can be such as detecting described manipulation focal area continuously, and stepless zooming is in and handles the manipulation element in the focal area and make it and user's motion is complementary on described read out instrument.
In one embodiment of the invention, when coupling is adjusted, change one or more manipulation elements diaphaneity, handle the spacing and/or the animation of element with adjacent other.In this case, animation simulation comprises the tabulation of a plurality of manipulation elements suitably, selects one or more list elements to make things convenient for the user.Especially can depend on detected manipulation and be intended to roll visit in other words than long tabulation.
Same preferably detect the spacing between the displayed map of body part and described manipulation element and depend on this spacing by means of described user's information come the described manipulation element of convergent-divergent.If such as using contactless sensor to activate described manipulation element, so can be by this sensor approaching such as the hand that detects the user in about 30 centimeters in described read out instrument front.Hand or finger are near more from described read out instrument, prediction should activate which handle the effect of element may be just good more.Therefore then can be implemented in simply and especially optimally demonstrate this manipulation element on the described read out instrument.In addition, correspondingly shown information is adjusted.
As about the replenishing of user's information, the information about motoring condition is analyzed in preferred embodiment a kind of, so that the adjustment of described manipulation element is optimized.For example, travelling on uneven road surface can exert an influence to the power operated reliability that knocks of handling element to the user.Under a kind of such situation, preferably to demonstrate described manipulation element than specification bigger in the travel conditions on the road surface of flat-satin.Guarantee better manipulative capability and higher traveling comfort thus.The situation that meanwhile depends on guarantees that the information of maximum possible shows.Therefore preferred short of detecting handled intention, and described information just is complementary with the demonstration that visual information is transmitted optimization, conceals gradually or " illustrates " with 100% diaphaneity such as all manipulation elements.This is favourable on interactive operating control especially, only can demonstrate the Information Selection that is very limited on so interactive operating control, because less such as display surface.
Of the present invention a kind of preferred embodiment in, when detect handling intention, identify by the performed posture of body part and to it and analyze, wherein come shown information is adjusted according to the adjustment function of attaching troops to a unit to the posture of corresponding identification.Be intended to specialize such as can when potential steerable manipulation number of elements is huge especially, making to handle thus.Posture by static state be such as can transmitting danger signal, and this danger signal stops further to be adjusted described manipulation element and can not carry out realizing final the selection under the situation that further convergent-divergent adjusts.Can impel equally and browse in a large number, handle that in elements one handles that element is furnished with focus and amplify at these and illustrate for manipulation with the manipulation element shown in the little figure.Described adjustment function can cause the variation of any appropriate of shown information thus.
The posture of so-called static state, dynamic posture and comprehensive posture confirm it is suitable posture.Therefore according to one embodiment of the present invention, described posture comprises the posture of at least a static state, identifies this static posture by means of predefined body part attitude.In other embodiments, described posture comprises at least a dynamic posture, by means of predefined by body part the track of process discern this dynamic posture.For track, can in the space of three-dimensional, analyze on the one hand shape.But also can analyze speed as a supplement extraly, described body part is continuous in each section in three dimensional space with this speed.At last in another embodiment, described posture comprises at least a comprehensive posture, identifies described comprehensive posture by means of the posture of predefined static state and/or through the phase co-conversion of the posture of the static state of predefined track.Different embodiment of the present invention thus can only be considered static posture, only consider dynamic posture or only consider comprehensive posture or consider the combination in any of these postures.Identify described posture with at least one sensor unit, described sensor unit can be determined the position of body part in the space.Described posture is discerned this statement by at least one sensor unit and should be illustrated under the situation that has a plurality of sensor units described posture and must be discerned by a single sensor unit.Or rather, this statement comprises that also the combined action of the sensor unit by a plurality of existence discerns described posture.Whether a single sensor unit is enough to be used in discerning special construction and the posture itself that posture depends on described at least one sensor unit.
Preferred so adjust described information, thereby correspondingly demonstrate maximum information, and however be intended to best manipulative capability and demonstrate at least one and detect and handle the manipulation element that is intended to for manipulation for visually-perceptible.Can consider the influence of very different situations in this case.
By the feature of device of the present invention have with by the identical advantage of the individual features of method of the present invention.
Description of drawings
The present invention is explained in detail with reference to accompanying drawing by means of preferred embodiment below.Wherein:
Fig. 1 is schematic diagram of circuit, and this diagram of circuit is used for a kind of embodiment of the method that is used to move interactive operating control is made an explanation;
Fig. 2 is schematic scheme drawing, illustrates out the principle of the situation that the depends on convergent-divergent of manipulation element by means of this;
Fig. 3 is the scheme drawing of read out instrument, on this read out instrument optimally for visually-perceptible or part for the sense of touch operation optimization demonstrate information;
Fig. 4 A-4D is the scheme drawing of the information that shows on read out instrument, and described information comprises the manipulation element shown in amplifying according to detected manipulation focal area part;
Fig. 5 A-5D is the scheme drawing of read out instrument, and the size that depends on detected manipulation focal area on this read out instrument has been carried out convergent-divergent to handling element;
Fig. 6 A-6C is the scheme drawing of read out instrument, depends on to handle on this read out instrument to be intended to show the manipulation element with different scalings;
Fig. 7 A-7B is the scheme drawing of read out instrument, depends on the manipulation intention on this read out instrument the manipulation element of tabulation is browsed;
Fig. 8 is the scheme drawing of the interactive operating control in the automobile;
Fig. 9-the 17th, the posture of the static state of carrying out by hand;
Figure 20-the 27th is by the dynamic posture of hand execution; And
Figure 28-the 33rd is by the comprehensive posture of hand execution.
The specific embodiment
Fig. 1 shows block diagram, this block diagram depiction be used to move the method 10 of interactive operating control.As by means of shown in the method module 12, this method is included in the demonstration information on the read out instrument.The at first preferred layout of so selecting to be used to show described information makes its visual information for the best transmit and designs.Below a kind of such layout is called visual layout.
Described operating control detecting sensor information 12.Described sensor information comprises the information about one or more users on the one hand.These information are called user's information.These information especially comprise the information about user's body action, detect these information by means of sensor unit.Described body action is then such as comprising arm motion, such as detecting described arm motion by means of the sensor unit of surveying with photographic camera and/or based on ultrasonic sensor unit.In addition, can detect user's direction of observation by means of the sensor unit that is provided with photographic camera.Turn one's attention to the body action that described read out instrument is a kind of particular importance because as a rule towards the sight of the read out instrument of described interactive operating control in advance in manipulation process.In addition, the sensor information that is detected preferably includes the information about travel conditions or automotive environment.The fact shows that specific chaufeur incident (Fahrereignisse) is often in advance in specific control action.
Detect user's manipulation intention 14 subsequently by means of the sensor information that is detected.Be to detect user's manipulation intention, to be included in the sensor information different information especially user's information analyze.Especially user's behavior be that is to say that its body action analyzes and assess in this case.If, can infer so thus and handle intention such as finding to detect under the situation that its direction of observation to the read out instrument of described interactive operating control changes and is associated therewith in time spatially from described interactive the handle nearest arm of element or the motion of hand.Can produce the many different combination of single information, can analyze and assess single information at this.Can be to handle the prerequisite that intention is considered as being identified such as body part in one embodiment towards the motion targetedly of the direction of actuation unit.
Check by means of puing question to the variation 16 of intention whether occurs handling.If not this situation, that does not just change ground and continues demonstration information on described read out instrument.If produced the variation of handling intention, that is to say that identifying the discovery in other words of a kind of manipulation intention no longer exists the manipulation intention, that just is intended to be adjusted at the information 18 that shows on the described read out instrument according to the manipulation of described manipulation intention or not (again) existence.When manipulation intention (further) obtains specializing, also exist to change.
If the variation of described manipulation intention is to identify user's non-existent before this manipulation intention, that just changes information to be shown, makes that the layout on described read out instrument is optimized to the sense of touch manipulation.Can stipulate in one embodiment, in visual layout, any manipulation element is not shown with figure.In the sense of touch layout, occur gradually now handling element, that is to say and reduce its diaphaneity of 100%.Can stipulate equally, be replaced by text display from graphic display.In another embodiment, with figure little manipulation element is shown in visual layout, described in this embodiment manipulation element can amplify in the sense of touch layout and illustrates.In addition, described adjustment can comprise the variation of the structure of described manipulation element, such as the animation simulation (Animieren) of described manipulation element (window member).On a kind of read out instrument that is configured to the automobile stereo three-dimensional display apparatus, spatially outstanding of described manipulation element can be set or that information shows is spatially preposition overlapping.
Preferably so that shown information is detected and adjusted to the stage of phase co-conversion continuously.At first, the sensor information by means of the first sensor unit detects the manipulation intention.Described first sensor unit preferably includes the sensing system that picture is provided, such as camera arrangement.If identify common manipulation intention, that just is replaced by the sense of touch layout from visual layout.Such as demonstrating previous invisible manipulation element now gradually.
In addition, a kind of preferred embodiment in, when detect handling intention, on described read out instrument, detect a position and one with this position area surrounded, having notified for the activation of manipulation element for control action that is to say at this should the zone.This process is called handles definite 20 of focal area.
For detecting described manipulation focal area, can analyze different sensor informations.Especially individually or jointly to user's movements of parts of the body direction and kinematic velocity, analyze towards the direction of observation of described read out instrument and about the information of travel conditions.As handling the result that the focal area is detected, on described read out instrument, obtain a position and a radius, described position shows the target location of being notified, described radius then is the probabilistic yardstick that is used for detected notified target location.Can stipulate that in other embodiments the shape of described manipulation focal area is not circular.This point is particularly favourable, if the deviation in direction of the plane vertical line of the display surface of steering and described read out instrument is huge.
Considering to characterize the information (position/radius and/or other zone explanation) of handling the focal area when having information to be shown to adjust.Preferred described manipulation element depend on described position and and the planar overlay region of described manipulation focal area between spacing come convergent-divergent to show.This point means that the manipulation element manipulation element more farther than such this position from described manipulation focal area of the position at the center that is in this manipulation focal area of close manipulation focal area put greatlyyer.When in addition, those project on the described read out instrument in described manipulation focal area and the manipulation element that has big planar overlay region between the described manipulation focal area put greatlyyer.Fig. 4 A shows the example of this respect to 4D.Be not in handle in the focal area 62 but than other manipulation element 61 " the manipulation element 61 ' of more close described manipulation focal area 62 can be preferably than these other manipulation element 61 " show greatlyyer.
Illustrated method is definite 22 of each dirigibility of handling element.These dirigibilities also can be determined under other is about information of situation influence situation such as travel conditions, user custom in the past etc. considering by means of user's information in case of necessity according to another kind of method.
Now described manipulation focal area is adjusted continuously.In another stage, come more accurately to detect movements of parts of the body and other characteristic of body part in case of necessity by means of second sensor unit.
In one embodiment, near and the receptor that the sender unit of generation high-frequency signal is arranged in user's health is arranged on the described read out instrument or around it, be used to receive high-frequency signal of propagating by user's health and near the position of hand described read out instrument of therefrom determining the user, can finely tune the adjustment of shown information particularly well in this embodiment.From the about 30 centimetres spacing place of described read out instrument, can detect user's body part with such sensing system.If a plurality of users are in the active distance of interactive operating control in the automobile, chaufeur and copilot such as automobile, can be distinguished these users by means of different high-frequency signals so, described different high-frequency signal is by importing in user's the health with different sender unit among the co pilot's seat such as being integrated in driver's seat.Can carry out convergent-divergent to shown information matchingly with user's function (chaufeur/copilot) extraly thus generally adjusts in other words.Such as on described read out instrument, showing manipulation element still less and bigger for this reason just highly significant, if chaufeur will be when galloping the manipulation element on the active ating displaying device.The copilot that will not concentrate on vehicle drive can handle the more a plurality of manipulation elements of demonstration the element from these such as handling less manipulation element for this reason on described read out instrument.In order to finely tune, preferably when handling intention, identification detects user's the body part and the spacing of described read out instrument.In addition, detect the stretching, extension of this body part extraly.At convergent-divergent and/or design described manipulator and should stretch when plain and together take into account.For the user with big and wide finger, described manipulation element must show greatlyyer on area than the user with little and narrow finger.In another stage, can carry out more meticulous adjustment thus.The plural stage can be set.Described second sensor unit also can be based on ultrasonic sensor unit.
Fig. 2 has schematically illustrated from visual layout and has been converted to the sense of touch layout.In the upper zone of Fig. 2, in a kind of so-called visual layout information of showing shows Figure 31, two kinds of possible design plans of 32.Among demonstration Figure 31 of on the left side the manipulation element is not shown.Be provided with little manipulation element 33 among demonstration Figure 32 on the right.The zone 34 of the maximum of described read out instrument 35 is provided for demonstration information.If body part 36 be here hand as illustrating in Fig. 2 center near as described in read out instrument 35, so shown information of coming out just changes, thereby amplify described manipulation element 33 ' be shown, comprise additional text message (A, B, C, D) and changing aspect its diaphaneity with respect to upper left demonstration Figure 31 at least.Described sense of touch layout is optimized, thereby can be best touches described manipulation element 33 ', so that can activate and control action that triggering is associated with described manipulation element 33 ' by finger.
Fig. 3 shows another example that is used for being converted to from visual layout 41 sense of touch layout 42.On described read out instrument 43, schematically illustrated the interested especially point (44-47 of point of interest-POI) of the map view 48 of navigationsystem.If point 49 with a kind of motion of the right hand edge 50 that points to described read out instrument below near this read out instrument 43, so described point of interest just depends on from the spacing of the bottom of described right hand edge 50 and is carrying out convergent-divergent aspect its area size.In order to reach better manipulative capability, some points 46,47 are mobile slightly with respect to its initial position.In the left section 51 of described map view 48, also be always visual information transmission this layout is adjusted.
Fig. 4 A shows the different displayed map 55-58s of information on read out instrument 59 to 4D.Except will correspondingly handling the finger 60 that one of them handles element 61, on described read out instrument 59, drawn so-called manipulation focal area 62 with circle.Described manipulation element 61 depends on it and has carried out convergent-divergent with respect to the position of the position 63 (center) of described manipulation focal area 62 and with the planar overlay region of described manipulation focal area 62.The whole size of convergent-divergent can depend on travel conditions.If automobile is such as running at high speed on the road surface of injustice, put greatlyyer when so described manipulation element just must be than low speed driving on smooth road surface.Described manipulation focal area 62 only exists virtually and does not show on described read out instrument 59 usually.Described manipulation focal area 62 only needs to illustrate for explanation at this.
Fig. 5 A illustrates to 5D, and how described manipulation focal area 70 changes during near described read out instrument 72 and this handles focal area 70 at a kind of convergent-divergent that how to influence described manipulation element in preferred embodiment at finger 71.Read out instrument 72 show navigation map at Fig. 5 A respectively to the view shown in the 5D 73 with point of interest 81-86, described point of interest 81-86 handles element.In Fig. 5 A, selected the sense of touch layout, in this sense of touch layout, be in the point of interest 61-65 that handles in the focal area 70 and show greater than the point of interest 86 that is in outside this manipulation focal area 70.By the view 73 of Fig. 5 A corresponding to the hand of handling also away from the displayed map of described read out instrument 72.Therefore, in Fig. 5 A, also do not demonstrate finger.The finger 71 near the time, the radius 74 of described manipulation focal area 70 dwindles, thus described manipulation focal area 70 shows lessly in Fig. 5 B.Being near the manipulation element 82,83 in position 75 (center) of handling focal area 70 puts maximumly.But described point of interest 86 is put greatlyyer with respect to its demonstration in Fig. 5 A.Finger 71 further near the time just the sense of motion of this finger 71 is analyzed, thereby the position 75 of mobile slightly described manipulation focal area 70.Therefore, put than now the point 83 away from the center 75 of described manipulation focal area 70 is big more at point of interest 82 described in Fig. 5 C.In such situation shown in Fig. 5 D, finger 71 is in the active region in this situation, and this active region is determined with respect to the displayed map of described manipulation element.In being configured to the interactive operating control of touch-screen, described active region is the face of graphic display normally.On the operating control that has with the sensor of noncontact mode work, described active region can be an area of space, this zone preferably with a less spacing be fixed on described manipulation element plotting table the front or be close to this plotting table and determine.Be in the described active region if body part is finger 71 here, the control action corresponding to this manipulation element just is activated so.
Fig. 6 A shows the scheme drawing of read out instrument 150, has arranged manipulation element 151 on this read out instrument 150, and these are handled element 151 and are divided into two groups 152,153.The manipulation element 151 of the conduct tabulation under in first group 152, having arranged.In second group, arranged manipulation element 151 as the digital block.In Fig. 6 A, the manipulation element 151 of described two groups 152,153 only occupies small surface on described read out instrument 150.The major part on surface can be used for showing the out of Memory (not shown).
If point 155 near described read out instrument 150, that just amplifies the manipulation element 151 in the group that is illustrated in described two groups 152,153.If detect be used for described first group 152 the manipulation element 151 that is configured to tabulate one the manipulation intention of handling element, that just illustrates this tabulation as amplification shown in Fig. 6 B.Describedly be configured to second group 153 of the digital block and handle element 151 if described finger 155 is more approaching, that amplification just as shown in Fig. 6 C illustrates these manipulation elements.
Preferably on described read out instrument, do not moving in conjunction with the center of handling element described in Fig. 5 A embodiment illustrated, here then obviously changing in conjunction with handling positions of elements described in the illustrated embodiment of Fig. 6 A-6C to 5D.
Illustrate by means of Fig. 7 A and 7B can how advantageously to make full use of and detect the manipulation intention obtain and come from tabulation, to select the manipulation element.
Fig. 7 A shows the manipulation element 161-169 tabulation 160 of level on read out instrument 170.Handle intention if detect, that just be that in the manipulation element of described tabulation 160 one handles focus of element 165 distribution.In this case, distributed described focus for manipulation element 165 with numeral " 5 " expression.This fact is exaggerated by described manipulation element 165 and this mode is shown becomes fully aware of.Usually, described focus is distributed to described tabulation 160 at the manipulation element shown in the center of described read out instrument 170.Scheme as an alternative, described focus also can be distributed at the manipulation element shown in the edge.
Described focus can " move ", and the method person of being to use moves on to its finger 171 edge of described read out instrument 170.In Fig. 7 A, finger 171 is in the right border place 172 of described read out instrument 170.Described focus can be moved right in one embodiment thus.
The described focus of the scheme optimization center and the described manipulation element 161-169 that stay described read out instrument 170 moves with respect to described focus as an alternative.That is to say, handle the district and as represented, be moved to the left by means of arrow 173.This means that handle the district as the next one and distribute described focus for the manipulation district 166 with numeral " 6 ", wherein said manipulation district 166 illustrates in center of described read out instrument 170 amplification at this.
In these two kinds of embodiments, described focus is rolled or is browsed the tabulation of passing through described manipulation element.
This process finishes because of pointing 171 tops, center that move on to described read out instrument 170.Can handle the manipulation element that has been assigned with described focus subsequently, the control action under being used to trigger.
Rolling or surfing can depend on the position of finger 171 and change.That is to say that finger is away from the center, rolling/surfing is just fast more.
Browse/rotating direction can be identical or opposite with the direction that finger moves.Can stipulate that it is unlimited that this tabulation is regarded as in this external tabulation.This means that first list element reconnects on to the end the list element.
Fig. 7 B shows read out instrument 180, shows the tabulation of handling element 181-186 on this read out instrument 180.If point 187 near described read out instrument 180, that just is the focus of a manipulation element distribution among the described manipulation element 181-186.The manipulation element 183 that has been assigned with focus amplifies and illustrates for carrying out best manipulation.Finger 187 is in lower edge 188 places of described read out instrument 180.Manipulation element 181-186 " through overfocus " moves up as described in making as represented by means of arrow 189 thus.If point 187 centers that move on to described read out instrument 180, just stop navigation process.The manipulation element that is in the focus can be handled best.If point in 187 positions that move on between the upper limb 190 that is in described focus and described read out instrument 180, so described manipulation element 181-186 just moves down.Can browse towards both direction thus.
Described focus needn't remain on the position on the described read out instrument regularly.Or rather, described focus can move with the manipulation element that has been set focus.If this handle element than the ensuing manipulation element of described tabulation more away from the nominal position of predesignating of described focus, this focus just jumps on this ensuing manipulation element so.
Other embodiment can stipulate that amplification illustrates a plurality of manipulation elements.Such as a prime focus and two secondary focal points can be set.The manipulation element of distributing to secondary focal point still shows smallerly slightly than the manipulation element of distributing to prime focus such as being exaggerated.
Can stipulate in one embodiment, keep stop time length given in advance and do not adjust shown information of coming out if user's body part changes ground such as finger, that is just handled one and handles element, detects the highest dirigibility (such as being in the fixing focus or being in the manipulation element of the center of described manipulation focal area) at this for this manipulation element.This point especially also is suitable for, if finger is not in the real active region of described manipulation element.Can realize handling the operating process of not having manipulation to a certain extent of element thus.
Fig. 8 has schematically illustrated a kind of embodiment of the interactive operating control 100 in the automobile 101.This operating control 100 comprises read out instrument 102, can show information with visual layout and sense of touch layout on this read out instrument 102.Integrated receiving sensor 104 in described operating control 100, described receiving sensor 104 can contactlessly receive health 106,108 high frequency signals transmitted by the user, and described high-frequency signal is input in the health by means of being arranged near described health 106,108 sender units 110,112.Described sender unit 110,112 is connected with sender unit unit 113, and 113 of this sender unit unit are connected with automobile bus system 126.Described sender unit unit 113 can also be regarded as sensing system sensor unit in other words with the receiving sensor 104 that in a narrow sense has been sensor unit.In addition, described interactive operating control 100 comprises control unit 120, and 120 of this control units comprise display module 122.Described display module 122 prepares to have information to be shown on described read out instrument 102.Especially described display module 122 is complementary layout information and vision or sense of touch.In addition, described interactive operating control 100 comprises receiving element 124, and this receiving element 124 is such as receiving by described automobile bus system 126 such as being configured to camera arrangement 130 or being configured to the information of the sensor unit of ultrasonic sensor system 132.In addition, the information that receives about the motoring condition of automobile 101 by described automobile bus system 126 of described receiving element 124.By means of the received sensor information that comprises about the information of motoring condition, detect the manipulation intention of users 106 or 108 by analysis module 128.Depend on detected manipulation intention, described display module 122 changes the information that shows on described read out instrument 102.The described analysis module 128 of preferred so design, thus detection is handled the focal area and is handled element for each and detect dirigibility.
In addition, described control unit comprises active module 134, and this active module 134 triggers when being in the active region of determining with respect to the demonstration of described manipulation element on described read out instrument 102 such as finger at body part and activates control action in other words.In this process, can come transmission signals, other control instrument of described effect of signals automobile 101 by described automobile bus.
Described control unit 120 and each included module 122,128,134 not only can constitute with example, in hardware but also with form of software.
Described read out instrument can be configured to the projected display, and information projection shown in this projected display is on a surface.Under a kind of such situation, described body part moves in other words with respect to this surperficial spacing, and to invest this surperficial sight etc. in other words very important.
In passing through the sensor unit of human body transmitting high-frequency signal, it is suitable especially to the frequency confirmation in the scope of 150kHz to be in about 80kHz.But described sensor unit also can move on the frequency that is in outside this illustrated frequency limit.
Except owing to detect the sensor unit of body part or as the replacement scheme of this sensor unit by the human body transmitting high-frequency signal, can use other sensor unit that works in non-contacting mode, such as based on ultrasonic sensor unit or also can use those to use the sensor unit of optical meanss.Such sensor unit is such as designing according to following principle.Transmission-LED (light-emitting diode) emission is a kind of to be in the optical signal of the amplitude modulation of the rectangle in appreciiable or the infrared range of wavelength.The optical signal that is reflected on target is detected by photodiode.By compensation-LED with phase deviation 180 ° the baseline optical signal of amplitude modulation of same rectangle send to described photodiode through the unmodified light path.Described compensation-LED is adjusted by means of conditioning signal by regulating loop, make the baseline optical signal that is received of the optical signal of the reflection that is received of described transmission-LED and described compensation-LED on described photodiode, offset and detect signal such as.The variation of described conditioning signal is the yardstick that is used for the spacing of target.Come the design-calculated sensor unit not rely on temperature fluctuation and brightness fluctuation to a great extent according to this principle.
Preferred so at least one sensor unit of design or a plurality of sensor unit make its area that can (in case of necessity by combined action) identifies body part stretch.Can detect the posture of carrying out such as hand with body part thus and be interpreted as handling intention.Those attitudes that only the depend on body part especially posture of the attitude of hand then are called as fixing or static posture.As shown in Figure 9 flatly remain on as described in read out instrument fwd hand 140 can be such as being interpreted as danger signal, this danger signal stops navigation process or stop any adjustment of shown information in time gap given in advance.Figure 10 and 11 exemplarily shows other simple posture of using the static state of left hand 140 execution respectively.If can divide a plurality of component parts of relieving oneself dividually, so also can be as exemplarily in the different fixing posture of identifying shown in Figure 12 to 17 and be applied.
If with body part in specific area of space motion and track given in advance compare, that just identifies dynamic posture.The example of the track in two dimensional surface is exemplarily shown in Figure 18, and is used at the example of the track of three dimensional space exemplarily shown in Figure 19.The example that is used for dynamic posture is shown in Figure 20 to 27.Comprise level and the upward movement of the hand 140 that flatly stretches by the posture of Figure 20, then correspondingly comprise moving downward of hand 140 by the posture of Figure 21.In Figure 22 to 25, posture is carried out (Figure 22) in other words by carrying out (Figure 23) towards the motion of described read out instrument and carrying out (Figure 24) or carry out (Figure 25) by motion to the right by motion left by the motion that vertical and flatly open hand leaves described read out instrument.The close velocity of body part and/or rate of departure can correspondingly obtain explaining and using equally.Figure 26 and 27 show by means of with hand 140 along the conter clockwise of the hand of being stretched out in other words clockwise direction be rotated the posture of execution round its longitudinal axis.Described posture also can correspondingly comprise two kinds of opposite sense of motions.When track is analyzed, except also can consider to carry out the speed of described motion the spatial point of definite motion of process.
If can divide a plurality of component parts of relieving oneself dividually and/or survey its relative velocity, so also can to comprehensive posture or gesture and motion process such as the expansion of the finger of smooth hand with close up or point open (Figure 29) of pinching into fist (Figure 28) and fist and analyze and correspondingly take in.Exemplarily show other comprehensive posture in Figure 30 and 31, the execution of corresponding posture comprises that the closing up of finger 142 (Einklappen) (Figure 30) and the stretching, extension (Figure 31) of finger 142 in these postures.Figure 32 illustrates a kind of comprehensive posture, in this posture, the center of gravity of hand 140 is as a kind of motion to the right of the additional execution of closing up of finger 142.In Figure 33, the comprehensive posture that exemplarily illustrates comprises the holding with a firm grip and about 90 ° of right-hand revolution that this hand is carried out simultaneously of the hand of flatly unfolding 140 of original vertical orientation.
Shown posture only is exemplary posture.Can distribute different manipulation intentions for each posture, described manipulation intention causes the corresponding adjustment of shown information.
Preferred described interactive operating control can move in mode of learning, thereby and can acquire the specific posture with individualized feature of being made by different personnel.Carry out specific posture such as requiring chaufeur.By means of the take off data that detects in the process of implementation, individualized feature that can learning posture.Preferred pin is learnt personnel.Even can be by the feature of posture or by carrying out personal identification such as user who in automobile key, encodes or chaufeur recognizer.
So design some embodiments, thereby the posture of chaufeur and copilot's posture are made a distinction.If described interactive operating control is arranged on the aux. fascia panel of automobile, so can be according to being with the right hand or carrying out posture with left hand makes a distinction the posture of chaufeur and copilot's posture, suppose that wherein chaufeur and copilot handle with the hand of close aux. fascia panel respectively.Some sensor units can be distinguished chaufeur and copilot such as the mode of transmitting different high-frequency signals by means of the health by chaufeur and copilot, described high-frequency signal is used for the position of detection of body parts by described sensor unit, on such sensor unit, can distinguish the posture of copilot and chaufeur by means of the information of sensor unit.If can distinguish, that just can be intended to or be used for chaufeur and copilot's different Presentation Functions or adjustment function for the different manipulation of same posture distribution.
Claims (33)
1. be used for moving the especially method of the interactive operating control (100) of automobile (101), described interactive operating control (100) has read out instrument (35; 43; 59; 72; 102; 150; 170; 180) and at this read out instrument (35; 43; 59; 72; 102; 150; 170; 180) that go up to show and/or that can show, comprise and handle element (33; 61; 151; 161-169; Information 181-186), this method may further comprise the steps:
A) detect at read out instrument (35; 43; 59; 72; 102; 150; 170; 180) go up the manipulation element (33 that shows; 61; 151; 161-169; 181-186) at least one handled the manipulation intention of element,
B) depend on detected manipulation intention at described read out instrument (35; 43; 59; 72; 102; 150; 170; 180) go up the information that shows and adjust, thereby optimally be described at least one manipulation element (33; 61; 151; 161-169; Activation 181-186) demonstrates described at least one manipulation element (33; 61; 151; 161-169; 181-186).
2. by the described method of claim 1, it is characterized in that, described at described read out instrument (35 for detecting; 43; 59; 72; 102; 150; 170; 180) go up the manipulation element (33 that shows; 61; 151; 161-169; Whether the body part (36) that at least one 181-186) handled the manipulation intention detection user of element is in the active region, and this active region is spatially with respect to described manipulation element (33; 61; 151; 161-169; 181-186) at least one handled element at described read out instrument (35; 43; 59; 72; 102; 150; 170; 180) display space on is determined.
3. by claim 1 or 2 described methods, it is characterized in that, before activating control action, detect in time for described at least one manipulation element (33; 61; 151; 161-169; Manipulation intention 181-186).
4. by each described method in the claim 1 to 3, it is characterized in that, repeatedly or continuously detect and handle intention and correspondingly shown information is adjusted.
5. by each described method in the claim 2 to 4, it is characterized in that, handle intention use relevant information for detecting, described relevant information comprises the information about body action, especially about the information of the sense of motion of body part (36) and/or about the information of user's direction of observation.
6. by the described method of claim 5, it is characterized in that, detect described body part (36) and described manipulation element (33 by means of described information; 61; 151; 161-169; The spacing of displayed map 181-186) and depend on this spacing and come the described manipulation element (33 of convergent-divergent; 61; 151; 161-169; 181-186).
7. by each described method in the aforementioned claim, it is characterized in that, survey described user's information by means of camera arrangement (130) and/or ultrasonic sensor system at least in part.
8. by each described method in the aforementioned claim, it is characterized in that, handle intention use relevant information for detecting, described relevant information comprises the environmental information about travel conditions, when adjusting the information that optimally shows described environmental information is taken in.
9. by each described method in the aforementioned claim, it is characterized in that, when detecting the manipulation intention, detect described manipulation element (33; 61; 151; 161-169; Dirigibility 181-186), and detect other in case of necessity and handle element (33; 61; 151; 161-169; Other dirigibility 181-186), and shown information adjusted, thus optimally show according to its dirigibility for the activation of the control action under corresponding or the activation of other control action.
10. by each described method in the aforementioned claim, it is characterized in that, during the information that on being adjusted at described read out instrument, shows, change described manipulation element (33; 61; 151; 161-169; Diaphaneity 181-186), size, handle element (33 with adjacent other; 61; 151; 161-169; Spacing 181-186) and/or described manipulation element (33; 61; 151; 161-169; 181-186) or a plurality of manipulation element (33; 61; 151; 161-169; Animation 181-186).
11. by each described method in the aforementioned claim, it is characterized in that, when the described manipulation of detection is intended to, identify by the posture of body part execution and to it and analyze, wherein come the information of demonstration is adjusted according to adjustment function corresponding to the corresponding posture of discerning.
12. by each described method in the aforementioned claim, it is characterized in that described posture comprises the posture of at least a static state, it is discerned by means of predefined body posture.
13. by each described method in the aforementioned claim, it is characterized in that described posture comprises at least a dynamic posture, its by means of predefined by body part the track of process discern.
14. by each described method in the aforementioned claim, it is characterized in that, described posture comprises at least a comprehensive posture, and described comprehensive posture is discerned by means of the posture of predefined static state and/or through the phase co-conversion of the posture of the static state of predefined track.
15., it is characterized in that short of detecting handled intention by each described method in the aforementioned claim, just the information that shows on described read out instrument adjusted for the information to vision transmits the demonstration of optimizing.
16. especially the interactive operating control (100) in the automobile (101) comprises read out instrument (35; 43; 59; 72; 102; 150; 170; 180) and control setup (120), at described read out instrument (35; 43; 59; 72; 102; 150; 170; 180) can show on and/or show to comprise and handle element (33; 61; 151; 161-169; Information 181-186) is constructed described control setup (120), thereby is detecting at read out instrument (35; 43; 59; 72; 102; 150; 170; Depend on detected manipulation intention when 180) at least one in the manipulation element that go up to show handled the manipulation intention of element at described read out instrument (35; 43; 59; 72; 102; 150; 170; 180) go up the information that shows and adjust, thereby optimally be described manipulation element (33; 61; 151; 161-169; Activation 181-186) shows described manipulation element (33; 61; 151; 161-169; 181-186) at least one handled element.
17., it is characterized in that by the described device of claim 16, be provided with at least one sensor device, it is used for detecting the user in active region body part (36) is used for detecting for described at read out instrument (35; 43; 59; 72; 102; 150; 170; 180) at least one that goes up in the manipulation element that shows handled the manipulation intention of element, and wherein this active region is spatially with respect to described manipulation element (33; 61; 151; 161-169; 181-186) at least one handled element at read out instrument (35; 43; 59; 72; 102; 150; 170; 180) display space on is determined.
18. by claim 16 or 17 described devices, it is characterized in that, construct described control setup (120), thus can be repeatedly or detect continuously and handle intention and shown information is adjusted accordingly.
19., it is characterized in that described sensor information comprises the information about user's body action by claim 17 or 18 described devices.
20. by each described device in the claim 16 to 19, it is characterized in that, can survey and/or survey described user's information by means of camera arrangement and/or ultrasonic sensor system at least in part.
21., it is characterized in that described sensor information comprises about the information of user's direction of observation and/or about the information of the sense of motion of user's body part (36) by each described device in the claim 17 to 20.
22. by each described device in the claim 17 to 21, it is characterized in that, construct described control setup (120), thereby can detect and/or detect user's sense of motion of body part (36) and/or user's direction of observation by means of described sensor information.
23., it is characterized in that, construct described control setup (120), thereby when the information of optimizing demonstration is adjusted, can consider and/or consider environmental information about travel conditions by each described device in the claim 16 to 22.
24. by each described device in the claim 16 to 23, it is characterized in that, when detecting the manipulation intention, can detect and/or detect described manipulation element (33; 61; 151; 161-169; Dirigibility 181-186) and other handles element (33 in case of necessity; 61; 151; 161-169; Other dirigibility 181-186), and shown information adjusted, thus optimally show according to its dirigibility for the activation of the control action under corresponding or the activation of other control action.
25., it is characterized in that, construct described control setup (120), thereby can detect and/or detect body part (36) and described manipulation element (33 by means of described sensor information by each described device in the claim 17 to 24; 61; 151; 161-169; The spacing of demonstration 181-186), and described manipulation element (33; 61; 151; 161-169; 181-186) depending on this spacing can convergent-divergent and/or carry out convergent-divergent.
26. by each described device in the claim 16 to 25, it is characterized in that, when adjusting, can change and/or change described manipulation element (33; 61; 151; 161-169; 181-186) or a plurality of manipulation element (33; 61; 151; 161-169; Diaphaneity 181-186), handle element (33 with adjacent other; 61; 151; 161-169; Spacing 181-186) and/or animation.
27., it is characterized in that by each described device in the claim 16 to 26, handle intention as long as can not and/or detect, just be at read out instrument (35 to the demonstration of visual information transmission optimization; 43; 59; 72; 102; 150; 170; 180) going up the information that shows adjusts.
28. by each described device in the claim 17 to 27, it is characterized in that, construct described at least one sensor device, thereby come detecting sensor information by means of the health high frequency signals transmitted by the user, described sensor information especially can comprise the position of body part (36).
29. by each described device in the claim 17 to 27, it is characterized in that, described at least one sensor device to the position differentiate, to the device of touch-sensitive.
30. by each described device in the claim 17 to 29, it is characterized in that, construct at least one sensor device, thereby the posture that identification is carried out by body part is also analyzed it, wherein can come shown information is adjusted according to one of adjustment function to the posture of corresponding identification of attaching troops to a unit.
31. by the described device of claim 30, it is characterized in that described posture comprises the posture of at least a static state, it can be discerned as predefined body posture by described at least one sensor device.
32. by claim 30 or 31 described devices, it is characterized in that described posture comprises at least a dynamic posture, it can be discerned by means of predefined track by described body part process by described at least one sensor device.
33. by each described device in the claim 30 to 32, it is characterized in that, described posture comprises at least a comprehensive posture, and described comprehensive posture can be discerned by means of the posture of predefined static state and/or through the phase co-conversion of the posture of the static state of predefined track by described at least one sensor device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610366526.0A CN106427571B (en) | 2006-03-22 | 2007-03-22 | Interactive operating device and method for operating same |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102006013067.7 | 2006-03-22 | ||
| DE102006013067 | 2006-03-22 | ||
| DE102006014426.0 | 2006-03-27 | ||
| DE102006037156.9 | 2006-08-02 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610366526.0A Division CN106427571B (en) | 2006-03-22 | 2007-03-22 | Interactive operating device and method for operating same |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101405177A true CN101405177A (en) | 2009-04-08 |
Family
ID=40538740
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007800098830A Pending CN101405177A (en) | 2006-03-22 | 2007-03-22 | Interactive operating device and method for operating the interactive operating device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101405177A (en) |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102109952A (en) * | 2009-12-25 | 2011-06-29 | 索尼公司 | Information processing apparatus, information processing method, and program |
| CN102476638A (en) * | 2010-11-26 | 2012-05-30 | 上海汽车集团股份有限公司 | Vehicular information supply system and method |
| CN102725724A (en) * | 2009-12-16 | 2012-10-10 | 苹果公司 | Device, method, and graphical user interface for resizing user interface content |
| CN102810045A (en) * | 2011-05-31 | 2012-12-05 | Lg电子株式会社 | A mobile device and a control method for the mobile device |
| CN102844229A (en) * | 2010-02-02 | 2012-12-26 | Dav公司 | Moduel with haptic feedback to be integrated in a motor vehicle for portable devices and corresponding control device |
| CN102985894A (en) * | 2010-07-15 | 2013-03-20 | 惠普发展公司，有限责任合伙企业 | First response and second response |
| CN103003089A (en) * | 2010-05-18 | 2013-03-27 | 大众汽车有限公司 | Method and device for displaying information on a display area |
| CN103998298A (en) * | 2011-12-29 | 2014-08-20 | 英特尔公司 | Secured electronic device |
| CN104039582A (en) * | 2012-01-09 | 2014-09-10 | 戴姆勒股份公司 | Method and device for operating functions displayed on a display unit of a vehicle using gestures which are carried out in a three-dimensional space, and corresponding computer program product |
| CN104278908A (en) * | 2013-07-10 | 2015-01-14 | 麦格纳覆盖件有限公司 | Method and system for hands-free operation of a power window of a vehicle |
| CN104354701A (en) * | 2014-10-29 | 2015-02-18 | 云南大学 | Human-car interaction realization method |
| CN104507733A (en) * | 2012-08-01 | 2015-04-08 | 大众汽车有限公司 | Displaying and operating device and method for controlling a displaying and operating device |
| CN104850331A (en) * | 2014-02-13 | 2015-08-19 | 大众汽车有限公司 | Method and apparatus for operating mechanism of motor-position variable display unit |
| CN104937528A (en) * | 2012-12-11 | 2015-09-23 | 大众汽车有限公司 | Operating method and operating device |
| CN104937522A (en) * | 2013-01-22 | 2015-09-23 | 科智库公司 | Improved feedback in touchless user interface |
| CN105718188A (en) * | 2014-12-19 | 2016-06-29 | 罗伯特·博世有限公司 | method of operating input device, input device, and motor vehicle |
| CN106458035A (en) * | 2014-05-07 | 2017-02-22 | 大众汽车有限公司 | User interface and method for changing between screen views of a user interface |
| CN110494319A (en) * | 2017-04-27 | 2019-11-22 | 株式会社电装 | Display apparatus |
| CN112140883A (en) * | 2019-06-28 | 2020-12-29 | 丰田自动车株式会社 | Operation device for automatic driving vehicle |
-
2007
- 2007-03-22 CN CNA2007800098830A patent/CN101405177A/en active Pending
Cited By (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102725724A (en) * | 2009-12-16 | 2012-10-10 | 苹果公司 | Device, method, and graphical user interface for resizing user interface content |
| CN102725724B (en) * | 2009-12-16 | 2015-11-11 | 苹果公司 | The equipment of convergent-divergent user interface content, method and graphic user interface |
| CN102109952A (en) * | 2009-12-25 | 2011-06-29 | 索尼公司 | Information processing apparatus, information processing method, and program |
| CN102844229A (en) * | 2010-02-02 | 2012-12-26 | Dav公司 | Moduel with haptic feedback to be integrated in a motor vehicle for portable devices and corresponding control device |
| CN103003089A (en) * | 2010-05-18 | 2013-03-27 | 大众汽车有限公司 | Method and device for displaying information on a display area |
| CN103003089B (en) * | 2010-05-18 | 2016-03-30 | 大众汽车有限公司 | For showing the method and apparatus of information on the display face |
| CN102985894A (en) * | 2010-07-15 | 2013-03-20 | 惠普发展公司，有限责任合伙企业 | First response and second response |
| CN102985894B (en) * | 2010-07-15 | 2017-02-08 | 惠普发展公司，有限责任合伙企业 | First response and second response |
| CN102476638A (en) * | 2010-11-26 | 2012-05-30 | 上海汽车集团股份有限公司 | Vehicular information supply system and method |
| CN102476638B (en) * | 2010-11-26 | 2017-06-06 | 上海汽车集团股份有限公司 | On-vehicle information provides system and method |
| CN102810045A (en) * | 2011-05-31 | 2012-12-05 | Lg电子株式会社 | A mobile device and a control method for the mobile device |
| CN102810045B (en) * | 2011-05-31 | 2016-10-05 | Lg电子株式会社 | Mobile device and the control method of mobile device |
| US9035890B2 (en) | 2011-05-31 | 2015-05-19 | Lg Electronics Inc. | Mobile device and control method for a mobile device |
| US9363266B2 (en) | 2011-12-29 | 2016-06-07 | Intel Corporation | Secured electronic device |
| CN103998298B (en) * | 2011-12-29 | 2016-08-31 | 英特尔公司 | Safing electronic installation |
| CN103998298A (en) * | 2011-12-29 | 2014-08-20 | 英特尔公司 | Secured electronic device |
| CN104039582B (en) * | 2012-01-09 | 2017-03-29 | 戴姆勒股份公司 | The method and apparatus of the function of being shown on the display unit of vehicle using the gesture operation implemented in three dimensions |
| CN104039582A (en) * | 2012-01-09 | 2014-09-10 | 戴姆勒股份公司 | Method and device for operating functions displayed on a display unit of a vehicle using gestures which are carried out in a three-dimensional space, and corresponding computer program product |
| US9440537B2 (en) | 2012-01-09 | 2016-09-13 | Daimler Ag | Method and device for operating functions displayed on a display unit of a vehicle using gestures which are carried out in a three-dimensional space, and corresponding computer program product |
| US10331271B2 (en) | 2012-08-01 | 2019-06-25 | Volkswagen Ag | Displaying and operating device and method for controlling a displaying and operating device |
| CN104507733B (en) * | 2012-08-01 | 2017-06-20 | 大众汽车有限公司 | Display and manipulation device and the method for manipulating display and manipulation device |
| CN104507733A (en) * | 2012-08-01 | 2015-04-08 | 大众汽车有限公司 | Displaying and operating device and method for controlling a displaying and operating device |
| CN104937528A (en) * | 2012-12-11 | 2015-09-23 | 大众汽车有限公司 | Operating method and operating device |
| CN104937528B (en) * | 2012-12-11 | 2019-10-08 | 大众汽车有限公司 | Operating method and operating device |
| CN104937522A (en) * | 2013-01-22 | 2015-09-23 | 科智库公司 | Improved feedback in touchless user interface |
| CN104278908A (en) * | 2013-07-10 | 2015-01-14 | 麦格纳覆盖件有限公司 | Method and system for hands-free operation of a power window of a vehicle |
| CN104850331A (en) * | 2014-02-13 | 2015-08-19 | 大众汽车有限公司 | Method and apparatus for operating mechanism of motor-position variable display unit |
| CN106458035B (en) * | 2014-05-07 | 2020-06-16 | 大众汽车有限公司 | User interface and method for transforming between screen views of user interface |
| CN106458035A (en) * | 2014-05-07 | 2017-02-22 | 大众汽车有限公司 | User interface and method for changing between screen views of a user interface |
| US10768793B2 (en) | 2014-05-07 | 2020-09-08 | Volkswagen Ag | User interface and method for changing between screen views of a user interface |
| CN104354701B (en) * | 2014-10-29 | 2016-11-23 | 云南大学 | The implementation method that a kind of people's car is mutual |
| CN104354701A (en) * | 2014-10-29 | 2015-02-18 | 云南大学 | Human-car interaction realization method |
| CN105718188A (en) * | 2014-12-19 | 2016-06-29 | 罗伯特·博世有限公司 | method of operating input device, input device, and motor vehicle |
| CN110494319A (en) * | 2017-04-27 | 2019-11-22 | 株式会社电装 | Display apparatus |
| CN110494319B (en) * | 2017-04-27 | 2022-04-29 | 株式会社电装 | Display device for vehicle |
| CN112140883A (en) * | 2019-06-28 | 2020-12-29 | 丰田自动车株式会社 | Operation device for automatic driving vehicle |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101405177A (en) | Interactive operating device and method for operating the interactive operating device | |
| KR101367593B1 (en) | Interactive operating device and method for operating the interactive operating device | |
| KR101561917B1 (en) | Vehicle control apparatus and method thereof | |
| US20160132126A1 (en) | System for information transmission in a motor vehicle | |
| US20120188285A1 (en) | Enhanced pointing interface | |
| US10627913B2 (en) | Method for the contactless shifting of visual information | |
| KR101575650B1 (en) | Terminal, vehicle having the same and method for controlling the same | |
| US20110037725A1 (en) | Control systems employing novel physical controls and touch screens | |
| EP2581248A1 (en) | Reconfigurable vehicle instrument panels | |
| CN107193398B (en) | Touch input device and vehicle including the same | |
| US20140236454A1 (en) | Control Device for a Motor Vehicle and Method for Operating the Control Device for a Motor Vehicle | |
| CN103906646A (en) | Method and array for providing a graphical user interface, in particular in a vehicle | |
| WO2014095070A1 (en) | Input device for a motor vehicle | |
| CN103748533A (en) | Apparatus and method for contactlessly detecting objects and/or persons and gestures and/or operating procedures made and/or carried out thereby | |
| JP6429886B2 (en) | Touch control system and touch control method | |
| CN103492987A (en) | Method and apparatus for providing a user interface, in particular in a vehicle | |
| US20210055813A1 (en) | Virtual image display device | |
| CN106103177B (en) | For providing the method and apparatus of the diagram form user interface in vehicle | |
| CN104040465A (en) | Method and device for the control of functions in a vehicle using gestures performed in three-dimensional space, and related computer program product | |
| JP4566596B2 (en) | Operation instruction device | |
| Manawadu et al. | A hand gesture based driver-vehicle interface to control lateral and longitudinal motions of an autonomous vehicle | |
| US10782776B2 (en) | Vehicle display configuration system and method | |
| EP3361352B1 (en) | Graphical user interface system and method, particularly for use in a vehicle | |
| KR101806172B1 (en) | Vehicle terminal control system and method | |
| RU2604430C2 (en) | Interaction with three-dimensional virtual scenario |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20090408 |