Background technology
Control a virtual target motion of objects and in the numerous areas of information processing, have vital role.Therefore,, how effectively to make things convenient for and control the virtual target motion of objects neatly is a problem that receives much concern all the time.At this,, at first provide the lexical or textual analysis of the some terms that use in order to describe and explain spirit of the present utility model and principle better.
The term that uses in the utility model " virtual target object " is meant the object that produces by the infotech means in electronic equipment for example, for example, and the focus in the cursor of pointing apparatus, instruction character, the interactive interface, or the like.
The term that uses in the utility model " motion " can be divided into two classes generally, i.e. displacement and attitude change.Alleged " displacement " is that object relative position in the space under given reference system changes in the utility model.Can utilize direction, distance, speed, acceleration equivalent to characterize displacement.On the other hand, alleged " attitude variation " is meant that object is rotated around certain point of self in the utility model, and this object is not subjected to displacement as a whole or the very little negligible situation of displacement.Can utilize object to characterize attitude with respect to vergence direction, angle of inclination, the speed of rotation equivalent of giving dead axle (being called axis of reference) changes.Be appreciated that in any given moment, the motion of object can comprise displacement and attitude in changing any one or the two.And any motion can be characterized by direction of motion and movement rate.
The term that uses in the utility model " attitude " is meant the inclination situation of object with respect to one or more axis of reference.The attitude that can utilize object to characterize object with respect to the vergence direction and the angle of inclination of axis of reference.Be appreciated that alleged " attitude " do not comprise the displacement of object itself herein.
After having defined above term, consider control now to the virtual target motion of objects.For example, in equipment such as personal computer (PC), mobile phone, PDA(Personal Digital Assistant), interactive television, set-top box, projector, be used for the cursor of user interface (UI) or the virtual target object that focus is a quasi-representative.In addition, the various virtual target objects in virtual game, application, the computer program also belong to the category of virtual target object.As how flexibly, effective and efficient manner controls the motion of these virtual target objects in UI for example, and is most important for interactive efficiency, naturality and user experience.
In the prior art, the mode that is used to control the virtual target motion of objects can be divided into two classes generally.First kind mode is to utilize parts such as operating buttons, button, knob, rocking bar, operating rod to produce control signal, to be used for controlling the motion of virtual target object at virtual world.One of general character of this mode is: the motion of opertaing device itself (displacement and attitude change) is for the not influence of virtual target motion of objects.For example, being used for the keyboard of PC, the telepilot that is used for interactive television etc. is the example of this class control mode of prior art.
There is obvious defects in this control mode.At first, handling these opertaing devices needs the user to have certain cognitive level and operant level, thereby has limited for example user's such as children, old man use.And the operation of this type of opertaing device usually is not user-friendly.For example, when carrying out virtual game, the user may need a plurality of operating rods of coordinated manipulation or like simultaneously, is respectively applied for the different motion parameter of control virtual target object.The user needs the hight coordinate and the cooperation of brain and both hands in operating process, could realize the motion of expectation, so the cognitive load of reciprocal process is higher.
The second class mode that is used to control the virtual target object motion is that the motion with opertaing device itself is associated with the virtual target motion of objects.In this way, opertaing device is converted to control signal to be used to control the virtual target motion of objects with user's gesture (that is the motion of user's hand).Gesture is one of daily relatively commonly used, more effective interactive means of people, and therefore this mode can significantly reduce cognitive load than first kind mode.For example, mouse is the typical case of this type of opertaing device.In reciprocal process, the user comes the cursor, focus and other virtual target motion of objects that present among control example such as the UI by rolling mouse itself.And for example, can provide a kind of hand-held remote control unit from the game host Wii that Japanese Nintendo Co. (Nintendo) obtains, when the user holds this controller, can come the motion of the virtual target object (for example, tennis, bowling etc.) in the direct game by one group of predefine gesture.In addition, at image and area of pattern recognition, existing several studies is paid close attention to by one or more external sensors (for example, camera) and is come Direct Recognition user's gesture, and is converted into control signal corresponding.
Yet the above-mentioned second class mode also has limitation.At first, the virtual target motion of objects is controlled in the displacement that this class opertaing device often depends on itself, and this just needs the user is that opertaing device is created and kept certain operating space.With the mouse is example, and the user needs certain space (two dimension or three-dimensional) could move and handle mouse.Similarly, for other prior art opertaing devices such as Wii controllers, need corresponding operating space equally to be used for the displacement of opertaing device itself.This usually makes troubles to the user, even is infeasible in some cases.For example, in order to create the operating space that is used for opertaing device, may need at first to clear up and/or be arranged in other article on the desktop for example, this is inconvenient to the user.This problem has particularly outstanding in limited time at free space.For example, present a lot of vehicles (for example, aircraft, train, taxi etc.) provide special-purpose interactive electronic equipment for the user, to be used for play-on-demand program, information inquiry, digital map navigation etc.At this moment, the space that the user can use narrow and small relatively (for example) because seat arrangement, other users on every side, the displacement of opertaing device itself will be inconvenient more.
Therefore, in the art, need a kind ofly control the scheme of virtual target object motion, thereby overcome the problems referred to above of the prior art with effective more, convenient and flexible way.
Embodiment
According to embodiment of the present utility model, provide a kind of signal processing apparatus and opertaing device that is used to control the virtual target motion of objects.Basic thought of the present utility model is: the user controls the virtual target motion of objects by the attitude of opertaing device fully or at least mainly, and does not need opertaing device itself to carry out displacement.And, be to realize to the detection of the attitude of opertaing device by the detecting unit that opertaing device self is equipped with, auxiliary without any need for external unit.
Note that as indicated abovely, " attitude " of the opertaing device of mentioning in the utility model limited by the inclination of this opertaing device with respect to one or more axis of reference, comprises the direction of inclination and the angle of inclination.And be appreciated that alleged " attitude " do not comprise the displacement of equipment itself herein.
Thus, the attitude that how to detect opertaing device is one of the problem that need consider of the utility model.Attitude detection comprises qualitative detection (that is the direction of inclination) and detection by quantitative (angle of inclination).In order to understand principle of the present utility model and spirit better, before embodiment is described in detail, at first will come the principle of the attitude detection of the opertaing device that concise and to the point description can use in embodiment of the present utility model with reference to Figure 1A and Figure 1B.
[attitude detection]
According to Newtonian mechanics second law, any object will produce acceleration in the time spent of doing that is subjected to power on the direction of power.All objects in earth gravitational field all are subjected to the effect of gravity, therefore all have acceleration of gravity (being designated as g).The direction of acceleration of gravity all the time vertically downward, the size near the face of land approximately constant.Can utilize acceleration of gravity to come the attitude of Measuring Object.It is pointed out that since tellurian object all with earth rotation, so object in fact also has centripetal acceleration.Yet the centripetal acceleration of earth rotation is very little, so can ignore in attitude detection.
For object to be detected, at first can determine one or more main shafts.With reference to Figure 1A, can select the main shaft of AA ' as object 100, this only is exemplary.At first consider with the Z axle as situation with reference to axle.When object changed (that is, tilting) with respect to Z axle generation attitude, shown in Figure 1B, in (that is, the XY plane), acceleration of gravity vector g can be decomposed into the component g perpendicular to object principal axis A A ' on the plane vertical with axis of reference
1, and the component g that is parallel to object principal axis A A '
2, g wherein
1And g
2Be perpendicular to one another.Because the constant magnitude of supposition g is by calculating g
1And/or g
2Size, can calculate component g
1Angle θ with respect to g.According to the resolution of vectors principle as can be known, this angle θ promptly is the angle between principal axis A A ' and the axis of reference Z, also is the angle of inclination of object with respect to axis of reference Z.In like manner, can calculate the angle of inclination of object with respect to any axis of reference.And, according to the direction of the component of acceleration of gravity, can determine the vergence direction of object with respect to each axis of reference.
Exist multiple means known can be used for the size and Orientation of inspected object acceleration.Especially, in recent years along with the fast development of micro electronmechanical (MEMS) technology, the acceleration transducer that a large amount of volumes are little, precision is high occurred, included but not limited to: accelerometer, acceleration transducer, gravity sensor (G-Sensor), inclination sensor, obliquity sensor, or the like.In these equipment, above-mentioned attitude detection principle can be put into practice by different ways, for example solid pendulum, liquid pendulum, spring, piezoelectricity, electric capacity, hotness, or the like.In this paper described, these checkout equipments were collectively referred to as mems accelerometer, and will be used to explain principle of the present utility model.Yet, should be appreciated that any attitude detection technology known now or exploitation in the future can be used in combination with embodiment of the present utility model.
[opertaing device]
Describe some illustrative embodiments of the present utility model below in detail.With reference to figure 2, it shows the block diagram of opertaing device 200 that is used to control the virtual target object motion according to the utility model illustrative embodiments.
As shown in the figure, the virtual target object that control is associated with main frame 205.Main frame 205 can be any suitable equipment, includes but not limited to: computing machine, interactive television, set-top box, projection display apparatus, or the like.The virtual target object for example can comprise any other virtual target object (for example, the object during various recreation are used) of focus, application or program creation of cursor, the user interface of the user interface of main frame 205, or the like.Opertaing device 200 can be implemented as pointing apparatus (for example, mouse), the controller that is used in combination with main frame, or the like.
As shown in Figure 2, opertaing device 200 can comprise signal processing apparatus 210, device for signalling 220 and feedback assembly 230, and these devices are arranged in the housing of opertaing device 200.Below signal processing apparatus 210 will be described at first.
In embodiment of the present utility model, thereby signal processing apparatus 210 can be used for the input (particularly, the user is to the change of the attitude of opertaing device 200) according to the user produce control signal control virtual target motion of objects (comprising direction of motion and movement rate).As shown in the figure, signal processing apparatus 210 can comprise detecting unit 2102 and processing unit 2104.When user's operational control unit 200, detecting unit 2102 can be used for the attitude of detection signal treating apparatus 210.Be appreciated that in practice signal processing apparatus 210 can be known (for example, fix, perhaps can find the solution) with the relative position of opertaing device 200.Therefore, the attitude of detection signal treating apparatus 210 is equal to the attitude that detects opertaing device 200.In other words, detecting unit 2102 can be used for detecting the attitude of opertaing device 200, and promptly opertaing device 200 is with respect to the vergence direction and the angle of inclination of given axis of reference.
With reference to Figure 1A or Figure 1B, suppose that object 100 represents opertaing device 200, and the XZ plane is surface level, then X-axis and Z axle are levels, and Y-axis is vertical.In this case, can select X-axis, Y-axis and Z axle as the reference axle.Thus, detecting unit 2102 can be used for detecting vergence direction and the angle of inclination of opertaing device with respect to these three axis of reference.In a preferred embodiment, detecting unit 2102 can utilize above-described mems accelerometer (for example, G-Sensor) to realize.In other embodiments, the angle of inclination that detecting unit 2102 also can be by can pick-up unit and the other technologies at angle of inclination realize.
Processing unit 2104 is coupled to detecting unit 2102, is used for producing control signal according to the attitude of detecting unit 2102 detected opertaing devices 200, thus control virtual target motion of objects.Processing unit 2104 can utilize any technology known now or exploitation in the future to realize, includes but not limited to special-purpose or general microcontroller (MCU), microprocessor, CPU (central processing unit) (CPU), or the like.
In some embodiments, processing unit 2102 can be controlled virtual target motion of objects direction according to the vergence direction of opertaing device 200.Be appreciated that term used herein " direction of motion " comprises the sense of displacement of virtual target object and attitude change direction (that is, around from one's body the sense of rotation of certain point).Still reference is the situation of axis of reference with X-axis, Y-axis and Z axle above.In some embodiments, the attitude variation of opertaing device with respect to the Z axle can be associated with the displacement in vertical direction of virtual target object.For example, when detecting unit 2102 detects opertaing device 200 and axially tilts with respect to Z, processing unit 2104 can produce control signal with control virtual target object in its space to top offset; When detecting unit 2102 detects opertaing device and axially has a down dip with respect to Z, processing unit 2104 can produce control signal with control virtual target object in its space to bottom offset.
Similarly, opertaing device 200 can be associated with the horizontal shift of virtual target object on left and right directions with respect to the inclination of X-axis, and can be associated with the horizontal shift of virtual target object on fore-and-aft direction with respect to the inclination of Y-axis.In addition, those skilled in the art expect easily, can utilize the vergence direction of opertaing device 200 to control the attitude change direction of virtual target object (that is, around from one's body the sense of rotation of certain point).
By opertaing device is carried out vector calculus with respect to the vergence direction of X-axis, Y-axis and Z axle, can calculate the resultant motion direction of virtual target object in the space.And the related etc. of the selection, angle of inclination that it will be understood by those skilled in the art that above-described axis of reference and virtual target object motion direction only is exemplary.Those skilled in the art can make amendment to it and dispose as the case may be.
In some embodiments, processing unit 2104 can also be controlled virtual target motion of objects speed according to the angle of inclination of opertaing device 200.Be appreciated that term used herein " movement rate " comprise the rate of displacement of virtual target object and attitude rate of change (for example, around from one's body the speed of rotation of certain point, or claim angular speed).For example, according to the increase of detecting unit 2102 detected opertaing devices 200 with respect to the angle of inclination of certain axis of reference, processing unit 2104 can produce control signal to increase the movement rate of virtual target object on respective direction.Similarly, with respect to the reducing of the angle of inclination of certain axis of reference, processing unit 2104 can produce control signal to reduce the movement rate of virtual target object on respective direction according to detecting unit 2102 detected opertaing devices 200.
In addition, in some embodiments, if do not receive user's further indication, then pass through predetermined periods after speed increases, processing unit 2102 can produce control signal to reduce the movement rate of virtual target object on respective direction.For example, speed can be reduced to speed and increase speed before.Otherwise, if do not receive user's further indication, then after changing down, passing through predetermined periods, processing unit 2102 can produce control signal to increase the movement rate of virtual target object on respective direction.For example, speed can be increased to speed and reduce speed before.
By the angle of inclination of opertaing device 200 is related with virtual target motion of objects speed, the user can utilize more the sign language of horn of plenty to control the virtual target motion of objects.For example, as mentioned above, in some embodiments, when opertaing device axially tilts with respect to Z, can make the virtual target object to top offset.If the user then can correspondingly increase the speed of virtual target object to top offset with respect to the Z axle opertaing device (that is, vergence direction is constant, and angle of inclination increase) that further is inclined upwardly.After this, keep the virtual target object to top offset if the user wishes to reduce movement rate, then he can suitably reduce the angle of inclination of opertaing device.At this moment, processing unit 2104 will produce control signal corresponding with the speed of suitable reduction virtual target object to top offset.On the other hand, if the user does not provide the further indication about speed, after the process predetermined periods, processing unit 2104 can produce the speed that control signal reduces the virtual target object.
Incidence relation between the angle of inclination of opertaing device 200 and the virtual target object motion speed can limit by variety of way.For example, in some embodiments, can have the relation of linear function between the two, promptly the angle of inclination of virtual target motion of objects speed and opertaing device changes pro rata.In other embodiments, the angle of inclination of opertaing device and virtual target motion of objects speed can have the relation of step function.For example, the angle of inclination can be divided into some intervals, each interval is corresponding to different virtual target motion of objects speed, and that movement rate keeps in same interval is constant.This only is several examples, in fact, can limit the angle of inclination of opertaing device and the incidence relation between the virtual target object motion speed by any suitable mode.
In above-described embodiment, the vergence direction of opertaing device 200 and virtual target motion of objects directional correlation connection, and the angle of inclination of opertaing device 200 is associated with virtual target motion of objects speed.Yet, those skilled in the art will appreciate that this only is exemplary.According to concrete application demand, can define different incidence relations between the attitude of opertaing device 200 and the virtual target motion of objects.For example, in some embodiments, with the angle of inclination of opertaing device 200 and virtual target motion of objects directional correlation connection, and/or the vergence direction of opertaing device 200 being associated with virtual target motion of objects speed, also is feasible.
It will be understood to those of skill in the art that shown in Fig. 2 and at above-described signal processing apparatus 210 to utilize multiple mode to realize.For example, in some embodiments, signal processing apparatus 210 can be implemented as integrated circuit (IC) chip, wherein above-described function for example by corresponding software/or firmware realize.In other embodiments, signal processing apparatus 210 can adopt system level chip (SOC) to realize in conjunction with software and/or firmware.Other modes known in the art or exploitation in the future also are feasible.
And, it will be understood by those skilled in the art that the signal processing apparatus 210 shown in Fig. 2 is not limited to be encapsulated in use in the opertaing device 200.In fact, signal processing apparatus 210 can be used in combination with opertaing device 200 by any suitable mode.In addition, what easily see is, signal processing apparatus 210 can be used as individual components (for example, as the IC chip, perhaps SOC chip) and is used in combination with other equipment, and/or need to be applied to the other field of control virtual target object motion.
Continuation is with reference to figure 2, opertaing device 200 also comprises device for signalling 220, is coupled to signal processing apparatus 210 (more specifically, being coupled to processing unit 2104), be used for the control signal that signal processing apparatus 210 produces is sent to main frame 205, with control virtual target motion of objects wherein.Device for signalling 220 can use any communication mode known at present or exploitation in the future to transmit control signal to main frame 205.In some control embodiment, can transmit control signal by wireless connections, wherein wireless connections include but not limited to: bluetooth connects, infrared (IR) connects, wireless lan (wlan) connects, radio frequency (RF) connects, radio universal bus (WUSB) connects, or the like.Alternatively or additionally, can transmit control signals to main frame 205 by wired connection, wherein wired connection includes but not limited to: versabus (USB) connects, RS-232 is connected in series, or the like.
For better interactive experience is provided to the user, in some embodiments, opertaing device 200 can also comprise optional feedback assembly 230 (optionally).Feedback assembly 230 can be used for during operation providing feedback to the user of opertaing device 200.In some embodiments, feedback assembly 230 can make the housing of opertaing device 200 produce vibration according to the operation that control signal will be carried out, thereby provide tactile feedback to the user, wherein parameters such as Zhen Dong frequency, number of times, amplitude can depend on the different motion state of virtual target object and/or different operations.
In other embodiments, can be furnished with display device on the housing of opertaing device 200, for example, the small screen, LED light etc.Feedback assembly 230 can utilize these display devices to provide visual feedback to the user.Alternatively or additionally, opertaing device 200 can be furnished with audio output apparatus, for example loudspeaker, receiver J-Horner etc.Feedback assembly 230 can utilize audio output apparatus to provide audio feedback to the user.Be appreciated that above-mentioned different feedback system can provide separately or carries out combination in any, and feedback system is a user customizable.
Opertaing device 200 allows the user to control the virtual target motion of objects based on the attitude language fully.Yet, in some embodiments,, also can be furnished with one or more buttons on the housing of opertaing device 200 and operate for the user in order further to improve interaction capabilities and compatible mutually with existing control device.Processing unit 2104 in the signal processing apparatus 210 can produce control signal corresponding to the operation of these buttons according to the user.Push-botton operation can combine with attitude control according to any suitable mode.In this way, more horn of plenty and interactive means are flexibly provided for the user.
In addition, with main frame 205 mutual in, the user needs sometimes to the main frame input information.For this reason, in some embodiment of the present utility model, opertaing device (more specifically, the control module in the signal processing apparatus) can generate control signal, presents the track of the attitude of this opertaing device with main control system 205.In some embodiments, this track can be used as image and is saved.Alternatively or additionally, opertaing device can generate control signal, with the track of the attitude of main control system 205 these opertaing devices of identification, thereby this track is converted to literal.Can use any recognizer known now or that develop in the future to the identification of attitude track.
Be appreciated that and only show parts relevant in the opertaing device 200 among Fig. 2 with theme of the present utility model.According to concrete application, opertaing device 200 can also comprise other devices of arbitrary number, for example modulus (AD) converter, digital-to-analogue (DA) converter, signal converter and other supporting supportive devices.And, being appreciated that virtual target object and the main frame mentioned in above describing are exemplary and nonrestrictive, embodiment of the present utility model is equally applicable to other virtual target objects.
[brief summary]
Embodiment of the present utility model provides signal processing apparatus and the opertaing device that is used to control the virtual target object motion.As mentioned above, main thought of the present utility model is: allow the user to control the virtual target motion of objects by the attitude of opertaing device fully or at least mainly.In operating process, do not rely on the operation of parts such as button, opertaing device itself does not need to carry out displacement yet.And, be to realize to the attitude detection of opertaing device by the device that opertaing device self is equipped with, need be by any external unit.
Any appropriate format that can be implemented as pointing apparatus, telepilot or line control machine such as mouse according to opertaing device of the present utility model and be used in combination with types of applications program (for example, recreation etc.).
Opertaing device according to embodiment of the present utility model has lot of advantages.When using this opertaing device, the user need not specially to opertaing device cleans out the operating space, and does not need stilt such as desktop fully.And, according to opertaing device of the present utility model in operating process itself not needs carry out displacement, so occupation space is little, is suitable for various occasions such as the vehicles, personnel are intensive and uses.By using the MEMS sensor, can provide high-precision operation.And the number of elements such as the button of opertaing device, variable resistor will significantly reduce, even can not exist, thereby provides cost savings and can obtain more small and exquisite profile.
For purpose of explanation, above explained in detail principle of the present utility model, and some concrete examples have been described.Yet, be appreciated that above describing only is for explanation and example purpose, and should be used for limiting scope of the present utility model.For a person skilled in the art, according to enlightenment given herein, can under the situation that does not break away from principle of the present utility model and spirit, carry out various modifications, replacement and combination to above-mentioned embodiment.These modifications, replacement and combination drop within the scope of the present utility model equally.Thereby scope of the present utility model only is defined by the following claims.