CN103324327B - Virtual screen implementation method and system - Google Patents
Virtual screen implementation method and system Download PDFInfo
- Publication number
- CN103324327B CN103324327B CN201210079257.1A CN201210079257A CN103324327B CN 103324327 B CN103324327 B CN 103324327B CN 201210079257 A CN201210079257 A CN 201210079257A CN 103324327 B CN103324327 B CN 103324327B
- Authority
- CN
- China
- Prior art keywords
- screen
- stereo
- axis
- mark
- coordinate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
A kind of virtual screen implementation method, comprises the following steps: initialization 3 D stereo screen; Gather the image sequence of mark; The change in location of identification marking in described 3 D stereo screen; Detect the need of correction 3 D stereo screen according to described change in location, if so, then 3 D stereo screen according to described change in location correction; Position according to mark generates instruction.Above-mentioned virtual screen implementation method, can according to the change in location judge mark be marked in 3 D stereo screen whether in space create unnecessary shake, if, explanation needs to correct 3 D stereo screen, then correct the unnecessary shake that 3 D stereo screen produces to eliminate mark further, thus aforesaid way can identify the behavior of user more accurately, and the operation avoiding hand shaking to cause is inaccurate.In addition, a kind of virtual screen is also provided to realize system.
Description
[technical field]
The present invention relates to human-computer interaction technique field, relate to a kind of virtual screen implementation method and system especially.
[background technology]
The conventional method of man-machine interaction for be entered the operating instructions by input media, to control controlled device.Traditional input media generally comprises keyboard, mouse, button, operating grip etc., in recent years touch-screen appearance to user bring do not economize convenient.The operator scheme hommization more of touch screen technology, when making user's input operation order more intuitively, simpler, and bring user and experience more really, therefore touch screen technology is applied to every field more and more widely.
But traditional touch screen technology must arrange the touch-screen be made up of special substance on controlled device, and user must touch touch-screen ability input control order.For making man-machine interaction more convenient, propose the concept of virtual screen, namely user often wishes to fictionalize one piece of screen (virtual touch-screen) in face of oneself.By this virtual screen, user can manipulate display screen a long way off, and user manipulates certain specific device and moves forward, and represent that the action of display screen is pinned in simulation, user manipulates this specific device and moves backward, represents that the action of display screen is left in simulation.Aforesaid way without the need to contacting display screen, also without the need to arranging traditional touch-screen.But, because user's manipulation has certain randomness, such as, when carrying out simulated action, often because the hand shaking of user causes maloperation.Therefore, the inaccurate problem of the operation how preventing hand shaking from bringing is the problem that virtual screen technology must solve.
[summary of the invention]
Based on this, be necessary to provide one can correct virtual screen, thus the inaccurate virtual screen implementation method of the operation that hand shaking can be avoided to cause.
Based on this, be necessary to provide one can correct virtual screen, thus the inaccurate virtual screen of the operation that hand shaking can be avoided to cause realizes system.
A kind of virtual screen implementation method, comprises the following steps: initialization 3 D stereo screen; Gather the image sequence of mark; The change in location of identification marking in described 3 D stereo screen; Detect the need of correction 3 D stereo screen according to described change in location, if so, then 3 D stereo screen according to described change in location correction; Position according to mark generates instruction.
Preferably, the step of described initialization 3 D stereo screen comprises: set up three-dimensional system of coordinate O-xyz, 3 D stereo screen described in initialization is the rectangular parallelepiped region in described three-dimensional system of coordinate, and three ribs intersected in described rectangular parallelepiped region are parallel with the x-axis of described three-dimensional system of coordinate, y-axis, z-axis respectively.
Preferably, described change in location changes to the second place for marking from primary importance; The described step detected the need of correcting 3 D stereo screen according to described change in location comprises: whether detecting described mark, to move to the shift length of the second place on the z-axis of described three-dimensional system of coordinate from primary importance larger than the shift length in the x-axis and y-axis of described three-dimensional system of coordinate, if so, then judge to correct described 3 D stereo screen.
Preferably, the step of described 3 D stereo screen according to change in location correction comprises: be marked at the x-axis of described three-dimensional system of coordinate and the displacement in y-axis described in acquisition, according to 3 D stereo screen described in described displacement translation.
Preferably, the step that the described position according to mark generates instruction comprises: obtain the position in described mark 3 D stereo screen after calibration, described position is converted to the screen coordinate in display screen, and generates the instruction relevant to described screen coordinate.
Preferably, the step of the described screen coordinate be converted in display screen described position comprises: the screen coordinate calculating mark correspondence position within display screen according to the component of the position be marked in 3 D stereo screen in x-axis and y-axis.
Preferably, described method also comprises: mark whether described in detection to be positioned at outside described 3 D stereo screen, if so, then arranges the region arranged when described 3 D stereo screen is initialization 3 D stereo screen.
A kind of virtual screen realizes system, comprising: processing module, for initialization 3 D stereo screen; Image capture module, for gathering the image sequence of mark; Identification module, the change in location of identification marking in described 3 D stereo screen; Described processing module also for detecting the need of correction 3 D stereo screen according to described change in location, if so, then 3 D stereo screen according to described change in location correction; Described processing module also generates instruction for the position according to mark.
Preferably, described processing module is also for setting up three-dimensional system of coordinate O-xyz, 3 D stereo screen described in initialization is the rectangular parallelepiped region in described three-dimensional system of coordinate, and three ribs intersected in described rectangular parallelepiped region are parallel with the x-axis of described three-dimensional system of coordinate, y-axis, z-axis respectively.
Preferably, described change in location changes to the second place for marking from primary importance; Also whether for detecting described mark, to move to the shift length of the second place on the z-axis of described three-dimensional system of coordinate from primary importance larger than the shift length in the x-axis and y-axis of described three-dimensional system of coordinate for described processing module, if so, then judge to need to correct described 3 D stereo screen.
Preferably, described processing module is also for correcting described 3 D stereo screen during when needs, described in acquisition, be marked at the x-axis of described three-dimensional system of coordinate and the displacement in y-axis, according to 3 D stereo screen described in described displacement translation.
Preferably, described position also for obtaining the position in described mark 3 D stereo screen after calibration, is converted to the screen coordinate in display screen by described processing module, and generates the instruction relevant to described screen coordinate.
Preferably, described processing module is used for when described position being converted to the screen coordinate in display screen, calculates the screen coordinate of mark correspondence position within display screen according to the component of the position be marked in 3 D stereo screen in x-axis and y-axis.
Preferably, described processing module also marks whether to be positioned at outside described 3 D stereo screen described in detecting, and if so, then arranges the region arranged when described 3 D stereo screen is initialization 3 D stereo screen.
Above-mentioned virtual screen implementation method and system, by initialization 3 D stereo screen, and according to the change in location be marked in 3 D stereo screen, judge whether to need to correct 3 D stereo screen, if so, then correct 3 D stereo screen, and generate instruction according to the position of mark.Aforesaid way can according to the change in location judge mark be marked in 3 D stereo screen whether in space create unnecessary shake, if, explanation needs to correct 3 D stereo screen, then correct the unnecessary shake that 3 D stereo screen produces to eliminate mark further, thus aforesaid way can identify the behavior of user more accurately, and the operation avoiding hand shaking to cause is inaccurate.
[accompanying drawing explanation]
Fig. 1 is the schematic flow sheet of the virtual screen implementation method in an embodiment;
Fig. 2 is the schematic diagram of the 3 D stereo screen in an embodiment;
Fig. 3 is the structural representation that virtual screen in an embodiment realizes system.
[embodiment]
As shown in Figure 1, in one embodiment, a kind of virtual screen implementation method, comprises the following steps:
Step S10, initialization 3 D stereo screen.
Concrete, in one embodiment, can set up three-dimensional system of coordinate O-xyz, initialization 3 D stereo screen is the rectangular parallelepiped region in three-dimensional system of coordinate, and three ribs intersected in rectangular parallelepiped region are parallel with the x-axis of described three-dimensional system of coordinate, y-axis, z-axis respectively.
As shown in Figure 2, in one embodiment, can the center of display screen be initial point O, with through initial point O, display screen planar and the direction straight line that is horizontal direction for x-axis, with through initial point O and the direction straight line that is vertical direction for y-axis, perpendicular to the straight line of xOy plane for z-axis, to set up three-dimensional system of coordinate O-xyz through initial point O.Further, can arrange block length side's body region in the front of display screen is 3 D stereo screen, makes three ribs intersected in rectangular parallelepiped region parallel with the x-axis of described three-dimensional system of coordinate, y-axis, z-axis respectively.Such as, can initialization 3 D stereo screen be rectangular parallelepiped region: (x, y, z) |-40≤x≤40 ,-30≤y≤30 ,-140≤z≤-10}.In one embodiment, initialization 3 D stereo screen can be carried out according to user's input, user can input the length, width and height of 3 D stereo screen and the position of 3 D stereo screen according to the extending range of self, vision condition, motor habit etc., makes user operation convenient.
In another embodiment, can the 3 D stereo screen of other shape of initialization according to actual needs.Concrete, can initialization 3 D stereo screen be a cylinder, the forward and backward surface of cylinder be parallel to xOy plane, and the line of forward and backward centre of surface is perpendicular to forward and backward surface, the shape size on forward and backward surface is identical, and the shape on forward and backward surface is identical with the shape of display screen.The shape on the forward and backward surface of 3 D stereo screen can be set according to the shape of display screen, such as circular, ellipse, hexagon etc.
Three-dimensional system of coordinate O-xyz and 3 D stereo screen are set in the above described manner, then be marked at the coordinate (x of xOy plane, y) the icon screen coordinate within display screen of mark is corresponded to, namely, the icon screen coordinate within display screen of mark can be calculated according to the coordinate (x, y) being marked at xOy plane.
Step S20, gathers the image sequence of mark.
In one embodiment, mark can be the object of designated color and/or shape.In one embodiment, mark can be the reflectorized material of designated color and/or shape.Preferably, circular reverse light-source is labeled as.In other embodiments, mark can also be certain position of human body, such as, can be the finger etc. of people.User can manipulate mark and move in space, the action of the real touch-screen of simulated touch.
Preferably, the image that three-dimensional image acquisition apparatus collection marks can be adopted, such as adopt stereo visual system (video camera known by two locus and Correlation method for data processing equipment form), structured-light system (right video camera, a light source and a Correlation method for data processing equipment form) or TOF (timeoffight, flight time) depth camera etc., gather the three dimensional depth image (i.e. 3-D view) of mark, do not repeat them here.
In one embodiment, the image that once can mark at interval of preset duration collection, obtains the image sequence of mark.
Step S30, the change in location of identification marking in 3 D stereo screen.
Concrete, the coordinate be marked in three-dimensional system of coordinate in identifiable design image, judge mark, whether in 3 D stereo screen, compares the change in location of the mark in current frame image relative to the mark in front default frame (e.g., former frame) image further.
In one embodiment, traditional image processing method can be adopted to extract the region marked in image, and the coordinate of the center of gravity of acquisition mark in above-mentioned three-dimensional system of coordinate is as the coordinate of mark, does not repeat them here.
Step S40, detects the need of correction 3 D stereo screen according to above-mentioned change in location, if so, then performs step S50 and step S60, if not, then perform step S60.
Because user is (instead of on surface) operational label motion in space, the action of the real touch-screen of simulated touch, therefore, is marked with and may produces unnecessary shake, this shake likely activated user expect outside event, or affect the operation of user.For above-mentioned three-dimensional system of coordinate O-xyz, if user is in the face of display screen, manipulation mark moves forward, namely manipulation mark moves near display screen, when pinning the action of display screen with simulation, first mark can be navigated to its position needing to press by user, and then mark is moved forward, wish the control that " pinning " this position is corresponding, but because the hand of user is likely shaken up and down, then mark and not only have displacement in the z-axis direction, it likely also has displacement in xOy plane, now, if the position according to mark generates the instruction pinning display screen, then may there is the phenomenon of " by incessantly " or " some miss ".Because be marked at mobile front and back, its x coordinate and y coordinate there occurs change, are no longer that user wishes the position of " pinning ".
Same, move when user manipulates mark backward, namely manipulation mark moves away from display screen, when leaving the action of display screen with simulation, because the hand of user is likely shaken up and down, be then marked at mobile front and back, not only there is displacement in the z-axis direction, it also may have displacement in xOy plane, if now generate the instruction of unclamping display screen according to the position of mark, then and the instruction of possibility generation error.
Concrete, in one embodiment, above-mentioned change in location changes to the second place for marking from primary importance, whether detectable label moves to the shift length of the second place on the z-axis of above-mentioned three-dimensional system of coordinate from primary importance larger than the shift length in x-axis and y-axis, if so, then judge to correct 3 D stereo screen.
Larger than the shift length in x-axis and y-axis when being marked at the shift length in z-axis, illustrate that mark moves near display screen or moves away from display screen, pin display screen with simulation or unclamp the action of display screen, if be marked at x-axis or/and y-axis also has displacement, y-axis direction is then marked at x-axis or/and there occurs shake, now, illustrate and need correction 3 D stereo screen, to eliminate the impact that mark jitter causes.Step S50, according to above-mentioned change in location correction 3 D stereo screen.
Concrete, in one embodiment, mark can be obtained and move to the second place in the x-axis of above-mentioned three-dimensional system of coordinate and the displacement on y-axis from primary importance, be marked at x-axis and the displacement translation 3 D stereo screen in y-axis according to above-mentioned.
With the three-dimensional system of coordinate O-xyz in Fig. 2 and 3 D stereo screen { (x, y, z) |-40≤x≤40,-30≤y≤30,-140≤z≤-10} is example, if be marked in three-dimensional system of coordinate from (20, 20,-139) (21 are moved to, 22,-132), then be marked at x-axis, y-axis, shift length in z-axis is respectively 1, 2, 7, the shift length be marked in z-axis is larger than the shift length in x-axis and y-axis, then now need according to being marked at x-axis and the displacement translation 3 D stereo screen in y-axis, 3 D stereo screen after correction is { (x, y, z) |-39≤x≤41,-29≤y≤31,-140≤z≤-10}.
After correcting 3 D stereo screen, be marked at mobile front and back, it does not change relative to the component of position in x-axis and y-axis of 3 D stereo screen.
In one embodiment, mark and can describe with the vector of the preset in 3 D stereo screen to mark relative to the position of 3 D stereo screen, be designated as (Δ x, Δ y, Δ z).Such as, can represent with the vector of the central point of 3 D stereo screen to mark, or represent to the vector marked with certain summit of 3 D stereo screen.With in Fig. 23 D stereo screen (x, y, z) |-40≤x≤40 ,-30≤y≤30 ,-140≤z≤-10} is example, can by the summit A (-40 ,-30 ,-140) of 3 D stereo screen to mark M vector
come the position of expressive notation relative to this screen, wherein
In the above example, mark M to move to (21,22 ,-132) from (20,20 ,-139).The mobile front position (20,20 ,-139) of mark is relative to the position correcting front three-dimensional stereoscopic screen
after mark M moves, according to the displacement 1 be marked in x-axis and the displacement 2 in y-axis, 3 D stereo screen is carried out translation, by (x, y, z) |-40≤x≤40,-30≤y≤30 ,-140≤z≤-10} becomes { (x, y, z) |-39≤x≤41,-28≤y≤32 ,-140≤z≤-10}, therefore marks the position (21 after moving, 22 ,-132) relative to the position of the 3 D stereo screen after correction
I.e. (Δ x, Δ y) not change.Correct 3 D stereo screen and eliminate the impact that mark shakes generation up and down.
Step S60, the position according to mark generates instruction.
Concrete, in one embodiment, the position be marked in 3 D stereo screen can be obtained, this position is converted to the screen coordinate in display screen, and generate the instruction relevant to screen coordinate.If 3 D stereo screen corrects, then obtain the position in mark 3 D stereo screen after calibration.
Concrete, being marked at position in 3 D stereo screen can with the position of above-mentioned mark relative to three-dimensional screen
Represent.
In one embodiment, the detailed process position be marked in 3 D stereo screen being converted to the step of the screen coordinate in display screen is: the screen coordinate calculating mark correspondence position within display screen according to the component of the position be marked in 3 D stereo screen in x-axis and y-axis.Concrete, can according to position (the Δ x of mark relative to 3 D stereo screen, Δ y, Δ z) component (i.e. Δ x, Δ y) in x-axis and y-axis, be parallel to the size in the face of xOy plane, the resolution sizes of display screen to calculate the screen coordinate of mark correspondence position within display screen in 3 D stereo screen.
For the three-dimensional system of coordinate in Fig. 2 and 3 D stereo screen, easily know that the size of the face ABCD being parallel to xOy plane in 3 D stereo screen is 80 × 60.Bidding note is (Δ x relative to the position of 3 D stereo screen, Δ y, Δ z)=(60,10,2), then (Δ x, Δ y)=(60,10), if the resolution of display screen is 800 × 600, then the ratio of the easy size according to ABCD and display screen resolution size calculates the screen coordinate be marked in display screen is (600,100).
Further, when detecting that mark moves to the second place from primary importance, the length being marked at z-axis top offset is larger than the shift length in x-axis and y-axis, and the distance being marked at primary importance and display screen is than when the distance of the second place and display screen is large, can according to mark screen coordinate within display screen, generate the instruction of pressing this screen coordinate place in this display screen, and event relevant according to the instruction triggers pressing display screen further.The length being marked at z-axis top offset if detect is larger than the shift length in x-axis and y-axis, and be marked at primary importance less than the distance being marked at the second place and display screen with the distance of display screen time, can according to mark screen coordinate within display screen, generate the instruction of unclamping this screen coordinate position in display screen, and further according to the instruction triggers dependent event of unclamping display screen.
In the present embodiment, whether shift length when judge mark moves to the second place from primary importance on z-axis is greater than the shift length in x-axis and y-axis, if, illustrate when display screen is pinned in simulation or unclamp the action of display screen, mark not only creates displacement in z-axis, may due to the shake of user's hand, be marked in x-axis or y-axis and also create displacement, now, according to the displacement translation 3 D stereo screen be marked in x-axis and y-axis, to eliminate the displacement produced in x-axis and y-axis due to mark jitter, corresponding instruction is generated further according to the position be marked in 3 D stereo screen.Aforesaid way can identify the operation behavior of user more exactly, and the operation avoiding hand shaking to cause is inaccurate.
In another embodiment, step S40 can judge whether according to the correcting condition pre-set to need to correct 3 D stereo screen.Concrete, can pre-set and need the condition correcting 3 D stereo screen to be the specific change in location of mark, such as, arranging the condition correcting 3 D stereo screen is: mark to move along preset direction or mark and move in a circle etc.Whether step S40 can move along preset direction by judge mark, or marks whether to move in a circle, and being if so, then judged to be needs to correct 3 D stereo screen.
In the present embodiment, the bearing calibration that step S50 can be corresponding according to the correcting condition pre-set corrects 3 D stereo screen.Concrete, such as, can arrange when mark in the horizontal direction be greater than pre-set velocity move time, according to the displacement translation 3 D stereo screen marking movement; When mark up moves to be greater than pre-set velocity, the shift length according to mark amplifies 3 D stereo screen; When mark moves down to be greater than pre-set velocity, the shift length according to mark reduces 3 D stereo screen; When mark moves in a circle, 3 D stereo screen is returned to prime area, etc.
In the present embodiment, according to pre-conditioned correction 3 D stereo screen, user can adjust position and the size of 3 D stereo screen as required, thus can user friendlyly operate.
In one embodiment, above-mentioned virtual screen implementation method, also comprises step:
Whether certification mark is positioned at outside 3 D stereo screen, if so, then arranges the region arranged when 3 D stereo screen is initialization 3 D stereo screen.
In above-mentioned example, the prime area of the 3 D stereo screen arranged during initialization 3 D stereo screen is { (x, y, z) |-40≤x≤40,-30≤y≤30,-140≤z≤-10}, when detecting that mark is positioned at outside 3 D stereo screen, can arrange 3 D stereo screen is above-mentioned prime area.
In the present embodiment, the region arranged when 3 D stereo screen being set to initialization 3 D stereo screen, can avoid 3 D stereo screen increasing with the skew of the 3 D stereo screen of original initialization after repeatedly correcting, and cause user to manipulate inconvenience.
In one embodiment, above-mentioned virtual screen implementation method also comprises:
According to the position of mark relative to 3 D stereo screen, obtain the pixel coordinate of this position correspondence within display screen, at the icon of this pixel coordinate place show tags of display screen.
Concrete, can according to position (the Δ x of mark relative to 3 D stereo screen, Δ y, Δ z) component (i.e. Δ x, Δ y) in x-axis and y-axis, be parallel to the size in the face of xOy plane, the resolution sizes of display screen to calculate mark pixel coordinate within display screen in 3 D stereo screen.For the three-dimensional system of coordinate in Fig. 2 and 3 D stereo screen, easily know that the size of the face ABCD being parallel to xOy plane in 3 D stereo screen is 80 × 60.Bidding note is (60 relative to the position of 3 D stereo screen, 10,2), then marking relative to the component of position in xOy plane of 3 D stereo screen is (60,10), if the resolution of display screen is 800 × 600, then easily calculate mark pixel coordinate within display screen for (600,100).
In one embodiment, when through mark and perpendicular to the straight line of xOy plane without 3 D stereo screen, can not the icon of show tags within display screen.Such as, for above-mentioned 3 D stereo screen (x, y, z) |-40≤x≤40,-30≤y≤30 ,-140≤z≤-10}, when mark is not at { (x, y) |-40≤x≤40, time within the scope of-30≤y≤30}, can not in display screen the icon of show tags.
In the present embodiment, according to the position of mark relative to 3 D stereo screen, at the icon of the corresponding position show tags of display screen, specifically labelled position when user can be facilitated to manipulate mark, improve the operation ease of user, and simulate the same effect of touch entity touch-screen, improve the experience of user.
In one embodiment, above-mentioned virtual screen implementation method also comprises: the distance of show tags and 3 D stereo screen and mark enter the information of the depth of 3 D stereo screen within display screen.
Concrete, the depth of 3 D stereo screen can be entered according to the distance between mark and 3 D stereo screen or mark, change the shape of the icon marked in display screen, size or pattern, mark to point out user the depth entering 3 D stereo screen with the distance of 3 D stereo screen or mark.
In the present embodiment, the distance of show tags and 3 D stereo screen and mark enter the information of the depth of 3 D stereo screen within display screen, the distance of user's perceptible markings and 3 D stereo screen and mark can be made to enter the depth of 3 D stereo screen, thus facilitate user to manipulate mark, and add the experience of user.
It should be noted that in one embodiment, step S10 can perform once when system starts, until system closing does not need to perform again.During system cloud gray model, step S20 can be performed at interval of preset duration, and perform step S30 ~ S60 in order at interval of preset duration.In one embodiment, step S20 and step S30 ~ S60 can carry out parallel processing.
As shown in Figure 3, in one embodiment, a kind of virtual screen realizes system, comprises processing module 10, image capture module 20, identification module 30, wherein:
Processing module 10 is for initialization 3 D stereo screen.
Concrete, in one embodiment, processing module 10 can set up three-dimensional system of coordinate O-xyz, and initialization 3 D stereo screen is the rectangular parallelepiped region in three-dimensional system of coordinate, makes three ribs intersected in rectangular parallelepiped region parallel with the x-axis of described three-dimensional system of coordinate, y-axis, z-axis respectively.。
As shown in Figure 2, in one embodiment, processing module 10 can the center of display screen be initial point O, with through initial point O, display screen planar and the direction straight line that is horizontal direction for x-axis, with through initial point O and the direction straight line that is vertical direction for y-axis, to set up three-dimensional system of coordinate O-xyz through initial point O and perpendicular to the straight line of xOy plane for z-axis, arranging block length side's body region in the front of display screen is 3 D stereo screen, makes three ribs intersected in rectangular parallelepiped region parallel with the x-axis of described three-dimensional system of coordinate, y-axis, z-axis respectively.Such as, can initialization 3 D stereo screen be rectangular parallelepiped region: (x, y, z) |-40≤x≤40 ,-30≤y≤30 ,-140≤z≤-10}.
In one embodiment, processing module 10 can carry out initialization 3 D stereo screen according to user's input, user can input the length, width and height of 3 D stereo screen and the position of 3 D stereo screen according to the extending range of self, vision condition, motor habit etc., makes user operation convenient.
In another embodiment, processing module 10 can the 3 D stereo screen of other shape of initialization according to actual needs.Concrete, processing module 10 can initialization 3 D stereo screen be a cylinder, the forward and backward surface of cylinder is parallel to xOy plane, the line of forward and backward centre of surface is perpendicular to forward and backward surface, the shape size on forward and backward surface is identical, and the shape on forward and backward surface is identical with the shape of display screen.The shape on the forward and backward surface of 3 D stereo screen can be set according to the shape of display screen, such as circular, ellipse, hexagon etc.
Three-dimensional system of coordinate O-xyz and 3 D stereo screen are set in the above described manner, then be marked at the coordinate (x of xOy plane, y) the icon screen coordinate within display screen of mark is corresponded to, namely, the icon screen coordinate within display screen of mark can be calculated according to the coordinate (x, y) being marked at xOy plane.
Image capture module 20 is for gathering the image sequence of mark.
In one embodiment, mark can be the object of designated color and/or shape.In one embodiment, mark can be the reflectorized material of designated color and/or shape.Preferably, circular reverse light-source is labeled as.In other embodiments, mark can also be certain position of human body, such as, can be the finger etc. of people.User can manipulate mark and move in space, the action of the real touch-screen of simulated touch.
Preferably, the image that image capture module 20 can adopt three-dimensional image acquisition apparatus collection to mark, such as adopt stereo visual system (video camera known by two locus and Correlation method for data processing equipment form), structured-light system (right video camera, a light source and a Correlation method for data processing equipment form) or TOF (timeofflight, flight time) depth camera etc., gather the three dimensional depth image (i.e. 3-D view) of mark, do not repeat them here.
In one embodiment, the image that image capture module 20 once can mark at interval of preset duration collection, obtains the image sequence of mark.
Identification module 30 is for the change in location of identification marking in 3 D stereo screen.
Concrete, the coordinate be marked in three-dimensional system of coordinate in identification module 30 identifiable design image, judge mark, whether in 3 D stereo screen, compares the change in location of the mark in current frame image relative to the mark in front default frame (e.g., former frame) image further.
In one embodiment, identification module 30 can adopt traditional image processing method to extract the region marked in image, and the coordinate of the center of gravity of acquisition mark in above-mentioned three-dimensional system of coordinate is as the coordinate of mark, does not repeat them here.
Processing module 10 also for detecting the need of correction 3 D stereo screen according to above-mentioned change in location, if so, then 3 D stereo screen according to described change in location correction.
Because user is (instead of on surface) operational label motion in space, the action of the real touch-screen of simulated touch, therefore, is marked with and may produces unnecessary shake, this shake likely activated user expect outside event, or affect the operation of user.For above-mentioned three-dimensional system of coordinate O-xyz, if user is in the face of display screen, manipulation mark moves forward, namely manipulation mark moves near display screen, when pinning the action of display screen with simulation, first mark can be navigated to its position needing to press by user, and then mark is moved forward, wish the control that " pinning " this position is corresponding, but because the hand of user is likely shaken up and down, then mark and not only have displacement in the z-axis direction, it likely also has displacement in xOy plane, now, if the position according to mark generates the instruction pinning display screen, then may there is the phenomenon of " by incessantly " or " some miss ".Because be marked at mobile front and back, its x coordinate and y coordinate there occurs change, are no longer that user wishes the position of " pinning ".
Same, move when user manipulates mark backward, namely manipulation mark moves away from display screen, when leaving the action of display screen with simulation, because the hand of user is likely shaken up and down, be then marked at mobile front and back, not only there is displacement in the z-axis direction, it also may have displacement in xOy plane, if now generate the instruction of unclamping display screen according to the position of mark, then and the instruction of possibility generation error.
Concrete, in one embodiment, above-mentioned change in location changes to the second place for marking from primary importance, whether processing module 10 detectable label moves to the shift length of the second place on the z-axis of above-mentioned three-dimensional system of coordinate from primary importance larger than the shift length in x-axis and y-axis, if so, then judge to correct 3 D stereo screen.
Larger than the shift length in x-axis and y-axis when being marked at the shift length in z-axis, illustrate that mark moves near display screen or moves away from display screen, pin display screen with simulation or unclamp the action of display screen, if be marked at x-axis or/and y-axis also has displacement, y-axis direction is then marked at x-axis or/and there occurs shake, now, illustrate and need correction 3 D stereo screen, to eliminate the impact that mark jitter causes.
Further, in one embodiment, processing module 10 is also for when needs correct 3 D stereo screen, obtain mark and move to the second place in the x-axis of above-mentioned three-dimensional system of coordinate and the displacement on y-axis from primary importance, be marked at x-axis and the displacement translation 3 D stereo screen in y-axis according to above-mentioned.
With the three-dimensional system of coordinate O-xyz in Fig. 2 and 3 D stereo screen { (x, y, z) |-40≤x≤40,-30≤y≤30,-140≤z≤-10} is example, if be marked in three-dimensional system of coordinate from (20, 20,-139) (21 are moved to, 22,-132), then be marked at x-axis, y-axis, shift length in x-axis is respectively 1, 2, 7, the shift length be marked in z-axis is larger than the shift length in x-axis and y-axis, then now need according to being marked at x-axis and the displacement translation 3 D stereo screen in y-axis, 3 D stereo screen after correction is { (x, y, z) |-39≤x≤41,-29≤y≤31,-140≤z≤-10}.
After correcting 3 D stereo screen, be marked at mobile front and back, it does not change relative to the component of position in x-axis and y-axis of 3 D stereo screen.
In one embodiment, mark and can describe with the vector of the preset in 3 D stereo screen to mark relative to the position of 3 D stereo screen, be designated as (Δ x, Δ y, Δ z).Such as, can represent with the vector of the central point of 3 D stereo screen to mark, or represent to the vector marked with certain summit of 3 D stereo screen.With in Fig. 23 D stereo screen (x, y, z) |-40≤x≤40 ,-30≤y≤30 ,-140≤z≤-10} is example, can by the summit A (-40 ,-30 ,-140) of 3 D stereo screen to mark M vector
come the position of expressive notation relative to this screen, wherein
In the above example, mark M to move to (21,22 ,-132) from (20,20 ,-139).The mobile front position (20,20 ,-139) of mark is relative to the position correcting front three-dimensional stereoscopic screen
after mark M moves, according to the displacement 1 be marked in x-axis and the displacement 2 in y-axis, 3 D stereo screen is carried out translation, by (x, y, z) |-40≤x≤40,-30≤y≤30 ,-140≤z≤-10} becomes { (x, y, z) |-39≤x≤41,-28≤y≤32 ,-140≤z≤-10}, therefore marks the position (21 after moving, 22 ,-132) relative to the position of the 3 D stereo screen after correction
I.e. (Δ x, Δ y) not change.Correct 3 D stereo screen and eliminate the impact that mark shakes generation up and down.
Further, processing module 10 also generates instruction for the position according to mark
Concrete, in one embodiment, processing module 10 can be used for obtaining the position be marked in 3 D stereo screen, this position is converted to the screen coordinate in display screen, and generates the instruction relevant to screen coordinate.
Concrete, if processing module 10 corrects 3 D stereo screen, then obtain the position in mark 3 D stereo screen after calibration.
Concrete, the position be marked in 3 D stereo screen can with the position marked in example relative to three-dimensional screen
Represent.
In one embodiment, processing module 10 can calculate the screen coordinate of mark correspondence position within display screen according to the component of the position be marked in 3 D stereo screen in x-axis and y-axis.Concrete, processing module 10 can according to position (the Δ x of mark relative to 3 D stereo screen, Δ y, Δ z) component (i.e. Δ x, Δ y) in x-axis and y-axis, be parallel to the size in the face of xOy plane, the resolution sizes of display screen to calculate the screen coordinate of mark correspondence position within display screen in 3 D stereo screen.
For the three-dimensional system of coordinate in Fig. 2 and 3 D stereo screen, easily know that the size of the face ABCD being parallel to xOy plane in 3 D stereo screen is 80 × 60.Bidding note is (Δ x relative to the position of 3 D stereo screen, Δ y, Δ z)=(60,10,2), then (Δ x, Δ y)=(60,10), if the resolution of display screen is 800 × 600, then the ratio of the easy size according to ABCD and display screen resolution size calculates mark screen coordinate within display screen for (600,100).
Further, when detecting that mark moves to the second place from primary importance, the length being marked at z-axis top offset is larger than the shift length in x-axis and y-axis, and the distance being marked at primary importance and display screen is than when the distance of the second place and display screen is large, processing module 10 can according to mark screen coordinate within display screen, generate the instruction of pressing this screen coordinate place in this display screen, and event relevant according to the instruction triggers pressing display screen further.The length being marked at z-axis top offset if detect is larger than the shift length in x-axis and y-axis, and be marked at primary importance less than the distance being marked at the second place and display screen with the distance of display screen time, processing module 10 can according to mark screen coordinate within display screen, generate the instruction of unclamping this screen coordinate position in display screen, and further according to the instruction triggers dependent event of unclamping display screen.
In the present embodiment, whether shift length when judge mark moves to the second place from primary importance on z-axis is greater than the shift length in x-axis and y-axis, if, illustrate when display screen is pinned in simulation or unclamp the action of display screen, mark not only creates displacement in z-axis, may due to the shake of user's hand, be marked in x-axis or y-axis and also create displacement, now, according to the displacement translation 3 D stereo screen be marked in x-axis and y-axis, to eliminate the displacement produced in x-axis and y-axis due to mark jitter, corresponding instruction is generated further according to the position be marked in 3 D stereo screen.Aforesaid way can identify the operation behavior of user more exactly, and the operation avoiding hand shaking to cause is inaccurate.
In another embodiment, processing module 10 also can be used for judging whether to need to correct 3 D stereo screen according to the correcting condition pre-set.Concrete, can pre-set and need the condition correcting 3 D stereo screen to be the specific change in location of mark, such as, arranging the condition correcting 3 D stereo screen is: mark to move along preset direction or mark and move in a circle etc.Whether processing module 10 can move along preset direction by judge mark, or marks whether to move in a circle, and being if so, then judged to be needs to correct 3 D stereo screen.
In the present embodiment, processing module 10 also can be used for the bearing calibration corresponding according to the correcting condition pre-set and corrects 3 D stereo screen.Concrete, such as, can arrange when mark in the horizontal direction be greater than pre-set velocity move time, according to the displacement translation 3 D stereo screen marking movement; When mark up moves to be greater than pre-set velocity, the shift length according to mark amplifies 3 D stereo screen; When mark moves down to be greater than pre-set velocity, the shift length according to mark reduces 3 D stereo screen; When mark moves in a circle, 3 D stereo screen is returned to prime area, etc.
In the present embodiment, according to pre-conditioned correction 3 D stereo screen, user can adjust position and the size of 3 D stereo screen as required, thus can user friendlyly operate.
In one embodiment, whether the processing module 10 that above-mentioned virtual screen realizes system is also positioned at outside 3 D stereo screen for certification mark, if so, then arranges the region arranged when 3 D stereo screen is initialization 3 D stereo screen.
In above-mentioned example, the prime area of the 3 D stereo screen arranged during initialization 3 D stereo screen is { (x, y, z) |-40≤x≤40,-30≤y≤30,-140≤z≤-10}, processing module 10 is also for when detecting that mark is positioned at outside 3 D stereo screen, and arranging 3 D stereo screen is above-mentioned prime area.
In the present embodiment, the region arranged when 3 D stereo screen being set to initialization 3 D stereo screen, can avoid 3 D stereo screen increasing with the skew of the 3 D stereo screen of original initialization after repeatedly correcting, and cause user to manipulate inconvenience.
In one embodiment, processing module 10 also for according to the position of mark relative to 3 D stereo screen, obtains the pixel coordinate of this position correspondence within display screen.In the present embodiment, above-mentioned virtual screen realizes system and also comprises display module (not shown), for the icon of this pixel coordinate place show tags at display screen.
Specifically, processing module 10 can according to position (the Δ x of mark relative to 3 D stereo screen, Δ y, Δ z) component (i.e. Δ x, Δ y) in x-axis and y-axis, be parallel to the size in the face of xOy plane, the resolution sizes of display screen to calculate mark pixel coordinate within display screen in 3 D stereo screen.For the three-dimensional system of coordinate in Fig. 2 and 3 D stereo screen, easily know that the size of the face ABCD being parallel to xOy plane in 3 D stereo screen is 80 × 60.Bidding note is (60 relative to the position of 3 D stereo screen, 10,2), then marking relative to the component of position in xOy plane of 3 D stereo screen is (60,10), if the resolution of display screen is 800 × 600, then easily calculate mark pixel coordinate within display screen for (600,100).
In one embodiment, when through mark and perpendicular to the straight line of xOy plane without 3 D stereo screen, can not the icon of show tags within display screen.Such as, for above-mentioned 3 D stereo screen (x, y, z) |-40≤x≤40,-30≤y≤30 ,-140≤z≤-10}, when mark is not at { (x, y) |-40≤x≤40, time within the scope of-30≤y≤30}, can not in display screen the icon of show tags.
In the present embodiment, according to the position of mark relative to 3 D stereo screen, at the icon of the corresponding position show tags of display screen, specifically labelled position when user can be facilitated to manipulate mark, improve the operation ease of user, and simulate the same effect of touch entity touch-screen, improve the experience of user.
In one embodiment, display module also enters the information of the depth of 3 D stereo screen for the distance of show tags and 3 D stereo screen within display screen and mark.
Concrete, display module can enter the depth of 3 D stereo screen according to the distance between mark and 3 D stereo screen or mark, change the shape of the icon marked in display screen, size or pattern, mark to point out user the depth entering 3 D stereo screen with the distance of 3 D stereo screen or mark.
In the present embodiment, the distance of show tags and 3 D stereo screen and mark enter the information of the depth of 3 D stereo screen within display screen, the distance of user's perceptible markings and 3 D stereo screen and mark can be made to enter the depth of 3 D stereo screen, thus facilitate user to manipulate mark, and add the experience of user.
Above-mentioned virtual screen implementation method and system provide a kind of touch-screen simulated operation pattern, user can in the 3 D stereo screen that it is virtual in front, manipulation mark moves the action of simulated touch entity touch-screen, the effect identical with touching entity touch-screen can be produced, and user also carries out remote control by manipulation mark to controlled device, therefore, aforesaid way improves user operation convenience, adds the experience of user.In addition, aforesaid way, can make the operation of user no longer be confined to the touch-screen of entity, but can more freely stretch more flexibly and move in space, and thus, aforesaid way makes the operation hommization more of user, improves the convenience of user operation.
Moreover, above-mentioned virtual screen implementation method and system, also according to the change in location be marked in 3 D stereo screen, judge whether to need to correct 3 D stereo screen, if so, then correct 3 D stereo screen, and generate instruction according to the position of mark.Aforesaid way can according to the change in location judge mark be marked in 3 D stereo screen whether in space create unnecessary shake, if, explanation needs to correct 3 D stereo screen, then correct the unnecessary shake that 3 D stereo screen produces to eliminate mark further, thus aforesaid way can identify the behavior of user more accurately, and the operation avoiding hand shaking to cause is inaccurate.
The above embodiment only have expressed several embodiment of the present invention, and it describes comparatively concrete and detailed, but therefore can not be interpreted as the restriction to the scope of the claims of the present invention.It should be pointed out that for the person of ordinary skill of the art, without departing from the inventive concept of the premise, can also make some distortion and improvement, these all belong to protection scope of the present invention.Therefore, the protection domain of patent of the present invention should be as the criterion with claims.
Claims (12)
1. a virtual screen implementation method, comprises the following steps:
Initialization 3 D stereo screen;
Gather the image sequence of mark;
The change in location of identification marking in described 3 D stereo screen;
Detect the need of correction 3 D stereo screen according to described change in location, if so, then 3 D stereo screen according to described change in location correction;
Position according to mark generates instruction;
Wherein, described change in location changes to the second place for marking from primary importance; The described step detected the need of correcting 3 D stereo screen according to described change in location comprises:
Detect described mark and whether than the shift length in the x-axis and y-axis of described three-dimensional system of coordinate greatly to move to the shift length of the second place on the z-axis of described three-dimensional system of coordinate from primary importance, if so, then judge to correct described 3 D stereo screen.
2. virtual screen implementation method according to claim 1, it is characterized in that, the step of described initialization 3 D stereo screen comprises: set up three-dimensional system of coordinate O-xyz, 3 D stereo screen described in initialization is the rectangular parallelepiped region in described three-dimensional system of coordinate, and three ribs intersected in described rectangular parallelepiped region are parallel with the x-axis of described three-dimensional system of coordinate, y-axis, z-axis respectively.
3. virtual screen implementation method according to claim 1, is characterized in that, the step of described 3 D stereo screen according to change in location correction comprises:
The x-axis of described three-dimensional system of coordinate and the displacement in y-axis is marked at, according to 3 D stereo screen described in described displacement translation described in acquisition.
4. virtual screen implementation method according to claim 2, it is characterized in that, the step that the described position according to mark generates instruction comprises: be marked at the position in 3 D stereo screen described in acquisition, described position is converted to the screen coordinate in display screen, and generates the instruction relevant to described screen coordinate.
5. virtual screen implementation method according to claim 4, is characterized in that, the step of the described screen coordinate be converted in display screen described position comprises:
The screen coordinate of mark correspondence position is within display screen calculated according to the component of the position be marked in 3 D stereo screen in x-axis and y-axis.
6. the virtual screen implementation method according to claim 1 to 5 any one, it is characterized in that, described method also comprises: mark whether described in detection to be positioned at outside described 3 D stereo screen, if so, then arranges the region arranged when described 3 D stereo screen is initialization 3 D stereo screen.
7. virtual screen realizes a system, it is characterized in that, comprising:
Processing module, for initialization 3 D stereo screen;
Image capture module, for gathering the image sequence of mark;
Identification module, the change in location of identification marking in described 3 D stereo screen;
Described processing module also for detecting the need of correction 3 D stereo screen according to described change in location, if so, then 3 D stereo screen according to described change in location correction;
Described processing module also generates instruction for the position according to mark,
Wherein, described change in location changes to the second place for marking from primary importance;
Also whether for detecting described mark, to move to the shift length of the second place on the z-axis of described three-dimensional system of coordinate from primary importance larger than the shift length in the x-axis and y-axis of described three-dimensional system of coordinate for described processing module, if so, then judge to need to correct described 3 D stereo screen.
8. virtual screen according to claim 7 realizes system, it is characterized in that, described processing module is also for setting up three-dimensional system of coordinate O-xyz, 3 D stereo screen described in initialization is the rectangular parallelepiped region in described three-dimensional system of coordinate, and three ribs intersected in described rectangular parallelepiped region are parallel with the x-axis of described three-dimensional system of coordinate, y-axis, z-axis respectively.
9. virtual screen according to claim 7 realizes system, it is characterized in that, described processing module is also for correcting described 3 D stereo screen during when needs, described in acquisition, be marked at the x-axis of described three-dimensional system of coordinate and the displacement in y-axis, according to 3 D stereo screen described in described displacement translation.
10. virtual screen according to claim 9 realizes system, it is characterized in that, described position also for being marked at the position in 3 D stereo screen described in obtaining, is converted to the screen coordinate in display screen by described processing module, and generates the instruction relevant to described screen coordinate.
11. virtual screen according to claim 10 realize system, it is characterized in that, described processing module is used for when described position being converted to the screen coordinate in display screen, calculates the screen coordinate of mark correspondence position within display screen according to the component of the position be marked in 3 D stereo screen in x-axis and y-axis.
12. virtual screen according to claim 7 to 11 any one realize system, it is characterized in that, described processing module also marks whether to be positioned at outside described 3 D stereo screen described in detecting, and if so, then arranges the region arranged when described 3 D stereo screen is initialization 3 D stereo screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210079257.1A CN103324327B (en) | 2012-03-22 | 2012-03-22 | Virtual screen implementation method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210079257.1A CN103324327B (en) | 2012-03-22 | 2012-03-22 | Virtual screen implementation method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103324327A CN103324327A (en) | 2013-09-25 |
| CN103324327B true CN103324327B (en) | 2016-04-06 |
Family
ID=49193124
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210079257.1A Active CN103324327B (en) | 2012-03-22 | 2012-03-22 | Virtual screen implementation method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103324327B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105912101B (en) * | 2016-03-31 | 2020-08-25 | 联想(北京)有限公司 | Projection control method and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0913790A1 (en) * | 1997-10-29 | 1999-05-06 | Takenaka Corporation | Hand pointing apparatus |
| CN101518096A (en) * | 2006-09-20 | 2009-08-26 | 苹果公司 | Three-dimensional display system |
| CN101625844A (en) * | 2008-07-07 | 2010-01-13 | 华晶科技股份有限公司 | System and method for preventing screen of image display device from vibrating |
| CN102004623A (en) * | 2010-11-29 | 2011-04-06 | 深圳市九洲电器有限公司 | Three-dimensional image display device and method |
-
2012
- 2012-03-22 CN CN201210079257.1A patent/CN103324327B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0913790A1 (en) * | 1997-10-29 | 1999-05-06 | Takenaka Corporation | Hand pointing apparatus |
| CN101518096A (en) * | 2006-09-20 | 2009-08-26 | 苹果公司 | Three-dimensional display system |
| CN101625844A (en) * | 2008-07-07 | 2010-01-13 | 华晶科技股份有限公司 | System and method for preventing screen of image display device from vibrating |
| CN102004623A (en) * | 2010-11-29 | 2011-04-06 | 深圳市九洲电器有限公司 | Three-dimensional image display device and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103324327A (en) | 2013-09-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP5604739B2 (en) | Image recognition apparatus, operation determination method, and program | |
| JP4701424B2 (en) | Image recognition apparatus, operation determination method, and program | |
| JP5167523B2 (en) | Operation input device, operation determination method, and program | |
| CN102508578B (en) | Projection positioning device and method as well as interaction system and method | |
| US8589824B2 (en) | Gesture recognition interface system | |
| JP5921835B2 (en) | Input device | |
| CN106020436A (en) | Image analyzing apparatus and image analyzing method | |
| CN104199550B (en) | Virtual keyboard operation device, system and method | |
| WO2012039140A1 (en) | Operation input apparatus, operation input method, and program | |
| JP4796194B1 (en) | Cursor display method and cursor display program | |
| CN104423578B (en) | Interactive input system and method | |
| JP6146094B2 (en) | Information operation display system, display program, and display method | |
| CN101799717A (en) | Man-machine interaction method based on hand action catch | |
| KR101518727B1 (en) | A stereoscopic interaction system and stereoscopic interaction method | |
| KR20120126508A (en) | method for recognizing touch input in virtual touch apparatus without pointer | |
| CN103677240A (en) | Virtual touch interaction method and equipment | |
| CN102650906A (en) | Control method and device for user interface | |
| CN106774938A (en) | Man-machine interaction integrating device based on somatosensory device | |
| CN203386146U (en) | Infrared video positioning-based man-machine interactive device | |
| CN107797648A (en) | Virtual touch system and image recognition localization method, computer-readable recording medium | |
| CN103324327B (en) | Virtual screen implementation method and system | |
| CN105759955A (en) | Input device | |
| US20180203528A1 (en) | Behind-display user interface | |
| CN102629155A (en) | Method and device for implementing non-contact operation | |
| CN103389793B (en) | Man-machine interaction method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 518000 Shenzhen, Nanshan District Province, science and technology, South Road, the building of the big square, building 02, room 4, Patentee after: SHENZHEN TAISHAN SPORTS TECHNOLOGY CORP., LTD. Address before: 518000 Shenzhen, Nanshan District Province, science and technology, South Road, the building of the big square, building 02, room 4, Patentee before: Shenzhen Tol Technology Co., Ltd. |
|
| CP01 | Change in the name or title of a patent holder |
Address after: 518000 room 02, 4th floor, Fangda building, Keji South 12th Road, Nanshan District, Shenzhen City, Guangdong Province Patentee after: Shenzhen Taishan Sports Technology Co.,Ltd. Address before: 518000 room 02, 4th floor, Fangda building, Keji South 12th Road, Nanshan District, Shenzhen City, Guangdong Province Patentee before: SHENZHEN TAISHAN SPORTS TECHNOLOGY Corp.,Ltd. |
|
| CP01 | Change in the name or title of a patent holder |