CN103984101B - Display contents controlling method and device - Google Patents

Display contents controlling method and device Download PDF

Info

Publication number
CN103984101B
CN103984101B CN201410239854.5A CN201410239854A CN103984101B CN 103984101 B CN103984101 B CN 103984101B CN 201410239854 A CN201410239854 A CN 201410239854A CN 103984101 B CN103984101 B CN 103984101B
Authority
CN
China
Prior art keywords
display
operating body
display content
display object
hmd
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410239854.5A
Other languages
Chinese (zh)
Other versions
CN103984101A (en
Inventor
陆元飞
黄西华
李建伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201410239854.5A priority Critical patent/CN103984101B/en
Publication of CN103984101A publication Critical patent/CN103984101A/en
Application granted granted Critical
Publication of CN103984101B publication Critical patent/CN103984101B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The embodiment of the present application provides a kind of display contents controlling method and device, it is applied in head-wearing type intelligent equipment, described head-wearing type intelligent equipment includes head mounted display HMD and image acquisition device, user realizes the control to the display content in the viewing area of described HMD by operating body, and described method includes: determined the initial position of described operating body by described image acquisition device;Determine that the initial position of described operating body is mapped to the operating position in the viewing area of described HMD, and determine the first display object in described display content according to described operating position;The action message of described operating body is gathered by described image acquisition device;According to described action message, adjusting described first display object morphological feature in described display content, it is convenient that the embodiment of the present application controls operation, meets the demand for control of user to a certain extent.

Description

Display contents controlling method and device
Technical field
The application relates to electronic technology field, particularly relates to a kind of display contents controlling method and device.
Background technology
Head-wearing type intelligent equipment refers to utilize wearable technology that headset equipment is carried out intelligentized design, and The smart machine developed, such as intelligent glasses etc..
(English: Head-mounted display is called for short: head HMD) to possess head mounted display Wearing formula smart machine, by exporting contents such as images to HMD, user is wearing head-wearing type intelligent equipment Time, i.e. may be viewed by the display content of HMD, and the display content of the HMD watched due to user The display interface of visual imaging space and head mounted display also differs, in the display that user is watched The visual imaging space held is virtual vision space.On user perspective, the HMD's that user is watched Display content is virtual content, and virtual content is added on the actual environment of user's viewing, thus Actual situation can be realized combine, such as, in real scene navigation scene, pavement image can be observed user In directly display navigation map etc..
During realizing the present invention, inventor finds, the head-wearing type intelligent of the existing HMD of possessing sets Standby, the control to HMD display content is only limitted to the control to the display parameters showing content, as bright in display Degree, and be only capable of being realized by the physical button of equipment, operate not convenient, it is impossible to meet the control need of user Ask.
Summary of the invention
In view of this, this application provides a kind of display contents controlling method and device, facility simple to operate, Add the control mode to display content, improve Consumer's Experience.
For achieving the above object, the application provides following technical scheme:
First aspect, it is provided that a kind of display contents controlling method, is applied in head-wearing type intelligent equipment, Described head-wearing type intelligent equipment includes head mounted display HMD and image acquisition device, and user is by operation Body realizes the control to the display content in the viewing area of described HMD, and described method includes:
The initial position of described operating body is determined by described image acquisition device;
Determine that the initial position of described operating body is mapped to the operating position in the viewing area of described HMD, And the first display object in described display content is determined according to described operating position;
The action message of described operating body is gathered by described image acquisition device;
According to described action message, adjust described first display object form in described display content special Levying, described morphological feature at least includes showing the one in position, display size and display shape.
Implementation described may determine the initial of described operating body in the first of described first aspect Position is mapped to the operating position in the viewing area of described HMD, and determines institute according to described operating position The the first display object stated in display content includes:
According to the initial position of described operating body, calculate described operating body and be mapped in virtual vision space Position relatively;Described virtual vision space is user visual imaging space when watching described display content;
Distance according to eyes of user to described HMD and the ratio of the distance to described virtual vision space, Calculate the operating position that described relative position is mapped in the display content of described HMD output;
Determine the first display object being positioned in described display content at described operating position.
In conjunction with the first possible implementation of described first aspect or described first aspect, additionally provide institute State the possible implementation of the second of first aspect, described according to described action message, adjust described first Display object morphological feature in described display content includes:
Determine the pending region blocked by described operating body in described first display object;
In described display content, described pending region is carried out transparent processing, after being adjusted One display object.
In conjunction with described first aspect the second may implementation, additionally provide the of described first aspect Three kinds may implementations, described determine in described first display object located by waiting of blocking of described operating body Reason region includes:
The shield portions of the described operating body corresponding with described action message that inquiry is preset;
Determine the pending region blocked by the shield portions of described operating body in described first display object.
In conjunction with the first possible implementation of described first aspect or described first aspect, additionally provide institute Stating the 4th kind of possible implementation of first aspect, described in the action message of described operating body, operating body is dynamic Make operating body described in information representation to move to end position from described initial position;
Described according to described action message, adjust described first display object shape in described display content State feature, including:
Obtain described operating body primary importance in described collection space and the second place, described first Position and the described second place are that initial position described in described operating body moves the fortune formed to end position Any two position in dynamic track;
Determine the described first display object the 3rd position in described display content;
According to the variation relation of described primary importance Yu the described second place, determine in described display content with The 4th position that described 3rd position is relevant;
Adjust the described first display object the 3rd position from described display content to move to described 4th Put.
In conjunction with the first possible implementation of described first aspect or described first aspect, additionally provide institute State the 5th kind of possible implementation of first aspect, described according to described action message, adjust described first Display object morphological feature in described display content includes:
Obtain the first control strategy that described action message is corresponding;
According to described first control strategy, adjust the display shape of described first display object.
Second aspect, it is provided that a kind of display content control device, is applied in head-wearing type intelligent equipment, Described head-wearing type intelligent equipment includes head mounted display HMD and image acquisition device, and user is by operation Body realizes the control to the display content in the viewing area of described HMD, and described device includes:
Initial position determines module, for being determined the initial bit of described operating body by described image acquisition device Put;
Position mapping block, for determining that the initial position of described operating body is mapped to the display of described HMD Operating position in region;
Object determines module, for determining the first display in described display content according to described operating position Object;
Action acquisition module, for gathering the action message of described operating body by described image acquisition device;
Adjusting module, for according to described action message, adjusts described first display object in described display Morphological feature in content, described morphological feature at least includes showing position, display size and display shape One in shape.
In the first possible implementation of described second aspect, described position mapping block includes:
First map unit, for the initial position according to described operating body, calculates described operating body and maps Relative position in virtual vision space;Described virtual vision space is that user watches described display content Time visual imaging space;
Second map unit, for the distance according to eyes of user to described HMD and to described virtual vision The ratio of the distance in space, calculates in the display content that described relative position is mapped to described HMD output Operating position.
In conjunction with the first possible implementation of described second aspect or described second aspect, additionally provide institute Stating the possible implementation of the second of second aspect, described adjusting module includes:
Area determination unit, is located by waiting of blocking of described operating body for determining in described first display object Reason region;
First adjustment unit, in described display content, carries out transparent place by described pending region Reason, the first display object after being adjusted.
In conjunction with described second aspect the second may implementation, additionally provide the of described second aspect Three kinds of possible implementations, described area determination unit includes:
Query unit, for inquiring about the occlusion part of the default described operating body corresponding with described action message Point;
Region determines subelement, for determining in described first display object by the occlusion part of described operating body Divide the pending region blocked.
In conjunction with the first possible implementation of described second aspect or described second aspect, additionally provide institute Stating the 4th kind of possible implementation of second aspect, the action message of described operating body characterizes described operating body Move to end position from described initial position;Described adjusting module includes:
Position acquisition unit, for obtain described operating body primary importance in described collection space and The second place, described primary importance and the described second place are that initial position described in described operating body moves Any two position to the movement locus that end position is formed;
First determines unit, for determining the 3rd in described display content of described first display object Put;
Second determines unit, for the variation relation according to described primary importance Yu the described second place, really The 4th position relevant to described 3rd position in fixed described display content;
Second adjustment unit, for adjusting the 3rd from described display content of described first display object Put mobile to described 4th position.
In conjunction with the first possible implementation of described second aspect or described second aspect, additionally provide institute Stating the 5th kind of possible implementation of second aspect, described adjusting module includes:
Strategy acquiring unit, for obtaining the first control strategy that described action message is corresponding;
3rd adjustment unit, for according to described first control strategy, adjusting described first display object Display shape.
Understand via above-mentioned technical scheme, compared with prior art, this application provides in a kind of display Holding control method and device, user can realize the control to display content by operating body, it is possible to will be aobvious Show that the display object in content is adjusted, it is not necessary to the physical button of touching head-wearing type intelligent equipment, To realize the control to display content, simple to operate, add the control mode to display content, one Determine to meet in degree user's request.And add user and show the interactive of content, to display content Adjustment consider operating body operating position in viewing area so that can accurately determine operation First display object, it is possible to realize the most virtual combination display effect.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present application or technical scheme of the prior art, below will be to reality Execute the required accompanying drawing used in example or description of the prior art to be briefly described, it should be apparent that below, Accompanying drawing in description is only embodiments herein, for those of ordinary skill in the art, not On the premise of paying creative work, it is also possible to obtain other accompanying drawing according to the accompanying drawing provided.
A kind of flow process showing one embodiment of contents controlling method that Fig. 1 provides for the embodiment of the present application Figure;
Fig. 2 is a kind of imaging schematic diagram of head-wearing type intelligent equipment in the embodiment of the present application;
A kind of flow process showing another embodiment of contents controlling method that Fig. 3 provides for the embodiment of the present application Figure;
A kind of flow process showing another embodiment of contents controlling method that Fig. 4 provides for the embodiment of the present application Figure;
Fig. 4 a is a kind of display schematic diagram of the first display object in the embodiment of the present application;
Fig. 4 b is a kind of display schematic diagram of the second display object in the embodiment of the present application;
Fig. 4 c is the another kind of display schematic diagram of the first display object in the embodiment of the present application;
Fig. 4 d is the another kind of display schematic diagram of the second display object in the embodiment of the present application.
A kind of structure showing one embodiment of content control device that Fig. 5 provides for the embodiment of the present application is shown It is intended to;
A kind of structure showing another embodiment of content control device that Fig. 6 provides for the embodiment of the present application Schematic diagram;
The a kind of of Fig. 7 the embodiment of the present application offer shows a kind of structure of adjusting module in content control device Schematic diagram;
Fig. 8 a kind of shows the another kind of adjusting module in content control device for what the embodiment of the present application provided Structural representation;
Fig. 9 a kind of shows in content control device adjusting module another for what the embodiment of the present application provided Structural representation;
The structural representation of a kind of one embodiment of head-wearing type intelligent equipment that Figure 10 provides for the embodiment of the present application Figure.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present application, the technical scheme in the embodiment of the present application is carried out Clearly and completely describe, it is clear that described embodiment is only some embodiments of the present application, and It is not all, of embodiment.Based on the embodiment in the application, those of ordinary skill in the art are not doing Go out the every other embodiment obtained under creative work premise, broadly fall into the scope of the application protection.
The technical scheme of the application, can apply in head-wearing type intelligent equipment, and head-wearing type intelligent equipment leads to Often include fixing firmware, can be worn by the user at head.
The head-wearing type intelligent equipment applied of technical scheme include head mounted display (English: Head-mounted display, is called for short: HMD), HMD is visual display, it is possible to achieve empty Intend the combination of content and actual environment.
In the embodiment of the present application, in the case of user wears head-wearing type intelligent equipment, user can pass through Operating body realizes the control to display content, it is possible to is adjusted by the display object in display content, uses Family, without touching the physical button of head-wearing type intelligent equipment, i.e. can realize the control to display content, behaviour Make simple, add the control mode to display content, meet user's request to a certain extent.And Adding user and show the interactive of content, the adjustment to display content considers operating body in viewing area Operating position in territory so that can accurately determine the first display object of operation, it is possible to realize more accurate True virtual combination display effect, improves Consumer's Experience.
Below in conjunction with the accompanying drawings technical scheme is described in detail.
A kind of flow chart showing one embodiment of contents controlling method that Fig. 1 provides for the embodiment of the present application, Control method described in the embodiment of the present application is mainly used in head-wearing type intelligent equipment, and this head-wearing type intelligent sets For including HMD and image acquisition device, user is capable of the display to described HMD by operating body The control of the display content in region.
The method can include following step:
101: determined the initial position of described operating body by described image acquisition device.
Described head-wearing type intelligent equipment is worn user, and by described head mounted display output display In the case of appearance, can be acquired gathering space by described image acquisition device.
The initial position of described operating body is i.e. that image acquisition device arrives in collection space acquisition.This initial bit Put is i.e. that operating body is positioned at the position gathered in space.
When user wears head-wearing type intelligent equipment, the imaging space of viewed display content and wear-type The display interface of display also differs.The imaging space of the display content that user observes is user's Virtual vision space.
In virtual vision space, user's viewed display content, i.e. in the viewing area of HMD Display content map is to the virtual content in virtual vision space, on user perspective, is i.e. added to use On the actual environment that family is observed.
As shown in Figure 2, it is shown that a kind of imaging schematic diagram of head-wearing type intelligent equipment.Display at HMD Region 100 output display content, when user wears head-wearing type intelligent equipment, viewed virtual content Being imaged in virtual vision space 200, described virtual vision space is that user is when watching described display content Visual imaging space.
Gather space 300 and virtual vision space 200 can at least part of space overlap, may refer to adopt Collection space includes virtual vision space.
Wherein, gathering space 300 is by the angular field of view of the image acquisition device 400 of head-wearing type intelligent equipment Determining, image acquisition device 400 specifically may refer to image first-class.
Operating body refers to the object collected by wear-type smart machine of user's true operation, Yi Zhongke The implementation of energy, this operating body is the hand of the user collected, and the action message of operating body is specifically May refer to gesture information, such as the operating body 500 in Fig. 2.
Certainly, this operating body can also refer to the object that user's hand is managed, such as rod shape thing etc..
102: determine the operation that the initial position of described operating body is mapped in the viewing area of described HMD Position, and the first display object in described display content is determined according to described operating position.
In order to realize the control to display content of action message according to operating body, need accurately to determine operation First display object in the display content that gymnastics is made.And in prior art, be generally not capable of knowing operating body Operational motion is which part in corresponding display content, thus can not realize the accurate control to display content, Poor with user interaction.
In the embodiment of the present application, operating body is mapped at the initial position gathering space the viewing area of HMD In territory, determine the operating position being mapped in viewing area, such that it is able to accurately determine operation gymnastics Display object in the display content made.
Owing to there are differences, if head-wearing type intelligent equipment is wanted to know human eye between human eye visual angle and collection visual angle In visual angle, operating body is when virtual content is accurately combined, and operating body is mapped to the operative position of HMD viewing area Put, can know that operating body is in virtual vision space according to the proportionate relationship of virtual content with display content In relative position be mapped to the operating position in HMD viewing area.
In a kind of possible implementation, this first display object, may refer to presetting with operating body Position is reference point, and the display content at operating position that this reference point maps is the first display object. Such as when operating body is hand, reference point can select forefinger summit.
In alternatively possible implementation, this first display object, may refer to show quilt in content The content that the operating body collected blocks.
In the implementation that another is possible, this first display object, can be the ginseng according to operating body Content indicated at the operating position of examination point, or the content that operated member is blocked, determined by wherein have There is given shape or to meet pre-conditioned information be the first display object.This given shape or meet pre- If condition can be obtained by the information analyzing display content.Such as including that there is the letter such as water tumbler, school bag In the display content of breath, according to the action message of operating body, the forefinger summit identifying operating body is positioned at water Any position of cup viewing area, place, then the first display object i.e. can be defined as water tumbler.
103: gathered the action message of described operating body by described image acquisition device.
The action message of operating body can include that operating body is in the action message of two dimensional surface or at three-dimensional space Between action message, specifically may refer to operating body from initial position move to end position formed motion In the positional information of trace information, the profile information of operating body, the deformation characteristics of operating body and operating body At least one etc..
Operating body can pass through depth camera in a kind of possible implementation of three-dimensional action message Or the depth information that binocular camera gathers obtains.
The action of the execution of operating body can be user when wearing head-wearing type intelligent equipment, regards according to virtual The virtual content that feel space observation is arrived, controls the operation that the virtual objects in virtual content is performed by operating body, Such as clicking on a certain virtual objects, now head-wearing type intelligent equipment can gather space acquisition to operating body Action message.
Collection identification to the action message of operating body, as a example by operating body is as staff, can pre-build Hand model, thus when operating body being detected, according to hand model, can identify the profile of staff with And key point, key point such as finger, joint etc..It is thus possible to the action message of operating body is recognized accurately.
104: according to described action message, adjust described first display object shape in described display content State feature.
Described morphological feature at least includes showing the one in position, display size and display shape.
The morphological feature of the first display object is adjusted so that described in described first display object matching Action message, when being mapped in virtual vision space, from the point of view of user perspective, the first display object and behaviour Make body can accurately combine, and mate described action message.
In the present embodiment, user wears head-wearing type intelligent equipment, and it is right that user can be realized by operating body HMD viewing area shows the control of content, the display object in display content is adjusted, user Without touching the physical button of head-wearing type intelligent equipment, the control to display content, operation i.e. can be realized Simply, add the control mode to display content, meet user's request to a certain extent.And increase Having added user and shown the interactive of content, the adjustment to display content considers operating body in viewing area In operating position so that can accurately determine the first display object, it is achieved the most virtual combination Display effect.
How head-wearing type intelligent equipment determines that the initial position of described operating body is mapped to described HMD's Operating position in viewing area, can have multiple implementation, in a kind of possible implementation, as Shown in Fig. 3, it is shown that a kind of display another embodiment of contents controlling method that the embodiment of the present application provides Flow chart, in the present embodiment, step 101, step 103~104 may refer to embodiment illustrated in fig. 1, its In, step 102 may comprise steps of:
301: according to the initial position of described operating body, calculate described operating body and be mapped to virtual vision space In relative position.
Described virtual vision space is user visual imaging space when watching described display content.
Head-wearing type intelligent equipment can gather space at it and set up space coordinates, may thereby determine that out Operating body is at the initial position of these space coordinates.
This initial position can with the coordinate representation of a pixel in the operating body image that collects, Or multiple pixel coordinate representation.
As a example by initial position is with a pixel coordinate representation, initial position has as follows with relative position Mapping relations:
WM WN 1 = a b c d e f g h 1 m n 1 ;
Wherein, (m, n) represents collection position coordinates, and (M, N) represents relative position coordinates, by this Formula understands, W=am+bn+1.
(a, b, c, d, e, f, g h) are parameter.
When collection position is known, by solving, (a, b, c, d, e, f, g h), are i.e. appreciated that phase To position (M, N).
Wherein, (a, b, c, d, e, f, g, solving h) can be carried out according to equation below:
x 1 y 1 1 0 0 0 - X 1 x 1 - X 1 y 1 0 0 0 x 1 y 1 1 - Y 1 x 1 - Y 1 y 1 x 2 y 2 1 0 0 0 - X 2 x 2 - X 2 y 2 0 0 0 x 1 y 1 0 - Y 2 x 2 - Y 2 y 2 . . . . . . . . . . . . . . . . . . . . . . . . x n y n 1 0 0 0 - X n x n - X n y n 0 0 0 x n y n 0 - Y n x n - Y n y n = a b c d e f g h X 1 Y 1 X 2 Y 1 . . . X n Y n
(xi, yj) represent the coordinate of any pixel point in gathering the image that space any position gathers, I=1,2 ... n, j=1,2 ... n, (Xi, Yj) represent (xi, yj) be mapped to virtual vision space after right The coordinate answered.
Assume that λ is the vector [a b c d e f g h] solved.
Above formula can be reduced to A* λ=B.
Such that it is able to obtain λ=(ATA)-1ATB
(X is obtained according to test in advancei, Yj) and (xi, yj) coordinate value, can obtain in the hope of solution λ, thus according to initial position co-ordinates (m, n) i.e. can obtain operating body relative position coordinates (M, N)。
When initial positions is by multiple pixel coordinate representation, each pixel can be solved respectively according to above-mentioned Point is mapped to the relative position coordinates in virtual vision space, thus position relatively is i.e. many by multiple pixels Individual relative position coordinates represents.
302: the distance according to eyes of user to described HMD and the distance to described virtual vision space Ratio, calculates the operating position that described relative position is mapped in the display content of described HMD output.
In a kind of possible implementation, it is assumed that in space coordinates, with human eye position as coordinate Initial point.Assume that HMD place plane is parallel with the imaging surface in virtual vision space.Then arrive according to eyes of user The distance of HMD is a with the ratio of the distance to virtual vision space, it is assumed that the relative position calculated is sat It is designated as (M, N), then can be calculated (M, N) and be mapped to the relative position in virtual vision space Coordinate is (M/a, N/a).
303: determine the first display object being positioned in described display content at described operating position.
In order to know the first display object in the display content that operating body operates, need operating body in void The relative position intending visual space is mapped in the viewing area of HMD, to obtain the display of operating body operation First display object in content.
Certainly, wear-type electronic equipment can also predefine out the virtual content in virtual vision space with aobvious Show the ratio of content, thus described relative position correspondence in display content can be obtained according to this ratio Operating position.
Wherein, according to described action message, adjust described first display object in described display content Morphological feature can have multiple implementation, in a kind of possible implementation, as shown in Figure 4, for A kind of flow chart showing another embodiment of contents controlling method that the embodiment of the present application provides, step 101~the operation of step 103 may refer to embodiment illustrated in fig. 1, the operation of step 102 specifically can be by Performing according to embodiment illustrated in fig. 3, in the present embodiment, step 104 may include that
401: determine the pending region blocked by described operating body in described first display object.
Proportionate relationship determined by initial position according to operating body and step 302, can will operate Body proportionally relation etc. zooms to, in the viewing area of HMD, may thereby determine that out the first display object The pending region blocked by described operating body.
402: in described display content, described pending region is carried out transparent processing, after being adjusted First display object.
Now, in the viewed virtual content of user, pending region is transparent image, therefore at this Pending region is it is observed that actual environment, the most described operating body.
Transparent processing is carried out, it is possible to achieve Yong Huyu by the pending region that described operating body is blocked Display content mutual of HMD output, is favorably improved the display effect of actual situation combination, brings user more Good Consumer's Experience.
Such as Fig. 4 a, it is shown that the display schematic diagram of the first display object being mapped in virtual vision space. Fig. 4 b shows the display schematic diagram being mapped in virtual vision space after the first display object adjustment.Figure 4a and Fig. 4 b is from user perspective, viewed view.From Fig. 4 a and Fig. 4 b, operating body 500 is staff, and its action message performed is " crawl ".First display object 600 of operating body operation For water tumbler, thus according to the operating body collected and action message thereof, it may be determined that go out the first display object The middle pending region blocked by described operating body, carries out transparent processing by pending region, is Fig. 4 b The first display object after shown adjustment.From Fig. 4 b, after the first display object is adjusted i.e. Achieve " water tumbler " that " staff " in actual environment accurately grabs in virtual content, have matched dynamic Making information, from user perspective, staff and water tumbler realize accurately combining, and improve the aobvious of actual situation combination Show effect, be not only that virtual content is added in actual environment, add user and display content Alternately, improve Consumer's Experience.
Fig. 4 a and Fig. 4 b is exemplary illustration, can also realize multiple by technical scheme Complex interaction.
Wherein, the determination in the pending region of the first display object can have multiple possible implementation, In a kind of possible implementation, can be according to the action message pre-set and operating body shield portions Corresponding relation determine, therefore, it can inquiry preset the described operating body corresponding with described action message Shield portions;So that it is determined that described first display object is blocked by the shield portions of described operating body Pending region.Such as, as a example by action message is as gesture information, when performing " crawl " action, hide The staff part that stopper is divided into including thumb;When performing " click " operation, shield portions is behaved Hand whole etc..
Additionally, as alternatively possible implementation, described according to described action message, adjust described First display object morphological feature in described display content may is that
Obtain the first control strategy that described action message is corresponding.
According to described first control strategy, adjust the display shape of described first display object.
Namely the corresponding relation of different action message and different control strategies can be preset, such that it is able to Inquiry obtains the first control strategy that described action message is corresponding, according to described first control strategy to described First display object is adjusted.
As Fig. 4 c and Fig. 4 d, Fig. 4 c show aobvious in virtual vision space of the first display object map Show that schematic diagram, Fig. 4 d show that the second display object map is to the display schematic diagram in virtual vision space.
Understanding in conjunction with Fig. 4 c and Fig. 4 d, operating body is user's both hands, and action message is " lifting " action. First display object 600 is unopened flower, by identifying described " lifting " action, shows first Showing that object is adjusted, the first display object after being adjusted is the flower bursted forth.
Wherein, the first control strategy can also refer to the display according to described action message of described first object Change in shape meets the natural law.Such as first display object is assumed to be " inflatable balloon ", and action is believed During the action that breath " stabs " for handheld information, then according to the natural law, it is somebody's turn to do " inflatable balloon " " stamp " Action under, i.e. " rupture ", thus " balloon is changed into state of rupture by inflated condition ", shape occur State change as.
Seen from the above description, in the embodiment of the present application, the first display object is not limited to static object.
As the implementation that another is possible, the action message of described operating body characterize described operating body from Described initial position moves to end position;
Described according to described action message, adjust described first display object shape in described display content State feature may is that
Obtain described operating body primary importance in described collection space and the second place, wherein, institute State primary importance and the described second place is that initial position described in described operating body moves to end position shape Any two position in the movement locus become;
Determine the described first display object the 3rd position in described display content;
According to the variation relation of described primary importance Yu the described second place, determine in described display content with The 4th position that described 3rd position is relevant;
Adjust the described first display object the 3rd position from described display content to move to described 4th Put.
It is achieved thereby that the mobile realization that can follow operating body is moved in the position of display object.
In the embodiment of the present application, in the case of user wears head-wearing type intelligent equipment, user can be by behaviour Making body to realize the control showing content in the viewing area of HMD, user sets without touching head-wearing type intelligent Standby physical button, i.e. can realize the control to display content, simple to operate, adds in display The control mode held, meets user's request to a certain extent.And add user and display content Interactive, the adjustment to display content considers operating body operating position in viewing area so that can Accurately to determine the first display object, it is achieved the most virtual combination display effect.
For aforesaid each method embodiment, in order to be briefly described, therefore it is all expressed as a series of dynamic Combining, but those skilled in the art should know, the application is not by described sequence of movement Limiting, because according to the application, some step can use other orders or carry out simultaneously.Secondly, Those skilled in the art also should know, embodiment described in this description belongs to preferred embodiment, Necessary to involved action and module not necessarily the application.
A kind of structure showing one embodiment of content control device that Fig. 5 provides for the embodiment of the present application is shown Being intended to, this display content control device is applied particularly in head-wearing type intelligent equipment, described head-wearing type intelligent Equipment includes HMD and image acquisition device, and user realizes the viewing area to described HMD by operating body The control of the display content in territory, wherein, this display content control device is desirably integrated into head-wearing type intelligent In the processor of equipment, the function that can realize as processor, or as single device with Processor is connected, and described device may include that
Initial position determines module 501, for determining the initial of described operating body by described image acquisition device Position.
The initial position of described operating body is i.e. that image acquisition device is gathering this initial position that space acquisition arrives It is i.e. that operating body is positioned at the position gathered in space.
Position mapping block 502, for determining that the initial position of described operating body is mapped to described HMD's Operating position in viewing area.
Operating body is mapped in the viewing area of HMD at the initial position gathering space, determines mapping Operating position in viewing area, such that it is able to accurately determine in the display content that operating body operates aobvious Show object.
Object determines module 503, for determining that first in described display content shows according to described operating position Show object.
Action acquisition module 504, is believed for being gathered the action of described operating body by described image acquisition device Breath.
The action message of operating body can include that operating body is in the action message of two dimensional surface or at three-dimensional space Between action message, specifically may refer to operating body from initial position move to end position formed motion In the positional information of trace information, the profile information of operating body, the deformation characteristics of operating body and operating body At least one etc..
The action of the execution of operating body can be user when wearing head-wearing type intelligent equipment, regards according to virtual The virtual content that feel space observation is arrived, controls the operation that the virtual objects in virtual content is performed by operating body, Such as clicking on a certain virtual objects, now head-wearing type intelligent equipment can gather space acquisition to operating body Action message.
Adjusting module 505, for according to described action message, adjusts described first display object described aobvious Show the morphological feature in content.
Described morphological feature at least includes showing the one in position, display size and display shape.
The morphological feature of the first display object is adjusted so that described in described first display object matching Action message, when being mapped in virtual vision space, from the point of view of user perspective, the first display object and behaviour Make body can accurately combine, and mate described action message.
In the present embodiment, when user wears head-wearing type intelligent equipment, user can be realized by operating body To HMD viewing area shows the control of content, content can will be shown by display content control device In display object be adjusted, user is without touching the physical button of head-wearing type intelligent equipment, the most permissible Realize the control to display content, simple to operate, add the control mode to display content, necessarily User's request is met in degree.And add user and show the interactive of content, to display content Adjust and consider operating body operating position in viewing area so that can accurately determine the first display Object, it is achieved the most virtual combination display effect.
Wherein, position mapping block 502 determines that the initial position of described operating body is mapped to described HMD's Operating position in viewing area, can have multiple implementation, in a kind of possible implementation, as Shown in Fig. 6, it is shown that a kind of display another embodiment of content control device that the embodiment of the present application provides Structural representation, this device can include initial position determine module 501, position mapping block 502, Object determines module 503, action acquisition module 504 and adjusting module 505, and each functions of modules can be joined Embodiment as shown in Figure 5, is with embodiment illustrated in fig. 5 difference, described position mapping block 502 May include that
First map unit 601, for the initial position according to described operating body, calculates described operating body and reflects The relative position being mapped in virtual vision space;
Wherein, described virtual vision space is user visual imaging space when watching described display content.
Second map unit 602, for according to the distance of eyes of user to described HMD with to described virtual The ratio of the distance of visual space, calculates described relative position and is mapped to the display content of described HMD output In operating position.
Wherein, according to described action message, adjust described first display object in described display content Morphological feature can have multiple implementation, in a kind of possible implementation, as it is shown in fig. 7, adjust Mould preparation block 505 may include that
Area determination unit 701, for determining in described first display object by treating that described operating body blocks Processing region.
First adjustment unit 702, in described display content, carries out transparent by described pending region Process, the first display object after being adjusted.
Wherein, wherein, the determination in the pending region of the first display object can have multiple possible realization Mode, in a kind of possible implementation, can hide with operating body according to the action message pre-set The corresponding relation that stopper is divided determines, therefore, this area determination unit may include that
Query unit, for inquiring about the occlusion part of the default described operating body corresponding with described action message Point;
Region determines subelement, for determining in described first display object by the occlusion part of described operating body Divide the pending region blocked.
Additionally, in alternatively possible implementation, the action message of described operating body characterizes described operation Body moves to end position from described initial position;As shown in Figure 8, described adjusting module 505 can wrap Include:
Position acquisition unit 801, for obtain described operating body primary importance in described collection space with And the second place, described primary importance and the described second place are that initial position described in described operating body moves Move any two position to the movement locus of end position formation;
First determines unit 802, for determining described first display object the 3rd in described display content Position;
Second determines unit 803, for the variation relation according to described primary importance Yu the described second place, Determine the 4th position relevant to described 3rd position in described display content;
Second adjustment unit 804, for adjusting described first display object the 3rd from described display content Position is moved to described 4th position.
It is achieved thereby that the mobile realization that can follow operating body is moved in the position of display object.
In the embodiment of the present application, user, i.e. can be real without touching the physical button of head-wearing type intelligent equipment The now control to display content, operation is convenient, adds the control mode to display content, in certain journey User's request is met on degree.And add user and show the interactive of content, the tune to display content Whole consider operating body operating position in viewing area so that can accurately determine that the first display is right As, it is achieved the most virtual combination display effect.
In another possible implementation, as it is shown in figure 9, adjusting module 505 can include
Strategy acquiring unit 901, for obtaining the first control strategy that described action message is corresponding;
3rd adjustment unit 902, for according to described first control strategy, adjusts described first display object Display shape.
Namely the corresponding relation of different action message and different control strategies can be preset, such that it is able to Inquiry obtains the first control strategy that described action message is corresponding, according to described first control strategy to described First display object is adjusted.
This first control strategy can also refer to described first object display shape according to described action message Change meets the natural law.
Adjusting module in Fig. 5 or Fig. 6 specifically can use the realization of any one adjusting module of Fig. 7~Fig. 9 Mode.
Display content control device described in above-described embodiment, in actual applications, is desirably integrated into and wears In formula smart machine.Disposing the electronic equipment of the embodiment of the present application display content control device, operation is convenient, Add the control mode to display content, meet user's request to a certain extent.
By above description, those skilled in the art is it can be understood that can be by the application Software adds the mode of required general hardware platform and realizes.Therefore, as shown in Figure 10, the application implements Example additionally provides a kind of head-wearing type intelligent equipment, and this head-wearing type intelligent equipment can be worn by fixing device At user's head.
This head-wearing type intelligent equipment at least include connecing memory 1001, processor 1002, HMD1003 with And image acquisition device 1004.
This memory 1001 stores batch processing instruction, and this memory can be high-speed RAM memory, It is also likely to be nonvolatile memory (non-volatile memory), for example, at least one magnetic disc store Deng.
This processor 1002, for calling the programmed instruction of this memory 1001 storage, performs to operate as follows:
By described HMD1003, in the viewing area output display content of HMD1003;
By described image acquisition device 1004 acquisition operations body, determine the initial position of described operating body;
Determine that the initial position of described operating body is mapped to the operation in the viewing area of described HMD1003 Position, and the first display object in described display content is determined according to described operating position;
The action message of described operating body is gathered by described image acquisition device 1004;
According to described action message, adjust described first display object form in described display content special Levying, described morphological feature at least includes showing the one in position, display size and display shape.
In this specification, each embodiment uses the mode gone forward one by one to describe, and each embodiment stresses Being the difference with other embodiments, between each embodiment, identical similar portion sees mutually. For device disclosed in embodiment, owing to it corresponds to the method disclosed in Example, so describing Fairly simple, relevant part sees method part and illustrates.
Finally, in addition it is also necessary to explanation, in this article, the relational terms of such as first and second or the like It is used merely to separate an entity or operation with another entity or operating space, and not necessarily requires Or imply relation or the order that there is any this reality between these entities or operation.And, art Language " includes ", " comprising " or its any other variant are intended to comprising of nonexcludability, thus Make to include that the process of a series of key element, method, article or equipment not only include those key elements, and Also include other key elements being not expressly set out, or also include for this process, method, article or The key element that person's equipment is intrinsic.In the case of there is no more restriction, by statement " including ... " The key element limited, it is not excluded that also deposit in including the process of described key element, method, article or equipment At other identical element.
Described above to the disclosed embodiments, makes professional and technical personnel in the field be capable of or uses The application.Multiple amendment to these embodiments will be aobvious and easy for those skilled in the art See, generic principles defined herein can in the case of without departing from the application protection domain, Other embodiments realizes.Therefore, the application is not intended to be limited to the embodiments shown herein, And it is to fit to the widest scope consistent with principles disclosed herein and features of novelty.

Claims (12)

1. a display contents controlling method, it is characterised in that be applied in head-wearing type intelligent equipment, institute Stating head-wearing type intelligent equipment and include head mounted display HMD and image acquisition device, user passes through operating body Realizing the control to the display content in the viewing area of described HMD, described method includes:
The initial position of described operating body is determined by described image acquisition device;
Determine that the initial position of described operating body is mapped to the operating position in the viewing area of described HMD, And the first display object in described display content is determined according to described operating position;
The action message of described operating body is gathered by described image acquisition device;
According to described action message, adjust described first display object form in described display content special Levying, described morphological feature at least includes showing the one in position, display size and display shape.
Method the most according to claim 1, it is characterised in that described determine at the beginning of described operating body Beginning position is mapped to the operating position in the viewing area of described HMD, and determines according to described operating position The first display object in described display content includes:
According to the initial position of described operating body, calculate described operating body and be mapped in virtual vision space Position relatively;Described virtual vision space is user visual imaging space when watching described display content;
Distance according to eyes of user to described HMD and the ratio of the distance to described virtual vision space, Calculate the operating position that described relative position is mapped in the display content of described HMD output;
Determine the first display object being positioned in described display content at described operating position.
Method the most according to claim 1 and 2, it is characterised in that described believe according to described action Breath, adjusts described first display object morphological feature in described display content and includes:
Determine the pending region blocked by described operating body in described first display object;
In described display content, described pending region is carried out transparent processing, after being adjusted One display object.
Method the most according to claim 3, it is characterised in that described determine described first display right As the middle pending region blocked by described operating body includes:
The shield portions of the described operating body corresponding with described action message that inquiry is preset;
Determine the pending region blocked by the shield portions of described operating body in described first display object.
Method the most according to claim 1 and 2, it is characterised in that the action letter of described operating body Breath characterizes described operating body and moves to end position from described initial position;
Described according to described action message, adjust described first display object shape in described display content State feature includes:
Obtain primary importance and the second place of described operating body, described primary importance and described second Position is that initial position described in described operating body moves any two to the movement locus of end position formation Individual position;
Determine the described first display object the 3rd position in described display content;
According to the variation relation of described primary importance Yu the described second place, determine in described display content with The 4th position that described 3rd position is relevant;
Adjust the described first display object the 3rd position from described display content to move to described 4th Put.
Method the most according to claim 1 and 2, it is characterised in that described believe according to described action Breath, adjusts described first display object morphological feature in described display content and includes:
Obtain the first control strategy that described action message is corresponding;
According to described first control strategy, adjust the display shape of described first display object.
7. a display content control device, it is characterised in that be applied in head-wearing type intelligent equipment, institute Stating head-wearing type intelligent equipment and include head mounted display HMD and image acquisition device, user passes through operating body Realizing the control to the display content in the viewing area of described HMD, described device includes:
Initial position determines module, for being determined the initial bit of described operating body by described image acquisition device Put;
Position mapping block, for determining that the initial position of described operating body is mapped to the display of described HMD Operating position in region;
Object determines module, for determining the first display in described display content according to described operating position Object;
Action acquisition module, for gathering the action message of described operating body by described image acquisition device;
Adjusting module, for according to described action message, adjusts described first display object in described display Morphological feature in content, described morphological feature at least includes showing position, display size and display shape One in shape.
Device the most according to claim 7, it is characterised in that described position mapping block includes:
First map unit, for the initial position according to described operating body, calculates described operating body and maps Relative position in virtual vision space;Described virtual vision space is that user watches described display content Time visual imaging space;
Second map unit, for the distance according to eyes of user to described HMD and to described virtual vision The ratio of the distance in space, calculates in the display content that described relative position is mapped to described HMD output Operating position.
9. according to the device described in claim 7 or 8, it is characterised in that described adjusting module includes:
Area determination unit, is located by waiting of blocking of described operating body for determining in described first display object Reason region;
First adjustment unit, in described display content, carries out transparent place by described pending region Reason, the first display object after being adjusted.
Device the most according to claim 9, it is characterised in that described area determination unit includes:
Query unit, for inquiring about the occlusion part of the default described operating body corresponding with described action message Point;
Region determines subelement, for determining in described first display object by the occlusion part of described operating body Divide the pending region blocked.
11. according to the device described in claim 7 or 8, it is characterised in that the action of described operating body Operating body described in information representation moves to end position from described initial position;
Described adjusting module includes:
Position acquisition unit, for obtaining described operating body gathering in space at described image acquisition device Primary importance and the second place, described primary importance and the described second place are described in described operating body Initial position moves any two position to the movement locus of end position formation;
First determines unit, for determining the 3rd in described display content of described first display object Put;
Second determines unit, for the variation relation according to described primary importance Yu the described second place, really The 4th position relevant to described 3rd position in fixed described display content;
Second adjustment unit, for adjusting the 3rd from described display content of described first display object Put mobile to described 4th position.
12. according to the device described in claim 7 or 8, it is characterised in that described adjusting module includes:
Strategy acquiring unit, for obtaining the first control strategy that described action message is corresponding;
3rd adjustment unit, for according to described first control strategy, adjusting described first display object Display shape.
CN201410239854.5A 2014-05-30 2014-05-30 Display contents controlling method and device Active CN103984101B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410239854.5A CN103984101B (en) 2014-05-30 2014-05-30 Display contents controlling method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410239854.5A CN103984101B (en) 2014-05-30 2014-05-30 Display contents controlling method and device

Publications (2)

Publication Number Publication Date
CN103984101A CN103984101A (en) 2014-08-13
CN103984101B true CN103984101B (en) 2016-08-24

Family

ID=51276136

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410239854.5A Active CN103984101B (en) 2014-05-30 2014-05-30 Display contents controlling method and device

Country Status (1)

Country Link
CN (1) CN103984101B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160196693A1 (en) * 2015-01-06 2016-07-07 Seiko Epson Corporation Display system, control method for display device, and computer program
CN104598036B (en) * 2015-03-02 2019-03-08 联想(北京)有限公司 A kind of information processing method and device
WO2018103072A1 (en) * 2016-12-09 2018-06-14 深圳市柔宇科技有限公司 Adjustment method and adjustment system for user interface, and head-mounted display device
CN110837764B (en) * 2018-08-17 2022-11-15 广东虚拟现实科技有限公司 Image processing method and device, electronic equipment and visual interaction system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH086708A (en) * 1994-04-22 1996-01-12 Canon Inc Display device
JP2009245392A (en) * 2008-03-31 2009-10-22 Brother Ind Ltd Head mount display and head mount display system
JP4674634B2 (en) * 2008-12-19 2011-04-20 ソニー株式会社 Head-mounted display
CN102346544A (en) * 2010-07-30 2012-02-08 鸿富锦精密工业(深圳)有限公司 Head-worn display system with interactive function and display method thereof
US20120249587A1 (en) * 2011-04-04 2012-10-04 Anderson Glen J Keyboard avatar for heads up display (hud)
CN103698884A (en) * 2013-12-12 2014-04-02 京东方科技集团股份有限公司 Opening type head-mounted display device and display method thereof

Also Published As

Publication number Publication date
CN103984101A (en) 2014-08-13

Similar Documents

Publication Publication Date Title
JP6393367B2 (en) Tracking display system, tracking display program, tracking display method, wearable device using them, tracking display program for wearable device, and operation method of wearable device
JP6057396B2 (en) 3D user interface device and 3D operation processing method
US8933886B2 (en) Instruction input device, instruction input method, program, recording medium, and integrated circuit
WO2016185845A1 (en) Interface control system, interface control device, interface control method and program
CN103984101B (en) Display contents controlling method and device
JP6177872B2 (en) I / O device, I / O program, and I / O method
JP6333801B2 (en) Display control device, display control program, and display control method
CN107004275A (en) For determining that at least one of 3D in absolute space ratio of material object reconstructs the method and system of the space coordinate of part
JP6250024B2 (en) Calibration apparatus, calibration program, and calibration method
WO2020124976A1 (en) Image processing method and apparatus, and electronic device and storage medium
CN104598037B (en) Information processing method and device
WO2014128751A1 (en) Head mount display apparatus, head mount display program, and head mount display method
JP6250025B2 (en) I / O device, I / O program, and I / O method
JP6446465B2 (en) I / O device, I / O program, and I / O method
CN106919928A (en) gesture recognition system, method and display device
CN107884930B (en) Head-mounted device and control method
CN106295570A (en) Block filtration system and method alternately
CN109426419B (en) Interface display method and related equipment
JP2017111537A (en) Head-mounted display and program for head-mounted display
JPWO2016051429A1 (en) I / O device, I / O program, and I / O method
CN106896904A (en) A kind of control method and electronic equipment
CN106502376A (en) A kind of 3D touch operation methods, electronic equipment and 3D glasses

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant