CN103677243B

CN103677243B - A kind of control method, device and multimedia input-output system

Info

Publication number: CN103677243B
Application number: CN201210362477.5A
Authority: CN
Inventors: 潘云峰; 吴斐
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2012-09-25
Filing date: 2012-09-25
Publication date: 2017-03-01
Anticipated expiration: 2032-09-25
Also published as: CN103677243A

Abstract

The invention provides a kind of control method, device and multimedia input-output system, wherein, the first content of multimedia is exported in the first solid space, described first content of multimedia includes the first display content, wherein, described first display content can be made way for outside described first solid space, and be in the user of diverse location around described first solid space and watch；Action message is gathered in the second solid space；According to described action message, determine the second display content；The second content of multimedia is exported in the first solid space, described second content of multimedia includes described second display content, wherein, described second display content can be made way for outside described first solid space, and be in the user of diverse location around described first solid space and watch.By the embodiment of the present invention it is achieved that effective control to content of multimedia.

Description

A kind of control method, device and multimedia input-output system

Technical field

The present invention relates to control technology field, more particularly to a kind of control method, device and multimedia input Output system.

Background technology

With the development of multimedia information technology, therefore how the multimedia form that user can experience is more and more diversified, Content of multimedia is control effectively becomes the emphasis of user's growing interest.

The control of existing content of multimedia, the physical button typically by multimedia output apparatus is realized to output The control of content of multimedia, but the simply audio frequency to output or the isoparametric control of display of this control method, such as volume, Display brightness, and, the particularly solid growing to multimedia experiences demand with multimedia variation and user The appearance of image, is not limited in the control to audio frequency parameter or display parameters to multimedia control operation, and the body of user Test impression often passively to receive, user can not actively realize the control to content of multimedia.Therefore existing controlling party Method still can not effectively realize the control to content of multimedia.

Content of the invention

In view of this, the invention provides a kind of control method, in order to solve cannot effectively realize many matchmakers in prior art The technical problem of body content-control.

Present invention also offers a kind of control device and multimedia input-output system, in order to ensure said method in reality Realization in application.

For achieving the above object, one aspect of the present invention provides a kind of control method, is applied to multimedia input and output system In system, methods described includes：

Export the first content of multimedia in the first solid space, described first content of multimedia is included in the first display Hold, wherein, described first display content can be made way for outside described first solid space, and is in around described first solid space The user of diverse location watches；

Action message is gathered in the second solid space；

According to described action message, determine the first changing content of the first object in described first display content, including：Know Primary importance in described second solid space for the object run body of the described action message that not described action message includes with And the second position；Determine the first object in corresponding described first display content of described action message, and described first right As the 3rd position in described first solid space；According to the variation relation of described primary importance and the described second position, really Fixed fourth position related to described 3rd position；

Update described first display content according to described changing content, form the second display content, including：Generation will be described First object from the 3rd position movement to the 4th position after the second display content；

Export the second content of multimedia in the first solid space, described second content of multimedia includes described second display Content, wherein, described second display content can be made way for outside described first solid space, and is in described first solid space week The user enclosing diverse location watches.

Preferably, described first solid space comprises described second solid space.

Preferably, described first changing content include the change in location content of described first object, moving direction change in Appearance, change in size content, change of shape content and/or forms of motion changing content.

Preferably, described generate by described first object from the 3rd position movement to the 4th position after the second display content Including：

Judge whether the boundary position that the described second position is the second solid space, and described object run body leave described Second solid space；

If it is, according to described first object type, obtaining corresponding second control strategy of described first object type, institute State the change that the second control strategy is described first object and meet the second nature rule；

Determine the second changing content of described first object according to described second control strategy；

By described first object from the 3rd position movement to the 4th position, and in described 4th position according to the described second change Change content to be processed, form the second display content；

If it is not, then generate by described first object from the 3rd position movement to the 4th position after the second display content.

Preferably, described multimedia input-output system includes projecting cell and medium signal generating unit, described described Export the first content of multimedia in one solid space to be specially：

By described medium signal generating unit, at least form projection medium in described first solid space；

By described projecting cell to the described projection medium projection in described first space, export described first multimedia Content.

Preferably, described multimedia input-output system includes multigroup ultrasonic wave generating apparatus and ultrasound wave receiving device, Described described second solid space collection action message include：

Launch the first ultrasound wave to described second solid space, and gather second ultrasonic from described second solid space Ripple；

According to described second ultrasound wave, determine the action message in described second solid space.

Preferably, described multimedia input-output system includes image acquisition units, and described image acquisition range includes institute State the second solid space, then described described second solid space collection action message include：

Obtain the picture material of inclusion second solid space of described image collecting unit collection；

According to described image content, identify the action message of object run body.

Preferably, methods described also includes；

Gather the acoustic information of targeted customer and/or facial feature information in described second solid space；

According to described acoustic information and/or facial feature information, determine the 3rd display content；

Export the 3rd content of multimedia in described first solid space, described 3rd content of multimedia includes the described 3rd and shows Show content.

Another aspect provides a kind of control device, be applied in multimedia input-output system, described dress Put including：

First output module, for exporting the first content of multimedia in the first solid space, in described first multimedia Hold and include the first display content, wherein, described first display content can be made way for outside described first solid space, and be in described Around first solid space, the user of diverse location watches；

First acquisition module, for gathering action message in the second solid space；

Information determination module, according to described action message, determines in the change of the first object in described first display content Hold, including：Identification module, for identifying the object run body of described action message that described action message includes described second Primary importance in solid space and the second position；Primary importance determining module, corresponding for determining described action message The first object in described first display content, and the 3rd position in described first solid space for described first object； Second position determining module, for the variation relation according to described primary importance and the described second position, determines and the described 3rd The 4th related position of position；

Process submodule, for processing described first display content according to described changing content, form the second display content； Specifically for, generate by described first object from the 3rd position movement to the 4th position after the second display content；

Second output module, for exporting the second content of multimedia in the first solid space, in described second multimedia Hold and include described second display content, wherein, described second display content can be made way for outside described first solid space, and is in Around described first solid space, the user of diverse location watches.

Preferably, described process submodule includes：

Judge module, for judging whether the boundary position that the described second position is the second solid space, and described target Operating body leaves described second solid space；

First acquisition module, for when described judge module is to be, according to described first object type, obtains described the Corresponding second control strategy of one object type, described second control strategy is that the change of described first object meets the second nature Rule；

First content determining module, for determining in the second change of described first object according to described second control strategy Hold；

First process submodule, for by described first object from the 3rd position movement to the 4th position, and described the Four positions are processed according to described second changing content, form the second display content；

Second processing submodule, for when described judge module is no, generating described first object from the 3rd position Mobile the second display content to the 4th position.

Preferably, described multimedia input-output system includes projecting cell and medium signal generating unit, then described first is defeated Go out module to include：

First control module, for by described medium signal generating unit, at least forming projection in described first solid space Medium；

Second control module, for being projected to the described projection medium in described first space by described projecting cell, Export described first content of multimedia.

Preferably, described multimedia input-output system includes multigroup ultrasonic wave generating apparatus and ultrasound wave receiving device, Then described first acquisition module includes：

Ultrasonic control module, for launching the first ultrasound wave to described second solid space, and gathers from described the Second ultrasound wave of two solid spaces；

Action message determining module, for according to described second ultrasound wave, determining the action in described second solid space Information.

Preferably, described multimedia input-output system includes image acquisition units, and described image acquisition range includes institute State the second solid space, then described acquisition module includes：

Image collection module, in the image for inclusion second solid space obtaining the collection of described image collecting unit Hold；

Identification module, for according to described image content, identifying the action message of object run body.

Preferably, described device also includes：

Second acquisition module, special for gathering the acoustic information of targeted customer and/or face in described second solid space Reference ceases；

Second processing module, for according to described acoustic information and/or facial feature information, determining the 3rd display content；

3rd output module, for exporting the 3rd content of multimedia, described 3rd multimedia in described first solid space Content includes described 3rd display content.

It is yet another aspect of the present invention to provide a kind of multimedia input-output system, including control device described above.

Via above-mentioned technical scheme understand, compared with prior art, the invention provides a kind of control method, device and Multimedia input-output system, when the first solid space output comprises the first content of multimedia of the first display content, the Gather action message in two solid spaces, and the second display content can be determined according to this action message, thus three-dimensional empty first Between middle output comprise this second display content the second content of multimedia so that according to and user-dependent action message, realize Conversion to display content in the first solid space, it is achieved that user and the interaction of display content, increased the experience of user, and Achieve the effective control to content of multimedia for the user.

Brief description

In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing Have technology description in required use accompanying drawing be briefly described it should be apparent that, drawings in the following description be only this Inventive embodiment, for those of ordinary skill in the art, on the premise of not paying creative work, can also basis The accompanying drawing providing obtains other accompanying drawings.

Fig. 1 is a kind of flow chart of present invention control method embodiment 1；

Fig. 2 is a kind of flow chart of present invention control method embodiment 2；

The schematic diagram of the first display content that Fig. 3 exports in the first solid space for the present invention；

The schematic diagram of the second display content that Fig. 4 exports in the first solid space for the present invention；

Fig. 5 is a kind of flow chart of present invention control method embodiment 3；

Fig. 6 is a kind of structural representation of present invention control device embodiment 1；

Fig. 7 is a kind of structural representation of present invention control device embodiment 2；

Fig. 8 is a kind of structural representation of present invention control device embodiment 3.

Specific embodiment

Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation description is it is clear that described embodiment is only a part of embodiment of the present invention, rather than whole embodiments.It is based on Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of not making creative work Embodiment, broadly falls into the scope of protection of the invention.

The embodiment of the invention discloses a kind of control method, control device and multimedia input-output system, vertical first When the output of body space comprises the first content of multimedia of the first display content, in the second solid space, gather action message, and The second display content can be determined according to this action message, thus output comprises this second display content in the first solid space The second content of multimedia, described first display content and the second display content are can to make way for outside the first solid space, and The user being in various location around the first solid space watches, and makes it possible to foundation and user by the embodiment of the present invention Related action message, enters line translation it is achieved that the active control of user to display content in the first solid space, increased use The experience at family, thus effectively achieve the control operation to content of multimedia for the user.

With reference to Fig. 1, show a kind of structural representation of present invention control method embodiment 1, this embodiment scheme is main It is applied in multimedia input-output system, methods described can include：

Step 101：Export the first content of multimedia in the first solid space, described first content of multimedia includes first Display content.

Wherein, described first display content can be made way for outside described first solid space, and it is three-dimensional empty to be in described first Between around the user of diverse location watch.

Described first display content shows in described first solid space, and user can from the first solid space not Watch this first display content with position, namely the first display content is stereo content.The user of various location is watched The form of expression of the first display content may be different, such as when the first display content includes human body, positioned at different positions The user putting may watch the contents such as the front of this human body, side, the back side respectively.

Exporting a kind of possible implementation of the first content of multimedia in the first solid space is：The input of this multimedia is defeated Go out system and include medium signal generating unit and projecting cell, such that it is able to by this medium signal generating unit, at least in this first solid Form projection medium in space, projected to the described projection medium in described first solid space by described projecting cell, with Export described first content of multimedia.User can experience has the contents such as relief image.This projecting cell can be adjusted Whole projection angle, can export content of multimedia to different directions.Described projection medium may refer to there is the saturating of special material Bright medium, or smog, water vapour etc. can realize other media of display information.

In the embodiment of the present invention, described projecting cell specifically may be located at below the first solid space, such that it is able to from Projected upwards below, to present, be there is relief display content.

Described first content of multimedia can also include the information such as audio content taste, so that around the first solid space The user of diverse location can be with uppick.

Step 102：Action message is gathered in the second solid space.

Described action message may refer to the action message of the object run body of detection, and this object run body can be specifically Finger watches the object that the targeted customer of this first display content is held, or the handss of targeted customer, and therefore described action message is For gesture information, then gather action message, such that it is able to realize gesture identification, specifically this multimedia in the second solid space Input-output system can include a gesture recognition system, and the gesture motion such that it is able to the user according to collection inquires about this gesture Identifying system, realizes gesture identification, determines the corresponding gesture information of this gesture motion.

Wherein, the action message of collection the second solid space can have multiple implementations, and a kind of possible situation is：Should Multimedia input-output system can include image acquisition units, and the image-capture field of image acquisition units at least includes Two solid spaces, such that it is able to obtain the picture material of inclusion second solid space of described image collecting unit collection；Foundation Described image content, you can identify the action message of object run body.

Alternatively possible situation is：This multimedia input-output system can include induction apparatuss, and this induction apparatus is permissible It is worn on user on hand, such as data glove, thus user carries out gesture operation, can sense that gesture changes by induction apparatuss, The identification realizing gesture obtains gesture information.Certainly described induction apparatuss may be located on a certain ad-hoc location, and user is in induction apparatuss Region carries out motion action, and induction apparatuss sense this motion action, thus obtaining corresponding action message.

Certainly can also be discussed in detail in embodiment below using other implementations.

Wherein, described second solid space can be in the target comprising targeted customer outside described first solid space The space of operating body.Can also be to be comprised by described first solid space, that is, the second solid space is located in the first solid space. In actual applications, user watches the first display content outside the first solid space, and user can be by handss or by object run Body enters the first solid space, carries out motion action, thus action message can be obtained.When the second solid space comprises and first During solid space, described second solid space can not be a certain specific space segment in finger the first solid space, but uses The position that the object run body at family is located is the second solid space, and the action message therefore gathering the second solid space that is to say The action message of the first solid space of collection.

Step 103：According to described action message, determine the second display content.

According to described action message it may be determined that corresponding second display content, this second display content is described in difference First display content, can be specifically that the information comprising is different, can be that the form of expression is different.So that according to object run The action message of body, realizes the conversion of display content, realizes the interaction with user.

Step 104：Export the second content of multimedia in the first solid space, described second content of multimedia includes described Second display content, wherein, described second display content can be made way for outside described first solid space, and it is vertical to be in described first The user of body spatial peripheral diverse location watches.

Determine the second display content, you can be contained in output in the second content of multimedia.Described second multimedia Content can be only that the display content comprising is different naturally it is also possible to inclusion is other different interior with described first content of multimedia Hold, the display parameters of such as audio content and display content, such as brightness, gray scale etc..

Described second display content is also to have relief display content, enables to positioned at described first solid space Outward, and be in the user of diverse location around described first solid space and watch.

In the present embodiment, when the first solid space exports the first content of multimedia, wherein this first content of multimedia The first display content watched including the user that can make way for various location around the first solid space, collection is vertical second Action message in body space is thus according to this action message, determine the second display content and defeated in the second solid space Go out so that can according to user-dependent action message, carry out the conversion of display content it is achieved that the active control of user, Such that it is able to effectively realize the control operation of content of multimedia, increased the experience of user simultaneously.

With reference to Fig. 2, the flow chart showing the present invention a kind of control method embodiment 2, this embodiment scheme is mainly applied In multimedia input-output system, methods described can include：

Step 201：Export the first content of multimedia in the first solid space, described first content of multimedia includes first Display content.

The operation of step 201 specifically may refer to, described in above-described embodiment 1, will not be described here

Step 202：Launch the first ultrasound wave to the second solid space, and gather from described second solid space second Ultrasound wave.

Step 203：According to described second ultrasound wave, determine the action message in described second solid space.

Described second ultrasound wave is the echo information of described first ultrasound wave, namely the first ultrasound wave returns after barrier The echo information returned.In the present embodiment, described multimedia input-output system can include ultrasonic wave generating apparatus and ultrasound wave Receiving device, thus launching the first ultrasound wave by ultrasonic wave generating apparatus to described second solid space, is connect by ultrasound wave Receiving unit receives the second ultrasound wave from the second solid space.

Described ultrasonic wave generating apparatus can be specially piezoelectric ceramic transducer or the battle array of piezoelectric ceramic transducer composition Row acoustical generator, or the array acoustical generator of electrostatic transducer or electrostatic transducer composition, in actual applications, described ultrasound wave Generation equipment can specifically described multimedia input-output system linear CCD pushbroom.Linear CCD pushbroom is one group of row Arrange the radiating element being in line, being spaced closely together, there is identical amplitude and phase place, ultrasound wave can be launched.Described ultrasound wave connects Receiving unit can be specially the linear array microphone of described multimedia input-output system, such as array microphone, ultrasonic to receive The echo information of ripple.

Wherein, described ultrasonic wave generating apparatus and ultrasound wave receiving device can include multigroup, to realize from different directions Launch ultrasound wave to the second solid space, so that action letter can be more recognized accurately according to the second ultrasound wave returning Breath.

According to this second ultrasound wave, you can be identified, determine the action message in this second solid space.Due to Two ultrasound wave are the echo information after barrier, therefore the identification to the second ultrasound wave, can identify specific action letter Breath.

Step 203：According to described action message, determine the second display content.

Wherein, according to described action message, determine the second display content, can have multiple implementations.

As an embodiment, described according to described action message, determine that the second display content can include：

First, according to described action message, determine display in described first solid space for described first display content Position and/or display direction.

Secondly, according to described display location and/or display direction, described first display content is adjusted, generates the Two display contents.

According to different action messages, the position to the first display content in the first solid space for the user can be identified Put and/or direction adjustment configured information, may thereby determine that out the first display content display location and/display direction.

The stereo-picture that first display content of display is behaved such as in the first solid space, because position is closed System, it may can only see the direct picture of this people, and therefore user can indicate the first display content by a certain certain gestures Adjustment, system is according to the gesture information of user it may be determined that going out the desired target display location of user and/target display side To thus generating the second display content, this second display content and described first display content are in the first solid space Display location or display direction are different.

As another embodiment, described according to described action message, determine that the second display content can include：

First, according to described action message and described first display content, determine first in described first display content First changing content of object.

Secondly, update described first display content according to described first changing content, form the second display content.

First display content can include different objects, for example flower, tree, animal, people etc., in this implementation, uses Family, can be interactive by the object implementatio8 comprising in motion action and the first display content when watching the first display content.From And according to a certain specific motion action it may be determined that going out the first changing content of the first object in the first display content, from And according to this first changing content, update this first object, form the second display content of the first object after comprising this renewal.

It should be noted that in described first object first does not imply that specifically a certain object, it is only intended to represent The targeted operation object of described action message.

Wherein, described first changing content can include：In the change in location content of the first object, moving direction change Appearance, change in size content, change of shape content and/or forms of motion changing content etc..

For example, when described first object is balloon, then targeted customer can realize the handss of " stamp " balloon with single finger Gesture action, you can collect this gesture information, determination is to poke balloon, thus processing to balloon, forming balloon and poking Change of shape content, ultimately form the second display content comprising the balloon after this is poked.

And for example, when described first object be leaveves when, targeted customer can to the first object implementatio8 " agitating " gesture Action, the described quick moving operation agitating action to refer to from a position to another location, thus can collect comprise The gesture information of " agitating ", determination is that leaveves are agitated, thus processing to this leaves, can form leaveves and carrying out backswing Dynamic forms of motion changing content, and then generate the display content of the content second comprising this leaf swing.

And for example, when the handss that described first object is behaved, and for the form shaken hands, then targeted customer can make with described The gesture motion of the first object implementatio8 " shaking hands ", then according to the gesture operation of targeted customer, identify the gesture information shaken hands, and Can determine that the handss of the targeted customer position in the first solid space and direction, accordingly the first object is adjusted, determine It is display location, display direction, forms the second display content.Therefore when showing this second display content, this first object Realize handshake operation with targeted customer, realize the interaction of targeted customer and display content.

Additionally, targeted customer can also make " grabbing ", " by ", " pushing away ", the gesture operation such as " waving ", thus using according to target These action messages at family, are processed to the first object, update the first display content.

The determination of this first changing content, a kind of possible implementation can be to be previously stored with different action messages From the corresponding relation of different first changing contents, search this first object corresponding such that it is able to the action message of foundation collection The first changing content.

Alternatively possible implementation, when described action message includes change in location, described according to described action message, Determine that the first changing content of the first object in described first display content can specifically include：

The object run body identifying the described action message that described action message includes is in described second solid space Primary importance and the second position.

Primary importance and the second position are specially different two position when object run body moves.

Determine the first object in corresponding described first display content of described action message, and described first object exists The 3rd position in described first solid space.

According to the variation relation of described primary importance and the described second position, determine fourth related to described 3rd position Position.

Then described according to described first changing content process described first display content, formed the second display content be： Generate described first object from the second display content of the 3rd position movement to the 4th change in location content.

For example, the second position of object run body is the position that the first direction being separated by the first distance with primary importance points to Put, then described 4th position is the position that the described first direction being separated by described first distance with described 3rd position points to.

Certainly described variation relation can also include motion track from primary importance to the second position for the object run body, from And generate by described first object from the 3rd position movement to the 4th position after the second display content specifically generate will be described First object according to described motion track from the 3rd position movement to the 4th position after the second display content.In the second display Rong Zhong, that is, assume the content that described first object follows object run body movement

Further, since object run body is in the second solid space moving process, described second may be left three-dimensional empty Between, therefore described generate by described first object from the 3rd position movement to the 4th position after the second display content can be concrete Including：

By described first object from the 3rd position movement to the 4th position, and in described 4th position according to the described second change Change content to be processed, form the second display content.

When assuming that the first object is entity object, entity object can change according to the natural law, such as motion shape Formula change or change of shape etc., therefore according to the second control strategy, it is possible to achieve the corresponding entity object of the first object, Follow the motion change identical motion change of the second nature rule when there is no operating body effect in moving process, do not grasp Make body effect, namely only acted on by gravity and aerostatic buoyancy.When the first object type is that its corresponding entity object gravity is big Under aerostatic buoyancy, such as stone, then according to corresponding second control strategy of the type, the first object can do the fortune of automatic falling bodies Dynamic；When the first object type is that its corresponding entity object gravity is less than aerostatic buoyancy, such as balloon, then according to the type pair The second control strategy answered, the first object can move upwards along aerostatic buoyancy direction, because described first changing content includes transporting The contents such as dynamic form, moving direction, change in location, motion track.

In the embodiment of the present invention, entity object refers to the object being physically present, and the first object refers to that entity object is corresponding Multimedia form, such as image, video recording etc., it is virtual, therefore can be realized to virtual objects by the embodiment of the present invention Control operation.

It should be noted that judge whether the boundary position that the described second position is the second solid space, and described target The operation that operating body leaves described second solid space can be carried out after obtaining the second position, and the present invention does not limit specifically Judgement opportunity.Certainly, the boundary position being the second solid space when the described second position, and object run body leaves described second During solid space, described first object can also rest on this second position and not do follow-up motion change.

Additionally, as another possible implementation, described according to described action message and in described first display Hold, determine that the changing content of the first object in described first display content can also specifically include：

It is first depending on described action message, identify that action message described in described first display content is corresponding first right As.

Obtain corresponding first control strategy of described action message, and according to described first control strategy and described action Information, determines the first changing content of described first object, and wherein, described first control strategy is described first object according to dynamic The change making information meets first natural law.

When assuming that the first object is entity object, entity object stress can be made to the motion action of entity object, and real Body object, under stress effect, can follow the course of nature and change, for example forms of motion change or change of shape etc..Therefore According to this action message and the first control strategy, can using the first object implementatio8 with its as during entity object under motion action Follow first natural law change identical change.

The motion action of user potentially includes operations such as " pushing away " " throwing " " loosing one's grip after gripping a certain object ".

Illustrate, when described action message collects for object run body executes the action of " throwing " to the first object Action message when, if then can determine that when the first object entity object, can be natural according to first under gravity Rule does the motion of parabolic path, and then can determine that first object the first changing content includes moving along parabolic path Forms of motion, moving direction, change in location, the content such as motion track, realize the process to the first object accordingly, update first Display content, forms the second display content, in the second display content, the first object moves along parabolic path.Certainly work as After described first object shows in the second display content and lands, if the first object is to have resilient object, this first couple As moving up and down in elastic force and action of gravity, until stop motion, the change of the first object is all to meet nature Rule.

And for example, the action letter that described action message collects for the first object is executed object run body with the action of " pushing away " During breath, if then can determine that when the first object entity object, in thrust according to first natural law, can be to thrust side To motion.Thus may determine that go out the first changing content including：First object is transported to thrust direction determined by this action message The contents such as dynamic forms of motion, moving direction, change in location, motion track, accordingly the first object is processed, update the One display content, forms the second display content, in the second display content, the first object moves along thrust direction.

Wherein, due to the finite volume of the viewing area of the first solid space, when the first changing content includes change in location During content, if the first object update according to the first changing content after position movement to the first solid space viewing area border Outward, then, due to the restriction of viewing area, when the first object movement is to viewing area boundary, a kind of possible variation pattern is： First object moves to the position of viewing area boundary by stopping at, then update described first according to described first changing content Display content specifically moves described first object according to described first changing content, stops when moving to viewing area boundary Only.

Alternatively possible variation pattern is：Stop in viewing area boundary, and become according to the second control strategy Change, if namely the first object its gravity of corresponding entity object be more than aerostatic buoyancy when, it does the motion of automatic falling bodies, if its When gravity is less than aerostatic buoyancy, move upwards under aerostatic buoyancy effect.

Certainly, according to action message, determine that the operation of the second display content is not limited in above-mentioned several implementation.

Step 205：Export the second content of multimedia in the first solid space, described second content of multimedia includes described Second display content.

Wherein, described second display content can be made way for outside described first solid space, and it is three-dimensional empty to be in described first Between around the user of diverse location watch.

Determine the second display content, you can output display, described second content of multimedia is included in this first display Hold.

With reference to diagram, the control operation of the content of multimedia of the first solid space in the present invention to be described, referring to Fig. 3 And Fig. 4, Fig. 3 exports the schematic diagram of the first display content for the present invention in the first solid space；Fig. 4 is that the present invention is vertical first The schematic diagram of the second display content is exported in body space.

Understand, described first display content 200 in described first solid space 100 includes personage couple in conjunction with Fig. 3 and Fig. 4 As who object shown in Fig. 3 is the state sat.User executes gesture operation by handss 300, it is possible to achieve three-dimensional with first empty Between display content interaction, in Fig. 3, user's handss 300 execution for " waving " operation, by gathering this gesture operation, identification Go out gesture information, then according to this gesture information it may be determined that the changing content going out this who object as stands and to user institute The dynamic change content walked about in position, thus the first display content 200 is carried out with process form the second display content 400, defeated After going out the second display content concrete as shown in figure 4, in the second display content shown in Fig. 4 who object be stand and to The static schematic diagram in a certain moment of family direction action.

In the present embodiment, when the first solid space exports the first content of multimedia, wherein this first content of multimedia The first display content watched including the user that can make way for various location around the first solid space, and pass through ultrasound wave Action message in the second solid space for the identification is thus according to this action message, determine the second display content and vertical second Output in body space so that can according to user-dependent action message, carry out the conversion of display content it is achieved that user Active control, such that it is able to effectively realize the control operation of content of multimedia, increased the experience of user simultaneously.

Referring to Fig. 5, the flow chart showing the present invention a kind of control method embodiment 3, methods described can include：

Step 501：Export the first content of multimedia in the first solid space, described first content of multimedia includes first Display content.

Step 502：Launch the first ultrasound wave to the second solid space, and gather from described second solid space second Ultrasound wave.

Step 503：According to described second ultrasound wave, determine the action message in described second solid space.

Certainly gather and identify that the action message of the second solid space can also be adopted using other forms, such as image The modes such as collection unit, data glove.

Step 504：According to described action message, determine the second display content.

Concrete implementation process may refer to, described in above-described embodiment, will not be described here.

Step 505：Export the second content of multimedia in the first solid space, described second content of multimedia includes described Second display content.

Step 506：Gather the acoustic information of targeted customer and/or facial feature information in described second solid space.

Described targeted customer can be the target executor that triggering generates action message.

Step 507：According to described acoustic information and/or facial feature information, determine the 3rd display content.

Multimedia input-output system can be provided with corresponding image acquisition units and audio collection unit, thus adopting Take acoustic information or the facial feature information of targeted customer.According to this acoustic information or facial feature information it may be determined that 3rd display content.For example in the first solid space, the first content of multimedia of output or the second content of multimedia are terror During the content of multimedia of type, when the wave volume of the targeted customer of detection exceeds preset value, face feature shows terrified shape, As pupil becomes big, when blocking the operation such as eyes, current display content in the first solid space can be converted accordingly, that is, really Fixed 3rd display content, described 3rd display content can be the display unrelated with the first display content or the second display content The display content that content or the first display content or the second display content obtain after processing, for example, will have terror The deletion of object etc..

In addition, according to acoustic information and/or facial feature information it may also be determined that other 3rd content of multimedia, such as 3rd audio content etc., described 3rd audio content can be when acoustic information and/facial feature information meet certain condition, phase The output volume of reduction audio frequency answered or output volume of raising audio frequency etc..

Step 508：Export the 3rd content of multimedia in described first solid space, described 3rd content of multimedia includes institute State the 3rd display content.

Determine the 3rd display content, you can include the matchmaker more than the 3rd of the 3rd display content in the first solid space output Internal appearance.

It should be noted that step 506～step 508 operate the execution sequence not limited with the present invention, it is permissible It is to execute when the first solid space exports the first content of multimedia, or export the second multimedia in the first solid space Execute again after content, or when described action message be according to the motion action of targeted customer determine when, can also with adopt The action message collecting the second solid space executes it is possible to by the determine second display content and the 3rd display content simultaneously In conjunction with after in output, the 3rd content of multimedia of therefore output can be included in the second display content and the 3rd display simultaneously Hold.

In the present embodiment, when the first solid space exports the first content of multimedia, wherein this first content of multimedia The first display content watched including the user that can make way for various location around the first solid space, collection is vertical second Action message in body space is thus according to this action message, determine the second display content and defeated in the second solid space Go out so that can according to user-dependent action message, carry out the conversion of display content it is achieved that the active control of user, Such that it is able to effectively realize the control operation of content of multimedia, the targeted customer positioned at the second solid space can also be gathered simultaneously Acoustic information and/or facial feature information, thus realizing further to many according to this acoustic information and/or facial feature information The control operation of media content, achieves effective control.

Corresponding with a kind of present invention control method embodiment 1, present invention also offers a kind of control device, with reference to Fig. 6, Show a kind of structural representation of present invention control device embodiment 1, described control device is applied particularly to multimedia input In output system, described device can include：

First output module 601, for exporting the first content of multimedia, described first multimedia in the first solid space Content includes the first display content.

Exporting a kind of possible implementation of the first content of multimedia in the first solid space is：The input of this multimedia is defeated Go out system and include medium signal generating unit and projecting cell, such that it is able to by this medium signal generating unit, at least in this first solid Form projection medium in space, projected to the described projection medium in described first solid space by described projecting cell, with Export described first content of multimedia.User can experience has the contents such as relief image.This projecting cell can be adjusted Whole projection angle, can export content of multimedia to different directions.Described projection medium may refer to there is the saturating of special material Bright medium, or smog, water vapour etc. can realize the medium of display information.Therefore described first output module 601 can have Body includes：

First control module 6011, for by described medium signal generating unit, at least forming in described first solid space Projection medium；

Second control module 6022, for being thrown to the described projection medium in described first space by described projecting cell Shadow, exports described first content of multimedia.

First acquisition module 602, for gathering action message in the second solid space.

The action message gathering the second solid space can have multiple implementations, as a kind of possible realize situation, This multimedia input-output system can include image acquisition units, and the image-capture field of image acquisition units at least includes Second solid space, therefore described first acquisition module can include：

Wherein, described second solid space can be in the target comprising targeted customer outside described first solid space The space of operating body.Can also be to be comprised by described first solid space, that is, the second solid space is located in the first solid space.

First processing module 603, for according to described action message, determining the second display content.

This second display content is different described first display content, can be specifically that the information comprising is different, Ke Yishi The form of expression is different.So that according to the action message of object run body, realizing the conversion of display content, realize with user's Interactive.

Second output module 603, for exporting the second content of multimedia, described second multimedia in the first solid space Content includes described second display content.

In the present embodiment, control device first solid space export the first content of multimedia when, wherein this more than first Media content includes making way for the first display content that the user of various location around the first solid space watches, collection Action message in the second solid space is thus according to this action message, determine the second display content and three-dimensional empty second Between middle output so that can according to user-dependent action message, carry out the conversion of display content it is achieved that the active of user Control, such that it is able to effectively realize the control operation of content of multimedia, increased the experience of user simultaneously.

Corresponding with the method that the invention described above a kind of control method embodiment 2 is provided, with reference to Fig. 7, the present invention also carries Supply a kind of control device embodiment 2, described device is applied particularly in multimedia input-output system, and described device can be wrapped Include：

First output module 701, for exporting the first content of multimedia, described first multimedia in the first solid space Content includes the first display content.

Wherein, described first display content can be made way for outside described first solid space, and it is three-dimensional empty to be in described first Between around the user of diverse location watch；

First acquisition module 702, for gathering action message in the second solid space.

Wherein, described first acquisition module 702 can include：

Ultrasonic control module 7021, for launching the first ultrasound wave to described second solid space, and gathers from institute State the second ultrasound wave of the second solid space.

Action message determining module 7022, for according to described second ultrasound wave, determining in described second solid space Action message.

Described second ultrasound wave is the echo information of described first ultrasound wave, namely the first ultrasound wave returns after barrier The echo information returned.In the present embodiment, described multimedia input-output system can include multigroup ultrasonic wave generating apparatus and surpass Acoustic receiver unit, thus launch the first ultrasound wave by ultrasonic wave generating apparatus to described second solid space, by ultrasonic Ripple receiving device receives the second ultrasound wave from the second solid space.

First processing module 703, for according to described action message, determining the second display content.

As an embodiment, described first processing module can specifically include：

Locality determining module, for according to described action message, determining described first display content described first The display location/of solid space or display direction.

Generation module, for according to described display location and/or display direction, described first display content being adjusted Whole, generate the second display content.

As another embodiment, described first processing module can specifically include：

Information determination module, according to described action message, determines in the change of the first object in described first display content Hold.

First display content can include different objects, for example flower, tree, animal, people etc., and described changing content can wrap Include：The contents such as the shift position of the first object, moving direction, size variation, change of shape and/or dynamic change content.This change Change content can according to the motion action of user, the action message identifying and determine, a kind of possible mode can be pre- The different action messages that are first stored with and the corresponding relation of different changing contents, such that it is able to look into according to the action message of collection Look for the changing content of this first object corresponding.

Process submodule, for processing described first display content according to described changing content, form the second display content.

Wherein, as a kind of possible implementation, described information determining module can include：

Identification module, for identifying the object run body of described action message that described action message includes described second Primary importance in solid space and the second position.

Primary importance determining module, for determining the first couple in corresponding described first display content of described action message As, and the 3rd position in described first solid space for described first object.

Second position determining module, for the variation relation according to described primary importance and the described second position, determine with The 4th related position of described 3rd position.

Then described process submodule specifically for generate by described first object from the 3rd position movement to the 4th position after The second display content.

In this implementation, described process submodule can also specifically include：

First process submodule, for by described first object from the 3rd position movement to the 4th position, and described the Four positions are processed according to described second changing content, form the second display content.

Second processing submodule, for when described judge module is to be, generating described first object from the 3rd position Mobile the second display content to the 4th position.

As alternatively possible implementation, described information determining module can include：

First object determining module, for according to described action message, identifying action described in described first display content Corresponding first object of information；

Second acquisition module, for obtaining corresponding first control strategy of described action message, and according to the described first control Make tactful and described action message, determine the first changing content of described first object, wherein, described first control strategy is Described first object meets first natural law according to the change of action message.

Second output module 704, for exporting the second content of multimedia, described second multimedia in the first solid space Content includes described second display content, and wherein, described second display content can be made way for outside described first solid space, and locates Around described first solid space, the user of diverse location watches.

Corresponding with a kind of the invention described above control method embodiment 3, with reference to Fig. 8, present invention also offers a kind of control Device embodiment 3, described device is applied particularly in multimedia input-output system, and described device can include：

First output module 801, for exporting the first content of multimedia, described first multimedia in the first solid space Content includes the first display content.

First acquisition module 802, for gathering action message in the second solid space.

Wherein, as a kind of possible implementation, described first acquisition module 802 can include：

Ultrasonic control module 8021, for launching the first ultrasound wave to described second solid space, and gathers from institute State the second ultrasound wave of the second solid space.

Action message determining module 8022, for according to described second ultrasound wave, determining in described second solid space Action message.

First processing module 803, for according to described action message, determining the second display content.

Second output module 804, for exporting the second content of multimedia, described second multimedia in the first solid space Content includes described second display content, and wherein, described second display content can be made way for outside described first solid space, and locates Around described first solid space, the user of diverse location watches.

Second acquisition module 805, for gathering the acoustic information of targeted customer and/or face in described second solid space Characteristic information.

Second processing module 806, for according to described acoustic information and/or facial feature information, determining in the 3rd display Hold.

3rd output module 807, for exporting the 3rd content of multimedia, described matchmaker more than 3rd in described first solid space Internal appearance includes described 3rd display content.

In addition, present invention also offers a kind of multimedia input-output system, including control device described above.

Wherein, described multimedia input-output system also includes projecting cell and medium signal generating unit, and medium generates single Unit, for forming projection medium in the first solid space.Described projecting cell is situated between to the projection in this first solid space Matter is projected, and exports content of multimedia, and the unit that control device can generate to projecting cell and medium is controlled, with When can gather the action message in the second solid space, and according to action message, determine other display contents, thus real The conversion of display content in existing first solid space.

Described projecting cell can be specifically located at below described first solid space, from lower to upper, three-dimensional to first Space is projected, and exports content of multimedia.

Wherein, as a kind of possible implementation, described multimedia input-output system can also include ultrasound wave and send out Generating apparatus and ultrasound wave receiving device, the action message that control device gathers in the second solid space is sent out particular by ultrasound wave Generating apparatus launch the first ultrasound wave to the second solid space, by the collection of ultrasound wave receiving device from the of the second solid space Two ultrasound wave, thus determine action message according to the second ultrasound wave.

As alternatively possible implementation, described multimedia input-output system can also include image acquisition list Unit, thus control device specifically can obtain the picture material of inclusion second solid space of described image collecting unit collection, Therefrom identify action message.

Certainly described multimedia input-output system necessarily can also include some other necessary parts, with prior art Identical, will not be described here.

In this specification, each embodiment is described by the way of going forward one by one, and what each embodiment stressed is and other The difference of embodiment, between each embodiment identical similar portion mutually referring to.For device disclosed in embodiment For, because it corresponds to the method disclosed in Example, so description is fairly simple, say referring to method part in place of correlation Bright.

Described above to the disclosed embodiments, makes professional and technical personnel in the field be capable of or uses the present invention. Multiple modifications to these embodiments will be apparent from for those skilled in the art, as defined herein General Principle can be realized without departing from the spirit or scope of the present invention in other embodiments.Therefore, the present invention It is not intended to be limited to the embodiments shown herein, and be to fit to and principles disclosed herein and features of novelty phase one The scope the widest causing.

Claims

1. a kind of control method is it is characterised in that be applied in multimedia input-output system, methods described includes：

Export the first content of multimedia in the first solid space, described first content of multimedia includes the first display content, its In, described first display content can be made way for outside described first solid space, and is in around described first solid space different The user of position watches；

Action message is gathered in the second solid space；

According to described action message, determine the first changing content of the first object in described first display content, including：Identification institute State the object run body of the described action message that action message the includes primary importance and in described second solid space Two positions；Determine the first object in corresponding described first display content of described action message, and described first object exists The 3rd position in described first solid space；According to the variation relation of described primary importance and the described second position, determine with The 4th related position of described 3rd position；

Update described first display content according to described changing content, form the second display content, including：Judge whether described Two positions are the boundary position of the second solid space, and described object run body leaves described second solid space；

If it is, according to described first object type, obtain corresponding second control strategy of described first object type, described the Two control strategies are that the change of described first object meets the second nature rule；

By described first object from the 3rd position movement to the 4th position, and in described 4th position according in the described second change Hold and processed, form the second display content；

If it is not, then generate by described first object from the 3rd position movement to the 4th position after the second display content；

Export the second content of multimedia in the first solid space, described second content of multimedia is included in described second display Hold, wherein, described second display content can be made way for outside described first solid space, and is in around described first solid space The user of diverse location watches.

2. method according to claim 1 is it is characterised in that described first solid space comprises the described second three-dimensional sky Between.

3. method according to claim 1 is it is characterised in that described first changing content includes the position of described first object Put changing content, moving direction changing content, change in size content, change of shape content and/or forms of motion changing content.

4. method according to claim 1 it is characterised in that described multimedia input-output system include projecting cell and Medium signal generating unit, described export the first content of multimedia in described first solid space and is specially：

By described projecting cell to the described projection medium projection in described first solid space, export described first multimedia Content.

5. method according to claim 1 is it is characterised in that described multimedia input-output system includes multigroup ultrasound wave Generation equipment and ultrasound wave receiving device, described described second solid space collection action message include：

Launch the first ultrasound wave to described second solid space, and gather the second ultrasound wave from described second solid space；

6. method according to claim 1 is it is characterised in that described multimedia input-output system includes image acquisition list Unit, described image acquisition range includes described second solid space, then described described second solid space collection action message Including：

7. the method according to claims 1 is it is characterised in that methods described also includes；

Export the 3rd content of multimedia in described first solid space, described 3rd content of multimedia is included in described 3rd display Hold.

8. a kind of control device is it is characterised in that be applied in multimedia input-output system, described device includes：

First output module, for exporting the first content of multimedia, described first content of multimedia bag in the first solid space Include the first display content, wherein, described first display content can be made way for outside described first solid space, and is in described first Around solid space, the user of diverse location watches；

Information determination module, according to described action message, determines the changing content of the first object in described first display content, bag Include：Identification module, the object run body for identifying described action message that described action message includes is three-dimensional described second Primary importance in space and the second position；Primary importance determining module, corresponding described for determining described action message The first object in first display content, and the 3rd position in described first solid space for described first object；Second Position determination module, for the variation relation according to described primary importance and the described second position, determines and described 3rd position The 4th related position；

Process submodule, for processing described first display content according to described changing content, form the second display content；Specifically For, generate by described first object from the 3rd position movement to the 4th position after the second display content；Including：Judge mould Block, for judging whether the boundary position that the described second position is the second solid space, and described object run body leave described Second solid space；First acquisition module, for when described judge module is to be, according to described first object type, obtaining Corresponding second control strategy of described first object type, described second control strategy is that the change of described first object meets Two natural laws；First content determining module, for determining the second change of described first object according to described second control strategy Change content；First process submodule, for by described first object from the 3rd position movement to the 4th position, and the described 4th Position is processed according to described second changing content, forms the second display content；Second processing submodule, for ought described sentence Disconnected module be no when, generate by described first object from the 3rd position movement to the 4th position after the second display content；

Second output module, for exporting the second content of multimedia, described second content of multimedia bag in the first solid space Include described second display content, wherein, described second display content can be made way for outside described first solid space, and be in described Around first solid space, the user of diverse location watches.

9. device according to claim 8 it is characterised in that described multimedia input-output system include projecting cell and Medium signal generating unit, then described first output module include：

First control module, for by described medium signal generating unit, at least forming projection medium in described first solid space；

Second control module, for being projected to the described projection medium in described first solid space by described projecting cell, Export described first content of multimedia.

10. device according to claim 8 it is characterised in that described multimedia input-output system include multigroup ultrasonic Wave generating apparatus and ultrasound wave receiving device, then described first acquisition module include：

Ultrasonic control module, for launching the first ultrasound wave to described second solid space, and gathers vertical from described second Second ultrasound wave in body space；

Action message determining module, for according to described second ultrasound wave, determining the action message in described second solid space.

11. devices according to claim 8 are it is characterised in that described multimedia input-output system includes image acquisition Unit, described image acquisition range includes described second solid space, then described acquisition module includes：

Image collection module, for obtaining the picture material of inclusion second solid space of described image collecting unit collection；

12. devices according to claim 8 are it is characterised in that described device also includes：

Second acquisition module, for gathering the acoustic information of targeted customer and/or face feature letter in described second solid space Breath；

3rd output module, for exporting the 3rd content of multimedia, described 3rd content of multimedia in described first solid space Including described 3rd display content.

A kind of 13. multimedia input-output systems are it is characterised in that include the control as described in any one of claim 8～12 Device.