CN108076363A - Implementation method, system and the set-top box of virtual reality - Google Patents
Implementation method, system and the set-top box of virtual reality Download PDFInfo
- Publication number
- CN108076363A CN108076363A CN201611027443.5A CN201611027443A CN108076363A CN 108076363 A CN108076363 A CN 108076363A CN 201611027443 A CN201611027443 A CN 201611027443A CN 108076363 A CN108076363 A CN 108076363A
- Authority
- CN
- China
- Prior art keywords
- signal
- virtual reality
- top box
- scenario
- scenario simulation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
- H04N21/43632—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wired protocol, e.g. IEEE 1394
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
- H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
Abstract
The embodiment of the present invention provides a kind of implementation method of virtual reality, system and set-top box, the scenario simulation signal for treating simulated scenario is obtained from virtual reality signal source by set-top box, then Three-dimensional Display processing is carried out to the picture signal that the virtual scene analog signal got includes, and will treated that scenario simulation signal is sent to virtual reality output equipment, drawn up for virtual reality output equipment according to scenario simulation signal mode and three-dimensional treat simulated scenario.This scheme provided in an embodiment of the present invention, take full advantage of the powerful processing capacity of set-top box, instead of modelling apparatus in professional virtual reality device, the cost for realizing virtual reality in the family is reduced, user is allowed to experience the enjoyment of virtual reality technology based on set-top box.Meanwhile based on the set-top box high advantage of popularity rate in the family, more people is allowed to experience the advantages of virtual reality technology is brought and enjoyment, improve user experience of the users when watching video or carrying out Entertainment.
Description
Technical field
The present invention relates to the implementation method of field of virtual reality more particularly to virtual reality, system and set-top boxes.
Background technology
Virtual reality (Virtual Reality, VR) is a kind of Computer Simulation that can be created with the experiencing virtual world
System, it using the simulated environment that computer generates is a kind of Multi-source Information Fusion, interactive Three-Dimensional Dynamic what comes into a driver's and reality
The system emulation of body behavior provides a user the simulation of vision, the sense of hearing even sense organs such as tactile, smell, allows user such as body
It goes through that its border is general, the things in three-dimensional space can be observed from two-dimentional angles of display with limiting.When user dresses virtual reality
During equipment, controller can be used or keyboard shuttles under virtual environment or interaction, such as user has on and wears display device,
It holds handle to wave in the air, it is possible to realize the interaction with things in virtual environment.
The virtual reality device of specialty it is expensive, therefore cause the virtual reality device popularity rate of specialty low, it is big absolutely
Majority could not also enjoy the enjoyment that virtual reality technology is brought.Professional virtual reality device generally comprise modelling apparatus,
Output equipment, User Status collecting device, interactive device etc., wherein, it is more demanding to the processing capacity of modelling apparatus, because building
Mould equipment needs to realize the three-dimensional process of simulated scenario, and therefore, modelling apparatus improves the holistic cost of virtual reality device, leads
Most consumers is caused to hang back virtual reality device.
And on the other hand, set-top box (Set Top Box, STB) is set as a connection television set and outside source
Standby, it can be by the compression number from wire cable, satellite antenna, broadband network, terrestrial broadcasting or other storage mediums
Word signal changes into television content, and shows on a television set.Set-top box is the very high a kind of equipment of popularity rate in family,
And with the development of information technology and the propulsion of wisdom home business, screen refresh rate, delay and the equipment of set-top box calculate
The hardware performances such as ability are constantly promoted, and effect has been no longer limited to video playing, and user can be more by network
Interactive digitalization amusement, education and commercialization activity are realized using set-top box.But although set-top box has high excellent of popularity rate
Gesture has come into most families, but since the image display of television set is two-dimentional, plane.Therefore, Yong Hu
When watching video or Entertainment, always cannot well it be immersed among video scene or scene of game, this to use
Family experience meets with bottleneck, and user can not obtain better entertaining experience from video or game.
To sum up, by television set show it is low with virtual reality device popularity rate limited, average family viewing video and into
When row Entertainment, it is impossible to which the entertaining experience of virtual reality technology offer is provided.
The content of the invention
Implementation method, system and the set-top box of virtual reality provided in an embodiment of the present invention, main technical problems to be solved
It is：Average family can not enjoy virtual reality technology by the set-top box that popularity rate is high and processing capacity is strong in the prior art
The enjoyment brought, and caused by user experience it is low the technical issues of.
In order to solve the above technical problems, the embodiment of the present invention provides a kind of implementation method of virtual reality, including：
Set-top box obtains the scenario simulation signal for treating simulated scenario of virtual reality signal source transmission；
The set-top box carries out Three-dimensional Display processing to the picture signal in the scenario simulation signal；
The set-top box by treated the scenario simulation signal output to the output equipment of virtual reality device, with
It is drawn up according to the scenario simulation signal mode for the output equipment of the virtual reality device and three-dimensional treats simulated scenario.
The embodiment of the present invention also provides a kind of set-top box, including：
Source signal reception module, for obtaining the scenario simulation signal for treating simulated scenario of virtual reality signal source transmission；
Source signal processing module, for carrying out Three-dimensional Display processing to the picture signal in the scenario simulation signal；
Source signal output module, for by the output of treated the scenario simulation signal output to virtual reality device
In equipment, drawn up for the output equipment of the virtual reality device according to the scenario simulation signal mode and three-dimensional treat simulation yard
Scape.
The embodiment of the present invention also provides a kind of set-top box, including：Virtual reality device and set-top box as described above.
The embodiment of the present invention also provides a kind of computer storage media, and computer is stored in the computer storage media
Executable instruction, the computer executable instructions are used to perform the implementation method of the virtual reality of foregoing any one.
The beneficial effects of the invention are as follows：
Implementation method, system and set-top box and the computer storage of the virtual reality provided according to embodiments of the present invention are situated between
Matter is obtained the scenario simulation signal for treating simulated scenario by set-top box from virtual reality signal source, then virtual to what is got
The picture signal that scenario simulation signal includes carries out Three-dimensional Display processing, and scenario simulation signal is sent to void by treated
Intend real output equipment, drawn up for virtual reality output equipment according to scenario simulation signal mode and three-dimensional treat simulated scenario.This
This scheme that inventive embodiments provide, takes full advantage of the powerful processing capacity of set-top box, is set instead of professional virtual reality
Standby middle modelling apparatus reduces the cost for realizing virtual reality in the family, user is allowed to experience virtual reality based on set-top box
The enjoyment of technology.Meanwhile based on the set-top box high advantage of popularity rate in the family, more people is allowed to experience virtual reality technology band
The advantages of coming and enjoyment improve user experience of the users when watching video or carrying out Entertainment.
Description of the drawings
Fig. 1 is a kind of flow chart of the implementation method for the virtual reality that the embodiment of the present invention one provides；
Fig. 2 is a kind of structure diagram of set-top box provided by Embodiment 2 of the present invention；
Fig. 3 is another structure diagram of set-top box provided by Embodiment 2 of the present invention；
Fig. 4 is hardware architecture diagram in the malice of set-top box provided by Embodiment 2 of the present invention；
Fig. 5 is a kind of structure diagram of the realization system for the virtual reality that the embodiment of the present invention three provides；
Fig. 6 is another structure diagram of the realization system for the virtual reality that the embodiment of the present invention three provides.
Specific embodiment
The embodiment of the present invention is described in further detail below by specific embodiment combination attached drawing.
Embodiment one：
In order to which more users is allowed to experience the enjoyment that virtual reality technology is brought, the present embodiment provides a kind of virtual realities
Implementation method, this method implemented by set-top box, is situated between in detail to the implementation method to virtual reality below in conjunction with Fig. 1
It continues, those skilled in the art is enable to have further understanding to the advantages of this method and details：
S102, set-top box obtain the scenario simulation signal for treating simulated scenario of virtual reality signal source transmission.
Virtual reality signal source can there are many, such as the memory of set-top box local or to be connected to set-top box local
Movable storage device.When virtual reality signal source is the memory of set-top box local, user can be virtually existing by desired progress
The video of crucial point reason or game storage allow set-top box to be read from its local memory to the memory of set-top box local
Treat the scenario simulation signal of simulated scenario.Alternatively, when set-top box has the ability for supporting connection External memory equipment, e.g., machine
There is USB interface on top box, video file can be prestored in External memory equipment, such as USB flash disk, mobile phone equipment by user,
Then by USB interface, External memory equipment is connected on set-top box.Set-top box is made to be obtained from these External memory equipments
Treat the scenario simulation signal of simulated scenario.The compression digital signal and the parallel processing that carry out automatic network are received since set-top box all has
It is shown on a television set afterwards, therefore, set-top box can also receive the scenario simulation signal for carrying out automatic network.In the prior art,
Set-top box carries out when the compression digital signal for carrying out automatic network is obtained generally by the mode of wired connection, but this
Field technology personnel are it is understood that in the present embodiment, set-top box can pass through when scenario simulation signal is obtained
Wired mode carries out, and can also pass through the wireless modes such as Wifi, bluetooth.
S104, set-top box carry out Three-dimensional Display processing to the picture signal in virtual scene analog signal.
Being included at least in scenario simulation signal has picture signal, and set-top box, can be with after scenario simulation signal is got
Picture signal therein is handled.When due to realizing virtual reality, when simulating visual scene in the form of three-dimensional
It presents, therefore, in the present embodiment, set-top box can carry out Three-dimensional Display processing to picture signal.
In general, we are in permeable material or when reversely observing object by material surface, it is found that finding geometry of objects
Different with the shape of its script, we term it optical distortions for this change.Optical distortion is present in almost all of regard
Feel in scene.Therefore, in order to improve the fidelity for treating simulated scenario, user can feel wherein when observing simulated scenario
Scenery is vivid, so, set-top box can also carry out optical distortion display processing to picture signal in the present embodiment.
S106, set-top box by treated scenario simulation signal output to the output equipment of virtual reality device, for
The output equipment of virtual reality device simulates according to virtual scene analog signal and three-dimensional treats simulated scenario.
It, can be by scenario simulation signal output to virtual reality device after set-top box handles scenario simulation signal
Output equipment on.Existing many three-dimensional display apparatus be all by two display screens and lens cooperate to realize it is three-dimensional
Display.Therefore, treated image stream can be conveyed to two display screens of virtual reality device respectively by set-top box simultaneously,
It can also input to give together and image stream is respectively delivered to two display screens by virtual reality device after virtual reality device
Up.
Set-top box to virtual reality device output one frame is treated have image after, it is new to what is got immediately
Scenario simulation signal is handled, and when the old image that new image replaces virtual reality device to show, is believed according to waiting to simulate
Number scene simulated is just into dynamic scene.Among this dynamic scene, different degrees of variation can occur for part scene,
So that entire scene is more vigorous.
Among a kind of example of the present embodiment, picture signal is not only included in scenario simulation signal, further includes audio letter
Number, audio signal can be more so that the 3D vision scene presented by image more has anger, for example, by set-top box
Image stream after Three-dimensional Display processing has simulated the picture of a forest：Inside forest, dense trees are dark green tall and straight, have
Golden sunlight is trickled down on the ground along woods gap, and morning fog is gradually rising upward.Although entire picture is dynamically and variation is abundant, use
Family is stayed wherein, may feel shortcoming, if simulating the chirm of some daystarts, entirely treats that simulated scenario will
More completely and with vitality.It, can be according to virtual existing after set-top box gets the audio signal in scenario simulation signal
The hardware characteristics of real equipment in itself handle audio signal, for example, virtual reality device is only with left and right acoustic channels and virtually
It is different that real world devices, which have the processing of stereo-circulation sound,.
In scene analog signal in addition to including picture signal and audio signal, some other control letters is further included
Number, such as olfactory analog control signal and touching simulation control signal.In above-mentioned simulating forest picture, soil might have
The fragrant and faint fragrance of a flower, therefore, set-top box can be by the smell that are sent in the scenario simulation signal of virtual reality device
Analog control signal control virtual reality device exports the smell that certain fragrance carrys out secondary user's.When the breeze winnowing in early morning
When, except the branches and leaves of vegetation can be swung therewith, the user of " staying wherein " should also be as to feel the face of a gentle wind springing up oneself
Cheek so touching simulation control signal can make the fan assembly in virtual reality device work, causes user that can perceive
Air motion, be that user experiences gentle breeze in " forest ".It will be appreciated by those skilled in the art that touching simulation controls
Signal can also cause different degrees of vibrations in addition to controlling " blowing ", be user carry out such as flying games or
The slight vibrations of oneself local environment can be felt during car race game, simulate the slight shake of aircraft cockpit or automobile driver seat
Dynamic sense of touch.
Virtual reality device in the present embodiment can be virtual reality helmet.It should be appreciated that institute here
The virtual reality helmet said refers to the helmet of broad sense, is worn over when not only including the use of with ensureing user in account
The display device of visual experience and the audio output device of audio experience, further include other matched auxiliaring equipments, such as fan,
Smell output equipment, mating seat etc..
Among the implementation method of virtual reality provided in this embodiment, the simulated scenario that virtual reality device simulates may be used also
To be changed and adjust according to the demand of user, for example, among real world, user can lead to when environment of observation
It crosses the eyeball for adjusting oneself or changes oneself face orientation by rotating head, so as to change the visual field.When the visual field of user changes
After change, seen scenery will necessarily change, and therefore, simulated scenario be treated in the three-dimensional that virtual reality device simulates
In, work as observer, i.e., after the observation visual angle of the change of user present position or user change, the image of display should also be as
It changes.So in the present embodiment, the state acquisition equipment of virtual reality device can also gather station status signal, and
Station status signal is sent to set-top box.Set-top box is after station status signal is received, with reference to User Status to obtaining
To scenario simulation signal handled.For example, user wishes a flower in close-ups forest simulated scenario, then user
This flower may be come into, therefore, set-top box needs to present in a manner of microspur according to the distance between user and virtual flower
Flower is observed for user.
, it is necessary to carry out human-computer interaction when user is in experiencing virtual reality game, at this time user needs to carry out defeated
Enter, user generally can realize input by interactive devices such as data glove, data suit, control walking sticks.On these interactive devices
Physical button can not only be set to be inputted for user, the capture such as gravity sensor, gyroscope, range sensor can also be passed through
The user action captured is transferred to set-top box, different action schedules by gesture motion, limb action of user etc., interactive device
It takes over the different instruction at family for use, set-top box is made to realize the processing for the scenario simulation signal for treating simulated scenario according to the action of user.Example
Batting is realized as user waves control walking stick, and set-top box calculates according to the data that control walking stick collects and determines whether user hits
In, so that it is determined that showing the movement tendency of ball in picture.
Interactive device except it is above-mentioned it is several in addition to, forceball, control stick, haptic feedback devices, power can also be included and feel anti-
Present device, acoustics is motion-captured, electromagnetic type is motion-captured, optical motion capture etc., in addition, can also be adopted by sound
Collect the sound that equipment uses user, and by the transmission of sound signals collected to set-top box, the sound for making set-top box that will receive
Signal is matched with pre-stored acoustic model, after successful match, is obtained the corresponding instruction of corresponding acoustic model and is made
The interactive instruction issued for user.
The implementation method of virtual reality provided in an embodiment of the present invention, by set-top box to from network, local storage or
It is connected to the scenario simulation signal got at the virtual realities signal sources such as other local storage devices to be handled, then will
By Three-dimensional Display, treated that picture signal etc. is transferred to virtual reality device in scenario simulation signal so that virtual reality is set
It is standby can directly treated that scenario simulation signal mode draws up treats simulated scenario for basis, the process of processing need not be undergone.Fully
The processing capacity of set-top box maturation is make use of, reduces the cost for realizing virtual reality technology in the family.Simultaneously as machine top
Box has come into huge numbers of families, thus it is possible to further improve the popularity rate of virtual reality technology, allow more users can be with
Experience the user experience innovation that virtual reality technology is brought.
Further, picture signal is not only included in scenario simulation signal, also includes meeting user's sense of hearing, smelling
Audio signal, smell, touching simulation control signal of other each orientation experience such as feel, tactile etc. so that virtual reality device mould
That draws up treats that simulated scenario is more life-like, improves user experience.
Meanwhile set-top box may be combined virtual when treat the scenario simulation signal of simulated scenario and handled
The station status signal and user input signal of state acquisition equipment or the interactive device input of real world devices carry out, therefore,
It can cause the simulated scenario realization and the interaction of user that virtual reality device simulates, user can immerse more vividly
Into simulated scenario.
Embodiment two：
The present embodiment provides a kind of set-top box first, refers to Fig. 2：
Set-top box 20 includes source signal reception module 202, source signal processing module 204 and source signal output module 206.
Virtual reality signal source can there are many, such as the local memory of set-top box 20 or be connected to set-top box 20
The movable storage device on ground.When virtual reality signal source is the local memory of set-top box 20, user can be by desired progress
The video of virtual reality processing or game storage allow source signal reception module 202 from its to the local memory of set-top box 20
The scenario simulation signal for treating simulated scenario is read on local memory.It is supported alternatively, having in set-top box 20 outside connection
During the ability of storage device, e.g., there is USB interface on set-top box 20, video file can be prestored to external storage by user
In equipment, such as USB flash disk, mobile phone equipment, then by USB interface, External memory equipment is connected on set-top box 20.Believe source
Number receiving module 202 obtains the scenario simulation signal for treating simulated scenario from these External memory equipments.Due to set-top box 20 all
With the ability for receiving the compression digital signal for carrying out automatic network and being shown on a television set after parallel processing, therefore, source letter
Number receiving module 202 can also receive the scenario simulation signal for carrying out automatic network.In the prior art, source signal reception module 202 exists
When obtaining the compression digital signal for carrying out automatic network, carried out generally by the mode of wired connection, but art technology
For personnel it is understood that in the present embodiment, source signal reception module 202, can be with when scenario simulation signal is obtained
It is carried out by wired mode, the wireless modes such as Wifi, bluetooth can also be passed through.
Being included at least in scenario simulation signal has picture signal, and source signal reception module 202 is getting scenario simulation letter
After number, source signal processing module 204 can be handled picture signal therein.When due to realizing virtual reality,
Simulate what is presented during visual scene in the form of three-dimensional, therefore, in the present embodiment, source signal processing module 204 can be to figure
As signal carries out Three-dimensional Display processing.
In general, we are in permeable material or when reversely observing object by material surface, it is found that finding geometry of objects
Different with the shape of its script, we term it optical distortions for this change.Optical distortion is present in almost all of regard
Feel in scene.Therefore, in order to improve the fidelity for treating simulated scenario, user can feel wherein when observing simulated scenario
Scenery is vivid, so, source signal processing module 204 can also show picture signal progress optical distortion in the present embodiment
Processing.
After source signal processing module 204 handles scenario simulation signal, scenario simulation signal output can be arrived
On the output equipment of virtual reality device.Existing many three-dimensional display apparatus are all the phase interworkings by two display screens and lens
It closes to realize Three-dimensional Display.Therefore, source signal output module 206 can image stream be conveyed to void respectively simultaneously by treated
Intend two display screens of real world devices, can also input and be given image after virtual reality device by virtual reality device together
Stream is respectively delivered to two display screens up.
Source signal output module 206 to virtual reality device output one frame is treated have image after, source signal
Receiving module 202 can get new scenario simulation signal, make source signal processing module 204 to the new scene mould that gets
Intend signal handled, when new image replace virtual reality device show old image when, according to treat analog signal simulation
The scene gone out is just into dynamic scene.Among this dynamic scene, different degrees of variation can occur for part scene, so that
It is more vigorous to obtain entire scene.
Among a kind of example of the present embodiment, picture signal is not only included in scenario simulation signal, further includes audio letter
Number, audio signal can be more so that the 3D vision scene presented by image more has anger, for example, by source signal
Image stream after the processing of 204 Three-dimensional Display of processing module has simulated the picture of a forest：Inside forest, dense trees
It is dark green tall and straight, there is golden sunlight to be trickled down on the ground along woods gap, morning fog is gradually rising upward.Although entire picture dynamic and change
Change and enrich, but user stays wherein, may feel shortcoming, if simulating the chirm of some daystarts, entirely treats
Simulated scenario will be more complete and with vitality.Source signal reception module 202 gets the audio in scenario simulation signal
After signal, source signal processing module 204 can according to the hardware characteristics of virtual reality device in itself to audio signal at
Reason, for example, virtual reality device is not not only with the processing of left and right acoustic channels and virtual reality device with stereo-circulation sound
With.
In scene analog signal in addition to including picture signal and audio signal, some other control letters is further included
Number, such as olfactory analog control signal and touching simulation control signal.In above-mentioned simulating forest picture, soil might have
The fragrant and faint fragrance of a flower, therefore, set-top box 20 can be by being sent to smelling in the scenario simulation signal of virtual reality device
Feel that analog control signal control virtual reality device exports the smell that certain fragrance carrys out secondary user's.When the breeze winnowing in early morning
When, except the branches and leaves of vegetation can be swung therewith, the user of " staying wherein " should also be as to feel the face of a gentle wind springing up oneself
Cheek so touching simulation control signal can make the fan assembly in virtual reality device work, causes user that can perceive
Air motion, be that user experiences gentle breeze in " forest ".It will be appreciated by those skilled in the art that touching simulation controls
Signal can also cause different degrees of vibrations in addition to controlling " blowing ", be user carry out such as flying games or
The slight vibrations of oneself local environment can be felt during car race game, simulate the slight shake of aircraft cockpit or automobile driver seat
Dynamic sense of touch.
Virtual reality device in the present embodiment can be virtual reality helmet.It should be appreciated that institute here
The virtual reality helmet said refers to the helmet of broad sense, is worn over when not only including the use of with ensureing user in account
The display device of visual experience and the audio output device of audio experience, further include other matched auxiliaring equipments, such as fan,
Smell output equipment, mating seat etc..
Among the implementation of virtual reality provided in this embodiment, the simulated scenario that virtual reality device simulates may be used also
To be changed and adjust according to the demand of user, for example, among real world, user can lead to when environment of observation
It crosses the eyeball for adjusting oneself or changes oneself face orientation by rotating head, so as to change the visual field.When the visual field of user changes
After change, seen scenery will necessarily change, and therefore, simulated scenario be treated in the three-dimensional that virtual reality device simulates
In, work as observer, i.e., after the observation visual angle of the change of user present position or user change, the image of display should also be as
It changes.So in the present embodiment as shown in figure 3, set-top box 20 further includes feedback signal receiving module 208, virtually now
The state acquisition equipment of real equipment can also gather station status signal, and station status signal is sent to the feedback of set-top box 20
Signal receiving module 208.After feedback signal receiving module 208 receives station status signal, source signal processing module 204
The scenario simulation signal got is handled with reference to User Status.For example, user wishes close-ups forest simulation yard
A flower in scape, then user may come into this flower, therefore, source signal processing module 204 need according to user with it is virtual
Flower is presented so that user observes in the distance between flower in a manner of microspur.
, it is necessary to carry out human-computer interaction when user is in experiencing virtual reality game, at this time user needs to carry out defeated
Enter, user generally can realize input by interactive devices such as data glove, data suit, control walking sticks.On these interactive devices
Physical button can not only be set to be inputted for user, the capture such as gravity sensor, gyroscope, range sensor can also be passed through
The user action captured is transferred to the feedback signal of set-top box 20 by gesture motion, limb action of user etc., interactive device
Receiving module 208, different action schedules take over the different instruction at family for use, make source signal processing module 204 real according to the action of user
Now treat the processing of the scenario simulation signal of simulated scenario.Such as user waves control walking stick and realizes batting, source signal processing module
204 data collected according to control walking stick, which calculate, determines whether user hits, so that it is determined that the movement of ball becomes in display picture
Gesture.
Interactive device except it is above-mentioned it is several in addition to, forceball, control stick, haptic feedback devices, power can also be included and feel anti-
Present device, acoustics is motion-captured, electromagnetic type is motion-captured, optical motion capture etc., in addition, can also be adopted by sound
Collect equipment and use the sound of user, and the transmission of sound signals collected is made to feedback signal receiving module 208 at source signal
Reason module 204 matches the voice signal received with pre-stored acoustic model, after successful match, acquisition pair
Answer acoustic model is corresponding to instruct the interactive instruction issued as user.
Illustrated in fig. 4 is a kind of hardware architecture diagram of set-top box, structurally, set-top box is generally by master chip
40th, the several majors such as memory 41, communicator 42, graphics processor 43 are formed.In the present embodiment, when virtual reality signal source
When being network, the function of source signal reception module 202 can be realized by communicator 42 in set-top box 20.Meanwhile
Virtual reality signal source can also be the either External memory equipment of memory 41 of set-top box itself.At the source signal of set-top box 20
The function of reason module 204 can control each other component to realize by master chip 40.For example, among scenario simulation signal
Picture signal processing, then can be completed by 40 control pattern processor 43 of master chip.And treated scenario simulation signal
Then can virtual reality device be output to up by the video and audio output unit in communicator 42.Feedback signal receiving module
208 function can then be realized by the return path in communicator 42.
Set-top box provided in an embodiment of the present invention, by set-top box to from network, local storage or being connected to local
The scenario simulation signal got at the virtual realities signal source such as other storage devices is handled, then by scenario simulation signal
Middle by Three-dimensional Display, treated that picture signal etc. is transferred to virtual reality device so that virtual reality device can direct root
According to treated, scenario simulation signal mode draws up treats simulated scenario, need not undergo the process of processing.Take full advantage of set-top box
Ripe processing capacity reduces the cost for realizing virtual reality technology in the family.Simultaneously as set-top box has been come into
Huge numbers of families, thus it is possible to further improve the popularity rate of virtual reality technology, more users can experience virtually now
The user experience innovation that real technology is brought.
Further, picture signal is not only included in scenario simulation signal, also includes meeting user's sense of hearing, smelling
Audio signal, smell, touching simulation control signal of other each orientation experience such as feel, tactile etc. so that virtual reality device mould
That draws up treats that simulated scenario is more life-like, improves user experience.
Meanwhile set-top box may be combined virtual when treat the scenario simulation signal of simulated scenario and handled
The station status signal and user input signal of state acquisition equipment or the interactive device input of real world devices carry out, therefore,
It can cause the simulated scenario realization and the interaction of user that virtual reality device simulates, user can immerse more vividly
Into simulated scenario.
Embodiment three：
The present embodiment provides a kind of realization system of virtual reality, as shown in figure 5, the realization system 5 of virtual reality includes
The set-top box 20 that virtual reality device 50 and embodiment two provide.With reference to specific example to the realization system of virtual reality
5 are introduced：
The scenario simulation signal of 50 receiving set up box 20 of virtual reality device output, includes figure after scene analog signal
As the control signal of signal, audio signal and other sensory experiences, such as olfactory analog control signal, touching simulation control letter
Number etc..Virtual reality device 50 shows 3 D stereo video to user on the display screen, makes user by watching in real time
Sound, smell, environment dynamic change in 3 D stereo video and simulated scenario etc., which are experienced, lays oneself open to virtual world.
Sensor, range sensor, accelerometer of tracking user's head movement etc. can be integrated on virtual reality device 50,
Virtual reality device 50 to set-top box 20, shows these data real-time deliveries collected so that set-top box 20 does image three-dimensional
Show processing and/or optical distortion display processing.
Display device is worn as illustrating exemplified by virtual reality device 50 using virtual reality below, virtual reality is worn
Fresnel Lenses, high definition screen, earphone and other ancillary equipments, such as fan, gas can be integrated on display device
Taste output device etc..User wears display device by virtual reality and experiences 3D or panoramic video.Further, virtual reality head
HDMI input interfaces can be carried by wearing display device, and set-top box 20 can be by the HDMI output interface of itself to virtual reality head
Wear high-definition image signal of the display device output Jing Guo three-dimensional process.Meanwhile set-top box 20 can also be by wired or wireless
Mode wear display device to virtual reality and export with the associated control signal of visual scene, for example have in simulated scenario and blow
When output blow control signal, alternatively, exporting the fragrance of a flower control signal when having fresh flower inside simulated scenario.It is virtual existing
Display device is worn according to these control signals received in fact, and corresponding control action makes user by ancillary equipment.
For example receive when blow control signal, the starting fan of ancillary equipment and work, the certain wind of simulation output is in user
On the face, when receiving fragrance of a flower control signal, the certain fragrance of ancillary equipment simulation output stimulates the smell of user.
Among a kind of example of the present embodiment, such as Fig. 6, the realization system 5 of virtual reality further includes interaction device 60, mutually
Dynamic equipment 60 can be data glove, data suit, control walking stick etc., gather the input signal of user, and sent out to set-top box 20
The user input signal collected is sent, so that set-top box 20 is handled scenario simulation signal according to user input signal, so
Afterwards will treated scenario simulation signal output to virtual reality device 50, virtual reality device 50 is allowed to be simulated to user and treats mould
Intend scene.
It is situated between below to the communication mode between 60 three of set-top box 20, virtual reality device 50 and interaction device
It continues：
The first, using over the horizon communication system between three, infrared communication is the infrared ray using 950nm near infrared bands
As the media for transferring information, modulates information to be sent can be a series of burst signal by information transmitting terminal, be passed through
Infrared transmitting tube emits infrared signal；After information receiving end receives, the light arteries and veins received can be converted into electric signal by it, then
It is demodulated by the processing such as amplifying, filtering, is reduced to binary digital signal, obtains raw information.
Second, when three is in WiFi coverages, the mode of WiFi communication, the communication frequency of WiFi may be employed
Section has the characteristics that broad covered area, long transmission distance between 2412MHz to 2484MHz.WiFi communication compared with use fortune
For the data traffic that battalion business provides is communicated, burden for users can be mitigated, more economical material benefit.
The third, is since user is when experiencing virtual is shown, set-top box 20 and interaction device 60 and virtual reality
The distance between equipment 50 is simultaneously not far, and therefore, the mode that short-range communication may be employed in three interacts.Short-range communication bag
Include Bluetooth communication, ZigBee (wireless personal area network) communications etc..Wherein relatively common communication mode is Bluetooth communication, because bluetooth
The main Microwave Radio frequency spectrum for using 2.402GHz to 2.480GHz, there is lower work(compared to other communication modes
Consumption.Therefore, when using bluetooth approach interaction between three, the spent power consumption of communication can be reduced.Moreover, from another point of view
For, at present, Bluetooth Communication Technology is ripe, is widely used, and almost all of electronic equipment can be supported, therefore using bluetooth
Mode transmit control information implement it is very easy.
The realization system of virtual reality provided in this embodiment, is obtained from virtual reality signal source by set-top box and waits to simulate
Then the scenario simulation signal of scene carries out Three-dimensional Display to the picture signal that the virtual scene analog signal got includes
Processing, and will treated that scenario simulation signal is sent to virtual reality output equipment, for virtual reality output equipment according to
Scenario simulation signal mode, which is drawn up, three-dimensional treats simulated scenario.The powerful processing capacity of set-top box is taken full advantage of, instead of specialty
Modelling apparatus in virtual reality device is reduced the cost for realizing virtual reality in the family, user is allowed to be experienced based on set-top box
To the enjoyment of virtual reality technology.Meanwhile based on the set-top box high advantage of popularity rate in the family, more people is allowed to experience virtually
The advantages of reality technology is brought and enjoyment improve user's body of the users when watching video or carrying out Entertainment
It tests.Meanwhile set-top box the processing of scenario simulation signal can be combined the station status signal that collects of virtual reality device and
User input signal that interaction device collects carries out, it is achieved that the true interaction of user and simulated scenario, allows simulation yard
Scape is more life-like, so as to which user also can more experience enjoyment on the spot in person.
Obviously, those skilled in the art should be understood that each module of the embodiments of the present invention or each step can be used
General computing device realizes that they can concentrate on single computing device or be distributed in multiple computing device institutes
On the network of composition, optionally, they can be realized with the program code that computing device can perform, it is thus possible to by they
It is stored in computer storage media (ROM/RAM, magnetic disc, CD) and is performed by computing device, and in some cases, it can
With the steps shown or described are performed in an order that is different from the one herein or they are fabricated to each integrated circuit die respectively
Multiple modules in them or step are fabricated to single integrated circuit module to realize by block.So the present invention does not limit
It is combined in any specific hardware and software.
The above content is the further descriptions made with reference to specific embodiment to the embodiment of the present invention, it is impossible to recognize
The specific implementation of the fixed present invention is confined to these explanations.For those of ordinary skill in the art to which the present invention belongs,
Without departing from the inventive concept of the premise, several simple deduction or replace can also be made, should all be considered as belonging to the present invention
Protection domain.
Claims (11)
1. a kind of implementation method of virtual reality, including：
Set-top box obtains the scenario simulation signal for treating simulated scenario of virtual reality signal source transmission；
The set-top box carries out Three-dimensional Display processing to the picture signal in the scenario simulation signal；
The set-top box is by treated the scenario simulation signal output to the output equipment of virtual reality device, for institute
It states the output equipment of virtual reality device and is drawn up according to the scenario simulation signal mode and three-dimensional treat simulated scenario.
2. the implementation method of virtual reality as described in claim 1, which is characterized in that the set-top box obtains virtual reality letter
The transmission of number source treats that the scenario simulation signal of simulated scenario includes：
The set-top box is by wired or wireless network reception come the scenario simulation signal of automatic network；
Or,
The set-top box is from local memory device or is connected to acquisition scenario simulation signal in local storage device.
3. the implementation method of virtual reality as described in claim 1, which is characterized in that further include the set-top box and receive interaction
The user input signal that equipment receives；
The set-top box carries out Three-dimensional Display to the picture signal in the scenario simulation signal to be included：
The set-top box is based on the user input signal and carries out Three-dimensional Display processing to the scenario simulation signal.
4. the implementation method of virtual reality as described in claim 1, which is characterized in that further include the set-top box to the field
Picture signal in scape analog signal carries out optical distortion display processing.
5. the implementation method of virtual reality as described in claim 1, which is characterized in that the scenario simulation signal further includes sound
At least one of frequency signal, olfactory analog control signal, touching simulation control signal.
6. such as the implementation method of claim 1-5 any one of them virtual realities, which is characterized in that further include the set-top box
Receive the station status signal that the state acquisition equipment of the virtual reality device collects；
The set-top box carries out Three-dimensional Display to the picture signal in the scenario simulation signal to be included：
The set-top box is based on the station status signal and carries out Three-dimensional Display processing to the scenario simulation signal.
7. the implementation method of virtual reality as claimed in claim 6, which is characterized in that the station status signal includes user
The variable signal of present position, the turn signal of user eyeball, the turn signal of user's face.
8. a kind of set-top box, which is characterized in that including：
Source signal reception module, for obtaining the scenario simulation signal for treating simulated scenario of virtual reality signal source transmission；
Source signal processing module, for carrying out Three-dimensional Display processing to the picture signal in the scenario simulation signal；
Source signal output module, for by the output equipment of treated the scenario simulation signal output to virtual reality device
On, it is drawn up for the output equipment of the virtual reality device according to the scenario simulation signal mode and three-dimensional treats simulated scenario.
9. a kind of realization system of virtual reality, which is characterized in that including：Machine described in virtual reality device and claim 8
Top box.
10. such as the realization system of claim 9 virtual reality, which is characterized in that further include interactive device, the interactive device is used
In the user input signal collected to set-top box transmission, for the set-top box according to the user input signal to institute
Scenario simulation signal is stated to be handled.
11. the realization of the virtual reality as described in claim 9 or 10, which is characterized in that the virtual reality device includes void
Intend real helmet.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611027443.5A CN108076363A (en) | 2016-11-16 | 2016-11-16 | Implementation method, system and the set-top box of virtual reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611027443.5A CN108076363A (en) | 2016-11-16 | 2016-11-16 | Implementation method, system and the set-top box of virtual reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108076363A true CN108076363A (en) | 2018-05-25 |
Family
ID=62161090
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611027443.5A Pending CN108076363A (en) | 2016-11-16 | 2016-11-16 | Implementation method, system and the set-top box of virtual reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108076363A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109410341A (en) * | 2018-11-13 | 2019-03-01 | 深圳市虚拟现实科技有限公司 | Individualized virtual reality entertainment systems and its method |
| CN109587470A (en) * | 2018-10-23 | 2019-04-05 | 嘉兴玄视信息科技有限公司 | A kind of 3D TV and all-in-one machine control system based on virtual reality all-in-one machine |
| CN112653933A (en) * | 2020-12-09 | 2021-04-13 | 深圳市创维软件有限公司 | VR data display method, device and system based on set top box and storage medium |
| CN113961074A (en) * | 2021-10-21 | 2022-01-21 | 南京康博智慧健康研究院有限公司 | Virtual home forest health maintenance method and system |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030046689A1 (en) * | 2000-09-25 | 2003-03-06 | Maria Gaos | Method and apparatus for delivering a virtual reality environment |
| CN103237238A (en) * | 2013-03-30 | 2013-08-07 | 潘玮玲 | Network television box |
| CN103856795A (en) * | 2014-02-10 | 2014-06-11 | 周丽明 | Television broadcast system |
| US20140298273A1 (en) * | 2013-04-02 | 2014-10-02 | Imimtek, Inc. | Systems and Methods for Implementing Three-Dimensional (3D) Gesture Based Graphical User Interfaces (GUI) that Incorporate Gesture Reactive Interface Objects |
| CN104321681A (en) * | 2012-06-29 | 2015-01-28 | 英特尔公司 | Enhanced information delivery using a transparent display |
| CN105338272A (en) * | 2015-11-27 | 2016-02-17 | 广东长虹电子有限公司 | Television set based on VR technology and Miracast technology |
| US20160162039A1 (en) * | 2013-07-21 | 2016-06-09 | Pointgrab Ltd. | Method and system for touchless activation of a device |
-
2016
- 2016-11-16 CN CN201611027443.5A patent/CN108076363A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030046689A1 (en) * | 2000-09-25 | 2003-03-06 | Maria Gaos | Method and apparatus for delivering a virtual reality environment |
| CN104321681A (en) * | 2012-06-29 | 2015-01-28 | 英特尔公司 | Enhanced information delivery using a transparent display |
| CN103237238A (en) * | 2013-03-30 | 2013-08-07 | 潘玮玲 | Network television box |
| US20140298273A1 (en) * | 2013-04-02 | 2014-10-02 | Imimtek, Inc. | Systems and Methods for Implementing Three-Dimensional (3D) Gesture Based Graphical User Interfaces (GUI) that Incorporate Gesture Reactive Interface Objects |
| US20160162039A1 (en) * | 2013-07-21 | 2016-06-09 | Pointgrab Ltd. | Method and system for touchless activation of a device |
| CN103856795A (en) * | 2014-02-10 | 2014-06-11 | 周丽明 | Television broadcast system |
| CN105338272A (en) * | 2015-11-27 | 2016-02-17 | 广东长虹电子有限公司 | Television set based on VR technology and Miracast technology |
Non-Patent Citations (1)
| Title |
|---|
| 司占军 等: "《数字出版》", 31 January 2013, 中国轻工业出版社 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109587470A (en) * | 2018-10-23 | 2019-04-05 | 嘉兴玄视信息科技有限公司 | A kind of 3D TV and all-in-one machine control system based on virtual reality all-in-one machine |
| CN109410341A (en) * | 2018-11-13 | 2019-03-01 | 深圳市虚拟现实科技有限公司 | Individualized virtual reality entertainment systems and its method |
| CN112653933A (en) * | 2020-12-09 | 2021-04-13 | 深圳市创维软件有限公司 | VR data display method, device and system based on set top box and storage medium |
| CN113961074A (en) * | 2021-10-21 | 2022-01-21 | 南京康博智慧健康研究院有限公司 | Virtual home forest health maintenance method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105704501B (en) | Virtual reality live broadcast system based on unmanned aerial vehicle panoramic video | |
| US20180373413A1 (en) | Information processing method and apparatus, and program for executing the information processing method on computer | |
| CN106730815B (en) | Somatosensory interaction method and system easy to realize | |
| CN108076363A (en) | Implementation method, system and the set-top box of virtual reality | |
| CN104258566B (en) | Multi-picture display-based virtual shooting cinema system and method | |
| US20190073830A1 (en) | Program for providing virtual space by head mount display, method and information processing apparatus for executing the program | |
| CN107683166A (en) | For limiting filtering and the father and mother's control method of the visual activity on head mounted display | |
| CN107158704A (en) | A kind of reality-virtualizing game system | |
| CN104731343A (en) | Virtual reality man-machine interaction children education experience system based on mobile terminal | |
| CN107683449A (en) | The personal space content that control is presented via head mounted display | |
| CN106919248A (en) | It is applied to the content transmission method and equipment of virtual reality | |
| CN106648045A (en) | Virtual reality technology-based real-time travel experience system | |
| CN205334369U (en) | Stage performance system based on motion capture | |
| CN106572344A (en) | Virtual reality live broadcast method and system and cloud server | |
| CN104080008B (en) | A kind of smart television game interaction system and method | |
| CN103093115A (en) | Game system and method which are based on three dimensional (3D) human body model of real human body | |
| CN108983982A (en) | AR aobvious equipment and terminal device combined system | |
| CN204855941U (en) | Wear -type virtual reality equipment and system | |
| US20180374275A1 (en) | Information processing method and apparatus, and program for executing the information processing method on computer | |
| CN114900678B (en) | VR end-cloud combined virtual concert rendering method and system | |
| CN105391984A (en) | UAV (Unmanned Aerial Vehicle) driving experience system and method | |
| CN105983235A (en) | Method and device for providing game scene | |
| CN108961368A (en) | The method and system of real-time live broadcast variety show in three-dimensional animation environment | |
| CN206312071U (en) | A kind of VR aobvious device systems for supporting online game | |
| CN207051853U (en) | A kind of immersive VR experiencing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180525 |