CN106774910A - Streetscape implementation method and device based on virtual reality - Google Patents
Streetscape implementation method and device based on virtual reality Download PDFInfo
- Publication number
- CN106774910A CN106774910A CN201611209993.9A CN201611209993A CN106774910A CN 106774910 A CN106774910 A CN 106774910A CN 201611209993 A CN201611209993 A CN 201611209993A CN 106774910 A CN106774910 A CN 106774910A
- Authority
- CN
- China
- Prior art keywords
- streetscape
- head
- display apparatus
- mounted display
- dimensional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 230000000007 visual effect Effects 0.000 claims abstract description 32
- 238000005516 engineering process Methods 0.000 claims description 11
- 238000007654 immersion Methods 0.000 abstract description 13
- 230000002452 interceptive effect Effects 0.000 abstract description 12
- 238000013507 mapping Methods 0.000 description 10
- 230000008859 change Effects 0.000 description 8
- 230000008569 process Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 239000007787 solid Substances 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 230000015572 biosynthetic process Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000005352 clarification Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 230000014759 maintenance of location Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 238000010304 firing Methods 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0641—Shopping interfaces
- G06Q30/0643—Graphical representation of items or shoppers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/003—Navigation within 3D models or images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Abstract
The invention discloses a kind of streetscape implementation method based on virtual reality, by obtaining head-mounted display apparatus present position；According to the head-mounted display apparatus present position, the three-dimensional periphery streetscape of the head-mounted display apparatus present position is obtained；Three-dimensional virtual human corresponding with the head-mounted display apparatus is built, the three-dimensional virtual human is dissolved into the three-dimensional periphery streetscape.Device is realized the invention also discloses a kind of streetscape based on virtual reality.Automatic identification three-dimensional periphery streetscape of the present invention, and the visual human of structure is dissolved into the three-dimensional periphery streetscape, provide the user more immersion and with interactive experience.
Description
Technical field
The present invention relates to technical field of virtual reality, more particularly to streetscape implementation method and device based on virtual reality.
Background technology
Streetscape has just been sent to expectation very high and extensive since the release as a kind of brand-new Map Services mode
Concern.Streetscape is a kind of photo that 360 degree of street both sides is shot by streetscape car, and then these photos are uploaded to by treatment
Website, for visitor views.This forms striking contrast with 2D plane maps, makes originally boring map more lively, more
Have readable and recreational.User is just seemingly on the spot in person, stays indoors just it will be seen that outdoor various landscape.Streetscape is opened
A kind of brand-new map reading mode has been created, a pattern for live-action map experience has also been opened.Particularly to up to a certain strange
When city, by searching streetscape map, local streetscape state can be rapidly understood, but, existing streetscape there is also necessarily
The drawbacks of, for example, user is not strong with streetscape interactivity, the feeling of immersion of user is also far from enough, therefore, how to strengthen user and street
The interactivity and the property immersed of scape, are a problem demanding prompt solutions.
The content of the invention
It is a primary object of the present invention to propose a kind of streetscape implementation method based on virtual reality and device, it is intended to strengthen
User and the interactivity and the property immersed of streetscape.
To achieve the above object, a kind of streetscape implementation method based on virtual reality that the present invention is provided, it is described based on void
The streetscape implementation method for intending reality includes step：
Obtain head-mounted display apparatus present position；
According to the head-mounted display apparatus present position, the head-mounted display apparatus present position is obtained
Three-dimensional periphery streetscape；
Three-dimensional virtual human corresponding with the head-mounted display apparatus is built, the three-dimensional virtual human is dissolved into described three
In dimension periphery streetscape.
Preferably, it is described according to the head-mounted display apparatus present position, obtain the head-mounted display apparatus
The step of three-dimensional periphery streetscape of present position, includes：
Gather the stereoscopic panoramic image pair of periphery streetscape in advance under different viewing angles using double full-view cameras；
The stereoscopic panoramic image pair and correspondence visual angle are stored in the street view database of setting in advance；
If get the head-mounted display apparatus present position in setting range, the street is accordingly recalled
The stereoscopic panoramic image pair in scape database.
Preferably, it is described according to the head-mounted display apparatus present position, obtain the head-mounted display apparatus
The step of three-dimensional periphery streetscape of present position, includes：
If recognize the head-mounted display apparatus present position more than the distance threshold for setting, building is opened
Group's display pattern, shows the groups of building of the three-dimensional periphery streetscape.
Preferably, it is described according to the head-mounted display apparatus present position, obtain the head-mounted display apparatus
The step of three-dimensional periphery streetscape of present position, includes：
If recognize the head-mounted display apparatus less than or equal to the distance threshold for setting, retail shop's display mould is opened
Formula, shows the retail shop of the three-dimensional periphery streetscape.
Preferably, it is described to include the step that the three-dimensional virtual human is dissolved into the three-dimensional periphery streetscape：
Using motion capture technology, the movement locus of the head-mounted display apparatus is caught；
For the three-dimensional virtual human sets up the fantasy sport direction with the movement locus maps mutually.
Additionally, to achieve the above object, the present invention also proposes that a kind of streetscape based on virtual reality realizes device, is applied to
In head-mounted display apparatus, the streetscape based on virtual reality realizes that device includes：
Current location acquisition module, for obtaining head-mounted display apparatus present position；
Streetscape acquisition module, shows for according to the head-mounted display apparatus present position, obtaining the wear-type
Show the three-dimensional periphery streetscape of equipment present position；
Module is incorporated, for building three-dimensional virtual human corresponding with the head-mounted display apparatus, by the three-dimensional
People is dissolved into the three-dimensional periphery streetscape.
Preferably, the streetscape acquisition module includes：
Collecting unit, the stereoscopic full views for gathering periphery streetscape in advance under different viewing angles using double full-view cameras
Image pair；
Memory cell, the street view database for the stereoscopic panoramic image pair and correspondence visual angle to be stored in setting in advance
In；
Call unit, if during for getting the head-mounted display apparatus present position in setting range,
Accordingly recall the stereoscopic panoramic image pair in the street view database.
Preferably, if the streetscape acquisition module be additionally operable to recognize the head-mounted display apparatus present position it is big
When the distance threshold of setting, then groups of building display pattern is opened, show the groups of building of the three-dimensional periphery streetscape.
Preferably, if the streetscape acquisition module is additionally operable to recognize the head-mounted display apparatus less than or equal to setting
Distance threshold when, then open retail shop display pattern, show the retail shop of the three-dimensional periphery streetscape.
Preferably, the module that incorporates includes：
Capture unit, for using motion capture technology, catches the movement locus of the head-mounted display apparatus；
Unit is set up, for setting up the fantasy sport direction with the movement locus maps mutually for the three-dimensional virtual human.
Streetscape implementation method and device based on virtual reality proposed by the present invention, are worked as by obtaining head-mounted display apparatus
Preceding position；According to the head-mounted display apparatus present position, obtain the head-mounted display apparatus and be currently located
The three-dimensional periphery streetscape of position；Three-dimensional virtual human corresponding with the head-mounted display apparatus is built, by the three-dimensional virtual human
It is dissolved into the three-dimensional periphery streetscape.Automatic identification three-dimensional periphery streetscape of the present invention, and the visual human of structure is dissolved into institute
State in three-dimensional periphery streetscape, provide the user more immersion and with interactive experience.
Brief description of the drawings
Fig. 1 is one of the streetscape implementation method structural representation of the present invention based on virtual reality；
Fig. 2 is the two of streetscape implementation method structural representation of the present invention based on virtual reality；
Fig. 3 is the schematic flow sheet of streetscape implementation method first embodiment of the present invention based on virtual reality；
Fig. 4 is the refinement schematic flow sheet of the step of head-mounted display apparatus present position is obtained described in Fig. 3；
Fig. 5 is the schematic flow sheet of streetscape implementation method second embodiment of the present invention based on virtual reality；
Fig. 6 is the schematic flow sheet of streetscape implementation method 3rd embodiment of the present invention based on virtual reality；
Fig. 7 is the refinement stream of the step being dissolved into the three-dimensional virtual human described in Fig. 3 in the three-dimensional periphery streetscape
Journey schematic diagram；
Fig. 8 is the high-level schematic functional block diagram that streetscape of the present invention based on virtual reality realizes device first embodiment；
Fig. 9 is the high-level schematic functional block diagram of streetscape acquisition module described in Fig. 8；
Figure 10 is the high-level schematic functional block diagram that module is incorporated described in Fig. 8.
The realization of the object of the invention, functional characteristics and advantage will be described further referring to the drawings in conjunction with the embodiments.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
Fig. 1-Fig. 2 is referred to, the present invention includes virtual implementing helmet 11, helmet positioner 21, device for positioning handle
22nd, virtual reality handle 41 and processor 39, wherein, helmet positioner 21 can observe the position of virtual implementing helmet 11 simultaneously
It is positioned, device for positioning handle 22 can observe the position of virtual reality handle 41 and it is positioned.
As shown in figure 3, first embodiment of the invention proposes a kind of streetscape implementation method based on virtual reality, it is described to be based on
The streetscape implementation method of virtual reality includes step：
Step S100, acquisition head-mounted display apparatus present position.
Head-mounted display apparatus perform positioning action according to the time threshold being previously set, and the time threshold can set
It is set to 1 second, it is also possible to be set as other values, time threshold can at any time be adjusted or change according to the setting of user, it is fixed
Bit manipulation passes through GPS (Global Positioning System, global positioning system) and RFID (Radio Frequency
Identification, radio frequency identification) cooperation complete, if at outdoor, then obtain present position by GPS
Longitude and latitude and coordinate；If when indoors, then using longitude and latitude and coordinate that RFID obtains present position instead.
Step S200, according to the head-mounted display apparatus present position, obtain the head-mounted display apparatus and work as
The three-dimensional periphery streetscape of preceding position.
Head-mounted display apparatus are adopted in advance using double full-view cameras under each different visual angle of two different viewpoints
Collect the stereoscopic panoramic image pair of periphery streetscape；And the stereoscopic panoramic image pair and correspondence visual angle are stored in the street of setting in advance
In scape database；If get the head-mounted display apparatus present position, the street view database is accordingly recalled
In the stereoscopic panoramic image pair.
Step S300, structure three-dimensional virtual human corresponding with the head-mounted display apparatus, the three-dimensional virtual human is melted
Enter in the three-dimensional periphery streetscape.
Head-mounted display apparatus build three-dimensional corresponding with the head-mounted display apparatus in virtual reality scenario
People, and be dissolved into the three-dimensional virtual human in the three-dimensional periphery streetscape in stereoscopic panoramic image pair.Wherein, it is described to wear
Corresponding relation between formula display device and the three-dimensional virtual human includes the corresponding of action, i.e., described head-mounted display apparatus with
The three-dimensional virtual human formation acts mapping relations, if the head-mounted display apparatus are moved to the left, the three-dimensional
People is accordingly moved to the left.
The streetscape implementation method based on virtual reality that the present embodiment is proposed, by obtaining the current institute of head-mounted display apparatus
In position；According to the head-mounted display apparatus present position, the head-mounted display apparatus present position is obtained
Three-dimensional periphery streetscape；Three-dimensional virtual human corresponding with the head-mounted display apparatus is built, the three-dimensional virtual human is incorporated
To in the three-dimensional periphery streetscape.The present embodiment automatic identification three-dimensional periphery streetscape, and the visual human of structure is dissolved into described
In three-dimensional periphery streetscape, more immersion is provided the user and with interactive experience.
As shown in figure 4, Fig. 4 is the refinement schematic flow sheet of step S200 described in Fig. 3, on the basis of first embodiment
On, the step S200 includes：
Step S210, the stereoscopic panoramic image for gathering periphery streetscape in advance under different viewing angles using double full-view cameras
It is right.
Head-mounted display apparatus are adopted in advance using double full-view cameras under two different viewpoints and different visual angles
Collect the stereoscopic panoramic image pair of periphery streetscape, in the present embodiment, the full-view camera is preferably fish-eye camera, described to regard
Angle is including height, direction and the angle of pitch etc..
Step S220, by the stereoscopic panoramic image pair and correspondence visual angle be stored in the street view database of setting in advance.
Head-mounted display apparatus will form mapping one by one and close between the stereoscopic panoramic image pair for collecting and visual angle
System, and accumulate visual angle mapping table；The stereoscopic panoramic image pair and the visual angle mapping table are stored in the street of setting in advance
In scape database.
If step S230, when getting the head-mounted display apparatus present position in setting range, accordingly
Recall the stereoscopic panoramic image pair in the street view database.
If head-mounted display apparatus get the head-mounted display apparatus present position in setting range,
The head-mounted display apparatus current visual angle is detected, the visual angle mapping table in the street view database is recalled and head
Wear the corresponding stereoscopic panoramic image pair of formula display device current visual angle.
The streetscape implementation method based on virtual reality that the present embodiment is proposed, using double full-view cameras at different visual angles
The stereoscopic panoramic image pair of the lower periphery streetscape of collection in advance；The stereoscopic panoramic image pair and correspondence visual angle are stored in set in advance
In fixed street view database；If get the head-mounted display apparatus present position in setting range, accordingly
Recall the stereoscopic panoramic image pair in the street view database.The present embodiment recalls periphery streetscape three-dimensional panorama and regards automatically
Figure, provides the user more immersion and with interactive experience.
As shown in figure 5, the flow that Fig. 5 is streetscape implementation method second embodiment of the present invention based on virtual reality is illustrated
Figure, on the basis of first embodiment, the step S200 includes：
If step S240, recognize the head-mounted display apparatus present position more than setting distance threshold when,
Groups of building display pattern is then opened, the groups of building of the three-dimensional periphery streetscape are shown.
If head-mounted display apparatus recognize present position more than the distance threshold for setting, i.e., described wear-type shows
Show equipment apart from the periphery streetscape farther out when, then open groups of building display pattern, show the building of the three-dimensional periphery streetscape
Group, so as to by way of watching groups of building birds-eye view, make user have a guide look of the panorama of the three-dimensional periphery streetscape.
The streetscape implementation method based on virtual reality that the present embodiment is proposed, if recognize the head-mounted display apparatus working as
When preceding position is more than the distance threshold for setting, then groups of building display pattern is opened, show building for the three-dimensional periphery streetscape
Group is built, so that user understands rapidly the panorama of periphery streetscape, more immersion is provided the user and with interactive experience.
As shown in fig. 6, the flow that Fig. 6 is streetscape implementation method 3rd embodiment of the present invention based on virtual reality is illustrated
Figure, on the basis of first embodiment, the step S200 includes：
If step S250, recognize the head-mounted display apparatus less than or equal to setting distance threshold when, open
Retail shop's display pattern, shows the retail shop of the three-dimensional periphery streetscape.
If head-mounted display apparatus recognize present position less than or equal to the distance threshold for setting, i.e., described head
Wear formula display device apart from the periphery streetscape it is nearer when, then open retail shop display pattern, show the three-dimensional periphery streetscape
Retail shop, so that user obtains rapidly the details of periphery solid shop.
The streetscape implementation method based on virtual reality that the present embodiment is proposed, if it is small to recognize the head-mounted display apparatus
In or equal to setting distance threshold when, then open retail shop display pattern, show the retail shop of the three-dimensional periphery streetscape so that
User obtains rapidly the details of periphery solid shop, provides the user more immersion and with interactive experience.
As shown in fig. 7, Fig. 7 is the refinement schematic flow sheet of step S300 described in Fig. 3, on the basis of first embodiment
On, the step S300 includes：
Step S310, using motion capture technology, catch the movement locus of the head-mounted display apparatus.
Head-mounted display apparatus use motion capture technology, movement locus are caught, first with background subtraction
The head-mounted display apparatus for extracting motion are combined with frame differential method, wherein, frame differential method is using image sequence
Make the difference to extract the moving region of the stereoscopic panoramic image centering between adjacent two field picture in row.First by number two field picture school
Just in the same coordinate system, then the two images by same background not in the same time carry out calculus of differences, and gray scale does not change
Background parts be subtracted, because position of the head-mounted display apparatus in adjacent two frame is different, and have with background gray scale
Institute's difference, two frames protrude the head-mounted display apparatus to come after subtracting each other, so as to substantially determine the head-mounted display apparatus
Position in the stereoscopic panoramic image pair.Background subtraction is using image sequence and subtracts each other with reference to background model and realize institute
State target object detection.Background subtraction can provide more complete characteristic and be shown so as to extract the wear-type
Equipment, but its dynamic scene change caused to illumination and external condition is excessively sensitive, needs to add the back of the body in uncontrolled feelings subordinate
Scape image update mechanism, and be not intended to and scape cam movement of enjoying a double blessing, or the larger situation of background grey scale change.It is described after again
Head-mounted display apparatus use SIFT (Scale-invariant feature transform, Scale invariant features transform
With) algorithm is tracked to the target object.Its main thought is to set up object library, by the stereoscopic panoramic image to first
The head-mounted display apparatus in frame are extracted, and property data base is stored in target database after carrying out SIFT conversion,
Each database includes target label, center-of-mass coordinate, coordinates of targets block and SIFT information.Each clarification of objective information is wrapped again
Include feature point coordinates, characteristic vector and the corresponding retention priority of characteristic vector.Then with object library as intermediary, with the second frame
Middle target SIFT feature information is matched, and finds the relevance of front and rear two frame, determines the position and track of the target object,
Then using target in storehouse and the matching relationship of the second frame target, updated using specific policy, eliminate object library information.Afterwards again
Continue to process subsequent frame as intermediary with object library.SIFT algorithms are divided into matching and update two processes.Matching process leads to
The matching probability of two objects feature is crossed, front and rear two frames identical target is found out, target is associated.Renewal process be then
Object library is supplemented and updated on the basis of matching, it is ensured that object library information is kept similitude with a few frame targets recently, with
Ensure the correctness of identification.
Step S320, be the three-dimensional virtual human set up and the movement locus maps mutually fantasy sport direction.
Head-mounted display apparatus, according to the movement locus for catching, are that the three-dimensional virtual human is set up and the movement locus phase
The fantasy sport direction of mapping, if the head-mounted display apparatus are moved, the three-dimensional virtual human is then on the three-dimensional periphery
It is corresponding in streetscape to realize that streetscape is roamed；And chosen in the retail shop of the three-dimensional periphery streetscape and try out all kinds of commodity, if selection
To after favorite commodity, virtual shopping cart is added by scanning after the Quick Response Code on the commodity, and further realize net
Upper payment.
The streetscape implementation method based on virtual reality that the present embodiment is proposed, using motion capture technology, catches the head
Wear the movement locus of formula display device；For the three-dimensional virtual human sets up the fantasy sport side with the movement locus maps mutually
To so that user chooses rapidly favorite commodity, providing the user more immersion and with interactive experience.
As shown in figure 8, Fig. 8 is streetscape of the present invention based on virtual reality realizes that the functional module of device first embodiment is shown
It is intended to, in the first embodiment, the streetscape based on virtual reality realizes that device includes：
Current location acquisition module 10, for obtaining head-mounted display apparatus present position, current location obtains dress
10 are put to be integrated in virtual implementing helmet 11；
Streetscape acquisition module 20, for according to the head-mounted display apparatus present position, obtaining the wear-type
The three-dimensional periphery streetscape of display device present position；
Module 30 is incorporated, for building three-dimensional virtual human corresponding with the head-mounted display apparatus, will be described three-dimensional empty
Personification is dissolved into the three-dimensional periphery streetscape, and incorporating device 30 includes virtual implementing helmet 11.
The current location acquisition module 10 of head-mounted display apparatus performs positional operand according to the time threshold being previously set
Make, the time threshold can be set as 1 second, it is also possible to be set as other values, time threshold can according to the setting of user with
When be adjusted or change, positioning action is completed by the cooperation of GPS and RFID, if at outdoor, then by GPS come
Obtain the longitude and latitude and coordinate of present position；If when indoors, then using the longitude and latitude that RFID obtains present position instead
Degree and coordinate.
The streetscape acquisition module 20 of head-mounted display apparatus using double full-view cameras two different viewpoints each not
The stereoscopic panoramic image pair of periphery streetscape is gathered under same visual angle in advance；And by the stereoscopic panoramic image pair and correspond to visual angle thing
First it is stored in the street view database of setting；It is corresponding to adjust if get the head-mounted display apparatus present position
The stereoscopic panoramic image pair gone out in the street view database.
The module 30 that incorporates of head-mounted display apparatus builds and the head-mounted display apparatus pair in virtual reality scenario
The three-dimensional virtual human answered, and be dissolved into the three-dimensional virtual human in the three-dimensional periphery streetscape in stereoscopic panoramic image pair.
Wherein, the corresponding relation between the head-mounted display apparatus and the three-dimensional virtual human includes corresponding, i.e., the described head of action
Wear formula display device and act mapping relations with the three-dimensional virtual human formation, if the head-mounted display apparatus are moved to the left,
Then the three-dimensional virtual human is accordingly moved to the left.
The head-mounted display apparatus that the present embodiment is proposed, by obtaining head-mounted display apparatus present position；According to
The head-mounted display apparatus present position, obtains the three-dimensional week back street of the head-mounted display apparatus present position
Scape；Three-dimensional virtual human corresponding with the head-mounted display apparatus is built, the three-dimensional virtual human is dissolved into the three-dimensional week
In the scape of back street.The present embodiment automatic identification three-dimensional periphery streetscape, and the visual human of structure incorporated into the three-dimensional periphery streetscape,
Provide the user more immersion and with interactive experience.
As shown in figure 9, Fig. 9 is the high-level schematic functional block diagram of current location acquisition module described in Fig. 8, implement first
On the basis of example, the streetscape acquisition module 20 includes：
Collecting unit 21, for the solid of collection periphery streetscape to be complete in advance under different viewing angles using double full-view cameras
Scape image pair；
Memory cell 22, the streetscape data for the stereoscopic panoramic image pair and correspondence visual angle to be stored in setting in advance
In storehouse；
Call unit 23, if during for getting the head-mounted display apparatus present position in setting range,
Then accordingly recall the stereoscopic panoramic image pair in the street view database.
The collecting unit 21 of head-mounted display apparatus is using double full-view cameras in two different viewpoints and different
The stereoscopic panoramic image pair of periphery streetscape is gathered under visual angle in advance, in the present embodiment, the full-view camera is preferably flake
Camera, the visual angle is including height, direction and the angle of pitch etc..
The memory cell 22 of head-mounted display apparatus is by shape between the stereoscopic panoramic image pair for collecting and visual angle
Into mapping relations one by one, and accumulate visual angle mapping table；The stereoscopic panoramic image pair and the visual angle mapping table are protected in advance
In the presence of in the street view database of setting.
If the call unit 23 of head-mounted display apparatus gets the head-mounted display apparatus present position and is setting
Determine when in scope, then detect the head-mounted display apparatus current visual angle, the visual angle in the street view database is reflected
Firing table, recalls the stereoscopic panoramic image pair corresponding with head-mounted display apparatus current visual angle.
The head-mounted display apparatus that the present embodiment is proposed, week is gathered using double full-view cameras in advance under different viewing angles
The stereoscopic panoramic image pair of back street scape；The stereoscopic panoramic image pair and correspondence visual angle are stored in the streetscape data of setting in advance
In storehouse；If get the head-mounted display apparatus present position in setting range, the streetscape is accordingly recalled
The stereoscopic panoramic image pair in database.The present embodiment recalls periphery streetscape three-dimensional panorama view automatically, provides the user
More immersion and with interactive experience.
With further reference to Fig. 8, if the streetscape acquisition module 20 be additionally operable to recognize the head-mounted display apparatus it is current
When position is more than the distance threshold for setting, then groups of building display pattern is opened, show the building of the three-dimensional periphery streetscape
Group.
If the streetscape acquisition module 20 of head-mounted display apparatus recognizes distance threshold of the present position more than setting
When, i.e., described head-mounted display apparatus apart from the periphery streetscape farther out when, then open groups of building display pattern, display described three
The groups of building of periphery streetscape are tieed up, so as to by way of watching groups of building birds-eye view, make user have a guide look of the three-dimensional periphery streetscape
Panorama.
The head-mounted display apparatus that the present embodiment is proposed, if it is big to recognize the head-mounted display apparatus present position
When the distance threshold of setting, then groups of building display pattern is opened, the groups of building of the three-dimensional periphery streetscape are shown, so as to use
Family understands rapidly the panorama of periphery streetscape, provides the user more immersion and with interactive experience.
With further reference to Fig. 8, if the streetscape acquisition module 20 is additionally operable to recognize the head-mounted display apparatus and is less than
Or during equal to the distance threshold for setting, then retail shop's display pattern is opened, show the retail shop of the three-dimensional periphery streetscape.
If the streetscape acquisition module 20 of head-mounted display apparatus recognize present position less than or equal to setting away from
During from threshold value, i.e., described head-mounted display apparatus apart from the periphery streetscape it is nearer when, then open retail shop display pattern, show institute
The retail shop of three-dimensional periphery streetscape is stated, so that user obtains rapidly the details of periphery solid shop.
The head-mounted display apparatus that the present embodiment is proposed, if recognizing the head-mounted display apparatus less than or equal to setting
Distance threshold when, then open retail shop display pattern, the retail shop of the three-dimensional periphery streetscape is shown, so that user obtains rapidly
The details of periphery solid shop, provide the user more immersion and with interactive experience.
As shown in Figure 10, Figure 10 is the high-level schematic functional block diagram that module is incorporated described in Fig. 8, on the basis of first embodiment
On, the module that incorporates includes：
Capture unit 31, for using motion capture technology, catches the movement locus of the head-mounted display apparatus, catches
Unit 31 includes helmet positioner 11 and device for positioning handle 22；
Unit 32 is set up, for setting up the fantasy sport side with the movement locus maps mutually for the three-dimensional virtual human
To.
The capture unit 31 of head-mounted display apparatus uses motion capture technology, and movement locus is caught, first profit
The head-mounted display apparatus for extracting motion are combined with background subtraction and frame differential method, wherein, frame differential method
It is the moving region that the stereoscopic panoramic image centering is extracted using being made the difference between adjacent two field picture in image sequence.First
By the correction of number two field picture in the same coordinate system, then the two images by same background not in the same time carry out calculus of differences, ash
The background parts that degree does not change are subtracted, because position of the head-mounted display apparatus in adjacent two frame is different, and
With background gray scale difference, two frames protrude the head-mounted display apparatus to come after subtracting each other, so as to substantially determine the head
Wear position of the formula display device in the stereoscopic panoramic image pair.Background subtraction is using image sequence and refers to background mould
Type subtracts each other realizes the target object detection.Background subtraction can provide more complete characteristic so as to extract
Head-mounted display apparatus are stated, but its dynamic scene change caused to illumination and external condition is excessively sensitive, in uncontrolled feelings portion
Under need to add background image update mechanism, and be not intended to and scape cam movement of enjoying a double blessing, or background grey scale change is larger
Situation.The head-mounted display apparatus are tracked using SIFT algorithms to the target object after again.Its main thought is to build
Vertical object library, by the stereoscopic panoramic image to the first frame in the head-mounted display apparatus extract, carry out SIFT changes
Property data base is stored in target database after changing, each database include target label, center-of-mass coordinate, coordinates of targets block with
And SIFT information.Each clarification of objective information includes feature point coordinates, characteristic vector and the corresponding retention of characteristic vector again
Priority.Then with object library as intermediary, matched with target SIFT feature information in the second frame, found the pass of front and rear two frame
Connection property, determines the position and track of the target object, then using target in storehouse and the matching relationship of the second frame target, uses
Specific policy updates, eliminates object library information.Subsequent frame is processed by intermediary's continuation of object library again afterwards.SIFT algorithms
It is divided into matching and updates two processes.The matching probability that matching process passes through two objects feature, finds out front and rear two frames identical
Target, is associated to target.Renewal process is then that object library is supplemented and updated on the basis of matching, it is ensured that target
Storehouse information keeps similitude with a few frame targets recently, to ensure the correctness of identification.
Head-mounted display apparatus set up unit 32 according to the movement locus for catching, and are the three-dimensional virtual human is set up and institute
The fantasy sport direction of movement locus maps mutually is stated, if the head-mounted display apparatus are moved, the three-dimensional virtual human then exists
It is corresponding in the three-dimensional periphery streetscape to realize that streetscape is roamed；And chosen in the retail shop of the three-dimensional periphery streetscape and try out all kinds of
Commodity, if after choosing favorite commodity, virtual shopping cart is added by scanning after the Quick Response Code on the commodity, go forward side by side
One step realizes online payment.
The head-mounted display apparatus that the present embodiment is proposed, using motion capture technology, catch the head-mounted display apparatus
Movement locus；For the three-dimensional virtual human sets up the fantasy sport direction with the movement locus maps mutually, so that user
Favorite commodity are chosen rapidly, more immersion is provided the user and with interactive experience.
The preferred embodiments of the present invention are these are only, the scope of the claims of the invention is not thereby limited, it is every to utilize this hair
Equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of streetscape implementation method based on virtual reality, it is characterised in that the streetscape realization side based on virtual reality
Method includes step：
Obtain head-mounted display apparatus present position；
According to the head-mounted display apparatus present position, the three of the head-mounted display apparatus present position are obtained
Dimension periphery streetscape；
Three-dimensional virtual human corresponding with the head-mounted display apparatus is built, the three-dimensional virtual human is dissolved into the three-dimensional week
In the scape of back street.
2. the streetscape implementation method of virtual reality is based on as claimed in claim 1, it is characterised in that worn described in the basis
The step of formula display device present position, three-dimensional periphery streetscape of the acquisition head-mounted display apparatus present position
Including：
Gather the stereoscopic panoramic image pair of periphery streetscape in advance under different viewing angles using double full-view cameras；
The stereoscopic panoramic image pair and correspondence visual angle are stored in the street view database of setting in advance；
If get the head-mounted display apparatus present position in setting range, the streetscape number is accordingly recalled
According to the stereoscopic panoramic image pair in storehouse.
3. the streetscape implementation method of virtual reality is based on as claimed in claim 1, it is characterised in that worn described in the basis
The step of formula display device present position, three-dimensional periphery streetscape of the acquisition head-mounted display apparatus present position
Including：
If recognize the head-mounted display apparatus present position more than the distance threshold for setting, open groups of building and show
Show pattern, show the groups of building of the three-dimensional periphery streetscape.
4. the streetscape implementation method of virtual reality is based on as claimed in claim 1, it is characterised in that worn described in the basis
The step of formula display device present position, three-dimensional periphery streetscape of the acquisition head-mounted display apparatus present position
Including：
If recognize the head-mounted display apparatus less than or equal to the distance threshold for setting, retail shop's display pattern is opened,
Show the retail shop of the three-dimensional periphery streetscape.
5. the streetscape implementation method based on virtual reality as described in any one of Claims 1-4, it is characterised in that it is described will
The step that the three-dimensional virtual human is dissolved into the three-dimensional periphery streetscape includes：
Using motion capture technology, the movement locus of the head-mounted display apparatus is caught；
For the three-dimensional virtual human sets up the fantasy sport direction with the movement locus maps mutually.
6. a kind of streetscape of virtual reality realizes device, it is characterised in that the headset equipment based on virtual reality includes
Virtual implementing helmet, helmet positioner, device for positioning handle, virtual reality handle and processor, wherein being divided into according to function：
Current location acquisition device, for obtaining head-mounted display apparatus present position, the current location acquisition device
It is integrated in the virtual implementing helmet；
Streetscape acquisition device, for according to the head-mounted display apparatus present position, the acquisition wear-type to show and sets
The three-dimensional periphery streetscape of standby present position；
Device is incorporated, for building three-dimensional virtual human corresponding with the head-mounted display apparatus, the three-dimensional virtual human is melted
Enter in the three-dimensional periphery streetscape, the device that incorporates includes the virtual implementing helmet.
7. the streetscape based on virtual reality as claimed in claim 6 realizes device, it is characterised in that the streetscape acquisition device
Including：
Collecting unit, the stereoscopic panoramic image for gathering periphery streetscape in advance under different viewing angles using double full-view cameras
It is right；
Memory cell, for the stereoscopic panoramic image pair and correspondence visual angle to be stored in the street view database of setting in advance；
Call unit, it is during for getting the head-mounted display apparatus present position in setting range, then corresponding to adjust
The stereoscopic panoramic image pair gone out in the street view database.
8. the streetscape based on virtual reality as claimed in claim 6 realizes device, it is characterised in that the streetscape acquisition device
If be additionally operable to recognize the head-mounted display apparatus present position more than the distance threshold for setting, groups of building are opened
Display pattern, shows the groups of building of the three-dimensional periphery streetscape.
9. the streetscape based on virtual reality as claimed in claim 6 realizes device, it is characterised in that the streetscape acquisition device
If be additionally operable to recognize the head-mounted display apparatus less than or equal to the distance threshold for setting, retail shop's display mould is opened
Formula, shows the retail shop of the three-dimensional periphery streetscape.
10. the streetscape based on virtual reality as described in any one of claim 6 to 9 realizes device, it is characterised in that described to melt
Entering device includes：
Capture unit, for using motion capture technology, catches the movement locus of the head-mounted display apparatus, the seizure list
Unit includes the helmet positioner and the device for positioning handle；
Unit is set up, for setting up the fantasy sport direction with the movement locus maps mutually for the three-dimensional virtual human.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611209993.9A CN106774910A (en) | 2016-12-24 | 2016-12-24 | Streetscape implementation method and device based on virtual reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611209993.9A CN106774910A (en) | 2016-12-24 | 2016-12-24 | Streetscape implementation method and device based on virtual reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106774910A true CN106774910A (en) | 2017-05-31 |
Family
ID=58920314
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611209993.9A Pending CN106774910A (en) | 2016-12-24 | 2016-12-24 | Streetscape implementation method and device based on virtual reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106774910A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107391546A (en) * | 2017-06-01 | 2017-11-24 | 浙江唯见科技有限公司 | The fully associative method and system of VR resources |
| CN108364353A (en) * | 2017-12-27 | 2018-08-03 | 广东鸿威国际会展集团有限公司 | The system and method for guiding viewer to watch the three-dimensional live TV stream of scene |
| CN109032344A (en) * | 2018-07-04 | 2018-12-18 | Oppo（重庆）智能科技有限公司 | Location processing method and Related product |
| CN109151517A (en) * | 2017-06-27 | 2019-01-04 | 中兴通讯股份有限公司 | Shopping centre interactive approach, device, system, storage medium and computer equipment |
| CN110019583A (en) * | 2017-08-29 | 2019-07-16 | 深圳市掌网科技股份有限公司 | A kind of environment methods of exhibiting and system based on virtual reality |
| CN114185437A (en) * | 2021-12-16 | 2022-03-15 | 浙江小族智能科技有限公司 | Method and device for interaction between amusement vehicle and real scene, storage medium and terminal |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103345357A (en) * | 2013-07-31 | 2013-10-09 | 关鸿亮 | Method for realizing automatic street view display based on mobile equipment sensor |
| CN104050177A (en) * | 2013-03-13 | 2014-09-17 | 腾讯科技（深圳）有限公司 | Street view generation method and server |
| CN104199944A (en) * | 2014-09-10 | 2014-12-10 | 重庆邮电大学 | Method and device for achieving street view exhibition |
| US20150268473A1 (en) * | 2014-03-18 | 2015-09-24 | Seiko Epson Corporation | Head-mounted display device, control method for head-mounted display device, and computer program |
-
2016
- 2016-12-24 CN CN201611209993.9A patent/CN106774910A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104050177A (en) * | 2013-03-13 | 2014-09-17 | 腾讯科技（深圳）有限公司 | Street view generation method and server |
| CN103345357A (en) * | 2013-07-31 | 2013-10-09 | 关鸿亮 | Method for realizing automatic street view display based on mobile equipment sensor |
| US20150268473A1 (en) * | 2014-03-18 | 2015-09-24 | Seiko Epson Corporation | Head-mounted display device, control method for head-mounted display device, and computer program |
| CN104199944A (en) * | 2014-09-10 | 2014-12-10 | 重庆邮电大学 | Method and device for achieving street view exhibition |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107391546A (en) * | 2017-06-01 | 2017-11-24 | 浙江唯见科技有限公司 | The fully associative method and system of VR resources |
| CN107391546B (en) * | 2017-06-01 | 2020-07-07 | 浙江唯见科技有限公司 | Method and system for full association of VR resources |
| CN109151517A (en) * | 2017-06-27 | 2019-01-04 | 中兴通讯股份有限公司 | Shopping centre interactive approach, device, system, storage medium and computer equipment |
| CN110019583A (en) * | 2017-08-29 | 2019-07-16 | 深圳市掌网科技股份有限公司 | A kind of environment methods of exhibiting and system based on virtual reality |
| CN110019583B (en) * | 2017-08-29 | 2021-01-05 | 深圳市掌网科技股份有限公司 | Environment display method and system based on virtual reality |
| CN108364353A (en) * | 2017-12-27 | 2018-08-03 | 广东鸿威国际会展集团有限公司 | The system and method for guiding viewer to watch the three-dimensional live TV stream of scene |
| CN109032344A (en) * | 2018-07-04 | 2018-12-18 | Oppo（重庆）智能科技有限公司 | Location processing method and Related product |
| CN114185437A (en) * | 2021-12-16 | 2022-03-15 | 浙江小族智能科技有限公司 | Method and device for interaction between amusement vehicle and real scene, storage medium and terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106774910A (en) | Streetscape implementation method and device based on virtual reality | |
| CN106251399B (en) | A kind of outdoor scene three-dimensional rebuilding method and implementing device based on lsd-slam | |
| CN103514432B (en) | Face feature extraction method, equipment and computer program product | |
| US11748907B2 (en) | Object pose estimation in visual data | |
| CN110245552B (en) | Interactive processing method, device, equipment and client for vehicle damage image shooting | |
| US20230419438A1 (en) | Extraction of standardized images from a single-view or multi-view capture | |
| CN109453517B (en) | Virtual character control method and device, storage medium and mobile terminal | |
| CN106709436A (en) | Cross-camera suspicious pedestrian target tracking system for rail transit panoramic monitoring | |
| CN106896925A (en) | The device that a kind of virtual reality is merged with real scene | |
| CN108351522A (en) | Direction of gaze maps | |
| CN106210538A (en) | Show method and apparatus and the program of image based on light field on a user device | |
| CN107230187A (en) | The method and apparatus of multimedia signal processing | |
| CN110853073A (en) | Method, device, equipment and system for determining attention point and information processing method | |
| CN110553648A (en) | method and system for indoor navigation | |
| KR20150082379A (en) | Fast initialization for monocular visual slam | |
| CN104363377B (en) | Display methods, device and the terminal of focus frame | |
| CN110858414A (en) | Image processing method and device, readable storage medium and augmented reality system | |
| JP6985897B2 (en) | Information processing equipment and its control method, program | |
| CN112207821B (en) | Target searching method of visual robot and robot | |
| CN110675426B (en) | Human body tracking method, device, equipment and storage medium | |
| CN116824533A (en) | Remote small target point cloud data characteristic enhancement method based on attention mechanism | |
| Zheng et al. | A study of 3D feature tracking and localization using a stereo vision system | |
| CN116416291A (en) | Electronic fence automatic generation method, real-time detection method and device | |
| CN112932910A (en) | Wearable intelligent sensing blind guiding system | |
| EP4040268A1 (en) | Object sharing method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |