CN109002162A - Method for changing scenes, device, terminal and computer storage medium - Google Patents
Method for changing scenes, device, terminal and computer storage medium Download PDFInfo
- Publication number
- CN109002162A CN109002162A CN201810643987.7A CN201810643987A CN109002162A CN 109002162 A CN109002162 A CN 109002162A CN 201810643987 A CN201810643987 A CN 201810643987A CN 109002162 A CN109002162 A CN 109002162A
- Authority
- CN
- China
- Prior art keywords
- terminal
- image
- reference position
- display area
- pose
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/61—Scene description
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/20—Indexing scheme for editing of 3D models
- G06T2219/2016—Rotation, translation, scaling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/20—Indexing scheme for editing of 3D models
- G06T2219/2024—Style variation
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Architecture (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention provides a kind of method for changing scenes, device, terminal and computer storage medium, this method comprises: the image display area in first terminal shows the camera of the first terminal collected actual scene image in real time;Spatial reference position is determined in the space coordinates of actual scene;In the target pixel location Overlapping display pre-set image of image display area, target pixel location is spatial reference position respective pixel position in image display area, the spatial position of pre-set image is fixed with respect to actual scene image, and presets the display area of scene in pre-set image comprising showing;Monitor pose of the first terminal relative to spatial reference position;According to the position of first terminal, the Dynamically Announce target scene in the image display area of first terminal.This method can realize further interacting for practical true environment and dummy object.
Description
Technical field
This application involves augmented reality fields, more particularly to a kind of method for changing scenes, device, terminal and calculating
Machine storage medium.
Background technique
With the development of augmented reality (Augmented Reality, abbreviation AR) technology, using the wearable eye of AR technology
Mirror is applied in more and more fields, for example, doctor implements operation using wearable AR glasses, player utilizes wearable AR
Glasses carry out game etc..
Due to wearable AR glasses portability poor (for example, wearable AR glasses are heavy) etc., AR technology is gradually
Be used on the portable terminals such as mobile phone or tablet computer.User can observe true ring on the portable mobile termianl
The picture in border and the superposition of virtual object.Such as user open mobile phone on AR function when, the camera of mobile phone is beaten automatically
It opens, user can observe the true environment picture (such as room of user) that mobile phone camera takes on mobile phone interface, together
When, dummy object (such as a sofa) to be added is needed in mobile phone interface selection, and the object is placed on mobile phone interface
On some position on shown true environment picture (such as southeast corner), what user can see on mobile phone interface
The picture (such as picture of one sofa of southeast corner position placement in room) of true environment picture and the dummy object of addition.
When user's cell phone, dummy object does not change relative to the position of real scene.
But existing portable mobile termianl is only capable of showing dummy object in true environment based on the realization of AR technology
Function, and can not achieve the function that true environment is further interacted with dummy object.
Summary of the invention
Based on this, it is necessary in view of the above technical problems, provide one kind can be realized true environment and dummy object again into
Method for changing scenes, device, terminal and the computer storage medium of one step interaction.
In a first aspect, the embodiment of the present invention provides a kind of method for changing scenes, which comprises
The camera of the first terminal collected actual scene in real time is shown in the image display area of first terminal
Image;
Spatial reference position is determined in the space coordinates of the actual scene;
Target pixel location Overlapping display pre-set image in described image display area, the target pixel location are institute
Spatial reference position respective pixel position in described image display area is stated, the spatial position of the pre-set image is relatively described
Actual scene image is fixed, and presets the display area of scene in the pre-set image comprising showing;
Pose of the first terminal relative to the spatial reference position is monitored, the pose includes the first terminal
Posture information and the spatial position relative to the spatial reference position;
According to the pose of the first terminal, the Dynamically Announce target field in the image display area of the first terminal
Scape, the target scene include default scene and/or the first terminal collected actual scene in real time.
Second aspect, the embodiment of the present invention provide a kind of method for changing scenes, which comprises
Receive the pose, described of spatial reference position, the first terminal that first terminal is sent relative to reference position
The camera acquired image of first terminal, the reference position are that Overlapping display is pre- in the image display area of first terminal
If the corresponding spatial position of pixel on picture position;
Obtain the camera acquired image of second terminal;
Camera according to the camera acquired image of the second terminal and the first terminal is collected
Image determines rotation and translation of the second terminal relative to the first terminal, the camera acquisition of the first terminal
To image and the camera acquired image of the second terminal have intersection;
Described in being sent according to the second terminal relative to the rotation and translation of the first terminal, the first terminal
The pose of spatial reference position, the first terminal relative to the spatial reference position, determine the second terminal relative to
Pose between spatial reference position;
The pre-set image is persistently adjusted according to the pose;
If the pose meets third preset condition, the display area Dynamically Announce in the pre-set image presets field
Scape, the third preset condition include at least: the pose does not pass through the spatial reference position.
The third aspect, the embodiment of the present invention provide a kind of device for changing scenes, and described device includes:
Acquisition module is used for, and shows that the camera of the first terminal is adopted in real time in the image display area of first terminal
The actual scene image collected;
Determining module, for determining spatial reference position in the space coordinates of the actual scene;
First display module, for the target pixel location Overlapping display pre-set image in described image display area, institute
Stating target pixel location is spatial reference position respective pixel position in described image display area, the pre-set image
The relatively described actual scene image in spatial position fix, comprising showing the display area of default scene in the pre-set image;
Monitoring modular, for continuing to monitor pose of the first terminal relative to the spatial reference position, institute's rheme
Appearance includes the first terminal posture information and the spatial position relative to the spatial reference position;
Second display module, for the pose according to the first terminal, in the image display area of the first terminal
Interior Dynamically Announce target scene, the target scene include default scene and/or the first terminal collected reality in real time
Scene.
Fourth aspect, the embodiment of the present invention provide a kind of device for changing scenes, and described device includes:
Receiving module, the spatial reference position, the first terminal for receiving first terminal transmission are relative to the sky
Between the pose of reference position, the first terminal camera acquired image, the spatial reference position is first terminal
Image display area in the corresponding spatial position of pixel on Overlapping display pre-set image position;
Module is obtained, for obtaining the camera acquired image of second terminal;
First determining module, for according to the second terminal camera acquired image and the first terminal
Camera acquired image, determine rotation and translation of the second terminal relative to the first terminal, described first
The camera acquired image of terminal and the camera acquired image of the second terminal have intersection;
Second determining module, for the rotation and translation, described according to the second terminal relative to the first terminal
Pose of the spatial reference position, the first terminal that first terminal is sent relative to the spatial reference position, determines
The second terminal is relative to the pose between spatial reference position;
Module is adjusted, for persistently adjusting the pre-set image according to the pose;
Display module, if meeting third preset condition for the pose, the display area in the pre-set image is dynamic
State shows that default scene, the third preset condition include at least: the pose does not pass through the spatial reference position.
5th aspect, the embodiment of the present invention mention a kind of computer equipment, including memory and processor, and the memory is deposited
Computer program is contained, the processor performs the steps of when executing the computer program
The camera of the first terminal collected actual scene in real time is shown in the image display area of first terminal
Image;
Spatial reference position is determined in the space coordinates of the actual scene;
Target pixel location Overlapping display pre-set image in described image display area, the target pixel location are institute
Spatial reference position respective pixel position in described image display area is stated, the spatial position of the pre-set image is relatively described
Actual scene image is fixed, and presets the display area of scene in the pre-set image comprising showing;
Pose of the first terminal relative to reference position is monitored, the pose includes the first terminal posture information
With the spatial position relative to the reference position;
According to the pose of the first terminal, the Dynamically Announce target field in the image display area of the first terminal
Scape, the target scene include default scene and/or the first terminal collected actual scene in real time.
6th aspect, the embodiment of the present invention mention a kind of computer equipment, including memory and processor, and the memory is deposited
Computer program is contained, the processor performs the steps of when executing the computer program
Receive the position of the spatial reference position, the first terminal of first terminal transmission relative to the spatial reference position
Appearance, the camera acquired image of the first terminal, the spatial reference position are the image display area of first terminal
The corresponding spatial position of pixel on middle Overlapping display pre-set image position;
Obtain the camera acquired image of second terminal;
Camera according to the camera acquired image of the second terminal and the first terminal is collected
Image determines rotation and translation of the second terminal relative to the first terminal, the camera acquisition of the first terminal
To image and the camera acquired image of the second terminal have intersection;
Described in being sent according to the second terminal relative to the rotation and translation of the first terminal, the first terminal
The pose of spatial reference position, the first terminal relative to the spatial reference position, determine the second terminal relative to
Pose between spatial reference position;
The pre-set image is persistently adjusted according to the pose;
If the pose meets third preset condition, the display area Dynamically Announce in the pre-set image presets field
Scape, the third preset condition include at least: the pose does not pass through the spatial reference position.
7th aspect, the embodiment of the present invention mention a kind of computer readable storage medium, are stored thereon with computer program, institute
It states when computer program is executed by processor and performs the steps of
The camera of the first terminal collected actual scene in real time is shown in the image display area of first terminal
Image;
Spatial reference position is determined in the space coordinates of the actual scene;
Target pixel location Overlapping display pre-set image in described image display area, the target pixel location are institute
Spatial reference position respective pixel position in described image display area is stated, the spatial position of the pre-set image is relatively described
Actual scene image is fixed, and presets the display area of scene in the pre-set image comprising showing;
Pose of the first terminal relative to the spatial reference position is monitored, the pose includes the first terminal
Posture information and the spatial position relative to the spatial reference position;
According to the pose of the first terminal, the Dynamically Announce target field in the image display area of the first terminal
Scape, the target scene include default scene and/or the first terminal collected actual scene in real time.
Eighth aspect, the embodiment of the present invention mention a kind of computer readable storage medium, are stored thereon with computer program, institute
It states and performs the steps of the spatial reference position for receiving first terminal and sending, described the when computer program is executed by processor
One terminal is relative to the pose of the spatial reference position, the camera acquired image of the first terminal, the space
Reference position is the corresponding spatial position of pixel in the image display area of first terminal on Overlapping display pre-set image position;
Obtain the camera acquired image of second terminal;
Camera according to the camera acquired image of the second terminal and the first terminal is collected
Image determines rotation and translation of the second terminal relative to the first terminal, the camera acquisition of the first terminal
To image and the camera acquired image of the second terminal have intersection;
Described in being sent according to the second terminal relative to the rotation and translation of the first terminal, the first terminal
The pose of spatial reference position, the first terminal relative to the spatial reference position, determine the second terminal relative to
Pose between spatial reference position;
The pre-set image is persistently adjusted according to the pose;
If the pose meets third preset condition, the display area Dynamically Announce in the pre-set image presets field
Scape, the third preset condition include at least: the pose does not pass through the spatial reference position.
Above-mentioned method for changing scenes, device, computer equipment and storage medium, first terminal is first in image display area
Middle display camera collected actual scene image, and the determining georeferencing position in the space coordinates of actual scene in real time
It sets, then in the target pixel location Overlapping display pre-set image of image display area, to realize the image in first terminal
Actual scene image and pre-set image are shown in display area.Further, monitoring first terminal is relative to spatial reference position
Pose, and according to the pose of first terminal in the image display area of first terminal Dynamically Announce target scene, wherein mesh
Marking scene includes default scene and/or actual scene.Since first terminal provided by the present application can join according to it relative to space
The pose for examining position shows different target scenes in image display area, therefore, scene switching side provided in this embodiment
Method can realize further interacting for true environment and dummy object.More further, second terminal can be according to first terminal phase
Translation and rotation relative to first terminal of pose, second terminal for spatial reference position, it may be determined that go out itself relative to
The pose of spatial reference position, while first terminal also can determine itself pose relative to spatial reference position, the two all may be used
Corresponding image, the i.e. image in second terminal and first terminal are shown in the image display area of itself according to the pose of itself
Display area can all show actual scene image, in pre-set image and pre-set image Dynamically Announce default scene image, from
And reach the visual effect that first terminal is in the same scene with second terminal, therefore, scene provided in this embodiment is cut
The method of changing can realize further interacting for same true environment and same dummy object in multiple terminals.
Detailed description of the invention
Fig. 1 is a kind of flow diagram of method for changing scenes provided in an embodiment of the present invention;
Fig. 2 is a kind of schematic diagram of space coordinates provided in an embodiment of the present invention;
Fig. 3 is a kind of image schematic diagram that the image display area of first terminal is shown provided in an embodiment of the present invention;
Fig. 4 is a kind of flow diagram that spatial reference position is determined in space coordinates of the embodiment of the present invention;
Fig. 5 is a kind of method flow schematic diagram of Overlapping display pre-set image provided in an embodiment of the present invention;
Fig. 6 is the flow diagram of another method for changing scenes provided in an embodiment of the present invention;
Fig. 7 is the flow diagram of another method for changing scenes provided in an embodiment of the present invention;
Fig. 8 is a kind of structural schematic diagram of device for changing scenes provided in an embodiment of the present invention;
Fig. 9 is the structural schematic diagram of another device for changing scenes provided in an embodiment of the present invention;
Figure 10 is the structural schematic diagram of another device for changing scenes provided in an embodiment of the present invention;
Figure 11 is the structural schematic diagram of another device for changing scenes provided in an embodiment of the present invention;
Figure 12 is the structural schematic diagram of another device for changing scenes provided in an embodiment of the present invention.
Specific embodiment
Augmented reality (Augmented Reality, abbreviation AR) technology is a kind of position for calculating camera image in real time
It sets and angle and plus the technology of respective image, video, 3D model, the target of this technology is true environment and virtual
Object is added to the same picture in real time or space exists simultaneously.Since AR technology can combine true environment and dummy object
Feature, therefore, AR technology is applied in more and more fields.For example, applying in urban construction planning, AR can be used
Technology will be planned in effect superposition real scene, to directly obtain the effect etc. of planning.
Currently, user can wear AR glasses or the AR helmet etc., experience AR technology, can also by portable terminal (such as
Mobile phone or tablet computer etc.), experience AR technology.But since wearable AR glasses and AR helmet portability are poor and portable
The computing capability of terminal is constantly promoted, and therefore, portable terminal is increasingly becoming the carrier of AR technology, to realize user portable
The picture of true environment and virtual object superposition is observed on mobile terminal.Such as in teaching process, by portable
The AR function of mobile terminal can be chosen different observation objects (i.e. dummy object, such as various animals), and by the observation of selection
Object is placed in the true classroom shown on portable terminal (i.e. true environment), so that student is more by AR technology
Add true study observation object.But existing portable mobile termianl is only capable of realizing based on AR technology in true environment
The function of upper display dummy object, and the problem of can not achieve the function that true environment is further interacted with dummy object.This
Method for changing scenes, device, terminal and the computer storage medium that application provides aim to solve the problem that the technology as above of traditional technology is asked
Topic.
It should be noted that the executing subject of following methods embodiment can be the various terminals comprising camera, such as
Mobile phone, AR glasses, the AR helmet, tablet computer, notebook etc., the application is it is not limited here.
It is with reference to the accompanying drawings and embodiments, right in order to which the objects, technical solutions and advantages of the application are more clearly understood
The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, not
For limiting the application.
Fig. 1 be a kind of flow diagram of method for changing scenes provided in an embodiment of the present invention, the present embodiment what is involved is
First terminal shows the process of actual scene image and display pre-set image, this method comprises:
S101, the camera of the first terminal collected reality in real time is shown in the image display area of first terminal
Scene image.
Specifically, above-mentioned first terminal is the executing subject of this method embodiment, it can to include each of camera
Kind terminal, such as mobile phone etc..The image display area of above-mentioned first terminal is the display screen area of first terminal, such as,
When first terminal is mobile phone, the image display area of first terminal is the display screen area of mobile phone.Above-mentioned first terminal
Camera is usually the rear camera of first terminal.Above-mentioned actual scene image is the figure of actual environment locating for first terminal
Picture.
S102, spatial reference position is determined in the space coordinates of the actual scene.
Specifically, above-mentioned space coordinates refer to the world coordinate system of actual scene locating for first terminal.It is optional
, as shown in Fig. 2, the origin of above-mentioned space coordinates can be the reference of any one in actual scene locating for first terminal
Point (such as the center on the ground in room locating for first terminal), Y-axis are between first terminal and the origin of space coordinates
Horizontal line on axis, using towards the direction of first terminal as positive direction.X-axis be with Y-axis vertical axis in the horizontal plane,
And using the right-hand direction towards first terminal as positive direction.Z axis is the horizontal plane perpendicular to X-axis and Y-axis, meets at the axis of origin
Line, and using direction upward as positive direction.
Above-mentioned spatial reference position can be any point in above-mentioned space coordinates, be indicated with (x, y, z).Example
Such as, above-mentioned spatial reference position can also be the origin of above-mentioned space coordinates, i.e. spatial reference position is (0,0,0).In addition,
Spatial reference position once it is determined that after, no longer change.Further alternative, spatial reference position can be a predeterminated position, example
Ground such as at 1m immediately ahead of first terminal a, or spatial position of user's triggering.
It should be noted that the selection of definition and spatial reference position for space coordinates is only in the present embodiment
It is only a kind of example, the present invention does not limit the definition mode of space coordinates and the selection mode of spatial reference position
It is fixed, as long as a spatial reference position can be determined in the world coordinate system of actual scene locating for first terminal.
S103, the target pixel location Overlapping display pre-set image in described image display area, the object pixel position
It is set to spatial reference position respective pixel position in described image display area, the spatial position phase of the pre-set image
The actual scene image is fixed, presets the display area of scene in the default scene comprising showing.
Specifically, above-mentioned pre-set image can be 2D image, or 3D model.Optionally, can appoint for one
" door " of the 2D or 3D of shape of anticipating, the window of the 2D or 3D of arbitrary shape, other objects of 2D or 3D of arbitrary shape etc..It is optional
, display scale of the above-mentioned pre-set image in the image display area of first terminal can manually adjust, for example, user is manual
Processing is zoomed in and out to pre-set image.In addition, including the region that can show other images in above-mentioned pre-set image.
The spatial position of above-mentioned pre-set image refers to that pre-set image is fixed on reality relative to the fixation of actual scene image
At a certain position in the scene image of border, when the pose of first terminal changes, visually the image of first terminal is aobvious
Show that the pre-set image shown in region remains at the above-mentioned a certain position in actual scene image.On it should be noted that
Region comprising other images of display in the pre-set image stated.
Above-mentioned target pixel location is one on the actual scene image shown in the image display area of first terminal
A location of pixels, and when the location of pixels is mapped in actual scene, it is above-mentioned spatial reference position.For example, when above-mentioned
Spatial reference position is the ground center in room locating for first terminal, and above-mentioned target pixel location is, first terminal
The corresponding location of pixels in ground center in the room shown in image display area.
In a kind of example, the above-mentioned target pixel location Overlapping display pre-set image in image display area it is specific
Implementation can use existing AR technology, specific: show that first is whole first in the image display area of first terminal
Then the actual scene image that the camera at end acquires in real time shows pre-set image in target pixel location, and by pre-set image
It is shown on actual scene image, using visual effect of the target pixel location as pre-set image for reaching actual scene image.
Optionally, be based on above-mentioned space coordinates shown in Fig. 2, the horizontal line of pre-set image can show X-axis on straight line, i.e.,
It is that user can observe the front of pre-set image in the image display area of first terminal in visual effect.It needs to illustrate
It is that the application does not limit the specific implementation of the target pixel location Overlapping display pre-set image in image display area
It is fixed, as long as being able to achieve visual effect described herein.
The pose of S104, the monitoring first terminal relative to spatial reference position, the pose include described first whole
Hold the posture information relative to the spatial reference position and spatial position.
Specifically, above-mentioned pose includes the posture information of first terminal and the space bit relative to spatial reference position
It sets, wherein the rotation angle of posture information, that is, first terminal of first terminal three change in coordinate axis direction in three-dimensional system of coordinate, it can
With but be not limited only to be obtained according to the Inertial Measurement Unit IMU information in first terminal.First is obtained eventually furthermore according to IMU information
End rotation angle of three reference axis in space coordinates belongs to traditional technology, repeats no more to this.
It in one embodiment, can be according to camera coordinate system and world coordinates in image coordinate system, first terminal
Conversion between system obtains spatial position of the first terminal relative to spatial reference position.It in another embodiment, can also be with
The actual scene image and related algorithm collected according to camera in first terminal obtains first terminal relative to space
The spatial position of reference position.It should be noted that any spatial position that can obtain first terminal relative to reference position
Method, all within protection scope of the present invention.
S105, according to the pose of the first terminal, the Dynamically Announce mesh in the image display area of the first terminal
Scene is marked, the target scene includes default scene and/or the first terminal collected actual scene in real time.
Specifically, that is, first terminal has occurred when first terminal changes relative to the pose of spatial reference position
The variation of position and/or direction, the collected actual scene image of the camera of first terminal can also change therewith therewith,
Simultaneously as spatial reference position does not change, and therefore, the pre-set image shown in the image display area of first terminal,
And the default scene shown in the display area in pre-set image also changes therewith.Based on this, when the first last phase for
When the pose of spatial reference position changes, different target scenes will be shown in the image display area of first terminal.Tool
Body, target scene, which can be the camera collected actual scene in real time of first terminal, to be virtual default field
Scape can also be the combination of actual scene and default scene.
Optionally, when first terminal changes relative to the pose of reference position, it will lead to pre-set image first
Angle and ratio for showing in the image display area of terminal etc. change.Therefore, in order to enable what pre-set image was shown
It is more true, then it needs persistently to adjust pre-set image according to the pose of first terminal, specifically, first terminal is joined relative to space
Examining the pose of position, there are one-to-one relationships with pre-set image, can determine pre-set image according to the one-to-one relationship
Display scale and angle etc., and shown on the corresponding object pixel of spatial reference position.
In one embodiment, when above-mentioned pre-set image is the image of a 2D " door ", in order to enable pre-set image
What is shown is more true, can not pass through georeferencing relative to the pose characterization first terminal of spatial reference position in first terminal
Position includes the pixel of " door " in the image shown in the image display area of first terminal, and first terminal is relative to space
The horizontal distance (can be obtained by first terminal relative to the pose of spatial reference position) of reference position less than a preset threshold,
Such as 0.5m, then the image replacement of " door " that has shown that is shown as to the image of " door " opening, i.e., is shown as pre-set image
Another pre-set image of display mode.
In method for changing scenes provided in this embodiment, first terminal shows camera reality in image display area first
When collected actual scene image, and spatial reference position is determined in the space coordinates of actual scene, then in image
The target pixel location Overlapping display pre-set image of display area is shown in the image display area of first terminal to realize
Actual scene and pre-set image.Further, pose of the monitoring first terminal relative to spatial reference position, and eventually according to first
The pose at end Dynamically Announce target scene in the image display area of first terminal, wherein target scene includes default scene
And/or actual scene.Since first terminal provided by the present application can be according to its pose relative to spatial reference position, in image
Different target scenes is shown in display area, therefore, method for changing scenes provided in this embodiment can realize true environment with
Dummy object further interacts.
Based on above-mentioned S105, when first terminal changes relative to the pose of spatial reference position, first terminal
The target scene shown in image display area is not also identical, specific:
If the pose meets the first preset condition, the display area Dynamically Announce in the pre-set image presets field
Scape, first preset condition include at least: the pose does not pass through the spatial reference position.
Specifically, the display area in above-mentioned pre-set image shows the aobvious of other images for include in pre-set image
Show region.For example, then the display area in above-mentioned pre-set image is " door " frame when pre-set image is the image of one " door "
Interior region.
When the pose of first terminal meets the first preset condition relative to the pose of spatial reference position, then illustrate first
It include the pixel of pre-set image in the image display area of terminal, therefore, when position of the first terminal relative to spatial reference position
When appearance meets the first preset condition, pre-set image is shown at the target pixel location in the image display area of first terminal,
And default scene is shown in the display area of pre-set image, the actual scene figure that camera takes is shown in other regions
Picture, it is specific as shown in Figure 3.In addition, the display scale when pre-set image is corresponded in the display mode of default scene, that is, work as root
When changing according to first terminal relative to the pose of spatial reference position, the variation such as the display scale of pre-set image and angle
When, the display scale of the default scene shown in the display area in pre-set image also changes therewith with angle.
Above-mentioned with origin that spatial reference position is space coordinates shown in Fig. 2, pre-set image is one " door " front
It is illustrated for 3D rendering, the first above-mentioned preset condition refers to spatial position of the first terminal relative to reference position
In, within the scope of the coordinate value of coordinate value Y-axis in the initial spatial location of first terminal of Y-axis is greater than 0.
Above content is after showing pre-set image at object pixel in the image display area based on first terminal, and first eventually
The case where posture information at end does not change.In order to avoid the posture information of first terminal shifts, so that first terminal
Pose relative to spatial reference position does not pass through spatial reference position, and can not obtain in the image display area of first terminal
The case where to pre-set image, therefore, the first above-mentioned preset condition further include: comprising pre- in the image display area of first terminal
If the pixel of image.
Based on above content, when first terminal meets the first preset condition relative to the pose of reference position, characterization the
In the image display area of one terminal include pre-set image pixel, and first terminal relative to spatial reference position pose not
Across spatial reference position, then Overlapping display has default figure in the target pixel location of the image display area of first terminal at this time
Picture, and the display area Dynamically Announce in pre-set image presets scene.Illustratively, when pre-set image is one " door " front
Image, when the display area in above-mentioned pre-set image is the region inside " door " frame, when first terminal posture meets first
When preset condition, the image of " door " frame is shown on the object pixel in the image display area of first terminal, and
A virtual default scene is shown in " door " frame.In visual experience, subscriber station " door " outside, can be seen that in " door " frame
Default scene, see the actual scene of " door " outer frame.
It is pre- described in the image display area Dynamically Announce of the first terminal if the pose meets the second preset condition
If scene, and the collected actual field of camera of the first terminal described in the display area Dynamically Announce in the pre-set image
Scape image, second preset condition include at least: the pose shape passes through the spatial reference position.
Above content is after showing pre-set image at object pixel in the image display area based on first terminal, and first eventually
The direction of rotation of Z axis is 180 degree in the posture information at end, and first terminal is passed through relative to the spatial position of spatial reference position
Spatial reference position, so that the case where can get the pixel of pre-set image in the image display area of first terminal, because
This, the second above-mentioned preset condition further include: include the pixel of pre-set image in the image display area of first terminal.
When the pose of first terminal meets the second preset condition relative to the pose of spatial reference position, then at this time the
Dynamic Overlapping display pre-set image in the target pixel location of the image display area of one terminal, and it is aobvious in pre-set image
Show that region shows the collected actual scene image of camera of first terminal.Illustratively, when pre-set image is one " door "
Positive image, when the display area in above-mentioned pre-set image is the region inside " door " frame, when first terminal posture meets
When the second preset condition, the image of " door " frame is shown on the object pixel in the image display area of first terminal,
And an actual scene image is shown in " door " frame.In visual experience, subscriber station is in " door " the inner direction towards " door "
It sees, can be seen that the actual scene in " door " frame, see the virtual scene of " door " outer frame.
In addition, first terminal relative to spatial reference position pose in addition to meeting above-mentioned the first preset condition and second
Outside preset condition, there is also other situations.For example, it is also possible to include following situation:
Situation 1: when first terminal meets four preset conditions relative to the pose of spatial reference position, described first
Scene is preset described in the image display area Dynamically Announce of terminal, the 4th preset condition is that first terminal is joined relative to space
The pose for examining position passes through spatial reference position, and does not include the picture of the pre-set image in the image display area of first terminal
Element.
Specifically, being one " door " front with origin that spatial reference position is space coordinates shown in Fig. 2, pre-set image
Image for be illustrated, the 4th above-mentioned preset condition refers to space of the first terminal relative to spatial reference position
In position, the coordinate value of Y-axis is less than coordinate value (i.e. 0) range with reference to Y-axis in spatial position, and the image of first terminal is shown
The pixel of the pre-set image is not included in region.
Based on above content, when first terminal posture meets four preset conditions, the image for characterizing first terminal is shown
It does not include the pixel of pre-set image in region, and first terminal is across spatial reference position.Then at this time in the image of first terminal
Display area shows default scene.Illustratively, when pre-set image is " door " positive image, in above-mentioned pre-set image
Display area be " door " frame inside region when, when first terminal posture meet four preset conditions when, the figure of first terminal
As default scene is shown on display area.In visual experience, subscriber station is inner at " door ", the direction other than direction " door "
It sees.
Situation 2: when first terminal meets five preset conditions relative to the pose of reference position, in the first terminal
Image display area Dynamically Announce actual scene, the 5th preset condition be first terminal relative to spatial reference position
Pose shape does not pass through spatial reference position, and does not include the pixel of the pre-set image in the image display area of first terminal.
Specifically, being one " door " front with origin that spatial reference position is space coordinates shown in Fig. 2, pre-set image
Image for be illustrated, the 5th above-mentioned preset condition refers to spatial position of the first terminal relative to reference position
In, the coordinate value of Y-axis is greater than coordinate value (i.e. 0) range of Y-axis in georeferencing spatial position, and first terminal is on Z axis
The angle of rotation makes the pixel for not including pre-set image in the image display area of first terminal.
Based on above content, when first terminal posture meets five preset conditions, the image for characterizing first terminal is shown
It does not include the pixel of pre-set image in region, and first terminal is not across spatial reference position.Then at this time in the figure of first terminal
As display area shows the collected actual scene of camera.Illustratively, when pre-set image be " door " positive image,
When display area in above-mentioned pre-set image is the region inside " door " frame, when first terminal posture meets the 5th preset condition
When, what is shown in the image display area of first terminal is only actual scene.In visual experience, subscriber station " door " outside,
Direction other than towards " door " is seen.
A kind of flow diagram determining spatial reference position in space coordinates as shown in Figure 4, in order to further
Raising first terminal intelligence, then above-mentioned spatial reference position can be determined by user.When user determines above-mentioned space
When reference position, above-mentioned S102 specifically comprises the following steps:
S201, the Inertial Measurement Unit IMU information for obtaining the first terminal in real time, the first terminal camera adopt
The actual scene image collected.
Specifically, above-mentioned actual scene image is identical as the explanation of actual scene image in above-mentioned S101, with
And Inertial Measurement Unit IMU information is identical to the explanation of Inertial Measurement Unit IMU information with above-mentioned S104, herein no longer
It repeats.
S202, it is surveyed according to the collected actual scene image of camera, the inertia of the first terminal got in real time
Nomography is built in amount unit IMU information and positioning, establishes the threedimensional model of three-dimensional space locating for the first terminal, and determine
Spatial position of the first terminal relative to the three-dimensional space.
Specifically, it is usually SLAM algorithm that nomography is built in above-mentioned positioning, naturally it is also possible to can be realized positioning for other
With map structuring algorithm, to this present embodiment and without limitation.Above-mentioned three-dimensional space is actual scene locating for first terminal
Stereoscopic three-dimensional space.By taking SLAM algorithm as an example, by the camera of first terminal collected actual scene image in real time, Yi Jishi
When the IMU information input that gets into SLAM algorithm, will obtain the point cloud chart of three-dimensional space, i.e., above-mentioned threedimensional model,
And first terminal arrives first terminal relative to three-dimensional space relative to the spatial position coordinate of any point cloud in the point cloud chart
Between spatial position.
S203, when having touch action in the image display area for detecting the first terminal, described first is obtained eventually
Touch-control dot position information in the image display area at end.
S204, the three-dimensional space according to locating for the touch-control dot position information, the first terminal threedimensional model and really
Fixed spatial position of the first terminal relative to the three-dimensional space determines the corresponding spatial point of the touch point and described the
Spatial position between one terminal.
Specifically, above-mentioned touch action can click any point in first terminal image display area for user, or
Person user executes preset operation in the image display area of first terminal, such as, in the image display area of first terminal
It slides etc..By taking touch action is a touch point as an example, a certain position in the image display area for detecting first terminal
Set when being clicked by user, the position as a touch point, due in the image display area of first terminal can real-time display it is real
Border scene image, therefore, touch point position can map a location of pixels in actual scene image here, i.e. touch point
There are mapping relations for pixel in position and actual scene image.The point cloud chart of three-dimensional space is obtained based on above-mentioned S202, it can
To know, the point cloud chart of three-dimensional space is established based on actual scene image, therefore, pixel and three-dimensional space in actual scene image
There are mapping relations for point cloud.To sum up, according to the pixel in touch point position and actual scene image, there are mapping relations, Yi Jishi
There are mapping relations for the point cloud of pixel and three-dimensional space in the scene image of border, and the point of touch point position and three-dimensional space can be obtained
Mapping relations between cloud.That is, any one touch point can be three in the image display area of first terminal
A matched cloud is found in the point cloud chart of dimension space.It is based on obtaining first terminal relative to the point cloud chart in above-mentioned S202 again
The spatial position coordinate of middle any point cloud, it can obtain the corresponding space bit between spatial point and first terminal of touch point
It sets.
S205, using the corresponding spatial point of the touch point as the origin of space coordinates, and be determined as space ginseng
Examine position.
In the present embodiment, the touch action according to user in the image display area of first terminal determines that space is sat
Spatial reference position in mark system, that is to say, that pre-set image is shown in the corresponding spatial point of touch point under touch action, this
User experience can be improved in sample, the further intelligence for improving first terminal.
Based on above-mentioned content, the present invention can achieve a kind of actual scene effect as described below:
User is before the display screen for clicking mobile phone, the figure of actual scene locating for real-time display user on the display screen of mobile phone
Picture, when the user clicks when one position of Ren on the aobvious screen of mobile phone, mobile phone obtains the corresponding location of pixels in the position, and in the picture
The image of one " door " is shown on plain position.When user hand handle machine, above-mentioned pixel is observed that by the display screen of mobile phone
Position is corresponding, and there are one " doors " on real space position.When user hand handle machine is walked to " door ", when going in front of " door "
When 0.5m, user is observed that " door " closed originally becomes " door " of an opening on a display of the handset, and " door "
Interior is virtual scene.When user hand handle machine continues to go ahead, user can observe virtual on a display of the handset
Scene.When user hand handle machine turns in the opposite direction, it is practical that user, which can be observed on a display of the handset in " door ",
Scene, and " door " other than be virtual scene.
The method flow schematic diagram of a kind of Overlapping display pre-set image as shown in Figure 5, in order to enable pre-set image is
What is shown in the image display area of one terminal is more true, such as, when pre-set image is the image of one " door ", then need
Gravity direction suffered by the short transverse of " door " and first terminal is shown unanimously, can just seem preset " door " first in this way
" door " on the ground is installed in the closer reality of display effect in terminal.Therefore, it is necessary to the display directions to pre-set image
It is adjusted correspondingly.Based on this, as shown in figure 5, above-mentioned S103 specifically comprises the following steps:
S1031, the gravity direction that the first terminal is subject to is obtained.
S1032, the gravity direction being subject to according to the first terminal, determine the display direction of the pre-set image.
S1033, the target pixel location superposition according to the display direction of the pre-set image, in described image display area
Show pre-set image.
Specifically, the gravity direction that above-mentioned first terminal is subject to can be obtained according to the gravity sensor in first terminal
It arrives.After determining gravity direction that first terminal is subject to, the short transverse of pre-set image and gravity direction can be shown as one
It causes, i.e., the gravity direction being subject to first terminal is determined as the display direction of the short transverse of pre-set image.It is default determining
After the display direction of image, first terminal image display area target pixel location according to the display side determined
To display pre-set image.In this way, it is more true to can make pre-set image to show in the image display area of first terminal
It is real.
In one embodiment, in order to enable the image shown in the image display area of first terminal is more nearly very
It is real, such as, when having a mobile object between reference position and first terminal, which can show reference position
Pre-set image blocked, rather than say, pre-set image is shown in front of mobile object, or is shown on mobile object,
Therefore, it is necessary to detect to the mobile object between first terminal and reference position.Based on this, the embodiment of the present application further includes
Following steps:
There is mobile target image if detecting between the first terminal and the reference position, by the target figure
As being shown on the pre-set image.
Specifically, the figure of mobile object of the above-mentioned mobile target image between first terminal and spatial reference position
Picture.When detecting between first terminal and reference position with the presence or absence of mobile target image, the camera of first terminal can be existed
The collected actual scene image of a predetermined time before Overlapping display pre-set image is as reference picture, and by reference picture
It is compared with the image shown in the image display area of first terminal after Overlapping display pre-set image, when Overlapping display is pre-
If the image shown in the image display area of first terminal after image is also deposited in addition to pre-set image compared to reference picture
In other images (image processing operations such as edge extracting can be carried out, it is determined whether there are other images), then first terminal is determined
Exist between reference position mobile target image (other images i.e. above-mentioned).At this point, first terminal shows target image
On the pre-set image.In this way, being more nearly the image shown in the image display area of first terminal really.
It is traditional technology, details are not described herein it should be noted that showing target image on pre-set image.
The flow diagram of another kind method for changing scenes as shown in FIG. 6, in order to enable other terminals can be with first
Terminal participates in the same scene jointly and interacts etc., i.e., the intelligence of terminal is further improved, therefore, at above-mentioned
Further include following steps after above-mentioned S105 on the basis of one embodiment:
S106, by the spatial reference position, the first terminal relative to spatial reference position pose, described first
The camera acquired image of terminal is sent in second terminal.
Specifically, above-mentioned second terminal is the various terminals comprising camera, for example, it is mobile phone, AR glasses, the AR helmet, flat
Plate computer, notebook etc., the application is it is not limited here.In addition, first terminal and second terminal need to establish communication link in advance
It connects, i.e., first terminal can be communicated with each other with second terminal.In practical applications, second terminal can be multiple.
Based on above content, the embodiment of the invention provides the flow diagrams of another method for changing scenes, such as Fig. 7 institute
Show, specifically comprises the following steps:
S301, the spatial reference position for receiving first terminal transmission, the first terminal are relative to spatial reference position
The camera acquired image of pose, the first terminal, the spatial reference position are the image display area of first terminal
The corresponding spatial position of pixel in domain on Overlapping display pre-set image position.
S302, the collected actual scene image of camera for obtaining second terminal.
S303, it is acquired according to the camera acquired image of the second terminal and the camera of the first terminal
The image arrived determines rotation and translation of the second terminal relative to the first terminal, the camera of the first terminal
The camera acquired image of acquired image and the second terminal has intersection.
Specifically, due to the camera acquired image of first terminal and the camera acquired image of second terminal
When having intersection, second terminal can just be acquired according to the camera acquired image of second terminal and the camera of first terminal
The image arrived determines the rotation and translation of first terminal Yu the second terminal.It should be noted that according to second terminal
The camera acquired image of camera acquired image and first terminal, determines first terminal and the second terminal
Rotation and translation be traditional technology, to this, this embodiment is not repeated.
S304, the institute sent according to the rotation and translation of the first terminal and the second terminal, the first terminal
The pose of reference position, the first terminal relative to spatial reference position is stated, determines the second terminal spatial reference position
Between pose.
Specifically, superposition second terminal is whole relative to first on pose of the first terminal relative to spatial reference position
Second terminal can be obtained relative to the pose between spatial reference position in the rotation and translation at end.It should be noted that herein
" superposition " belong to the Geometrical change in traditional technology, details are not described herein.It, can be by first terminal and based on above-mentioned S304
Two terminals are included in a space coordinates.
It should be noted that any can be included in the method in the same space coordinates for first terminal and second terminal,
All within the scope of protection of this application.
In addition, can be realized in another terminal (such as cloud server) above-mentioned to reduce the load of second terminal
S301-S303 method, after the terminal obtains second terminal relative to the pose between spatial reference position, with wired or
Wirelessly, second terminal is sent to second terminal relative to the posture between spatial reference position.
S305, the pre-set image is persistently adjusted according to the pose.
If S306, the pose meet third preset condition, the display area Dynamically Announce in the pre-set image is pre-
If scene, the third preset condition includes at least: the pose makes the pre-set image in the display of the second terminal
In region.
Specifically, the specific implementation of above-mentioned S305 and S306, similar with illustrating for above-mentioned S105, herein no longer
It repeats.In addition, it is above-mentioned right to can refer to when second terminal is unsatisfactory for third preset condition relative to the pose of spatial reference position
Pose of the first terminal relative to spatial reference position shows various forms of images in the image display area of second terminal,
It also repeats no more herein.
In the present embodiment, second terminal can pose according to first terminal relative to spatial reference position, second terminal
Translation and rotation relative to first terminal, it may be determined that go out itself pose relative to spatial reference position, while first terminal
Also it can determine itself pose relative to spatial reference position, the two all can be according to itself pose in itself image display area
Domain shows corresponding image, i.e., can all show actual scene image, pre- in second terminal and the image display area of first terminal
If the default scene image of Dynamically Announce in image and pre-set image, it is in same with second terminal to reach first terminal
Visual effect in a scene, therefore, method for changing scenes provided in this embodiment can be realized same true in multiple terminals
Environment is further interacted with same dummy object.
It should be understood that although each step in the flow chart of Fig. 1,4-7 is successively shown according to the instruction of arrow,
It is these steps is not that the inevitable sequence according to arrow instruction successively executes.Unless expressly stating otherwise herein, these steps
There is no stringent sequences to limit for rapid execution, these steps can execute in other order.Moreover, in Fig. 1,4-7 extremely
Few a part of step may include that perhaps these sub-steps of multiple stages or stage are not necessarily same to multiple sub-steps
Moment executes completion, but can execute at different times, and the execution sequence in these sub-steps or stage is also not necessarily
It successively carries out, but in turn or can be handed over at least part of the sub-step or stage of other steps or other steps
Alternately execute.
If Fig. 8 is a kind of device for changing scenes for providing of one embodiment, as shown in Figure 8, comprising: acquisition module 11, really
Cover half block 12, the first display module 13, monitoring modular 14 and the second display module 15, in which:
Acquisition module 11 shows that the camera of the first terminal is adopted in real time for the image display area in first terminal
The actual scene image collected;
Determining module 12, for determining spatial reference position in the space coordinates of the actual scene;
First display module 13, for the target pixel location Overlapping display pre-set image in described image display area,
The target pixel location is spatial reference position respective pixel position in described image display area, the default figure
The relatively described actual scene image in the spatial position of picture is fixed, and presets the viewing area of scene in the pre-set image comprising showing
Domain;
Monitoring modular 14, for monitoring pose of the first terminal relative to reference position, the pose includes described
First terminal posture information and the spatial position relative to the reference position;
Second display module 15, for the pose according to the first terminal, in the image display area of the first terminal
Dynamically Announce target scene in domain, the target scene include default scene and/or the first terminal collected reality in real time
Border scene.
Device for changing scenes provided in this embodiment can execute the embodiment of above-mentioned method as shown in Figure 1, realize former
Reason is similar with technical effect, and details are not described herein.
On the basis of the above embodiments, the second display module 15, if being also used to the pose meets the first preset condition,
Display area Dynamically Announce in the pre-set image presets scene, and first preset condition includes at least: the pose
The spatial reference position is not passed through;
Alternatively, if the pose meets the second preset condition, in the image display area Dynamically Announce of the first terminal
The default scene, and the camera of the first terminal described in the display area Dynamically Announce in the pre-set image is collected
Actual scene image, second preset condition include at least: the pose passes through the spatial reference position.
If Fig. 9 is another device for changing scenes that one embodiment provides, as shown in figure 9, in above-mentioned reality as shown in Figure 8
On the basis of applying example, above-mentioned determining module 12, further includes: acquiring unit 121 and determination unit 122, in which:
Acquiring unit 121, for obtain in real time the first terminal Inertial Measurement Unit IMU information, it is described first eventually
The collected actual scene image of the camera at end;
Determination unit 122, for building figure according to the actual scene image, Inertial Measurement Unit IMU information and positioning
Algorithm establishes the threedimensional model of three-dimensional space locating for the first terminal, and determines the first terminal relative to described three
The spatial position of dimension space;
Acquiring unit 121 obtains when being also used to have touch action in the image display area for detecting the first terminal
Take the touch-control dot position information in the image display area of the first terminal;
Determination unit 122 is also used to three of the three-dimensional space according to locating for the touch-control dot position information, the first terminal
The spatial position of dimension module and the determining first terminal relative to the three-dimensional space, determines the corresponding sky of the touch point
Between put and the first terminal between spatial position;
Determination unit 122 is also used to using the corresponding spatial point of the touch point as the origin of space coordinates, and is determined
For the spatial reference position.
Device for changing scenes provided in this embodiment can execute the embodiment of above-mentioned method as shown in Figure 4, realize former
Reason is similar with technical effect, and details are not described herein.
If Figure 10 is another device for changing scenes that one embodiment provides, as shown in Figure 10, in above-mentioned Fig. 8 or Fig. 9
On the basis of illustrated embodiment, the first above-mentioned display module 13 further include: gravity acquiring unit 131, direction-determining unit 132
And display unit 133, in which:
Gravity acquiring unit 131, the gravity direction being subject to for obtaining the first terminal;
Direction-determining unit 132, the gravity direction for being subject to according to the first terminal, determines the pre-set image
Display direction;
Display unit 133, the target picture for the display direction according to the pre-set image, in described image display area
Plain position Overlapping display pre-set image.
Device for changing scenes provided in this embodiment can execute the embodiment of above-mentioned method as shown in Figure 5, realize former
Reason is similar with technical effect, and details are not described herein.
On the basis of the above embodiments, the first display module 13, if be also used to detect the first terminal with it is described
There is mobile target image between reference position, then shows the target image on the pre-set image.
If Figure 11 is another device for changing scenes that one embodiment provides, as shown in figure 11, in any reality of above-mentioned figure
On the basis of applying example, the device further include: sending module 16, in which:
Sending module 16, for by the reference position, the first terminal relative to reference position pose, described
The camera acquired image of one terminal is sent in second terminal.
Device for changing scenes provided in this embodiment can execute the embodiment of above-mentioned method as shown in Figure 6, realize former
Reason is similar with technical effect, and details are not described herein.
If Figure 12 is a kind of device for changing scenes again that one embodiment provides, as shown in figure 11, the device further include: connect
It receives module 21, obtain module 22, the first determining module 23, the second determining module 24, adjustment module 25 and display module 26,
In:
Receiving module 21, the spatial reference position, the first terminal for receiving first terminal transmission are relative to described
The camera acquired image of the pose of spatial reference position, the first terminal, the spatial reference position are first whole
The corresponding spatial position of pixel in the image display area at end on Overlapping display pre-set image position;
Module 22 is obtained, for obtaining the camera acquired image of second terminal;
First determining module 23, for according to the camera acquired image of the second terminal and described first eventually
The camera acquired image at end, determines rotation and translation of the second terminal relative to the first terminal, described
The camera acquired image of one terminal and the camera acquired image of the second terminal have intersection;
Second determining module 24, for the rotation and translation according to the second terminal relative to the first terminal, institute
The pose of the spatial reference position, the first terminal of first terminal transmission relative to the spatial reference position is stated, really
The fixed second terminal is relative to the pose between spatial reference position;
Module 25 is adjusted, for persistently adjusting the pre-set image according to the pose;
Display module 26, if meeting third preset condition for the pose, the display area in the pre-set image
Dynamically Announce presets scene, and the third preset condition includes at least: the pose does not pass through the spatial reference position.
Device for changing scenes provided in this embodiment can execute the embodiment of above-mentioned method as shown in Figure 7, realize former
Reason is similar with technical effect, and details are not described herein.
In one embodiment, a kind of terminal is provided, including memory, processor and storage are on a memory and can be
The computer program run on processor, the processor perform the steps of when executing computer program
The camera of the first terminal collected actual scene in real time is shown in the image display area of first terminal
Image;
Spatial reference position is determined in the space coordinates of the actual scene;
Target pixel location Overlapping display pre-set image in described image display area, the target pixel location are institute
Spatial reference position respective pixel position in described image display area is stated, the spatial position of the pre-set image is relatively described
Actual scene image is fixed, and presets the display area of scene in the pre-set image comprising showing;
Pose of the first terminal relative to the spatial reference position is monitored, the pose includes the first terminal
Posture information and the spatial position relative to the spatial reference position;
According to the pose of the first terminal, the Dynamically Announce target field in the image display area of the first terminal
Scape, the target scene include default scene and/or the first terminal collected actual scene in real time.
In one embodiment, a kind of terminal is provided, including memory, processor and storage are on a memory and can be
The computer program run on processor, the processor perform the steps of when executing computer program
Receive the position of the spatial reference position, the first terminal of first terminal transmission relative to the spatial reference position
Appearance, the camera acquired image of the first terminal, the spatial reference position are the image display area of first terminal
The corresponding spatial position of pixel on middle Overlapping display pre-set image position;
Obtain the camera acquired image of second terminal;
Camera according to the camera acquired image of the second terminal and the first terminal is collected
Image determines rotation and translation of the second terminal relative to the first terminal, the camera acquisition of the first terminal
To image and the camera acquired image of the second terminal have intersection;
Described in being sent according to the second terminal relative to the rotation and translation of the first terminal, the first terminal
The pose of spatial reference position, the first terminal relative to the spatial reference position, determine the second terminal relative to
Pose between spatial reference position;
The pre-set image is persistently adjusted according to the pose;
If the pose meets third preset condition, the display area Dynamically Announce in the pre-set image presets field
Scape, the third preset condition include at least: the pose does not pass through the spatial reference position.
In one embodiment, the present embodiment additionally provides a kind of terminal, including memory, processor and is stored in storage
On device and the computer program that can run on a processor, the processor perform the steps of when executing computer program
The camera of the first terminal collected actual scene in real time is shown in the image display area of first terminal
Image;
Spatial reference position is determined in the space coordinates of the actual scene;
Target pixel location Overlapping display pre-set image in described image display area, the target pixel location are institute
Spatial reference position respective pixel position in described image display area is stated, the spatial position of the pre-set image is relatively described
Actual scene image is fixed, and presets the display area of scene in the pre-set image comprising showing;
Pose of the first terminal relative to the spatial reference position is monitored, the pose includes the first terminal
Posture information and the spatial position relative to the spatial reference position;
According to the pose of the first terminal, the Dynamically Announce target field in the image display area of the first terminal
Scape, the target scene include default scene and/or the first terminal collected actual scene in real time.
In one embodiment, the present embodiment additionally provides a kind of terminal, including memory, processor and is stored in storage
On device and the computer program that can run on a processor, the processor perform the steps of when executing computer program
Receive the position of the spatial reference position, the first terminal of first terminal transmission relative to the spatial reference position
Appearance, the camera acquired image of the first terminal, the spatial reference position are the image display area of first terminal
The corresponding spatial position of pixel on middle Overlapping display pre-set image position;
Obtain the camera acquired image of second terminal;
Camera according to the camera acquired image of the second terminal and the first terminal is collected
Image determines rotation and translation of the second terminal relative to the first terminal, the camera acquisition of the first terminal
To image and the camera acquired image of the second terminal have intersection;
Described in being sent according to the second terminal relative to the rotation and translation of the first terminal, the first terminal
The pose of spatial reference position, the first terminal relative to the spatial reference position, determine the second terminal relative to
Pose between spatial reference position;
The pre-set image is persistently adjusted according to the pose;
If the pose meets third preset condition, the display area Dynamically Announce in the pre-set image presets field
Scape, the third preset condition include at least: the pose does not pass through the spatial reference position.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the computer program can be stored in a non-volatile computer
In read/write memory medium, the computer program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein,
To any reference of memory, storage, database or other media used in each embodiment provided herein,
Including non-volatile and/or volatile memory.Nonvolatile memory may include read-only memory (ROM), programming ROM
(PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include
Random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms,
Such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhancing
Type SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM
(RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
Each technical characteristic of above embodiments can be combined arbitrarily, for simplicity of description, not to above-described embodiment
In each technical characteristic it is all possible combination be all described, as long as however, the combination of these technical characteristics be not present lance
Shield all should be considered as described in this specification.
The several embodiments of the application above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously
It cannot therefore be construed as limiting the scope of the patent.It should be pointed out that coming for those of ordinary skill in the art
It says, without departing from the concept of this application, various modifications and improvements can be made, these belong to the protection of the application
Range.Therefore, the scope of protection shall be subject to the appended claims for the application patent.
Claims (13)
1. a kind of method for changing scenes, which is characterized in that the described method includes:
The camera of the first terminal collected actual scene image in real time is shown in the image display area of first terminal;
Spatial reference position is determined in the space coordinates of the actual scene;
Target pixel location Overlapping display pre-set image in described image display area, the target pixel location are the sky
Between reference position respective pixel position in described image display area, the relatively described reality in the spatial position of the pre-set image
Scene image is fixed, and presets the display area of scene in the pre-set image comprising showing;
Pose of the first terminal relative to the spatial reference position is monitored, the pose includes the first terminal posture
Information and the spatial position relative to the spatial reference position;
According to the pose of the first terminal, the Dynamically Announce target scene in the image display area of the first terminal, institute
Stating target scene includes the default scene and/or the first terminal collected actual scene in real time.
2. the method according to claim 1, wherein the pose according to the first terminal, described
Dynamically Announce target scene in the image display area of one terminal, comprising:
If the pose meets the first preset condition, the display area Dynamically Announce in the pre-set image presets scene, institute
State the first preset condition to include at least: the pose does not pass through the spatial reference position;
Alternatively, if the pose meets the second preset condition, described in the image display area Dynamically Announce of the first terminal
Default scene, and the collected reality of camera of the first terminal described in the display area Dynamically Announce in the pre-set image
Scene image, second preset condition include at least: the pose passes through the spatial reference position.
3. the method according to claim 1, wherein described determine in the space coordinates of the actual scene
Spatial reference position, comprising:
The Inertial Measurement Unit IMU information of the first terminal, the collected reality of camera of the first terminal are obtained in real time
Border scene image;
Nomography is built according to the actual scene image, Inertial Measurement Unit IMU information and positioning, establishes the first terminal
The threedimensional model of locating three-dimensional space, and determine spatial position of the first terminal relative to the three-dimensional space;
When having touch action in the image display area for detecting the first terminal, the image for obtaining the first terminal is aobvious
Show the touch-control dot position information in region;
According to the threedimensional model of three-dimensional space locating for the touch-control dot position information, the first terminal and determining described first
Spatial position of the terminal relative to the three-dimensional space determines between the corresponding spatial point of the touch point and the first terminal
Spatial position;
Using the corresponding spatial point of the touch point as the origin of space coordinates, and it is determined as the spatial reference position.
4. the method according to claim 1, wherein the target pixel location in described image display area
Overlapping display pre-set image, comprising:
Obtain the gravity direction that the first terminal is subject to;
According to the gravity direction that the first terminal is subject to, the display direction of the pre-set image is determined;
According to the display direction of the pre-set image, the target pixel location Overlapping display in described image display area presets figure
Picture.
5. the method according to claim 1, wherein the method also includes:
There is mobile target image if detecting between the first terminal and the spatial reference position, by the target figure
As being shown on the pre-set image.
6. the method according to claim 1, wherein the method also includes:
Pose, the first terminal by the spatial reference position, the first terminal relative to the spatial reference position
Camera acquired image be sent in second terminal.
7. a kind of method for changing scenes, which is characterized in that the described method includes:
Receive first terminal send spatial reference position, the first terminal relative to the spatial reference position pose,
The camera acquired image of the first terminal, the spatial reference position are to fold in the image display area of first terminal
Add the corresponding spatial position of pixel on display pre-set image position;
Obtain the camera acquired image of second terminal;
According to the camera acquired image of the second terminal and the camera acquired image of the first terminal,
Determine rotation and translation of the second terminal relative to the first terminal, the collected figure of the camera of the first terminal
As the camera acquired image with the second terminal has intersection;
The space sent according to the second terminal relative to the rotation and translation of the first terminal, the first terminal
The pose of reference position, the first terminal relative to the spatial reference position determines the second terminal relative to space
Pose between reference position;
The pre-set image is persistently adjusted according to the pose;
If the pose meets third preset condition, the display area Dynamically Announce in the pre-set image presets scene, institute
State third preset condition to include at least: the pose does not pass through the spatial reference position.
8. a kind of device for changing scenes, which is characterized in that described device includes:
Acquisition module is used for, and shows that the camera of the first terminal collects in real time in the image display area of first terminal
Actual scene image;
Determining module, for determining spatial reference position in the space coordinates of the actual scene;
First display module, for the target pixel location Overlapping display pre-set image in described image display area, the mesh
Mark location of pixels is spatial reference position respective pixel position in described image display area, the sky of the pre-set image
Between the relatively described actual scene image in position fix, and comprising showing the display area of default scene in the pre-set image;
Monitoring modular, for monitoring pose of the first terminal relative to the spatial reference position, the pose includes institute
State first terminal posture information and the spatial position relative to the spatial reference position;
Second display module moves in the image display area of the first terminal for the pose according to the first terminal
State displaying target scene, the target scene include default scene and/or the first terminal collected actual scene in real time.
9. a kind of device for changing scenes, which is characterized in that described device includes:
Receiving module, for receiving the spatial reference position of first terminal transmission, the first terminal is joined relative to the space
The pose of position, the camera acquired image of the first terminal are examined, the spatial reference position is the figure of first terminal
As the corresponding spatial position of pixel in display area on Overlapping display pre-set image position;
Module is obtained, for obtaining the camera acquired image of second terminal;
First determining module, for according to the camera acquired image of the second terminal and taking the photograph for the first terminal
As head acquired image, rotation and translation of the second terminal relative to the first terminal, the first terminal are determined
Camera acquired image and the camera acquired image of the second terminal have intersection;
Second determining module, for according to the second terminal relative to the first terminal rotation and translation, described first
The pose relative to the spatial reference position of the spatial reference position, the first terminal that terminal is sent, determine described in
Second terminal is relative to the pose between spatial reference position;
Module is adjusted, for persistently adjusting the pre-set image according to the pose;
Display module, if meeting third preset condition for the pose, the display area dynamic in the pre-set image is aobvious
Show that default scene, the third preset condition include at least: the pose does not pass through the spatial reference position.
10. a kind of terminal, including memory and processor, the memory are stored with computer program, which is characterized in that described
The step of processor realizes any one of claims 1 to 6 the method when executing the computer program.
11. a kind of terminal, including memory and processor, the memory are stored with computer program, which is characterized in that described
The step of processor realizes claim 7 the method when executing the computer program.
12. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
The step of method described in any one of claims 1 to 6 is realized when being executed by processor.
13. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
The step of method of claim 7 is realized when being executed by processor.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810643987.7A CN109002162B (en) | 2018-06-21 | 2018-06-21 | Scene switching method, device, terminal and computer storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810643987.7A CN109002162B (en) | 2018-06-21 | 2018-06-21 | Scene switching method, device, terminal and computer storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109002162A true CN109002162A (en) | 2018-12-14 |
CN109002162B CN109002162B (en) | 2021-06-22 |
Family
ID=64601064
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810643987.7A Active CN109002162B (en) | 2018-06-21 | 2018-06-21 | Scene switching method, device, terminal and computer storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109002162B (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112399068A (en) * | 2019-08-16 | 2021-02-23 | 触景无限科技(北京)有限公司 | Image processing system and image processing method |
CN112577488A (en) * | 2020-11-24 | 2021-03-30 | 腾讯科技(深圳)有限公司 | Navigation route determining method, navigation route determining device, computer equipment and storage medium |
WO2022021965A1 (en) * | 2020-07-30 | 2022-02-03 | 北京市商汤科技开发有限公司 | Virtual object adjustment method and apparatus, and electronic device, computer storage medium and program |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170278486A1 (en) * | 2014-08-27 | 2017-09-28 | Sony Corporation | Display control apparatus, display control method, and program |
CN108008817A (en) * | 2017-12-01 | 2018-05-08 | 西安枭龙科技有限公司 | A kind of method for realizing virtual reality fusion |
-
2018
- 2018-06-21 CN CN201810643987.7A patent/CN109002162B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170278486A1 (en) * | 2014-08-27 | 2017-09-28 | Sony Corporation | Display control apparatus, display control method, and program |
CN108008817A (en) * | 2017-12-01 | 2018-05-08 | 西安枭龙科技有限公司 | A kind of method for realizing virtual reality fusion |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112399068A (en) * | 2019-08-16 | 2021-02-23 | 触景无限科技(北京)有限公司 | Image processing system and image processing method |
CN112399068B (en) * | 2019-08-16 | 2022-05-03 | 触景无限科技(北京)有限公司 | Image processing system and image processing method |
WO2022021965A1 (en) * | 2020-07-30 | 2022-02-03 | 北京市商汤科技开发有限公司 | Virtual object adjustment method and apparatus, and electronic device, computer storage medium and program |
CN112577488A (en) * | 2020-11-24 | 2021-03-30 | 腾讯科技(深圳)有限公司 | Navigation route determining method, navigation route determining device, computer equipment and storage medium |
CN112577488B (en) * | 2020-11-24 | 2022-09-02 | 腾讯科技(深圳)有限公司 | Navigation route determining method, navigation route determining device, computer equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN109002162B (en) | 2021-06-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11217019B2 (en) | Presenting image transition sequences between viewing locations | |
US20210142582A1 (en) | Display of an occluded object in a hybrid-reality system | |
US20200380769A1 (en) | Image processing method and apparatus, storage medium, and computer device | |
Behzadan et al. | Augmented reality visualization: A review of civil infrastructure system applications | |
CN101794349B (en) | Experimental system and method for augmented reality of teleoperation of robot | |
US8823855B2 (en) | User equipment and method for providing augmented reality (AR) service | |
CN104662587B (en) | Three-dimensional user interface device and three-dimensional manipulating method | |
AU2023275894A1 (en) | Automated control of image acquisition via use of mobile device user interface | |
US11321929B2 (en) | System and method for spatially registering multiple augmented reality devices | |
JP6458371B2 (en) | Method for obtaining texture data for a three-dimensional model, portable electronic device, and program | |
US20180144555A1 (en) | Determining and/or generating data for an architectural opening area associated with a captured three-dimensional model | |
CN109002162A (en) | Method for changing scenes, device, terminal and computer storage medium | |
DE112013003257T5 (en) | Improved information transfer through a transparent display | |
CN106062821A (en) | Sensor-based camera motion detection for unconstrained slam | |
WO2019168886A1 (en) | System and method for spatially mapping smart objects within augmented reality scenes | |
CN113936121A (en) | AR (augmented reality) label setting method and remote collaboration system | |
CN113160270A (en) | Visual map generation method, device, terminal and storage medium | |
US20220130064A1 (en) | Feature Determination, Measurement, and Virtualization From 2-D Image Capture | |
CN115731349A (en) | Method and device for displaying house type graph, electronic equipment and storage medium | |
JP7280223B2 (en) | Information terminal device, remote communication support method and program | |
CN110232744A (en) | A kind of display methods and device | |
JP2024072072A (en) | Information processing device | |
CN109242953A (en) | A method of realizing the three-dimensional data volume drawing of aerial display and virtual interacting | |
WO2023040551A1 (en) | Method for displaying image on display screen, electronic device, and apparatus | |
CN115810065A (en) | House information editing method and device, electronic equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |