CN109002162A - Method for changing scenes, device, terminal and computer storage medium - Google Patents

Method for changing scenes, device, terminal and computer storage medium Download PDF

Info

Publication number
CN109002162A
CN109002162A CN201810643987.7A CN201810643987A CN109002162A CN 109002162 A CN109002162 A CN 109002162A CN 201810643987 A CN201810643987 A CN 201810643987A CN 109002162 A CN109002162 A CN 109002162A
Authority
CN
China
Prior art keywords
terminal
image
reference position
display area
pose
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810643987.7A
Other languages
Chinese (zh)
Other versions
CN109002162B (en
Inventor
淮静
郭亨凯
陈尧
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing ByteDance Network Technology Co Ltd
Original Assignee
Beijing ByteDance Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing ByteDance Network Technology Co Ltd filed Critical Beijing ByteDance Network Technology Co Ltd
Priority to CN201810643987.7A priority Critical patent/CN109002162B/en
Publication of CN109002162A publication Critical patent/CN109002162A/en
Application granted granted Critical
Publication of CN109002162B publication Critical patent/CN109002162B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/20Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/61Scene description
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20Indexing scheme for editing of 3D models
    • G06T2219/2016Rotation, translation, scaling
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20Indexing scheme for editing of 3D models
    • G06T2219/2024Style variation

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Architecture (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention provides a kind of method for changing scenes, device, terminal and computer storage medium, this method comprises: the image display area in first terminal shows the camera of the first terminal collected actual scene image in real time;Spatial reference position is determined in the space coordinates of actual scene;In the target pixel location Overlapping display pre-set image of image display area, target pixel location is spatial reference position respective pixel position in image display area, the spatial position of pre-set image is fixed with respect to actual scene image, and presets the display area of scene in pre-set image comprising showing;Monitor pose of the first terminal relative to spatial reference position;According to the position of first terminal, the Dynamically Announce target scene in the image display area of first terminal.This method can realize further interacting for practical true environment and dummy object.

Description

Method for changing scenes, device, terminal and computer storage medium
Technical field
This application involves augmented reality fields, more particularly to a kind of method for changing scenes, device, terminal and calculating Machine storage medium.
Background technique
With the development of augmented reality (Augmented Reality, abbreviation AR) technology, using the wearable eye of AR technology Mirror is applied in more and more fields, for example, doctor implements operation using wearable AR glasses, player utilizes wearable AR Glasses carry out game etc..
Due to wearable AR glasses portability poor (for example, wearable AR glasses are heavy) etc., AR technology is gradually Be used on the portable terminals such as mobile phone or tablet computer.User can observe true ring on the portable mobile termianl The picture in border and the superposition of virtual object.Such as user open mobile phone on AR function when, the camera of mobile phone is beaten automatically It opens, user can observe the true environment picture (such as room of user) that mobile phone camera takes on mobile phone interface, together When, dummy object (such as a sofa) to be added is needed in mobile phone interface selection, and the object is placed on mobile phone interface On some position on shown true environment picture (such as southeast corner), what user can see on mobile phone interface The picture (such as picture of one sofa of southeast corner position placement in room) of true environment picture and the dummy object of addition. When user's cell phone, dummy object does not change relative to the position of real scene.
But existing portable mobile termianl is only capable of showing dummy object in true environment based on the realization of AR technology Function, and can not achieve the function that true environment is further interacted with dummy object.
Summary of the invention
Based on this, it is necessary in view of the above technical problems, provide one kind can be realized true environment and dummy object again into Method for changing scenes, device, terminal and the computer storage medium of one step interaction.
In a first aspect, the embodiment of the present invention provides a kind of method for changing scenes, which comprises
The camera of the first terminal collected actual scene in real time is shown in the image display area of first terminal Image;
Spatial reference position is determined in the space coordinates of the actual scene;
Target pixel location Overlapping display pre-set image in described image display area, the target pixel location are institute Spatial reference position respective pixel position in described image display area is stated, the spatial position of the pre-set image is relatively described Actual scene image is fixed, and presets the display area of scene in the pre-set image comprising showing;
Pose of the first terminal relative to the spatial reference position is monitored, the pose includes the first terminal Posture information and the spatial position relative to the spatial reference position;
According to the pose of the first terminal, the Dynamically Announce target field in the image display area of the first terminal Scape, the target scene include default scene and/or the first terminal collected actual scene in real time.
Second aspect, the embodiment of the present invention provide a kind of method for changing scenes, which comprises
Receive the pose, described of spatial reference position, the first terminal that first terminal is sent relative to reference position The camera acquired image of first terminal, the reference position are that Overlapping display is pre- in the image display area of first terminal If the corresponding spatial position of pixel on picture position;
Obtain the camera acquired image of second terminal;
Camera according to the camera acquired image of the second terminal and the first terminal is collected Image determines rotation and translation of the second terminal relative to the first terminal, the camera acquisition of the first terminal To image and the camera acquired image of the second terminal have intersection;
Described in being sent according to the second terminal relative to the rotation and translation of the first terminal, the first terminal The pose of spatial reference position, the first terminal relative to the spatial reference position, determine the second terminal relative to Pose between spatial reference position;
The pre-set image is persistently adjusted according to the pose;
If the pose meets third preset condition, the display area Dynamically Announce in the pre-set image presets field Scape, the third preset condition include at least: the pose does not pass through the spatial reference position.
The third aspect, the embodiment of the present invention provide a kind of device for changing scenes, and described device includes:
Acquisition module is used for, and shows that the camera of the first terminal is adopted in real time in the image display area of first terminal The actual scene image collected;
Determining module, for determining spatial reference position in the space coordinates of the actual scene;
First display module, for the target pixel location Overlapping display pre-set image in described image display area, institute Stating target pixel location is spatial reference position respective pixel position in described image display area, the pre-set image The relatively described actual scene image in spatial position fix, comprising showing the display area of default scene in the pre-set image;
Monitoring modular, for continuing to monitor pose of the first terminal relative to the spatial reference position, institute's rheme Appearance includes the first terminal posture information and the spatial position relative to the spatial reference position;
Second display module, for the pose according to the first terminal, in the image display area of the first terminal Interior Dynamically Announce target scene, the target scene include default scene and/or the first terminal collected reality in real time Scene.
Fourth aspect, the embodiment of the present invention provide a kind of device for changing scenes, and described device includes:
Receiving module, the spatial reference position, the first terminal for receiving first terminal transmission are relative to the sky Between the pose of reference position, the first terminal camera acquired image, the spatial reference position is first terminal Image display area in the corresponding spatial position of pixel on Overlapping display pre-set image position;
Module is obtained, for obtaining the camera acquired image of second terminal;
First determining module, for according to the second terminal camera acquired image and the first terminal Camera acquired image, determine rotation and translation of the second terminal relative to the first terminal, described first The camera acquired image of terminal and the camera acquired image of the second terminal have intersection;
Second determining module, for the rotation and translation, described according to the second terminal relative to the first terminal Pose of the spatial reference position, the first terminal that first terminal is sent relative to the spatial reference position, determines The second terminal is relative to the pose between spatial reference position;
Module is adjusted, for persistently adjusting the pre-set image according to the pose;
Display module, if meeting third preset condition for the pose, the display area in the pre-set image is dynamic State shows that default scene, the third preset condition include at least: the pose does not pass through the spatial reference position.
5th aspect, the embodiment of the present invention mention a kind of computer equipment, including memory and processor, and the memory is deposited Computer program is contained, the processor performs the steps of when executing the computer program
The camera of the first terminal collected actual scene in real time is shown in the image display area of first terminal Image;
Spatial reference position is determined in the space coordinates of the actual scene;
Target pixel location Overlapping display pre-set image in described image display area, the target pixel location are institute Spatial reference position respective pixel position in described image display area is stated, the spatial position of the pre-set image is relatively described Actual scene image is fixed, and presets the display area of scene in the pre-set image comprising showing;
Pose of the first terminal relative to reference position is monitored, the pose includes the first terminal posture information With the spatial position relative to the reference position;
According to the pose of the first terminal, the Dynamically Announce target field in the image display area of the first terminal Scape, the target scene include default scene and/or the first terminal collected actual scene in real time.
6th aspect, the embodiment of the present invention mention a kind of computer equipment, including memory and processor, and the memory is deposited Computer program is contained, the processor performs the steps of when executing the computer program
Receive the position of the spatial reference position, the first terminal of first terminal transmission relative to the spatial reference position Appearance, the camera acquired image of the first terminal, the spatial reference position are the image display area of first terminal The corresponding spatial position of pixel on middle Overlapping display pre-set image position;
Obtain the camera acquired image of second terminal;
Camera according to the camera acquired image of the second terminal and the first terminal is collected Image determines rotation and translation of the second terminal relative to the first terminal, the camera acquisition of the first terminal To image and the camera acquired image of the second terminal have intersection;
Described in being sent according to the second terminal relative to the rotation and translation of the first terminal, the first terminal The pose of spatial reference position, the first terminal relative to the spatial reference position, determine the second terminal relative to Pose between spatial reference position;
The pre-set image is persistently adjusted according to the pose;
If the pose meets third preset condition, the display area Dynamically Announce in the pre-set image presets field Scape, the third preset condition include at least: the pose does not pass through the spatial reference position.
7th aspect, the embodiment of the present invention mention a kind of computer readable storage medium, are stored thereon with computer program, institute It states when computer program is executed by processor and performs the steps of
The camera of the first terminal collected actual scene in real time is shown in the image display area of first terminal Image;
Spatial reference position is determined in the space coordinates of the actual scene;
Target pixel location Overlapping display pre-set image in described image display area, the target pixel location are institute Spatial reference position respective pixel position in described image display area is stated, the spatial position of the pre-set image is relatively described Actual scene image is fixed, and presets the display area of scene in the pre-set image comprising showing;
Pose of the first terminal relative to the spatial reference position is monitored, the pose includes the first terminal Posture information and the spatial position relative to the spatial reference position;
According to the pose of the first terminal, the Dynamically Announce target field in the image display area of the first terminal Scape, the target scene include default scene and/or the first terminal collected actual scene in real time.
Eighth aspect, the embodiment of the present invention mention a kind of computer readable storage medium, are stored thereon with computer program, institute It states and performs the steps of the spatial reference position for receiving first terminal and sending, described the when computer program is executed by processor One terminal is relative to the pose of the spatial reference position, the camera acquired image of the first terminal, the space Reference position is the corresponding spatial position of pixel in the image display area of first terminal on Overlapping display pre-set image position;
Obtain the camera acquired image of second terminal;
Camera according to the camera acquired image of the second terminal and the first terminal is collected Image determines rotation and translation of the second terminal relative to the first terminal, the camera acquisition of the first terminal To image and the camera acquired image of the second terminal have intersection;
Described in being sent according to the second terminal relative to the rotation and translation of the first terminal, the first terminal The pose of spatial reference position, the first terminal relative to the spatial reference position, determine the second terminal relative to Pose between spatial reference position;
The pre-set image is persistently adjusted according to the pose;
If the pose meets third preset condition, the display area Dynamically Announce in the pre-set image presets field Scape, the third preset condition include at least: the pose does not pass through the spatial reference position.
Above-mentioned method for changing scenes, device, computer equipment and storage medium, first terminal is first in image display area Middle display camera collected actual scene image, and the determining georeferencing position in the space coordinates of actual scene in real time It sets, then in the target pixel location Overlapping display pre-set image of image display area, to realize the image in first terminal Actual scene image and pre-set image are shown in display area.Further, monitoring first terminal is relative to spatial reference position Pose, and according to the pose of first terminal in the image display area of first terminal Dynamically Announce target scene, wherein mesh Marking scene includes default scene and/or actual scene.Since first terminal provided by the present application can join according to it relative to space The pose for examining position shows different target scenes in image display area, therefore, scene switching side provided in this embodiment Method can realize further interacting for true environment and dummy object.More further, second terminal can be according to first terminal phase Translation and rotation relative to first terminal of pose, second terminal for spatial reference position, it may be determined that go out itself relative to The pose of spatial reference position, while first terminal also can determine itself pose relative to spatial reference position, the two all may be used Corresponding image, the i.e. image in second terminal and first terminal are shown in the image display area of itself according to the pose of itself Display area can all show actual scene image, in pre-set image and pre-set image Dynamically Announce default scene image, from And reach the visual effect that first terminal is in the same scene with second terminal, therefore, scene provided in this embodiment is cut The method of changing can realize further interacting for same true environment and same dummy object in multiple terminals.
Detailed description of the invention
Fig. 1 is a kind of flow diagram of method for changing scenes provided in an embodiment of the present invention;
Fig. 2 is a kind of schematic diagram of space coordinates provided in an embodiment of the present invention;
Fig. 3 is a kind of image schematic diagram that the image display area of first terminal is shown provided in an embodiment of the present invention;
Fig. 4 is a kind of flow diagram that spatial reference position is determined in space coordinates of the embodiment of the present invention;
Fig. 5 is a kind of method flow schematic diagram of Overlapping display pre-set image provided in an embodiment of the present invention;
Fig. 6 is the flow diagram of another method for changing scenes provided in an embodiment of the present invention;
Fig. 7 is the flow diagram of another method for changing scenes provided in an embodiment of the present invention;
Fig. 8 is a kind of structural schematic diagram of device for changing scenes provided in an embodiment of the present invention;
Fig. 9 is the structural schematic diagram of another device for changing scenes provided in an embodiment of the present invention;
Figure 10 is the structural schematic diagram of another device for changing scenes provided in an embodiment of the present invention;
Figure 11 is the structural schematic diagram of another device for changing scenes provided in an embodiment of the present invention;
Figure 12 is the structural schematic diagram of another device for changing scenes provided in an embodiment of the present invention.
Specific embodiment
Augmented reality (Augmented Reality, abbreviation AR) technology is a kind of position for calculating camera image in real time It sets and angle and plus the technology of respective image, video, 3D model, the target of this technology is true environment and virtual Object is added to the same picture in real time or space exists simultaneously.Since AR technology can combine true environment and dummy object Feature, therefore, AR technology is applied in more and more fields.For example, applying in urban construction planning, AR can be used Technology will be planned in effect superposition real scene, to directly obtain the effect etc. of planning.
Currently, user can wear AR glasses or the AR helmet etc., experience AR technology, can also by portable terminal (such as Mobile phone or tablet computer etc.), experience AR technology.But since wearable AR glasses and AR helmet portability are poor and portable The computing capability of terminal is constantly promoted, and therefore, portable terminal is increasingly becoming the carrier of AR technology, to realize user portable The picture of true environment and virtual object superposition is observed on mobile terminal.Such as in teaching process, by portable The AR function of mobile terminal can be chosen different observation objects (i.e. dummy object, such as various animals), and by the observation of selection Object is placed in the true classroom shown on portable terminal (i.e. true environment), so that student is more by AR technology Add true study observation object.But existing portable mobile termianl is only capable of realizing based on AR technology in true environment The function of upper display dummy object, and the problem of can not achieve the function that true environment is further interacted with dummy object.This Method for changing scenes, device, terminal and the computer storage medium that application provides aim to solve the problem that the technology as above of traditional technology is asked Topic.
It should be noted that the executing subject of following methods embodiment can be the various terminals comprising camera, such as Mobile phone, AR glasses, the AR helmet, tablet computer, notebook etc., the application is it is not limited here.
It is with reference to the accompanying drawings and embodiments, right in order to which the objects, technical solutions and advantages of the application are more clearly understood The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, not For limiting the application.
Fig. 1 be a kind of flow diagram of method for changing scenes provided in an embodiment of the present invention, the present embodiment what is involved is First terminal shows the process of actual scene image and display pre-set image, this method comprises:
S101, the camera of the first terminal collected reality in real time is shown in the image display area of first terminal Scene image.
Specifically, above-mentioned first terminal is the executing subject of this method embodiment, it can to include each of camera Kind terminal, such as mobile phone etc..The image display area of above-mentioned first terminal is the display screen area of first terminal, such as, When first terminal is mobile phone, the image display area of first terminal is the display screen area of mobile phone.Above-mentioned first terminal Camera is usually the rear camera of first terminal.Above-mentioned actual scene image is the figure of actual environment locating for first terminal Picture.
S102, spatial reference position is determined in the space coordinates of the actual scene.
Specifically, above-mentioned space coordinates refer to the world coordinate system of actual scene locating for first terminal.It is optional , as shown in Fig. 2, the origin of above-mentioned space coordinates can be the reference of any one in actual scene locating for first terminal Point (such as the center on the ground in room locating for first terminal), Y-axis are between first terminal and the origin of space coordinates Horizontal line on axis, using towards the direction of first terminal as positive direction.X-axis be with Y-axis vertical axis in the horizontal plane, And using the right-hand direction towards first terminal as positive direction.Z axis is the horizontal plane perpendicular to X-axis and Y-axis, meets at the axis of origin Line, and using direction upward as positive direction.
Above-mentioned spatial reference position can be any point in above-mentioned space coordinates, be indicated with (x, y, z).Example Such as, above-mentioned spatial reference position can also be the origin of above-mentioned space coordinates, i.e. spatial reference position is (0,0,0).In addition, Spatial reference position once it is determined that after, no longer change.Further alternative, spatial reference position can be a predeterminated position, example Ground such as at 1m immediately ahead of first terminal a, or spatial position of user's triggering.
It should be noted that the selection of definition and spatial reference position for space coordinates is only in the present embodiment It is only a kind of example, the present invention does not limit the definition mode of space coordinates and the selection mode of spatial reference position It is fixed, as long as a spatial reference position can be determined in the world coordinate system of actual scene locating for first terminal.
S103, the target pixel location Overlapping display pre-set image in described image display area, the object pixel position It is set to spatial reference position respective pixel position in described image display area, the spatial position phase of the pre-set image The actual scene image is fixed, presets the display area of scene in the default scene comprising showing.
Specifically, above-mentioned pre-set image can be 2D image, or 3D model.Optionally, can appoint for one " door " of the 2D or 3D of shape of anticipating, the window of the 2D or 3D of arbitrary shape, other objects of 2D or 3D of arbitrary shape etc..It is optional , display scale of the above-mentioned pre-set image in the image display area of first terminal can manually adjust, for example, user is manual Processing is zoomed in and out to pre-set image.In addition, including the region that can show other images in above-mentioned pre-set image.
The spatial position of above-mentioned pre-set image refers to that pre-set image is fixed on reality relative to the fixation of actual scene image At a certain position in the scene image of border, when the pose of first terminal changes, visually the image of first terminal is aobvious Show that the pre-set image shown in region remains at the above-mentioned a certain position in actual scene image.On it should be noted that Region comprising other images of display in the pre-set image stated.
Above-mentioned target pixel location is one on the actual scene image shown in the image display area of first terminal A location of pixels, and when the location of pixels is mapped in actual scene, it is above-mentioned spatial reference position.For example, when above-mentioned Spatial reference position is the ground center in room locating for first terminal, and above-mentioned target pixel location is, first terminal The corresponding location of pixels in ground center in the room shown in image display area.
In a kind of example, the above-mentioned target pixel location Overlapping display pre-set image in image display area it is specific Implementation can use existing AR technology, specific: show that first is whole first in the image display area of first terminal Then the actual scene image that the camera at end acquires in real time shows pre-set image in target pixel location, and by pre-set image It is shown on actual scene image, using visual effect of the target pixel location as pre-set image for reaching actual scene image. Optionally, be based on above-mentioned space coordinates shown in Fig. 2, the horizontal line of pre-set image can show X-axis on straight line, i.e., It is that user can observe the front of pre-set image in the image display area of first terminal in visual effect.It needs to illustrate It is that the application does not limit the specific implementation of the target pixel location Overlapping display pre-set image in image display area It is fixed, as long as being able to achieve visual effect described herein.
The pose of S104, the monitoring first terminal relative to spatial reference position, the pose include described first whole Hold the posture information relative to the spatial reference position and spatial position.
Specifically, above-mentioned pose includes the posture information of first terminal and the space bit relative to spatial reference position It sets, wherein the rotation angle of posture information, that is, first terminal of first terminal three change in coordinate axis direction in three-dimensional system of coordinate, it can With but be not limited only to be obtained according to the Inertial Measurement Unit IMU information in first terminal.First is obtained eventually furthermore according to IMU information End rotation angle of three reference axis in space coordinates belongs to traditional technology, repeats no more to this.
It in one embodiment, can be according to camera coordinate system and world coordinates in image coordinate system, first terminal Conversion between system obtains spatial position of the first terminal relative to spatial reference position.It in another embodiment, can also be with The actual scene image and related algorithm collected according to camera in first terminal obtains first terminal relative to space The spatial position of reference position.It should be noted that any spatial position that can obtain first terminal relative to reference position Method, all within protection scope of the present invention.
S105, according to the pose of the first terminal, the Dynamically Announce mesh in the image display area of the first terminal Scene is marked, the target scene includes default scene and/or the first terminal collected actual scene in real time.
Specifically, that is, first terminal has occurred when first terminal changes relative to the pose of spatial reference position The variation of position and/or direction, the collected actual scene image of the camera of first terminal can also change therewith therewith, Simultaneously as spatial reference position does not change, and therefore, the pre-set image shown in the image display area of first terminal, And the default scene shown in the display area in pre-set image also changes therewith.Based on this, when the first last phase for When the pose of spatial reference position changes, different target scenes will be shown in the image display area of first terminal.Tool Body, target scene, which can be the camera collected actual scene in real time of first terminal, to be virtual default field Scape can also be the combination of actual scene and default scene.
Optionally, when first terminal changes relative to the pose of reference position, it will lead to pre-set image first Angle and ratio for showing in the image display area of terminal etc. change.Therefore, in order to enable what pre-set image was shown It is more true, then it needs persistently to adjust pre-set image according to the pose of first terminal, specifically, first terminal is joined relative to space Examining the pose of position, there are one-to-one relationships with pre-set image, can determine pre-set image according to the one-to-one relationship Display scale and angle etc., and shown on the corresponding object pixel of spatial reference position.
In one embodiment, when above-mentioned pre-set image is the image of a 2D " door ", in order to enable pre-set image What is shown is more true, can not pass through georeferencing relative to the pose characterization first terminal of spatial reference position in first terminal Position includes the pixel of " door " in the image shown in the image display area of first terminal, and first terminal is relative to space The horizontal distance (can be obtained by first terminal relative to the pose of spatial reference position) of reference position less than a preset threshold, Such as 0.5m, then the image replacement of " door " that has shown that is shown as to the image of " door " opening, i.e., is shown as pre-set image Another pre-set image of display mode.
In method for changing scenes provided in this embodiment, first terminal shows camera reality in image display area first When collected actual scene image, and spatial reference position is determined in the space coordinates of actual scene, then in image The target pixel location Overlapping display pre-set image of display area is shown in the image display area of first terminal to realize Actual scene and pre-set image.Further, pose of the monitoring first terminal relative to spatial reference position, and eventually according to first The pose at end Dynamically Announce target scene in the image display area of first terminal, wherein target scene includes default scene And/or actual scene.Since first terminal provided by the present application can be according to its pose relative to spatial reference position, in image Different target scenes is shown in display area, therefore, method for changing scenes provided in this embodiment can realize true environment with Dummy object further interacts.
Based on above-mentioned S105, when first terminal changes relative to the pose of spatial reference position, first terminal The target scene shown in image display area is not also identical, specific:
If the pose meets the first preset condition, the display area Dynamically Announce in the pre-set image presets field Scape, first preset condition include at least: the pose does not pass through the spatial reference position.
Specifically, the display area in above-mentioned pre-set image shows the aobvious of other images for include in pre-set image Show region.For example, then the display area in above-mentioned pre-set image is " door " frame when pre-set image is the image of one " door " Interior region.
When the pose of first terminal meets the first preset condition relative to the pose of spatial reference position, then illustrate first It include the pixel of pre-set image in the image display area of terminal, therefore, when position of the first terminal relative to spatial reference position When appearance meets the first preset condition, pre-set image is shown at the target pixel location in the image display area of first terminal, And default scene is shown in the display area of pre-set image, the actual scene figure that camera takes is shown in other regions Picture, it is specific as shown in Figure 3.In addition, the display scale when pre-set image is corresponded in the display mode of default scene, that is, work as root When changing according to first terminal relative to the pose of spatial reference position, the variation such as the display scale of pre-set image and angle When, the display scale of the default scene shown in the display area in pre-set image also changes therewith with angle.
Above-mentioned with origin that spatial reference position is space coordinates shown in Fig. 2, pre-set image is one " door " front It is illustrated for 3D rendering, the first above-mentioned preset condition refers to spatial position of the first terminal relative to reference position In, within the scope of the coordinate value of coordinate value Y-axis in the initial spatial location of first terminal of Y-axis is greater than 0.
Above content is after showing pre-set image at object pixel in the image display area based on first terminal, and first eventually The case where posture information at end does not change.In order to avoid the posture information of first terminal shifts, so that first terminal Pose relative to spatial reference position does not pass through spatial reference position, and can not obtain in the image display area of first terminal The case where to pre-set image, therefore, the first above-mentioned preset condition further include: comprising pre- in the image display area of first terminal If the pixel of image.
Based on above content, when first terminal meets the first preset condition relative to the pose of reference position, characterization the In the image display area of one terminal include pre-set image pixel, and first terminal relative to spatial reference position pose not Across spatial reference position, then Overlapping display has default figure in the target pixel location of the image display area of first terminal at this time Picture, and the display area Dynamically Announce in pre-set image presets scene.Illustratively, when pre-set image is one " door " front Image, when the display area in above-mentioned pre-set image is the region inside " door " frame, when first terminal posture meets first When preset condition, the image of " door " frame is shown on the object pixel in the image display area of first terminal, and A virtual default scene is shown in " door " frame.In visual experience, subscriber station " door " outside, can be seen that in " door " frame Default scene, see the actual scene of " door " outer frame.
It is pre- described in the image display area Dynamically Announce of the first terminal if the pose meets the second preset condition If scene, and the collected actual field of camera of the first terminal described in the display area Dynamically Announce in the pre-set image Scape image, second preset condition include at least: the pose shape passes through the spatial reference position.
Above content is after showing pre-set image at object pixel in the image display area based on first terminal, and first eventually The direction of rotation of Z axis is 180 degree in the posture information at end, and first terminal is passed through relative to the spatial position of spatial reference position Spatial reference position, so that the case where can get the pixel of pre-set image in the image display area of first terminal, because This, the second above-mentioned preset condition further include: include the pixel of pre-set image in the image display area of first terminal.
When the pose of first terminal meets the second preset condition relative to the pose of spatial reference position, then at this time the Dynamic Overlapping display pre-set image in the target pixel location of the image display area of one terminal, and it is aobvious in pre-set image Show that region shows the collected actual scene image of camera of first terminal.Illustratively, when pre-set image is one " door " Positive image, when the display area in above-mentioned pre-set image is the region inside " door " frame, when first terminal posture meets When the second preset condition, the image of " door " frame is shown on the object pixel in the image display area of first terminal, And an actual scene image is shown in " door " frame.In visual experience, subscriber station is in " door " the inner direction towards " door " It sees, can be seen that the actual scene in " door " frame, see the virtual scene of " door " outer frame.
In addition, first terminal relative to spatial reference position pose in addition to meeting above-mentioned the first preset condition and second Outside preset condition, there is also other situations.For example, it is also possible to include following situation:
Situation 1: when first terminal meets four preset conditions relative to the pose of spatial reference position, described first Scene is preset described in the image display area Dynamically Announce of terminal, the 4th preset condition is that first terminal is joined relative to space The pose for examining position passes through spatial reference position, and does not include the picture of the pre-set image in the image display area of first terminal Element.
Specifically, being one " door " front with origin that spatial reference position is space coordinates shown in Fig. 2, pre-set image Image for be illustrated, the 4th above-mentioned preset condition refers to space of the first terminal relative to spatial reference position In position, the coordinate value of Y-axis is less than coordinate value (i.e. 0) range with reference to Y-axis in spatial position, and the image of first terminal is shown The pixel of the pre-set image is not included in region.
Based on above content, when first terminal posture meets four preset conditions, the image for characterizing first terminal is shown It does not include the pixel of pre-set image in region, and first terminal is across spatial reference position.Then at this time in the image of first terminal Display area shows default scene.Illustratively, when pre-set image is " door " positive image, in above-mentioned pre-set image Display area be " door " frame inside region when, when first terminal posture meet four preset conditions when, the figure of first terminal As default scene is shown on display area.In visual experience, subscriber station is inner at " door ", the direction other than direction " door " It sees.
Situation 2: when first terminal meets five preset conditions relative to the pose of reference position, in the first terminal Image display area Dynamically Announce actual scene, the 5th preset condition be first terminal relative to spatial reference position Pose shape does not pass through spatial reference position, and does not include the pixel of the pre-set image in the image display area of first terminal.
Specifically, being one " door " front with origin that spatial reference position is space coordinates shown in Fig. 2, pre-set image Image for be illustrated, the 5th above-mentioned preset condition refers to spatial position of the first terminal relative to reference position In, the coordinate value of Y-axis is greater than coordinate value (i.e. 0) range of Y-axis in georeferencing spatial position, and first terminal is on Z axis The angle of rotation makes the pixel for not including pre-set image in the image display area of first terminal.
Based on above content, when first terminal posture meets five preset conditions, the image for characterizing first terminal is shown It does not include the pixel of pre-set image in region, and first terminal is not across spatial reference position.Then at this time in the figure of first terminal As display area shows the collected actual scene of camera.Illustratively, when pre-set image be " door " positive image, When display area in above-mentioned pre-set image is the region inside " door " frame, when first terminal posture meets the 5th preset condition When, what is shown in the image display area of first terminal is only actual scene.In visual experience, subscriber station " door " outside, Direction other than towards " door " is seen.
A kind of flow diagram determining spatial reference position in space coordinates as shown in Figure 4, in order to further Raising first terminal intelligence, then above-mentioned spatial reference position can be determined by user.When user determines above-mentioned space When reference position, above-mentioned S102 specifically comprises the following steps:
S201, the Inertial Measurement Unit IMU information for obtaining the first terminal in real time, the first terminal camera adopt The actual scene image collected.
Specifically, above-mentioned actual scene image is identical as the explanation of actual scene image in above-mentioned S101, with And Inertial Measurement Unit IMU information is identical to the explanation of Inertial Measurement Unit IMU information with above-mentioned S104, herein no longer It repeats.
S202, it is surveyed according to the collected actual scene image of camera, the inertia of the first terminal got in real time Nomography is built in amount unit IMU information and positioning, establishes the threedimensional model of three-dimensional space locating for the first terminal, and determine Spatial position of the first terminal relative to the three-dimensional space.
Specifically, it is usually SLAM algorithm that nomography is built in above-mentioned positioning, naturally it is also possible to can be realized positioning for other With map structuring algorithm, to this present embodiment and without limitation.Above-mentioned three-dimensional space is actual scene locating for first terminal Stereoscopic three-dimensional space.By taking SLAM algorithm as an example, by the camera of first terminal collected actual scene image in real time, Yi Jishi When the IMU information input that gets into SLAM algorithm, will obtain the point cloud chart of three-dimensional space, i.e., above-mentioned threedimensional model, And first terminal arrives first terminal relative to three-dimensional space relative to the spatial position coordinate of any point cloud in the point cloud chart Between spatial position.
S203, when having touch action in the image display area for detecting the first terminal, described first is obtained eventually Touch-control dot position information in the image display area at end.
S204, the three-dimensional space according to locating for the touch-control dot position information, the first terminal threedimensional model and really Fixed spatial position of the first terminal relative to the three-dimensional space determines the corresponding spatial point of the touch point and described the Spatial position between one terminal.
Specifically, above-mentioned touch action can click any point in first terminal image display area for user, or Person user executes preset operation in the image display area of first terminal, such as, in the image display area of first terminal It slides etc..By taking touch action is a touch point as an example, a certain position in the image display area for detecting first terminal Set when being clicked by user, the position as a touch point, due in the image display area of first terminal can real-time display it is real Border scene image, therefore, touch point position can map a location of pixels in actual scene image here, i.e. touch point There are mapping relations for pixel in position and actual scene image.The point cloud chart of three-dimensional space is obtained based on above-mentioned S202, it can To know, the point cloud chart of three-dimensional space is established based on actual scene image, therefore, pixel and three-dimensional space in actual scene image There are mapping relations for point cloud.To sum up, according to the pixel in touch point position and actual scene image, there are mapping relations, Yi Jishi There are mapping relations for the point cloud of pixel and three-dimensional space in the scene image of border, and the point of touch point position and three-dimensional space can be obtained Mapping relations between cloud.That is, any one touch point can be three in the image display area of first terminal A matched cloud is found in the point cloud chart of dimension space.It is based on obtaining first terminal relative to the point cloud chart in above-mentioned S202 again The spatial position coordinate of middle any point cloud, it can obtain the corresponding space bit between spatial point and first terminal of touch point It sets.
S205, using the corresponding spatial point of the touch point as the origin of space coordinates, and be determined as space ginseng Examine position.
In the present embodiment, the touch action according to user in the image display area of first terminal determines that space is sat Spatial reference position in mark system, that is to say, that pre-set image is shown in the corresponding spatial point of touch point under touch action, this User experience can be improved in sample, the further intelligence for improving first terminal.
Based on above-mentioned content, the present invention can achieve a kind of actual scene effect as described below:
User is before the display screen for clicking mobile phone, the figure of actual scene locating for real-time display user on the display screen of mobile phone Picture, when the user clicks when one position of Ren on the aobvious screen of mobile phone, mobile phone obtains the corresponding location of pixels in the position, and in the picture The image of one " door " is shown on plain position.When user hand handle machine, above-mentioned pixel is observed that by the display screen of mobile phone Position is corresponding, and there are one " doors " on real space position.When user hand handle machine is walked to " door ", when going in front of " door " When 0.5m, user is observed that " door " closed originally becomes " door " of an opening on a display of the handset, and " door " Interior is virtual scene.When user hand handle machine continues to go ahead, user can observe virtual on a display of the handset Scene.When user hand handle machine turns in the opposite direction, it is practical that user, which can be observed on a display of the handset in " door ", Scene, and " door " other than be virtual scene.
The method flow schematic diagram of a kind of Overlapping display pre-set image as shown in Figure 5, in order to enable pre-set image is What is shown in the image display area of one terminal is more true, such as, when pre-set image is the image of one " door ", then need Gravity direction suffered by the short transverse of " door " and first terminal is shown unanimously, can just seem preset " door " first in this way " door " on the ground is installed in the closer reality of display effect in terminal.Therefore, it is necessary to the display directions to pre-set image It is adjusted correspondingly.Based on this, as shown in figure 5, above-mentioned S103 specifically comprises the following steps:
S1031, the gravity direction that the first terminal is subject to is obtained.
S1032, the gravity direction being subject to according to the first terminal, determine the display direction of the pre-set image.
S1033, the target pixel location superposition according to the display direction of the pre-set image, in described image display area Show pre-set image.
Specifically, the gravity direction that above-mentioned first terminal is subject to can be obtained according to the gravity sensor in first terminal It arrives.After determining gravity direction that first terminal is subject to, the short transverse of pre-set image and gravity direction can be shown as one It causes, i.e., the gravity direction being subject to first terminal is determined as the display direction of the short transverse of pre-set image.It is default determining After the display direction of image, first terminal image display area target pixel location according to the display side determined To display pre-set image.In this way, it is more true to can make pre-set image to show in the image display area of first terminal It is real.
In one embodiment, in order to enable the image shown in the image display area of first terminal is more nearly very It is real, such as, when having a mobile object between reference position and first terminal, which can show reference position Pre-set image blocked, rather than say, pre-set image is shown in front of mobile object, or is shown on mobile object, Therefore, it is necessary to detect to the mobile object between first terminal and reference position.Based on this, the embodiment of the present application further includes Following steps:
There is mobile target image if detecting between the first terminal and the reference position, by the target figure As being shown on the pre-set image.
Specifically, the figure of mobile object of the above-mentioned mobile target image between first terminal and spatial reference position Picture.When detecting between first terminal and reference position with the presence or absence of mobile target image, the camera of first terminal can be existed The collected actual scene image of a predetermined time before Overlapping display pre-set image is as reference picture, and by reference picture It is compared with the image shown in the image display area of first terminal after Overlapping display pre-set image, when Overlapping display is pre- If the image shown in the image display area of first terminal after image is also deposited in addition to pre-set image compared to reference picture In other images (image processing operations such as edge extracting can be carried out, it is determined whether there are other images), then first terminal is determined Exist between reference position mobile target image (other images i.e. above-mentioned).At this point, first terminal shows target image On the pre-set image.In this way, being more nearly the image shown in the image display area of first terminal really. It is traditional technology, details are not described herein it should be noted that showing target image on pre-set image.
The flow diagram of another kind method for changing scenes as shown in FIG. 6, in order to enable other terminals can be with first Terminal participates in the same scene jointly and interacts etc., i.e., the intelligence of terminal is further improved, therefore, at above-mentioned Further include following steps after above-mentioned S105 on the basis of one embodiment:
S106, by the spatial reference position, the first terminal relative to spatial reference position pose, described first The camera acquired image of terminal is sent in second terminal.
Specifically, above-mentioned second terminal is the various terminals comprising camera, for example, it is mobile phone, AR glasses, the AR helmet, flat Plate computer, notebook etc., the application is it is not limited here.In addition, first terminal and second terminal need to establish communication link in advance It connects, i.e., first terminal can be communicated with each other with second terminal.In practical applications, second terminal can be multiple.
Based on above content, the embodiment of the invention provides the flow diagrams of another method for changing scenes, such as Fig. 7 institute Show, specifically comprises the following steps:
S301, the spatial reference position for receiving first terminal transmission, the first terminal are relative to spatial reference position The camera acquired image of pose, the first terminal, the spatial reference position are the image display area of first terminal The corresponding spatial position of pixel in domain on Overlapping display pre-set image position.
S302, the collected actual scene image of camera for obtaining second terminal.
S303, it is acquired according to the camera acquired image of the second terminal and the camera of the first terminal The image arrived determines rotation and translation of the second terminal relative to the first terminal, the camera of the first terminal The camera acquired image of acquired image and the second terminal has intersection.
Specifically, due to the camera acquired image of first terminal and the camera acquired image of second terminal When having intersection, second terminal can just be acquired according to the camera acquired image of second terminal and the camera of first terminal The image arrived determines the rotation and translation of first terminal Yu the second terminal.It should be noted that according to second terminal The camera acquired image of camera acquired image and first terminal, determines first terminal and the second terminal Rotation and translation be traditional technology, to this, this embodiment is not repeated.
S304, the institute sent according to the rotation and translation of the first terminal and the second terminal, the first terminal The pose of reference position, the first terminal relative to spatial reference position is stated, determines the second terminal spatial reference position Between pose.
Specifically, superposition second terminal is whole relative to first on pose of the first terminal relative to spatial reference position Second terminal can be obtained relative to the pose between spatial reference position in the rotation and translation at end.It should be noted that herein " superposition " belong to the Geometrical change in traditional technology, details are not described herein.It, can be by first terminal and based on above-mentioned S304 Two terminals are included in a space coordinates.
It should be noted that any can be included in the method in the same space coordinates for first terminal and second terminal, All within the scope of protection of this application.
In addition, can be realized in another terminal (such as cloud server) above-mentioned to reduce the load of second terminal S301-S303 method, after the terminal obtains second terminal relative to the pose between spatial reference position, with wired or Wirelessly, second terminal is sent to second terminal relative to the posture between spatial reference position.
S305, the pre-set image is persistently adjusted according to the pose.
If S306, the pose meet third preset condition, the display area Dynamically Announce in the pre-set image is pre- If scene, the third preset condition includes at least: the pose makes the pre-set image in the display of the second terminal In region.
Specifically, the specific implementation of above-mentioned S305 and S306, similar with illustrating for above-mentioned S105, herein no longer It repeats.In addition, it is above-mentioned right to can refer to when second terminal is unsatisfactory for third preset condition relative to the pose of spatial reference position Pose of the first terminal relative to spatial reference position shows various forms of images in the image display area of second terminal, It also repeats no more herein.
In the present embodiment, second terminal can pose according to first terminal relative to spatial reference position, second terminal Translation and rotation relative to first terminal, it may be determined that go out itself pose relative to spatial reference position, while first terminal Also it can determine itself pose relative to spatial reference position, the two all can be according to itself pose in itself image display area Domain shows corresponding image, i.e., can all show actual scene image, pre- in second terminal and the image display area of first terminal If the default scene image of Dynamically Announce in image and pre-set image, it is in same with second terminal to reach first terminal Visual effect in a scene, therefore, method for changing scenes provided in this embodiment can be realized same true in multiple terminals Environment is further interacted with same dummy object.
It should be understood that although each step in the flow chart of Fig. 1,4-7 is successively shown according to the instruction of arrow, It is these steps is not that the inevitable sequence according to arrow instruction successively executes.Unless expressly stating otherwise herein, these steps There is no stringent sequences to limit for rapid execution, these steps can execute in other order.Moreover, in Fig. 1,4-7 extremely Few a part of step may include that perhaps these sub-steps of multiple stages or stage are not necessarily same to multiple sub-steps Moment executes completion, but can execute at different times, and the execution sequence in these sub-steps or stage is also not necessarily It successively carries out, but in turn or can be handed over at least part of the sub-step or stage of other steps or other steps Alternately execute.
If Fig. 8 is a kind of device for changing scenes for providing of one embodiment, as shown in Figure 8, comprising: acquisition module 11, really Cover half block 12, the first display module 13, monitoring modular 14 and the second display module 15, in which:
Acquisition module 11 shows that the camera of the first terminal is adopted in real time for the image display area in first terminal The actual scene image collected;
Determining module 12, for determining spatial reference position in the space coordinates of the actual scene;
First display module 13, for the target pixel location Overlapping display pre-set image in described image display area, The target pixel location is spatial reference position respective pixel position in described image display area, the default figure The relatively described actual scene image in the spatial position of picture is fixed, and presets the viewing area of scene in the pre-set image comprising showing Domain;
Monitoring modular 14, for monitoring pose of the first terminal relative to reference position, the pose includes described First terminal posture information and the spatial position relative to the reference position;
Second display module 15, for the pose according to the first terminal, in the image display area of the first terminal Dynamically Announce target scene in domain, the target scene include default scene and/or the first terminal collected reality in real time Border scene.
Device for changing scenes provided in this embodiment can execute the embodiment of above-mentioned method as shown in Figure 1, realize former Reason is similar with technical effect, and details are not described herein.
On the basis of the above embodiments, the second display module 15, if being also used to the pose meets the first preset condition, Display area Dynamically Announce in the pre-set image presets scene, and first preset condition includes at least: the pose The spatial reference position is not passed through;
Alternatively, if the pose meets the second preset condition, in the image display area Dynamically Announce of the first terminal The default scene, and the camera of the first terminal described in the display area Dynamically Announce in the pre-set image is collected Actual scene image, second preset condition include at least: the pose passes through the spatial reference position.
If Fig. 9 is another device for changing scenes that one embodiment provides, as shown in figure 9, in above-mentioned reality as shown in Figure 8 On the basis of applying example, above-mentioned determining module 12, further includes: acquiring unit 121 and determination unit 122, in which:
Acquiring unit 121, for obtain in real time the first terminal Inertial Measurement Unit IMU information, it is described first eventually The collected actual scene image of the camera at end;
Determination unit 122, for building figure according to the actual scene image, Inertial Measurement Unit IMU information and positioning Algorithm establishes the threedimensional model of three-dimensional space locating for the first terminal, and determines the first terminal relative to described three The spatial position of dimension space;
Acquiring unit 121 obtains when being also used to have touch action in the image display area for detecting the first terminal Take the touch-control dot position information in the image display area of the first terminal;
Determination unit 122 is also used to three of the three-dimensional space according to locating for the touch-control dot position information, the first terminal The spatial position of dimension module and the determining first terminal relative to the three-dimensional space, determines the corresponding sky of the touch point Between put and the first terminal between spatial position;
Determination unit 122 is also used to using the corresponding spatial point of the touch point as the origin of space coordinates, and is determined For the spatial reference position.
Device for changing scenes provided in this embodiment can execute the embodiment of above-mentioned method as shown in Figure 4, realize former Reason is similar with technical effect, and details are not described herein.
If Figure 10 is another device for changing scenes that one embodiment provides, as shown in Figure 10, in above-mentioned Fig. 8 or Fig. 9 On the basis of illustrated embodiment, the first above-mentioned display module 13 further include: gravity acquiring unit 131, direction-determining unit 132 And display unit 133, in which:
Gravity acquiring unit 131, the gravity direction being subject to for obtaining the first terminal;
Direction-determining unit 132, the gravity direction for being subject to according to the first terminal, determines the pre-set image Display direction;
Display unit 133, the target picture for the display direction according to the pre-set image, in described image display area Plain position Overlapping display pre-set image.
Device for changing scenes provided in this embodiment can execute the embodiment of above-mentioned method as shown in Figure 5, realize former Reason is similar with technical effect, and details are not described herein.
On the basis of the above embodiments, the first display module 13, if be also used to detect the first terminal with it is described There is mobile target image between reference position, then shows the target image on the pre-set image.
If Figure 11 is another device for changing scenes that one embodiment provides, as shown in figure 11, in any reality of above-mentioned figure On the basis of applying example, the device further include: sending module 16, in which:
Sending module 16, for by the reference position, the first terminal relative to reference position pose, described The camera acquired image of one terminal is sent in second terminal.
Device for changing scenes provided in this embodiment can execute the embodiment of above-mentioned method as shown in Figure 6, realize former Reason is similar with technical effect, and details are not described herein.
If Figure 12 is a kind of device for changing scenes again that one embodiment provides, as shown in figure 11, the device further include: connect It receives module 21, obtain module 22, the first determining module 23, the second determining module 24, adjustment module 25 and display module 26, In:
Receiving module 21, the spatial reference position, the first terminal for receiving first terminal transmission are relative to described The camera acquired image of the pose of spatial reference position, the first terminal, the spatial reference position are first whole The corresponding spatial position of pixel in the image display area at end on Overlapping display pre-set image position;
Module 22 is obtained, for obtaining the camera acquired image of second terminal;
First determining module 23, for according to the camera acquired image of the second terminal and described first eventually The camera acquired image at end, determines rotation and translation of the second terminal relative to the first terminal, described The camera acquired image of one terminal and the camera acquired image of the second terminal have intersection;
Second determining module 24, for the rotation and translation according to the second terminal relative to the first terminal, institute The pose of the spatial reference position, the first terminal of first terminal transmission relative to the spatial reference position is stated, really The fixed second terminal is relative to the pose between spatial reference position;
Module 25 is adjusted, for persistently adjusting the pre-set image according to the pose;
Display module 26, if meeting third preset condition for the pose, the display area in the pre-set image Dynamically Announce presets scene, and the third preset condition includes at least: the pose does not pass through the spatial reference position.
Device for changing scenes provided in this embodiment can execute the embodiment of above-mentioned method as shown in Figure 7, realize former Reason is similar with technical effect, and details are not described herein.
In one embodiment, a kind of terminal is provided, including memory, processor and storage are on a memory and can be The computer program run on processor, the processor perform the steps of when executing computer program
The camera of the first terminal collected actual scene in real time is shown in the image display area of first terminal Image;
Spatial reference position is determined in the space coordinates of the actual scene;
Target pixel location Overlapping display pre-set image in described image display area, the target pixel location are institute Spatial reference position respective pixel position in described image display area is stated, the spatial position of the pre-set image is relatively described Actual scene image is fixed, and presets the display area of scene in the pre-set image comprising showing;
Pose of the first terminal relative to the spatial reference position is monitored, the pose includes the first terminal Posture information and the spatial position relative to the spatial reference position;
According to the pose of the first terminal, the Dynamically Announce target field in the image display area of the first terminal Scape, the target scene include default scene and/or the first terminal collected actual scene in real time.
In one embodiment, a kind of terminal is provided, including memory, processor and storage are on a memory and can be The computer program run on processor, the processor perform the steps of when executing computer program
Receive the position of the spatial reference position, the first terminal of first terminal transmission relative to the spatial reference position Appearance, the camera acquired image of the first terminal, the spatial reference position are the image display area of first terminal The corresponding spatial position of pixel on middle Overlapping display pre-set image position;
Obtain the camera acquired image of second terminal;
Camera according to the camera acquired image of the second terminal and the first terminal is collected Image determines rotation and translation of the second terminal relative to the first terminal, the camera acquisition of the first terminal To image and the camera acquired image of the second terminal have intersection;
Described in being sent according to the second terminal relative to the rotation and translation of the first terminal, the first terminal The pose of spatial reference position, the first terminal relative to the spatial reference position, determine the second terminal relative to Pose between spatial reference position;
The pre-set image is persistently adjusted according to the pose;
If the pose meets third preset condition, the display area Dynamically Announce in the pre-set image presets field Scape, the third preset condition include at least: the pose does not pass through the spatial reference position.
In one embodiment, the present embodiment additionally provides a kind of terminal, including memory, processor and is stored in storage On device and the computer program that can run on a processor, the processor perform the steps of when executing computer program
The camera of the first terminal collected actual scene in real time is shown in the image display area of first terminal Image;
Spatial reference position is determined in the space coordinates of the actual scene;
Target pixel location Overlapping display pre-set image in described image display area, the target pixel location are institute Spatial reference position respective pixel position in described image display area is stated, the spatial position of the pre-set image is relatively described Actual scene image is fixed, and presets the display area of scene in the pre-set image comprising showing;
Pose of the first terminal relative to the spatial reference position is monitored, the pose includes the first terminal Posture information and the spatial position relative to the spatial reference position;
According to the pose of the first terminal, the Dynamically Announce target field in the image display area of the first terminal Scape, the target scene include default scene and/or the first terminal collected actual scene in real time.
In one embodiment, the present embodiment additionally provides a kind of terminal, including memory, processor and is stored in storage On device and the computer program that can run on a processor, the processor perform the steps of when executing computer program
Receive the position of the spatial reference position, the first terminal of first terminal transmission relative to the spatial reference position Appearance, the camera acquired image of the first terminal, the spatial reference position are the image display area of first terminal The corresponding spatial position of pixel on middle Overlapping display pre-set image position;
Obtain the camera acquired image of second terminal;
Camera according to the camera acquired image of the second terminal and the first terminal is collected Image determines rotation and translation of the second terminal relative to the first terminal, the camera acquisition of the first terminal To image and the camera acquired image of the second terminal have intersection;
Described in being sent according to the second terminal relative to the rotation and translation of the first terminal, the first terminal The pose of spatial reference position, the first terminal relative to the spatial reference position, determine the second terminal relative to Pose between spatial reference position;
The pre-set image is persistently adjusted according to the pose;
If the pose meets third preset condition, the display area Dynamically Announce in the pre-set image presets field Scape, the third preset condition include at least: the pose does not pass through the spatial reference position.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with Relevant hardware is instructed to complete by computer program, the computer program can be stored in a non-volatile computer In read/write memory medium, the computer program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, To any reference of memory, storage, database or other media used in each embodiment provided herein, Including non-volatile and/or volatile memory.Nonvolatile memory may include read-only memory (ROM), programming ROM (PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include Random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms, Such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhancing Type SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
Each technical characteristic of above embodiments can be combined arbitrarily, for simplicity of description, not to above-described embodiment In each technical characteristic it is all possible combination be all described, as long as however, the combination of these technical characteristics be not present lance Shield all should be considered as described in this specification.
The several embodiments of the application above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously It cannot therefore be construed as limiting the scope of the patent.It should be pointed out that coming for those of ordinary skill in the art It says, without departing from the concept of this application, various modifications and improvements can be made, these belong to the protection of the application Range.Therefore, the scope of protection shall be subject to the appended claims for the application patent.

Claims (13)

1. a kind of method for changing scenes, which is characterized in that the described method includes:
The camera of the first terminal collected actual scene image in real time is shown in the image display area of first terminal;
Spatial reference position is determined in the space coordinates of the actual scene;
Target pixel location Overlapping display pre-set image in described image display area, the target pixel location are the sky Between reference position respective pixel position in described image display area, the relatively described reality in the spatial position of the pre-set image Scene image is fixed, and presets the display area of scene in the pre-set image comprising showing;
Pose of the first terminal relative to the spatial reference position is monitored, the pose includes the first terminal posture Information and the spatial position relative to the spatial reference position;
According to the pose of the first terminal, the Dynamically Announce target scene in the image display area of the first terminal, institute Stating target scene includes the default scene and/or the first terminal collected actual scene in real time.
2. the method according to claim 1, wherein the pose according to the first terminal, described Dynamically Announce target scene in the image display area of one terminal, comprising:
If the pose meets the first preset condition, the display area Dynamically Announce in the pre-set image presets scene, institute State the first preset condition to include at least: the pose does not pass through the spatial reference position;
Alternatively, if the pose meets the second preset condition, described in the image display area Dynamically Announce of the first terminal Default scene, and the collected reality of camera of the first terminal described in the display area Dynamically Announce in the pre-set image Scene image, second preset condition include at least: the pose passes through the spatial reference position.
3. the method according to claim 1, wherein described determine in the space coordinates of the actual scene Spatial reference position, comprising:
The Inertial Measurement Unit IMU information of the first terminal, the collected reality of camera of the first terminal are obtained in real time Border scene image;
Nomography is built according to the actual scene image, Inertial Measurement Unit IMU information and positioning, establishes the first terminal The threedimensional model of locating three-dimensional space, and determine spatial position of the first terminal relative to the three-dimensional space;
When having touch action in the image display area for detecting the first terminal, the image for obtaining the first terminal is aobvious Show the touch-control dot position information in region;
According to the threedimensional model of three-dimensional space locating for the touch-control dot position information, the first terminal and determining described first Spatial position of the terminal relative to the three-dimensional space determines between the corresponding spatial point of the touch point and the first terminal Spatial position;
Using the corresponding spatial point of the touch point as the origin of space coordinates, and it is determined as the spatial reference position.
4. the method according to claim 1, wherein the target pixel location in described image display area Overlapping display pre-set image, comprising:
Obtain the gravity direction that the first terminal is subject to;
According to the gravity direction that the first terminal is subject to, the display direction of the pre-set image is determined;
According to the display direction of the pre-set image, the target pixel location Overlapping display in described image display area presets figure Picture.
5. the method according to claim 1, wherein the method also includes:
There is mobile target image if detecting between the first terminal and the spatial reference position, by the target figure As being shown on the pre-set image.
6. the method according to claim 1, wherein the method also includes:
Pose, the first terminal by the spatial reference position, the first terminal relative to the spatial reference position Camera acquired image be sent in second terminal.
7. a kind of method for changing scenes, which is characterized in that the described method includes:
Receive first terminal send spatial reference position, the first terminal relative to the spatial reference position pose, The camera acquired image of the first terminal, the spatial reference position are to fold in the image display area of first terminal Add the corresponding spatial position of pixel on display pre-set image position;
Obtain the camera acquired image of second terminal;
According to the camera acquired image of the second terminal and the camera acquired image of the first terminal, Determine rotation and translation of the second terminal relative to the first terminal, the collected figure of the camera of the first terminal As the camera acquired image with the second terminal has intersection;
The space sent according to the second terminal relative to the rotation and translation of the first terminal, the first terminal The pose of reference position, the first terminal relative to the spatial reference position determines the second terminal relative to space Pose between reference position;
The pre-set image is persistently adjusted according to the pose;
If the pose meets third preset condition, the display area Dynamically Announce in the pre-set image presets scene, institute State third preset condition to include at least: the pose does not pass through the spatial reference position.
8. a kind of device for changing scenes, which is characterized in that described device includes:
Acquisition module is used for, and shows that the camera of the first terminal collects in real time in the image display area of first terminal Actual scene image;
Determining module, for determining spatial reference position in the space coordinates of the actual scene;
First display module, for the target pixel location Overlapping display pre-set image in described image display area, the mesh Mark location of pixels is spatial reference position respective pixel position in described image display area, the sky of the pre-set image Between the relatively described actual scene image in position fix, and comprising showing the display area of default scene in the pre-set image;
Monitoring modular, for monitoring pose of the first terminal relative to the spatial reference position, the pose includes institute State first terminal posture information and the spatial position relative to the spatial reference position;
Second display module moves in the image display area of the first terminal for the pose according to the first terminal State displaying target scene, the target scene include default scene and/or the first terminal collected actual scene in real time.
9. a kind of device for changing scenes, which is characterized in that described device includes:
Receiving module, for receiving the spatial reference position of first terminal transmission, the first terminal is joined relative to the space The pose of position, the camera acquired image of the first terminal are examined, the spatial reference position is the figure of first terminal As the corresponding spatial position of pixel in display area on Overlapping display pre-set image position;
Module is obtained, for obtaining the camera acquired image of second terminal;
First determining module, for according to the camera acquired image of the second terminal and taking the photograph for the first terminal As head acquired image, rotation and translation of the second terminal relative to the first terminal, the first terminal are determined Camera acquired image and the camera acquired image of the second terminal have intersection;
Second determining module, for according to the second terminal relative to the first terminal rotation and translation, described first The pose relative to the spatial reference position of the spatial reference position, the first terminal that terminal is sent, determine described in Second terminal is relative to the pose between spatial reference position;
Module is adjusted, for persistently adjusting the pre-set image according to the pose;
Display module, if meeting third preset condition for the pose, the display area dynamic in the pre-set image is aobvious Show that default scene, the third preset condition include at least: the pose does not pass through the spatial reference position.
10. a kind of terminal, including memory and processor, the memory are stored with computer program, which is characterized in that described The step of processor realizes any one of claims 1 to 6 the method when executing the computer program.
11. a kind of terminal, including memory and processor, the memory are stored with computer program, which is characterized in that described The step of processor realizes claim 7 the method when executing the computer program.
12. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program The step of method described in any one of claims 1 to 6 is realized when being executed by processor.
13. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program The step of method of claim 7 is realized when being executed by processor.
CN201810643987.7A 2018-06-21 2018-06-21 Scene switching method, device, terminal and computer storage medium Active CN109002162B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810643987.7A CN109002162B (en) 2018-06-21 2018-06-21 Scene switching method, device, terminal and computer storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810643987.7A CN109002162B (en) 2018-06-21 2018-06-21 Scene switching method, device, terminal and computer storage medium

Publications (2)

Publication Number Publication Date
CN109002162A true CN109002162A (en) 2018-12-14
CN109002162B CN109002162B (en) 2021-06-22

Family

ID=64601064

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810643987.7A Active CN109002162B (en) 2018-06-21 2018-06-21 Scene switching method, device, terminal and computer storage medium

Country Status (1)

Country Link
CN (1) CN109002162B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112399068A (en) * 2019-08-16 2021-02-23 触景无限科技(北京)有限公司 Image processing system and image processing method
CN112577488A (en) * 2020-11-24 2021-03-30 腾讯科技(深圳)有限公司 Navigation route determining method, navigation route determining device, computer equipment and storage medium
WO2022021965A1 (en) * 2020-07-30 2022-02-03 北京市商汤科技开发有限公司 Virtual object adjustment method and apparatus, and electronic device, computer storage medium and program

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170278486A1 (en) * 2014-08-27 2017-09-28 Sony Corporation Display control apparatus, display control method, and program
CN108008817A (en) * 2017-12-01 2018-05-08 西安枭龙科技有限公司 A kind of method for realizing virtual reality fusion

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170278486A1 (en) * 2014-08-27 2017-09-28 Sony Corporation Display control apparatus, display control method, and program
CN108008817A (en) * 2017-12-01 2018-05-08 西安枭龙科技有限公司 A kind of method for realizing virtual reality fusion

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112399068A (en) * 2019-08-16 2021-02-23 触景无限科技(北京)有限公司 Image processing system and image processing method
CN112399068B (en) * 2019-08-16 2022-05-03 触景无限科技(北京)有限公司 Image processing system and image processing method
WO2022021965A1 (en) * 2020-07-30 2022-02-03 北京市商汤科技开发有限公司 Virtual object adjustment method and apparatus, and electronic device, computer storage medium and program
CN112577488A (en) * 2020-11-24 2021-03-30 腾讯科技(深圳)有限公司 Navigation route determining method, navigation route determining device, computer equipment and storage medium
CN112577488B (en) * 2020-11-24 2022-09-02 腾讯科技(深圳)有限公司 Navigation route determining method, navigation route determining device, computer equipment and storage medium

Also Published As

Publication number Publication date
CN109002162B (en) 2021-06-22

Similar Documents

Publication Publication Date Title
US11217019B2 (en) Presenting image transition sequences between viewing locations
US20210142582A1 (en) Display of an occluded object in a hybrid-reality system
US20200380769A1 (en) Image processing method and apparatus, storage medium, and computer device
Behzadan et al. Augmented reality visualization: A review of civil infrastructure system applications
CN101794349B (en) Experimental system and method for augmented reality of teleoperation of robot
US8823855B2 (en) User equipment and method for providing augmented reality (AR) service
CN104662587B (en) Three-dimensional user interface device and three-dimensional manipulating method
AU2023275894A1 (en) Automated control of image acquisition via use of mobile device user interface
US11321929B2 (en) System and method for spatially registering multiple augmented reality devices
JP6458371B2 (en) Method for obtaining texture data for a three-dimensional model, portable electronic device, and program
US20180144555A1 (en) Determining and/or generating data for an architectural opening area associated with a captured three-dimensional model
CN109002162A (en) Method for changing scenes, device, terminal and computer storage medium
DE112013003257T5 (en) Improved information transfer through a transparent display
CN106062821A (en) Sensor-based camera motion detection for unconstrained slam
WO2019168886A1 (en) System and method for spatially mapping smart objects within augmented reality scenes
CN113936121A (en) AR (augmented reality) label setting method and remote collaboration system
CN113160270A (en) Visual map generation method, device, terminal and storage medium
US20220130064A1 (en) Feature Determination, Measurement, and Virtualization From 2-D Image Capture
CN115731349A (en) Method and device for displaying house type graph, electronic equipment and storage medium
JP7280223B2 (en) Information terminal device, remote communication support method and program
CN110232744A (en) A kind of display methods and device
JP2024072072A (en) Information processing device
CN109242953A (en) A method of realizing the three-dimensional data volume drawing of aerial display and virtual interacting
WO2023040551A1 (en) Method for displaying image on display screen, electronic device, and apparatus
CN115810065A (en) House information editing method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant