CN106843790A - A kind of information display system and method - Google Patents
A kind of information display system and method Download PDFInfo
- Publication number
- CN106843790A CN106843790A CN201710061210.5A CN201710061210A CN106843790A CN 106843790 A CN106843790 A CN 106843790A CN 201710061210 A CN201710061210 A CN 201710061210A CN 106843790 A CN106843790 A CN 106843790A
- Authority
- CN
- China
- Prior art keywords
- information
- scene
- dimensional
- server
- exhibition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
Abstract
The invention provides a kind of information display system and method, the system includes:Picture pick-up device, the first scene information for obtaining scene residing for the picture pick-up device, first scene information is transmitted to the server;Smart machine, for showing three-dimensional exhibition information, and obtains the second scene information of scene residing for the smart machine, and second scene information and the three-dimensional exhibition information are transmitted to the server;Server, for according to first scene information and second scene information for receiving, processing the three-dimensional exhibition information, obtains three-dimensional scenic exhibition information, and the three-dimensional scenic exhibition information is transmitted to the display device;Display device, for showing the three-dimensional scenic exhibition information.Present invention also offers corresponding information displaying method.
Description
Technical field
The present invention relates to a kind of information display system and method.
Background technology
At present, conventional information display technique be used to imparting knowledge to students, exhibition, opening ceremony, podium, etc. need the field of exhibition information
Close, be mainly the element combinations such as figure, word, the animation that will design, in output to display device, by projection or
Display screen is illustrated in spectators at the moment, but information exhibition method is single, lack spatial interaction.
It is, therefore, desirable to provide a set of can realize spatial interaction function, will believe with reference to technologies such as augmented reality, holographic displays
The system that breath preferably shows.
The content of the invention
In view of this, it is an object of the invention to provide a kind of information display system and method, with try hard to solve or extremely
Alleviate the problem for existing above less.
In a first aspect, the embodiment of the invention provides a kind of information display system, the system includes:Picture pick-up device, display
Equipment, smart machine and server, wherein
The picture pick-up device, the first scene information for obtaining scene residing for the picture pick-up device, by first scene
Information transfer is to the server;
The smart machine, for showing three-dimensional exhibition information, and obtain scene residing for the smart machine
Two scene informations, second scene information and the three-dimensional exhibition information are transmitted to the server;
The server, for according to first scene information and second scene information for receiving, to described
Three-dimensional exhibition information is processed, and obtains three-dimensional scenic exhibition information, and the three-dimensional scenic exhibition information is transmitted to institute
State display device;
The display device, for showing the three-dimensional scenic exhibition information.
Alternatively, in the method according to the invention, the server is additionally operable to:
The coordinate system of first scene information of the picture pick-up device transmission that will be received is demarcated as target-based coordinate system.
Alternatively, in the method according to the invention, the server is additionally operable to:
After the three-dimensional exhibition information is received, the coordinate system of the three-dimensional exhibition information is transformed into institute
Target-based coordinate system is stated, objective virtual display information is obtained;
First scene information and the objective virtual display information are processed, the three-dimensional scenic is obtained
Exhibition information.
Alternatively, in the method according to the invention, the server is additionally operable to:
According to first scene information and second scene information, using iteration closest approach algorithm, described the is calculated
Transitional information between the coordinate system of two scene informations and the target-based coordinate system;
According to the transitional information, conversion process is carried out to the three-dimensional exhibition information, obtain the objective
Virtual display information.
Alternatively, in the method according to the invention, wherein,
The smart machine is additionally operable to the operation information outside acquisition, and the operation information is transmitted to the server;
The server is additionally operable to, according to the three-dimensional scenic exhibition information and the operation information, adjust the three dimensional field
The display location in the display device of scape exhibition information.
Second aspect, The embodiment provides a kind of information displaying method, using information display system as above,
The method includes:
The first scene information of scene residing for the picture pick-up device is obtained by the picture pick-up device, by first scene letter
Breath is transmitted to the server;
Three-dimensional exhibition information, and obtain scene residing for the smart machine second are shown by the smart machine
Scene information, second scene information and the three-dimensional exhibition information are transmitted to the server;
By the server according to first scene information and second scene information for receiving, to described three
Dimension virtual display information is processed, and obtains three-dimensional scenic exhibition information, and the three-dimensional scenic exhibition information is transmitted to described
Display device;
The three-dimensional scenic exhibition information is shown by the display device.
Alternatively, in a device in accordance with the invention, it is described by the server according to described first for receiving
Scape information and second scene information, are processed the three-dimensional exhibition information, including:
The coordinate system of first scene information that the picture pick-up device that will be received by the server is transmitted is demarcated
It is target-based coordinate system.
Alternatively, in a device in accordance with the invention, believed according to first scene for receiving by the server
Breath and second scene information, are processed the three-dimensional exhibition information, are also included:
By the server after the three-dimensional exhibition information is received, by the three-dimensional exhibition information
Coordinate system is transformed into the target-based coordinate system, obtains objective virtual display information;
First scene information and the objective virtual display information are processed by the server, is obtained
To the three-dimensional scenic exhibition information.
Alternatively, in a device in accordance with the invention, it is described that the three-dimensional exhibition is being received by the server
After showing information, the coordinate system of the three-dimensional exhibition information is transformed into the target-based coordinate system, obtains objective virtual
Exhibition information, including:
By the server according to first scene information and second scene information, counted recently using iteration
Method, calculates the transitional information between the coordinate system and the target-based coordinate system of second scene information;
By the server according to the transitional information, conversion process is carried out to the three-dimensional exhibition information, obtained
To the objective virtual display information.
Alternatively, in a device in accordance with the invention, also include:
By the operation information outside smart machine acquisition, the operation information is transmitted to the server;
By the server according to the three-dimensional scenic exhibition information and the operation information, the three-dimensional scenic is adjusted
The display location in the display device of exhibition information.
In the inventive solutions, obtained from different perspectives in Same Scene not by picture pick-up device and smart machine
With scene information, and three-dimensional exhibition information to being pre-set in different scene information and smart machine processes
Three-dimensional scenic exhibition information is obtained, user's viewing visual angle is increased, the degree of accuracy of three-dimensional scenic exhibition information is improve, improve
Enjoyment.
To enable the above objects, features and advantages of the present invention to become apparent, preferred embodiment cited below particularly, and coordinate
Appended accompanying drawing, is described in detail below.
Brief description of the drawings
Technical scheme in order to illustrate more clearly the embodiments of the present invention, below will be attached to what is used needed for embodiment
Figure is briefly described, it will be appreciated that the following drawings illustrate only certain embodiments of the present invention, thus be not construed as it is right
The restriction of scope, for those of ordinary skill in the art, on the premise of not paying creative work, can also be according to this
A little accompanying drawings obtain other related accompanying drawings.
Fig. 1 shows a kind of structure chart of information display system that the embodiment of the present invention is provided;
Fig. 2 shows that a kind of depth camera that the embodiment of the present invention is provided gathers the schematic diagram in the visual field;
Fig. 3 shows the schematic diagram of information displaying scene in a kind of smart machine that the embodiment of the present invention is provided;
Fig. 4 shows a kind of flow chart of information displaying method that the embodiment of the present invention is provided.
Specific embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
Middle accompanying drawing, is clearly and completely described to the technical scheme in the embodiment of the present invention, it is clear that described embodiment is only
It is a part of embodiment of the invention, rather than whole embodiments.The present invention generally described and illustrated in accompanying drawing herein is real
The component for applying example can be arranged and designed with a variety of configurations.Therefore, it is of the invention to what is provided in the accompanying drawings below
The detailed description of embodiment is not intended to limit the scope of claimed invention, but is merely representative of selected reality of the invention
Apply example.Based on embodiments of the invention, the institute that those skilled in the art are obtained on the premise of creative work is not made
There is other embodiment, belong to the scope of protection of the invention.
Fig. 1 shows the structure chart of information display system according to an embodiment of the invention.As shown in figure 1, this is
System includes:Picture pick-up device 110, display device 120, smart machine 130 and server 140.
Picture pick-up device 110 is used to obtain the first scene information of scene residing for the picture pick-up device, and first scene is believed
Breath is sent to server 140.First scene information is generally comprised in image information, depth information and the picture pick-up device of the first scene
Data (IMU data) of Inertial Measurement Unit (IMU) output etc..Wherein, the first scene refers generally to the field in the picture pick-up device visual field
Scape, IMU data generally comprise attitude angle, acceleration, speed of equipment etc., and depth information refers to be obtained by three-dimensional reconstruction function
Three dimensional space coordinate information, the profile in space can be embodied.Such as, there was only two dimensions for a width picture, then obtain
Depth information on picture direction, just constitutes a three-dimensional information, and substantial amounts of three-dimensional coordinate point is macroscopically being seen just
It is a cloud information, embodies the profile in space.
The shooting that picture pick-up device 110 includes but is not limited to camera, depth camera, can obtain depth information is first-class,
For example, HoloLens equipment, Kinect video camera etc..The picture pick-up device has three-dimensional reconstruction function and tracking function.At one
In embodiment, in certain new product release, due to the limited view (referring to Fig. 2) of depth camera such as Hololens, Kinect, hair
Cloth meeting meeting-place can set multiple depth cameras, for example, being arranged on each corner in meeting-place, all be drawn to photograph meeting-place
Face.
Smart machine 130 includes display screen, depth camera, luminosity sensor, environment sensing camera, 2,000,000 pictures
Plain camera, memory cell etc., are previously stored with three-dimensional exhibition information, depth camera, luminosity sensing in memory cell
Device etc. can be used for display three-dimensional exhibition information as virtual for detecting, catch the gesture etc. of wearer in smart machine 130
Fantasy football, court in scene etc., and the second scene information of scene residing for the smart machine is obtained, and the second scene is believed
Breath and three-dimensional exhibition information are transmitted to server 140.Second scene information includes the image information of the second scene, depth
Information and the data (IMU data) of Inertial Measurement Unit (IMU) output etc., the second scene refers generally to the field in the smart machine visual field
The information of the Same Scene that scape, the first scene information and the second scene information are usually obtained from different perspectives, the IMU data
Attitude angle, acceleration, speed including equipment etc..Smart machine 130 can be but not limited to wearable device, intelligent glasses,
With showing virtual information and obtaining portable set of scene information etc., for example, the smart machine can be HoloLens
Mirror, in addition, the smart machine has three-dimensional reconstruction function and tracking function.
Hololens holographic glasses are the special spectacles for merging CPU, GPU and hologram processor, by picture images harmony
Sound, can just enter the augmented reality world in allowing wearer indoors, holographic experience is carried out by carrier of surrounding enviroment.Wearer can
With by HoloLens, using actual surrounding environment as carrier, various virtual informations are added above in picture.Can check indoors
Martian surface, human heart model, even number enter virtual well-known sight spot, can be possibly realized by HoloLens.Example
Such as, after the person of giving lessons wears Hololens holographic glasses, can be by lecture contents, such as the religion such as manikin, moisture submodel
Content is learned to be showed in the way of holography, and wearer can move to the content of courses, scale, rotate etc. and operating,
For student carries out careful teaching explanation.
Server 140 is used to, according to the first scene information and the second scene information for receiving, show three-dimensional and believe
Breath is processed, and obtains three-dimensional scenic exhibition information, and three-dimensional scenic exhibition information is transmitted to display device 120.Display device
120 display three-dimensional scenic exhibition information.Wherein, display device can be but not limited to projecting apparatus, display screen, LED screen, with aobvious
Show screen of function etc..
In one embodiment, the coordinate system of the second scene information of the smart machine transmission that server 140 will be received
It is demarcated as target-based coordinate system, or, the coordinate of the first scene information that the picture pick-up device 110 that server 140 will be received is transmitted
System is demarcated as target-based coordinate system, or, server 140 can directly using world coordinate system as target-based coordinate system.Wherein, target
Coordinate system is used for all data unifications for receiving server in same coordinate system, it should here be understood that, coordinates of targets
The demarcation of system be only it is schematic, it is all can by data unification to the same coordinate system coordinate system all in protection model of the invention
In enclosing.
The present invention can be used following any one mode to obtain needing the three-dimensional scenic exhibition information of displaying.
When the coordinate system of the first scene information is demarcated as target-based coordinate system by server 140, server 140 is being received
After three-dimensional exhibition information, by the coordinate system converting into target coordinate system of three-dimensional exhibition information, objective is obtained empty
Intend exhibition information.First scene information and objective virtual display information are processed, three-dimensional scenic exhibition information is obtained.
When the coordinate system of the second scene information is demarcated as target-based coordinate system by server 140, server 140 is being received
After first scene information, by the coordinate system converting into target coordinate system of the first scene information, first object scene information is obtained, connect
After receiving three-dimensional exhibition information, by the coordinate system converting into target coordinate system of three-dimensional exhibition information, three-dimensional mesh is obtained
Mark virtual display information.First object scene information and objective virtual display information are processed, three-dimensional scenic is obtained
Exhibition information.
To be obtained such as the coordinate system of the first scene information, the second scene information or three-dimensional exhibition information in server
During converting into target coordinate system, changed using identical algorithm, be demarcated as coordinates of targets with by the first scene information below
Illustrated as a example by system.
In one embodiment, server 140 is nearest using iteration according to the first scene information and the second scene information
Point algorithm, calculates the transitional information between the coordinate system and target-based coordinate system of the second scene information.Server 140 is according to first
The IMU data in IMU data and the second scene information in scape information obtain the coordinate system and the second scene of the first scene information
The anglec of rotation between the coordinate system of information, using the anglec of rotation as rotation initial value.Server 140 is in a zone of reasonableness
A translation distance is inside randomly selected as flat between the coordinate system of the first scene information and the coordinate system of the second scene information
Move initial value.Server 140 combines rotation initial value and translation initial value utilizes iteration closest approach algorithm, calculates the second scene letter
Transitional information between the coordinate system and target-based coordinate system of breath, if iteration result is less than the error threshold for pre-setting,
The transitional information for arriving is effective.Server 140 is carried out at conversion according to the above-mentioned transitional information for obtaining to three-dimensional exhibition information
Reason, obtains objective virtual display information.
In one embodiment, picture pick-up device is responsible for obtaining the first scene information, and the first scene information includes the first scene
Picture and depth information.Picture pick-up device has the function of smart machine, computing device etc., e.g., with three-dimensional reconstruction and tracking
Function, can set high-definition camera on the picture pick-up device, high-definition camera can obtain scenic picture, and the high-definition camera will
The high definition picture transmission for photographing is to picture pick-up device.
User shifts to an earlier date a three-dimensional information is placed in smart machine, meanwhile, the smart machine can obtain
Two scene informations, above-mentioned three-dimensional information has position and orientation data in the coordinate system of the second scene information, by three-dimensional
Virtual information and the second scene information are sent to server, and server is calculated according to the first scene information and the second scene information and turned
Change information, further, three-dimensional information be transformed under the coordinate system of the first scene information according to transitional information, obtain this three
The position and orientation data of dimension virtual display information, i.e. three-dimensional information under the coordinate system of the first scene information, server
Above-mentioned three-dimensional exhibition information is output as scenic picture that two-dimensional picture again photographs this picture and high-definition camera (such as
First scene information) synthesized, e.g., using the picture of the first scene as background frame, by the superposition of virtual three-dimensional exhibition information
Thereon, final picture i.e. three-dimensional scenic exhibition information is obtained.Display device is exported to be shown, or output sets to projection
It is standby to be projected.
ICP algorithm has detailed calculating process in the prior art, is below underdrawed:
Assuming that input data is the first scene point cloud data set A={ ai, the second scene point cloud data set B={ bi, A and B
Between transformational relation be T, T is a matrix, comprising the anglec of rotation and translation distance.When iteration starts, T mono- is pre-set
Individual initial value T0.The anglec of rotation in initial value is obtained by way of being described above, and translation distance value then can only be in a conjunction
Randomly selected in the range of reason, the two values constitute initial value.
Step 1:Previously given maximal translation distance value Dmax;
Step 2:Judge whether to reach maximum iteration, if reaching maximum iteration, terminate iteration, otherwise from step
Rapid 3 start next iteration.Then, convergence is judged whether, if convergence, terminates, wherein, judge whether that convergent standard is
Whether f (x) is close to minimum value in step 4.
Step 3:Point in traversal set B;
A point b is chosen from B every timei, by biTransfer point x is once converted to T valuesi=Tbi, then from
Found from x in set AiThe nearest point m of pointi, judge xiWith miThe distance between whether be less than default ultimate range DmaxIf,
Less than ultimate range, then the weighted value w of this point is assigned toiIt is 1, is otherwise assigned to weighted value wiIt is 0.At the end of traversal, one has been obtained
Group mi, one group of wi。
Step 4:Make f (x)=∑iwi||T·bi-mi| | ^2, target is the matrix T for obtaining causing that f (x) is minimum.Herein,
Using gradient descent method, a new matrix T' is obtained so that f (x) reductions, reuse this new T' and perform step 2.
After iteration terminates, if reaching maximum iteration, illustrate that current iteration does not find suitable matrix T, if
Terminate iteration because of convergence, then whether f (x) is judged less than predetermined threshold, if less than predetermined threshold, it is believed that what is obtained is effective
Matrix T, otherwise, matrix T be invalid matrix.
After successive ignition obtains a suitable matrix T, it may be determined that the transformational relation between A and B, two have also been determined that
Transitional information between individual scene.
But it should here be understood that, the second scene information, the transfer process of the coordinate system of three-dimensional exhibition information with it is upper
State process consistent, no longer described one by one.Above-mentioned ICP algorithm is prior art, is no longer described in detail herein.
In one embodiment, smart machine 130 can also be believed for example, by the operation outside depth camera acquisition
Breath such as gesture operation or voice messaging, operation information is transmitted to server 140.Server 140 shows according to three-dimensional scenic to be believed
Breath and operation information, adjust the display location in the display device of three-dimensional scenic exhibition information.Wherein, operation information can be with intelligence
The gesture operation information or voice messaging of energy equipment wearer, or the wearer utilizes keyboard, wearable device, handle
Etc. the operation information that equipment is carried out.For example, when smart machine is Hololens holographic glasses, wearer can be by holographic eye
Display screen display holographic content such as chart, picture etc. in mirror, when adjusting diagram or picture is needed, wearer can be by hand
The operations such as gesture action is amplified, mobile, deletion are adjusted to chart, or by sound adjusting diagram as " please amplified chart
One times " etc., the corresponding content shown in display device can be adjusted correspondingly (scene refers to Fig. 3), it is achieved thereby that
Interacting between user and virtual information.
It should be noted that the first scene information being described above and the second scene information are same scene, from different perspectives
The scene information of acquisition.The quantity of picture pick-up device can be configured according to actual conditions, and the present invention does not do any limitation.
The three-dimensional reconstruction function that the present invention is described has various implementations, such as based on image, based on flight time skill
Art (Time of Flight, TOF) etc., it is therefore an objective to set up space three-dimensional cloud data, so that if depth camera is to surrounding
Space possesses perception.Tracking function refers to the tracking of movement to itself and rotation, for example, user is worn with Three-dimensional Gravity
The equipment with tracking function is built, when the user walks, tracer technique can accurately track the displacement and the anglec of rotation of user
Degree, so synchronous adjustment virtual three-dimensional information display location and angle so that user feel virtual three-dimensional information be stabilization exist
On locus, shifted without the walking with user.
In the inventive solutions, obtained from different perspectives in Same Scene not by picture pick-up device and smart machine
With scene information, and three-dimensional exhibition information to being pre-set in different scene information and smart machine processes
Three-dimensional scenic exhibition information is obtained, user's viewing visual angle is increased, the degree of accuracy of three-dimensional scenic exhibition information is improve, improve
Enjoyment.In addition, in the inventive solutions, smart machine can be with information realizations such as the gesture of identifying user, voices
User and surrounding environment, the real-time, interactive of virtual information, also more hommization.
Fig. 4 shows a kind of flow chart of information displaying method of offer according to embodiments of the present invention.As shown in figure 4, should
Method starts from step S410.
In step S410, the first scene information of scene residing for the picture pick-up device is obtained by picture pick-up device, by first
Scene information is transmitted to the server.
In the step s 420, three-dimensional exhibition information is shown by smart machine, and is obtained residing for the smart machine
Second scene information of scene, the second scene information and three-dimensional exhibition information are transmitted to server.
In step S430, by server according to the first scene information and the second scene information for receiving, to three-dimensional
Virtual display information is processed, and obtains three-dimensional scenic exhibition information, and three-dimensional scenic exhibition information is transmitted to display device.
In one embodiment, first scene that the picture pick-up device that will be received by the server is transmitted
The coordinate system of information is demarcated as target-based coordinate system.By the server after the three-dimensional exhibition information is received,
The coordinate system of the three-dimensional exhibition information is transformed into the target-based coordinate system, objective virtual display information is obtained.
First scene information and the objective virtual display information are processed by the server, obtains described three
Dimension scene display information.Wherein, by the server according to first scene information and second scene information, utilize
Iteration closest approach algorithm, calculates the transitional information between the coordinate system and the target-based coordinate system of second scene information, leads to
The server is crossed according to the transitional information, conversion process is carried out to the three-dimensional exhibition information, obtain the three-dimensional
Destination virtual exhibition information.
Wherein, the demarcation mode of target-based coordinate system is described in detail above, is no longer excessively described herein.
In step S440, three-dimensional scenic exhibition information is shown by display device.
In one embodiment, by the operation information outside smart machine acquisition, the operation information is passed
The server is transported to, by the server according to the three-dimensional scenic exhibition information and the operation information, adjustment is described
The display location in the display device of three-dimensional scenic exhibition information.
A kind of information display system that the embodiment of the present invention is provided can be equipment on specific hardware or be installed on
Software or firmware in equipment etc..The technique effect of the device that the embodiment of the present invention is provided, its realization principle and generation and preceding
State embodiment of the method identical, to briefly describe, device embodiment part does not refer to part, refers to phase in preceding method embodiment
Answer content.It is apparent to those skilled in the art that, for convenience and simplicity of description, system described above,
The specific work process of device and unit, may be referred to the corresponding process in above method embodiment, will not be repeated here.
In embodiment provided by the present invention, it should be understood that disclosed apparatus and method, can be by other sides
Formula is realized.Device embodiment described above is only schematical, for example, the division of the unit, only one kind are patrolled
Collect function to divide, there can be other dividing mode when actually realizing, but for example, multiple units or component can combine or can
To be integrated into another system, or some features can be ignored, or not perform.It is another, it is shown or discussed each other
Coupling or direct-coupling or communication connection can be the INDIRECT COUPLING or communication link of device or unit by some communication interfaces
Connect, can be electrical, mechanical or other forms.
The unit that is illustrated as separating component can be or may not be it is physically separate, it is aobvious as unit
The part for showing can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be according to the actual needs selected to realize the mesh of this embodiment scheme
's.
In addition, during each functional unit in the embodiment that the present invention is provided can be integrated in a processing unit, also may be used
Being that unit is individually physically present, it is also possible to which two or more units are integrated in a unit.
If the function is to realize in the form of SFU software functional unit and as independent production marketing or when using, can be with
Storage is in a computer read/write memory medium.Based on such understanding, technical scheme is substantially in other words
The part contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used to so that a computer equipment (can be individual
People's computer, server, or network equipment etc.) perform all or part of step of each embodiment methods described of the invention.
And foregoing storage medium includes:USB flash disk, mobile hard disk, read-only storage (ROM, Read-Only Memory), arbitrary access are deposited
Reservoir (RAM, Random Access Memory), magnetic disc or CD etc. are various can be with the medium of store program codes.
It should be noted that:Similar label and letter represents similar terms in following accompanying drawing, therefore, once a certain Xiang Yi
It is defined in individual accompanying drawing, then it need not be further defined and explained in subsequent accompanying drawing, additionally, term " the
One ", " second ", " the 3rd " etc. are only used for distinguishing description, and it is not intended that indicating or implying relative importance.
Finally it should be noted that:Embodiment described above, specific embodiment only of the invention, is used to illustrate the present invention
Technical scheme, rather than its limitations, protection scope of the present invention is not limited thereto, although with reference to the foregoing embodiments to this hair
It is bright to be described in detail, it will be understood by those within the art that:Any one skilled in the art
The invention discloses technical scope in, it can still modify to the technical scheme described in previous embodiment or can be light
Change is readily conceivable that, or equivalent is carried out to which part technical characteristic;And these modifications, change or replacement, do not make
The essence of appropriate technical solution departs from the spirit and scope of embodiment of the present invention technical scheme.Should all cover in protection of the invention
Within the scope of.Therefore, protection scope of the present invention described should be defined by scope of the claims.
Claims (10)
1. a kind of information display system, it is characterised in that the system includes:Picture pick-up device, display device, smart machine and service
Device, wherein
The picture pick-up device, the first scene information for obtaining scene residing for the picture pick-up device, by first scene information
Transmit to the server;
The smart machine, for showing three-dimensional exhibition information, and obtain scene residing for the smart machine second
Scape information, second scene information and the three-dimensional exhibition information are transmitted to the server;
The server, for according to first scene information and second scene information for receiving, to the three-dimensional
Virtual display information is processed, and obtains three-dimensional scenic exhibition information, the three-dimensional scenic exhibition information is transmitted to described and is shown
Show equipment;
The display device, for showing the three-dimensional scenic exhibition information.
2. the system as claimed in claim 1, it is characterised in that the server is additionally operable to:
The coordinate system of first scene information of the picture pick-up device transmission that will be received is demarcated as target-based coordinate system.
3. system as claimed in claim 2, it is characterised in that the server is additionally operable to:
After the three-dimensional exhibition information is received, the coordinate system of the three-dimensional exhibition information is transformed into the mesh
Mark coordinate system, obtains objective virtual display information;
First scene information and the objective virtual display information are processed, the three-dimensional scenic displaying is obtained
Information.
4. system as claimed in claim 3, it is characterised in that the server is additionally operable to:
According to first scene information and second scene information, using iteration closest approach algorithm, calculate described second
Transitional information between the coordinate system of scape information and the target-based coordinate system;
According to the transitional information, conversion process is carried out to the three-dimensional exhibition information, obtain the objective virtual
Exhibition information.
5. the system as claimed in claim 1, it is characterised in that wherein,
The smart machine is additionally operable to the operation information outside acquisition, and the operation information is transmitted to the server;
The server is additionally operable to, according to the three-dimensional scenic exhibition information and the operation information, adjust the three-dimensional scenic exhibition
Show the display location in the display device of information.
6. a kind of information displaying method, using the information display system as any one of claim 1-5, its feature exists
In the method includes:
The first scene information of scene residing for the picture pick-up device is obtained by the picture pick-up device, first scene information is passed
Transport to the server;
Three-dimensional exhibition information, and the second scene for obtaining scene residing for the smart machine are shown by the smart machine
Information, second scene information and the three-dimensional exhibition information are transmitted to the server;
By the server according to first scene information and second scene information for receiving, to described three-dimensional empty
Intend exhibition information to be processed, obtain three-dimensional scenic exhibition information, the three-dimensional scenic exhibition information is transmitted to the display
Equipment;
The three-dimensional scenic exhibition information is shown by the display device.
7. method as claimed in claim 6, it is characterised in that it is described by the server according to described first for receiving
Scene information and second scene information, are processed the three-dimensional exhibition information, including:
The coordinate system of first scene information for being transmitted the picture pick-up device for receiving by the server is demarcated as mesh
Mark coordinate system.
8. method as claimed in claim 7, it is characterised in that by the server according to first scene for receiving
Information and second scene information, are processed the three-dimensional exhibition information, are also included:
By the server after the three-dimensional exhibition information is received, by the coordinate of the three-dimensional exhibition information
System is transformed into the target-based coordinate system, obtains objective virtual display information;
First scene information and the objective virtual display information are processed by the server, obtains institute
State three-dimensional scenic exhibition information.
9. method as claimed in claim 8, it is characterised in that described that the three-dimensional is being received by the server
After exhibition information, the coordinate system of the three-dimensional exhibition information is transformed into the target-based coordinate system, obtains objective empty
Intend exhibition information, including:
By the server according to first scene information and second scene information, using iteration closest approach algorithm,
Calculate the transitional information between the coordinate system and the target-based coordinate system of second scene information;
By the server according to the transitional information, conversion process is carried out to the three-dimensional exhibition information, obtain institute
State objective virtual display information.
10. method as claimed in claim 6, it is characterised in that also include:
By the operation information outside smart machine acquisition, the operation information is transmitted to the server;
By the server according to the three-dimensional scenic exhibition information and the operation information, the three-dimensional scenic displaying is adjusted
The display location in the display device of information.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710061210.5A CN106843790B (en) | 2017-01-25 | 2017-01-25 | Information display system and method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710061210.5A CN106843790B (en) | 2017-01-25 | 2017-01-25 | Information display system and method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106843790A true CN106843790A (en) | 2017-06-13 |
CN106843790B CN106843790B (en) | 2020-08-04 |
Family
ID=59121858
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710061210.5A Active CN106843790B (en) | 2017-01-25 | 2017-01-25 | Information display system and method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106843790B (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107393446A (en) * | 2017-09-14 | 2017-11-24 | 广州米文化传媒有限公司 | Laser projection interactive exhibition system and methods of exhibiting |
CN108255291A (en) * | 2017-12-05 | 2018-07-06 | 腾讯科技(深圳)有限公司 | Transmission method, device, storage medium and the electronic device of virtual scene data |
WO2019184593A1 (en) * | 2018-03-26 | 2019-10-03 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and apparatus for generating environment model, and storage medium |
CN114928619A (en) * | 2022-04-29 | 2022-08-19 | 厦门图扑软件科技有限公司 | Information synchronization method and device, electronic equipment and storage medium |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102157011A (en) * | 2010-12-10 | 2011-08-17 | 北京大学 | Method for carrying out dynamic texture acquisition and virtuality-reality fusion by using mobile shooting equipment |
CN103700128A (en) * | 2013-12-30 | 2014-04-02 | 无锡触角科技有限公司 | Mobile equipment and enhanced display method thereof |
CN104134229A (en) * | 2014-08-08 | 2014-11-05 | 李成 | Real-time interaction reality augmenting system and method |
CN104143212A (en) * | 2014-07-02 | 2014-11-12 | 惠州Tcl移动通信有限公司 | Reality augmenting method and system based on wearable device |
US20150356770A1 (en) * | 2013-03-04 | 2015-12-10 | Tencent Technology (Shenzhen) Company Limited | Street view map display method and system |
CN106097435A (en) * | 2016-06-07 | 2016-11-09 | 北京圣威特科技有限公司 | A kind of augmented reality camera system and method |
-
2017
- 2017-01-25 CN CN201710061210.5A patent/CN106843790B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102157011A (en) * | 2010-12-10 | 2011-08-17 | 北京大学 | Method for carrying out dynamic texture acquisition and virtuality-reality fusion by using mobile shooting equipment |
US20150356770A1 (en) * | 2013-03-04 | 2015-12-10 | Tencent Technology (Shenzhen) Company Limited | Street view map display method and system |
CN103700128A (en) * | 2013-12-30 | 2014-04-02 | 无锡触角科技有限公司 | Mobile equipment and enhanced display method thereof |
CN104143212A (en) * | 2014-07-02 | 2014-11-12 | 惠州Tcl移动通信有限公司 | Reality augmenting method and system based on wearable device |
CN104134229A (en) * | 2014-08-08 | 2014-11-05 | 李成 | Real-time interaction reality augmenting system and method |
CN106097435A (en) * | 2016-06-07 | 2016-11-09 | 北京圣威特科技有限公司 | A kind of augmented reality camera system and method |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107393446A (en) * | 2017-09-14 | 2017-11-24 | 广州米文化传媒有限公司 | Laser projection interactive exhibition system and methods of exhibiting |
CN108255291A (en) * | 2017-12-05 | 2018-07-06 | 腾讯科技(深圳)有限公司 | Transmission method, device, storage medium and the electronic device of virtual scene data |
WO2019184593A1 (en) * | 2018-03-26 | 2019-10-03 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and apparatus for generating environment model, and storage medium |
US10861169B2 (en) | 2018-03-26 | 2020-12-08 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method, storage medium and electronic device for generating environment model |
CN114928619A (en) * | 2022-04-29 | 2022-08-19 | 厦门图扑软件科技有限公司 | Information synchronization method and device, electronic equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN106843790B (en) | 2020-08-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11157070B2 (en) | Massive simultaneous remote digital presence world | |
JP7209777B2 (en) | Surface modeling system and method | |
JP6575974B2 (en) | Head mounted display tracking system | |
US10573060B1 (en) | Controller binding in virtual domes | |
JP2020537201A (en) | Shadow generation for inserted image content | |
EP3014581A2 (en) | Space carving based on human physical data | |
CN110832442A (en) | Optimized shading and adaptive mesh skin in point-of-gaze rendering systems | |
US20210318547A1 (en) | Augmented reality viewer with automated surface selection placement and content orientation placement | |
CN106843790A (en) | A kind of information display system and method | |
Li et al. | Real-time immersive table tennis game for two players with motion tracking | |
US10740957B1 (en) | Dynamic split screen | |
US20240070973A1 (en) | Augmented reality wall with combined viewer and camera tracking | |
WO2022023142A1 (en) | Virtual window | |
EP4279157A1 (en) | Space and content matching for augmented and mixed reality | |
WO2019241712A1 (en) | Augmented reality wall with combined viewer and camera tracking | |
TW202032978A (en) | Augmented reality wall with combined viewer and camera tracking |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |