CN106843790A - A kind of information display system and method - Google Patents

A kind of information display system and method Download PDF

Info

Publication number
CN106843790A
CN106843790A CN201710061210.5A CN201710061210A CN106843790A CN 106843790 A CN106843790 A CN 106843790A CN 201710061210 A CN201710061210 A CN 201710061210A CN 106843790 A CN106843790 A CN 106843790A
Authority
CN
China
Prior art keywords
information
scene
dimensional
server
exhibition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710061210.5A
Other languages
Chinese (zh)
Other versions
CN106843790B (en
Inventor
侯朝阳
肖洪波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Touch Vision Technology (beijing) Co Ltd
Original Assignee
Touch Vision Technology (beijing) Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Touch Vision Technology (beijing) Co Ltd filed Critical Touch Vision Technology (beijing) Co Ltd
Priority to CN201710061210.5A priority Critical patent/CN106843790B/en
Publication of CN106843790A publication Critical patent/CN106843790A/en
Application granted granted Critical
Publication of CN106843790B publication Critical patent/CN106843790B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay

Abstract

The invention provides a kind of information display system and method, the system includes:Picture pick-up device, the first scene information for obtaining scene residing for the picture pick-up device, first scene information is transmitted to the server;Smart machine, for showing three-dimensional exhibition information, and obtains the second scene information of scene residing for the smart machine, and second scene information and the three-dimensional exhibition information are transmitted to the server;Server, for according to first scene information and second scene information for receiving, processing the three-dimensional exhibition information, obtains three-dimensional scenic exhibition information, and the three-dimensional scenic exhibition information is transmitted to the display device;Display device, for showing the three-dimensional scenic exhibition information.Present invention also offers corresponding information displaying method.

Description

A kind of information display system and method
Technical field
The present invention relates to a kind of information display system and method.
Background technology
At present, conventional information display technique be used to imparting knowledge to students, exhibition, opening ceremony, podium, etc. need the field of exhibition information Close, be mainly the element combinations such as figure, word, the animation that will design, in output to display device, by projection or Display screen is illustrated in spectators at the moment, but information exhibition method is single, lack spatial interaction.
It is, therefore, desirable to provide a set of can realize spatial interaction function, will believe with reference to technologies such as augmented reality, holographic displays The system that breath preferably shows.
The content of the invention
In view of this, it is an object of the invention to provide a kind of information display system and method, with try hard to solve or extremely Alleviate the problem for existing above less.
In a first aspect, the embodiment of the invention provides a kind of information display system, the system includes:Picture pick-up device, display Equipment, smart machine and server, wherein
The picture pick-up device, the first scene information for obtaining scene residing for the picture pick-up device, by first scene Information transfer is to the server;
The smart machine, for showing three-dimensional exhibition information, and obtain scene residing for the smart machine Two scene informations, second scene information and the three-dimensional exhibition information are transmitted to the server;
The server, for according to first scene information and second scene information for receiving, to described Three-dimensional exhibition information is processed, and obtains three-dimensional scenic exhibition information, and the three-dimensional scenic exhibition information is transmitted to institute State display device;
The display device, for showing the three-dimensional scenic exhibition information.
Alternatively, in the method according to the invention, the server is additionally operable to:
The coordinate system of first scene information of the picture pick-up device transmission that will be received is demarcated as target-based coordinate system.
Alternatively, in the method according to the invention, the server is additionally operable to:
After the three-dimensional exhibition information is received, the coordinate system of the three-dimensional exhibition information is transformed into institute Target-based coordinate system is stated, objective virtual display information is obtained;
First scene information and the objective virtual display information are processed, the three-dimensional scenic is obtained Exhibition information.
Alternatively, in the method according to the invention, the server is additionally operable to:
According to first scene information and second scene information, using iteration closest approach algorithm, described the is calculated Transitional information between the coordinate system of two scene informations and the target-based coordinate system;
According to the transitional information, conversion process is carried out to the three-dimensional exhibition information, obtain the objective Virtual display information.
Alternatively, in the method according to the invention, wherein,
The smart machine is additionally operable to the operation information outside acquisition, and the operation information is transmitted to the server;
The server is additionally operable to, according to the three-dimensional scenic exhibition information and the operation information, adjust the three dimensional field The display location in the display device of scape exhibition information.
Second aspect, The embodiment provides a kind of information displaying method, using information display system as above, The method includes:
The first scene information of scene residing for the picture pick-up device is obtained by the picture pick-up device, by first scene letter Breath is transmitted to the server;
Three-dimensional exhibition information, and obtain scene residing for the smart machine second are shown by the smart machine Scene information, second scene information and the three-dimensional exhibition information are transmitted to the server;
By the server according to first scene information and second scene information for receiving, to described three Dimension virtual display information is processed, and obtains three-dimensional scenic exhibition information, and the three-dimensional scenic exhibition information is transmitted to described Display device;
The three-dimensional scenic exhibition information is shown by the display device.
Alternatively, in a device in accordance with the invention, it is described by the server according to described first for receiving Scape information and second scene information, are processed the three-dimensional exhibition information, including:
The coordinate system of first scene information that the picture pick-up device that will be received by the server is transmitted is demarcated It is target-based coordinate system.
Alternatively, in a device in accordance with the invention, believed according to first scene for receiving by the server Breath and second scene information, are processed the three-dimensional exhibition information, are also included:
By the server after the three-dimensional exhibition information is received, by the three-dimensional exhibition information Coordinate system is transformed into the target-based coordinate system, obtains objective virtual display information;
First scene information and the objective virtual display information are processed by the server, is obtained To the three-dimensional scenic exhibition information.
Alternatively, in a device in accordance with the invention, it is described that the three-dimensional exhibition is being received by the server After showing information, the coordinate system of the three-dimensional exhibition information is transformed into the target-based coordinate system, obtains objective virtual Exhibition information, including:
By the server according to first scene information and second scene information, counted recently using iteration Method, calculates the transitional information between the coordinate system and the target-based coordinate system of second scene information;
By the server according to the transitional information, conversion process is carried out to the three-dimensional exhibition information, obtained To the objective virtual display information.
Alternatively, in a device in accordance with the invention, also include:
By the operation information outside smart machine acquisition, the operation information is transmitted to the server;
By the server according to the three-dimensional scenic exhibition information and the operation information, the three-dimensional scenic is adjusted The display location in the display device of exhibition information.
In the inventive solutions, obtained from different perspectives in Same Scene not by picture pick-up device and smart machine With scene information, and three-dimensional exhibition information to being pre-set in different scene information and smart machine processes Three-dimensional scenic exhibition information is obtained, user's viewing visual angle is increased, the degree of accuracy of three-dimensional scenic exhibition information is improve, improve Enjoyment.
To enable the above objects, features and advantages of the present invention to become apparent, preferred embodiment cited below particularly, and coordinate Appended accompanying drawing, is described in detail below.
Brief description of the drawings
Technical scheme in order to illustrate more clearly the embodiments of the present invention, below will be attached to what is used needed for embodiment Figure is briefly described, it will be appreciated that the following drawings illustrate only certain embodiments of the present invention, thus be not construed as it is right The restriction of scope, for those of ordinary skill in the art, on the premise of not paying creative work, can also be according to this A little accompanying drawings obtain other related accompanying drawings.
Fig. 1 shows a kind of structure chart of information display system that the embodiment of the present invention is provided;
Fig. 2 shows that a kind of depth camera that the embodiment of the present invention is provided gathers the schematic diagram in the visual field;
Fig. 3 shows the schematic diagram of information displaying scene in a kind of smart machine that the embodiment of the present invention is provided;
Fig. 4 shows a kind of flow chart of information displaying method that the embodiment of the present invention is provided.
Specific embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention Middle accompanying drawing, is clearly and completely described to the technical scheme in the embodiment of the present invention, it is clear that described embodiment is only It is a part of embodiment of the invention, rather than whole embodiments.The present invention generally described and illustrated in accompanying drawing herein is real The component for applying example can be arranged and designed with a variety of configurations.Therefore, it is of the invention to what is provided in the accompanying drawings below The detailed description of embodiment is not intended to limit the scope of claimed invention, but is merely representative of selected reality of the invention Apply example.Based on embodiments of the invention, the institute that those skilled in the art are obtained on the premise of creative work is not made There is other embodiment, belong to the scope of protection of the invention.
Fig. 1 shows the structure chart of information display system according to an embodiment of the invention.As shown in figure 1, this is System includes:Picture pick-up device 110, display device 120, smart machine 130 and server 140.
Picture pick-up device 110 is used to obtain the first scene information of scene residing for the picture pick-up device, and first scene is believed Breath is sent to server 140.First scene information is generally comprised in image information, depth information and the picture pick-up device of the first scene Data (IMU data) of Inertial Measurement Unit (IMU) output etc..Wherein, the first scene refers generally to the field in the picture pick-up device visual field Scape, IMU data generally comprise attitude angle, acceleration, speed of equipment etc., and depth information refers to be obtained by three-dimensional reconstruction function Three dimensional space coordinate information, the profile in space can be embodied.Such as, there was only two dimensions for a width picture, then obtain Depth information on picture direction, just constitutes a three-dimensional information, and substantial amounts of three-dimensional coordinate point is macroscopically being seen just It is a cloud information, embodies the profile in space.
The shooting that picture pick-up device 110 includes but is not limited to camera, depth camera, can obtain depth information is first-class, For example, HoloLens equipment, Kinect video camera etc..The picture pick-up device has three-dimensional reconstruction function and tracking function.At one In embodiment, in certain new product release, due to the limited view (referring to Fig. 2) of depth camera such as Hololens, Kinect, hair Cloth meeting meeting-place can set multiple depth cameras, for example, being arranged on each corner in meeting-place, all be drawn to photograph meeting-place Face.
Smart machine 130 includes display screen, depth camera, luminosity sensor, environment sensing camera, 2,000,000 pictures Plain camera, memory cell etc., are previously stored with three-dimensional exhibition information, depth camera, luminosity sensing in memory cell Device etc. can be used for display three-dimensional exhibition information as virtual for detecting, catch the gesture etc. of wearer in smart machine 130 Fantasy football, court in scene etc., and the second scene information of scene residing for the smart machine is obtained, and the second scene is believed Breath and three-dimensional exhibition information are transmitted to server 140.Second scene information includes the image information of the second scene, depth Information and the data (IMU data) of Inertial Measurement Unit (IMU) output etc., the second scene refers generally to the field in the smart machine visual field The information of the Same Scene that scape, the first scene information and the second scene information are usually obtained from different perspectives, the IMU data Attitude angle, acceleration, speed including equipment etc..Smart machine 130 can be but not limited to wearable device, intelligent glasses, With showing virtual information and obtaining portable set of scene information etc., for example, the smart machine can be HoloLens Mirror, in addition, the smart machine has three-dimensional reconstruction function and tracking function.
Hololens holographic glasses are the special spectacles for merging CPU, GPU and hologram processor, by picture images harmony Sound, can just enter the augmented reality world in allowing wearer indoors, holographic experience is carried out by carrier of surrounding enviroment.Wearer can With by HoloLens, using actual surrounding environment as carrier, various virtual informations are added above in picture.Can check indoors Martian surface, human heart model, even number enter virtual well-known sight spot, can be possibly realized by HoloLens.Example Such as, after the person of giving lessons wears Hololens holographic glasses, can be by lecture contents, such as the religion such as manikin, moisture submodel Content is learned to be showed in the way of holography, and wearer can move to the content of courses, scale, rotate etc. and operating, For student carries out careful teaching explanation.
Server 140 is used to, according to the first scene information and the second scene information for receiving, show three-dimensional and believe Breath is processed, and obtains three-dimensional scenic exhibition information, and three-dimensional scenic exhibition information is transmitted to display device 120.Display device 120 display three-dimensional scenic exhibition information.Wherein, display device can be but not limited to projecting apparatus, display screen, LED screen, with aobvious Show screen of function etc..
In one embodiment, the coordinate system of the second scene information of the smart machine transmission that server 140 will be received It is demarcated as target-based coordinate system, or, the coordinate of the first scene information that the picture pick-up device 110 that server 140 will be received is transmitted System is demarcated as target-based coordinate system, or, server 140 can directly using world coordinate system as target-based coordinate system.Wherein, target Coordinate system is used for all data unifications for receiving server in same coordinate system, it should here be understood that, coordinates of targets The demarcation of system be only it is schematic, it is all can by data unification to the same coordinate system coordinate system all in protection model of the invention In enclosing.
The present invention can be used following any one mode to obtain needing the three-dimensional scenic exhibition information of displaying.
When the coordinate system of the first scene information is demarcated as target-based coordinate system by server 140, server 140 is being received After three-dimensional exhibition information, by the coordinate system converting into target coordinate system of three-dimensional exhibition information, objective is obtained empty Intend exhibition information.First scene information and objective virtual display information are processed, three-dimensional scenic exhibition information is obtained.
When the coordinate system of the second scene information is demarcated as target-based coordinate system by server 140, server 140 is being received After first scene information, by the coordinate system converting into target coordinate system of the first scene information, first object scene information is obtained, connect After receiving three-dimensional exhibition information, by the coordinate system converting into target coordinate system of three-dimensional exhibition information, three-dimensional mesh is obtained Mark virtual display information.First object scene information and objective virtual display information are processed, three-dimensional scenic is obtained Exhibition information.
To be obtained such as the coordinate system of the first scene information, the second scene information or three-dimensional exhibition information in server During converting into target coordinate system, changed using identical algorithm, be demarcated as coordinates of targets with by the first scene information below Illustrated as a example by system.
In one embodiment, server 140 is nearest using iteration according to the first scene information and the second scene information Point algorithm, calculates the transitional information between the coordinate system and target-based coordinate system of the second scene information.Server 140 is according to first The IMU data in IMU data and the second scene information in scape information obtain the coordinate system and the second scene of the first scene information The anglec of rotation between the coordinate system of information, using the anglec of rotation as rotation initial value.Server 140 is in a zone of reasonableness A translation distance is inside randomly selected as flat between the coordinate system of the first scene information and the coordinate system of the second scene information Move initial value.Server 140 combines rotation initial value and translation initial value utilizes iteration closest approach algorithm, calculates the second scene letter Transitional information between the coordinate system and target-based coordinate system of breath, if iteration result is less than the error threshold for pre-setting, The transitional information for arriving is effective.Server 140 is carried out at conversion according to the above-mentioned transitional information for obtaining to three-dimensional exhibition information Reason, obtains objective virtual display information.
In one embodiment, picture pick-up device is responsible for obtaining the first scene information, and the first scene information includes the first scene Picture and depth information.Picture pick-up device has the function of smart machine, computing device etc., e.g., with three-dimensional reconstruction and tracking Function, can set high-definition camera on the picture pick-up device, high-definition camera can obtain scenic picture, and the high-definition camera will The high definition picture transmission for photographing is to picture pick-up device.
User shifts to an earlier date a three-dimensional information is placed in smart machine, meanwhile, the smart machine can obtain Two scene informations, above-mentioned three-dimensional information has position and orientation data in the coordinate system of the second scene information, by three-dimensional Virtual information and the second scene information are sent to server, and server is calculated according to the first scene information and the second scene information and turned Change information, further, three-dimensional information be transformed under the coordinate system of the first scene information according to transitional information, obtain this three The position and orientation data of dimension virtual display information, i.e. three-dimensional information under the coordinate system of the first scene information, server Above-mentioned three-dimensional exhibition information is output as scenic picture that two-dimensional picture again photographs this picture and high-definition camera (such as First scene information) synthesized, e.g., using the picture of the first scene as background frame, by the superposition of virtual three-dimensional exhibition information Thereon, final picture i.e. three-dimensional scenic exhibition information is obtained.Display device is exported to be shown, or output sets to projection It is standby to be projected.
ICP algorithm has detailed calculating process in the prior art, is below underdrawed:
Assuming that input data is the first scene point cloud data set A={ ai, the second scene point cloud data set B={ bi, A and B Between transformational relation be T, T is a matrix, comprising the anglec of rotation and translation distance.When iteration starts, T mono- is pre-set Individual initial value T0.The anglec of rotation in initial value is obtained by way of being described above, and translation distance value then can only be in a conjunction Randomly selected in the range of reason, the two values constitute initial value.
Step 1:Previously given maximal translation distance value Dmax
Step 2:Judge whether to reach maximum iteration, if reaching maximum iteration, terminate iteration, otherwise from step Rapid 3 start next iteration.Then, convergence is judged whether, if convergence, terminates, wherein, judge whether that convergent standard is Whether f (x) is close to minimum value in step 4.
Step 3:Point in traversal set B;
A point b is chosen from B every timei, by biTransfer point x is once converted to T valuesi=Tbi, then from Found from x in set AiThe nearest point m of pointi, judge xiWith miThe distance between whether be less than default ultimate range DmaxIf, Less than ultimate range, then the weighted value w of this point is assigned toiIt is 1, is otherwise assigned to weighted value wiIt is 0.At the end of traversal, one has been obtained Group mi, one group of wi
Step 4:Make f (x)=∑iwi||T·bi-mi| | ^2, target is the matrix T for obtaining causing that f (x) is minimum.Herein, Using gradient descent method, a new matrix T' is obtained so that f (x) reductions, reuse this new T' and perform step 2.
After iteration terminates, if reaching maximum iteration, illustrate that current iteration does not find suitable matrix T, if Terminate iteration because of convergence, then whether f (x) is judged less than predetermined threshold, if less than predetermined threshold, it is believed that what is obtained is effective Matrix T, otherwise, matrix T be invalid matrix.
After successive ignition obtains a suitable matrix T, it may be determined that the transformational relation between A and B, two have also been determined that Transitional information between individual scene.
But it should here be understood that, the second scene information, the transfer process of the coordinate system of three-dimensional exhibition information with it is upper State process consistent, no longer described one by one.Above-mentioned ICP algorithm is prior art, is no longer described in detail herein.
In one embodiment, smart machine 130 can also be believed for example, by the operation outside depth camera acquisition Breath such as gesture operation or voice messaging, operation information is transmitted to server 140.Server 140 shows according to three-dimensional scenic to be believed Breath and operation information, adjust the display location in the display device of three-dimensional scenic exhibition information.Wherein, operation information can be with intelligence The gesture operation information or voice messaging of energy equipment wearer, or the wearer utilizes keyboard, wearable device, handle Etc. the operation information that equipment is carried out.For example, when smart machine is Hololens holographic glasses, wearer can be by holographic eye Display screen display holographic content such as chart, picture etc. in mirror, when adjusting diagram or picture is needed, wearer can be by hand The operations such as gesture action is amplified, mobile, deletion are adjusted to chart, or by sound adjusting diagram as " please amplified chart One times " etc., the corresponding content shown in display device can be adjusted correspondingly (scene refers to Fig. 3), it is achieved thereby that Interacting between user and virtual information.
It should be noted that the first scene information being described above and the second scene information are same scene, from different perspectives The scene information of acquisition.The quantity of picture pick-up device can be configured according to actual conditions, and the present invention does not do any limitation.
The three-dimensional reconstruction function that the present invention is described has various implementations, such as based on image, based on flight time skill Art (Time of Flight, TOF) etc., it is therefore an objective to set up space three-dimensional cloud data, so that if depth camera is to surrounding Space possesses perception.Tracking function refers to the tracking of movement to itself and rotation, for example, user is worn with Three-dimensional Gravity The equipment with tracking function is built, when the user walks, tracer technique can accurately track the displacement and the anglec of rotation of user Degree, so synchronous adjustment virtual three-dimensional information display location and angle so that user feel virtual three-dimensional information be stabilization exist On locus, shifted without the walking with user.
In the inventive solutions, obtained from different perspectives in Same Scene not by picture pick-up device and smart machine With scene information, and three-dimensional exhibition information to being pre-set in different scene information and smart machine processes Three-dimensional scenic exhibition information is obtained, user's viewing visual angle is increased, the degree of accuracy of three-dimensional scenic exhibition information is improve, improve Enjoyment.In addition, in the inventive solutions, smart machine can be with information realizations such as the gesture of identifying user, voices User and surrounding environment, the real-time, interactive of virtual information, also more hommization.
Fig. 4 shows a kind of flow chart of information displaying method of offer according to embodiments of the present invention.As shown in figure 4, should Method starts from step S410.
In step S410, the first scene information of scene residing for the picture pick-up device is obtained by picture pick-up device, by first Scene information is transmitted to the server.
In the step s 420, three-dimensional exhibition information is shown by smart machine, and is obtained residing for the smart machine Second scene information of scene, the second scene information and three-dimensional exhibition information are transmitted to server.
In step S430, by server according to the first scene information and the second scene information for receiving, to three-dimensional Virtual display information is processed, and obtains three-dimensional scenic exhibition information, and three-dimensional scenic exhibition information is transmitted to display device.
In one embodiment, first scene that the picture pick-up device that will be received by the server is transmitted The coordinate system of information is demarcated as target-based coordinate system.By the server after the three-dimensional exhibition information is received, The coordinate system of the three-dimensional exhibition information is transformed into the target-based coordinate system, objective virtual display information is obtained. First scene information and the objective virtual display information are processed by the server, obtains described three Dimension scene display information.Wherein, by the server according to first scene information and second scene information, utilize Iteration closest approach algorithm, calculates the transitional information between the coordinate system and the target-based coordinate system of second scene information, leads to The server is crossed according to the transitional information, conversion process is carried out to the three-dimensional exhibition information, obtain the three-dimensional Destination virtual exhibition information.
Wherein, the demarcation mode of target-based coordinate system is described in detail above, is no longer excessively described herein.
In step S440, three-dimensional scenic exhibition information is shown by display device.
In one embodiment, by the operation information outside smart machine acquisition, the operation information is passed The server is transported to, by the server according to the three-dimensional scenic exhibition information and the operation information, adjustment is described The display location in the display device of three-dimensional scenic exhibition information.
A kind of information display system that the embodiment of the present invention is provided can be equipment on specific hardware or be installed on Software or firmware in equipment etc..The technique effect of the device that the embodiment of the present invention is provided, its realization principle and generation and preceding State embodiment of the method identical, to briefly describe, device embodiment part does not refer to part, refers to phase in preceding method embodiment Answer content.It is apparent to those skilled in the art that, for convenience and simplicity of description, system described above, The specific work process of device and unit, may be referred to the corresponding process in above method embodiment, will not be repeated here.
In embodiment provided by the present invention, it should be understood that disclosed apparatus and method, can be by other sides Formula is realized.Device embodiment described above is only schematical, for example, the division of the unit, only one kind are patrolled Collect function to divide, there can be other dividing mode when actually realizing, but for example, multiple units or component can combine or can To be integrated into another system, or some features can be ignored, or not perform.It is another, it is shown or discussed each other Coupling or direct-coupling or communication connection can be the INDIRECT COUPLING or communication link of device or unit by some communication interfaces Connect, can be electrical, mechanical or other forms.
The unit that is illustrated as separating component can be or may not be it is physically separate, it is aobvious as unit The part for showing can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple On NE.Some or all of unit therein can be according to the actual needs selected to realize the mesh of this embodiment scheme 's.
In addition, during each functional unit in the embodiment that the present invention is provided can be integrated in a processing unit, also may be used Being that unit is individually physically present, it is also possible to which two or more units are integrated in a unit.
If the function is to realize in the form of SFU software functional unit and as independent production marketing or when using, can be with Storage is in a computer read/write memory medium.Based on such understanding, technical scheme is substantially in other words The part contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter Calculation machine software product is stored in a storage medium, including some instructions are used to so that a computer equipment (can be individual People's computer, server, or network equipment etc.) perform all or part of step of each embodiment methods described of the invention. And foregoing storage medium includes:USB flash disk, mobile hard disk, read-only storage (ROM, Read-Only Memory), arbitrary access are deposited Reservoir (RAM, Random Access Memory), magnetic disc or CD etc. are various can be with the medium of store program codes.
It should be noted that:Similar label and letter represents similar terms in following accompanying drawing, therefore, once a certain Xiang Yi It is defined in individual accompanying drawing, then it need not be further defined and explained in subsequent accompanying drawing, additionally, term " the One ", " second ", " the 3rd " etc. are only used for distinguishing description, and it is not intended that indicating or implying relative importance.
Finally it should be noted that:Embodiment described above, specific embodiment only of the invention, is used to illustrate the present invention Technical scheme, rather than its limitations, protection scope of the present invention is not limited thereto, although with reference to the foregoing embodiments to this hair It is bright to be described in detail, it will be understood by those within the art that:Any one skilled in the art The invention discloses technical scope in, it can still modify to the technical scheme described in previous embodiment or can be light Change is readily conceivable that, or equivalent is carried out to which part technical characteristic;And these modifications, change or replacement, do not make The essence of appropriate technical solution departs from the spirit and scope of embodiment of the present invention technical scheme.Should all cover in protection of the invention Within the scope of.Therefore, protection scope of the present invention described should be defined by scope of the claims.

Claims (10)

1. a kind of information display system, it is characterised in that the system includes:Picture pick-up device, display device, smart machine and service Device, wherein
The picture pick-up device, the first scene information for obtaining scene residing for the picture pick-up device, by first scene information Transmit to the server;
The smart machine, for showing three-dimensional exhibition information, and obtain scene residing for the smart machine second Scape information, second scene information and the three-dimensional exhibition information are transmitted to the server;
The server, for according to first scene information and second scene information for receiving, to the three-dimensional Virtual display information is processed, and obtains three-dimensional scenic exhibition information, the three-dimensional scenic exhibition information is transmitted to described and is shown Show equipment;
The display device, for showing the three-dimensional scenic exhibition information.
2. the system as claimed in claim 1, it is characterised in that the server is additionally operable to:
The coordinate system of first scene information of the picture pick-up device transmission that will be received is demarcated as target-based coordinate system.
3. system as claimed in claim 2, it is characterised in that the server is additionally operable to:
After the three-dimensional exhibition information is received, the coordinate system of the three-dimensional exhibition information is transformed into the mesh Mark coordinate system, obtains objective virtual display information;
First scene information and the objective virtual display information are processed, the three-dimensional scenic displaying is obtained Information.
4. system as claimed in claim 3, it is characterised in that the server is additionally operable to:
According to first scene information and second scene information, using iteration closest approach algorithm, calculate described second Transitional information between the coordinate system of scape information and the target-based coordinate system;
According to the transitional information, conversion process is carried out to the three-dimensional exhibition information, obtain the objective virtual Exhibition information.
5. the system as claimed in claim 1, it is characterised in that wherein,
The smart machine is additionally operable to the operation information outside acquisition, and the operation information is transmitted to the server;
The server is additionally operable to, according to the three-dimensional scenic exhibition information and the operation information, adjust the three-dimensional scenic exhibition Show the display location in the display device of information.
6. a kind of information displaying method, using the information display system as any one of claim 1-5, its feature exists In the method includes:
The first scene information of scene residing for the picture pick-up device is obtained by the picture pick-up device, first scene information is passed Transport to the server;
Three-dimensional exhibition information, and the second scene for obtaining scene residing for the smart machine are shown by the smart machine Information, second scene information and the three-dimensional exhibition information are transmitted to the server;
By the server according to first scene information and second scene information for receiving, to described three-dimensional empty Intend exhibition information to be processed, obtain three-dimensional scenic exhibition information, the three-dimensional scenic exhibition information is transmitted to the display Equipment;
The three-dimensional scenic exhibition information is shown by the display device.
7. method as claimed in claim 6, it is characterised in that it is described by the server according to described first for receiving Scene information and second scene information, are processed the three-dimensional exhibition information, including:
The coordinate system of first scene information for being transmitted the picture pick-up device for receiving by the server is demarcated as mesh Mark coordinate system.
8. method as claimed in claim 7, it is characterised in that by the server according to first scene for receiving Information and second scene information, are processed the three-dimensional exhibition information, are also included:
By the server after the three-dimensional exhibition information is received, by the coordinate of the three-dimensional exhibition information System is transformed into the target-based coordinate system, obtains objective virtual display information;
First scene information and the objective virtual display information are processed by the server, obtains institute State three-dimensional scenic exhibition information.
9. method as claimed in claim 8, it is characterised in that described that the three-dimensional is being received by the server After exhibition information, the coordinate system of the three-dimensional exhibition information is transformed into the target-based coordinate system, obtains objective empty Intend exhibition information, including:
By the server according to first scene information and second scene information, using iteration closest approach algorithm, Calculate the transitional information between the coordinate system and the target-based coordinate system of second scene information;
By the server according to the transitional information, conversion process is carried out to the three-dimensional exhibition information, obtain institute State objective virtual display information.
10. method as claimed in claim 6, it is characterised in that also include:
By the operation information outside smart machine acquisition, the operation information is transmitted to the server;
By the server according to the three-dimensional scenic exhibition information and the operation information, the three-dimensional scenic displaying is adjusted The display location in the display device of information.
CN201710061210.5A 2017-01-25 2017-01-25 Information display system and method Active CN106843790B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710061210.5A CN106843790B (en) 2017-01-25 2017-01-25 Information display system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710061210.5A CN106843790B (en) 2017-01-25 2017-01-25 Information display system and method

Publications (2)

Publication Number Publication Date
CN106843790A true CN106843790A (en) 2017-06-13
CN106843790B CN106843790B (en) 2020-08-04

Family

ID=59121858

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710061210.5A Active CN106843790B (en) 2017-01-25 2017-01-25 Information display system and method

Country Status (1)

Country Link
CN (1) CN106843790B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107393446A (en) * 2017-09-14 2017-11-24 广州米文化传媒有限公司 Laser projection interactive exhibition system and methods of exhibiting
CN108255291A (en) * 2017-12-05 2018-07-06 腾讯科技(深圳)有限公司 Transmission method, device, storage medium and the electronic device of virtual scene data
WO2019184593A1 (en) * 2018-03-26 2019-10-03 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method and apparatus for generating environment model, and storage medium
CN114928619A (en) * 2022-04-29 2022-08-19 厦门图扑软件科技有限公司 Information synchronization method and device, electronic equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102157011A (en) * 2010-12-10 2011-08-17 北京大学 Method for carrying out dynamic texture acquisition and virtuality-reality fusion by using mobile shooting equipment
CN103700128A (en) * 2013-12-30 2014-04-02 无锡触角科技有限公司 Mobile equipment and enhanced display method thereof
CN104134229A (en) * 2014-08-08 2014-11-05 李成 Real-time interaction reality augmenting system and method
CN104143212A (en) * 2014-07-02 2014-11-12 惠州Tcl移动通信有限公司 Reality augmenting method and system based on wearable device
US20150356770A1 (en) * 2013-03-04 2015-12-10 Tencent Technology (Shenzhen) Company Limited Street view map display method and system
CN106097435A (en) * 2016-06-07 2016-11-09 北京圣威特科技有限公司 A kind of augmented reality camera system and method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102157011A (en) * 2010-12-10 2011-08-17 北京大学 Method for carrying out dynamic texture acquisition and virtuality-reality fusion by using mobile shooting equipment
US20150356770A1 (en) * 2013-03-04 2015-12-10 Tencent Technology (Shenzhen) Company Limited Street view map display method and system
CN103700128A (en) * 2013-12-30 2014-04-02 无锡触角科技有限公司 Mobile equipment and enhanced display method thereof
CN104143212A (en) * 2014-07-02 2014-11-12 惠州Tcl移动通信有限公司 Reality augmenting method and system based on wearable device
CN104134229A (en) * 2014-08-08 2014-11-05 李成 Real-time interaction reality augmenting system and method
CN106097435A (en) * 2016-06-07 2016-11-09 北京圣威特科技有限公司 A kind of augmented reality camera system and method

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107393446A (en) * 2017-09-14 2017-11-24 广州米文化传媒有限公司 Laser projection interactive exhibition system and methods of exhibiting
CN108255291A (en) * 2017-12-05 2018-07-06 腾讯科技(深圳)有限公司 Transmission method, device, storage medium and the electronic device of virtual scene data
WO2019184593A1 (en) * 2018-03-26 2019-10-03 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method and apparatus for generating environment model, and storage medium
US10861169B2 (en) 2018-03-26 2020-12-08 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method, storage medium and electronic device for generating environment model
CN114928619A (en) * 2022-04-29 2022-08-19 厦门图扑软件科技有限公司 Information synchronization method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN106843790B (en) 2020-08-04

Similar Documents

Publication Publication Date Title
US11157070B2 (en) Massive simultaneous remote digital presence world
JP7209777B2 (en) Surface modeling system and method
JP6575974B2 (en) Head mounted display tracking system
US10573060B1 (en) Controller binding in virtual domes
JP2020537201A (en) Shadow generation for inserted image content
EP3014581A2 (en) Space carving based on human physical data
CN110832442A (en) Optimized shading and adaptive mesh skin in point-of-gaze rendering systems
US20210318547A1 (en) Augmented reality viewer with automated surface selection placement and content orientation placement
CN106843790A (en) A kind of information display system and method
Li et al. Real-time immersive table tennis game for two players with motion tracking
US10740957B1 (en) Dynamic split screen
US20240070973A1 (en) Augmented reality wall with combined viewer and camera tracking
WO2022023142A1 (en) Virtual window
EP4279157A1 (en) Space and content matching for augmented and mixed reality
WO2019241712A1 (en) Augmented reality wall with combined viewer and camera tracking
TW202032978A (en) Augmented reality wall with combined viewer and camera tracking

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant