CN106210468A - A kind of augmented reality display packing and device - Google Patents
A kind of augmented reality display packing and device Download PDFInfo
- Publication number
- CN106210468A CN106210468A CN201610559898.5A CN201610559898A CN106210468A CN 106210468 A CN106210468 A CN 106210468A CN 201610559898 A CN201610559898 A CN 201610559898A CN 106210468 A CN106210468 A CN 106210468A
- Authority
- CN
- China
- Prior art keywords
- physical equipment
- image acquisition
- display information
- dimensional display
- work process
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
Embodiments of the present invention provide a kind of augmented reality AR display packing, including: by image acquisition units, the physical equipment in current scene is carried out image acquisition, the display screen corresponding to described image acquisition units presents the real time imaging collected；The three dimensional display information superposition that would correspond to physical equipment shows in the corresponding position of real time imaging, and three dimensional display information includes the three dimensional display information corresponding to physical equipment internal structure and/or the three dimensional display information for analog physical equipment work process.Owing to retaining the actually located environment of user as the main perception of user and interactive environment, add the sense of reality of displaying, and owing to user can carry out image acquisition from arbitrarily angled to physical equipment according to actual needs, and the omnibearing internal structure seeing physical equipment and/or work process, improve Consumer's Experience.Embodiments of the present invention additionally provide a kind of augmented reality display device.
Description
Technical field
Embodiments of the present invention relate to augmented reality field, more specifically, embodiments of the present invention relate to one
Plant augmented reality display packing and device.
Background technology
This part is it is intended that the embodiments of the present invention stated in claims provide background or context.Herein
Describe not because being included in this part just recognize it is prior art.
The internal structure of physical equipment contributes to user and understands the structure composition of physical equipment and the work of physical equipment is former
Reason.Such as, the inside centrifugal fan showing smoke exhaust ventilator or the combustion gas showing the kitchen range top enter air inlet pipe and by pulse firing
Process that device is lighted etc..But, in actual application, such displaying is often due to restriction (such as, the family of actual show surroundings
Electricity sales field is inconvenient to dismantle lampblack absorber to show blower fan to client), or it is difficult to visual (combustion gas of the such as kitchen range top is invisible) or rule
Then limit (as household electrical appliances sales field does not allow naked light occur, so the flame of gas-cooker cannot be shown) and use multimedia mode or
The mode of person's stage property auxiliary is shown.
Common multimedia mode is that perspective view, video cartoon, structure according to physical equipment design and produce displaying video
Or the Principle of Process of abstraction technology, utilize hardware wired averager projection still image or animation to body surface (as shown in Figure 1), three-dimensional can
Interactive animation etc..Common stage property accessory exhibition mode includes LED case (as shown in Figure 2), it is seen that consume thing (such as gas)
Auxiliary produce instrument (as shown in Figure 3).
Summary of the invention
In above-mentioned various exhibition methods, perspective view is that single angle is shown, user cannot see equipment inner structure
Overall picture, and video cartoon is line style story description scheme, user can only passive viewing to the content of display in video cartoon, and not
Viewing, hardware wired averager projection still image or animation can be selected to be similarly single angle to body surface according to oneself wish, it is impossible to
See that overall picture, three-dimension interaction animation can be interacted by input equipment on image display, but this three-dimensional animation takes off
From true environment, have impact on Consumer's Experience；And on the one hand stage property accessory exhibition mode needs the stage property of auxiliary, the opposing party's face
Shunting tool accessory exhibition mode also cannot show whole angles.
To this end, be highly desirable to the equipment inner structure display packing of a kind of improvement, with in true environment from different perspectives
Comprehensive presentation device internal structure or the operation principle of equipment.
In the present context, embodiments of the present invention expectation provides a kind of augmented reality display packing and device.
In the first aspect of embodiment of the present invention, it is provided that a kind of augmented reality AR display packing, including:
By image acquisition units, the physical equipment in current scene carried out image acquisition, and corresponding to described figure
As presenting the real time imaging collected on the display screen of collecting unit；
The three dimensional display information superposition that would correspond to described physical equipment is carried out in the corresponding position of described real time imaging
Display, described three dimensional display information includes the three dimensional display information corresponding to described physical equipment internal structure and/or for mould
Intend the three dimensional display information of described physical equipment work process.
In the second aspect of embodiment of the present invention, it is provided that a kind of augmented reality AR display device, including:
Image acquisition units, for the physical equipment in current scene being carried out image acquisition by image acquisition units,
And on the display screen corresponding to described image acquisition units, present the real time imaging collected；
Display unit, for would correspond to the three dimensional display information superposition phase at described real time imaging of described physical equipment
Answering position to show, described three dimensional display information includes the three dimensional display information corresponding to described physical equipment internal structure
And/or for simulating the three dimensional display information of described physical equipment work process.
In the third aspect of embodiment of the present invention, it is provided that a kind of augmented reality AR display device, for example, it is possible to bag
Including memorizer and processor, wherein, processor may be used for reading the program in memorizer, performs following process: pass through image
Collecting unit carries out image acquisition to the physical equipment in current scene, and in the display corresponding to described image acquisition units
The real time imaging collected is presented on screen；Would correspond to the three dimensional display information superposition of described physical equipment at described real time imaging
Corresponding position show, described three dimensional display information includes the three dimensional display corresponding to described physical equipment internal structure
Information and/or for simulating the three dimensional display information of described physical equipment work process.
In the fourth aspect of embodiment of the present invention, it is provided that a kind of program product, it includes program code, when described
When program product runs, described program code is used for performing procedure below: by image acquisition units to the thing in current scene
Reason equipment carries out image acquisition, and presents the real-time figure collected on the display screen corresponding to described image acquisition units
Picture；The three dimensional display information superposition that would correspond to described physical equipment shows in the corresponding position of described real time imaging,
Described three dimensional display information includes the three dimensional display information corresponding to described physical equipment internal structure and/or described for simulating
The three dimensional display information of physical equipment work process.
Augmented reality AR display packing according to embodiment of the present invention and device, by the physical equipment at Real-time Collection
On image, superposition is for showing the internal structure of this physical equipment and/or simulating the three dimensional display of described physical equipment work process
Information, owing to retaining the actually located environment of user as the main perception of user and interactive environment, adds the true of displaying
Sense, and owing to user can carry out image acquisition from arbitrarily angled to physical equipment according to actual needs, therefore, it can full side
Position the internal structure seeing physical equipment and/or work process, it addition, the present invention provide physical equipment internal structure and/
Or work process display packing assists without any stage property, and do not limited by environment, thus brought preferably experience for user.
Accompanying drawing explanation
By reading detailed description below, above-mentioned and other mesh of exemplary embodiment of the invention with reference to accompanying drawing
, feature and advantage will become prone to understand.In the accompanying drawings, if showing the present invention's by way of example, and not by way of limitation
Dry embodiment, wherein:
Fig. 1 is in prior art, utilizes hardware wired averager projection still image or animation to the schematic diagram of body surface；
Fig. 2 is in prior art, and LED case carries out accessory exhibition schematic diagram；
Fig. 3 is in prior art, it is seen that the auxiliary consuming thing (such as gas) produces instrument schematic diagram；
Fig. 4 schematically shows the application scenarios schematic diagram according to embodiment of the present invention；
Fig. 5 schematically shows the augmented reality display packing implementing procedure schematic diagram according to embodiment of the present invention；
The three dimensional display information corresponding to physical equipment that Fig. 6 a schematically shows according to embodiment of the present invention is entered
The implementing procedure schematic diagram of row display；
Fig. 6 b schematically shows the effect showing flame on real gas-cooker according to embodiment of the present invention
Schematic diagram；
Fig. 7 schematically shows the structural representation of augmented reality display device according to another embodiment of the present invention；
Fig. 8 schematically shows the structural representation of the augmented reality display device according to further embodiment of this invention；
Fig. 9 schematically shows the program product signal of augmented reality display device according to yet another embodiment of the invention
Figure；
In the accompanying drawings, identical or corresponding label represents identical or corresponding part.
Detailed description of the invention
Principle and the spirit of the present invention are described below with reference to some illustrative embodiments.Should be appreciated that and provide this
A little embodiments are only used to make those skilled in the art better understood when and then realize the present invention, and not with any
Mode limits the scope of the present invention.On the contrary, it is provided that these embodiments are to make the disclosure more thorough and complete, and energy
Enough the scope of the present disclosure is intactly conveyed to those skilled in the art.
One skilled in the art will appreciate that embodiments of the present invention can be implemented as a kind of system, device, equipment, method
Or computer program.Therefore, the disclosure can be to be implemented as following form, it may be assumed that hardware, completely software completely
(including firmware, resident software, microcode etc.), or the form that hardware and software combines.
According to the embodiment of the present invention, it is proposed that a kind of augmented reality AR display packing and device.
In this article, any number of elements in accompanying drawing is used to example and unrestricted, and any name is only used for
Distinguish, and not there is any limitation.
Principle and spirit below with reference to some representative embodiments of the present invention, in detail the explaination present invention.
Summary of the invention
The inventors discovered that, existing in the methods of exhibiting such as physical equipment internal structure and/or work process, or
Can only be shown from single angle, it is impossible to meet user's request, or need stage property to assist, add displaying difficulty, impact
Consumer's Experience.
In view of this, the invention provides a kind of display side based on augmented reality (AR, Augmented Reality)
Method, by being acquired obtaining comprising the image of this physical equipment, and in the phase of this image to the physical equipment in true environment
Answer superposition on position for simulating this physical equipment work process or for showing that the three-dimensional of this physical equipment internal structure shows
Show information, retain true environment residing for user and, as actual show surroundings, add the sense of reality of displaying, and user can select
Select arbitrarily angled acquisition physical equipment image, such that it is able to omnibearing to physical equipment and internal structure thereof and/or worked
Journey is shown, and improves Consumer's Experience.
After the ultimate principle describing the present invention, introduce the various non-limiting embodiment party of the present invention in detail below
Formula.
Application scenarios overview
With reference first to Fig. 4, the application scenarios schematic diagram of its augmented reality (AR) method provided for the embodiment of the present invention.With
Family 40 carries out image acquisition by mobile terminal 41 to the physical equipment in true environment, and such as, user 40 opens mobile terminal
The AR installed in 41 shows client, selects to need the physical equipment of display, calls the photographic head of mobile terminal 41 to true ring
Physical equipment in border carries out image acquisition, the real-time figure that display in real time collects on the display screen of mobile terminal 41
Picture, AR display client calculates photographic head in real time and physical equipment carries out the real-time attitude information of image acquisition, and utilizes calculating
The real-time attitude information obtained with the image acquisition parameter of photographic head to three-dimensional material that prestore, that this physical equipment is corresponding
Information carries out imaging processing and obtains the three dimensional display information of correspondence, the thing three dimensional display information superposition obtained shown at screen
On reason equipment drawing picture.
During it should be noted that be embodied as, need to gather in advance the physical equipment of variety classes and different model
Three dimensional structure, internal structure and simulate the relevant three-dimensional material information such as this physical equipment work process and be preset at AR display visitor
In the end of family.
In the embodiment of the present invention, the three dimensional structure of physical equipment, internal structure and mould can be obtained by either type
Intend the relevant three-dimensional material information such as this physical equipment work process, such as:
User or the physical equipment of physical equipment manufacturer offer and the three-dimensional information of internal structure thereof are provided.
Under this embodiment, generally can directly be provided physical equipment and internal structure thereof by physical equipment manufacturer
Tomograph, directly obtains the three-dimensional information of respective physical equipment and internal structure thereof according to the tomograph obtained.
And can be carried by physical equipment production firm for the three-dimensional material information for analog physical equipment work process
Supply, it is also possible to carry out being pre-designed obtaining according to physical equipment operation principle.
The three-dimensional material information of above-mentioned acquisition can be preset in AR display client.So, user is to true environment
In physical equipment carry out image acquisition before, need to select the physical equipment kind of current presentation and model, such as, AR shows
Client can show physical equipment kind in further menu, shows physical equipment brand in second-level menu kind, at three grades of dishes
List shows the model etc. of physical equipment, in order to user selects.
For the determination of the real-time attitude of photographic head, such as, can use scheme based on location recognition, such as SLAM
(Simultaneous localization and mapping) algorithm, obtains initial camera by initialization and sets relative to physics
Standby attitude, and in photographic head moving process, carry out map structuring, insert new key frame and marker characteristic point, and according to thing
Reason equipment position in map carries out real-time tracking, thus obtains the real-time attitude of photographic head, be here SLAM algorithm be normal
The prior art seen, repeats no more.
Illustrative methods
Below in conjunction with the application scenarios of Fig. 4, describe according to the exemplary embodiment party of the present invention with reference to Fig. 5 and Fig. 6 a, Fig. 6 b
The AR display packing of formula.It should be noted that above-mentioned application scenarios be for only for ease of understand spirit and principles of the present invention and
Illustrating, embodiments of the present invention are the most unrestricted.On the contrary, embodiments of the present invention can apply to be suitable for
Any scene.
As it is shown in figure 5, its AR display packing implementing procedure schematic diagram provided for the embodiment of the present invention, including following step
Rapid:
S51, by image acquisition units the physical equipment in current scene carried out image acquisition, and corresponding to figure
As presenting the real time imaging collected on the display screen of collecting unit.
In this step, user needs displaying or viewing physical equipment internal structure and/or analog physical equipment worked
Cheng Shi, opens AR and shows client, and after determining that user have selected physical equipment kind and model, AR display client call moves
The image acquisition units of terminal, such as, this image acquisition units can be photographic head, carries out the physical equipment in current scene
Shooting, and on the display screen of mobile terminal, present the physical equipment image that shooting obtains.
S52, the three dimensional display information superposition that would correspond to described physical equipment are carried out in the corresponding position of real time imaging
Display.
Wherein, the three dimensional display information of described physical equipment includes showing corresponding to the three-dimensional of described physical equipment internal structure
Show information and/or for simulating the three dimensional display information of described physical equipment work process.
It should be noted that the physical equipment internal structure related in the embodiment of the present invention is user is using physical equipment
Time physical equipment internal structure sightless to user, rather than the internal storage space of cabinet type physical equipment, such as refrigerator etc., should
Memory space is visible after cabinet door is opened for a user.And the physical equipment internal junction that the present embodiments relate to
Structure can be the structure composition of equipment, such as, and the blower fan system structure within lampblack absorber, Control system architecture, oil-filtering apparatus knot
Structures etc., the refrigerant system configurations of refrigerator, Control system architecture etc., wherein, the refrigeration system of refrigerator can include compressor, condensation
Device, vaporizer and capillary restrictor etc., the according to embodiments of the present invention middle physical equipment internal structure shown, can be to user
Show the annexation between each device.
According to embodiments of the present invention, it is also possible to the three dimensional display information superposition of the work process of analog physical equipment will be used for
The physical equipment image of Real-time Collection shows, to help user to understand the work process of physical equipment.Wherein, physics
Equipment work process is the work process in physical equipment internal structure, sightless for user in actual applications, uses
Three dimensional display information in analog physical equipment work process includes for simulating being correlated with in described physical equipment work process
The form of solid, gas and/or liquid, position and/or the dynamic display information of color change.
Above it is used for the form of related solid, gas and/or liquid, the position simulating in described physical equipment work process
Put and/or the dynamic display information of color change, such as, real physics gas kitchen range is demonstrated combustion gas by inside the kitchen range top
Pipeline imports stove air jet and is ignited presenting the process of virtual flame, or superposition on actual physical gas kitchen range
Virtual frying pan and beefsteak are to represent the scene effect of pan-fried beefsteak；Or on real lampblack absorber, demonstrate the process that lampblack absorber cleans
Deng.
When being embodied as, step S52 can be according to the flow implementation shown in Fig. 6 a:
S521, real time imaging according to image acquisition units collection determine that the most described physics of described image acquisition units sets
Standby real-time attitude information.
In step S521, in addition to using above-mentioned SLAM algorithm to determine the real-time attitude information of image acquisition units,
Sharp can also determine the real-time attitude information of image acquisition units, the side such as mated based on 2D (two-dimentional) the most in real time
Method and the method mated based on 3D (three-dimensional), wherein, method based on 2D coupling can paste specific identifier on the physical devices
(the 3C mark of such as home appliance or brand identity etc.), by this specific identifier relative to the position of physical equipment and
Image acquisition units relative to specific identifier position and towards, determine the real-time of image acquisition units in image acquisition units
Position and in real time towards.In method based on 3D coupling, visual signature point or the marginal information of physical equipment, and base can be passed through
In physical equipment 3D information by three-dimensional recognition method determine image acquisition units real time position and in real time towards etc..
S522, according to the image acquisition parameter of image acquisition units and attitude information and the correspondence that prestores in real time
Three-dimensional material information in described physical equipment, it is thus achieved that corresponding to described physical equipment and the three dimensional display of current real-time attitude
Information, and described three dimensional display information superposition is shown in the corresponding position of described real time imaging.
In step S522, utilize the image acquisition units determined in the step S521 real-time attitude relative to physical equipment
Information, the three-dimensional material information prestored (include describing the three-dimensional material information of physical equipment internal structure and/or for mould
Intend the three-dimensional material information of the work process of physical equipment), it is thus achieved that corresponding to physical equipment and the three-dimensional of current real-time attitude
Display information.
Wherein, adopt according to the image of three-dimensional material information, the real-time attitude of image acquisition units and image acquisition units
Collection parameter, utilizes perspective imaging principle (projection equation) can obtain the three dimensional display information of three-dimensional material information, idiographic flow
As follows: to each summit (X, Y, Z) in three-dimensional material information, real-time attitude and image according to image acquisition units are adopted
The projection matrix P that collection parameter obtains, (x, y), to this picture for the pixel image space calculated on imaging plane by projection equation
Element draws the color information on this summit, repeats to carry out the most as procedure described above for all summits comprised in three-dimensional material information
Processing the three dimensional display information that then can obtain this three-dimensional material, wherein, the image acquisition parameter of image acquisition units can include
The internal reference matrix etc. of image acquisition units.According to calculated pixel image space, by three dimensional display information superposition to mobile
The corresponding position on physical equipment image that terminal screen shows.As shown in Figure 6 b, it is to show on real gas-cooker
The effect schematic diagram of flame.
When being embodied as, in order to strengthen display effect, it is also possible to the physical equipment that mobile terminal display screen curtain is presented
The outer surface of real time imaging carry out transparent processing.
It should be noted that the mobile terminal related in the embodiment of the present invention can be common mobile phone, panel computer etc.,
Can also be wearable terminal, such as augmented reality (AR) glasses etc..
The AR display packing that the embodiment of the present invention provides, gathers the three dimensional structure of physical equipment, internal structure and mould in advance
Intend the three-dimensional material information such as its work process and store, when in internal structure or the work process needing to show physical equipment,
The photographic head utilizing mobile terminal carries out image acquisition to the physical equipment in true environment, and on the display screen of mobile terminal
The real time imaging that display collects, determines the real-time attitude of photographic head, and utilizes image according to the real time imaging collected
The three dimensional display information that the image acquisition parameter of collecting unit is corresponding with the real-time attitude obtained and three-dimensional material information acquisition,
Show on the relevant position of the physical equipment image that the three dimensional display information superposition of acquisition is shown in real time at display screen.
During above-mentioned display, remain user place true environment, add the sense of reality of display, simultaneously as user can be from
Arbitrarily angled carry out image acquisition for physical equipment, thus be shown from different perspectives, improve Consumer's Experience.
Example devices
After the method describing exemplary embodiment of the invention, it follows that with reference to Fig. 7 reality exemplary to the present invention
The augmented reality display device executing mode illustrates.
As it is shown in fig. 7, the structural representation of its augmented reality display device provided for the embodiment of the present invention, can wrap
Include:
Image acquisition units 71, adopts for the physical equipment in current scene being carried out image by image acquisition units
Collection, and on the display screen corresponding to described image acquisition units, present the real time imaging collected；
Display unit 72, for would correspond to the three dimensional display information superposition of described physical equipment at described real time imaging
Corresponding position shows, described three dimensional display information includes believing corresponding to the three dimensional display of described physical equipment internal structure
Cease and/or for simulating the three dimensional display information of described physical equipment work process.
Wherein, described physical equipment internal structure is that user is sightless to described user when using described physical equipment
Physical equipment internal structure.Described physical equipment work process is the work process in described physical equipment internal structure.Described
Include for simulating in described physical equipment work process for simulating the three dimensional display information of described physical equipment work process
The form of related solid, gas and/or liquid, position and/or color change dynamic display information.
Alternatively, the augmented reality display device that the embodiment of the present invention provides, it is also possible to including:
Processing unit 73, the outer surface for the real time imaging of the described physical equipment being presented described display unit enters
Row transparent processing.
It is preferred that described display unit 72, including:
Determine subelement 721, for determining that the most described physics of described image acquisition units sets according to described real time imaging
Standby real-time attitude information；
Obtain subelement 722, for according to the image acquisition parameter of described image acquisition units and real-time attitude information, with
And the three-dimensional material information corresponding to described physical equipment prestored, it is thus achieved that corresponding to described physical equipment and current reality
Time attitude three dimensional display information；
Display subelement 723, for entering described three dimensional display information superposition in the corresponding position of described real time imaging
Row display.
After the augmented reality display packing describing present invention offer and device, it follows that introduce according to the present invention
The augmented reality display device of another exemplary embodiment.
Person of ordinary skill in the field it is understood that various aspects of the invention can be implemented as system, method or
Program product.Therefore, various aspects of the invention can be to be implemented as following form, it may be assumed that hardware embodiment, complete completely
Full Software Implementation (including firmware, microcode etc.), or the embodiment that hardware and software aspect combines, can unite here
It is referred to as " circuit ", " module " or " system ".
In the embodiment that some are possible, can include at least one according to the augmented reality display device of the present invention
Reason unit and at least one memory element.Wherein, described memory element has program stored therein code, when described program code quilt
When described processing unit performs so that described processing unit performs the root described in this specification above-mentioned " illustrative methods " part
According to the various steps in the message prompt method of the various illustrative embodiments of the present invention.Such as, described processing unit can be held
Row step S51 as shown in Figure 5, carries out image acquisition by image acquisition units to the physical equipment in current scene, and
And corresponding to presenting the real time imaging collected, step S52 on the display screen of image acquisition units, would correspond to described physics
The three dimensional display information superposition of equipment shows in the corresponding position of real time imaging.
Although it should be noted that, in above-detailed, be referred to some unit or the subelement of device, but this stroke
Point be merely exemplary is the most enforceable.It practice, according to the embodiment of the present invention, above-described two or more
The feature of unit and function can embody in a unit.Otherwise, feature and the function of an above-described unit can
Embody with Further Division for by multiple unit.
Although additionally, describe the operation of the inventive method in the accompanying drawings with particular order, but, this do not require that or
Hint must perform these operations according to this particular order, or having to carry out the most shown operation could realize desired
Result.Additionally or alternatively, it is convenient to omit some step, multiple steps are merged into a step and performs, and/or by one
Step is decomposed into multiple step and performs.
Referring to Fig. 8, the augmented reality display device 80 according to the embodiment of the invention is described.Shown in Fig. 8
Be only an example for augmented reality display device, the function of the embodiment of the present invention and range should not brought appoint
What limits.
As shown in Figure 8, augmented reality display device 80 can show with the form of universal computing device.Augmented reality shows
The assembly of device 80 can include but not limited to: at least one processing unit 81 above-mentioned, at least one memory element 82 above-mentioned, company
Connect the bus 83 of different system assembly (including memory element 82 and processing unit 81).
Bus 83 represents one or more in a few class bus structures, including memory bus or Memory Controller,
Peripheral bus, processor or use any bus-structured local bus in multiple bus structures.
Memory element 82 can include the computer-readable recording medium of form of volatile memory, such as random access memory (RAM)
821 and/or cache memory 822, it is also possible to farther include read only memory (ROM) 823.
Memory element 82 can also include the program/utility 825 with one group of (at least one) program module 824,
Such program module 824 includes but not limited to: operating system, one or more application program, other program module and
Routine data, potentially includes the realization of network environment in each or certain combination in these examples.
Augmented reality display device 80 can also be led to one or more external equipments 84 (such as keyboard, sensing equipment etc.)
Letter, also can enable a user to the equipment communication mutual with augmented reality display device 80 with one or more, and/or with make
Any equipment that this augmented reality display device 80 can communicate with other calculating equipment one or more (such as router,
Modem etc.) communication.This communication can be passed through input/output (I/O) interface 85 and carry out.Further, augmented reality shows
Showing device 80 can also be by network adapter 86 and one or more network (such as LAN (LAN), wide area network (WAN)
And/or public network, such as the Internet) communication.As it can be seen, network adapter 86 is shown with for augmented reality by bus 83
Other module communication of showing device 80.Should be appreciated that although not shown in, can use in conjunction with augmented reality display device 80
Other hardware and/or software module, include but not limited to: microcode, device driver, redundant processing unit, external disk drive
Dynamic array, RAID system, tape drive and data backup storage system etc..
Exemplary process product
In the embodiment that some are possible, the various aspects of the augmented reality display packing that the present invention provides can also be real
Being now the form of a kind of program product, it includes program code, when described program product runs on the terminal device, and described journey
Sequence code is used for making that described terminal unit performs described in this specification above-mentioned " illustrative methods " part is each according to the present invention
Planting the step in the augmented reality display packing of illustrative embodiments, such as, described terminal unit can perform such as institute in Fig. 5
Step S51 shown, carries out image acquisition by image acquisition units to the physical equipment in current scene, and corresponding to figure
As presenting the real time imaging collected, step S52 on the display screen of collecting unit, the three-dimensional that would correspond to described physical equipment shows
Show that information superposition shows in the corresponding position of real time imaging.
Described program product can use the combination in any of one or more computer-readable recording medium.Computer-readable recording medium can be readable letter
Number medium or readable storage medium storing program for executing.Readable storage medium storing program for executing such as can be but not limited to electricity, magnetic, optical, electromagnetic, red
Outside line or the system of quasiconductor, device or device, or above combination.The more specifically example of readable storage medium storing program for executing
(non exhaustive list) including: has the electrical connection of one or more wire, portable disc, hard disk, random access memory
(RAM), read only memory (ROM), erasable type programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc are only
Read memorizer (CD-ROM), light storage device, magnetic memory device or the combination of above-mentioned any appropriate.
As it is shown in figure 9, describe the program product 90 shown for augmented reality according to the embodiment of the present invention, its
Portable compact disc read only memory (CD-ROM) can be used and include program code, it is possible to running on the terminal device.
But, the program product of the present invention is not limited to this, and in this document, readable storage medium storing program for executing can be any comprising or storage program
Tangible medium, this program can be commanded execution system, device or device use or in connection.
The data signal that readable signal medium can include in a base band or propagate as a carrier wave part, wherein carries
Readable program code.The data signal of this propagation can take various forms, and includes but not limited to that electromagnetism is believed
Number, optical signal or the combination of above-mentioned any appropriate.Readable signal medium can also is that beyond readable storage medium storing program for executing any can
Read medium, this computer-readable recording medium can send, propagate or transmit for being used by instruction execution system, device or device or
Program in connection.
The program code comprised on computer-readable recording medium can include but not limited to any suitable medium transmission
Wireless, wired, optical cable, RF etc., or the combination of above-mentioned any appropriate.
The program for performing present invention operation can be write with the combination in any of one or more programming languages
Code, described programming language includes object oriented program language such as Java, C++ etc., also includes routine
Process type programming language such as " C " language or similar programming language.Program code can be fully user
Perform on calculating equipment, perform the most on a user device, perform as an independent software kit, partly calculate user
Its upper side is divided execution on a remote computing or performs in remote computing device or server completely.Relating to far
Journey calculates in the situation of equipment, and remote computing device can include LAN (LAN) or wide by the network of any kind
Territory net (WAN) is connected to user and calculates equipment, or, it may be connected to external computing device (such as utilizes Internet service
Provider passes through Internet connection).
Although additionally, describe the operation of the inventive method in the accompanying drawings with particular order, but, this do not require that or
Hint must perform these operations according to this particular order, or having to carry out the most shown operation could realize desired
Result.Additionally or alternatively, it is convenient to omit some step, multiple steps are merged into a step and performs, and/or by one
Step is decomposed into multiple step and performs.
Although describing spirit and principles of the present invention by reference to some detailed description of the invention, it should be appreciated that, this
Invention is not limited to disclosed detailed description of the invention, and the division to each side does not means that the feature in these aspects can not yet
Combination to be benefited, this division merely to statement convenience.It is contemplated that contain claims spirit and
Various amendments included by the range of and equivalent arrangements.
Claims (12)
1. an augmented reality AR display packing, including:
By image acquisition units, the physical equipment in current scene carried out image acquisition, and adopting corresponding to described image
Present, on the display screen of collection unit, the real time imaging collected；
The three dimensional display information superposition that would correspond to described physical equipment shows in the corresponding position of described real time imaging,
Described three dimensional display information includes the three dimensional display information corresponding to described physical equipment internal structure and/or described for simulating
The three dimensional display information of physical equipment work process.
Method the most according to claim 1, described physical equipment internal structure is that user is when using described physical equipment
Physical equipment internal structure sightless to described user.
Method the most according to claim 1 and 2, described physical equipment work process is in described physical equipment internal structure
Work process.
Method the most according to claim 3, the described three dimensional display information for simulating described physical equipment work process
Including for simulating the form of related solid, gas and/or liquid, position and/or the face in described physical equipment work process
The dynamic display information of complexion changed.
Method the most according to claim 1, also includes: enter the outer surface of the real time imaging of the described physical equipment presented
Row transparent processing.
Method the most according to claim 1, would correspond to the three dimensional display information superposition of described physical equipment in described reality
Time image corresponding position show, specifically include:
The real-time attitude information of the most described physical equipment of described image acquisition units is determined according to described real time imaging；
Image acquisition parameter according to described image acquisition units and real-time attitude information and prestore corresponding to described
The three-dimensional material information of physical equipment, it is thus achieved that corresponding to described physical equipment and the three dimensional display information of current real-time attitude,
And described three dimensional display information superposition is shown in the corresponding position of described real time imaging.
7. an augmented reality AR display device, including:
Image acquisition units, for the physical equipment in current scene being carried out image acquisition by image acquisition units, and
Display screen corresponding to described image acquisition units presents the real time imaging collected；
Display unit, for would correspond to the three dimensional display information superposition corresponding positions at described real time imaging of described physical equipment
The place of putting shows, described three dimensional display information include the three dimensional display information corresponding to described physical equipment internal structure and/
Or for simulating the three dimensional display information of described physical equipment work process.
Device the most according to claim 7, described physical equipment internal structure is that user is when using described physical equipment
Physical equipment internal structure sightless to described user.
9., according to the device described in claim 7 or 8, described physical equipment work process is in described physical equipment internal structure
Work process.
Device the most according to claim 9, the described three dimensional display information for simulating described physical equipment work process
Including for simulating the form of related solid, gas and/or liquid, position and/or the face in described physical equipment work process
The dynamic display information of complexion changed.
11. devices according to claim 7, also include:
Processing unit, the outer surface for the real time imaging of the described physical equipment being presented described display unit carries out transparent
Process.
12. devices according to claim 7, described display unit, including:
Determine subelement, for determining the real-time of the most described physical equipment of described image acquisition units according to described real time imaging
Attitude information；
Obtain subelement, for according to the image acquisition parameter of described image acquisition units and real-time attitude information and in advance
The three-dimensional material information corresponding to described physical equipment of storage, it is thus achieved that corresponding to described physical equipment and current real-time attitude
Three dimensional display information；
Display subelement, for showing described three dimensional display information superposition in the corresponding position of described real time imaging.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610559898.5A CN106210468B (en) | 2016-07-15 | 2016-07-15 | A kind of augmented reality display methods and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610559898.5A CN106210468B (en) | 2016-07-15 | 2016-07-15 | A kind of augmented reality display methods and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106210468A true CN106210468A (en) | 2016-12-07 |
| CN106210468B CN106210468B (en) | 2019-08-20 |
Family
ID=57475029
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610559898.5A Active CN106210468B (en) | 2016-07-15 | 2016-07-15 | A kind of augmented reality display methods and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106210468B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106603928A (en) * | 2017-01-20 | 2017-04-26 | 维沃移动通信有限公司 | Shooting method and mobile terminal |
| CN107995481A (en) * | 2017-11-30 | 2018-05-04 | 贵州颐爱科技有限公司 | The display methods and device of a kind of mixed reality |
| CN108415681A (en) * | 2018-03-23 | 2018-08-17 | 联想(北京)有限公司 | display device and method |
| CN108459711A (en) * | 2018-02-09 | 2018-08-28 | 上海永微信息科技有限公司 | Augmented reality management system for breeding, method and computer readable storage medium |
| CN108573530A (en) * | 2018-03-29 | 2018-09-25 | 麒麟合盛网络技术股份有限公司 | Augmented reality AR exchange methods and system |
| CN108681389A (en) * | 2018-05-11 | 2018-10-19 | 亮风台（上海）信息科技有限公司 | A kind of method and apparatus read by arrangement for reading |
| CN108898231A (en) * | 2018-05-31 | 2018-11-27 | 广东美的制冷设备有限公司 | interface display method, terminal device and computer readable storage medium |
| CN108897573A (en) * | 2018-05-31 | 2018-11-27 | 广东美的制冷设备有限公司 | Display appliance method, terminal device and server |
| CN109085924A (en) * | 2018-08-03 | 2018-12-25 | 百度在线网络技术（北京）有限公司 | The management method and device of smart machine based on AR |
| CN109584373A (en) * | 2017-09-29 | 2019-04-05 | 苹果公司 | Cooperate with augmented reality map interface |
| CN110569265A (en) * | 2019-09-10 | 2019-12-13 | 浪潮商用机器有限公司 | server accessory information display method and device, AR glasses and media |
| CN110889337A (en) * | 2019-11-08 | 2020-03-17 | 福建工程学院 | AR-based description method and AR-based description system |
| CN112242008A (en) * | 2020-10-17 | 2021-01-19 | 郑州西亚斯学院 | AR interaction visual perception method and system for transparent container |
| CN112509147A (en) * | 2020-11-27 | 2021-03-16 | 武汉全乐科技有限公司 | Three-dimensional augmented reality display method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101171565A (en) * | 2005-05-31 | 2008-04-30 | 菲利普莫里斯生产公司 | Virtual reality smoking system |
| US20100103075A1 (en) * | 2008-10-24 | 2010-04-29 | Yahoo! Inc. | Reconfiguring reality using a reality overlay device |
| CN103390287A (en) * | 2012-05-11 | 2013-11-13 | 索尼电脑娱乐欧洲有限公司 | Apparatus and method for augmented reality |
| CN103823553A (en) * | 2013-12-18 | 2014-05-28 | 微软公司 | Method for enhancing real display of scenes behind surface |
| CN105303557A (en) * | 2015-09-21 | 2016-02-03 | 深圳先进技术研究院 | Perspective type intelligent glasses and perspective method thereof |
-
2016
- 2016-07-15 CN CN201610559898.5A patent/CN106210468B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101171565A (en) * | 2005-05-31 | 2008-04-30 | 菲利普莫里斯生产公司 | Virtual reality smoking system |
| US20100103075A1 (en) * | 2008-10-24 | 2010-04-29 | Yahoo! Inc. | Reconfiguring reality using a reality overlay device |
| CN103390287A (en) * | 2012-05-11 | 2013-11-13 | 索尼电脑娱乐欧洲有限公司 | Apparatus and method for augmented reality |
| CN103823553A (en) * | 2013-12-18 | 2014-05-28 | 微软公司 | Method for enhancing real display of scenes behind surface |
| CN105303557A (en) * | 2015-09-21 | 2016-02-03 | 深圳先进技术研究院 | Perspective type intelligent glasses and perspective method thereof |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106603928A (en) * | 2017-01-20 | 2017-04-26 | 维沃移动通信有限公司 | Shooting method and mobile terminal |
| US11922588B2 (en) | 2017-09-29 | 2024-03-05 | Apple Inc. | Cooperative augmented reality map interface |
| CN109584373B (en) * | 2017-09-29 | 2023-08-22 | 苹果公司 | Collaborative augmented reality map interface |
| CN109584373A (en) * | 2017-09-29 | 2019-04-05 | 苹果公司 | Cooperate with augmented reality map interface |
| CN107995481B (en) * | 2017-11-30 | 2019-11-15 | 贵州颐爱科技有限公司 | A kind of display methods and device of mixed reality |
| CN107995481A (en) * | 2017-11-30 | 2018-05-04 | 贵州颐爱科技有限公司 | The display methods and device of a kind of mixed reality |
| CN108459711A (en) * | 2018-02-09 | 2018-08-28 | 上海永微信息科技有限公司 | Augmented reality management system for breeding, method and computer readable storage medium |
| CN108415681A (en) * | 2018-03-23 | 2018-08-17 | 联想(北京)有限公司 | display device and method |
| CN108573530A (en) * | 2018-03-29 | 2018-09-25 | 麒麟合盛网络技术股份有限公司 | Augmented reality AR exchange methods and system |
| CN108573530B (en) * | 2018-03-29 | 2022-02-11 | 麒麟合盛网络技术股份有限公司 | Augmented reality AR interaction method and system |
| CN108681389A (en) * | 2018-05-11 | 2018-10-19 | 亮风台（上海）信息科技有限公司 | A kind of method and apparatus read by arrangement for reading |
| CN108681389B (en) * | 2018-05-11 | 2021-12-14 | 亮风台（上海）信息科技有限公司 | Method and device for reading through reading device |
| CN108897573B (en) * | 2018-05-31 | 2021-06-18 | 广东美的制冷设备有限公司 | Household appliance display method, terminal equipment and server |
| CN108897573A (en) * | 2018-05-31 | 2018-11-27 | 广东美的制冷设备有限公司 | Display appliance method, terminal device and server |
| CN108898231A (en) * | 2018-05-31 | 2018-11-27 | 广东美的制冷设备有限公司 | interface display method, terminal device and computer readable storage medium |
| CN109085924A (en) * | 2018-08-03 | 2018-12-25 | 百度在线网络技术（北京）有限公司 | The management method and device of smart machine based on AR |
| CN110569265A (en) * | 2019-09-10 | 2019-12-13 | 浪潮商用机器有限公司 | server accessory information display method and device, AR glasses and media |
| CN110889337A (en) * | 2019-11-08 | 2020-03-17 | 福建工程学院 | AR-based description method and AR-based description system |
| CN112242008A (en) * | 2020-10-17 | 2021-01-19 | 郑州西亚斯学院 | AR interaction visual perception method and system for transparent container |
| CN112509147A (en) * | 2020-11-27 | 2021-03-16 | 武汉全乐科技有限公司 | Three-dimensional augmented reality display method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106210468B (en) | 2019-08-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106210468B (en) | A kind of augmented reality display methods and device | |
| CN106817568A (en) | A kind of augmented reality display methods and device | |
| US20180350145A1 (en) | Augmented Reality Devices and Methods Thereof for Rendering Virtual Objects | |
| US5590062A (en) | Simulator for producing various living environments mainly for visual perception | |
| US20180173404A1 (en) | Providing a user experience with virtual reality content and user-selected, real world objects | |
| CN106600709A (en) | Decoration information model-based VR virtual decoration method | |
| CN106780421A (en) | Finishing effect methods of exhibiting based on panoramic platform | |
| CN105760106A (en) | Interaction method and interaction device of intelligent household equipment | |
| CN111951374B (en) | House decoration data processing method and device, electronic equipment and storage medium | |
| CN104641400A (en) | User-controlled 3D simulation for providing realistic and enhanced digital object viewing and interaction experience | |
| KR20160033495A (en) | Apparatus and method for arranging furniture using augmented reality | |
| CN107967054B (en) | Immersive three-dimensional electronic sand table with virtual reality and augmented reality coupled | |
| Li et al. | Research on the application of AR technology based on Unity3D in education | |
| US11928384B2 (en) | Systems and methods for virtual and augmented reality | |
| Racz et al. | VR aided architecture and interior design | |
| CN110909439A (en) | AR-based assembly method and device and terminal | |
| Malinchi et al. | A mobile exploration solution for virtual libraries in higher education | |
| EP3594906B1 (en) | Method and device for providing augmented reality, and computer program | |
| CN111949904A (en) | Data processing method and device based on browser and terminal | |
| Suh et al. | Context-aware mobile ar system for personalization, selective sharing, and interaction of contents in ubiquitous computing environments | |
| CN210377371U (en) | Building visualization system applying augmented reality technology | |
| CN114327083A (en) | House property, object display method and device, readable storage medium and electronic equipment | |
| JP6629636B2 (en) | Drawing creation device and drawing creation program | |
| CN107038625A (en) | A kind of building sale based on augmented reality is with seeing room guidance system | |
| Souphamith et al. | The application of virtual reality technology in smart hom |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20210521 Address after: 311200 Room 102, 6 Blocks, C District, Qianjiang Century Park, Xiaoshan District, Hangzhou City, Zhejiang Province Patentee after: Hangzhou Yixian Advanced Technology Co.,Ltd. Address before: 310052 Building No. 599, Changhe Street Network Business Road, Binjiang District, Hangzhou City, Zhejiang Province, 4, 7 stories Patentee before: NETEASE (HANGZHOU) NETWORK Co.,Ltd. |