CN109903129A - Augmented reality display methods and device, electronic equipment, storage medium - Google Patents
Augmented reality display methods and device, electronic equipment, storage medium Download PDFInfo
- Publication number
- CN109903129A CN109903129A CN201910120539.3A CN201910120539A CN109903129A CN 109903129 A CN109903129 A CN 109903129A CN 201910120539 A CN201910120539 A CN 201910120539A CN 109903129 A CN109903129 A CN 109903129A
- Authority
- CN
- China
- Prior art keywords
- threedimensional model
- virtual objects
- information
- image
- entity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
Abstract
The disclosure belongs to augmented reality field, is related to a kind of augmented reality display methods and device, electronic equipment, computer readable storage medium.This method comprises: obtaining the entity information in collected reality scene image；For the threedimensional model of virtual objects, the dimension information of threedimensional model is extracted；According to entity information and dimension information, the display parameters of threedimensional model are determined；Based on display parameters, the threedimensional model image of virtual objects is shown in reality scene image.The disclosure determines the display parameters of the threedimensional model of virtual objects by the entity in reality scene image, so that user be made definitely to find out the mating situation of virtual objects and reality scene, brings user and more really experiences, and improves buying rate, reduces return of goods rate；Further, human-computer interaction is carried out by gesture motion, not only increases interest to the online shopping of user, more allow user that there is feeling of immersion on the spot in person, shopping way is more flexible and accurate, promotes conversion ratio.
Description
Technical field
This disclosure relates to which the augmented reality field (Augmented Reality, AR) more particularly to a kind of augmented reality are shown
Method and augmented reality display device, electronic equipment and computer readable storage medium.
Background technique
With the development of science and technology, e-commerce edges close to people's lives.With the promotion and popularization of online shopping, give
The consumption of user brings completely new shopping experience.Shopping mode is that consumer by graphic form checks commodity in traditional wire,
But the merchandise news that can get of consumer is received and is greatly limited.In this case, other a kind of shopping sides are needed
Formula provides the consumer with required information, so that consumer is intuitively understood the relevent information of commodity, experiences quotient whenever and wherever possible
Product function etc..
It should be noted that information is only used for reinforcing the reason to the background of the disclosure disclosed in above-mentioned background technology part
Solution, therefore may include the information not constituted to the prior art known to persons of ordinary skill in the art.
Summary of the invention
The disclosure be designed to provide a kind of augmented reality display methods and augmented reality display device, electronic equipment and
Computer readable storage medium, and then commodity image caused by the limitation due to the relevant technologies is overcome at least to a certain extent
It can not be associated with scene and the problems such as consumer can not interact with commodity.
Other characteristics and advantages of the disclosure will be apparent from by the following detailed description, or partially by the disclosure
Practice and acquistion.
According to one aspect of the disclosure, a kind of augmented reality display methods is provided, which comprises acquisition collects
Reality scene image in entity information；For the threedimensional model of virtual objects, the dimension information of the threedimensional model is extracted；
According to the entity information and the dimension information, the display parameters of the threedimensional model are determined；Based on the display parameters,
The threedimensional model image of the virtual objects is shown in the reality scene image.
In a kind of exemplary embodiment of the disclosure, the entity letter obtained in collected reality scene image
Breath, comprising: identify at least one entity in the reality scene image；Obtain the boundary information and position letter of the entity
Breath.
In a kind of exemplary embodiment of the disclosure, the method also includes: obtain the video counts of the virtual objects
According to；The still image of default frame number is extracted from the video data；The virtual objects are generated using the still image
Threedimensional model.
In a kind of exemplary embodiment of the disclosure, the display parameters of the determination threedimensional model, comprising: determine
The display size and scaling of the threedimensional model；Determine the display position of the threedimensional model.
In a kind of exemplary embodiment of the disclosure, the augmented reality display methods further include: in response to being directed to institute
The interactive instruction for stating virtual objects shows the three-dimensional mould of the virtual objects after treatment in the reality scene image
Type image.
In a kind of exemplary embodiment of the disclosure, the augmented reality display methods further include: for the hand of user
Gesture movement generates the interactive instruction for being directed to the virtual objects.
In a kind of exemplary embodiment of the disclosure, the gesture motion for user, which generates, is directed to the virtual object
The interactive instruction of product, comprising: when judging the gesture motion for first gesture, generate for moving the virtual objects
One interactive instruction；When judging the gesture motion for second gesture, the second interaction for scaling the virtual objects is generated
Instruction.
According to one aspect of the disclosure, a kind of augmented reality display device is provided, described device includes: to obtain information mould
Block is configured as obtaining the entity information in collected reality scene image；Information module is extracted, is configured as virtual
The threedimensional model of article extracts the dimension information of the threedimensional model；Parameter determination module is configured as being believed according to the entity
Breath and the dimension information, determine the display parameters of the threedimensional model；Image display is configured based on the display
Parameter shows the threedimensional model image of the virtual objects in the reality scene image.
According to one aspect of the disclosure, a kind of electronic equipment is provided, comprising: processor and memory；Wherein, memory
On be stored with computer-readable instruction, the computer-readable instruction is realized above-mentioned any exemplary when being executed by the processor
The augmented reality display methods of embodiment.
According to one aspect of the disclosure, a kind of computer readable storage medium is provided, computer program is stored thereon with,
The computer program realizes the augmented reality display methods in above-mentioned any exemplary embodiment when being executed by processor.
The exemplary embodiment of the disclosure has the advantages that
In the method and device that the exemplary embodiment of the disclosure provides, determined by the entity in reality scene image
The display parameters of the threedimensional model of virtual objects, to make what user definitely found out virtual objects and reality scene to be adapted to feelings
Condition brings user and more really experiences, and improves buying rate, reduces and does not meet bring because buying article and true service condition back
Return of goods rate；Further, human-computer interaction is carried out by gesture motion, not only adds interest to the online shopping of user, more allows
User has feeling of immersion on the spot in person, and shopping way is more flexible and accurate, promotes conversion ratio.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not
The disclosure can be limited.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the disclosure
Example, and together with specification for explaining the principles of this disclosure.It should be evident that the accompanying drawings in the following description is only the disclosure
Some embodiments for those of ordinary skill in the art without creative efforts, can also basis
These attached drawings obtain other attached drawings.
Fig. 1 schematically shows a kind of flow chart of augmented reality display methods in disclosure exemplary embodiment；
Fig. 2 schematically shows a kind of part steps flow chart of augmented reality display methods in the embodiment of the present disclosure；
Fig. 3 schematically shows a kind of part steps flow chart of augmented reality display methods in the embodiment of the present disclosure；
Fig. 4 schematically shows a kind of part steps flow chart of augmented reality display methods in the embodiment of the present disclosure；
Fig. 5 schematically shows a kind of part steps flow chart of augmented reality display methods in the embodiment of the present disclosure；
Fig. 6 shows a kind of structural schematic diagram of augmented reality display device in disclosure exemplary embodiment；
Fig. 7 schematically shows a kind of electronics for realizing augmented reality display methods in disclosure exemplary embodiment and sets
It is standby；
Fig. 8 schematically shows a kind of computer for realizing augmented reality display methods in disclosure exemplary embodiment
Readable storage medium storing program for executing.
Specific embodiment
Illustrative embodiments are described more fully with reference to the drawings.However, illustrative embodiments can be with more
Kind form is implemented, and is not understood as limited to example set forth herein；On the contrary, thesing embodiments are provided so that the disclosure will
More fully and completely, and by the design of illustrative embodiments comprehensively it is communicated to those skilled in the art.It is described
Feature, structure or characteristic can be incorporated in any suitable manner in one or more embodiments.
In addition, attached drawing is only the schematic illustrations of the disclosure, it is not necessarily drawn to scale.Identical attached drawing mark in figure
Note indicates same or similar part, thus will omit repetition thereof.Some block diagrams shown in the drawings are function
Energy entity, not necessarily must be corresponding with physically or logically independent entity.These function can be realized using software form
Energy entity, or these functional entitys are realized in one or more hardware modules or integrated circuit, or at heterogeneous networks and/or place
These functional entitys are realized in reason device device and/or microcontroller device.
It should be noted that term " comprising ", " being configured with ", " being set to " are to indicate open packet in the disclosure
The meaning including including, and refer to that other element/composition portion also may be present in the element in addition to listing/component part/other than waiting
Point/etc.；Term " first ", " second " etc. are only used as label, are not the limitations to its number of objects or order.
In an exemplary embodiment of the disclosure, a kind of augmented reality display methods is provided firstly, is set applied to terminal
Standby, for example, which can be computer configured with camera or notebook, it is more to show with augmented reality
Function glasses are also possible to intelligent terminal as acquisition and processing side and the home videos with communication link are as display side
Equipment, in addition it can be any other electric terminal equipment with augmented reality display function.
With reference to shown in Fig. 1, which mainly be may comprise steps of:
Step S101. obtains the entity information in collected reality scene image.
In practical applications, the photographic device acquisition reality scene image of intelligent terminal can be used, which can
It also may include multiple cameras positioned at different angle to include a camera.When photographic device only includes a camera shooting
When head, 360 ° of acquisitions can be carried out, every 15 ° of acquisitions, one scene, 1 can be set to the acquisition distance of the scene
Rice, 2 meters, 3 meters, five kinds of distances such as 4 meters and 5 meters, acquisition environment can be set in room on daytime, two kinds of scenes such as in night room；
Correspondingly, different acquisition distance and acquisition environment need to only be arranged when photographic device includes multiple cameras.
For different virtual objects, need to select optimum entity as ginseng in collected reality scene image
It examines.For the reality scene image, need to obtain entity information therein.Entity in the entity information can be reality scene
The object for including in image, object number are not construed as limiting.It is referred to for different entities due to its local environment difference
Object is different, for example, entity can be tea table, chair, sofa, desk etc. if reality scene is in family；When reality scene is to hand over
On logical tool, entity can be seat, display screen, window etc.；When reality scene is office, entity can be water dispenser, do
Public table, computer, phone etc.；When reality scene is in market, entity can be model, pier glass etc..So, entity information refers to
Be exactly information relevant to entity, such as dimension information, location information, color information, shape information, environmental information, wherein
Environmental information is the relevant information of entity local environment, for example, physical distance wall distance, local environment brightness, with it is locating
The distance between other entities in environment etc..
Step S102. is directed to the threedimensional model of virtual objects, extracts the dimension information of threedimensional model.
By the entity information in the available collected reality scene image of step S101, this step obtains virtual object
The dimension information of the threedimensional model of product.In general, virtual objects are presented in the form of 3D model.Wherein, which can
To be the article in shop on line, such as furniture, dress ornament, equipment, musical instrument, accessory etc..Obtaining images of items can be by showing
The images of items that name acquiring provides is inputted on the page, can also obtain images of items etc. by shooting article using camera shooting tool
Mode.The threedimensional model of corresponding virtual objects is generated with the images of items got, and obtains the ruler of the threedimensional model
Very little information.For example, the characteristic information for obtaining the threedimensional model of desk can be its length etc. when virtual objects are desk
Dimension information etc..For the different available different dimension informations of virtual objects, facilitate subsequent operation.
Step S103. determines the display parameters of threedimensional model according to entity information and dimension information.
The entity information in reality scene image is got in step S101, and gets virtual objects in step S102
The dimension information of threedimensional model, this step can show the threedimensional model of the virtual objects on line in reality scene image,
The display parameters of threedimensional model are determined by entity information and dimension information.If the entity in reality scene image is chair
Son, and have been achieved with the entity information of the chair, the i.e. information such as its size, shape, position and color, when virtual objects are desk
When, dimension scale between the two can be determined according to the size relationship of dimension information and desk in the entity information obtained
Relationship determines the display size of desk, and aobvious to the display position of desk and adaptation color etc. according to other entity informations of chair
Show that parameter is determined.
Step S104. is based on display parameters, and the threedimensional model image of virtual objects is shown in reality scene image.
The display parameters of the threedimensional model of virtual objects are had determined in step s 103, this step can be by virtual objects
Threedimensional model image shown in reality scene image.It is virtual in order to be intervened in the reality scene image that photographic device is shot
The threedimensional model image of article needs to allow users to the presence for feeling virtual objects in reality scene to camera shooting
The relevant parameter of device is set, and to carry out threedimensional model image on the basis of the threedimensional model image of virtual objects
With the superposition processing of reality scene image, for example, virtual objects are looped around around the entity in reality scene, or it is covered on reality
On body, or be placed on entity side etc..
It can be in the glasses that augmented reality is shown to the display of the threedimensional model image of virtual objects in reality scene image
On eyeglass, it is also possible on the screen of intelligent terminal, such as on the display screen of mobile phone, computer, home videos.
It is to be shown to needing by the entity in reality scene according to the augmented reality display methods in this example embodiment
The associated display information of the threedimensional model of virtual objects is determined, so that it is determined that going out most true virtual objects dimension information；
Further, virtual goods are shown in reality scene, user is determined whether to meet and is expected, assesses whether that purchase has
Great reference value improves the success rate bought on line, reduces due to that can not grasp merchandise news bring goods return and replacement
It happens, has saved cost and resource.
On the basis of above embodiments, as shown in Fig. 2, obtaining the entity information in reality scene image, including following
Step:
Step S201. identifies at least one entity in reality scene image.
Reality scene image can be acquired in step S101, this step can identify the entity in reality scene image.It is right
Entity recognition in reality scene image can be first identifies entire reality scene image, is also possible to real field
A certain specific region in scape image is identified.Before identifying reality scene image, reply reality scene image is pre- first
Processing realizes that pretreatment mode can have: down-sampled, binaryzation, filtering etc..Wherein, down-sampled to be used to improve real field
Scape image property, meeting reality scene image needs display area size；Binaryzation can make the characteristic point chosen not only
Dependent on color, it is more clear；Noise can be reduced using gaussian filtering, draws the reality scene image got such as
The influence of trace, dust or the like.
Entity in reality scene image is identified, without limitation to the entity number recognized, can be one,
It is also possible to multiple, the entity number of identification is more, to the display size and/or scaling for determining threedimensional model, Yi Jixian
Show that the positioning of position is more accurate.The mode of identification entity, which can be, identifies particular color, is also possible to specific shape
Shape is identified, as long as required entity can be identified, the present exemplary embodiment to identification method without limitation.
The boundary information and location information of step S202. acquisition entity.
The entity in reality scene image, the available identified entity of this step have been identified in step s 201
Relevant information, which can be the boundary information and location information of entity.For example, the location information of entity is obtained,
It can establish three-dimensional system of coordinate of the entity in reality scene image, and establish the photographic device for capturing the reality scene image
Coordinate system is imaged, according to mutually converting between three-dimensional system of coordinate and camera shooting coordinate system, gets the location information of entity.And it is real
The boundary information of body can be determined by image recognition algorithm, such as Sobel edge detection algorithm, Laplace operator etc..
The present embodiment can identify the entity in reality scene image, and determine its relevant information, can accurately grasp existing
Entity information in real environment has very important reference significance for the determination of the display parameters of virtual objects.
On the basis of above embodiments, as shown in figure 3, obtaining the threedimensional model of virtual objects, comprising the following steps:
The video data of step S301. acquisition virtual objects.
Businessman can be used camera terminal and shoot video to virtual objects, obtain video data.Wherein, camera terminal can be with
It can also include obtaining video including monitor camera, the front camera of intelligent terminal, rear camera of intelligent terminal etc.
The processing terminal that it is handled after data.For collected video data, can be stored in data such as xml, json
In database and server.
Step S302. extracts the still image of default frame number from video data.
The video data of virtual objects is collected in step S301, this step can extract in the video data
Still image.By setting extract still image frame number interval, and the starting point at frame number interval can be it is preceding once obtain it is quiet
Frame number when state image, come complete to extract default frame number still image purpose.Frame number interval should not be arranged it is too small, it is otherwise empty
Quasi- article has not occurred variation and extracts still image, and the still image quantity that will lead to extraction is excessive, results in waste of resources；Frame
Number interval should not be arranged excessive, and otherwise the extraction quantity of still image is very few, will lead to effective information extract it is insufficient so that user
Experience Degree decline.In general, being extracted to allow the threedimensional model of virtual objects to show three-dimensional stereopsis more true to nature
The still image of default frame number may include the front views of virtual objects, rear view, left side view, right side view, above
View and lower view.The mode for extracting still image can be the mode for the coding for using Standard of image compression for JPEG.
Step S303. generates the threedimensional model of virtual objects using still image.
Can be drawn into step s 302 virtual objects still image several, this step will be raw using still image
At the threedimensional model of the virtual objects.Smart machine can be used to acquisition in the technology that threedimensional model is established by still image
The still image arrived carries out graphics process and three-dimensional computations, to automatically generate the threedimensional model of virtual objects.
The present embodiment is illustrated the generation of the threedimensional model of virtual objects, obtains still image by video data,
To threedimensional model needed for building, generating mode is simple, easy to operate, and the threedimensional model constructed by practical still image is more
It is true to nature, commodity perception is improved, the shopping experience of user is improved.
On the basis of above embodiments, as shown in figure 4, determining the display parameters of threedimensional model, comprising the following steps:
Step S401. determines the display size and scaling of threedimensional model.
According to the entity in reality scene image, the display parameters of threedimensional model can be determined, so that it is not only
It can reflect the real information of virtual objects, and can reflect it simultaneously in the most appropriate and suitable size of environment, user
It can with ocular and clear know whether virtual objects match with the true use environment of user.For example, if threedimensional model is one
Desk, can be according to the stool of placement area in reality scene image or the size of sofa and ratio, to determine suitable pendulum
Put the display size and scaling of the desk in region, such as the height of desk, length, width.
Step S402. determines the display position of threedimensional model.
The display size and scaling of threedimensional model can be determined in step S401, this step can be to the three-dimensional mould
The display position of type is determined.The display position of threedimensional model should be placement position in reality scene image, using position
The optimum position such as set.For example, when virtual objects are desk, display position should stool or sofa just before
Side, and keep suitable distance.
Corresponding to the entity information in reality scene image, the present embodiment obtains the dimension information of threedimensional model, with the two
Proportionate relationship, determine the corresponding display size of the optimal display result of threedimensional model and scaling and display position, keep away
Exempt from since virtual objects are excessive or the lofty sense of the bad bring in too small and placement position.
On the basis of above embodiments, augmented reality display methods further include: in response to being directed to the interaction of virtual objects
Instruction, shows the threedimensional model image of virtual objects after treatment in reality scene image.
When the threedimensional model of virtual objects is placed in reality scene image, it can not determine that default color at the beginning is most
It is adapted to color, can not also determine that display surface at the beginning is the one side of optimal display result, so needing to virtual objects
Threedimensional model image is adjusted.When user implements a gesture motion, it is equivalent to and has sent an interaction for being directed to virtual objects
Instruction, the interactive instruction can complete the movement such as the scaling to threedimensional model, rotation, switching.This is got well virtually when user is selected
The optimal display result of article, that is, complete and interacted in reality scene image with the threedimensional model images of virtual objects
Journey.
The present embodiment by an interactive instruction allow user in reality scene image with the three-dimensional mould of virtual objects
Type interacts, and shows the threedimensional model image after interaction, can not only guarantee the really substitution sense of user, but also can guarantee not
With the individualized selection of user, virtual objects can also be made to be placed in reality scene with optimal display state, ensure that on line
The optimal display effect of shopping.
On the basis of above embodiments, augmented reality display methods further include: generate needle for the gesture motion of user
Interactive instruction to virtual objects.
When obtaining the gesture motion of user, the hand dynamic image of user can be first acquired.Pass through taking the photograph for intelligent terminal
The hand dynamic image of user is obtained as the depth camera on device or augmented reality equipment, and to the hand dynamic image
It is parsed.The real-time hand information for obtaining user's hand, may include effective gesture motion and invalid gesture motion, effective hand
Gesture movement refers to default gesture motion.One default gesture motion should be at least set in the augmented reality device, for example, big thumb
Refer to and index finger closure, index finger rotation, index finger such as stir at other gesture motions, but is not limited to use specific finger or specific dynamic
Make.One default gesture motion is provided with corresponding operation, such as zooms in and out, rotates, switches to virtual objects.Work as acquisition
When the gesture motion of the user arrived, which can be matched with default gesture motion, if successful match, the hand
Gesture movement can execute corresponding operating, if matching is unsuccessful, which is considered as invalid gesture motion.User with void
The threedimensional model of quasi- article interacts, can be by having held when needing to adjust it such as being scaled, rotated, switched
Capable gesture operation sends an interactive instruction and carries out relevant operation.
The present embodiment issues an interactive instruction to virtual objects and executes behaviour to virtual objects by the gesture motion of user
Make, the fluency and accuracy when user's shopping on the one hand can be improved, user is facilitated to carry out the display state of threedimensional model
Adjustment, to reach desired display effect；On the other hand it can break in traditional wire nothing between the user and commodity of shopping way
The barrier of method interaction improves the feeling of immersion of user's shopping experience on line.
On the basis of above embodiments, as shown in figure 5, the gesture motion for user is generated for the virtual objects
Interactive instruction, may comprise steps of:
Step S501. is generated and is referred to for the first interaction of mobile virtual article when judging gesture motion for first gesture
It enables.
For having got the gesture motion of user, this step, which is listed to work as, judges that the gesture motion got is first-hand
Scene when gesture.When the gesture motion got is a kind of deliberate action and when for first gesture, which can be food
Refer to overturning, when there is the gesture motion, is equivalent to and triggers the first interactive instruction, which corresponds to mobile virtual article
Operation.
Step S502. generates the second interaction for scaling virtual objects and refers to when judging gesture motion for second gesture
It enables.
The gesture motion of user is got in step S501, this step lists the gesture motion when judgement is got
Scene when for second gesture.When the gesture motion got is a kind of deliberate action and when for second gesture, the second gesture
It can be the closure of thumb and index finger.As long as there is the gesture motion, it is equivalent to and triggers the second interactive instruction, which refers to
Enable the operation of corresponding scaling virtual objects.Wherein, the second interactive instruction may include two kinds of situations: when between thumb and index finger
Distance when being from small become larger, can be and reduce virtual objects；When the distance between thumb and index finger are from large to small,
It can be and virtual objects are amplified.
The present embodiment lists the display state of the corresponding adjustment virtual objects of two kinds of gesture motions, to the interaction side of user
Formula is illustrated, and keeps user so more acurrate that operate to virtual objects in shopping, virtual objects are more life-like, shopping
Mode is more flexible.
It should be noted that, although the embodiment of exemplary embodiment above describes side in the disclosure with particular order
Each step of method, still, this does not require that perhaps hint must execute these steps or necessary in this particular order
It executes whole steps and is just able to achieve desired result.Additionally or alternatively, it is convenient to omit certain steps, by multiple steps
It merges into a step to execute, and/or a step is decomposed into execution of multiple steps etc..
In addition, additionally providing a kind of augmented reality display device in the example embodiment of the disclosure.Referring to shown in Fig. 6,
Augmented reality display device 600 may include: obtain information module 601, extract information module 602, parameter determination module 603,
Image display 604.Wherein:
Information module 601 is obtained, is configured as obtaining the entity information in collected reality scene image；Extract information
Module 602 is configured as the threedimensional model for virtual objects, extracts the dimension information of the threedimensional model；Parameter determines mould
Block 603 is configured as determining the display parameters of the threedimensional model according to the entity information and the dimension information；Figure
As display module 604, it is configured to show the three of the virtual objects in the reality scene image based on the display parameters
Dimension module image.
The detail of above-mentioned augmented reality display device has carried out in corresponding augmented reality display methods in detail
Thin description, therefore details are not described herein again.
It should be noted that although be referred in the above detailed description augmented reality display device 600 several modules or
Unit, but this division is not enforceable.In fact, according to embodiment of the present disclosure, above-described two or more
Multimode or the feature and function of unit can embody in a module or unit.Conversely, above-described one
Module or the feature and function of unit can be to be embodied by multiple modules or unit with further division.
In addition, in an exemplary embodiment of the disclosure, additionally providing a kind of electronic equipment that can be realized the above method.
The electronic equipment 700 of this embodiment according to the present invention is described referring to Fig. 7.The electronics that Fig. 7 is shown is set
Standby 700 be only an example, should not function to the embodiment of the present invention and use scope bring any restrictions.
As shown in fig. 7, electronic equipment 700 is showed in the form of universal computing device.The component of electronic equipment 700 can wrap
It includes but is not limited to: at least one above-mentioned processing unit 710, at least one above-mentioned storage unit 720, the different system components of connection
The bus 730 of (including storage unit 720 and processing unit 710), display unit 740.
Wherein, the storage unit is stored with program code, and said program code can be held by the processing unit 710
Row, so that various according to the present invention described in the execution of the processing unit 710 above-mentioned " illustrative methods " part of this specification
The step of exemplary embodiment.
Storage unit 720 may include the readable medium of volatile memory cell form, such as Random Access Storage Unit
(RAM) 721 and/or cache memory unit 722, it can further include read-only memory unit (ROM) 723.
Storage unit 720 can also include program/utility 724 with one group of (at least one) program module 725,
Such program module 725 includes but is not limited to: operating system, one or more application program, other program modules and
It may include the realization of network environment in program data, each of these examples or certain combination.
Bus 730 can be to indicate one of a few class bus structures or a variety of, including storage unit bus or storage
Cell controller, peripheral bus, graphics acceleration port, processing unit use any bus structures in a variety of bus structures
Local bus.
Electronic equipment 700 can also be with one or more external equipments 900 (such as keyboard, sensing equipment, bluetooth equipment
Deng) communication, can also be enabled a user to one or more equipment interact with the electronic equipment 700 communicate, and/or with make
Any equipment (such as the router, modulation /demodulation that the electronic equipment 700 can be communicated with one or more of the other calculating equipment
Device etc.) communication.This communication can be carried out by input/output (I/O) interface 750.Also, electronic equipment 700 can be with
By network adapter 760 and one or more network (such as local area network (LAN), wide area network (WAN) and/or public network,
Such as internet) communication.As shown, network adapter 740 is communicated by bus 730 with other modules of electronic equipment 700.
It should be understood that although not shown in the drawings, other hardware and/or software module can not used in conjunction with electronic equipment 700, including but not
Be limited to: microcode, device driver, redundant processing unit, external disk drive array, RAID system, tape drive and
Data backup storage system etc..
By the description of above embodiment, those skilled in the art is it can be readily appreciated that example embodiment described herein
It can also be realized in such a way that software is in conjunction with necessary hardware by software realization.Therefore, implemented according to the disclosure
The technical solution of example can be embodied in the form of software products, which can store in a non-volatile memories
In medium (can be CD-ROM, USB flash disk, mobile hard disk etc.) or on network, including some instructions are so that a calculating equipment (can
To be personal computer, server, terminal installation or network equipment etc.) it executes according to the method for the embodiment of the present disclosure.
In an exemplary embodiment of the disclosure, a kind of computer readable storage medium is additionally provided, energy is stored thereon with
Enough realize the program product of this specification above method.In some possible embodiments, various aspects of the invention can be with
It is embodied as a kind of form of program product comprising program code, it is described when described program product is run on the terminal device
Program code is for executing the terminal device described in above-mentioned " illustrative methods " part of this specification according to the present invention
The step of various exemplary embodiments.
Refering to what is shown in Fig. 8, the program product 800 for realizing the above method of embodiment according to the present invention is described,
It can using portable compact disc read only memory (CD-ROM) and including program code, and can in terminal device, such as
It is run on PC.However, program product of the invention is without being limited thereto, in this document, readable storage medium storing program for executing, which can be, appoints
What include or the tangible medium of storage program that the program can be commanded execution system, device or device use or and its
It is used in combination.
Described program product can be using any combination of one or more readable mediums.Readable medium can be readable letter
Number medium or readable storage medium storing program for executing.Readable storage medium storing program for executing for example can be but be not limited to electricity, magnetic, optical, electromagnetic, infrared ray or
System, device or the device of semiconductor, or any above combination.The more specific example of readable storage medium storing program for executing is (non exhaustive
List) include: electrical connection with one or more conducting wires, portable disc, hard disk, random access memory (RAM), read-only
Memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc read only memory
(CD-ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.
Computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal,
In carry readable program code.The data-signal of this propagation can take various forms, including but not limited to electromagnetic signal,
Optical signal or above-mentioned any appropriate combination.Readable signal medium can also be any readable Jie other than readable storage medium storing program for executing
Matter, the readable medium can send, propagate or transmit for by instruction execution system, device or device use or and its
The program of combined use.
The program code for including on readable medium can transmit with any suitable medium, including but not limited to wirelessly, have
Line, optical cable, RF etc. or above-mentioned any appropriate combination.
The program for executing operation of the present invention can be write with any combination of one or more programming languages
Code, described program design language include object oriented program language-Java, C++ etc., further include conventional
Procedural programming language-such as " C " language or similar programming language.Program code can be fully in user
It calculates and executes in equipment, partly executes on a user device, being executed as an independent software package, partially in user's calculating
Upper side point is executed on a remote computing or is executed in remote computing device or server completely.It is being related to far
Journey calculates in the situation of equipment, and remote computing device can pass through the network of any kind, including local area network (LAN) or wide area network
(WAN), it is connected to user calculating equipment, or, it may be connected to external computing device (such as utilize ISP
To be connected by internet).
Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to its of the disclosure
His embodiment.This application is intended to cover any variations, uses, or adaptations of the disclosure, these modifications, purposes or
Adaptive change follow the general principles of this disclosure and including the undocumented common knowledge in the art of the disclosure or
Conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the disclosure are by claim
It points out.
Claims (10)
1. a kind of augmented reality display methods characterized by comprising
Obtain the entity information in collected reality scene image；
For the threedimensional model of virtual objects, the dimension information of the threedimensional model is extracted；
According to the entity information and the dimension information, the display parameters of the threedimensional model are determined；
Based on the display parameters, the threedimensional model image of the virtual objects is shown in the reality scene image.
2. augmented reality display methods according to claim 1, which is characterized in that described to obtain collected reality scene
Entity information in image, comprising:
Identify at least one entity in the reality scene image；
Obtain the boundary information and location information of the entity.
3. augmented reality display methods according to claim 1, which is characterized in that the method also includes:
Obtain the video data of the virtual objects；
The still image of default frame number is extracted from the video data；
The threedimensional model of the virtual objects is generated using the still image.
4. augmented reality display methods according to claim 1, which is characterized in that the determination threedimensional model is shown
Show parameter, comprising:
Determine the display size and scaling of the threedimensional model；
Determine the display position of the threedimensional model.
5. augmented reality display methods according to claim 1, which is characterized in that the method also includes:
In response to be directed to the virtual objects interactive instruction, shown in the reality scene image after treatment described in
The threedimensional model image of virtual objects.
6. augmented reality display methods according to claim 5, which is characterized in that the method also includes:
The interactive instruction for the virtual objects is generated for the gesture motion of user.
7. augmented reality display methods according to claim 6, which is characterized in that the gesture motion for user is raw
At the interactive instruction for being directed to the virtual objects, comprising:
When judging the gesture motion for first gesture, the first interactive instruction for moving the virtual objects is generated；
When judging the gesture motion for second gesture, the second interactive instruction for scaling the virtual objects is generated.
8. a kind of augmented reality display device characterized by comprising
Information module is obtained, is configured as obtaining the entity information in collected reality scene image；
Information module is extracted, the threedimensional model for virtual objects is configured as, extracts the dimension information of the threedimensional model；
Parameter determination module is configured as determining the threedimensional model according to the entity information and the dimension information
Display parameters；
Image display is configured to show the virtual objects in the reality scene image based on the display parameters
Threedimensional model image.
9. a kind of electronic equipment characterized by comprising
Processor；And
Memory is stored with computer-readable instruction on the memory, and the computer-readable instruction is held by the processor
Method according to any one of claim 1 to 7 is realized when row.
10. a kind of computer readable storage medium, is stored thereon with computer program, the computer program is executed by processor
Shi Shixian is according to claim 1 to any one of 7 the methods.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910120539.3A CN109903129A (en) | 2019-02-18 | 2019-02-18 | Augmented reality display methods and device, electronic equipment, storage medium |
| PCT/CN2019/125029 WO2020168792A1 (en) | 2019-02-18 | 2019-12-13 | Augmented reality display method and apparatus, electronic device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910120539.3A CN109903129A (en) | 2019-02-18 | 2019-02-18 | Augmented reality display methods and device, electronic equipment, storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109903129A true CN109903129A (en) | 2019-06-18 |
Family
ID=66944949
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910120539.3A Pending CN109903129A (en) | 2019-02-18 | 2019-02-18 | Augmented reality display methods and device, electronic equipment, storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109903129A (en) |
| WO (1) | WO2020168792A1 (en) |
Cited By (32)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110473293A (en) * | 2019-07-30 | 2019-11-19 | Oppo广东移动通信有限公司 | Virtual objects processing method and processing device, storage medium and electronic equipment |
| CN110533780A (en) * | 2019-08-28 | 2019-12-03 | 深圳市商汤科技有限公司 | A kind of image processing method and its device, equipment and storage medium |
| CN110544299A (en) * | 2019-09-05 | 2019-12-06 | 广东电网有限责任公司 | power distribution network 10kV pole load switch 3D model and generation method thereof |
| CN111063033A (en) * | 2019-11-30 | 2020-04-24 | 国网辽宁省电力有限公司葫芦岛供电公司 | Electric power material goods arrival acceptance method based on augmented reality technology |
| CN111084980A (en) * | 2019-12-25 | 2020-05-01 | 网易（杭州）网络有限公司 | Method and device for purchasing virtual article |
| CN111242734A (en) * | 2020-01-09 | 2020-06-05 | 中移（杭州）信息技术有限公司 | Commodity display method, server, terminal, system, electronic equipment and storage medium |
| CN111274910A (en) * | 2020-01-16 | 2020-06-12 | 腾讯科技（深圳）有限公司 | Scene interaction method and device and electronic equipment |
| CN111415422A (en) * | 2020-04-17 | 2020-07-14 | Oppo广东移动通信有限公司 | Virtual object adjustment method and device, storage medium and augmented reality equipment |
| CN111562845A (en) * | 2020-05-13 | 2020-08-21 | 贝壳技术有限公司 | Method, device and equipment for realizing three-dimensional space scene interaction |
| CN111580679A (en) * | 2020-06-07 | 2020-08-25 | 浙江商汤科技开发有限公司 | Space capsule display method and device, electronic equipment and storage medium |
| WO2020168792A1 (en) * | 2019-02-18 | 2020-08-27 | 北京三快在线科技有限公司 | Augmented reality display method and apparatus, electronic device, and storage medium |
| CN111625103A (en) * | 2020-06-03 | 2020-09-04 | 浙江商汤科技开发有限公司 | Sculpture display method and device, electronic equipment and storage medium |
| CN111679741A (en) * | 2020-06-08 | 2020-09-18 | 浙江商汤科技开发有限公司 | Image processing method and device, electronic equipment and storage medium |
| CN111709818A (en) * | 2020-06-30 | 2020-09-25 | 广东奥园奥买家电子商务有限公司 | Augmented reality-based commodity information display method and device and computer equipment |
| CN111897431A (en) * | 2020-07-31 | 2020-11-06 | 北京市商汤科技开发有限公司 | Display method and device, display equipment and computer readable storage medium |
| CN111918114A (en) * | 2020-07-31 | 2020-11-10 | 北京市商汤科技开发有限公司 | Image display method, image display device, display equipment and computer readable storage medium |
| CN112016439A (en) * | 2020-08-26 | 2020-12-01 | 上海松鼠课堂人工智能科技有限公司 | Game learning environment creation method and system based on antagonistic neural network |
| CN112270765A (en) * | 2020-10-09 | 2021-01-26 | 百度(中国)有限公司 | Information processing method, device, terminal, electronic device and storage medium |
| CN112308980A (en) * | 2020-10-30 | 2021-02-02 | 脸萌有限公司 | Augmented reality interactive display method and equipment |
| CN112422901A (en) * | 2020-10-30 | 2021-02-26 | 哈雷医用(广州)智能技术有限公司 | Method and device for generating operation virtual reality video |
| CN112418995A (en) * | 2020-11-26 | 2021-02-26 | 珠海格力电器股份有限公司 | Online shopping virtual interaction method based on MR virtual reality technology and storage medium |
| CN112506463A (en) * | 2020-12-04 | 2021-03-16 | 歌尔光学科技有限公司 | Display method, device and equipment based on head-mounted equipment |
| CN112535392A (en) * | 2019-09-20 | 2021-03-23 | 北京外号信息技术有限公司 | Article display system based on optical communication device, information providing method, apparatus and medium |
| CN112672185A (en) * | 2020-12-18 | 2021-04-16 | 脸萌有限公司 | Augmented reality-based display method, device, equipment and storage medium |
| CN112817449A (en) * | 2021-01-28 | 2021-05-18 | 北京市商汤科技开发有限公司 | Interaction method and device for augmented reality scene, electronic equipment and storage medium |
| CN112819559A (en) * | 2019-11-18 | 2021-05-18 | 北京沃东天骏信息技术有限公司 | Article comparison method and device |
| CN113298588A (en) * | 2020-06-19 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Method and device for providing object information and electronic equipment |
| CN113661470A (en) * | 2019-09-26 | 2021-11-16 | 苹果公司 | Presenting environments based on physical dimensions |
| CN113947670A (en) * | 2021-09-18 | 2022-01-18 | 北京城市网邻信息技术有限公司 | Information display method and device, electronic equipment and readable medium |
| CN114167744A (en) * | 2021-12-23 | 2022-03-11 | 四川启睿克科技有限公司 | AR-based household intelligent appliance management method |
| CN114935994A (en) * | 2022-05-10 | 2022-08-23 | 阿里巴巴（中国）有限公司 | Article data processing method, device and storage medium |
| WO2023231793A1 (en) * | 2022-05-31 | 2023-12-07 | 京东方科技集团股份有限公司 | Method for virtualizing physical scene, and electronic device, computer-readable storage medium and computer program product |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI717296B (en) * | 2020-06-24 | 2021-01-21 | 南亞塑膠工業股份有限公司 | Cyber shopping mall system |
| CN113362472B (en) * | 2021-05-27 | 2022-11-01 | 百度在线网络技术（北京）有限公司 | Article display method, apparatus, device, storage medium and program product |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150077340A1 (en) * | 2013-09-18 | 2015-03-19 | Genius Toy Taiwan Co., Ltd. | Method, system and computer program product for real-time touchless interaction |
| CN106817568A (en) * | 2016-12-05 | 2017-06-09 | 网易（杭州）网络有限公司 | A kind of augmented reality display methods and device |
| CN109213728A (en) * | 2017-06-29 | 2019-01-15 | 深圳市掌网科技股份有限公司 | Cultural relic exhibition method and system based on augmented reality |
| CN107862580A (en) * | 2017-11-22 | 2018-03-30 | 纽世纪（广东）电子商务有限公司 | A kind of commodity method for pushing and system |
| CN108269307B (en) * | 2018-01-15 | 2023-04-07 | 歌尔科技有限公司 | Augmented reality interaction method and equipment |
| CN108492363B (en) * | 2018-03-26 | 2020-03-10 | Oppo广东移动通信有限公司 | Augmented reality-based combination method and device, storage medium and electronic equipment |
| CN109903129A (en) * | 2019-02-18 | 2019-06-18 | 北京三快在线科技有限公司 | Augmented reality display methods and device, electronic equipment, storage medium |
-
2019
- 2019-02-18 CN CN201910120539.3A patent/CN109903129A/en active Pending
- 2019-12-13 WO PCT/CN2019/125029 patent/WO2020168792A1/en active Application Filing
Cited By (44)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020168792A1 (en) * | 2019-02-18 | 2020-08-27 | 北京三快在线科技有限公司 | Augmented reality display method and apparatus, electronic device, and storage medium |
| US11893702B2 (en) | 2019-07-30 | 2024-02-06 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Virtual object processing method and apparatus, and storage medium and electronic device |
| CN110473293B (en) * | 2019-07-30 | 2023-03-24 | Oppo广东移动通信有限公司 | Virtual object processing method and device, storage medium and electronic equipment |
| CN110473293A (en) * | 2019-07-30 | 2019-11-19 | Oppo广东移动通信有限公司 | Virtual objects processing method and processing device, storage medium and electronic equipment |
| CN110533780A (en) * | 2019-08-28 | 2019-12-03 | 深圳市商汤科技有限公司 | A kind of image processing method and its device, equipment and storage medium |
| CN110533780B (en) * | 2019-08-28 | 2023-02-24 | 深圳市商汤科技有限公司 | Image processing method and device, equipment and storage medium thereof |
| US11880956B2 (en) | 2019-08-28 | 2024-01-23 | Shenzhen Sensetime Technology Co., Ltd. | Image processing method and apparatus, and computer storage medium |
| CN110544299A (en) * | 2019-09-05 | 2019-12-06 | 广东电网有限责任公司 | power distribution network 10kV pole load switch 3D model and generation method thereof |
| CN110544299B (en) * | 2019-09-05 | 2020-10-16 | 广东电网有限责任公司 | Power distribution network 10kV pole load switch 3D model and generation method thereof |
| CN112535392A (en) * | 2019-09-20 | 2021-03-23 | 北京外号信息技术有限公司 | Article display system based on optical communication device, information providing method, apparatus and medium |
| CN113661470A (en) * | 2019-09-26 | 2021-11-16 | 苹果公司 | Presenting environments based on physical dimensions |
| CN112819559A (en) * | 2019-11-18 | 2021-05-18 | 北京沃东天骏信息技术有限公司 | Article comparison method and device |
| CN111063033A (en) * | 2019-11-30 | 2020-04-24 | 国网辽宁省电力有限公司葫芦岛供电公司 | Electric power material goods arrival acceptance method based on augmented reality technology |
| CN111084980A (en) * | 2019-12-25 | 2020-05-01 | 网易（杭州）网络有限公司 | Method and device for purchasing virtual article |
| CN111084980B (en) * | 2019-12-25 | 2023-04-07 | 网易（杭州）网络有限公司 | Method and device for purchasing virtual article |
| CN111242734A (en) * | 2020-01-09 | 2020-06-05 | 中移（杭州）信息技术有限公司 | Commodity display method, server, terminal, system, electronic equipment and storage medium |
| CN111274910B (en) * | 2020-01-16 | 2024-01-30 | 腾讯科技（深圳）有限公司 | Scene interaction method and device and electronic equipment |
| CN111274910A (en) * | 2020-01-16 | 2020-06-12 | 腾讯科技（深圳）有限公司 | Scene interaction method and device and electronic equipment |
| CN111415422A (en) * | 2020-04-17 | 2020-07-14 | Oppo广东移动通信有限公司 | Virtual object adjustment method and device, storage medium and augmented reality equipment |
| CN111415422B (en) * | 2020-04-17 | 2022-03-18 | Oppo广东移动通信有限公司 | Virtual object adjustment method and device, storage medium and augmented reality equipment |
| CN111562845A (en) * | 2020-05-13 | 2020-08-21 | 贝壳技术有限公司 | Method, device and equipment for realizing three-dimensional space scene interaction |
| CN111625103A (en) * | 2020-06-03 | 2020-09-04 | 浙江商汤科技开发有限公司 | Sculpture display method and device, electronic equipment and storage medium |
| CN111580679A (en) * | 2020-06-07 | 2020-08-25 | 浙江商汤科技开发有限公司 | Space capsule display method and device, electronic equipment and storage medium |
| CN111679741B (en) * | 2020-06-08 | 2023-11-28 | 浙江商汤科技开发有限公司 | Image processing method, device, electronic equipment and storage medium |
| CN111679741A (en) * | 2020-06-08 | 2020-09-18 | 浙江商汤科技开发有限公司 | Image processing method and device, electronic equipment and storage medium |
| CN113298588A (en) * | 2020-06-19 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Method and device for providing object information and electronic equipment |
| CN111709818A (en) * | 2020-06-30 | 2020-09-25 | 广东奥园奥买家电子商务有限公司 | Augmented reality-based commodity information display method and device and computer equipment |
| CN111897431B (en) * | 2020-07-31 | 2023-07-25 | 北京市商汤科技开发有限公司 | Display method and device, display equipment and computer readable storage medium |
| CN111918114A (en) * | 2020-07-31 | 2020-11-10 | 北京市商汤科技开发有限公司 | Image display method, image display device, display equipment and computer readable storage medium |
| CN111897431A (en) * | 2020-07-31 | 2020-11-06 | 北京市商汤科技开发有限公司 | Display method and device, display equipment and computer readable storage medium |
| CN112016439B (en) * | 2020-08-26 | 2021-06-29 | 上海松鼠课堂人工智能科技有限公司 | Game learning environment creation method and system based on antagonistic neural network |
| CN112016439A (en) * | 2020-08-26 | 2020-12-01 | 上海松鼠课堂人工智能科技有限公司 | Game learning environment creation method and system based on antagonistic neural network |
| CN112270765A (en) * | 2020-10-09 | 2021-01-26 | 百度(中国)有限公司 | Information processing method, device, terminal, electronic device and storage medium |
| CN112422901A (en) * | 2020-10-30 | 2021-02-26 | 哈雷医用(广州)智能技术有限公司 | Method and device for generating operation virtual reality video |
| CN112308980A (en) * | 2020-10-30 | 2021-02-02 | 脸萌有限公司 | Augmented reality interactive display method and equipment |
| CN112418995A (en) * | 2020-11-26 | 2021-02-26 | 珠海格力电器股份有限公司 | Online shopping virtual interaction method based on MR virtual reality technology and storage medium |
| CN112506463A (en) * | 2020-12-04 | 2021-03-16 | 歌尔光学科技有限公司 | Display method, device and equipment based on head-mounted equipment |
| CN112672185A (en) * | 2020-12-18 | 2021-04-16 | 脸萌有限公司 | Augmented reality-based display method, device, equipment and storage medium |
| CN112817449B (en) * | 2021-01-28 | 2023-07-21 | 北京市商汤科技开发有限公司 | Interaction method and device for augmented reality scene, electronic equipment and storage medium |
| CN112817449A (en) * | 2021-01-28 | 2021-05-18 | 北京市商汤科技开发有限公司 | Interaction method and device for augmented reality scene, electronic equipment and storage medium |
| CN113947670A (en) * | 2021-09-18 | 2022-01-18 | 北京城市网邻信息技术有限公司 | Information display method and device, electronic equipment and readable medium |
| CN114167744A (en) * | 2021-12-23 | 2022-03-11 | 四川启睿克科技有限公司 | AR-based household intelligent appliance management method |
| CN114935994A (en) * | 2022-05-10 | 2022-08-23 | 阿里巴巴（中国）有限公司 | Article data processing method, device and storage medium |
| WO2023231793A1 (en) * | 2022-05-31 | 2023-12-07 | 京东方科技集团股份有限公司 | Method for virtualizing physical scene, and electronic device, computer-readable storage medium and computer program product |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020168792A1 (en) | 2020-08-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109903129A (en) | Augmented reality display methods and device, electronic equipment, storage medium | |
| EP2702566B1 (en) | Inferring spatial object descriptions from spatial gestures | |
| US9619105B1 (en) | Systems and methods for gesture based interaction with viewpoint dependent user interfaces | |
| CN108520552A (en) | Image processing method, device, storage medium and electronic equipment | |
| US10043317B2 (en) | Virtual trial of products and appearance guidance in display device | |
| US20120229509A1 (en) | System and method for user interaction | |
| CN109284001A (en) | Execute the method and apparatus for carrying out the process of the function of equipment | |
| CN110473293B (en) | Virtual object processing method and device, storage medium and electronic equipment | |
| CN111459264B (en) | 3D object interaction system and method and non-transitory computer readable medium | |
| Fiorentino et al. | Design review of CAD assemblies using bimanual natural interface | |
| CN103067727A (en) | Three-dimensional 3D glasses and three-dimensional 3D display system | |
| CN110809187B (en) | Video selection method, video selection device, storage medium and electronic equipment | |
| CN113129450A (en) | Virtual fitting method, device, electronic equipment and medium | |
| CN110253595A (en) | A kind of smart machine control method and device | |
| CN103125115A (en) | Information processing apparatus, information processing system and information processing method | |
| US11550435B2 (en) | Trackpad on back portion of a device | |
| CN113867531A (en) | Interaction method, device, equipment and computer readable storage medium | |
| CN109547836A (en) | Exchange method and device, electronic equipment, storage medium is broadcast live | |
| CN109426342B (en) | Document reading method and device based on augmented reality | |
| KR20210073428A (en) | Method and System for restoring objects and background and creating your own character for reality-based Social Network Services | |
| CN108629824B (en) | Image generation method and device, electronic equipment and computer readable medium | |
| CN111918114A (en) | Image display method, image display device, display equipment and computer readable storage medium | |
| US11756260B1 (en) | Visualization of configurable three-dimensional environments in a virtual reality system | |
| CN114779948B (en) | Method, device and equipment for controlling instant interaction of animation characters based on facial recognition | |
| CN109298782A (en) | Eye movement exchange method, device and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |