CN110599604A - Multimedia AR view sharing method - Google Patents

Multimedia AR view sharing method Download PDF

Info

Publication number
CN110599604A
CN110599604A CN201910894008.XA CN201910894008A CN110599604A CN 110599604 A CN110599604 A CN 110599604A CN 201910894008 A CN201910894008 A CN 201910894008A CN 110599604 A CN110599604 A CN 110599604A
Authority
CN
China
Prior art keywords
image
coordinate system
real
scene
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910894008.XA
Other languages
Chinese (zh)
Inventor
周道华
杨陈
彭容
曾俊
洪江
黄维
李武鸿
刘瑞东
张明娟
许江泽
吴婷婷
付志华
刘杰
詹飞
程武彬
杨眉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CHENGDU ZHONGKE DAQI SOFTWARE Co Ltd
Original Assignee
CHENGDU ZHONGKE DAQI SOFTWARE Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by CHENGDU ZHONGKE DAQI SOFTWARE Co Ltd filed Critical CHENGDU ZHONGKE DAQI SOFTWARE Co Ltd
Priority to CN201910894008.XA priority Critical patent/CN110599604A/en
Publication of CN110599604A publication Critical patent/CN110599604A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a multimedia AR view sharing method, which comprises the following steps: acquiring a scene image from a playing image of display equipment; acquiring a target position corresponding to image information to be displayed in the scene image, and establishing a scene coordinate system in the scene image; and positioning the image information by the scene coordinate system, then superposing the image information at the target position, generating a playing image containing the image information and delivering the playing image to the display equipment. The position of the image information is determined by establishing a scene coordinate system, so that the image information is prevented from shaking and distorting during superposition, and the positioning speed and the positioning precision are greatly improved.

Description

Multimedia AR view sharing method
Technical Field
The invention relates to multimedia propagation, AR view and data sharing, in particular to a multimedia AR view sharing method.
Background
With the progress of the times and the rapid development of electronic technology, the use modes of multimedia are diversified more and more, and the appearance of AR and VR makes people new.
At present, most common product information display is in the form of paper, static advertisements or video advertisements, the form and style of products are directly presented to users, but the expressive force of the products on the plane can only make the products alive and vivid through the inspiration of a plane designer, the users can not effectively feel the full appearance of the products intuitively, the expressive force of the plane is insufficient, the establishment of a 3D physical model of the products is complex, and the transmission force is insufficient; the flat product display cannot effectively and quickly know the product.
For example, in the aspect of scenic spot culture display, the AR mode can be utilized to enable the user to comprehensively know the culture, the humanistic landscape and the like of the scenic spot.
Disclosure of Invention
The invention provides a multimedia AR view sharing method which is used for displaying products or information to users in an AR mode, quickly positioning a virtual model, enhancing the information transmission efficiency, improving the product or information display expressive force and improving the user experience.
The invention is realized by the following technical scheme:
the multimedia AR view sharing method comprises the following steps:
acquiring a scene image from a playing image of display equipment;
acquiring a target position corresponding to image information to be displayed in the scene image, and establishing a scene coordinate system in the scene image;
and positioning the image information by the scene coordinate system, then superposing the image information at the target position, generating a playing image containing the image information and delivering the playing image to the display equipment.
The position of the image information is determined by establishing a scene coordinate system, so that the image information is prevented from shaking and distorting during superposition, and the positioning speed and the positioning precision are greatly improved.
Further, the establishing a scene coordinate system includes:
establishing a gravity coordinate system according to a gravity sensing module of the display equipment;
establishing a world coordinate system according to the target position of the scene image;
and (4) superposing the Z axis of the gravity coordinate system and the Z axis of the world coordinate system to form a scene coordinate system.
The accurate positioning is realized through the two coordinate systems, and the world coordinate system is mainly used for matching with image information and later model information, and the position of the Z axis is determined through the gravity coordinate system of the display device.
Further, the display device further comprises a processor, a sensor and an image collector, wherein the image collector is used for acquiring a real-time image; the sensor is used for marking sensing information for the real-time image when the image collector obtains the real-time image; the processor is used for analyzing and processing the real-time image acquired by the image collector, and the processor puts the real-time image marked with the sensing information into a display device for display.
Further, the sensor comprises a gravity sensor and a GPS locator.
Based on the display device provided with the image collector, the dynamic video AR can be realized:
an image collector of the display equipment continuously acquires real-time images, and acquires real-time scene images from the real-time images;
acquiring a target position corresponding to model information to be displayed in the real-time scene image, and establishing a positioning coordinate system in the real-time scene image according to the sensing information;
and positioning the model information by the positioning coordinate system, and then superposing the model information on the target position to generate a real-time image containing the model information and continuously delivering the real-time image to the display equipment.
Further, the model information is a 3D virtual graph.
Compared with the prior art, the invention has the following advantages and beneficial effects:
1. the multimedia AR view sharing method has the advantages of high reaction speed, good display effect and low development cost;
2. the multimedia AR view sharing method adopts a double-coordinate system structure to reduce complex algorithms, accurate positioning is realized through the two coordinate systems, and the world coordinate system is mainly used for determining the position of a Z axis through the gravity coordinate system of the display equipment by matching with image information and later model information.
Drawings
The accompanying drawings, which are included to provide a further understanding of the embodiments of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the principles of the invention. In the drawings:
FIG. 1 is a schematic flow chart of the steps of the present invention;
fig. 2 is a schematic diagram showing a gravity coordinate system and a world coordinate system of the device.
Reference numbers and corresponding part names in the drawings:
1-a display device.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail below with reference to examples and accompanying drawings, and the exemplary embodiments and descriptions thereof are only used for explaining the present invention and are not meant to limit the present invention.
Examples
As shown in fig. 1, the multimedia AR view sharing method includes:
in the playback image of the display device 1, first, step S1 acquires a scene image;
in the scene image, performing step S2 to obtain a target position corresponding to image information to be displayed, and performing step S3 to establish a scene coordinate system in the scene image;
subsequently, steps S4 and S5 are performed to position the image information in the scene coordinate system and then superimpose the image information on the target position, and finally, step S6 is performed to generate a playback image containing the image information and launch the playback image on the display device 1.
The display device 1 further comprises a processor, a sensor and an image collector, wherein the image collector is used for acquiring a real-time image; the sensor is used for marking sensing information for the real-time image when the image collector obtains the real-time image; the processor is used for analyzing and processing the real-time image acquired by the image collector, and the processor puts the real-time image marked with the sensing information into the display device 1 for display.
The sensor comprises a gravity sensor and a GPS locator.
Based on the display device 1 provided with the image collector, the dynamic video AR can be realized:
the image collector of the display device 1 continuously obtains real-time images, and obtains real-time scene images from the real-time images;
acquiring a target position corresponding to model information to be displayed in the real-time scene image, and establishing a positioning coordinate system in the real-time scene image according to the sensing information;
and positioning the model information by the positioning coordinate system, and then superposing the model information on the target position to generate a real-time image containing the model information and continuously delivering the real-time image to the display device 1.
The model information is a 3D virtual graph.
As shown in fig. 2, in the drawing, a sphere is a gravity coordinate system, a rectangular frame is a world coordinate system, wherein X, Y, Z axes of the world coordinate system and a Z axis of the gravity coordinate system are marked, and the establishing a scene coordinate system includes:
establishing a gravity coordinate system according to a gravity sensing module of the display device 1;
establishing a world coordinate system according to the target position of the scene image;
and (4) superposing the Z axis of the gravity coordinate system and the Z axis of the world coordinate system to form a scene coordinate system.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are merely exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims (6)

1. The multimedia AR view sharing method is characterized by comprising the following steps:
acquiring a scene image from a playing image of display equipment;
acquiring a target position corresponding to image information to be displayed in the scene image, and establishing a scene coordinate system in the scene image;
and positioning the image information by the scene coordinate system, then superposing the image information at the target position, generating a playing image containing the image information and delivering the playing image to the display equipment.
2. The method of claim 1, wherein the establishing a scene coordinate system comprises:
establishing a gravity coordinate system according to a gravity sensing module of the display equipment;
establishing a world coordinate system according to the target position of the scene image;
and (4) superposing the Z axis of the gravity coordinate system and the Z axis of the world coordinate system to form a scene coordinate system.
3. The multimedia AR view sharing method according to claim 1, wherein the display device further comprises a processor, a sensor, an image collector, the image collector is configured to obtain a real-time image; the sensor is used for marking sensing information for the real-time image when the image collector obtains the real-time image; the processor is used for analyzing and processing the real-time image acquired by the image collector, and the processor puts the real-time image marked with the sensing information into a display device for display.
4. The multimedia AR view sharing method according to claim 3, wherein the sensor comprises a gravity sensor, a GPS locator.
5. The multimedia AR view sharing method according to claim 3, further comprising:
an image collector of the display equipment continuously acquires real-time images, and acquires real-time scene images from the real-time images;
acquiring a target position corresponding to model information to be displayed in the real-time scene image, and establishing a positioning coordinate system in the real-time scene image according to the sensing information;
and positioning the model information by the positioning coordinate system, and then superposing the model information on the target position to generate a real-time image containing the model information and continuously delivering the real-time image to the display equipment.
6. The method of claim 5, wherein the model information is 3D virtual graphics.
CN201910894008.XA 2019-09-20 2019-09-20 Multimedia AR view sharing method Pending CN110599604A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910894008.XA CN110599604A (en) 2019-09-20 2019-09-20 Multimedia AR view sharing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910894008.XA CN110599604A (en) 2019-09-20 2019-09-20 Multimedia AR view sharing method

Publications (1)

Publication Number Publication Date
CN110599604A true CN110599604A (en) 2019-12-20

Family

ID=68861927

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910894008.XA Pending CN110599604A (en) 2019-09-20 2019-09-20 Multimedia AR view sharing method

Country Status (1)

Country Link
CN (1) CN110599604A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108917758A (en) * 2018-02-24 2018-11-30 石化盈科信息技术有限责任公司 A kind of navigation methods and systems based on AR
CN109559382A (en) * 2018-12-04 2019-04-02 百度在线网络技术(北京)有限公司 Intelligent guide method, apparatus, terminal and medium
CN110018742A (en) * 2019-04-03 2019-07-16 北京八亿时空信息工程有限公司 A kind of network virtual touring system and its construction method
CN110045832A (en) * 2019-04-23 2019-07-23 叁书云(厦门)科技有限公司 Immersion safety education experience system and method based on AR interaction

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108917758A (en) * 2018-02-24 2018-11-30 石化盈科信息技术有限责任公司 A kind of navigation methods and systems based on AR
CN109559382A (en) * 2018-12-04 2019-04-02 百度在线网络技术(北京)有限公司 Intelligent guide method, apparatus, terminal and medium
CN110018742A (en) * 2019-04-03 2019-07-16 北京八亿时空信息工程有限公司 A kind of network virtual touring system and its construction method
CN110045832A (en) * 2019-04-23 2019-07-23 叁书云(厦门)科技有限公司 Immersion safety education experience system and method based on AR interaction

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
DAVID MARIMON 等: ""MobiAR: Tourist Experiences through Mobile Augmented Reality"", 《HTTPS://WWW.RESEARCHGATE.NET/PUBLICATION/228979424_MOBIAR_TOURIST_EXPERIENCES_THROUGH_MOBILE_AUGMENTED_REALITY》 *
曹宇: ""ARKit:增强现实技术在美团到餐业务的实践"", 《HTTPS://TECH.MEITUAN.COM/2018/09/13/DEFAR.HTML》 *

Similar Documents

Publication Publication Date Title
US11960651B2 (en) Gesture-based shared AR session creation
KR20220138398A (en) Creating Augmented Reality Sessions Using Skeleton Tracking
CN106846497B (en) Method and device for presenting three-dimensional map applied to terminal
WO2013028908A1 (en) Touch and social cues as inputs into a computer
JP2015001875A (en) Image processing apparatus, image processing method, program, print medium, and print-media set
US11991469B2 (en) Skeletal tracking for real-time virtual effects
CN107329671B (en) Model display method and device
CN115516406B (en) Depth estimation using biological data
US20160371885A1 (en) Sharing of markup to image data
WO2022056118A1 (en) Augmented reality messenger system
CN113426117A (en) Virtual camera shooting parameter acquisition method and device, electronic equipment and storage medium
CN111932446B (en) Method and device for constructing three-dimensional panoramic map
TWI694355B (en) Tracking system, tracking method for real-time rendering an image and non-transitory computer-readable medium
CN108446023B (en) Virtual reality feedback device and positioning method, feedback method and positioning system thereof
CN110599604A (en) Multimedia AR view sharing method
KR101850134B1 (en) Method and apparatus for generating 3d motion model
KR101265554B1 (en) 3D advertising method and system
CN110662099B (en) Method and device for displaying bullet screen
CN111476873A (en) Mobile phone virtual doodling method based on augmented reality
CN204089958U (en) A kind of camera with composite effect
JP7072706B1 (en) Display control device, display control method and display control program
US20230319426A1 (en) Traveling in time and space continuum
JP5533311B2 (en) Exhibit information presentation device and presentation method
CN113409472A (en) AR presentation method and system of shared interactive information in space based on real object
CN116664802A (en) Virtual content presentation method, system, electronic device, and computer-readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20191220