TWM631115U - Augmented reality system for playing augmented reality video - Google Patents

Abstract

An augmented reality (AR) system for playing an AR video. The AR system includes a first object, a second object, and a user equipment (UE). The UE captures a first image corresponding to the first object and a second image corresponding to the second object, wherein the UE generates an image recognition result according to the first image and plays the AR video according to the image recognition result, wherein the AR video includes a first virtual object, wherein the UE replaces the first virtual object by a second virtual object corresponding to the second image.

Description

Augmented reality system

This disclosure is about an augmented reality (AR) system.

At present, storybooks or picture books that incorporate augmented reality technology are printed with identification marks on the pages. When the user equipment scans the identification mark, the user equipment can play an augmented reality image related to the identification mark. However, this approach cannot bring users a good interactive experience.

The present disclosure provides an augmented reality system that can provide users with an immersive interactive experience.

An augmented reality system of the present disclosure includes a first object, a second object, and a user equipment. The user equipment captures a first image corresponding to the first object and a second image corresponding to the second object, wherein the user equipment generates an image recognition result according to the first image, and plays the augmented reality according to the image recognition result. The augmented reality image includes a first virtual object, wherein the user equipment replaces the first virtual object with a second virtual object corresponding to the second image.

In an embodiment of the present disclosure, the above-mentioned augmented reality system further includes a box. The box body includes a fixing member and an opening, wherein the first object is fixed in the box body through the fixing member, and the user equipment captures the first image through the opening.

In an embodiment of the present disclosure, the above-mentioned first object is a paper card showing the first image, wherein the fixing member is a card slot.

In an embodiment of the present disclosure, the above-mentioned user equipment stores an image recognition model, and inputs the first image into the image recognition model to generate an image recognition result.

In an embodiment of the present disclosure, the above-mentioned image recognition model is a machine learning model.

In an embodiment of the present disclosure, the above-mentioned user equipment plays the first dubbing corresponding to the augmented reality image according to the image recognition result.

In an embodiment of the present disclosure, the above-mentioned user equipment includes a sound capturing device, wherein the user equipment replaces the first dubbing with the second dubbing in response to acquiring the second dubbing through the sound capturing device.

In an embodiment of the present disclosure, the above-mentioned user equipment records the augmented reality image, and outputs the augmented reality image.

Based on the above, the augmented reality system of the present disclosure can replace the virtual objects in the augmented reality image with the objects drawn by the user, and can replace the dubbing of the augmented reality image with the dubbing recorded by the user .

FIG. 1 is a schematic diagram of an augmented reality system 10 according to an embodiment of the present disclosure. The augmented reality system 10 may include a user equipment 100 , a first object 200 , a second object 300 and a box 400 .

The user equipment 100 may include, but is not limited to, an advanced mobile station (AMS), server, client, desktop computer, notebook computer, network computer, workstation, personal digital assistant (PDA) ), personal computer (PC), tablet or smartphone, etc. FIG. 2 is a schematic diagram of the user equipment 100 according to an embodiment of the present disclosure. The user equipment 100 may include a processor 110 , a storage medium 120 , a transceiver 130 , an image capture device 140 , a sound capture device 150 , and an output device 160 .

The processor 110 is, for example, a central processing unit (CPU), or other programmable general-purpose or special-purpose micro control unit (micro control unit, MCU), microprocessor (microprocessor), digital signal processing digital signal processor (DSP), programmable controller, application specific integrated circuit (ASIC), graphics processor (graphics processing unit, GPU), image signal processor (image signal processor, ISP) ), image processing unit (IPU), arithmetic logic unit (ALU), complex programmable logic device (CPLD), field programmable gate array (field programmable gate array) , FPGA) or other similar elements or a combination of the above. The processor 110 may be coupled to the storage medium 120 , the transceiver 130 , the image capture device 140 , the sound capture device 150 and the output device 160 , and access and execute a plurality of modules and various applications stored in the storage medium 120 program.

The storage medium 120 is, for example, any type of fixed or removable random access memory (random access memory, RAM), read-only memory (ROM), and flash memory (flash memory). , a hard disk drive (HDD), a solid state drive (SSD), or similar components or a combination of the above components for storing a plurality of modules or various application programs executable by the processor 110 .

The transceiver 130 transmits and receives signals in a wireless or wired manner. Transceiver 130 may also perform operations such as low noise amplification, impedance matching, frequency mixing, up or down frequency conversion, filtering, amplification, and the like. The image capture device 140 is, for example, an electronic device such as a video camera or a camera, which can be used to capture image signals. The sound capture device 150 is, for example, an electronic device such as a microphone that can be used to capture sound signals. The output device 160 can be used to play multimedia materials. For example, the output device 160 may include a display for playing images or speakers for playing audio.

The first object 200 is, for example, a paper card showing a first image 210 , wherein the first image 210 is, for example, a scene image. For example, the first image 210 may include scenes such as plains, forests, castles, or deserts. Box 400 is a platform for displaying stories. The material of the box body 400 is, for example, paper, metal or plastic. The box body 400 may include a fixing member 410 and an opening 420 . When the first object 200 is a paper card, the fixing member 410 may be a card slot for fixing the paper card. The user uses the fixing member 410 to fix the first object 200 in the box body 400 . When the first object 200 is fixed in the box body 400 , the first image 210 shown on the first object 200 can be exposed to the outside through the opening 420 of the box body 400 . The image capturing device 140 of the user equipment 100 can capture the first image 210 by capturing the first object 200 through the opening 420 .

The user equipment 100 may perform image recognition on the first image 210 to generate an image recognition result. Specifically, the storage medium 120 of the user equipment 100 can store an image recognition model, wherein the image recognition model can be a machine learning model. After obtaining the first image 210 , the processor 110 may input the first image 210 into an image recognition model to generate an image recognition result. For example, if the first image 210 is an image depicting a plain scene, the image recognition model can generate an image recognition result according to the first image 210 , wherein the image recognition result can indicate the first image 210 Classified as plain scene.

The storage medium 120 can pre-store an augmented reality image corresponding to the first image 210 and a first dubbing (ie, preset dubbing) corresponding to the augmented reality image. After the image recognition model generates the image recognition result, the processor 110 can determine whether the image recognition result is consistent with the augmented reality image pre-stored in the storage medium 120 . If the image recognition result matches the augmented reality image, the processor 110 can play the augmented reality image corresponding to the image recognition result through the output device 160 , and can play the augmented reality image corresponding to the image recognition result through the output device 160 . Corresponding first dubbing. The augmented reality image may include a first virtual object (ie, a default virtual object). For example, if the image recognition result indicates that the first image 210 depicts a plain scene, the processor 110 may output the augmented reality image corresponding to the plain scene and the first dubbing through the output device 160 , wherein the augmented The first virtual object in the reality image is, for example, a moving character.

The second object 300 is, for example, a paper card showing a second image 310 , wherein the second image 310 is an object such as an animal, a vehicle, or a person. For example, the second image 310 may be a character holding a weapon. The image capture device 140 of the user equipment 100 can capture the second object 300 to capture the second image 310 . After acquiring the second image 310 , the processor 110 may replace the first virtual object in the augmented reality image with a second virtual object corresponding to the second image 310 in response to acquiring the second image 310 . For example, the processor 110 may replace a moving character in the augmented reality image with a character holding a weapon. On the other hand, the processor 110 can obtain the second dubbing through the sound capturing device 150 . After acquiring the second dubbing, the processor 110 may replace the first dubbing corresponding to the augmented reality image with the second dubbing in response to acquiring the second dubbing.

Based on the above, the user can draw objects on the second object 300 or record dubbing according to their own ideas. The processor 110 may replace the preset objects in the augmented reality image with objects drawn by the user, or replace the preset dubbing corresponding to the augmented reality image with the dubbing recorded by the user. In this way, the user's interactive experience with the augmented reality image can be enhanced.

FIG. 3 is a flowchart illustrating a method for playing an augmented reality image according to an embodiment of the present disclosure, wherein the method can be implemented by the augmented reality system shown in FIG. 1 . In step S301, a first image corresponding to the first object and a second image corresponding to the second object are captured by the user equipment. In step S302, an image recognition result is generated by the user equipment according to the first image, and an augmented reality image is played according to the image recognition result, wherein the augmented reality image includes a first virtual object. In step S303, the user equipment replaces the first virtual object with a second virtual object corresponding to the second image.

To sum up, the user equipment of the augmented reality system of the present disclosure can play the corresponding augmented reality image and the preset dubbing according to the image recognition result. The augmented reality image may include preset virtual objects. When the user equipment captures the image drawn by the user, the user equipment can replace the preset virtual object with the image drawn by the user. On the other hand, when the user equipment captures the dubbing recorded by the user, the user equipment may replace the preset dubbing with the dubbing recorded by the user. Accordingly, the present disclosure can provide users with a good interactive experience of augmented reality images.

10: Augmented reality system 100: User Equipment 110: Processor 120: Storage Media 130: Transceiver 140: Image capture device 150: Sound capture device 160: Output device 200: First Object 210: First Image 300: Second Object 310: Second Image 400: Box 410: Fixtures 420: Opening S301, S302, S303: Steps

FIG. 1 is a schematic diagram of an augmented reality system according to an embodiment of the present disclosure. FIG. 2 is a schematic diagram of a user equipment according to an embodiment of the present disclosure. FIG. 3 is a flowchart illustrating a method for playing an augmented reality image according to an embodiment of the present disclosure.

10: Augmented reality system

100: User Equipment

200: First Object

210: First Image

300: Second Object

310: Second Image

400: Box

410: Fixtures

420: Opening

Claims (8)

An augmented reality system comprising: the first object; the second object; and User equipment, capturing a first image corresponding to the first object and a second image corresponding to the second object, wherein The user equipment generates an image recognition result according to the first image, and plays an augmented reality image according to the image recognition result, wherein the augmented reality image includes a first virtual object, wherein The user equipment replaces the first virtual object with a second virtual object corresponding to the second image. The augmented reality system according to claim 1, further comprising: A box body includes a fixing member and an opening, wherein the first object is fixed in the box body through the fixing member, wherein the user equipment captures the first image through the opening. The augmented reality system according to claim 2, wherein the first object is a paper card showing the first image, and wherein the fixing member is a card slot. The augmented reality system of claim 1, wherein the user equipment stores an image recognition model, and inputs the first image to the image recognition model to generate the image recognition result. The augmented reality system of claim 4, wherein the image recognition model is a machine learning model. The augmented reality system of claim 1, wherein the user equipment plays a first dubbing corresponding to the augmented reality image according to the image recognition result. The augmented reality system of claim 6, wherein the user equipment includes a sound capture device, wherein the user equipment replaces the first voiceover in response to obtaining a second voiceover through the sound capture device Dub the second. The augmented reality system of claim 1, wherein the user equipment records the augmented reality image and outputs the augmented reality image.

Images