TWI762830B - System for displaying hint in augmented reality to play continuing film and method thereof - Google Patents

Abstract

A system for displaying a hint in augmented reality to play a continuing film and a method thereof are provided. By cutting a full video to plurality of film, corresponding each film with an object, determining a play identification corresponding with a detected object matches a play sequence by a playback device when an image captured by the playback device contains the detected object, displaying a hint of the object that corresponded the play identification matched the play sequence if the play identification dose not match the play sequence, and playing the film corresponding with the detected object if the play identification matches the play sequence, the system and the method can prompt user to find continuing film, and cab achieve the effect of avoiding break feeling of watch video.

Description

System and method for prompting through augmented reality to play continuation video

An augmented reality video playback system and method, particularly a system and method for playing a subsequent video by giving prompts through augmented reality.

Augmented Reality (AR) refers to the technology that calculates the position and angle of the captured image and adds image analysis technology, so that the objects in the virtual world displayed on the screen can be combined and interacted with the real world scene. .

In the current application of augmented reality, one is to shoot the current scene as a real-life image, and analyze the captured real-life image to determine whether the current scene contains a specific physical object. The relevant information is superimposed on the captured live image, and the live image after the superimposed information is displayed.

If there are too many related information about the physical objects, it may not be easy to understand when they are displayed all at once. Therefore, multiple physical objects can also be set in the scene, so that different physical objects can emphasize the time and place where the related information occurs. If the relevant information of different physical objects is related, most of them are currently in the physical The order is marked on the object to indicate the order in which related messages are displayed. However, if the scene is complicated or there are too many entities, it is not easy for the user to find the order of the entities.

To sum up, it can be seen that there has been a long-standing problem in the prior art that it is difficult for users to successfully find a connected entity in a complex scene, so it is necessary to propose an improved technical means to solve this problem.

In view of the problem in the prior art that it is not easy for users to successfully find a connection object in a complex scene, the present invention discloses a system and method for giving a prompt through augmented reality to play a connection video, wherein: the present invention discloses A system for giving prompts through augmented reality to play a subsequent video, at least comprising: a storage module for storing a plurality of plot videos, each of the plot videos corresponding to different playback identification data, and each of the playback identification data corresponding to a detective A detection target; a setting module for obtaining a position data of each detection target, and for setting a playback sequence, the playback sequence records the arrangement sequence of the playback identification data; an image capture module for capturing Take a real scene image; a target detection module is used to determine whether each detection target is included in the real scene image; a prompt generation module is used to determine that at least one of the detection targets is not included in the target detection module In the real-life image, a target prompt is generated according to the position data and the playback sequence, and the target prompt includes the position information and sequence information of the at least one detection target not included in the real-life image; the sequence judgment module uses When the target detection module determines that only one detection target is included in the real-life image, it is determined whether one of the playback identification data corresponding to the detection target included in the real-life image conforms to the playback sequence; playback display a module for displaying the real-life image, for displaying the target prompt in the real-life image, and for displaying the target prompt in the real-life image When one of the playback identification data corresponding to the detection target in the image conforms to the playback sequence, a corresponding drama video is played according to the playback identification data corresponding to the detection target included in the live image.

The method for playing a follow-up video by giving a prompt through augmented reality disclosed by the present invention at least includes the steps of: storing a plurality of scenario videos, each of the scenario videos corresponding to different playback identification data, and each of the playback identification data corresponding to a Detecting targets; obtaining a position data of each of the detecting targets, and setting a playback sequence, the playback sequence recording the arrangement sequence of the playback identification data; capturing and displaying a live image; judging that at least one of the detection targets is not When included in the live image, generate a target prompt according to the location data and the playback sequence, and display the target prompt in the live image, the target prompt includes the at least one detection target not included in the live image position information and sorting information; when it is judged that only one detection target is included in the live image, and one of the playback identification data corresponding to the detection target included in the live image conforms to the playback sequence, the content is based on the The detection target in the live image corresponds to one of the playing identification data and plays a corresponding one of the drama video.

The system and method disclosed in the present invention are as above, and the difference between the system and the prior art is that the present invention divides a complete video into a plurality of plot videos, and after each plot video corresponds to the detection target, when the playback device determines the detection target When the target is not included in the real-life image, a target prompt is generated and displayed according to the location data of the detection target and the playback sequence, and the playback device determines that only one detection target is included in the real-life image and all detection targets included in the real-life image are included. If the corresponding playback identification data conforms to the playback sequence, the playback device will play the plot video corresponding to the detected detection target, so as to solve the problems existing in the prior art and achieve the technical effect of avoiding damaging the emotion of watching the subsequent plot video. .

110: detect target

110a~110e: detect target

200: playback device

201: Server

210: Setting the module

220: Image Capture Module

230: Target Detection Module

250: Sequence judgment module

241: Storage Module

243: display screen

260: Prompt to generate mods

270: Distance Judgment Module

280: Gesture judgment module

290:Play display module

420:Play area

430: Direction sign

440: Representative icon

510~530: Entity

Step 301: Provide a plurality of plot movies, the plot movies correspond to playback identification data, and the playback identification data corresponds to the detection target

Step 305: Obtain the location data of the detection target and set the playback sequence

Step 310: Continue to capture and display live images

Step 320: Determine whether there is a detection target that is not included in the real scene image

Step 330: Generate target prompts according to the location data and playback sequence, and display the target prompts in the live image

Step 340: Determine whether the live image contains only one detection target

Step 350: Determine whether the playback identification data corresponding to the detection target in the live image conforms to the playback sequence

Step 360: Play the corresponding drama video according to the playback identification data corresponding to the detection target in the real-life image

Step 350: The playback device displays a prompt of the detection target corresponding to the playback identification data in accordance with the playback sequence

Step 360: The playback device displays a target prompt in the live image according to the arrangement order of the detection targets not included in the live image

Step 381: The playback device determines the target distance from the detection target in the real-life image

Step 385: The playback device adjusts the size of the screen for playing the plot video according to the target distance

Step 391: The playback device captures a specific gesture

Step 395: The playback device performs an operation corresponding to a specific gesture on the played drama film

FIG. 1 is a system architecture diagram of the present invention for providing prompts through augmented reality to play a follow-up video.

FIG. 2 is a schematic diagram of the components of the playback device according to the present invention.

FIG. 3A is a flow chart of the method for playing a follow-up video by giving a prompt through augmented reality according to the present invention.

FIG. 3B is a flow chart of the method for providing sequential prompts according to the detection target in the real-life image according to the present invention.

FIG. 3C is a flow chart of the method for adjusting the size of the video according to the distance from the detection target proposed by the present invention.

FIG. 3D is a flowchart of a method for performing corresponding operations according to gestures provided by the present invention.

FIG. 4A is a schematic diagram of playing a scenario video according to an embodiment of the present invention.

FIG. 4B is a schematic diagram of a prompt for displaying a detection target according to an embodiment of the present invention.

FIG. 5 is a schematic diagram of using a real object in a live image as a video control element according to an embodiment of the present invention.

The features and implementations of the present invention will be described in detail below in conjunction with the drawings and examples, and the content is sufficient to enable any person skilled in the relevant art to easily and fully understand the technical means applied to solve the technical problems of the present invention and implement them accordingly, thereby achieving The effect that the present invention can achieve.

The present invention can set a plurality of detection targets in the physical scene, and the playback device can display the prompt of the detection targets that have not been detected when all the detection targets are not detected, and when the detection target is detected When the detected target matches the play sequence, play the predetermined plot video. Wherein, the entity scene is an area in the real world, such as a space on a desktop, a part of a forest, or a city, etc.; a drama movie is a segment of a complete movie, and a complete movie can be used in the present invention. Divide into multiple drama films.

In the present invention, the detection target is a real object or information that can trigger the augmented reality technology. For example, the detection target can be a real object in a physical scene such as a photo, picture, barcode, object, etc., and the detection target can also be a longitude and latitude, etc. The present invention is not particularly limited; the playback device is a device that can capture images, display captured images, and play videos, such as mobile phones, tablet computers, notebook computers, personal digital assistants, navigation devices, digital Cameras, video cameras, multimedia players, e-book readers, handheld game instruments, electronic dictionaries, car computers, etc., but the present invention is not limited thereto.

First, the system operation of the present invention will be described with reference to “FIG. 1” of the system structure diagram of the present invention that provides prompts through augmented reality to play a subsequent video. As shown in FIG. 1 , the system of the present invention includes a plurality of detection targets 110 , a playback device 200 , and in some embodiments, a server 201 . Among them, the playback device 200 has a display screen 243 .

The detection target 110 corresponds to a drama movie. A detection target 110 usually corresponds to a story film, but the present invention is not limited to this. In some embodiments, a detection target 110 may also correspond to a plurality of story films.

Generally speaking, all the story films corresponding to the detection targets 110 have a corresponding arrangement order, and after arranging all the story films in order, a complete film with a coherent story can be assembled. However, in some embodiments, the plot movies corresponding to all the detection targets 110 may also be combined into multiple complete movies, wherein different complete movies may or may not be related, and the present invention is not particularly limited. . For example, there are three detection targets (110a, 110b, 110c), the detection target 110a corresponds to the videos FA1 and FB2, the detection target 110b corresponds to the videos FA2, FB1 and FB4, and the detection target 110c corresponds to the videos FA3 and FB3, wherein the movie FA1, the movie FA2 and the movie FA3 can be combined to form a complete movie with a coherent plot, and Movie FB1, Movie FB2, Movie FB3 and Movie FB4 can also be combined into another complete movie.

Each detection target 110 has one or more playback identification data, and the playback identification data mentioned in the present invention can be the target identification data of the detection target 110 or the video identification data of the drama movie corresponding to the detection target 110 .

As shown in FIG. 2 , the playback device 200 may include a setting module 210 , an image capture module 220 , a target detection module 230 , a sequence judgment module 250 , a prompt generation module 260 , and a playback display module 290 , and an additional prompt generation module distance judgment module 270 and gesture judgment module 280 can be added.

The setting module 210 is responsible for obtaining the position data of each detection target. The setting module 210 can provide an input interface to input the position data of the detection target, and can also download the position data of the detection target through a network connection to an external server.

The setting module 210 is also responsible for setting the playing sequence of the feature films. Wherein, the playback sequence records the arrangement sequence of the playback identification data. The playback sequence proposed in the present invention records the video sequence of the drama videos corresponding to the detection targets, for example, recording the video identification data of each drama movie according to the sequence, or recording the target identification data of the detection targets corresponding to each drama movie according to the sequence data, but the way of recording the sequence of videos in the playback sequence is not limited to the above. For example, there are two videos F1 and F2, and there are also two detection targets (110a, 110b), wherein, the video F1 corresponds to the detection target 110a, and the video F2 corresponds to the detection target 110b. The arrangement sequence is that the video F1 is followed by the video F2, then when the playback identification data is the video identification data of the plot video corresponding to the detection target, the playback sequence can record the video identification data of the video F1 and the video identification data of the video F2 in sequence, and When the playback identification data is detected When the target identification data of the target is detected, the target identification data of the detection target 110a corresponding to the video F1 and the target identification data of the detection target 110b corresponding to the video F2 are sequentially recorded in the playback sequence.

In some embodiments, the setting module 210 may be pre-connected to the server 201 to download the play sequence of the drama video.

The image capture module 220 is responsible for continuously capturing live images. Wherein, the image capture module 220 can capture a real-life image through a photographic lens (not shown in the figure) and a photosensitive element (not shown in the figure), but the present invention is not limited to this; the real-life image includes all or part of the entity image of the scene.

The target detection module 230 is responsible for detecting whether the detection target is included in the real-world image captured by the image capture module 220 . The target detection module 230 can determine that the detection target is detected when the physical object in the physical image is consistent with the image represented by a detection target through image recognition technology; the target detection module 230 can also use global positioning The system obtains the outdoor positioning data, and/or obtains the indoor positioning data through the indoor positioning technology, and judges that the detection target is detected when the positioning data is consistent with the data indicating the detection target. However, the manner in which the target detection module 230 detects and detects the target is not limited to the above.

The target detection module 230 can obtain the broadcast identification data of the detected detection target. For example, the target detection module 230 can read the playback identification data corresponding to the image corresponding to the physical object in the real-life image or the playback identification data corresponding to the positioning data representing the current position from the pre-established correspondence table.

The sequence judgment module 250 is responsible for judging whether the playback identification data corresponding to the detection target detected by the target detection module 230 conforms to the playback sequence when the target detection module 230 determines that the real-world image contains only one detection target .

The sequence determination module 250 can determine whether the playback identification data obtained by the target detection module 230 is consistent with the playback sequence. In more detail, when the playback identification data is the target identification of the detection target In the case of data, the sequence judgment module 250 can judge whether the target identification data of the detection target detected by the target detection module 230 is the same as the target identification data indicating the next detection target in the playback order. Next is the target identification data of the detection target 110b, and the sequence determination module 250 can determine whether the target identification data of the detection target detected by the target detection module 230 is the target identification data of the detection target 110b. Similarly, when the playback identification data is the video identification data of the virtual video corresponding to the detection target, the sequence determination module 250 can determine the video identification data of the virtual video corresponding to the detection target detected by the target detection module 230. Whether it is the same as the playback sequence indicates the next video identification data, for example, if the playback sequence indicates that the next video identification data is the virtual video F1 corresponding to the detection target 110a, then the sequence judgment module 250 can determine the target detection module. 230 Whether the video identification data of the drama film corresponding to the detected detection target is the video identification data of the drama film F1.

In another part of the embodiment, the sequence determination module 250 may transmit the playback identification data obtained by the target determination module 230 to the server 201, and the server 201 determines whether the received playback identification data matches the playback sequence After matching, according to the judgment result returned by the server 201, it is judged whether the playback identification data obtained by the target judgment module 230 is consistent with the playback sequence.

The prompt generation module 260 is responsible for, when the target detection module 230 determines that the detection target 110 is not included in the real-life image captured by the image capture module 220, according to the location data of the detection target obtained by the setting module 210 and the playback sequence corresponding to the playback identification data corresponding to the detection target 110 to generate target prompts.

The target hints generated by the hint generation module 260 include position information and ranking information of each detection target not included in the live image. The prompt generation module, wherein the position information of the prompt generation module includes but is not limited to the position coordinates, direction indication, guidance text, and/or navigation information of the detection target 110 interest, etc. Prompt Generation Module In addition, sorting messages are usually numbers. However, the location information and sorting information mentioned in the present invention are not limited to the above.

More specifically, the prompt generation module 260 can read the representation of the detection target 110 corresponding to the playback identification data corresponding to the detection target detected by the target detection module 230 from a pre-established file or database. The prompt generation module 260 can also generate direction signs, guidance text, and/ Or navigation information, wherein the prompt generation module 260 can load the position information of the relative positions of all the detection targets 110 in a pre-created file, or connect to the server 201 to download the position information of the relative positions of all the detection targets 110 , the current direction of the playback device 200 can also be obtained through a direction sensor (not shown in the figure) such as a gyroscope of the playback device 200 .

The distance determination module 270 can determine the distance between the playback device 200 and the detection target detected by the target detection module 230 (referred to as "target distance" in the present invention). For example, the distance judging module 270 can establish a virtual coordinate system in the real-life image captured by the image capturing module 220, and calculate the target distance according to the virtual coordinates of the detected detection target, but the distance judging module The method of 270 judging the target distance is not limited to the above.

The gesture determination module 280 can determine whether the real image captured by the image capture module 220 includes a specific gesture. The gesture determination module 280 can determine whether a specific gesture is included according to a plurality of continuous live images, for example, a finger or palm moves from right to left, moves from bottom to top, clicks on a specific position, and is recognized by the click target detection module 230 specific physical objects in the live image, etc.

The playback and display module 290 is responsible for continuously displaying the real-life images captured by the image capturing module 220, and is also responsible for displaying the target prompts generated by the prompting generating module 260 in the displayed real-life images, and is responsible for determining the sequence in the sequence judgment mode. The group 250 determines to which the detection target detected by the target detection module 230 corresponds. When the corresponding playback identification data matches the playback sequence, play the story video corresponding to the detected detection target.

The playback display module 290 can also adjust the screen size of the played drama video according to the target distance determined by the distance determination module 270. For example, the smaller the target distance determined by the distance determination module 270, the more the playback device 200 is. Approaching the detection target, the playback and display module 290 can display a larger-screen drama movie or the like.

The playback display module 290 can also perform a corresponding operation on the played drama movie according to the specific gesture determined by the gesture determination module 280 . For example, when the gesture judging module 280 judges that the specific gesture is moving from left to right, the playback speed of the drama film can be accelerated; when the gesture judging module 280 judges that the specific gesture is moving from bottom to top, it can increase the playback volume of the drama film ; When the gesture judgment module 280 judges that the specific gesture is to click on the play screen of the plot movie, it can pause or continue the play of the plot movie. For another example, when the gesture judging module 280 judges that the specific gesture is to click on a specific object in the background (live-action image) of the played drama film, the playback display module 290 can pause or resume the playing of the drama; When the group 280 determines that the specific gesture is to toggle, push, or slide a specific physical object in the background (live-action image) of the played story film, the playback display module 290 can change the playback speed of the story film or adjust the playback volume of the story film .

Next, the first embodiment is used to explain the operation system and method of the present invention, and please refer to "Fig. 3A" for the flow chart of the method of the present invention for giving prompts through augmented reality to play a follow-up video. In this embodiment, the physical scene is an exhibition hall, but the present invention is not limited to this.

First, the film provider cuts the film into multiple drama films with a film sequence (step 301). At the same time, the film provider can also divide the multiple exhibits (real objects) in the physical scene. body) as the detection targets 110a-110e, and record the position data of each of the detection targets 110a-110e, and upload the position data of the detection targets 110a-110e and the video sequence of the plot video to the server.

When the visitor visits the exhibition, if the visitor uses the playback device 200 supporting the present invention, the setting module 210 of the playback device 200 can download the location data of the detection objects 110a-110e and the video sequence of the plot video from the server, and can According to the downloaded location data of the detection objects 110a-110e and the video sequence of the drama videos, the location data of the detection objects 110a-110e and the play sequence of the drama videos are set (step 305). In this embodiment, it is assumed that the video provider divides the video into five drama videos, and the five drama videos correspond to the detection targets 110a to 110e in sequence, that is, the first video corresponds to the detection target 110a, the second The video segment corresponds to the detection target 110b, . . . and the fifth video segment corresponds to the detection target 110e.

After the setting module 210 of the playback device 200 sets the playback sequence of the story video and obtains the position information of the detection target (step 305 ), the image capture module 220 of the playback device 200 can use the camera lens of the playback device 200 (in the figure) Not shown) continuously captures the live image, and the play display module 290 of the playback device 200 can continuously display the live image captured by the image capture module 220 on the display screen 243 of the playback device 200 (step 310).

While the playback display module 290 of the playback device 200 continues to display the live image captured by the image capture module 220 of the playback device 200, the target detection module 230 of the playback device 200 can continuously determine whether there is a detection target 110 is not included in the live image (step 320). In this embodiment, it is assumed that the target detection module 230 can perform various image processing on the real-life image captured by the image capture module 220, so as to determine whether the real-life image contains any physical object (detection target 110). matching images.

If the target detection module 230 determines that the real-life image includes an image consistent with each physical object, the target detection module 230 can continue to perform image processing on the next real-life image captured by the image capture module 220; And if the target detection module 230 determines that the real-life image does not contain images that match all the detection targets, the prompt generation module 260 can determine the location data of the detection targets not included in the real-life image and the setting module 210 according to the position data. The set playback sequence generates target prompts, and the playback display module 290 may superimpose and display the target prompts generated by the prompt generation module 260 on the displayed live image (step 330 ).

After the target detection module 230 of the playback device 200 determines that the real-world image does not include images that match all the detection targets, the target detection module 230 can determine whether the real-world image only includes images that match one detection target ( step 340). If not, the target detection module 230 can continue to perform image processing on the next real-world image captured by the image capture module 220 . If the object detection module 230 determines that the real-life image contains an image corresponding to a physical object (the detection target 110 ), the sequence determination module 250 of the playback device 200 can further determine the detection target included in the real-life image. Whether the corresponding playback identification data conforms to the playback sequence (step 350). In this embodiment, it is assumed that the target detection module 230 can obtain the playback identification data corresponding to the detection target contained in the real-life image through the correspondence table between the physical objects and the playback identification data established by the setting module 210, and determine the sequence in order. The module 250 can compare the playback identification data obtained by the target detection module 230 with the first identification data recorded in the playback sequence according to the playback sequence set by the setting module 210 .

In this embodiment, it is assumed that the play sequence is the sequence in which the drama videos are recorded based on the target identification data of the detection targets corresponding to the drama videos, then the sequence determination module 250 can determine the sequence corresponding to the detection targets included in the live video. Whether the playing identification data is the target identification data of the detection target 110a. If not, as shown in "Fig. 4B", the playback identification corresponding to the detected detection target 110b The data is different from the next identification data (target identification data of the detection target 110a) recorded in the playback sequence. The playback display module 290 of the playback device 200 can be displayed on the The display screen 243 displays the target prompt of the detection target corresponding to the playback identification data in accordance with the playback order, for example, the direction sign 430 and/or the representative icon 440 of the detection target 110a corresponding to the playback identification data in accordance with the playback order is displayed, or even Introductory text or navigation messages can be displayed.

If the sequence determination module 250 determines that the playback identification data corresponding to the detection target included in the live image is the target identification data of the detection target 110a, the playback display module 290 of the playback device 200 can be as shown in FIG. 4A As shown, in the playing area 420 of the display screen 243 of the playing device 200, the drama video corresponding to the detection target 110a is played (step 360).

Next, the visitors of the exhibition hall can repeat the above steps 310 to 360, that is, the real image captured by the image capture module 220 of the playback device 200 is continuously displayed by the playback display module 290 of the playback device 200 (step 310). The target detection module 230 of the playback device 200 determines whether all the detection targets 110 are included in the real-life image (step 320 ). When the object detection module 230 determines that the real image does not contain all the images that match the real object (the detection target 110 ), the prompt generation module 260 can determine the position of the detection target that is not included in the real image according to the matching image. The data and the play sequence set by the setting module 210 generate target prompts, and the play display module 290 displays the target prompts generated by the prompt generation module 260 (step 330). In addition, when the object detection module 230 determines that only one image that matches the real object (detection object 110 ) is included in the real-world image (step 340 ), the sequence determination module 250 of the playback device 200 can determine the object detection module Whether the playback identification data corresponding to the detection target acquired by the group 230 conforms to the playback sequence (step 350). If so, the play display module 290 can play the drama movie corresponding to the detection target (step 360 ), that is, play the drama movie corresponding to the detection target 110b.

8 In this way, the present invention can interact with the user by sequentially detecting different detection targets.

In the above-mentioned embodiment, as shown in the flow of "FIG. 3B", the playback display module 290 of the playback device 200 plays the story video corresponding to the detection target in the playback area 420 of the display screen 243 of the playback device 200. Before (step 340), the distance judgment module 270 of the playback device 200 can judge the target distance between the playback device 200 and the detected detection target (step 381), so that the playback display module 290 can judge the model according to the distance. The target distance determined by the group 270 adjusts the screen size of the play area 420 for playing the drama movie (step 385).

In the above-mentioned embodiment, as shown in the flow of "FIG. 3C", the playback display module 290 of the playback device 200 plays the story video corresponding to the detection target in the playback area 420 of the display screen 243 of the playback device 200. (step 340 ), the gesture determination module 280 of the playback device 200 can determine whether the captured live image contains a specific gesture (step 391 ). The determined specific gesture performs a corresponding operation on the drama movie being played (step 395 ). In this embodiment, as shown in FIG. 5, the gesture determination module 280 can define the functions corresponding to the physical objects 510, 520, 530 in the real-life image recognized by the target detection module 230, and play The display module 290 can display descriptions corresponding to the defined functions around the physical objects 510, 520, and 530 whose functions are defined by the gesture determination module 280, for example, displaying instructions for continuing/pausing video playback below the physical objects 510, The right side of the physical object 520 displays the instructions for enlarging/reducing the size of the video, and the left side of the physical object 530 displays instructions for increasing/decreasing the playback speed and increasing/decreasing the playback volume, etc. When the gesture determination module 280 determines that the specific gesture is a click on the physical object At 510, the playback display module 290 can pause or resume the play of the drama; when the gesture determination module 280 determines that the specific gesture is to toggle, push, or slide the physical object 520 to the left (up) or right (down), The playback display module 290 can be zoomed in or out The size of the playback area 420; when the gesture determination module 280 determines that the specific gesture is to toggle, push, or slide the physical object 530 to the left or right, the playback display module 290 can slow down or speed up the playback speed of the drama; when When the gesture determination module 280 determines that the specific gesture is to flip, push, or slide the physical object 530 up or down, the playback display module 290 can increase or decrease the playback volume of the drama movie.

To sum up, it can be seen that the difference between the present invention and the prior art is that a complete video is divided into a plurality of plot videos, and after each plot video corresponds to the detection target, when the playback device determines that the detection target is not included in the In the live image, the target prompt is generated and displayed according to the location data of the detected target and the playback sequence, and the playback device determines that the live image contains only one detected target and the playback identification corresponding to the detected target included in the live image If the data conforms to the playback order, the playback device plays the technical means of playing the plot video corresponding to the detected detection target. This technical means can solve the problem that the prior art is not easy for users to find smoothly in complex scenes. The problem of continuing the target, and then achieve the technical effect of avoiding destroying the emotions of watching the continuing story film.

Furthermore, the method for playing a subsequent video by giving a prompt through augmented reality of the present invention can be implemented in hardware, software, or a combination of hardware and software, and can also be implemented in a computer system in a centralized manner or with different components. A decentralized implementation spread over several interconnected computer systems.

Although the embodiments disclosed in the present invention are as above, the above-mentioned contents are not intended to directly limit the scope of the patent protection of the present invention. Any person with ordinary knowledge in the technical field to which the present invention pertains, without departing from the spirit and scope disclosed by the present invention, makes slight modifications to the form and details of the implementation of the present invention, all belong to the patent protection of the present invention scope. The scope of patent protection of the present invention shall still be defined by the appended patent application scope.

Step 301: Provide a plurality of plot movies, the plot movies correspond to playback identification data, and the playback identification data corresponds to the detection target

Step 305: Obtain the location data of the detection target and set the playback sequence

Step 310: Continue to capture and display live images

Step 320: Determine whether there is a detection target that is not included in the real scene image

Step 330: Generate target prompts according to the location data and playback sequence, and display the target prompts in the live image

Step 340: Determine whether the live image contains only one detection target

Step 350: Determine whether the playback identification data corresponding to the detection target in the live image conforms to the playback sequence

Step 360: Play the corresponding drama video according to the playback identification data corresponding to the detection target in the real-life image

Step 350: The playback device displays a prompt of the detection target corresponding to the playback identification data in accordance with the playback sequence

Step 360: The playback device displays a target prompt in the live image according to the arrangement order of the detection targets not included in the live image

Claims (10)

A method for playing a subsequent video by giving a prompt through augmented reality, the method at least comprises the following steps: storing a plurality of plot videos, each of the plot videos corresponding to different playback identification data, and each of the playback identification data corresponding to a detection target; obtain a position data of each detection target, and set a playback sequence, the playback sequence records the arrangement sequence of the playback identification data; capture and display a live image; determine whether each detection target is included in the In the live image; when it is determined that at least one of the detection targets is not included in the live image, a target prompt is generated according to the position data and the playback sequence, and the target prompt is displayed in the live image, and the target prompt includes the At least one position information and ordering information of the detection target not included in the live image; and when it is determined that only one detection target is included in the real image, and the detection target included in the real image corresponds to When the play identification data conforms to the play sequence, a corresponding drama video is played according to a play identification data corresponding to the detection target included in the live image. The method for playing a subsequent video by giving a prompt through augmented reality as described in item 1 of the scope of the patent application, wherein before the step of storing the scenario videos, the method further comprises dividing at least one complete video to generate the scenarios Video steps. The method for giving a prompt through augmented reality to play a follow-up video as described in item 1 of the scope of the patent application, wherein the step of displaying the target prompt in the live image is to repeat the process on the live image. Overlay display of a representative icon of the detection target corresponding to the playback identification data in accordance with the playback sequence; or superimposed display on the live image according to the position data of the detection targets and the current direction of the playback device A direction indication, guidance text, or navigation message of the detection target corresponding to one of the playback identification data in the playback sequence. The method for playing a follow-up video by giving a prompt through augmented reality as described in item 1 of the scope of the patent application, wherein the method further comprises determining the playback device and the content included in the live-action video before the step of playing the scenario video. A target distance of a detection target in the step of adjusting the screen size of playing a story video according to the target distance. According to the method for playing a follow-up video by giving a prompt through augmented reality as described in item 1 of the scope of the patent application, the step of playing a drama video further includes capturing a specific gesture and sending the play to the drama video to be played. The step of performing the operation corresponding to the specific gesture. A system for giving prompts through augmented reality to play a subsequent video, applied to a playback device, the system at least includes: a storage module for storing a plurality of plot videos, each of which corresponds to different playback identification data , each of the playback identification data corresponds to a detection target; a setting module is used to obtain a position data of each detection target, and to set a playback sequence, the playback sequence records the arrangement of the playback identification data sequence; an image capture module for capturing a real scene image; a target detection module for judging whether each of the detection targets is included in the real scene image; a prompt generation module for the When the target detection module determines that at least one of the detection targets is not included in the real-life image, a target prompt is generated according to the position data and the playback sequence. The label prompt includes the position information and ordering information of the at least one detection target not included in the real-life image; a sequence determination module is used for determining that only one detection target is included in the real-life image by the target detection module When the target is detected, determine whether one of the playback identification data corresponding to the detection target included in the real-life image conforms to the playback sequence; and a playback display module for displaying the real-life image and for displaying the real-life image Display the target prompt in the live image, and when one of the playback identification data corresponding to the detected target included in the live image matches the play sequence, according to one of the corresponding detected targets included in the live image The play identification data plays a corresponding one of the drama videos. The system for giving a prompt through augmented reality to play a subsequent video as described in item 6 of the scope of the patent application, wherein the object detection module is a physical object in the physical image that matches an image represented by the detection target When the positioning data is determined to be consistent with the data of the detection target, it is determined that a detection target is detected. As described in item 6 of the scope of the patent application, the system for giving a prompt through augmented reality to play a subsequent video, wherein the prompt generating module is further used to read a corresponding one of the playing identification data that matches the playing sequence One of the detection targets represents an icon, or according to the position data of the detection targets and the current direction of the playback device, determine a direction of the detection target corresponding to one of the playback identification data in accordance with the playback sequence a sign, a guide text, or a navigation message, and the playback display module is further used to overlay and display the representative icon, the direction sign, the guide text, or the navigation message on the live image. As described in item 6 of the scope of the patent application, the system for giving prompts through augmented reality to play a subsequent video, wherein the system further includes a distance judgment module for judging the relationship between the playback device and the package. A target distance of the detection target contained in the real-life image, and the playback display module is further used for adjusting the screen size of playing a plot video according to the target distance. As described in item 6 of the scope of the patent application, the system for giving prompts through augmented reality to play a follow-up video, wherein the system further includes a gesture judgment module, which is used for when the play display module plays a story video, A specific gesture is captured, and the playing display module is further used to perform an operation corresponding to the specific gesture on the played story video.

Images