TW202119817A - System for displaying hint in augmented reality to play continuing film and method thereof - Google Patents

Abstract

A system for displaying a hint in augmented reality to play a continuing film and a method thereof are provided. By cutting a full video to plurality of film, corresponding each film with an object, determining a play identification corresponding with a detected object matches a play sequence by a playback device when an image captured by the playback device contains the detected object, displaying a hint of the object that corresponded the play identification matched the play sequence if the play identification dose not match the play sequence, and playing the film corresponding with the detected object if the play identification matches the play sequence, the system and the method can prompt user to find continuing film, and cab achieve the effect of avoiding break feeling of watch video.

Description

System and method for giving prompts through augmented reality to play continuous video

A video playback system and method for augmented reality, in particular, refers to a system and method for playing a subsequent video by giving prompts through augmented reality.

Augmented Reality (Augmented Reality, AR) refers to the technology that calculates the position and angle of the captured image and adds image analysis technology, so that the objects in the virtual world displayed on the screen can be combined and interacted with the scenes of the real world. .

Among the current augmented reality applications, one is to capture the current scene as a real-life image, and analyze the captured real-life image to determine whether the current scene contains a specific physical object. If so, it can be combined with the physical object. The relevant information is superimposed on the real scene image captured, and the real scene image after superimposed information is displayed.

If there are too many related information of the physical object, it may not be easy to understand it all at once. Therefore, multiple physical objects can also be set in the scene to emphasize the time and place of the related information by different physical objects. If the related messages of different physical objects are related, most of them currently mark the order on the physical objects to indicate the order in which the related messages are displayed. However, if the scene is complicated or there are too many physical objects, it is not easy for the user to find the order of the physical objects.

In summary, it can be seen that in the prior art, there has been a long-standing problem in the prior art that it is not easy for users to find the connected physical objects smoothly in complex scenes. Therefore, it is necessary to propose improved technical means to solve this problem.

In view of the problem in the prior art that it is not easy for users to find the connection entity in a complicated scene, the present invention discloses a system and method for playing the connection video by giving prompts through augmented reality, in which:

The system disclosed in the present invention for giving prompts through augmented reality to play a continuous video at least includes: a storage module for storing a plurality of story movies, each story movie corresponds to different playback identification data, and each play The identification data corresponds to a detection target; the setting module is used to obtain position data of each detection target, and is used to set a playback sequence that records the sequence of the playback identification data; image capture module Group, used to capture a real scene image; target detection module, used to determine whether each detected target is included in the real scene image; prompt generation module used to determine at least one of the target detection module When the detection target is not included in the real scene image, a target prompt is generated according to the location data and the playback sequence, and the target prompt includes the position information and sorting information of the at least one detection target not included in the real scene image; The judging module is used for judging whether the playback identification data corresponding to one of the detected targets included in the real-scene image when the target detection module determines that the real-scene image contains only one detection target Play sequence; Play display module to display the real scene image, and to display the target prompt in the real scene image, and the playback identification data corresponding to one of the detected targets included in the real scene image matches In the playback sequence, the drama movie corresponding to the one of the playback identification data corresponding to the detection target included in the real-scene image is played. .

The method of giving prompts through augmented reality to play a subsequent video disclosed in the present invention includes at least the steps of: storing a plurality of story movies, each of the story movies corresponds to different playback identification data, and each of the playback identification data corresponds to one Detect targets; obtain position data of each of the detected targets, and set a playback sequence that records the sequence of the playback identification data; capture and display a real scene image; determine that at least one of the detected targets is not When included in the real-scene image, generate a target prompt based on the position data and the playback sequence, and display the target prompt in the real-scene image, the target prompt including the at least one detected target not included in the real-scene image Position information and sorting information; determine that the real-scene image contains only one detection target, and the detection target included in the real-scene image corresponds to one of the detection targets. When the playback identification data matches the playback sequence, the basis and the inclusion The detection target in the real scene image corresponds to one of the playback identification data to play the corresponding one of the drama movies. .

The system and method disclosed in the present invention are as above. The difference between the present invention and the prior art is that the present invention cuts a complete movie into multiple plot movies, and after each plot movie corresponds to the detection target, when the playback device judges and detects When the target is not included in the real scene image, the target prompt is generated and displayed according to the location data of the detected target and the playback sequence, and the playback device judges that the real scene image contains only one detection target and is included in the real scene image. If the corresponding playback identification data conforms to the playback sequence, the playback device will play the drama movie corresponding to the detected target, so as to solve the problems of the previous technology and achieve the technical effect of avoiding the emotion of watching the subsequent drama movie. .

In the following, the features and implementation of the present invention will be described in detail with the drawings and embodiments. The content is sufficient to enable any person familiar with the relevant art to easily and fully understand the technical means used by the present invention to solve the technical problems and implement them accordingly. The achievable effect of the present invention.

The present invention can set multiple detection targets in the physical scene, and the playback device can display the prompt of the undetected detection target when all the detection targets are not detected, and when the detection target is detected When the target matches the play order, play a predetermined plot movie. Among them, the physical scene is an area in the real world, such as a space on a desktop, a part of a forest, or a city, etc.; a plot movie is a fragment of a complete movie, and a complete movie can be used in the present invention. Cut into multiple drama movies.

In the present invention, the detection target is a physical object or message that can trigger the augmented reality technology. For example, the detection target can be a physical object in a physical scene such as a photo, picture, barcode, and object, and the detection target can also be latitude and longitude, etc. Message, the present invention is not particularly limited; the playback device is a device that can capture images, display the captured images, and play videos, such as mobile phones, tablets, notebook computers, personal digital assistants, navigation devices, and digital Cameras, video cameras, multimedia players, e-book readers, palm-type games, electronic dictionaries, car computers, etc., but the present invention is not limited to this.

Hereinafter, the system structure diagram of the system in which the augmented reality is provided in the "Figure 1" of the present invention is used to play the subsequent video to illustrate the system operation of the present invention. As shown in "Figure 1", the system of the present invention includes multiple detection targets 110 and playback devices 200. In some embodiments, it may also include a server 201. Among them, the playback device 200 has a display screen 243.

The detection target 110 corresponds to the story movie. One detection target 110 usually corresponds to a drama movie, but the present invention is not limited to this. In some embodiments, one detection target 110 may also correspond to multiple drama movies.

Generally speaking, all the drama movies corresponding to the detection target 110 have a corresponding sequence. After all the drama movies are arranged in the order, a complete movie with a coherent story can be combined. However, in some embodiments, all the plot movies corresponding to the detected target 110 may also be combined into multiple complete movies. Among them, different complete movies may or may not be related, and the present invention is not particularly limited. . For example, there are three detection targets (110a, 110b, 110c). The detection target 110a corresponds to the films FA1 and FB2, the detection target 110b corresponds to the films FA2, FB1 and FB4, and the detection target 110c corresponds to the films FA3 and FB3. Among them, The film FA1, the film FA2, and the film FA3 can be combined to form a complete film with a coherent plot, and the film FB1, the film FB2, the film FB3 and the film FB4 can also be combined to form another complete film.

Each detection target 110 has one or more playback identification data. The playback identification data mentioned in the present invention can be the target identification data of the detection target 110 or the video identification data of the drama movie corresponding to the detection target 110. .

The playback device 200 may include a setting module 210, an image capture module 220, a target detection module 230, a sequence determination module 250, a prompt generation module 260, and a playback display module 290, as shown in "Figure 2". , And the prompt generation module may be added with a distance judgment module 270 and a gesture judgment module 280.

The setting module 210 is responsible for obtaining location data of each detection target. The setting module 210 can provide an input interface to input the location data of the detection target, and can also download the location data of the detection target through a network connection to an external server.

The setting module 210 is also responsible for setting the play order of the storyline movie. Among them, the playback sequence records the sequence of the playback identification data. The playback sequence mentioned in the present invention records the movie sequence of the drama movie corresponding to the detection target, for example, records the movie identification data of each drama movie according to the sequence, or records the target identification of the detection target corresponding to each drama movie according to the sequence Data, but the way to record the sequence of movies in the playback sequence is not limited to the above. For example, there are two videos F1 and F2, and there are also two detection targets (110a, 110b). Among them, the video F1 corresponds to the detection target 110a, and the video F2 corresponds to the detection target 110b. The arrangement sequence is movie F1 followed by movie F2. When the playing identification data is the movie identification data of the drama movie corresponding to the detection target, the playing sequence can record the movie identification data of movie F1 and the movie identification data of movie F2 in sequence, and When the playback identification data is the target identification data of the detection target, the playback sequence records the target identification data of the detection target 110a corresponding to the movie F1, and the target identification data of the detection target 110b corresponding to the movie F2.

In some embodiments, the setting module 210 can be pre-connected to the server 201 to download the play order of the storyline movie

The image capturing module 220 is responsible for continuously capturing real scene images. Wherein, the image capture module 220 can capture a real scene image through a photographic lens (not shown in the figure) and a photosensitive element (not shown in the figure), but the present invention is not limited to this; the real scene image includes all or part of the entity The image of the scene.

The target detection module 230 is responsible for detecting whether the detected target is included in the real scene image captured by the image capturing module 220. The target detection module 230 can determine the detected target when the physical object in the physical image matches the image represented by a certain detection target through image recognition technology; the target detection module 230 can also use global positioning The system obtains outdoor positioning data, and/or obtains indoor positioning data through indoor positioning technology, and determines that the detected target is detected when the positioning data matches the data representing the detected target. However, the method for the target detection module 230 to detect the target is not limited to the above.

The target detection module 230 can obtain the playback identification data of the detected target. For example, the target detection module 230 can read the playback identification data corresponding to the image corresponding to the physical object in the real scene image, or the playback identification data corresponding to the positioning data indicating the current position from the pre-established correspondence table.

The sequence determination module 250 is responsible for determining whether the playback identification data corresponding to the detected target detected by the target detection module 230 conforms to the playback sequence when the target detection module 230 determines that the real scene image contains only one detection target .

The sequence determination module 250 can determine whether the playback identification data obtained by the target detection module 230 matches the playback sequence. In more detail, when the playback identification data is the target identification data of the detection target, the sequence determination module 250 can determine whether the target identification data of the detection target detected by the target detection module 230 corresponds to the playback sequence indicating the next The target identification data of the detection target is the same. For example, if the playback sequence indicates that the next is the target identification data of the detection target 110b, the sequence determination module 250 can determine the target recognition of the detection target detected by the target detection module 230 Whether the data is the target identification data of the detection target 110b. Similarly, when the playback identification data is the video identification data of the virtual video corresponding to the detection target, the sequence determination module 250 can determine the video identification data of the virtual video corresponding to the detection target detected by the target detection module 230 Whether it is the same as the playback sequence indicates that the next video identification data is the same, for example, the playback sequence indicates that the next is the video identification data of the virtual video F1 corresponding to the detection target 110a, then the sequence determination module 250 can determine the same as the target detection module 230 Whether the movie identification data of the drama movie corresponding to the detected target is the movie identification data of the drama movie F1.

In another part of the embodiment, the sequence determination module 250 can send the playback identification data obtained by the target determination module 230 to the server 201, and the server 201 determines whether the received playback identification data is consistent with the playback sequence. After matching, it is determined whether the playback identification data obtained by the target determination module 230 matches the playback sequence according to the determination result returned by the server 201.

The prompt generation module 260 is responsible for the position data of the detection target obtained by the setting module 210 when the target detection module 230 determines that the detection target 110 is not included in the real scene image captured by the image capture module 220 And the playback sequence corresponding to the playback identification data corresponding to the detection target 110 generates a target prompt.

The target reminder generated by the reminder generating module 260 includes position information and sorting information of each detected target not included in the real scene image. The prompt generation module, where the position information of the prompt generation module includes, but is not limited to, the position coordinates, direction marks, guidance text, and/or navigation information of the detection target 110. In addition, the sorting information is usually a number. However, the location information and sorting information mentioned in the present invention are not limited to the above.

In more detail, the prompt generation module 260 can read the representative of the detection target 110 corresponding to the playback identification data corresponding to the detection target detected by the target detection module 230 from a pre-created file or database. Icon; the prompt generation module 260 can also generate the direction indicator, the guide text, and/or the detection target corresponding to the playback identification data corresponding to the playback sequence according to the relative position of all the detection targets 110 and the current direction of the playback device 200 Or navigation message, where the prompt generation module 260 can load the position information of all the relative positions of the detection target 110 in a pre-created file, or connect to the server 201 to download the position information of all the relative positions of the detection target 110 , The current direction of the playback device 200 can also be obtained through a direction sensor such as a gyroscope of the playback device 200 (not shown in the figure).

The distance determining module 270 can determine the distance between the playback device 200 and the detected target detected by the target detecting module 230 (referred to as “target distance” in the present invention). For example, the distance determining module 270 can establish a virtual coordinate system in the real scene image captured by the image capturing module 220, and calculate the target distance based on the virtual coordinates of the detected target, but the distance determining module 270 The method of judging the target distance is not limited to the above.

The gesture determining module 280 can determine whether the real scene image captured by the image capturing module 220 includes a specific gesture. The gesture determination module 280 can determine whether a specific gesture is included according to multiple continuous real-scene images, for example, a finger or palm moves from right to left, moves from bottom to top, clicks on a specific location, and is recognized by the click target detection module 230 The specific physical objects in the real scene images.

The playback and display module 290 is responsible for continuously displaying the real scene images captured by the image capturing module 220, is also responsible for displaying the target prompts generated by the prompt generation module 260 in the displayed real scene images, and is responsible for judging the mode in sequence. When the group 250 determines that the playback identification data corresponding to the detected target detected by the target detection module 230 conforms to the playback sequence, the drama video corresponding to the detected target is played.

The playback display module 290 can also adjust the screen size of the story movie to be played based on the target distance determined by the distance determination module 270. For example, the smaller the target distance determined by the distance determination module 270, the larger the playback device 200 is. Close to the detection target, the playback and display module 290 can display a larger-screen storyline, etc.

The play display module 290 may also perform corresponding operations on the drama movie being played according to the specific gesture determined by the gesture determination module 280. For example, when the gesture judging module 280 judges that the specific gesture is moving from left to right, the play speed of the story movie can be speeded up; when the gesture judging module 280 judges that the specific gesture is moving from bottom to top, the playing volume of the story movie can be increased ; When the gesture judgment module 280 judges that the specific gesture is a click on the play screen of the plot movie, it can pause or continue the play of the plot movie. For another example, when the gesture judgment module 280 judges that the specific gesture is a specific physical object in the background (real scene image) of the drama movie being played, the play display module 290 can pause or continue the play of the drama movie; When the group 280 determines that the specific gesture is a specific physical object in the background (real scene image) of the drama movie being played, the play display module 290 can change the playback speed of the story movie or adjust the playback volume of the story movie. .

Next, the first embodiment is used to explain the operating system and method of the present invention, and please refer to "Figure 3A" for the flow chart of the method of playing a continuous video through augmented reality that is provided in the present invention. In this embodiment, the physical scene is an exhibition hall, but the present invention is not limited to this.

First, the provider of the film cuts the film into multiple plot films with one film sequence (step 301). At the same time, the provider of the film can also use multiple exhibits (physical objects) in the physical scene as the detection target 110a ~110e, and record the location data of each detection target 110a~110e, and upload the location data of the detection target 110a~110e and the movie sequence of the story to the server.

When a visitor visits an exhibition, if the visitor uses the playback device 200 that supports the present invention, the setting module 210 of the playback device 200 can go to the server to download the location data of the detected targets 110a~110e and the movie sequence of the storytelling film, and can According to the downloaded location data of the detected targets 110a to 110e and the sequence of the movie of the story, the location data of the detected targets 110a to 110e and the play sequence of the story are set (step 305). In this embodiment, it is assumed that the provider of the movie cuts the movie into five plot movies, and the five plot movies correspond to the detection targets 110a~110e in sequence, that is, the first section of the movie corresponds to the detection target 110a, and the second section of the movie corresponds to the detection target 110a. One segment of the video corresponds to the detection target 110b,..., and the fifth segment of the video corresponds to the detection target 110e.

After the setting module 210 of the playback device 200 sets the play order of the storyline movie and obtains the location information of the detected target (step 305), the image capture module 220 of the playback device 200 can use the camera lens of the playback device 200 (in the figure) Not shown) The real scene images are continuously captured, and the playback display module 290 of the playback device 200 can continuously display the real scene images captured by the image capture module 220 on the display screen 243 of the playback device 200 (step 310).

While the playback display module 290 of the playback device 200 continues to display the real scene images captured by the image capture module 220 of the playback device 200, the target detection module 230 of the playback device 200 can continuously determine whether there is a detection target. 110 is not included in the real scene image (step 320). In this embodiment, it is assumed that the target detection module 230 can perform various image processing on the real scene image captured by the image capturing module 220 to determine whether the real scene image contains any physical objects (detection target 110) Matching images.

If the target detection module 230 determines that the real scene image contains an image that matches each physical object, the target detection module 230 can continue to perform image processing on the next real scene image captured by the image capture module 220; If the target detection module 230 determines that the real scene image does not contain images that match all the detected targets, the prompt generation module 260 can be based on the position data of the detection target that is not included in the real scene image and the setting module 210 The set play sequence generates target prompts, and the play display module 290 can superimpose and display the target prompts generated by the prompt generation module 260 on the displayed real scene images (step 330).

After the target detection module 230 of the playback device 200 determines that the real scene image does not contain images that match all the detected targets, the target detection module 230 can determine whether the real scene image only contains an image that matches one detected target ( Step 340). If not, the target detection module 230 can continue to perform image processing on the next real scene image captured by the image capturing module 220. If the target detection module 230 determines that the real scene image contains an image that matches a physical object (detection target 110), the sequence determination module 250 of the playback device 200 can further determine the detected target included in the real scene image. Whether the corresponding playback identification data conforms to the playback sequence (step 350). In this embodiment, it is assumed that the target detection module 230 can obtain the playback identification data corresponding to the detected target included in the real scene image through the correspondence table between the physical object and the playback identification data created by the setting module 210, and determine the sequence The module 250 can compare the playback identification data obtained by the target detection module 230 with the first identification data recorded in the playback sequence according to the playback sequence set by the setting module 210.

In this embodiment, assuming that the playback sequence is the sequence in which the scenario movie is recorded by the target identification data of the detected target corresponding to the scenario movie, the sequence determination module 250 can determine the sequence corresponding to the detection target included in the real-life image Whether the playback identification data is the target identification data of the detection target 110a. If not, as shown in "Figure 4B", the playback identification data corresponding to the detected detection target 110b and the next identification data recorded in the playback sequence (target identification data of the detection target 110a) are combined Different, the playback display module 290 of the playback device 200 can display the target prompts of the detected targets corresponding to the playback identification data corresponding to the playback sequence on the display screen 243 of the playback device 200 as shown in "Figure 4B", for example, Display the direction mark 430 and/or the representative icon 440 of the detected target 110a corresponding to the playback identification data in the playback order, and even display guide text or navigation information.

If the sequence determination module 250 determines that the playback identification data corresponding to the detection target included in the real scene image is the target identification data of the detection target 110a, the playback display module 290 of the playback device 200 may be as shown in "FIG. 4A" As shown, the drama movie corresponding to the detected target 110a is played in the play area 420 of the display screen 243 of the play device 200 (step 360).

Then, the visitors of the exhibition hall can repeat the above steps 310 to 360, that is, the playback display module 290 of the playback device 200 continuously displays the real scene images captured by the image capture module 220 of the playback device 200 (step 310). And the target detection module 230 of the playback device 200 determines whether all the detected targets 110 are included in the real scene image (step 320). When the target detection module 230 determines that the real scene image does not contain all images that match the physical object (detection target 110), the prompt generation module 260 can detect the position of the target based on the matching image that is not included in the real scene image The data and the play order set by the setting module 210 generate target prompts, and the play display module 290 displays the target prompts generated by the prompt generation module 260 (step 330). In addition, when the target detection module 230 determines that the real scene image contains only one image that matches the physical object (detection target 110) (step 340), the sequence determination module 250 of the playback device 200 can determine that it matches the target detection mode. Whether the playback identification data corresponding to the detection target obtained by the group 230 conforms to the playback sequence (step 350). If so, the play display module 290 can play the story movie corresponding to the detection target (step 360), that is, play the story movie corresponding to the detection target 110b.

8 In this way, the present invention can interact with the user by sequentially detecting different detection targets.

In the above-mentioned embodiment, as shown in the process of "Figure 3B", the playback display module 290 of the playback device 200 plays the drama movie corresponding to the detected target in the playback area 420 of the display screen 243 of the playback device 200 Before (step 340), the distance judging module 270 of the playback device 200 can judge the target distance between the playback device 200 and the detected target (step 381), so that the playback display module 290 can judge the distance based on the distance. The target distance determined by the group 270 adjusts the screen size of the play area 420 of the play story movie (step 385).

In the above-mentioned embodiment, as shown in the process of "Figure 3C", the playback display module 290 of the playback device 200 plays the drama movie corresponding to the detected target in the playback area 420 of the display screen 243 of the playback device 200 (Step 340), the gesture determination module 280 of the playback device 200 can determine whether the captured real-scene image contains a specific gesture (step 391). If so, the playback and display module 290 can determine whether the specific gesture is included in the captured real scene image (step 391). The determined specific gesture performs a corresponding operation on the drama movie being played (step 395). In this embodiment, it is assumed that as shown in "Figure 5", the gesture judgment module 280 can define the functions corresponding to the physical objects 510, 520, and 530 in the real scene image identified by the target detection module 230, and play The display module 290 can display descriptions corresponding to the defined functions around the physical objects 510, 520, and 530 whose functions are defined by the gesture judgment module 280, for example: display instructions to resume/pause video playback under the physical objects 510, The right side of the physical object 520 displays instructions for zooming in/out the size of the video, and the left side of the physical object 530 displays instructions for speeding up/slowing the playback speed and increasing/decreasing the playback volume. When the gesture judgment module 280 judges that the specific gesture is clicking the physical object At 510, the play display module 290 can pause or continue the play of the storytelling movie; when the gesture judgment module 280 judges that the specific gesture is to move, push, or slide the physical object 520 to the left (up) or right (down), The play display module 290 can enlarge or reduce the size of the play area 420; when the gesture judgment module 280 judges that the specific gesture is swiping, pushing, or sliding the physical object 530 to the left or right, the play display module 290 can slow down Or speed up the play speed of the storyline movie; when the gesture judgment module 280 judges that the specific gesture is to move, push, or slide the physical object 530 up or down, the play display module 290 can increase or decrease the play volume of the storyline movie.

To sum up, it can be seen that the difference between the present invention and the prior art is that a complete movie is divided into multiple plot movies, and after each plot movie is corresponding to the detection target, when the playback device determines that the detection target is not included in the When in the real scene image, generate and display the target prompt according to the location data of the detected target and the playback sequence, and the playback device judges that the real scene image contains only one detection target and is included in the real scene image. The corresponding playback recognition of the detection target If the data conforms to the playback sequence, the playback device is a technical means to play the drama movie corresponding to the detected target. This technical means can solve the problem of the previous technology that users cannot easily find in complex scenes. The problem of the succession goal, and then achieve the technical effect of avoiding destroying the emotion of watching the succession drama film.

Furthermore, the method of the present invention to give prompts through augmented reality to play a continuous video can be implemented in hardware, software, or a combination of hardware and software, and can also be implemented in a centralized manner in a computer system or with different components Distributed in a number of interconnected computer systems implemented in a decentralized manner.

Although the embodiments of the present invention are disclosed as above, the content described is not intended to directly limit the scope of patent protection of the present invention. Any person with ordinary knowledge in the technical field to which the present invention belongs, without departing from the spirit and scope of the present invention, makes slight modifications to the form and details of the implementation of the present invention, all belong to the patent protection of the present invention. range. The scope of patent protection of the present invention shall still be determined by the scope of the attached patent application.

110: Detect target 110a~110e: detect target 200: playback device 201: Server 210: Setting module 220: Image capture module 230: Target Detection Module 250: Sequence Judgment Module 241: Storage Module 243: display screen 260: Prompt generation module 270: Distance Judgment Module 280: Gesture Judgment Module 290: Play display module 420: Play area 430: Direction indicator 440: Representative icon 510~530: physical objects Step 301: Provide multiple story movies, the story movie corresponds to playing identification data, and the playing identification data corresponds to the detection target Step 305: Obtain the location data of the detected target and set the playback sequence Step 310: Continuously capture and display real-life images Step 320: Determine whether there is a detected target that is not included in the real scene image Step 330: Generate a target reminder according to the location data and the playback sequence, and display the target reminder in the real scene image Step 340: Determine whether there is only one detection target in the real scene image Step 350: Determine whether the playback identification data corresponding to the detected target in the real scene image meets the playback sequence Step 360: Play the corresponding drama movie based on the playback identification data corresponding to the detected target in the real scene image Step 350: The playback device displays a prompt for the detection target corresponding to the playback identification data in the playback order Step 360: The playback device displays target prompts in the real scene image according to the sequence of the detected targets not included in the real scene image Step 381: The playback device judges the target distance to the detected target in the real scene image Step 385: The playback device adjusts the screen size of the play story movie according to the target distance Step 391: The playback device captures a specific gesture Step 395: The playback device performs an operation corresponding to the specific gesture on the drama movie being played

Figure 1 is a system architecture diagram of the present invention that provides prompts through augmented reality to play a subsequent video. Figure 2 is a schematic diagram of the components of the playback device of the present invention. Figure 3A is a flow chart of the method for playing a continuous video by giving prompts through augmented reality according to the present invention. FIG. 3B is a flow chart of the method of giving sequential prompts based on the detected targets in the real image according to the present invention. FIG. 3C is a flow chart of the method for adjusting the size of the video according to the distance from the detection target according to the present invention. Figure 3D is a flowchart of the method for performing corresponding operations according to gestures according to the present invention. FIG. 4A is a schematic diagram of playing a drama movie according to an embodiment of the present invention. FIG. 4B is a schematic diagram showing a prompt for detecting a target according to an embodiment of the present invention. FIG. 5 is a schematic diagram of a physical object in a real image as a movie control element according to an embodiment of the present invention.

Step 301: Provide multiple story movies, the story movie corresponds to playing identification data, and the playing identification data corresponds to the detection target

Step 305: Obtain the location data of the detected target and set the playback sequence

Step 310: Continuously capture and display real-life images

Step 320: Determine whether there is a detected target that is not included in the real scene image

Step 330: Generate a target reminder according to the location data and the playback sequence, and display the target reminder in the real scene image

Step 340: Determine whether there is only one detection target in the real scene image

Step 350: Determine whether the playback identification data corresponding to the detected target in the real scene image meets the playback sequence

Step 360: Play the corresponding drama movie based on the playback identification data corresponding to the detected target in the real scene image

Step 350: The playback device displays a prompt for the detection target corresponding to the playback identification data in the playback order

Step 360: The playback device displays target prompts in the real scene image according to the sequence of the detected targets not included in the real scene image

Claims (10)

A method for playing a subsequent video by giving prompts through augmented reality, the method at least includes the following steps: Store multiple drama movies, each drama movie corresponds to different playback identification data, and each playback identification data corresponds to a detection target; Obtain the position data of one of the detection targets, and set a playback sequence, which records the arrangement sequence of the playback identification data; Capture and display a real scene image; When it is determined that at least one detected target is not included in the real scene image, a target prompt is generated according to the position data and the playback sequence, and the target prompt is displayed in the real scene image. The target prompt includes the at least one not included in the real scene image. The position information and sorting information of the detected target in the real scene image; When it is determined that the real scene image contains only one detection target, and the playback identification data corresponding to one of the detection targets included in the real scene image matches the playback sequence, it is based on the detection target included in the real scene image. The test target corresponds to one of the playing identification data to play the corresponding one of the story movies. As described in item 1 of the scope of patent application, the method of giving prompts to play a continuous video through augmented reality, wherein the method is used to determine whether the playback identification data corresponding to one of the detection targets included in the real scene image conforms to Before the step of the playback sequence, it further includes providing selection of a plot parameter corresponding to the playback sequence, and the method is used to determine whether the playback identification data corresponding to the detected target included in the real-scene image conforms to the The step of the playback sequence further includes the step of determining whether the playback identification data corresponding to the detected target included in the real-scene image conforms to the playback sequence corresponding to the plot parameter. As described in item 1 of the scope of patent application, the method of giving a reminder through augmented reality to play a subsequent video, wherein the step of displaying the target reminder in the real-scene image is to superimpose one of the playback sequences on the real-scene image The playback identification data corresponds to a representative icon of the detection target; or based on the location data of the detection targets and the current direction of the playback device, the real scene image is displayed overlaid on the real scene image in accordance with the playback sequence. The playback Identify the direction mark, guide text, or navigation message of the detected target corresponding to the identification data. As described in item 1 of the scope of the patent application, the method of giving hints to play a continuous movie through augmented reality, wherein the method further includes determining the playback device and the real-life image before the step of playing a story movie The step of detecting a target distance in the target, and adjusting the screen size of the story movie according to the target distance. As described in the first item of the scope of patent application, the method of giving prompts to play a subsequent video through augmented reality, in which the step of playing a story movie further includes capturing a specific gesture when the story is played The movie executes the steps of the operation corresponding to the specific gesture. A system that gives prompts through augmented reality to play a subsequent video is applied to a playback device, and the system at least includes: A storage module for storing multiple drama movies, each drama movie corresponds to different playback identification data, and each playback identification data corresponds to a detection target; A setting module for obtaining position data of each detection target, and for setting a playback sequence, which records the arrangement sequence of the playback identification data; An image capturing module for capturing a real image; A target detection module for judging whether each detected target is included in the real scene image; A prompt generation module is used to generate a target prompt based on the position data and the playback sequence when the target detection module determines that at least one of the detected targets is not included in the real scene image, and the target prompt includes the at least one Position information and sorting information of the detected target not included in the real scene image; A sequence judgment module for judging whether the playback identification data corresponding to one of the detection targets included in the real scene image when the target detection module judges that the real scene image contains only one detection target Conform to the play order; and A playback display module for displaying the real-scene image, and for displaying the target prompt in the real-scene image, and the playback identification data corresponding to one of the detected targets included in the real-scene image conforms to the playback In the sequence, based on the playback identification data corresponding to the detection target included in the real-scene image, a corresponding one of the drama movies is played. As described in item 6 of the scope of patent application, the system that gives prompts to play the subsequent video through the augmented reality, wherein the sequence determination module is further used to select a plot parameter, the plot parameter corresponds to the playback sequence, and is used to determine Whether the playback identification data corresponding to one of the detection targets included in the real scene image conforms to the playback sequence corresponding to the plot parameter. As described in item 6 of the scope of the patent application, the system for giving prompts to play the continued video through augmented reality, wherein the prompt generation module is used to read one corresponding to the play identification data that matches the play order One of the detection targets represents an icon, or according to the position data of the detection targets and the current direction of the playback device, it is determined that the playback sequence corresponds to a direction of the detection target corresponding to the playback identification data. Mark, a guide text, or a navigation message, and the playback display module is further used to display the representative icon, the direction mark, the guide text, or the navigation message on the real scene image. As described in item 6 of the scope of the patent application, the system that gives prompts to play a continuous video through augmented reality, wherein the system further includes a distance judgment module for judging the playback device and the real-life image A target distance of a target is detected, and the playback display module is further used to adjust the screen size of a story movie to be played according to the target distance. For example, the system that provides prompts to play a subsequent video through augmented reality as described in item 6 of the scope of patent application, wherein the system further includes a gesture judgment module for when the play and display module plays a story movie, A specific gesture is captured, and the playback and display module is further used to perform an operation corresponding to the specific gesture on the drama movie being played.

Images