TWI533682B - Multimedia content playback method and system - Google Patents

Description

Multimedia content playing method and system

The invention relates to a multimedia content playing method and system, in particular to a multimedia content playing method and system combined with augmented reality technology.

With the rapid development of multimedia and communication technologies, it has become quite common to use mobile devices such as smart phones and tablet devices to download multimedia content such as images, movies, and texts from the Internet to mobile devices. In particular, there is also a multimedia content playback method in combination with Augmented Reality technology, that is, the user operates the mobile device to download the reference image and the multimedia content corresponding to the reference image from the data server. Then, the operating mobile device captures an image of the target object to generate a target image containing the target object, such as a basketball, a picture, or a building, and the like. When the mobile device determines that the similarity between the target image and the reference image is higher than the preset threshold, the mobile device plays the multimedia content corresponding to the reference image.

However, at present, the multimedia content corresponding to each reference image in the data server is fixed, and even if the data server updates the reference image and the multimedia content, the related user is not actively notified, so There is room for improvement.

Accordingly, it is an object of the present invention to provide a method of playing multimedia content.

Therefore, the multimedia content playing method of the present invention is jointly executed by a servo module and a mobile device connected to the servo module via a network, the servo module includes a plurality of reference images, a plurality of multimedia contents, and a recording of the servo module. The pairing information of the correspondence between the at least one reference image and the at least one multimedia content in the group, the multimedia content playing method comprises the following five steps.

Step (a): The servo module updates the correspondence in the pairing information.

Step (b): The servo module sends the pairing information to the mobile device.

Step (c): The mobile device downloads at least one reference image and multimedia content corresponding to the downloaded reference image from the servo module according to the pairing information.

Step (d): The mobile device captures an image of a target object to generate a target image containing the target object.

Step (e): When the mobile device determines that the similarity between the target image and the downloaded reference image is higher than a preset threshold, the mobile device plays the multimedia content corresponding to the downloaded reference image.

Further, another object of the present invention is to provide a multimedia content playing system.

Therefore, the multimedia content playing system of the present invention is connected through a network From the line to a mobile device, the multimedia content playback system includes a servo module and an application module.

The servo module includes a plurality of reference images and a plurality of multimedia content, and is configured to generate pairing information for recording a correspondence between the at least one reference image and the at least one multimedia content in the servo module, and is used to update the correspondence.

The application module is executed in the mobile device to connect the mobile device to the servo module via the network, and receives the pairing information, and downloads at least one reference image and corresponding office from the servo module according to the pairing information. Downloading the multimedia content of the reference image, and capturing an image of a target object to generate a target image including the target object, and when the application module determines that the target image is more similar to the downloaded reference image than the pre-preview When the threshold is set, the application module causes the mobile device to play the multimedia content corresponding to the downloaded reference image.

The effect of the present invention is that the pairing server sends the pairing information to the mobile device, and can actively notify the user of the mobile device of the latest correspondence between the reference image and the multimedia content in the data server, and let the user The mobile device can be operated to download the multimedia content with the viewing interest and the corresponding reference image according to the latest correspondence, and then play the multimedia content in a manner combined with the augmented reality technology.

1‧‧‧pairing server

2‧‧‧Data Server

3‧‧‧External electronic devices

4‧‧‧Mobile devices

41‧‧‧Application Module

501~510‧‧‧Steps

6‧‧‧TV Shows

7‧‧ ‧Basketball

8‧‧‧ Target image

Other features and effects of the present invention will be apparent from the following description of the drawings. FIG. 1 is a block diagram illustrating the multimedia content playing system of the present invention. 2A is a flow chart illustrating the flow of steps of the multimedia content playing method of the present invention; FIG. 2B is a flow chart, and FIG. 2A illustrates the flow of steps of the multimedia content playing method of the present invention; FIG. 3A is a schematic diagram illustrating the present embodiment. A case where a mobile device of the multimedia content playing system plays a multimedia content; and FIG. 3B is a schematic diagram illustrating a case where the mobile device plays another multimedia content.

Before the present invention is described in detail, it should be noted that in the following description, similar elements are denoted by the same reference numerals.

Referring to FIG. 1, the multimedia content playing method of the present invention is a pairing server 1, a data server 2, an external electronic device 3 connected via the Internet as shown in FIG. 1, and a smart phone or a tablet, for example. The mobile device 4 of the computer is co-executed; wherein the mobile device 4 is coupled to the pairing server 1, the data server 2, and the specific application module 41 installed in the mobile device 4. The external electronic device 3 collectively performs the method of the present invention. The data server 2 includes a plurality of reference images and a plurality of multimedia content, wherein the multimedia content includes image files and movie files, music files, texts, and the like having two-dimensional or three-dimensional content. The pairing server 1 includes a pairing information (not shown) for recording a correspondence between at least one reference image and at least one multimedia content in the data server 2, and each reference image in the pairing information corresponds to at least one multimedia content.

For example, as shown in FIG. 1, the data server 2 includes reference images A~E and multimedia contents A~E. The pairing information includes the content shown in the following list 1. The reference image A corresponds to the multimedia content A, the reference image C corresponds to the multimedia content D, and the reference image D corresponds to the multimedia content D.

The flow of steps of the multimedia content playing method of the present invention is detailed below. Referring to FIG. 2A and FIG. 2B, first, in step 501, a content provider transmits at least one of the reference images A~E and the multimedia contents A~E different from the data server 2 via the external electronic device 3. Refer to the image or multimedia content (not shown) to the data server 2.

Next, in step 502, the data server 2 sends a data update message to the pairing server 1 after receiving the reference image or multimedia content, to notify the pairing server 1 that the data content in the data server 2 has been Update.

Next, in step 503, the pairing server 1 updates the correspondence in the pairing information. In addition, the pairing information may also include information related to the data update of the data server 2.

For example, in step 501, the external electronic device 3 transmits the reference image F, the multimedia content F, and the multimedia content G to the data server 2 (not shown); and in step 503, the pairing server 1 The correspondence relationship shown in Table 1 in the pairing information is updated to the correspondence relationship shown in the following Table 2, wherein the reference image A is updated from the original corresponding multimedia content A to the corresponding multimedia content F.

Next, in step 504, the pairing server 1 sends a prompt message related to the pairing information to the mobile device 4 to prompt the user of the mobile device 4 to have the latest pairing information.

Next, in step 505, the user operates the mobile device 4 to send a confirmation download message to the pairing server 1 that should prompt the message.

Next, in step 506, the pairing server 1 sends the pairing information to the mobile device 4.

Next, in step 507, the mobile device 4 downloads at least one reference image and multimedia content corresponding to the downloaded reference image from the data server 2 according to the pairing information.

Next, in step 508, the mobile device 4 targets a target object. The image is captured to produce a target image containing the target object.

Next, in step 509, the mobile device 4 determines whether there is a reference image corresponding to the target image. In detail, if the mobile device 4 downloads only one reference image and the multimedia content corresponding to the image in step 507, the mobile device 4 determines whether the similarity between the target image and the downloaded reference image is higher than a preset. If the result of the determination is affirmative, the mobile device 4 determines that the reference image corresponds to the target image, otherwise it does not correspond to the target image. If the mobile device 4 downloads a plurality of reference images and multimedia content corresponding to the reference images in step 507, the mobile device 4 calculates the similarity between each reference image and the target image, and determines whether the similarities are in the similarity. The highest one is higher than the preset threshold. If the result of the determination is affirmative, the mobile device 4 determines that the reference image having the highest similarity with the target image corresponds to the target image, otherwise the reference images do not correspond to each other. Target image.

When the result of the determination in step 509 is affirmative, step 510 is performed, otherwise returning to step 508. In step 510, the mobile device 4 plays the multimedia content corresponding to the reference image corresponding to the target image, and when the multimedia content is played, the multimedia content can be overlapped with the target image.

For example, referring to FIG. 3A and Table 1, the reference image A is an image containing a basketball (not shown), and the multimedia content A is a film of a pre-match analysis of a specific game of a specific professional basketball team. Before the specific competition is held, the content provider transmits the reference image A and the multimedia content A to the data server 2 via the external electronic device 3. The pairing server 1 Sending the pairing information including Table 1 to the mobile device 4, and then the user operates the mobile device 4 to download the reference image A and the multimedia content A; then, as shown in FIG. 3A, when the user watches the TV program 6 related to the basketball The mobile device 4 is operated to capture the image of the basketball 7 in the television screen to generate the target image 8 including the basketball 7; finally, the mobile device 4 plays the multimedia content A so that the user can view the specific content of the specific professional basketball team. Pre-match analysis of the game. After the end of the specific game, the content provider transmits the multimedia content F to the data server 2 via the external electronic device 3, wherein the multimedia content F is a wonderful process segment of the specific game of the specific professional basketball team. Then, the pairing server 1 updates the correspondence in the pairing information to generate a pairing information including the above list 2. Then, the pairing server 1 sends the pairing information including the table 2 to the mobile device 4, and then the user operates the mobile device 4 to download the reference image A and the multimedia content F. Then, as shown in FIG. 3B, the user views the same again. The basketball program related to the basketball is operated at 6 o'clock. The mobile device 4 captures the image of the basketball 7 in the television screen to generate the target image 8 including the basketball 7; finally, the mobile device 4 plays the multimedia content F so that the user can view it. A wonderful process fragment of the particular game of the particular professional basketball team.

In addition, in another embodiment, the multimedia content playing method may only include steps 503-510 shown in FIG. 2A and FIG. 2B. That is to say, even if the data server 2 does not perform data update, the pairing server 1 can update the correspondence between the reference images in the data server 2 and the multimedia content.

In summary, the multimedia content playing method and system of the present invention The matching server generates and updates the pairing information, and sends the pairing information to the mobile device 4, and can actively notify the user of the mobile device 4 of the reference image and multimedia content in the data server 2. The latest correspondence enables the user to operate the mobile device 4 to download the multimedia content with the viewing interest and the corresponding reference image according to the latest correspondence, and then play the multimedia content in a manner combined with the augmented reality technology, so that the virtual content can be achieved. The object of the invention.

However, the above is only the embodiment of the present invention, and the scope of the present invention is not limited thereto, that is, the simple equivalent changes and modifications made by the patent application scope and the patent specification of the present invention are still It is within the scope of the patent of the present invention.

1‧‧‧pairing server

2‧‧‧Data Server

3‧‧‧External electronic devices

4‧‧‧Mobile devices

41‧‧‧Application Module

Claims (10)

A multimedia content playing method is jointly performed by a servo module and a mobile device connected to the servo module via a network, the servo module includes a plurality of reference images, a plurality of multimedia contents, and a record in the servo module The pairing information of the at least one reference image and the at least one multimedia content, the multimedia content playing method comprises the following steps: (a) the servo module updates the corresponding relationship in the pairing information; (b) the servo module Sending the pairing information to the mobile device; (c) the mobile device downloads at least one reference image and multimedia content corresponding to the downloaded reference image from the servo module according to the pairing information; (d) the mobile device targets a target object Taking the image to generate a target image including the target object; and (e) when the mobile device determines that the similarity between the target image and the downloaded reference image is higher than a preset threshold, the mobile device plays the corresponding downloaded reference The multimedia content of the image. The method for playing multimedia content according to claim 1, further comprising the following steps performed between step (a) and step (b): (f) the servo module sends a prompt message related to the pairing information to the a mobile device; and (g) the mobile device sends a confirmation download message to the servo module that should prompt the message. The method for playing a multimedia content according to claim 2, wherein the server module comprises a pairing server and a data server connected to the pairing server via a network, and the mobile device connects the pairing server via a network and The data server, the reference images and the multimedia content are stored in the data server, and the pairing information is generated by the pairing server, wherein in step (a), the pairing server updates the pairing In the correspondence in the information, in step (b), the pairing server sends the pairing information to the mobile device, and in step (c), the mobile device downloads the reference image from the data server according to the pairing information. Corresponding to the multimedia content of the downloaded reference image, in step (f), the prompting message is sent by the pairing server to the mobile device, and in step (g) the mobile device sends the confirmation download message to the pairing server. The multimedia content playing method according to claim 3, further comprising the following steps performed before the step (a): (h) an external electronic device transmitting the reference image and the multimedia content different from the data server And at least one reference image or multimedia content to the data server; and (i) the data server sends a data update message to the pairing server after receiving the reference image or multimedia content. The multimedia content playing method of claim 1, wherein in step (e), the mobile device superimposes the multimedia content with the target image when the multimedia content is played. A multimedia content playing system is connected to a mobile device through a network. The multimedia content playing system comprises: a servo module, comprising a plurality of reference images and a plurality of multimedia content, and configured to generate a record in the servo module. Matching information of at least one reference image and at least one multimedia content, and used for updating And the application module is executed in the mobile device to enable the mobile device to connect to the servo module via a network, and receive the pairing information, and download at least the servo module from the server module according to the pairing information. a reference image and a multimedia content corresponding to the downloaded reference image, and used to capture an image of a target object to generate a target image including the target object, and when the application module determines the target image and the downloaded reference image When the similarity is higher than a preset threshold, the application module causes the mobile device to play the multimedia content corresponding to the downloaded reference image. The multimedia content playing system of claim 6, wherein the servo module sends a prompt message related to the pairing information to the mobile device after updating the corresponding relationship in the pairing information, and the mobile device is receiving The prompt message is followed by a pair of confirmation download messages that should prompt the message to the servo module, and the servo module sends the pairing information to the mobile device after receiving the confirmation download message. The multimedia content playing system of claim 7, wherein the server module comprises a pairing server and a data server connected to the pairing server via a network, and the mobile device connects the pairing server via a network And the data server, the reference images and the multimedia content are stored in the data server, the pairing server generates and updates the correspondence in the pairing information, and sends the prompt message and the pairing information to the a mobile device, the mobile device sends the confirmation download message to the pairing server, and downloads the reference image and the multimedia content corresponding to the downloaded reference image from the data server according to the pairing information. The multimedia content playing system of claim 8, wherein the data server receives at least one reference image or multimedia content different from the reference image and the multimedia content in the data server from an external electronic device, Then, send a data update message to the pairing server. The multimedia content playing system of claim 1, wherein the mobile device superimposes the multimedia content with the target image when playing the multimedia content.