TWM458037U - Audio/video interaction system and operation carrier for the audio/video interaction system - Google Patents

Description

Audio-visual interactive system and operation vehicle for the audio-visual interactive system

The present invention relates to an audio-visual interactive system and an operating vehicle for the interactive system, in particular, an audio-visual interactive system with an augmented reality technology and an operating vehicle for the interactive audio-visual system.

A traditional card can only print the text or picture to be expressed on the surface of the card, and the content of the expression will be limited by the size of the card itself, and cannot convey more information. Moreover, the way of conveying the 2D plane is boring. When the user reads the card once and can't afford the interest and then watch the second time, the user's impression of the card content is not too deep, so the traditional card should convey the information or Advertising benefits are not great.

At present, some public documents have improved the limitation of traditional card expression content, and a two-dimensional barcode for storing a web address has been added to the conventional card. For example, FIG. 1 shows a two-dimensional barcode card 1 disclosed in Patent No. M388050. The 2D barcode can be placed on the front or the back of the traditional card, and the relevant URL is stored in the network location (URL) in the 2D barcode, and the URL provides the extended digit information related to the 2D barcode card 1 The barcode card 1 recipient can easily read the 2D barcode through various 2D barcode reading devices and link to the stored URL, and then connect to the webpage corresponding to the storage URL to view more 2D barcode cards. 1 related content, effectively solve the problem that the traditional card expression content is limited. However, after the recipient uses the two-dimensional bar code reading device to read the two-dimensional bar code, it begins to read and operate on the web page, and thereafter has no direct interaction with the two-dimensional bar code card 1 itself. Therefore, the service of the 2D barcode card 1 recipients online and There is not much difference in the services after entering the social networking site and the web blog. Finally, the 2D barcode card 1 recipients actually use the traditional Internet connection to interact, so the use of this 2D barcode card 1 to convey information is not new, the card itself does not produce cool effects to attract cards to accept People repeatedly watch and use.

Therefore, how to provide a cool card communication method, let the card holder want to repeat the operation, and let the card holder have a surprising effect when obtaining information, it is worthy of the ordinary knowledge in the field. Think about it.

The purpose of the present invention is to provide an audio-visual interactive system including a portable electronic device, an operating vehicle and a cloud server. The portable electronic device includes a display screen, a camera, and an audio-visual interactive application. The audio-visual interactive application includes an operation module, an identification module and a storage module. The operation carrier includes an identification mark and a real pattern, and the identification mark can be recognized by the identification module. The cloud server stores an augmented reality module corresponding to the identification mark. The augmented reality module includes a multimedia component, and the augmented reality module can be downloaded into a storage module of the audiovisual interactive application.

Wherein, when the identification module recognizes the identification mark, the audio-visual interactive application checks whether the storage module stores the augmented reality module corresponding to the identification mark, and if there is no augmented reality module, starts a downloading process to The cloud server downloads the augmented reality module to the storage module of the audio-visual interactive application; when the augmented reality module is activated, and the camera is aimed at the real-world pattern, the display screen of the portable electronic device is displayed. The reality graphics and multimedia components, the multimedia components will interact with the real-world pattern.

In the audio-visual interactive system described above, the identification mark is a two-dimensional barcode, and the portable electronic device reads the identification mark by the camera.

In the audio-visual interactive system described above, the operation module of the audio-visual interactive application includes a download list page, a profile page, and a play button, and the download list page lists the downloaded The name of the augmented reality module, the introduction page lists the basic data of the augmented reality module, and the play button is used to play the multimedia components of the augmented reality module.

In the audio-visual interactive system described above, the operation module includes a webpage connection key, and the webpage connection key is a website hyperlinked to the provider of the augmented reality module.

In the audio-visual interactive system described above, the identification module senses the identification mark by means of wireless sensing.

In the audio-visual interactive system described above, the wireless sensing method is a short-range wireless communication technology.

In the audio-visual interactive system described above, the operating vehicle is a card, and the identification mark and the real-world pattern are printed on different pages of the card.

In the audio-visual interactive system described above, the multimedia component is a three-dimensional image or a video unit.

In the audio-visual interactive system described above, the portable electronic device is a smart phone or a tablet computer.

The purpose of the present invention is to provide an operating vehicle that is coupled with the audio-visual interactive system. The operating vehicle includes an identification mark and a real-world pattern, and the identification mark can be recognized by the image recognition module. The pattern is a pattern or text.

1‧‧‧2D barcode card

2, 8‧‧‧ audio and video interactive system

3‧‧‧Portable electronic devices

31‧‧‧ camera

32‧‧‧ Display screen

33‧‧‧Video Interactive App

331‧‧‧ Storage Module

332‧‧‧Operating module

3322‧‧‧Start button of the download list page

3322A‧‧‧Download List Page

3324‧‧‧ URL Link Key

333‧‧‧ Identification Module

3331‧‧‧ Identification module start button

4‧‧‧Operating vehicle

40‧‧‧Smart mobile phones

401‧‧‧Webcam

402‧‧‧ card

403‧‧‧QR code

404‧‧‧God pattern

406‧‧‧God of God

407‧‧‧ Live songs

41‧‧‧ Identification marks

42‧‧‧ Reality pattern

5‧‧‧Cloud Server

51‧‧‧Augmented Reality Module

51A‧‧‧Introduction page

51B‧‧‧Play button

511‧‧‧Multimedia components

801‧‧‧ sensor

802‧‧‧RFID tags

FIG. 1 is a two-dimensional barcode card 1 disclosed in Patent No. M388050.

FIG. 2 illustrates the video and audio interactive system 2 of the present embodiment.

FIG. 3A illustrates a top page of the operation module 332.

FIG. 3B illustrates the operation module 332 downloading the list page 3322A.

FIG. 3C illustrates an introduction page 51A of the operation module 332.

FIG. 4 is a schematic diagram of the "QR code" 403 of the camera 401 of the smart phone 40 aligned with the card 402.

FIG. 5 is a schematic diagram of the audio-visual interactive application 33 downloading the augmented reality module 51.

FIG. 6 is a schematic diagram showing the camera 401 of the smart phone 40 aligned with the Caishen pattern 404 of the card 402.

FIG. 7A and FIG. 7B are schematic diagrams showing the use of the audio-visual interactive system 2 of the present embodiment.

FIG. 8 illustrates a video and audio interaction system 8 of another embodiment.

Referring to FIG. 2 , FIG. 2 illustrates the audio-visual interaction system 2 of the present embodiment. The audio-visual interaction system 2 includes a portable electronic device 3 , an operation carrier 4 , and a cloud server 5 . The portable electronic device 3 includes a camera 31, a display screen 32, and an audio-visual interactive application 33. The video interactive application 33 includes a storage module 331, an operation module 332, and an identification module 333. The operation carrier 4 includes an identification mark 41 and a real pattern 42. The reality pattern 42 can be a pattern or a text. The reality pattern 42 in the embodiment shown in FIG. 6 is a Q version of the God of Wealth pattern. In addition, the cloud server 5 stores an augmented reality module 51 corresponding to the identification mark 41. The augmented reality module 51 includes a multimedia component 511. The portable electronic device 3 described above is, for example, a smart phone or a tablet computer, and the operation carrier 4 is, for example, an outer case package of a card or a cosmetic product.

Referring to FIG. 3A to FIG. 3C , FIG. 3A illustrates a top page of the operation module 332 . The first page of the operation module 332 includes a start button 3331 of the identification module 333 and a start button of the download list page 3322A. 3322, and a web link key 3324. When the start button 3322 of the download list page 3322A is clicked, the download list page 3322A (see FIG. 3B) is displayed. The download list page 3322A can display the name of the augmented reality module 51 that has been downloaded, so that the user is very It is clearly seen that a total of a total number of augmented reality modules 51 have been downloaded; in Figure 3, two augmented reality modules 51 have been downloaded, namely "Cai Shen Ye" and "Wenchang Emperor". In addition, the website link key 3324 is hyperlinked to the website page (not shown) of the provider of the augmented reality module 51, and other new product information can be known from the website page.

Please refer to FIG. 3C. FIG. 3C is an introduction page 51A of the operation module 332 of the audio-visual interactive application 2, When the augmented reality module 51 is clicked, the profile page 51A of the augmented reality module 51 is displayed, and the basic data of the augmented reality module (Cai Shen Ye) 51 can be read in the profile page 51A, and the profile page is A play button 51B is provided on the 51A, and the play button 51B is a multimedia element 511 for playing an augmented reality module (God of Wealth) 51 (please refer to FIG. 7A).

Please refer to FIG. 4. FIG. 4 is a schematic diagram of the "QR code" 403 of the camera 401 of the smart phone 40 aligned with the card 402. After the user selects the start button 3331 of the identification module 333, the camera 401 of the smart phone 40 is used to align the "QR code" 403 on the surface of the card 402. At this time, the recognition module 333 of the audio-visual interactive application 33 can be used. The "QR code" 403 is recognized. In the present embodiment, the smart phone 40 is equivalent to the portable electronic device 3, the card 402 is equivalent to the operation carrier 4, the "QR code" 403 is equivalent to the identification mark 41, and the "QR code" 403 belongs to the two-dimensional barcode. One.

Please refer to FIG. 5. FIG. 5 is a schematic diagram of the audio-visual interactive application 33 of the audio-visual interactive system 2 of the present embodiment downloading the augmented reality module 51. After the identification module 333 recognizes the "QR code" 403, the video interactive application 33 checks whether the augmented reality module 51 corresponding to the "QR code" 403 is stored in the storage module 331, if no amplification is detected. The download module is immediately launched by the real-world module 51. The download program is downloaded from the cloud server 5 to the storage module 331 of the augmented reality module 51 to the audio-visual interactive application 33. The download status of the augmented reality module 51 can be displayed on the download list page 3322A (please refer to FIG. 3B). After the download is completed, the augmented reality module 51 can be started. If it is checked that the augmented reality module 51 has been stored in the storage module 331, the video interactive application 33 directly activates the augmented reality module 51.

Please refer to FIG. 6 and FIG. 7A. FIG. 6 is a schematic diagram of the camera 401 of the smart phone 40 aligned with the God of Wealth pattern 404 of the card 402. FIG. 7A is a schematic diagram of the audio-visual interaction system 2 of the embodiment. After entering the introduction page 3323 of the Augmented Reality Module (财神爷) 51, press the play button 3323A again (please refer to Figure 3C), and then activate the Augmented Reality Module (财神爷) 51. After the click-up is started, the camera 401 of the smart phone 40 is aimed at the God of Wealth pattern 404. At this time, the display screen 32 of the smart phone 40 displays the God of Wealth 404, 3D God of Wealth dynamic The image 406 and the lively song 407; the 3D God of Wealth motion image 406 can be presented in a completely static manner, in addition to being presented in a dynamic manner. In the present embodiment, the God of Wealth pattern 404 is equivalent to the physical pattern 42, the 3D God of Wealth motion picture 406 and the lively song 407 are equivalent to the multimedia element 511. Compared with the conventional card, the audio-visual interactive system 2 of the embodiment can use the multimedia component 511 to transmit more information, for example, by using a 3D image dynamic or voice. Moreover, the 3D image dynamic communication method is cool and novel. When the user reads the card 402 once and wants to convey the novel reading mode to friends and relatives, the information and interaction system 2 of the embodiment can convey the information and The advertising benefits are very high. As can be seen from FIGS. 4 and 6, the "QR code" 403 and the God of Wealth pattern 404 are printed on different pages of the card 402.

In addition, please refer to FIG. 7A and FIG. 7B. FIG. 7A and FIG. 7B are schematic diagrams of the audio-visual interaction system 2 of the embodiment. When the user of the audio-visual interactive system 2 changes the card 402, the display screen 32 of the smart phone 40 displays the 3D God of Wealth motion image 406 above the God of Wealth pattern 404. Compared with the conventional two-dimensional barcode card 1, the audio-visual interactive system 2 of the embodiment can directly interact with the card 402, so that the user can have more fun when reading the card 402.

In addition, in addition to reading the two-dimensional barcode, other methods can be used to activate the augmented reality module, for example, wireless sensing. For example, the augmented reality module can be activated by Near Field Communication (NFC) or Radio Frequency Identification (RFID). Please refer to FIG. 8. FIG. 8 is another embodiment of the audio-visual interaction system 8. In another embodiment of the audio-visual interaction system 8, the sensor 801 of the smart phone 40 is adjacent to the RFID tag 802 on the card 402, and the sensor The 801 can inductively recognize the RFID tag 802 on the card 402, and then download the corresponding augmented reality module 51 from the cloud server 5. In the present embodiment, the RFID tag 802 on the card 402 corresponds to the identification mark 41.

The present invention is described above by way of example, but it is not intended to limit the patent claimed by the present invention. Benefit range. The scope of patent protection is subject to the scope of the patent application and its equivalent fields. Any changes or modifications made by those skilled in the art without departing from the spirit or scope of this patent are subject to the equivalent changes or designs made in the spirit of the present disclosure and should be included in the following patent claims. Inside.

2‧‧‧Video Interactive System

3‧‧‧Portable electronic devices

31‧‧‧ camera

32‧‧‧ Display screen

33‧‧‧Video Interactive App

331‧‧‧ Storage Module

332‧‧‧Operating module

333‧‧‧ Identification Module

4‧‧‧Operating vehicle

41‧‧‧ Identification marks

42‧‧‧ Reality pattern

5‧‧‧Cloud Server

51‧‧‧Augmented Reality Module

511‧‧‧Multimedia components

Claims (10)

An audio-visual interactive system includes: a portable electronic device, the portable electronic device includes a display screen, a camera, and an audio-visual interactive application, the audio-visual interactive application includes an operation module, an identification module, and a a storage module, an operation carrier, the operation carrier includes an identification mark and a real pattern, and the identification mark can be recognized by the identification module; a cloud server, the cloud server stores the corresponding An augmented reality module of the identification mark, the augmented reality module includes a multimedia component, and the augmented reality module is downloadable into a storage module of the audio-visual interactive application; wherein, the identification The module recognizes the identification mark, and the audio-visual interactive application checks whether the storage module stores the augmented reality module corresponding to the identification mark, and if the augmented reality module does not start, a downloading process is started. Downloading the augmented reality module from the cloud server to a storage module of the audio-visual interactive application; when the augmented reality module is activated, and the camera is aligned with the real-world map , The display screen of the portable electronic device may display the pattern and the reality of the multimedia element, the display element will interact with the pattern reality. The audio-visual interactive system of claim 1, wherein the identification mark is a two-dimensional bar code, and the portable electronic device reads the identification mark by the camera. The audio-visual interactive system of claim 1, wherein the operation module of the audio-visual interactive application comprises a download list page, a profile page, and a play button, the download list page listing the downloaded The name of the augmented reality module is listed. The profile page lists the basic data of the augmented reality module, and the play button is used to play the multimedia component of the augmented reality module. The video interactive system according to claim 3, wherein the operation module comprises a webpage connection key, and the webpage connection key is a website hyperlinked to the provider of the augmented reality module. The audio-visual interactive system of claim 1, wherein the identification module senses the identification symbol by means of wireless sensing. For example, the audio-visual interactive system described in claim 5, wherein the wireless sensing method uses a short-range wireless communication technology or a radio frequency identification system. The video interactive system of claim 1, wherein the operation carrier is a card, and the identification mark and the reality pattern are printed on different pages of the card. The video interactive system according to claim 1, wherein the multimedia component is a three-dimensional image or a video unit. The audio-visual interactive system of claim 1, wherein the portable electronic device is a smart phone or a tablet. An operation carrier is an audio-visual interactive system in accordance with claim 1 of the patent application scope, the operation carrier includes: an identification mark, the identification mark can be recognized by the image recognition module; a real-world pattern, The real pattern is a pattern or a text.