JP6593477B2 - Video content display device, glasses, video content processing system, and video content display program - Google Patents

Description

  The present invention relates to a video content display device, glasses, a video content processing system, and a video content display program.

Conventionally, content related to the playback position of audio data such as music data is displayed (for example, Patent Document 1).
Further, a technology called AR (Augmented Reality) that gives supplementary information by superimposing information created by a computer on information given to perception from an actual environment is disclosed (for example, Patent Document 2). ).

JP 2008-83297 A Japanese Patent No. 5158007

  In Patent Document 1 described above, the content is page content corresponding to the elapsed time from the start of reproduction of audio data. Further, Patent Document 2 has no cooperation with music.

  Therefore, an object of the present invention is to provide a video content display device, glasses, a video content processing system, and a video content display program that display video content linked to music.

The present invention solves the above problems by the following means.
The first invention includes a photographing unit, a display unit capable of displaying video content, sound data, a storage unit that stores preset recognition objects in association with each other, and a sound acquisition unit that acquires sound data. And an object determination for determining whether or not the captured image captured by the imaging unit includes the recognition object corresponding to the sound data being acquired while the sound acquisition unit is acquiring the sound data. And the video content associated with the recognition target object at a specific position specified from the recognition target object while corresponding to the reproduction position of the sound data while the captured image includes the recognition target object. And a display control unit that superimposes and displays on the display unit.
According to a second aspect of the present invention, in the video content display device according to the first aspect of the present invention, the distance between the sound output unit that outputs sound data and the specific position and the photographing position is calculated, and the position specified from the recognition target object And a sound control unit that controls output of the sound data to the sound output unit so that sound is generated.
According to a third aspect of the present invention, there is provided the video content display device according to the first or second aspect, wherein the display control unit is connected to a content server storing the video content via a communication network so as to be communicable. Is a video content display device that displays the video content downloaded in advance from the content server or sequentially acquired.
A fourth invention is a pair of glasses including any one of the video content display devices from the first invention to the third invention.
A fifth invention comprises any one of the video content display devices from the first invention to the third invention, and a content server communicatively connected to the video content display device via a communication network. The content server has a storage unit that stores sound data, a recognition object, and the video content in association with each other, and the storage unit of the video content display device downloads the content server from the content server A video content processing system characterized by storing sound data and the recognition object corresponding to the sound data.
A sixth invention is a video content display program for a computer, comprising: a photographing unit, a display unit capable of displaying video content, sound data, and a storage unit that stores preset recognition objects in association with each other. The sound acquisition means for acquiring sound data and the sound image being acquired by the imaging unit while the sound acquisition means is acquiring the sound data. A target determination unit that determines whether or not the corresponding recognition target object is included, and a video content associated with the recognition target object while the captured image includes the recognition target object. The video content display program is configured to function as display control means for displaying on the display unit in a superimposed manner at a specific position specified from the recognition object. It is a non.

  According to the present invention, it is possible to provide a video content display device, glasses, a video content processing system, and a video content display program that display video content linked to music.

It is a figure explaining the outline | summary of the spectacles which concern on 1st Embodiment. It is a figure which shows the functional block of the video content processing system which concerns on 1st Embodiment. It is a figure explaining the content data memorize | stored in the content data storage part which concerns on 1st Embodiment. It is a flowchart which shows the main process of the spectacles which concern on 1st Embodiment. It is a flowchart which shows the video content display process of the glasses which concerns on 1st Embodiment. It is a figure which shows the example of a display with the spectacles which concern on 1st Embodiment. It is a figure which shows the example which concerns on the mark which concerns on 2nd Embodiment, and a portable terminal.

DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. This is merely an example, and the technical scope of the present invention is not limited to this.
(First embodiment)
<Overall Configuration of Video Content Processing System 100>
FIG. 1 is a diagram illustrating an outline of the glasses 1 according to the first embodiment.
FIG. 2 is a functional block diagram of the video content processing system 100 according to the first embodiment.
FIG. 3 is a diagram illustrating content data stored in the content data storage unit 22 according to the first embodiment.

<Glasses 1>
The glasses 1 shown in FIG. 1 reproduce music and whether the stereoscopic video of the animation character is in front of the user wearing the glasses 1 as stereoscopic video content (video content) corresponding to the music being played back. It is a device that displays as follows.
The glasses 1 are permanently installed in a CD shop that sells CDs, DVDs, and the like, for example. In the glasses 1, for example, music whose sales are being strengthened at a CD shop is stored in the storage unit 20 (see FIG. 2) in advance.
The glasses 1 include a camera 31 (imaging unit), a transmissive display 32 (display unit), a speaker 33 (sound output unit), operation buttons 34 (34a to 34f), a communication I / F (interface) unit 39, and the like. . Moreover, the glasses 1 have a housing 30 on one side surface. The housing 30 includes the control unit 10 and the storage unit 20 shown in FIG.
The control unit 10 shown in FIG. 2 is a central processing unit (CPU) that controls the entire glasses 1. The control unit 10 executes various functions in cooperation with the hardware described above by appropriately reading and executing an operating system (OS) and various application programs stored in the storage unit 20.

The control unit 10 includes a sound acquisition unit 11, a sound control unit 12, an object determination unit 13, a content acquisition unit 14, a display control unit 15, and the like.
The sound acquisition unit 11 is a control unit that acquires music sound data.
The sound control unit 12 is a control unit that outputs music sound data to the speaker 33. The sound control unit 12 controls the volume of the speaker 33.
The target determination unit 13 includes an AR (Augmented Reality) code (recognition target) corresponding to the music in the image captured by the camera 31 while the sound acquisition unit 11 is acquiring the sound data of the music. It is a control part which judges whether it is.
The content acquisition unit 14 is a control unit that acquires a stereoscopic video of an animation character that is stored in the storage unit 20 and that corresponds to the AR code determined by the target determination unit 13.
The display control unit 15 is a control unit that displays a 3D image of an animation character corresponding to a music playback position at a specific position specified from the AR code, in front of the AR code.
Details of these functions and the AR code will be described later.

The storage unit 20 is a storage device such as a semiconductor memory element for storing programs, data, and the like necessary for the operation of the glasses 1.
Note that the computer in the present invention refers to an information processing apparatus including a control unit, a storage device, and the like, and the glasses 1 are an information processing apparatus including the control unit 10, the storage unit 20 and the like, and the computer of the present invention. Included in the concept.
The storage unit 20 stores a program storage unit 21, a content data storage unit 22, and the like.
The program storage unit 21 is a storage area capable of storing a plurality of application programs that cause the glasses 1 to execute various functions. The program storage unit 21 stores at least an AR program (video content display program) 21a.
The content data storage unit 22 is a storage area for storing content data in which music, an AR code, and a stereoscopic video of an animation character are associated with each other.

As shown in FIG. 3A, the content data associates the music with the stereoscopic video of the animation character via the AR code. For example, when the AR code is “B”, if the music is different even if the AR code is the same, the stereoscopic image of the corresponding animation character is also different.
The music includes music attribute data related to the title and author of the music, and in the case of a song, the name of the singer, sound data related to the actual sound, and the like. The sound data has a reproduction position indicating the reproduction time of the music.
The AR code is, for example, the shape of a stage in a CD shop. In addition, the AR code may be a shape of a CD jacket or the like, and has a preset shape.
A stereoscopic video of an animation character is, for example, a stereoscopic video of a character imitating an idol. A three-dimensional image of an animated character that behaves as if it is singing and dancing to the music moves as if singing and dancing in synchronization with the playback position of the sound data.

FIG. 3B is a diagram for explaining the reproduction position of the music “A1” and the stereoscopic video “a1” of the animation character. The music “A1” and the three-dimensional video “a1” of the animation character have the same playback time as the playback length. For example, when the music “A1” is playing back the sound data of the time of “1:02”, the stereoscopic video “a1” of the animation character plays the video of “1:02”.
FIG. 3C is a diagram for explaining the reproduction position of the music “B1” and the stereoscopic video “b1” of the animation character. The reproduction time of the animation character's stereoscopic video “b1” is shorter than the music “B1”. Therefore, in order to match the stereoscopic video “b1” of the animation character with the playback time of the music “B1”, the stereoscopic video “b1” of the animation character is repeated three times.

Returning to FIG. 1, the camera 31 is a device that is provided on the side of the transmissive display 32 and photographs the forward direction of the user. In other words, the camera 31 captures a field of view that the user sees in the through state via the transmissive display 32.
The transmissive display 32 is a display device provided in the lens portion of the glasses 1. As the transmissive display 32, for example, a liquid crystal panel is used, and can be made transparent or translucent by controlling the transmittance. The user can see the viewing area through the transmissive display 32 in a through state.
The speaker 33 is a device that outputs music sound data. The speaker 33 is provided at a position near the left and right ears of the user so that music can be heard with the user wearing the glasses 1.

The operation button 34 is provided on a vine portion on one side of the glasses 1. The operation button 34 is a button operated by the user's hand while the user wears the glasses 1. The operation buttons 34 include a power button 34a, a menu button 34b, a selection button 34c, an enter button 34d, a stop button 34e, a play / pause button 34f, and the like.
The power button 34 a is a button that supplies power to the glasses 1 and stops the power supplied to the glasses 1.
The menu button 34 b is a button for displaying a menu screen (not shown) on the transmissive display 32.
The selection button 34 c is a button for moving the cursor on the menu screen or the like displayed on the transmissive display 32.
The determination button 34d is a button for determining the contents of the cursor position on the menu screen or the like.
The stop button 34e is a button for stopping the reproduction of music.
The play / pause button 34f is a button for playing and pausing music.
A method of using these operation buttons 34 will be described later.

  The communication I / F unit 39 is an interface unit for performing communication with the content server 4 (FIG. 2) via the communication network N. The communication I / F unit 39 may include a connector unit for performing communication by wire, for example. Further, the communication I / F unit 39 may include an antenna unit for performing communication by radio. The glasses 1 may be capable of communicating by wire and wireless.

A video content processing system 100 shown in FIG. 2 is a system in which the above-described glasses 1 and a content server 4 are connected via a communication network N.
<Content server 4>
The content server 4 includes a control unit 40, a storage unit 45, a communication I / F unit 49, and the like.
The control unit 40 is a CPU that controls the entire content server 4. The control unit 40 executes various functions in cooperation with the hardware described above by appropriately reading and executing the OS and various application programs stored in the storage unit 45.
The storage unit 45 is a storage device such as a hard disk or a semiconductor memory element for storing programs, data, and the like necessary for executing the processing of the control unit 40.
The storage unit 45 includes a content database that stores content data in which music, an AR code, and a stereoscopic video of an animation character are associated with each other.
The communication I / F unit 49 is an interface unit for performing communication with the glasses 1 via the communication network N.
The communication network N is a network between the glasses 1 and the content server 4 and is a communication network such as an Internet line.

<Main processing>
Next, processing of the glasses 1 will be described.
FIG. 4 is a flowchart showing a main process of the glasses 1 according to the first embodiment.
In step S (hereinafter referred to as “S”) 1, when the user operates the power button 34 a of the glasses 1, power is supplied to the control unit 10 of the glasses 1.
In S <b> 2, when the user operates the menu button 34 b of the glasses 1, the control unit 10 displays a menu screen on the transmissive display 32. The menu screen is a screen on which items for downloading content data or starting the AR program 21a are displayed, for example.
Selection and determination on the menu screen are performed by a selection button 34c and a determination button 34d.

In S3, with the content data download selected, the user operates the determination button 34d of the glasses 1, whereby the control unit 10 determines whether or not the content data download has been accepted. When the download of the content data is accepted (S3: YES), the control unit 10 moves the process to S4. On the other hand, when download of content data is not received (S3: NO), the control part 10 moves a process to S5.
In S4, the control unit 10 performs content data download processing. After confirming that the control unit 10 can communicate with the content server 4 via the communication I / F unit 39, the control unit 10 downloads content data from the content server 4 and stores it in the content data storage unit 22. Since the amount of content data is large, it is desirable to download content data by narrowing down the target from the content data stored in the content server 4. Thereafter, the control unit 10 moves the process to S2.

In S5, when the activation of the AR program 21a is selected, the control unit 10 determines whether or not the activation of the AR program 21a is accepted when the user operates the determination button 34d of the glasses 1. . When the activation of the AR program 21a is received (S5: YES), the control unit 10 moves the process to S6. On the other hand, when the activation of the AR program 21a is not accepted (S5: NO), the control unit 10 moves the process to S7.
In S6, the control unit 10 performs a video content display process described later. Thereafter, the control unit 10 moves the process to S2.

In S7, when the user operates the power button 34a of the glasses 1 in a state where the power is turned on, the control unit 10 determines whether or not the power OFF is accepted. When the power OFF is received (S7: YES), the control unit 10 stops the power supply and ends the process. On the other hand, when the power OFF is not received (S7: NO), the control unit 10 moves the process to S2.
In the main process described here, the AR program 21a is the only program to be activated. However, a plurality of application programs stored in the program storage unit 21 may also be activated. In that case, processing corresponding to each application program is performed, but the description here is omitted.

<Video content display processing>
Next, video content display processing will be described.
FIG. 5 is a flowchart showing video content display processing of the glasses 1 according to the first embodiment.
FIG. 6 is a diagram illustrating a display example with the glasses according to the first embodiment.
In S10 of FIG. 5, the control unit 10 of the glasses 1 activates the AR program 21a. When the AR program 21a is activated, the control unit 10 displays the music attribute data of music stored in the content data storage unit 22 on the transparent display 32 as a music selection screen (not shown).
Here, for example, when the user selects certain music attribute data with the selection button 34c and operates the play / pause button 34f, the control unit 10 (sound control unit 12) corresponds to the music attribute data. Sound data is output from the speaker 33. The control unit 10 (sound acquisition unit 11) acquires sound data. As described above, when the user operates the play / pause button 34f, the control unit 10 turns off the music selection screen displayed on the transmissive display 32 so as not to display it. To do.

In S <b> 11, the control unit 10 activates the camera 31 and acquires a captured image.
In S12, music is being reproduced, and the control unit 10 (sound acquisition unit 11) determines whether or not sound data is acquired. As described above, when the user selects certain music attribute data displayed on the music selection screen with the selection button 34c and operates the play / pause button 34f, the control unit 10 (sound acquisition unit 11) Sound data is being acquired. On the other hand, even if the music selection screen is displayed, if the user does not perform an operation, the control unit 10 has not acquired sound data. When the sound data is acquired (S12: YES), the control unit 10 moves the process to S13. On the other hand, when the sound data is not acquired (S12: NO), the control unit 10 moves the process to S14.

  In S <b> 13, the control unit 10 (target determination unit 13) determines whether or not the captured image captured by the camera 31 includes an AR code corresponding to the music of the acquired sound data. This is because the control unit 10 (target determination unit 13) checks whether or not the captured image captured by the camera 31 has an AR code stored in the content data storage unit 22 and corresponding to the music of the sound data. Is done. In the AR code stored in the content data storage unit 22, the characteristics of the shape of the object are set in advance as the characteristics of the AR code. Then, the control unit 10 (target determination unit 13) can determine whether or not the photographed photographed image includes a subject having the characteristic. When the captured image includes an AR code corresponding to the music of the acquired sound data (S13: YES), the control unit 10 moves the process to S16. On the other hand, when the captured image does not include the AR code corresponding to the music of the acquired sound data (S13: NO), the control unit 10 moves the process to S18.

In S <b> 14, the control unit 10 (target determination unit 13) determines whether the captured image captured by the camera 31 includes the AR code stored in the content data storage unit 22. This is performed by the control unit 10 collating whether or not a photographed image photographed by the camera 31 has any of a plurality of AR codes stored in the content data storage unit 22. When the captured image includes the AR code stored in the content data storage unit 22 (S14: YES), the control unit 10 moves the process to S15. On the other hand, when the captured image does not include the AR code stored in the content data storage unit 22 (S14: NO), the process proceeds to S22.
When the photographed image includes two or more of the plurality of AR codes stored in the content data storage unit 22, the control unit 10 may select one of them.
In S <b> 15, the control unit 10 (sound control unit 12) outputs music sound data corresponding to the AR code included in the captured image to the speaker 33 after a predetermined time (for example, 10 seconds) has elapsed. . The control unit 10 (sound acquisition unit 11) acquires music sound data. 3A will be described as an example. When the AR code is “A”, the music “A1” can be specified. However, when the AR code is “B”, the corresponding music is “B1” to “B3”. In this case, for example, the control unit 10 may select one of the music from “B1” to “B3” and output the sound data.

  As described above, even when music is not being played back and sound data is not being acquired, if the AR 31 is included in the captured image captured by the camera 31, the control unit 10 determines that the AR The sound data of music corresponding to the chord can be automatically output, and as a result, the sound data can be acquired.

In S <b> 16, the control unit 10 (content acquisition unit 14) displays the stereoscopic video of the animation character on the transmissive display 32. The three-dimensional image of the animation character displayed on the transmissive display 32 is synchronized with the reproduction position of the corresponding music sound data. In addition, the stereoscopic video of the animation character is displayed in front of the AR code and superimposed on a specific position specified from the position of the AR code. This can be realized by a known technique (for example, JP 2013-84313 A).
In S <b> 17, the control unit 10 (sound control unit 12) outputs sound data to the speaker 33 provided near both ears of the user according to the direction of the stereoscopic image of the animation character displayed on the transmission display 32. Control the output. This is to calculate the distance between the specific position and the photographing position so that sound is generated from the position specified from the AR code. According to a known technique (for example, Japanese Patent No. 5197525). It is feasible.

<Specific example>
Here, FIG. 6 will be described as an example.
When the AR code is, for example, the shape of the stage 61 provided in the CD shop 60, the user views the stage 61 with the glasses 1 on, so that the character 62 that is a stereoscopic image of the animation character is displayed. Is displayed on the transmissive display 32.
Note that the character 62 is not displayed on the actual stage 61 (see FIG. 6A). Thereby, as shown in FIG. 6B, the user can see the character 62 as if singing and dancing on the stage 61 in accordance with the music.
When the character 62 is facing the front, as shown in FIG. 6B, when the user views the stage 61 from the front, the character 62 sings and dances facing the front. At this time, the control unit 10 (sound control unit 12) performs control to make the volume of the speakers 33 of the user's both ears the same.

On the other hand, when the user moves and the stage 61 is viewed from the diagonally right direction as shown in FIG. 6C, the character 62 sings and dances facing the left direction. At this time, the control unit 10 (sound control unit 12) performs control to make the volume of the speaker 33 of the user's left ear larger than the volume of the speaker 33 of the user's right ear. As a result, the user can feel as if sound is being output from the character 62.
When the user does not move and the character 62 changes direction, the control unit 10 (sound control unit 12) changes the volume of the speaker 33 according to the direction of the character 62. The user can see the character 62 whose direction has changed, and can listen to music having a volume corresponding to the direction.

Returning to FIG. 5, in S <b> 18, the control unit 10 determines whether or not the music has ended. The case where the music is finished means, for example, the case where the reproduction position of the sound data has reached the end, or the case where the user operates the stop button 34e. When the music ends (S18: YES), the control unit 10 moves the process to S21. On the other hand, if the music has not ended (S18: NO), the control unit 10 moves the process to S19.
In S19, the control unit 10 determines whether or not the music is temporarily stopped. The case where the music is paused means a case where the user operates the play / pause button 34f while the music is being played. If the music is paused (S19: YES), the control unit 10 moves the process to S20. On the other hand, when the music is not paused (S19: NO), the control unit 10 moves the process to S13.
In S <b> 20, the control unit 10 causes the transmissive display 32 to display a 3D image of the animation character corresponding to the reproduction position where the sound data is paused. That is, in the case of pause, the stereoscopic video of the animated character displayed on the transmissive display 32 is synchronized with the music playback position, so that there is no motion corresponding to the paused music playback position. Become an image. Thereafter, the control unit 10 moves the process to S19.
When the user further operates the play / pause button 34f to release the pause, the stereoscopic video of the animation character moves corresponding to the playback position of the music sound data ( When NO is selected in S19 and YES is selected in S13).

In S <b> 21, when the stereoscopic video of the animation character is displayed on the transmissive display 32, the control unit 10 deletes the stereoscopic video of the animation character. That is, the control unit 10 displays a stereoscopic image of the animation character corresponding to the sound data on the transmissive display 32 only during the reproduction of the sound data.
In S22, the control unit 10 determines whether or not to end the AR program 21a. If the AR program 21a is to be ended (S22: YES), the control unit 10 ends this process and returns to FIG. On the other hand, when the AR program 21a is not terminated (S22: NO), the control unit 10 moves the process to S12.

  In S18 and S19, the case where the music is finished or paused has been described as determining the operation of the stop button 34e or the play / pause button 34f, but the present invention is not limited to this. For example, when the control unit 10 detects that music is stopped, the control unit 10 causes the transmissive display 32 to display a stereoscopic image of the animation character corresponding to the stopped reproduction position. If the music is played before the predetermined time is exceeded, the control unit 10 detects the playback and moves the three-dimensional image of the animation character. If the music is not played after the predetermined time, the control unit 10 The stereoscopic video of the animation character may be erased from the transmissive display 32.

Thus, according to the first embodiment, the glasses 1 have the following effects.
(1) When an AR code corresponding to the music of the acquired sound data is included in the captured image acquired by the camera 31 while the sound data of the music is acquired, an animation character corresponding to the AR code Can be displayed on the transmissive display 32. When sound data is no longer acquired, the stereoscopic video of the animation character corresponding to the AR code displayed on the transmissive display 32 is erased and is not displayed. Therefore, a stereoscopic image of an animation character corresponding to music can be displayed on the transmissive display 32 only during music playback.
(2) Since the music and the stereoscopic video of the animation character correspond to the AR code, even if the AR code is the same, if the music is different, the stereoscopic video of the animation character displayed on the transmissive display 32 Can be different.

(3) Since the stereoscopic video of the animation character displayed on the transmissive display 32 corresponds to the playback position of the sound data, whether the stereoscopic video of the animation character is singing and dancing in accordance with the playback of the sound data. You can produce as follows.
(4) The sound volume output from the speaker 33 can be changed as if sound data is output from the stereoscopic video of the animation character.
(5) Since the 3D video of the animation character is arranged and displayed at a specific position corresponding to the AR code, for example, when the AR code has the shape of the stage, the 3D video of the animation character appears on the stage. Can be displayed as if singing and dancing.
(6) Even when music is not being played back, if the AR code stored in the content data storage unit 22 is present in the captured image taken by the camera 31, music corresponding to the AR code can be played back. Then, by reproducing the music, the stereoscopic image of the animation character corresponding to the AR code can be displayed on the transmissive display 32.

  (7) Even when music is being played back, if the captured image captured by the camera 31 does not include the AR code corresponding to the music, the stereoscopic video of the animation character is not displayed. When the user moves and the captured image captured by the camera 31 includes the AR code corresponding to the music, from that time, the stereoscopic video of the animation character corresponding to the reproduction position of the sound data is displayed. Displayed on the transmissive display 32. On the other hand, even when music is being played back and a stereoscopic image of an animation character is displayed on the transmissive display 32, the user moves and the captured image captured by the camera 31 is displayed on the AR image. When the code is not included, the displayed 3D image of the animation character is deleted and not displayed. By using such a mechanism, it is possible to provide a user with a treasure hunting method for displaying a stereoscopic image of an animated character.

(Second Embodiment)
2nd Embodiment demonstrates the case where a portable terminal is used instead of spectacles. In the following description, parts that perform the same functions as those in the first embodiment described above are given the same reference numerals or the same reference numerals at the end, and redundant descriptions are omitted as appropriate.
FIG. 7 is a diagram illustrating an example of the mark 261 and the mobile terminal 201 according to the second embodiment.

FIG. 7A shows a mark 261 (recognition target object). The mark 261 is one of AR codes stored in the content data storage unit. The mark 261 is an ax symbol in the example shown in FIG.
7B includes a touch panel display 232, a control unit, a storage unit, a camera, a speaker, and a communication I / F unit.
The touch panel display 232 has, for example, a function as a display unit configured by a liquid crystal panel or the like and a function as an operation unit that detects a touch input by a finger or the like from a user.
The touch panel display 232 displays a captured image captured by the camera.
FIG. 7B shows a case where the camera shoots the mark 261 in a state where the mobile terminal 201 activates the AR program, plays music corresponding to the mark 261, and acquires sound data. In this case, the touch panel display 232 displays a character 262 that is a stereoscopic image (video content) of an animation character corresponding to the music being played and the mark 261. The character 262 is arranged so as to overlap the front surface of the mark 261. The character 262 moves in the range 263 (specific position).

Thus, according to the second embodiment, there are the following effects.
Even if the touch panel display 232 does not have transparency, when a photographed image photographed by the camera is displayed and the mark 261 is included in the photographed image, the character 262 corresponding to the mark 261 is reproduced as music. Can be displayed in synchronization with the position. In addition, the character 262 can be displayed while the sound data of the music corresponding to the mark 261 is being acquired and the mark 261 is being photographed.

  As mentioned above, although embodiment of this invention was described, this invention is not limited to embodiment mentioned above. In addition, the effects described in the embodiments are merely the most preferable effects resulting from the present invention, and the effects of the present invention are not limited to those described in the embodiments. In addition, although embodiment mentioned above and the deformation | transformation form mentioned later can also be used in combination as appropriate, detailed description is abbreviate | omitted.

(Deformation)
(1) In the first embodiment, the spectacles 1 are described as including the transmissive display 32, but the present invention is not limited to this. Similarly to the mobile terminal 201 of the second embodiment, a captured image captured by the camera 31 may be displayed as a background, and a stereoscopic image of the animation character may be displayed in front of the captured image.
(2) In the first embodiment, the shape of the stage and the design of the ax in the second embodiment are described as AR codes, respectively, but the present invention is not limited to this. For example, in the case of a stereoscopic image of an animation character, the AR code may be the shape of the outline of the animation character. By doing so, when the AR code is displayed, it is possible to produce an effect that the stereoscopic video of the animation character is raised from the AR code and operated.
(3) Although the first embodiment has been described on the assumption that the glasses 1 are permanently installed in the CD shop, the present invention is not limited to this. It may be owned by the user.

(4) In each embodiment, although it demonstrated as what displays the stereo image of an animation character, it is not limited to this. It may be a stereoscopic video of an object that is not an animation character, or may be a two-dimensional video instead of a stereoscopic video.
(5) In each embodiment, although it demonstrated as reproducing music and acquiring sound data, it is not limited to this. For example, a microphone (sound collecting unit) is provided, an external sound is collected, and the music is identified by analyzing the sound. For example, similar music can be specified from the wavelength of sound. If a digital watermark is embedded in the sound, music can be specified from the digital watermark. By doing so, when the photographed photographed image includes the AR code corresponding to the specified music sound data, it is possible to display the music and the video content corresponding to the AR code. Therefore, it is possible to link music flowing in the city or a CD shop with video content using the AR code.
(6) In each embodiment, the video content has been described as being stored in advance in the storage unit 20 of each device (glasses 1, mobile terminal 201), but the present invention is not limited to this. For example, the video content may be acquired by sequentially receiving from the content server 4.
(7) Although each embodiment has been described as including one camera 31, the present invention is not limited to this. For example, in the glasses 1 of the first embodiment, a total of two may be provided on both sides of the transmissive display 32.

DESCRIPTION OF SYMBOLS 1 Glasses 4 Content server 10,40 Control part 11 Sound acquisition part 12 Sound control part 13 Target judgment part 14 Content acquisition part 15 Display control part 20,45 Storage part 21a AR program 22 Content data storage part 31 Camera 32 Transmission type display 33 Speaker 61 Stage 62, 262 Character 100 Video content processing system 201 Mobile terminal 232 Touch panel display 261 Mark

Claims (7)

A shooting section;
A display unit capable of displaying video content;
A storage unit that stores sound data and a preset recognition object in association with each other;
A sound acquisition unit for acquiring sound data;
An object determination unit that determines whether or not the captured image captured by the imaging unit includes the recognition object corresponding to the sound data being acquired by the sound acquisition unit;
While the captured image includes the recognition object, the video content associated with the recognition object is synchronized with the reproduction position of the sound data while being synchronized with a specific position specified from the recognition object. A display control unit that superimposes and displays on the display unit;
Providing
A video content display device characterized by the above. The video content display device according to claim 1,
The storage unit stores a plurality of sound data and video content corresponding to each sound data with respect to the one recognition target object,
While the display control unit includes the recognition object in the photographed image, the display control unit synchronizes video content associated with the recognition object and the sound data in correspondence with the reproduction position of the sound data, Superimposing on a specific position specified from the recognition object, and displaying on the display unit;
A video content display device characterized by the above. In the video content display device according to claim 1 or 2,
A sound output unit for outputting sound data;
A sound control unit that calculates a distance between the specific position and the shooting position, and controls output of the sound data to the sound output unit so that sound is generated from a position specified from the recognition object;
Providing
A video content display device characterized by the above. In the video content display device according to any one of claims 1 to 3,
The content server for storing the video content is communicably connected via a communication network,
The display control unit displays the video content downloaded in advance or sequentially obtained from the content server,
A video content display device characterized by the above.   Glasses comprising the video content display device according to any one of claims 1 to 4. A video content display device according to any one of claims 1 to 4,
A content server communicably connected to the video content display device via a communication network;
With
The content server includes a storage unit that stores sound data, a recognition object, and the video content in association with each other,
The storage unit of the video content display device stores the sound data downloaded from the content server and the recognition object corresponding to the sound data;
A video content processing system. A shooting section;
A display unit capable of displaying video content;
A storage unit that stores sound data and a preset recognition object in association with each other;
A video content display program for a computer comprising:
The computer,
Sound acquisition means for acquiring sound data;
Object determination means for determining whether or not the captured image captured by the imaging unit includes the recognition object corresponding to the sound data being acquired by the sound acquisition means;
While the captured image includes the recognition object, the video content associated with the recognition object is synchronized with the reproduction position of the sound data while being synchronized with a specific position specified from the recognition object. Display control means for superimposing and displaying on the display unit;
Make it work,
A video content display program characterized by the above.

Images