JP2013051686A - Video presentation apparatus, video presentation method, video presentation program, and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video presentation apparatus capable of facilitating user's grasp of correspondence between video and audio.SOLUTION: The video presentation apparatus includes a video display section that concurrently displays a plurality of videos; an arithmetic section that sets a position of virtual sound source at each of positions at which a plurality of videos are displayed and outputs, to a sound reproduction section, such audio signals as to reproduce states of occurring sounds from the virtual sound source in auditory or audiovisual sensation; and an operation input section that receives an operation input and outputs it to the arithmetic section.

Description

  The present invention relates to a technique for presenting video.

  In recent years, information has been distributed from various media to homes. For example, TV and radio image / audio broadcasts are distributed to homes through terrestrial broadcasts, communication satellite broadcasts, CATV cable networks, and the like.

  In addition, in recent years, digital broadcasting systems that digitize and transmit television signals in CS (communication satellite) broadcasting, CATV (cable TV), and the like have become widespread. In these systems, hundreds of channels can be secured by adopting digital compression / transmission technology. Therefore, it has become possible to provide more TV / radio (music) programs than ever before.

  In addition, with the advancement of digitalization of AV equipment, video / audio recorded as broadcast content by DVD (Digital Versatile Disk), DV (Digital Video), video / audio sources as package media such as digital cameras, digital video recorders, etc. There are many sources in the home.

  In addition, the number of routes through which video / audio information flows into homes will increase due to the digitization of broadcasting and the development of communication infrastructure.

  As described above, services that provide various types of video and audio information from various media are increasing, but the time that users can enjoy these services is limited. Therefore, recently, a multi-window playback function has been realized in which a plurality of windows are opened simultaneously on a large display, and different information sources are assigned to each window for playback.

  There has also been proposed a multi-window video search system that uses the multi-window display function to display a list of many videos at a time and search for content desired by the user. When a user is interested in another video while paying attention to a plurality of videos displayed as a list on the screen, the user can instantly check the contents of the video without switching the screen. By making use of such human visual processing capabilities, the user can confirm more search candidates at a time, and can efficiently find a program to be viewed.

  In the multi-window video search system, if the sound of the video content is output simultaneously with each video so that the user can recognize each sound, it is effective as auxiliary information for quickly confirming the video content. In view of this, a method has been proposed in which a plurality of videos and their sounds displayed by the multi-window function can be viewed simultaneously.

  Japanese Patent Application Laid-Open No. 2004-228561 describes a technique for simultaneously emitting sounds corresponding to a plurality of videos displayed on one screen from a speaker at a position corresponding to a video display position. As a result, the user can sensuously associate the video simultaneously displayed on the screen with the sound.

  Japanese Patent Application Laid-Open No. 2004-228561 describes a technique for adjusting the volume balance of audio signals to be added to left, center, and right speakers in accordance with the size and position of a window in which video is displayed. Thus, the user can sensibly recognize the correspondence between each voice synthesized by each speaker and the window based on the sound volume.

  Patent Document 3 listed below describes a technique for limiting the frequency band of a sub-screen audio signal to a narrow band similar to that of a telephone. As a result, the user can distinguish between the main screen sound and the sub screen sound based on the difference in sound quality.

JP-A-8-98102 JP 2000-69391 A Japanese Patent Laid-Open No. 9-322094

  In the technique described in Patent Document 1, the installation position of the speaker is fixed. Therefore, in order for the user to properly grasp the correspondence between video and audio, it is necessary to adjust the window display position, the number of audio channels to be output simultaneously, and the like according to the speaker installation position. That is, in the technique described in Patent Document 1, video and audio are easily restricted by the speaker installation position.

  In Patent Document 1, when two images are simultaneously displayed, the sound of the image displayed on the left screen is output from the speaker on the left side of the screen, and the sound of the image displayed on the right screen is displayed on the speaker on the right side of the screen. An example of output from is described. However, no specific method is described on how to divide the screen when simultaneously displaying three or more videos and which speaker corresponds to each video.

  In the technique described in Patent Document 2, the distance between the user and the left speaker and the distance between the user and the right speaker are approximately equal in order to appropriately grasp the correspondence between the video and audio in the window. The user needs to be located at the place. For example, when the user is located at a position extremely close to the right speaker, it is easy to feel as if the sound output from the right speaker is generated from nearby. Therefore, even if the window arrangement is equal to the left and right, only the right video sound is heard loudly, and the balance between the video and the sound is shifted.

  In Japanese Patent Laid-Open No. 2004-260260, it is possible to cope with a case where a single user is located in front of the screen due to the above situation, but it is difficult to cope with a situation where a plurality of users are lined up in front of the screen. there is a possibility.

  In the technique described in Patent Document 3, there is a possibility that the frequency band of the high information density area of the main screen sound overlaps the frequency band of the sub screen sound output after filtering. At this time, it becomes difficult for the user to distinguish between the two.

  That is, in Patent Document 3, depending on the combination of the main screen sound and the sub screen sound, it may be difficult for the user to associate the video and the sound. In Patent Document 3, as in Patent Document 1, a specific method is not described as to which speaker corresponds to each image when three or more images are simultaneously displayed.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a video presentation apparatus that allows a user to easily grasp the correspondence between video and audio.

  The video presentation apparatus according to the present invention sets a virtual sound source at a position where a video is displayed, and forms a sound field that simulates a state in which sound is generated from the virtual sound source.

  According to the video presentation apparatus according to the present invention, the position of the video on the screen matches the sound source position recognized by the user, so that the user can easily grasp the correspondence between the video and the audio.

2 is a functional block diagram of a video presentation device 100 according to Embodiment 1. FIG. 6 is a diagram illustrating a screen display example of a screen display unit 150. FIG. It is a figure which shows a mode that the audio | voice output part 160 is simulating the sound field which generate | occur | produces from the virtual sound source 161 using a wavefront synthesis technique. It is a figure which shows the example which set the depth direction position of the virtual sound source 161 in the back from the screen display part 150, ie, the side away from the user 200. FIG. 10 is a functional block diagram of a video presentation device 100 according to Embodiment 3. FIG. It is a figure which shows the detail of the button with which the remote control 180 is provided. It is a figure which shows the example of an initial screen of screen transition mode. It is a figure which shows the example of a screen transition in screen transition mode. It is a figure which shows the example of a screen transition in the selection mode in a screen. It is a figure which shows the example of a screen transition when a user presses the determination button 184 of the remote control 180 in the selection mode in a screen. It is an operation | movement flowchart of the video presentation apparatus 100 which concerns on Embodiment 3. FIG. It is a figure which shows the example which comprised the video presentation apparatus 100 of FIG. 1 as a television apparatus. It is a figure which shows the example which comprised the video presentation apparatus 100 of FIG. 1 as a television apparatus. It is a figure which shows the example which comprised the video presentation apparatus 100 of FIG. 1 as a television apparatus. It is a figure which shows the example which comprised the video presentation apparatus 100 of FIG. 1 as a video projection system. It is a figure which shows the example which comprised the video presentation apparatus 100 of FIG. 1 as a video projection system. It is a figure which shows the example which comprised the video presentation apparatus 100 of FIG. 1 as a system which consists of a television board and a television apparatus. 3 is a diagram illustrating a configuration example of an audio output unit 160. FIG.

<Embodiment 1>
FIG. 1 is a functional block diagram of a video presentation device 100 according to Embodiment 1 of the present invention. The video presentation device 100 is a device that reproduces and presents video information and audio information to a user, and includes an arithmetic processing unit 110, a content storage unit 120, a video signal reproduction unit 130, an audio signal reproduction unit 140, a screen display unit 150, An audio output unit 160 is provided.

  The arithmetic processing unit 110 controls the overall operation of the video presentation device 100. The arithmetic processing unit 110 controls the operations of the video signal reproduction unit 130 and the audio signal reproduction unit 140. The arithmetic processing unit 110 can be configured using an arithmetic device such as a CPU (Central Processing Unit). The operation of the arithmetic processing unit 110 can also be realized by separately providing a program describing the control operation and executing the program by the arithmetic device.

  The content storage unit 120 is a storage device that stores content data in which video information and audio information are recorded. The content storage unit 120 can be configured using a storage device such as an HDD (Hard Disk Drive). Content data can be obtained from various content sources such as television broadcast waves, storage media such as DVDs, video / audio signals output from video players and video tape recorders, and downloads from servers that distribute digital content via a network. It can be obtained. The video presentation device 100 appropriately includes an interface that receives content data from a content source as necessary.

  The video signal reproduction unit 130 reads content data from the content storage unit 120, generates video signals by decoding the video information, etc., performs processing such as video effects, and processes the video data into a predetermined screen layout. The video signal reproduction unit 130 outputs the video signal to the screen display unit 150 to display the screen.

  The audio signal playback unit 140 reads content data from the content storage unit 120, generates audio signals by decoding audio information, etc., applies audio effects as necessary, performs D / A conversion, and amplifies analog signals After that, the data is output to the audio output unit 160 and output as audio.

  The screen display unit 150 is a screen display device configured using, for example, a liquid crystal display device. The screen display unit 150 displays an image on the screen based on the video signal output from the video signal reproduction unit 130. The processing for driving the screen display unit 150 may be executed by the video signal reproduction unit 130 or the arithmetic processing unit 110.

  The audio output unit 160 is configured using one or more audio output devices (for example, speakers). In the first embodiment, a speaker array in which a plurality of speakers are arranged in a straight line is assumed, but the present invention is not limited to this. For convenience of explanation, it is assumed that the audio output unit 160 is installed below the screen display unit 150.

  FIG. 2 is a diagram illustrating a screen display example of the screen display unit 150. The video signal reproduction unit 130 reads one or more pieces of content data from the content storage unit 120 and generates a video signal that causes the video information to be displayed on a predetermined position on the screen display unit 150. Here, an example in which three pieces of video information are simultaneously displayed on the screen display unit 150 is shown. The user views three video contents on the screen display unit 150 at the same time.

  The audio output unit 160 individually reproduces the audio of each video content. At this time, it is desirable that the audio source and the position on the screen of each video match. This is because when they match, the user can easily associate the video with the audio and grasp the contents.

  The configuration of the video presentation device 100 has been described above. Next, a method for associating video and audio on the screen display unit 150 will be described together with a wavefront synthesis method using a speaker array.

<Embodiment 1: Speaker array>
Even in a hustle and bustle like a cocktail party, there is a phenomenon called the cocktail party effect, in which conversations of interested people can be heard naturally. As can be seen from the example of this effect, humans can simultaneously recognize a plurality of sounds by the difference in the position of the sound image (recognized sound image) or the difference in the sound itself.

  Consider that such human auditory ability is utilized in the video presentation apparatus 100. If each sound image can be localized at a plurality of video positions, the user can selectively hear the sound of a specific video.

  In order to distinguish a plurality of sounds naturally as in the cocktail party effect, it is desirable to make the sound field reproduced by the sound output unit 160 as close as possible to the original sound field. Therefore, a wavefront synthesis technique using a speaker array is applied to the audio output unit 160.

  The wavefront synthesis technique is to synthesize the wavefront of the sound field based on the sum of the wavefronts radiated from the speakers of the speaker array, assuming that there is a sound source behind the speaker array (virtual sound source). By using the wavefront synthesis technique, it is possible to reproduce the sense of direction and spread of the sound as if the real sound source actually exists at the position of the virtual sound source.

  FIG. 3 is a diagram illustrating a state in which the audio output unit 160 simulates the sound field generated from the virtual sound source 161 using the wavefront synthesis technique. Here, for simplicity of explanation, an example in which the screen display unit 150 displays a single video content on the screen is shown.

  FIG. 3A shows a screen display example of the screen display unit 150. Assume that the video signal reproduction unit 130 causes the screen display unit 150 to display one video content on the screen at a position slightly to the left of the screen. The user views the video content on the assumption that sound is generated from the position where the video content is displayed on the screen.

  FIG. 3B is a top view of the screen display unit 150 and the audio output unit 160 as viewed from above. The audio signal reproduction unit 140 assumes that there is a sound source at a position on the screen of the video content shown in FIG. 3A, and sets the virtual sound source 161 at that position. It is assumed that the user 200 is located in front of the screen display unit 150. Specifically, the arithmetic processing unit 110 acquires the position of the video display window on the screen (for example, the center coordinates of the window) from the video signal reproduction unit 130 and sets it as the position of the virtual sound source 161 in the audio signal reproduction unit 140. .

  When the virtual sound source 161 is at the position shown in FIG. 3B, the user 200 assumes that a sound wave surface as shown by a solid arc in FIG. 3B is formed. If this sound wave surface is reproduced by the wave surface synthesis technique, the user 200 has the illusion that the sound source is at the position of the virtual sound source 161, and can associate the on-screen position of the video content with the sound source position.

  In order to simulate the sound wave surface indicated by the solid arc in FIG. 3B, the audio signal reproducing unit 140 synthesizes the sound wave generated by each speaker as indicated by the dotted arc, and the synthesized wave becomes a solid arc. In this way, the sound output from each speaker may be controlled. Thereby, since the sound wave surface reaching the user 200 becomes like a solid arc, the sound field in which sound is generated from the virtual sound source 161 can be simulated.

  In this example, for the sake of convenience of explanation, the reproduction is performed by the wavefront synthesis reproduction method. However, in order to reproduce the wavefront within the actual audible frequency range, speakers must be arranged on the two-dimensional plane at intervals of 8.5 mm. It is not realistic. Therefore, a product using a speaker having a realistic aperture is on the market based on the idea of approximating a linear speaker array such as Wave Field Synthesis (WFS). In these implementation examples, the wavefront can be synthesized only in the low frequency band component, but such approximation can perceptively give an effect similar to the case where the wavefront is synthesized. The present invention also presupposes an approximate reproduction method by such an implementation.

  Also, from the perspective of auditory psychology, the clue to perceive a sound image is said to be the sound pressure difference and time difference of the sound entering both ears. As long as it is interpreted as a system that allows such sounds to be heard, any playback system may be used instead of a system that strictly synthesizes wavefronts as long as the playback system produces such an effect.

  Regardless of the reproduction method, the audio output unit 160 must know the position of each speaker during reproduction, but each speaker is normally installed and fixed, so that the speaker position can be known. Alternatively, the speaker can be moved, and the position of the speaker can be set automatically or by a user operation along with the movement.

  For convenience of explanation, FIG. 3 shows an example in which a sound wave surface is synthesized on a horizontal plane. This makes use of the fact that human hearing is generally less sensitive to vertical shifts than horizontal sound image and video shifts. Furthermore, a so-called ventricular effect is also used, in which when a sound image corresponding to the video is presented from a place different from the video position, the sound image is drawn to the video. If the horizontal position of the virtual sound source is reproduced from these perceptual effects, even if the sound image position in the vertical direction (the height of the sound image position) deviates from the image, the user makes sound from the image. I get the illusion. Therefore, it is sufficient if the speakers are arranged in a straight line in the horizontal direction at the upper or lower end of the screen and the sound is output so that there is no left-right shift between the video and the sound image.

  In this case, the virtual sound source position does not necessarily coincide with the video position, and may be positioned on or near a straight line extending in the vertical direction from the video position. The virtual sound source does not have to be positioned on or behind the screen, and may be positioned on or before or behind the speaker array, for example. However, of course, the sound wave surface may be synthesized also in the height direction.

  For example, it is assumed that the virtual sound source 161 is installed at a position in the height direction where the screen display unit 150 displays video content on the screen, and the sound output from each speaker is controlled. If necessary, a plurality of speaker arrays may be arranged in the height direction, and sound surface synthesis in the height direction may be performed.

  As normal video content, not only monaural audio but also stereo (2ch), surround sound (5.1ch), etc. are widely spread. In the method of the present invention, in order to reproduce the content having these multi-channel audio signals in association with one virtual sound source, it is necessary to downmix to monaural audio. The downmix method may be performed by a method usually used for televisions. Or, with regard to surround sound, there are many reverberation components in the rear channel audio signal, and it may be difficult to localize the sound image in the normal downmix method. For example, only the front three channels (FR, FC, FL) May be used, added and divided by 3, etc.

  Even when the screen display unit 150 displays a plurality of video contents at the same time, the virtual sound source 161 of each video content is individually set by the same method as in FIG. 3, and the position on the screen of each video content and the position of the virtual sound source 161 It is possible to simulate a sound field corresponding to. Thereby, the user can easily grasp the correspondence between the position of the virtual sound source 161 and the position on the screen of each video content.

  In the first embodiment, for the sake of simplicity, the audio signal reproduction unit 140 has been described as determining the position of the virtual sound source 161. However, the arithmetic processing unit 110 may perform arithmetic processing and the like for that purpose. The same applies to the following embodiments.

<Embodiment 1: Summary>
As described above, the video presentation device 100 according to the first embodiment sets the position of the virtual sound source 161 at the position where the screen display unit 150 displays the video, and the sound is generated from the virtual sound source 161. Let the audio output unit 160 simulate the assumed sound field. As a result, the user can easily associate the video position on the screen display unit 150 with the audio heard from the audio output unit 160.

  In addition, according to the video presentation device 100 according to the first embodiment, the user can select the desired video content while associating the video with the audio regardless of the layout of the video content displayed on the screen by the screen display unit 150. Video content can be easily identified. This makes it possible to quickly find desired video content in an arbitrary screen layout.

  This effect is effective in a multi-user environment where the screen layout is different for each user. That is, when each user customizes the screen layout, it is difficult to associate the video position with the sound source position, since which video content is individually displayed on which part of the screen is different. According to the first embodiment, the virtual sound source position and the video display position can be associated with a high degree of freedom, so that the video and audio can be flexibly associated regardless of the screen layout. it can.

<Embodiment 2>
In the first embodiment, it is assumed that the virtual sound source 161 is arranged along the screen display unit 150, but the position of the virtual sound source can be arbitrarily set. For example, the virtual sound source 161 can be arranged on the side farther from the user than the screen display unit 150. In Embodiment 2 of the present invention, one example will be described. The configuration of the video presentation device 100 is the same as that described in the first embodiment.

  FIG. 4 is a diagram illustrating an example in which the depth direction position of the virtual sound source 161 is set behind the screen display unit 150, that is, on the side away from the user 200. For comparison, an example in which the virtual sound source 161 is arranged as in FIG. 3 is also shown in FIG.

  In FIG. 4B, the screen display unit 150 displays three video contents simultaneously on the screen. The position and size of the video content 151 are the same as those in FIG. The other two video contents 152 and 153 are arranged on the right side toward the screen display unit 150. The screen size of the video content 152 is smaller than the video content 151, and the screen size of the video content 153 is even smaller.

  The user generally assumes that the volume of a small image is small. The audio signal reproduction unit 140 reflects this in the position of the virtual sound source and sets the position of the virtual sound source of each video content.

  In FIG. 4, the position of the virtual sound source 162 of the video content 152 is set behind the position of the virtual sound source 161. This reflects that the screen size of the video content 152 is smaller than the screen size of the video content 151, and the virtual sound source 162 is arranged farther from the user 200 than the virtual sound source 161. The position of the virtual sound source 163 of the video content 153 is set further to the back.

  The relationship between the display size of the video content and the depth of the virtual sound source is such that the depth of the content displayed on the screen (video content 151 in FIG. 4) is 0, and the video content screen as viewed from the user Corresponding to the size, the relative depths of the video contents 152 and 153 are calculated. The calculated depth information of the virtual sound source is output from the video reproduction unit 130 to the arithmetic processing unit at the same time as the position of the virtual sound source on the screen (the center position of the display window), and is set in the audio information reproduction unit 140. The

  The method of setting the position of the virtual sound source in the depth direction is a reproduction method that uses the concept of the virtual sound source, and the method of reproducing the position of the virtual sound source in the depth direction is generally defined. It depends on the method. Usually, for example, the volume is adjusted, the phase of the sound wave surface is adjusted, and the like.

<Embodiment 2: Summary>
As described above, the video presentation device 100 according to the second embodiment sets the depth direction position of the virtual sound source corresponding to the video according to the size of the video displayed on the screen by the screen display unit 150. As a result, the correspondence between the screen size of the video and the audio can be easily grasped, so that the user can immediately understand which audio corresponds to which video.

<Embodiment 3>
In Embodiment 3 of the present invention, an operation example in which the screen displayed by the screen display unit 150 is scrolled or moved to switch the video content to be displayed will be described. In addition, a remote controller is taken up as an example of an operation device for the user to instruct the video presentation apparatus 100 to switch the screen.

  FIG. 5 is a functional block diagram of the video presentation device 100 according to the third embodiment. The video presentation apparatus 100 according to the third embodiment includes an operation input unit 170 and a remote controller 180 in addition to the configurations described in the first and second embodiments. The items other than the items related to the operation input unit 170 and the remote controller 180 are the same as those in the first and second embodiments.

  The remote controller 180 is an operation device that gives an operation instruction to the video presentation device 100 by the user. Details of the remote controller 180 will be described later with reference to FIG. The operation input unit 170 receives an operation signal transmitted from the remote controller 180 and outputs the operation instruction content to the arithmetic processing unit 110.

  FIG. 6 is a diagram illustrating details of buttons provided in the remote controller 180. The remote controller 180 includes a search mode button 181, a search mode end button 182, a direction instruction button 183, an enter button 184, and a return button 185 in addition to the power button, channel button, and volume button.

  The video presentation device 100 fixes a screen transition mode for switching the video content displayed on the screen display unit 150 in accordance with an operation instruction input by the user using the remote controller 180 and any video content by fixing the video content displayed on the screen. Switch to the in-screen selection mode. Further, the screen display unit 150 switches the video content displayed on the screen. Below, the example of operation and the example of a screen transition are demonstrated.

  FIG. 7 is a diagram illustrating an example of an initial screen in the screen transition mode. When the user presses the search button 181 of the remote controller 180, the operation input unit 170 receives an operation signal to that effect and outputs it to the arithmetic processing unit 110. The arithmetic processing unit 110 switches the operation mode of the video presentation device 100 to the screen transition mode.

  The arithmetic processing unit 110 reads content data (for example, the newest content data) to be displayed on the initial screen in the screen transition mode from the content storage unit 120 according to a predetermined rule, decodes video information and audio information, etc. A signal and an audio signal are generated and output from the screen display unit 150 and the audio output unit 160, respectively. Since the process regarding the virtual sound source is the same as in the first and second embodiments, the description thereof is omitted. The same applies hereinafter.

  The layout of each video content when the screen display unit 150 displays the video content on the screen follows a predetermined rule. Here, the time when video content was acquired (eg, recorded) in the horizontal axis direction of the screen, the broadcast channel of the video content was assigned in the vertical axis direction of the screen, and both attributes of each video content were made to correspond on the two-dimensional plane. The example shown above is shown.

  FIG. 8 is a diagram illustrating an example of screen transition in the screen transition mode. Hereinafter, the screen transition shown in FIG. 8 will be described.

  FIG. 8A is a diagram illustrating an example of a screen after the user presses the left direction button following FIG. The left direction in FIG. 8 is a direction in which the recording time is toward the old side. Therefore, when receiving the operation signal in the left direction from the remote controller 180, the arithmetic processing unit 110 reads content data with the same channel and an older recording time from the content storage unit 120, and displays it on the screen display unit 150 in the same procedure as in FIG. Display on the screen. The number of content data to be newly read is appropriately determined according to the screen size of the screen display unit 150, or the arithmetic processing unit 110 determines an appropriate value each time.

  FIG. 8B is a diagram showing an example of a screen after the user presses the upward button following FIG. 8A. The upward direction in FIG. 8 is the direction toward the channel number increasing side. Therefore, upon receiving an upward operation signal from the remote controller 180, the arithmetic processing unit 110 reads content data having the same recording time zone and a large channel number from the content storage unit 120, and the screen display unit 150 in the same procedure as in FIG. Display on the screen.

  FIG. 8C is a diagram showing an example of a screen after the user presses the left button following FIG. 8B. The operation procedure is the same as in FIG.

  FIG. 9 is a diagram illustrating an example of screen transition in the in-screen selection mode. When the user presses the enter button 184 of the remote controller 180 in the screen transition mode, the operation input unit 170 receives an operation signal to that effect and outputs it to the arithmetic processing unit 110. The arithmetic processing unit 110 switches the operation mode of the video presentation device 100 to the in-screen selection mode.

  FIG. 9A is a diagram illustrating an example of an initial screen in the in-screen selection mode. In the initial screen of the in-screen selection mode, the video signal reproduction unit 130 highlights, for example, the video content closest to the screen center among the video content displayed on the screen by the screen display unit 150 in the previous screen transition mode. Apply video effects. Thus, the user can easily grasp which video content is currently selected on the screen.

  FIG. 9B is a diagram illustrating a screen example after the user presses the down button following FIG. 9A. Arithmetic processing unit 110 receives a downward operation instruction signal from remote controller 180 via operation input unit 170. The arithmetic processing unit 110 instructs the video signal reproduction unit 130 to highlight the video content displayed on the screen below the video content currently highlighted. The video signal reproduction unit 130 highlights the video content according to the instruction. When there are a plurality of video contents below, for example, highlights are made in order from the left video content toward the screen.

  FIG. 9C is a diagram illustrating an example of a screen after the user presses the down button following FIG. 9B. The operation procedure is the same as in FIG.

  FIG. 10 is a diagram showing an example of screen transition when the user presses the enter button 184 of the remote control 180 in the in-screen selection mode.

  When the arithmetic processing unit 110 receives the operation signal of the determination button 184 from the remote control 180 in the in-screen selection mode, the arithmetic processing unit 110 instructs the video signal reproduction unit 130 to display the video content highlighted at that time in full screen. The video signal reproduction unit 130 displays the video content on the screen display unit 150 in the full screen mode in accordance with the instruction.

  The arithmetic processing unit 110 sets the position of the virtual sound source of the video content at the center of the screen display unit 150 as the video content is switched to the full screen mode. Since the screen size of the video content is increased by the full screen, the depth direction position of the virtual sound source may be adjusted accordingly.

  FIG. 11 is an operation flowchart of the video presentation apparatus 100 according to the third embodiment. Hereinafter, each step of FIG. 11 will be described.

(FIG. 11: Step S1100)
When the video presentation device 100 is powered on, the arithmetic processing unit 110 starts the operation flow after appropriately executing initialization processing by reading a control program from the memory or the like.

(FIG. 11: Step S1101)
The arithmetic processing unit 110 displays an initial screen on the screen display unit 150. For example, the content data name and window position of the video content displayed on the screen by the screen display unit 150 when the power was turned off last time are stored in the memory when the power is turned off, and read again when the power is turned on. Thereby, the screen state when the power was last turned off can be reproduced.

(FIG. 11: Step S1102)
Arithmetic processor 110 waits for an operation signal from remote controller 180. When the arithmetic processing unit 110 receives an operation signal from the operation input unit 170, the operation processing unit 110 proceeds to step S <b> 1103 and repeats this step until the operation signal is received and waits for the operation signal.

(FIG. 11: Step S1103)
The arithmetic processing unit 110 determines whether or not the operation signal received from the remote controller 180 is an operation instruction for causing the screen display unit 150 to perform full screen display. Specifically, if the current screen mode is the in-screen selection mode described in FIG. 9 and the pressed button is the decision button 184, an operation for instructing to display the video content selected by the user in full screen. It turns out that it is an instruction. If it is a full screen instruction, the process proceeds to step S1107. Otherwise, the process proceeds to step S1104.

(FIG. 11: Step S1104)
The arithmetic processing unit 110 determines which screen mode the operation signal received from the remote controller 180 indicates. If it is an operation signal for instructing an in-screen search mode, the process proceeds to step S1105, and if it is an operation signal for instructing a screen transition mode, the process proceeds to step S1106.

(FIG. 11: Step S1104: Supplement)
If the pressed button is the search button 181, the arithmetic processing unit 110 determines that the instruction is to shift to the screen transition mode. Alternatively, when the return button 185 is pressed when the current screen mode is the in-screen selection mode, it is determined that the instruction is to shift to the screen transition mode. If the current screen mode is the screen transition mode and the pressed button is the decision button 184, it is determined that the instruction is to shift to the in-screen selection mode.

(FIG. 11: Step S1105)
The arithmetic processing unit 110 executes the in-screen search mode described with reference to FIG.

(FIG. 11: Step S1106)
The arithmetic processing unit 110 executes the screen transition mode described with reference to FIG.

(FIG. 11: Step S1107)
The arithmetic processing unit 110 executes the full screen display mode described with reference to FIG.

(FIG. 11: Step S1108)
The arithmetic processing unit 110 ends the operation flow when the operation of the video presentation device 100 is ended, and returns to step S1102 to repeat the same processing when the operation is continued.

  The operation of the video presentation device 100 according to the third embodiment has been described above. In the third embodiment, the remote controller 180 is exemplified as the operation device, but other operation devices may be used. For example, an operation button similar to that of the remote controller 180 may be provided on the main body housing of the video presentation device 100.

<Embodiment 3: Summary>
As described above, the video presentation device 100 according to the third embodiment switches the video content to be displayed on the screen display unit 150 when the direction instruction button 183 is pressed while the screen transition mode is being executed. The video signal reproduction unit 130 is instructed. Thus, the user can visually search for desired video content while simultaneously displaying a plurality of video content on the screen. In addition, the desired content can be audibly identified by associating video and audio by the effect of the virtual sound source.

  In addition, the video presentation device 100 according to the third embodiment fixes a screen transition mode for switching video content to be displayed simultaneously on the screen in accordance with a direction operation instruction from the remote controller 180 and a video content to be displayed on the screen. Switch to the in-screen selection mode for selecting the video content. Thereby, in the screen transition mode, a plurality of video contents can be displayed on the screen, a desired video content can be roughly searched, and the video content can be determined in the in-screen selection mode. In particular, in the screen transition mode, it is possible to search for desired video content while associating video and audio, so that the effect as a video content search device can also be exhibited.

<Embodiment 4>
In the fourth embodiment of the present invention, a mounting example of the first to third embodiments will be briefly described. The present invention can be used for any apparatus as long as the apparatus is accompanied by an image. Various examples of apparatuses to which the present invention can be applied will be described with reference to FIGS.

  12 to 14 are diagrams showing examples in which the video presentation device 100 in FIG. 1 is configured as a television device. FIGS. 15 and 16 are diagrams showing examples in which the video presentation device 100 of FIG. 1 is configured as a video projection system. FIG. 17 is a diagram illustrating an example in which the video presentation device 100 of FIG. 1 is configured as a system including a television board and a television device. In any of FIGS. 12 to 17, an example in which ten speakers are arranged as a speaker array is described, but the number of speakers may be plural.

  When the video presentation device 100 according to the present invention is implemented by a television device, the arrangement of the audio output unit in the television device may be freely determined. As in the television device shown in FIG. 12, a speaker array in which speakers in the audio output unit are arranged in a straight line may be provided below the television screen. As in the television device shown in FIG. 13, a speaker array in which speakers in the audio output unit are arranged in a straight line may be provided above the television screen. As in the television apparatus shown in FIG. 14, a speaker group in which transparent film type speakers in the audio output unit are arranged in a straight line may be embedded in the television screen.

  The video presentation apparatus 100 according to the present invention can be used for a video projection system. As in the video projection system shown in FIG. 15, a speaker array may be embedded in a projection screen that projects video with a video projection device. As in the video projection system shown in FIG. 16, a speaker array may be arranged behind a sound transmission type screen for projecting video with a video projection device.

  In addition, the video presentation device 100 according to the present invention can be mounted by a television device and a television stand (television board). As in the system shown in FIG. 17 (home theater system), a speaker array in which speakers are arranged on a television stand for mounting a television device may be embedded.

  In addition, when the video presentation processing according to the present invention is applied to the devices described with reference to FIGS. 12 to 17, the user can use the wavefront synthesis reproduction processing (the arithmetic processing unit 110 and the audio signal reproduction unit 140 in FIG. 1). It is also possible to provide a switching unit that switches whether or not to perform the process (2) by a user operation performed by a button operation or a remote controller operation provided in the apparatus main body. For example, when only one image is displayed on the screen and the wavefront synthesis reproduction process is not performed, for reproduction of 2ch audio data, a virtual sound source is arranged as shown in FIG. May be.

  FIG. 18 is a diagram illustrating a configuration example of the audio output unit 160. As shown in FIG. 18, the audio output unit 160 may reproduce sound by performing wavefront synthesis using only the both-end speakers 1601L and 1601R of the array speaker 1601. The 5.1ch audio data may be similarly reproduced by wavefront synthesis, or may be reproduced by only the front three channels using only the central speaker 1601C and the two speakers 1601L and 1601R on both sides.

<Embodiment 5>
Programs for realizing the functions of the arithmetic processing unit 110, the video signal playback unit 130, and the audio signal playback unit 140 of the video presentation device 100 described in the first to fourth embodiments are recorded in a computer-readable storage medium. Then, the processing of each functional unit may be realized by causing the computer system to read and execute the program recorded in the storage medium. Here, the “computer system” includes hardware such as an OS (Operating System) and peripheral devices.

  Further, the program may be for realizing a part of the functions described above, and may be capable of realizing the functions described above in combination with a program already recorded in the computer system. .

  In addition, the “storage medium” storing the above-mentioned program includes a computer-readable portable medium such as a flexible disk, a magneto-optical disk, a ROM (Read Only Memory), a CD-ROM, and a hard disk built in the computer system. A storage device. Furthermore, a program that dynamically holds a program for a short time, such as a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line, and a server or client in that case Such a volatile memory inside a computer system as described above includes a program that holds a program for a certain period of time.

  DESCRIPTION OF SYMBOLS 100: Video | video presentation apparatus, 110: Arithmetic processing part, 120: Content memory | storage part, 130: Video signal reproduction | regeneration part, 140: Audio | voice signal reproduction | regeneration part, 150: Screen display part, 151-153: Video content, 160: Audio | voice output part 1601: Array speaker, 1601L, 1601R: Speakers at both ends, 1601C: Center speaker, 161-163: Virtual sound source, 170: Operation input unit, 180: Remote control, 181: Search mode button, 182: Search mode end button, 183: Direction instruction button, 184: determination button, 185: return button, 200: user.

Claims (8)

A video presentation device for presenting video,
A video playback unit for playing back video information and outputting a video signal;
An audio reproduction unit that reproduces audio information and outputs an audio signal;
A screen display unit for displaying video on the screen using the video signal output by the video playback unit;
An audio output unit that outputs audio using an audio signal output by the audio reproduction unit;
A calculation unit for controlling operations of the video reproduction unit and the audio reproduction unit;
An operation input unit that receives an operation input and outputs the operation input to the calculation unit;
With
The screen display unit displays a plurality of the images at the same time,
The computing unit is
Setting the position of the virtual sound source of the video on the screen display unit at each position where the screen display unit is displaying a plurality of the videos;
Causing the audio reproduction unit to output the audio signal such that the state in which the sound is generated from the virtual sound source is reproduced auditorially or audiovisually;
When an operation input indicating that the screen display unit should switch the video displayed on the screen at the same time is received from the operation input unit, the video reproduction unit reproduces the video information corresponding to the switched video, and the switching The video presenting apparatus, wherein the video is displayed on the screen display unit using the video signal corresponding to a later video.   The video presentation apparatus according to claim 1, wherein the audio reproduction unit converts the audio information into a monaural signal. The calculation unit sets a depth direction position of the virtual sound source with respect to a display surface of the screen display unit according to a size of the screen display unit displaying the video. Or the video presentation apparatus of 2. The computing unit is
When receiving an operation input from the operation input unit that the screen display unit should switch the video displayed on the screen at the same time,
Causing the video playback unit to play back the video information corresponding to the video after the switching,
4. The video presentation apparatus according to claim 1, wherein the video is displayed on the screen display unit using the video signal corresponding to the video after switching. 5. The operation input unit includes:
A screen transition mode for switching the video that the screen display unit displays on the screen at the same time;
In-screen selection mode for selecting one of a plurality of videos displayed in the screen by fixing the video displayed on the screen by the screen display unit at the same time;
Receive screen mode switching operation input
The computing unit is
When the screen mode switching operation input is received from the operation input unit, the screen display unit is switched to a mode specified by the screen mode switching operation input,
When the operation input indicating that the video to be displayed on the screen is simultaneously switched is received from the operation input unit while the screen transition mode is being executed, the video information corresponding to the video after the switching is received. And the video playback unit to display the video on the screen display unit using the video signal corresponding to the video after switching,
When an operation input for selecting one of a plurality of videos displayed on the screen of the screen display unit is received from the operation input unit while the in-screen selection mode is being executed, the video is fully displayed. The video presentation apparatus according to claim 1, wherein the video display device displays the screen and sets the position of the virtual sound source at the center of the screen display unit. A video playback unit for playing back video information and outputting a video signal;
An audio reproduction unit that reproduces audio information and outputs an audio signal;
A screen display unit for displaying video on the screen using the video signal output by the video playback unit;
An audio output unit that outputs audio using an audio signal output by the audio reproduction unit;
A method for presenting a video using a video presentation device comprising:
Causing the screen display unit to simultaneously display a plurality of the images;
Setting the position of the virtual sound source of the video on the screen display unit at each position where the screen display unit displays a plurality of the videos;
Outputting the audio signal such that the audio output unit forms a sound field simulating a state in which the audio is generated from the virtual sound source;
When the screen display unit receives an operation input indicating that the video to be displayed on the screen should be switched at the same time, the video reproduction unit reproduces the video information corresponding to the video after the switching, and supports the video after the switching. Using the video signal to display the video on the screen display unit;
A video presentation method characterized by comprising:   A video presentation program causing a computer to execute the video presentation method according to claim 6.   8. A computer-readable storage medium storing the video presentation program according to claim 7.

Images