JP2012244343A - Multi-image reproduction device and multi-image reproduction method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a multi-image reproduction device, which simultaneously displays and reproduces plural images on a screen, to efficiently perform extraction and layout display on the screen, of plural correlated images by a simple operation.SOLUTION: In reproduction of plural image contents, when a user designates a layout template 107 which defines relative conditions of photographic information among plural images to be displayed simultaneously, a multi-image reproduction control circuit 102 automatically extracts image contents 103 meeting the relative conditions and performs layout display on a display 109 on the plural extracted image contents 103 in a screen layout according to the layout template 107. This allows for multi-image reproduction in the screen layout according to user's intention without compelling the user to do complicated editing work.

Description

  The present invention relates to a video playback apparatus that displays and plays back a plurality of video content simultaneously on a screen, and more particularly to a screen layout process using shooting information.

  In recent years, high definition video playback equipment represented by digital television has been developed. With high definition, it is expected that not only high-resolution video playback will be enjoyed, but also a usage method for simultaneously displaying and playing back a plurality of videos on one screen is expected.

  In addition, photographing apparatuses such as digital video cameras, mobile phones having a moving image photographing function, and smartphones are widespread, and the situation where the same scene is photographed using a plurality of photographing apparatuses is increasing. Furthermore, in shooting with a digital device, even if shooting fails, it is only necessary to delete the shooting data, and therefore, a plurality of shootings are often performed continuously for one scene.

  When viewing a large number of captured videos, a method of extracting related videos and efficiently viewing them together is desired by many users. Displaying and playing multiple related videos simultaneously on a single screen allows for efficient viewing and enjoyment that cannot be obtained by single viewing, but users themselves extract relevant videos. In order to determine the screen layout when viewing a plurality of videos at the same time, a complicated editing operation is required, and thus a multi-video playback technique by a simple operation for the user is required.

  As a conventional technique related to image layout, for example, Patent Document 1 discloses a layout editing system using image photographing information. This layout editing system is efficient by determining image attribute information for each page template of an album when determining a photo layout at the time of creating an album, and selecting only images with matching attribute information. Layout editing is realized.

JP 2006-277065 A

  However, in the conventional configuration, the image attribute information used when narrowing down the selected image is considered only when it matches a single information, and the relative relationship of the attribute information with respect to a plurality of images laid out at the same time Is not considered at all.

  In addition, an operation for selecting an image from the extracted image group needs to be performed by the user himself, and does not include a technique for automatically determining a layout by extracting an image that satisfies the attribute information conditions. .

  Furthermore, this is a technique for determining a layout by assigning an image to a predetermined position of a page template, and does not include a technique for changing the layout according to conditions such as the size of the extracted image.

  The present invention solves the above-described conventional problems, and its purpose is to perform complicated editing for a user by automating using shooting information held by video content when determining a screen layout. An object of the present invention is to provide a multi-video playback apparatus capable of realizing multi-video playback with a screen layout that matches a user's intention without forcing work.

  In order to achieve the above object, a multi-video playback apparatus according to claim 1 is a video playback apparatus that displays and plays back a plurality of video contents at the same time, and holds the video contents as information at the time of shooting. Shooting information search means for searching for video content holding the shooting information, video content acquisition means for acquiring video content, layout information management means for managing layout templates, A multi-playback control unit that controls playback of video content at the same time; and a display unit that displays a plurality of video content at the same time, wherein the multi-playback control unit includes the shooting information search unit, the video content acquisition unit, and layout information management And the multi-playback control means to control the record having layout information designated by the user. Based on an out template, a plurality of video contents holding shooting information satisfying a relative condition with a video content specified by the user are acquired, and the acquired plurality of video contents are displayed in a screen layout according to the layout template. It is characterized by being played back simultaneously.

  With this configuration, in the present invention, a user who wants to enjoy multi-playback only specifies a layout template in which the relative conditions of shooting information between a plurality of videos to be displayed at the same time are specified when playing back video content. Video content that satisfies the conditions is automatically extracted, and the extracted video content is displayed in a layout according to the layout template. This makes it possible to realize multi-video playback without complicated editing work. it can.

  As described above, according to the multi-video playback device of the present invention, the related video can be automatically selected only by selecting a layout template according to the video to be played back without forcing the user to perform complicated editing work. It is possible to realize multi-video playback with a screen layout that matches the user's intention.

It is a figure which shows an example of a structure of the whole system in embodiment of this invention. It is a figure which shows an example of the data hold | maintained as imaging | photography information in the embodiment. It is a figure which shows an example of the data hold | maintained as a layout template in the embodiment. It is a flowchart figure which shows the image | video reproduction | regeneration operation | movement in the embodiment. It is a flowchart figure which shows the image | video reproduction | regeneration operation | movement in the modification of this embodiment. It is a figure which shows typically an example in the case of changing the comparison object in the modification. It is a figure which shows typically an example in the case of changing the image | video position in the modification. It is a figure which shows typically an example in the case of switching the video content in the modification.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing an example of the overall system configuration of a multi-video playback apparatus in an embodiment of the present invention.

  In the figure, a multi-video playback apparatus 101 is a video playback apparatus that simultaneously displays and plays back a plurality of video contents on a screen, and realizes a screen layout function using shooting information.

  The multi-video playback apparatus 101 includes a multi-play control circuit (multi-play control unit) 102 that controls playback of a plurality of videos simultaneously, and a video content acquisition circuit (video content acquisition unit) that acquires video content 103 to be played back. 104, a shooting information search circuit (shooting information search means) 106 for acquiring shooting information 105 held by video content as information at the time of shooting, and a relative condition of shooting information between a plurality of videos displayed at the same time are defined. A layout information management circuit (layout information management means) 108 for managing the layout template 107, and a display (display means) 109 for simultaneously displaying a plurality of video contents according to the layout determined by the multi-playback control circuit 102. I have.

  The multi-playback control circuit 102 acquires layout information defined in the layout template specified by the user from the layout information management circuit 108, acquires video content specified by the user from the video content acquisition circuit 104, and acquires the acquired video Based on the shooting information held by the content, the shooting information search circuit 106 searches for video content holding shooting information satisfying the relative conditions specified as the layout information specified by the layout template specified by the user. The plurality of extracted video contents are acquired from the video content acquisition circuit 104, and the acquired plurality of video contents are displayed in a screen layout according to the layout information defined in the layout template specified by the user. Display 109 By shown, it performs control to reproduce a plurality of images at the same time.

  The video content 103 is video data to be reproduced, and holds shooting information 105 for each video content 103. The video content 103 only needs to hold video data to be displayed on the screen, and is recorded by a video camera, a video recorded by a recording device such as a video recorder, or a video recorded on a recording medium such as a DVD. But you can.

  The video content acquisition circuit 104 realizes a function of acquiring video content to be played back in response to a request from the multi-playback control circuit 102. The video content to be acquired may be video content stored in the external video database 110 as well as video content held in the multi-video playback device 101.

  The shooting information 105 holds data such as conditions when video content is shot.

  FIG. 2 shows an example of shooting information held by the video content in the present embodiment. The shooting information may be information indicating the characteristics of the shot video, and representative examples include the start date and time and end date of shooting, the location and direction of the shot, the screen size of the shot video, and the shot image. The distance to the subject and the brightness information of the captured image. These pieces of information are stored for each video content together with video data by the photographing device. Information at the time of photographing can be added based on time information held by the photographing device, various sensing information such as GPS and acceleration sensors, and personal information by a face detection function. It should be noted that the user himself / herself may add and store the captured video content as information indicating the video characteristics such as the name of the person who is the subject.

  In response to a request from the multi-playback control circuit 102, the shooting information search circuit 106 searches whether there is video content that holds shooting information that satisfies a specified condition, and provides information on the extracted video content To do.

  The layout template 107 holds layout information of a plurality of video contents displayed on the screen at the same time.

  FIG. 3 shows an example of data held as a layout template in the present embodiment. In the figure, an example of layout information of three video contents is shown. As the position information of each video content, for example, the information on the upper left coordinates and size on the display screen is held, thereby displaying the information on the display screen. The display position of each video content can be designated. The position information of each video content may be information that can determine the display position, and may be realized by specifying relative coordinates between the videos or by specifying a predetermined display position number. Furthermore, as the layout information, information defining the relative relationship of the shooting information held by each video content is held as a relative condition. FIG. 3 shows an example of relative conditions between three video contents. For example, as a relative condition of video [1], video [2], and video [3], the shooting time and direction are respectively constant. By using the condition that the difference is within the difference range, it is possible to designate the video content in which almost the same object is simultaneously photographed. Also, for example, the shooting date and time of video [1] is older than video [2], the shooting date and time of video [3] is older than video [1], and the shooting date and time of video [3] is older than video [2]. By specifying the relative condition as old, the condition can be specified so that the video [1], the video [2], and the video [3] are extracted in time series. Note that the layout template 107 may specify layout information by creating not only a template prepared in advance in the multi-video playback apparatus 101 but also a template in which the user himself / herself freely defines relative conditions.

  The layout information management circuit 108 implements a function of providing layout information defined by a designated layout template in response to a request from the multi-playback control circuit 102.

  In response to a request from the multi-play control circuit 102, the display device 109 displays a plurality of video contents simultaneously on the screen with a designated layout.

  The video database 110 is connected to the multi-video playback device 101 via a communication network, and stores video content that holds shooting information. The data communication method may be wireless communication or wired communication, and data transmission / reception may be realized by directly connecting a memory card holding shooting information and video content.

  The flowchart shown in FIG. 4 shows an operation procedure when a plurality of video contents are simultaneously played by the multi-video playback device 101 according to the present embodiment.

  First, the video content that the user wants to reproduce is selected (step S401). When the video content to be played back is designated by the user, the multi-playback control circuit 102 requests the video content acquisition circuit 104 to acquire the designated video content, thereby obtaining the video content data to be played back. get.

  Next, the user selects a layout template in order to designate a screen layout for performing multi-playback of the video content selected by the user (step S402). When a layout template is designated by the user, the multi-reproduction control circuit 102 performs multi-reproduction by requesting the layout information management circuit 108 to acquire layout information defined by the designated layout template. The layout information of the video content at the time is acquired.

  Note that the layout template 107 can be a frequently used layout template depending on the type of video content to be reproduced. Therefore, by displaying the recommended layout template to the user according to the selected video content, the layout by the user can be displayed. Template selection operation can be facilitated. For example, if there are a lot of video content that was taken at the same time, including a family or a friend, such as a wedding or an athletic meet, specify different angles for the same shooting location and date as relative conditions. Layout templates are considered suitable. In addition, when it is assumed that there are video content shot by multiple users at the same place at different dates, such as video content shot at a tourist destination, it is possible to use different dates at the same shooting location. It is considered that a layout template that specifies is suitable. The relative condition of the shooting date and time can be determined, for example, by checking whether the shooting time is included in a certain difference range, before or after the difference range, based on the shooting date and time held as shooting information. . The relative condition of the shooting angle is such that, for example, the shooting location is within a certain difference range based on the shooting location and direction held as shooting information, and vectors from the shooting location to the shooting direction intersect. By confirming whether the condition is satisfied, it can be determined that almost the same object is photographed at different angles.

  Note that either step S401 or step S402 may be performed first.

  Next, the multi-playback control circuit 102 satisfies the relative condition based on the shooting information held in the video content acquired in step S401 and the relative condition held in the layout information acquired in step S402. Video content having shooting information is acquired (step S403). The multi-playback control circuit 102 refers to the shooting information held by the video content to be played back according to the relative condition held by the acquired layout information, and uses the shooting information of the video content to be played back as a comparison target. A search is made by requesting the imaging information search circuit 106 whether there is video content satisfying the relative condition. When the multi-playback control circuit 102 receives the extracted video content information from the shooting information search circuit 106, the multi-playback control circuit 102 requests the video content acquisition circuit 104 to acquire the extracted video content. The video content data to be acquired is acquired.

  Note that the video content to be acquired may be video content stored in the external video database 110 as well as video content held in the multi-video playback device 101.

  The acquisition of video content to be subjected to multi-playback is repeated until the confirmation for all relative conditions held in the layout information acquired in step S402 is completed (in the case of No in step S404).

  When the confirmation for all the relative conditions held in the layout information acquired in step S402 is completed (in the case of Yes in step S405), the multi-playback control circuit 102 displays screens of all the acquired video contents according to the layout information. A multi-playback is realized by determining the layout and requesting the display 109 to play a plurality of video contents (step S405).

(Modification)
The flowchart shown in FIG. 5 shows an operation procedure when the layout information is changed when simultaneous playback of a plurality of video contents is realized using the multi-video playback apparatus 101.

  First, the user selects video content to be reproduced and a layout template to be applied to multi-reproduction (step S501). This step S501 is the same as step S401 and step S402 shown in FIG.

  Next, the multi-playback control circuit 102 determines the relative condition based on the shooting information held by the video content acquired in step S501 and the relative condition held by the layout information defined in the layout template. Video content having shooting information that satisfies the condition is acquired (step S502). The multi-playback control circuit 102 refers to shooting information held by the video content to be played back according to the relative condition, and there is video content that satisfies the relative condition by using the shooting information of the video content to be played back as a comparison target. Whether or not the image information retrieval circuit 106 is requested. If there is video content satisfying the relative condition (Yes in step S502), the extracted video content data is acquired by the video content acquisition circuit 104 as in step S403 of FIG. 4 (step S503). .

  If there is no video content that satisfies the relative condition (No in step S502), it is possible to perform multi-play without placing video content at the display position where the relative content does not exist, but it is comfortable for the user. In order to provide a comfortable viewing environment, it is desirable to arrange some video content. Therefore, when there is no video content satisfying the relative condition, when there is video content already acquired in step S503 instead of shooting information held by the video content designated as a reproduction target by the user, in step S503. The image information held by the acquired video content is searched by changing the comparison target of the relative condition and requesting the image information search circuit 106 to determine whether or not there is video content satisfying the relative condition.

  FIG. 6 is a diagram schematically illustrating an example of changing the comparison target of the relative condition. For example, the shooting date of video [1] is older than video [2], the shooting date of video [3] is older than video [1], and the shooting date of video [3] is older than video [2]. When the relative condition is specified, the video [2] having the latest shooting date than the video [1] is searched based on the shooting information held by the video [1] specified as the reproduction target by the user. get. Furthermore, when the video [3] whose shooting date and time is older than the video [1] is searched, but the video content satisfying the condition cannot be acquired, the shooting information held by the already acquired video [2] is used as a comparison target. Search for video content that satisfies the relative conditions. Also, the video content is arranged such that the video [2] is arranged at the display position of the video [1] in conjunction with the change of the comparison target. Video [2] is compared and the older video [4] is searched and acquired, so that video [1], video [2], and video [4] are arranged to satisfy the relative condition. Content can be placed.

  The acquisition of video content to be subjected to multi-playback is repeated until the confirmation for all relative conditions held in the layout information acquired in step S501 is completed (in the case of No in step S505).

  When the confirmation for all the relative conditions held in the layout information acquired in step S501 is completed (in the case of Yes in step S505), a display that satisfies the relative condition is displayed when the multi-playback control circuit 102 determines the screen layout. The acquired video content is arranged at the position, but by changing the layout information in accordance with the size and playback time of the acquired video content, a screen layout that is easier for the user to view can be realized (step S506). .

  FIG. 7 is a diagram schematically illustrating an example in which layout information is changed according to the size of video content. For example, in the case of a layout template in which three video contents are arranged, video [1] is a normal screen with a screen ratio of 4: 3 in width and height, and video [2] and video [3] have a screen ratio of 16: Assume that layout information is assumed assuming 9 wide screens. On the other hand, it is assumed that the video content acquired according to the relative condition is the wide screen for the video content acquired as video [1] and video [3], and the normal content for the video content acquired as video [2]. In this case, it may be possible to arrange and display the screen with the size of the acquired video content, or to enlarge and display the acquired video content within the range that fits the size specified by the layout information without changing the screen layout. However, in order to provide a comfortable viewing environment for the user, it is desirable to play the video content in an arrangement that is displayed as large as possible. Therefore, by changing the layout information and switching the screen arrangement of the video [1] and the video [2], it is possible to realize multi-reproduction with an arrangement that is enlarged and displayed larger.

  FIG. 8 is a diagram schematically illustrating an example in which layout information is changed in accordance with the playback time of video content. For example, when multi-playback is performed using a layout template in which three video contents are arranged, if the playback time of the video [2] is shorter than the playback time of the video [1] and the video [3], the video [2 It may be possible to stop the playback of the video [1] and the video [3], but in order to provide a comfortable viewing environment for the user, some video content should be placed. Is desirable. Therefore, when the video [4] satisfying the same conditions as the relative conditions of the video [1] and the video [2] can be acquired, the layout information is changed and the playback of the video [2] is completed. By switching to the playback of 4], it is possible to realize multi-playback that matches the user's intention. In addition, acquisition of video content to be switched may be acquired for all video content satisfying the relative conditions before starting multi-playback. The video content may be acquired while being reproduced after the start.

  When the screen layout is determined in step S506 in FIG. 5, the multi playback control circuit 102 requests the display unit 109 to play a plurality of video contents, thereby realizing multi playback (step S507).

  In the present embodiment, the case of a layout template in which mainly three video contents are arranged has been described as an example. However, the number and arrangement of the video contents are not limited, and two or more video contents are assigned as one. It is possible to apply this patent when arranging within one screen.

  As described above, the multi-video playback device of the present invention can be adapted to the user's intention by simply selecting a layout template according to the video to be played back when simultaneously displaying and playing back a plurality of videos on the screen. Since multi-image playback with a layout can be realized, it can be widely applied to high-definition video equipment.

101 Multi-Video Playback Device 102 Multi-Play Control Circuit (Multi-Play Control Unit)
103 video content 104 video content acquisition circuit (video content acquisition means)
105 Shooting information 106 Shooting information search circuit (shooting information search means)
107 layout template 108 layout information management circuit (layout information management means)
109 Display (display means)
110 Video database

Claims (14)

A video playback device for displaying and playing back a plurality of video contents simultaneously,
Shooting information search means for searching for video content holding the shooting information based on shooting information held by the video content as information at the time of shooting;
Video content acquisition means for acquiring video content;
Layout information management means for managing layout templates;
Multi-playback control means for controlling playback of a plurality of video contents simultaneously;
Display means for simultaneously displaying a plurality of video contents,
The multi-playback control means includes
Based on the layout template having layout information specified by the user by controlling the shooting information search means, video content acquisition means, layout information management means, and multi-playback control means, the video content specified by the user A multi-video playback device that acquires a plurality of video contents holding shooting information satisfying a relative condition and plays back the acquired video contents simultaneously with a screen layout according to the layout template. The multi-image playback apparatus according to claim 1, wherein
The photographing information search means and video content acquisition means are
Multi video playback apparatus characterized by not only shooting information and video content stored in a multi video playback apparatus but also shooting information and video content stored in an external video database connected via a communication network . The multi-image playback apparatus according to claim 1, wherein
The multi-playback control means includes
Video that retains shooting information that satisfies the relative condition after the video content that is to be compared with the relative condition is changed to the acquired video content when the video content that holds the shooting information that satisfies the relative condition cannot be acquired. A multi-image playback apparatus characterized by acquiring content. The multi-image playback apparatus according to claim 1, wherein
The multi-playback control means includes
When video content that holds shooting information that satisfies relative conditions is acquired, the screen layout is determined by changing the layout information defined in the layout template according to the width and height of the acquired video content. Multi-image playback device. The multi-image playback apparatus according to claim 1, wherein
The multi-playback control means includes
A multi-video playback device, wherein when video content holding shooting information satisfying a relative condition is acquired, video content to be arranged is switched according to the playback time of the acquired video content. The multi-image playback apparatus according to claim 1, wherein
The multi-playback control means includes
A multi-image playback apparatus, wherein a screen layout is determined by determining, as a relative condition, whether or not a shooting time is included in a certain difference range based on a shooting date and time held as shooting information. The multi-image playback apparatus according to claim 1, wherein
The multi-playback control means includes
A multi-image playback apparatus characterized in that, based on a location and direction held as shooting information, a screen layout is determined by determining whether a shooting angle is included in a certain difference range as a relative condition. . In the multi-image playback method for displaying and playing multiple images simultaneously on the screen,
A user specifying video content and a layout template;
Acquiring video content holding shooting information satisfying a relative condition with video content specified by the user based on layout information specified by the user;
And a step of determining a screen layout that conforms to a layout template based on the acquired video content. The multi-image playback method according to claim 8.
In the step of acquiring video content,
A multi-video playback method characterized by acquiring not only shooting information and video content stored in a multi-video playback device, but also shooting information and video content stored in an external video database connected via a communication network. The multi-image playback method according to claim 8.
In the step of acquiring video content,
Video that retains shooting information that satisfies the relative condition after the video content that is to be compared with the relative condition is changed to the acquired video content when the video content that holds the shooting information that satisfies the relative condition cannot be acquired. A multi-image playback method characterized by acquiring content. The multi-image playback method according to claim 8.
In the step of finalizing the screen layout,
A multi-video playback method, wherein a screen layout is determined by changing layout information defined in a layout template according to the width and height of acquired video content. The multi-image playback method according to claim 8.
A multi-video playback method characterized in that, in the step of determining the screen layout, the video content to be arranged is switched and played back according to the playback time of the acquired video content. The multi-image playback method according to claim 8.
In the step of finalizing the screen layout,
A multi-image playback method characterized by determining a screen layout by determining, as a relative condition, whether or not a shooting time is included in a certain difference range based on a shooting date and time held as shooting information. The multi-image playback method according to claim 8.
In the step of finalizing the screen layout,
Multi-image playback characterized by determining the screen layout by determining as a relative condition whether or not the shooting angle is included in a certain difference range based on the shooting location and direction stored as shooting information Method.

Images