JP2012156756A - Display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device capable of displaying simultaneously in a same screen by associating among all contents photographed at a same photographing time on a same theme against a plurality of contents photographed by a plurality of photographing apparatuses along a same scenario, and avoiding displaying simultaneously in a same screen contents photographed at a same photographing time set on different photographed themes.SOLUTION: When reproducing contents photographed at a same time by a plurality of photographing apparatuses along scenarios, if contents are those photographed on different scenario themes, simultaneous reproductions are not conducted and switched to a method to reproduce only contents which are being reproduced at the time.

Description

  The present invention relates to a display device that displays related image information stored in a recording medium in cooperation on the same display unit.

  The conventional playback device and playback means detect the presence / absence of content captured at the same time as related content from a plurality of content during content playback, notify the user of the result, There is a conventional example in which related content is displayed in an overlapping manner in a part of the display screen of a certain content (Patent Document 1).

  However, in Patent Document 1, since content association is performed using only the shooting time, the following problems exist. If the shooting time overlaps with the content being played back, the content shot at an irrelevant location will be played back, and if there is no content with the same shooting time as the content being played back, Since the content with the closest time is associated, the content with a significantly different shooting time such as one year later is associated.

  In view of this, a playback apparatus and a playback method have been proposed that can play back content that is predicted to have shot the same scene from content stored in a plurality of shooting devices with high accuracy (Patent Document 2). .

  Japanese Patent Laid-Open No. 2004-228688 describes content of a photographed image obtained by acquiring position information of the photographing device acquired from the GPS at the time of photographing, photographing direction information of the photographing device, photographing date / time information, and subject distance information obtained from the infrared distance measuring sensor and focus information. Embed a file. The embedded position information, shooting direction information, and shooting date / time information are associated with content that is within a predetermined position range, and after playing the associated content, content that has a time that overlaps with the shooting date / time is particularly duplicated. The playback device and means for simultaneously displaying on the display unit at a certain time.

JP 2006-260178 A JP 2010-232853

  However, in the above conventional example, contents are associated with each other only by the information of the same shooting time, and thus there are the following problems.

  A plurality of photographing devices capture a content according to a scenario composed of each photographing theme having a photographing order and the same scenario. After that, if you associate multiple shot contents with the same shooting time and display them at the same time on the same screen, the contents at the same shooting time set with different shooting themes are also displayed at the same time. , There is a problem that it is confusing to the user who is viewing the display result.

  In order to solve the above-described problem, the invention according to claim 1 sets the priority of the image information even when the date and time information determined by the shooting date and time determination unit is the same or overlaps and the shooting rules are different. The display device is characterized by switching to display of image information having different shooting rules.

  According to a second aspect of the present invention, even when the date and time information determined by the shooting date and time determination means is the same or overlapping, and the shooting rules are different, the priority of the image information is determined and different shooting rules are set. The display device according to claim 1, wherein the display device is switched to display of image information.

  According to a third aspect of the present invention, in the display device according to the first or second aspect, the shooting rule determining unit determines a scenario and a shooting theme of the scenario.

  According to a fourth aspect of the present invention, in the display device according to any one of the first to third aspects, the display unit is an external device.

  The invention according to claim 5 is the display device according to any one of claims 1 to 4, wherein the image display means displays a plurality of pieces of image information superimposed and divided. .

  According to the present invention, a plurality of contents photographed in accordance with the same scenario by a plurality of photographing devices are associated only with contents photographed at the same photographing time at the same photographing time. It is possible to provide a display device that can simultaneously display content on the same screen at the same shooting time that are set to different shooting themes and shot at the same shooting time.

1 is a system diagram showing a schematic configuration of a first embodiment to which the present invention is applied. Folder configuration diagram of the first embodiment to which the present invention is applied Data structure diagram of the first embodiment to which the present invention is applied Data structure diagram of the first embodiment to which the present invention is applied The screen block diagram of 1st Embodiment to which this invention is applied The flowchart which shows the process of 1st Embodiment to which this invention is applied. Conceptual diagram of processing of the first embodiment to which the present invention is applied Data structure diagram of the first embodiment to which the present invention is applied Data structure diagram of the first embodiment to which the present invention is applied Data structure diagram of the first embodiment to which the present invention is applied Conceptual diagram of processing of the first embodiment to which the present invention is applied The screen block diagram of 1st Embodiment to which this invention is applied The flowchart which shows the process of 1st Embodiment to which this invention is applied. The screen block diagram of 1st Embodiment to which this invention is applied The screen block diagram of 1st Embodiment to which this invention is applied

<First Embodiment>
The present invention will be described below with reference to FIGS. Also, a digital video camera will be described as an example of the video content display device.

  FIG. 1 is a system diagram of a video camera according to an embodiment of the present invention.

  Reference numeral 100 denotes an HDD (Hard Disc Drive), which records an image file shown in the data structure of FIG. NAS (Network Attached Storage) capable of wireless data communication by Wi-Fi may be used. FIG. 2 will be described later.

  Reference numeral 101 denotes an HDD interface. When the HDD 100 is connected to a video camera via USB, data communication is performed via the USB terminal. When 100 is a NAS, packet data is transmitted via Wi-Fi data communication. Refers to a wireless module capable of transmitting and receiving. In this embodiment, a case where the HDD 100 is connected by USB will be described.

  Reference numeral 102 denotes a reading means, which reads all or part of the image file stored in the HDD 100 to an SD memory card or a built-in memory and stores it. Note that reading is performed in units indicated by 201 in FIG. 2, and the description of FIG. 2 will be described later. It also performs operations to output image files in the SD memory card or internal memory to the CODEC.

  Reference numeral 103 denotes a built-in memory, which holds the image file having the data structure shown in FIG.

  Reference numeral 104 denotes an SD memory card, which holds an image file read from the HDD 100 by the reading means 102 as in the built-in memory 103.

  Reference numeral 105 denotes an SD memory card interface. When an image file is read from the SD memory card by the reading means 102, the SD memory card communicates directly with the SD memory card to read data requested by the reading means.

  A codec 106 demultiplexes the image file read as a file from the HDD 100, the built-in memory 103, and the SD memory card 104 by the reading means 102, and divides it into audio compression data and video compression data. Thereafter, the audio compression data and the video compression data are decoded and temporarily stored in the RAM.

  Reference numeral 107 denotes a RAM (Random Access Memory), which is a volatile memory that holds data calculation results in the CPU and holds data decoded by the CODEC.

Reference numeral 108 denotes display means, which creates display data via the CPU and transmits it to the display unit 109 so that the data decoded by the CODEC 106 from the image file held in the RAM 107 can be displayed as desired.
Reference numeral 109 denotes a display unit, which receives the display data transmitted from the display means 108, and then performs display according to the contents of the display data.

  Reference numeral 110 denotes an operation unit, which is operated by the user to start and end the video camera and select an image file displayed on the display unit.

  Reference numeral 111 denotes a ROM (Read Only Memory), which stores a program that describes the contents of the system that operates the video camera. When the operation unit 110 is operated by the user and the video camera is activated, the program is read and executed by the CPU.

  Reference numeral 112 denotes a CPU, which not only executes a video camera program stored in a ROM, but also performs arithmetic processing in each unit constituting the system FIG.

  Reference numeral 113 denotes photographing date / time information determination means, which analyzes the image file read from the HDD 100 to the internal memory 103 or the SD memory card 104 by the reading means 102 and obtains the analysis result. The shooting date / time information indicating the shooting start time and shooting end time of the image file is acquired from the acquired analysis result, and the shooting date / time information of the image files is compared to determine whether there is an overlapping portion in the time zone where the image was shot. judge. If a portion that overlaps the time zone in which the image was taken is found, information indicating the relationship between the compared image files is stored in the RAM 107.

  Reference numeral 114 denotes a priority information determination unit. For the image file read from the HDD 100 to the internal memory 103 or the SD memory card 104 by the reading unit 102, the priority information between the files is referred to, and the priority is high or low. And the result is stored in the RAM 107. The priority information will be described with reference to FIG.

  Reference numeral 115 denotes an external output device, which indicates a television (both HighDifinition and StandardDifinition) and a PC monitor.

  Reference numeral 116 denotes an external output device interface, which transmits display data to the external output device 115 after receiving display data transmitted from the display means.

  Reference numeral 117 denotes a system bus in the video camera, which is a transmission path for control signals, address signals, and data signals to each unit.

  Reference numeral 118 denotes theme name determination means for determining the theme name of the scenario management information file associated with the image file. Scenarios and themes are explained in Figs.

  Next, FIGS. 2 and 3 will be described. FIG. 2 is a diagram showing a folder structure in the HDD when video content is stored as a file in the HDD 100. 200 is the root folder of HDD100. 201 is a diagram showing the structure of a folder in which image files and scenario management files are stored. In this embodiment, 201 folders are stored in units of a plurality of shooting devices (for example, not only a video camera but also a digital single-lens reflex camera or a compact digital camera having a video shooting function). Assuming that backup is performed several times with a single photographing device.

  The video content information folder 202 includes a management information file 203 and an image file 204. The management information file 203 describes management information for managing image files, and is updated when the contents of the image file are changed or increased or decreased. Reference numeral 205 denotes a folder in which a scenario management file for associating image files based on shooting rules called scenarios is stored. The details of the scenario management information file will be described with reference to FIG.

300 in FIG. 3 is an example of a scenario management information file indicating in which scenario each image file is registered, and is stored in a folder 201 in association with the image file. Scenario that was set when the image file indicated by "Scenario name" and "File name" of the scenario in which the image file indicated by "File name" and "File name" of the image file is registered "Theme name" indicating the name of each shooting theme
“Shooting Date / Time Information” 301 indicating the shooting date, shooting start time, and shooting end time when the image file indicated by “File Name” was shot,
It consists of “priority information” 302 indicating the priority of the video content file indicated by “file name”. The relationship between the scenario name and the theme name is shown in Fig. 4, and an example of a scenario 400 called "Travel" consisting of themes 401 such as "Create title", "Schedule introduction", "Scenery on the move" Is shown. Further, the theme name 401 is in the order of prompting the user to take a picture in order from the top item “Create Title” to the lower order.

A specific example of priority information is indicated by 302. For example, the “resolution”, “recording bit rate”, “number of audio channels”, “recording time” of the video content file, and the user evaluates the quality of the shooting result. “Rating information” to be set and “3D display support / not supported” are not limited to these. The determination of each priority level is as follows: “Resolution” has a high resolution, “Recording bit rate” has a high bit rate, “Audio channel”
Regarding the number, it is considered that the number of channels is large, the “recording time” is long, the “rating information” is high in rating, and the above items have high priority for each item.

  Each file described in FIGS. 2 and 3 is assumed to be shot not only by a video camera but also by a plurality of shooting devices such as a digital camera and a digital single lens reflex camera.

  Next, an actual operation example of the present invention in the above configuration will be described. When the operation unit 110 is operated by the user and the video camera is turned on, the CPU 112 executes a program describing the contents of the video camera system from the ROM 111, and the video camera is activated. After starting the video camera, the reading means 102 reads an image file from the HDD 100 to the built-in memory 103 via the USB terminal via the CPU 112. From the image files read into the built-in memory 103, the display unit 108 searches for the first image file registered in each scenario. The search result is temporarily stored in the RAM 107 by the display means 108.

  Here, the first video content refers to the video content that was first shot on the shooting theme in terms of the shooting order of the scenario, but is not limited thereto. The display means 108 transmits the searched image file to the CODEC 106, and creates a thumbnail of each searched video content file via the CPU 112 from the image file stored in the RAM 107. Further, the display unit 108 displays the screen information 500 as shown in FIG. 5 from the created thumbnail via the CPU 107 and transmits it to the display unit 109. Reference numeral 501 denotes a created thumbnail.

  Next, the scenario management information stored in the scenario management information folder 205 is stored in the scenario management information folder 205 by the user selecting a thumbnail 501 on the screen information 500 from the operation unit 110 and registering the original image file from which the thumbnail 501 was created. A series of processing flows until all image files detected from the file and registered in the detected scenario name are reproduced by the CODEC 107 and displayed on the display unit 109 will be described with reference to FIGS.

  FIG. 6 is a flowchart showing the flow of processing. FIG. 7 is a diagram for explaining the relationship between the shooting times of image files. The horizontal axis indicates the shooting time, and the arrow indicates the direction in which the shooting time passes. Reference numerals 700 to 703 denote arbitrary image files A to D, and specific examples will be described in the following description. T0 to T4 each indicate a shooting time. Shooting start time of image file A is T0, shooting end time is T4, shooting end time of image file B is T1, shooting start time of image file C is T2, shooting end time is T3, shooting of image file C starts The time is T3 and the shooting end time is T4.

  In FIG. 6, a circled number 1 (hereinafter referred to as (1)) indicates that the shooting start time T2 of the image file C is later than the shooting start time T0 of the image file A (T0 ≦ T2). The shooting end time T3 of the image file C is before the shooting end time T4 of A (T3 ≦ T4). A circled number 2 (hereinafter referred to as (2)) indicates that the shooting start time T0 of the image file A is earlier than the shooting end time T1 of the image file B (T0 ≦ T1), and the circled number 3 (hereinafter referred to as (3) )) Indicates that the shooting end time T4 of the image file A is later than the start time T3 of the image file D (T3 ≦ T4).

  FIG. 8 is an example of the scenario management information file 300 associated with the image file recorded in the video content information folder 202 of FIG. 801 is image file 1 registered with scenario name “travel”, the theme name when shooting with scenario name “travel” is “create title”, and “shooting date / time information” which is the shooting start and end time at the time of shooting , It is composed of six pieces of “priority information” 302. FIG. 9 is an example of the scenario management information file as in FIG.

  The shooting date determination means 113 identifies the image file from which the thumbnail 501 was created from the content stored in the RAM 107, and analyzes the scenario management information file 300 stored in association with the specified image file. To do. After the analysis, the shooting date / time information 301, the scenario name, and the theme name are acquired from the scenario management information file 300 and stored in the RAM 107. As a specific example, a case will be described in which the video content file from which the thumbnail 501 is created is the image file 1 shown in FIGS. The scenario name “travel” described in the information 801 in the scenario management information file 800 stored in association with the image file 1 and the shooting date / time information “shooting date: 2010/10/11, Shooting start time: 10:00:00, shooting end time: 10:20:00 "and theme name" create title "are stored in RAM 107.

  On the other hand, the scenario management information file 300 of another image file stored in the internal memory 103 is referred to (S600, S601), and the shooting date held in the scenario name and shooting date / time information 301 corresponds to the image file 1. An image file that matches the information (S602) and whose shooting start time matches at least one condition described with reference to FIG. 7 is searched.

That is, when the video content A in FIG. 7 is the video content file 1 and the video contents B to D are the video content files to be searched other than the video content file 1,
(1) It is after the shooting start time of the shooting date / time information 301 of the image file 1 (FIGS. 2 and 8) stored in the RAM 107 and before the shooting end time (S603).

  (2) It is before the shooting end time of the shooting date / time information 301 of the image file 1 stored in the RAM 107 (S604).

Furthermore, the shooting end time is
(3) It is later than the shooting start time of the shooting date / time information 301 of the image file 1 stored in the RAM 107 (S605).

  If the search does not correspond to the above (1) to (3), the image file 1 stored in the RAM 107 is reproduced (S606). As an example corresponding to (1), for the image file 1, the shooting date / time information 901 of the image file 01 shown in FIG. 9 matches the above condition (1). That is, the scenario management information of the image file 01 is described as 901 in the scenario management information file 900, the scenario name matches the image file 1801, and both the shooting start time and the shooting end time are the shooting date and time information of the image file 1. In contrast, the condition (1) is satisfied (801, 901).

  After completing the search for the image file that satisfies any of the above conditions (1) to (3), the searched image file is stored in the RAM 107 together with the corresponding scenario management information file. The theme name determination means 118 records the theme name of the scenario management information file of image file 1 stored in the RAM 107 and the scenario management information file 300 of the image file other than image file 1 stored in the built-in memory 103. It is determined whether the theme names match (S606). If there is no scenario management information file 300 with a matching theme name, the video content file 1 is transmitted from the display means 108 to the CODEC 106, played back, and the played back data is sent to the display unit for display ( S607). If there is a scenario management information file 300 with a matching theme name, the scenario management information file with the matching theme name and the associated video content file are saved in the RAM 107 and video content is saved. Used to display 1 (S608).

  The actual display flow will be described with reference to FIGS.

  FIG. 10 shows an example of the scenario management information file 300 stored in association with the image file stored in the built-in memory 103, as in FIGS. FIG. 11 is a diagram showing a playback method along the time axis when playing back an image file selected by the operation unit by the user. As in the above case, consider the case where the user selects image file 1 (1101 in FIG. 11). On the RAM 107, an image file 01, a scenario name, a theme name, and an image file 01 satisfying the above condition (1) are stored by the shooting date / time information determination unit 113 and the theme name determination unit 118. When a display operation is started by the display means 108, the image file 1 stored on the RAM is transmitted to the CODEC 106, the demultiplexing and decoding operations are performed, the audio signal and the video signal are transmitted to the display device, and then the time T0 Is displayed on the display.

  Further, the condition of the above (1) that the image file 01 (1102) on the RAM 107 satisfies is confirmed, and when the shooting start time of the image file 01 approaches while the image file 1 is displayed, the image file 01 also changes the CODEC 106 in the same manner. The audio signal and video signal of the image file 01 are simultaneously displayed on the display unit during the time T1 to T3 with respect to the audio signal and video signal of the image file 1 currently being displayed. . An example of a method for displaying the images simultaneously is a method of displaying them in a superimposed manner. The display result is shown in FIG. 1200 is the display result of the image file 1, and 1201 displayed in a superimposed manner is the display result of the image file 01.

  In this embodiment, an example of PIP (Picture In Picture) is shown as a superimposed display method, but the present invention is not limited to this. When superimposing, the selection of which image file to display on the small screen or main screen is automatically selected by the priority information 302 of the scenario management information file 300 stored in association with each image file. The The selection method will be described with reference to FIG. The priority information determination unit 114 refers to the scenario management information file 300 associated with the image file 01 on the RAM 107 (S1300).

  Referring to the priority information 302 of each scenario management information file, the contents of each item recorded in the priority information 302 are compared between the scenario management information (S1301), and the total number of items of the item with the highest priority Information for displaying the main screen is stored in the RAM 107 in the image file associated with the scenario management information file 300 (S1302). The display unit 108 refers to the main screen display information stored in the RAM 107 from the RAM 107, and displays the image file on the main screen with reference to the main screen display when displaying a plurality of image files (S1303). Other image files are displayed on the display unit in a sub-screen display (S1304). If the total number of items with high priority matches among the plurality of scenario management information files in the priority information determination unit 114, the screen is divided into two (S1305).

  However, in addition to the split display, it is also conceivable that the video content file selected by the user is used as a main screen or a sub-screen to be displayed in a superimposed manner, or only the video content file selected by the user is preferentially displayed on the main screen. In the time period from T2 to T3 in FIG. 11, the image file 01 and the image file 001 also satisfy the above condition (3) and are simultaneously displayed, but the theme names of 901 and 1001 in FIGS. Therefore, only the image file 1 (1101) is displayed. The time period from T3 to T4 also satisfies the condition (3) in the image file 01 and the image file 001, but the theme names of 801 in FIG. 8 and 1001 in FIG. Only image file 1 is displayed on the main screen (S1300). In summary, when the image file 1 is 1400 in FIG. 14 and the image file 01 is 1500 in FIG. 15, only the image file 1 (1400) is displayed on the display unit from the time T0 to T1 in FIG. From time T1 to time T3, image file 01 is superimposed and displayed on image file 1, and from time T3 to time T4, image file 1 (1400) is displayed (1106).

  However, from the examples in FIGS. 8 to 10, time T0 is 10:00:00, time T1 is 10:10:00, time T2 is 10:13:00, time T3 is 10:15:00, and time T4 is 10 : 20:00.

  In this embodiment, the image file is read from the HDD 100 to the built-in memory by the reading means 102. However, the video content data may be directly read from the HDD 100 to the RAM 107 via the HDD interface 101.

<Second Embodiment>
The present invention will be described with reference to FIG.

  Since the system diagram of the present invention is the same as that of the first embodiment, description thereof is omitted. In FIG. 11, the time zone from T2 to T3 is the scenario management information file 901 in FIG. 9 stored in association with the video content file 01, and the scenario management information file stored in association with the video content file 001 in FIG. Since the theme name of 1001 is different, an example in which the display unit 109 does not display simultaneously is shown in the first embodiment. However, if the user visually confirms the display of the desired subject before the time T2 in the display content of the video content file 01, the display content of the display unit 110 is changed by the operation of the operation means 110 by the user. The display content of the video content file 001 may be changed.

  When changing the display contents, the priority information determination unit 114 refers to the priority information of each scenario management information file on the RAM 107, and manages the contents of each item recorded in the priority information for each scenario. The content of the display contents displayed on the display unit is displayed after the video content file is transmitted to the display unit 109 by the display means 108 and is associated with the scenario management information file having the total number of items of the highest priority compared with the information. Switch.

  Although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. included. A part of the above-described embodiments may be appropriately combined.

100 HDD (Hard Disc Drive)
101 HDD interface

Claims (5)

Display unit for displaying image information Playback unit for reproducing image information Reading unit for reading out image information Shooting date and time information detecting unit for detecting shooting date and time information of image information Shooting detected by the shooting date and time information detecting unit from a plurality of pieces of image information Shooting date / time information determining means for determining whether or not there is an overlapping part with the same date / time information. For multiple image information, there is a part with the same or overlapping shooting date / time information in the shooting date / time information determining means. In this case, only in the same or overlapping time zone, a plurality of images determined by the shooting date and time information determination unit are displayed simultaneously on the display unit. A shooting rule of image information captured based on a shooting rule is detected. Shooting rule detecting means for determining whether or not the shooting rules detected by the shooting rule detecting means are the same for a plurality of pieces of image information. A rice cake,
As a result of determination by the shooting date / time information determination unit and the shooting rule determination unit for the plurality of image information, the shooting date / time information is the same or duplicated in all or a part of the image information, The display device, wherein when the shooting rule is different, the display means does not simultaneously display image information on the display unit in the same or overlapping time zone. Even when the date and time information determined by the shooting date and time determination means is the same or overlapped and the shooting rules are different, the priority of the image information is determined and switching to display of image information having different shooting rules is performed. The display device according to claim 1. The display device according to claim 1, wherein the shooting rule determination unit determines a scenario and a shooting theme of the scenario. The display device according to claim 1, wherein the display unit is an external device. The display device according to claim 1, wherein the image display unit displays a plurality of pieces of image information by superimposing and dividing the information.