WO2013183366A1

WO2013183366A1 - Display control device, display control method, and computer program

Info

Publication number: WO2013183366A1
Application number: PCT/JP2013/061194
Authority: WO
Inventors: 啓川井; 洋一元川; あゆみ山本; 春生吉田; 昌良大野; 立桑原; 志穂西野
Original assignee: ソニー株式会社
Priority date: 2012-06-06
Filing date: 2013-04-15
Publication date: 2013-12-12

Abstract

Provided is a display control device that is equipped with a display control unit that controls displaying of representative images corresponding to pieces of content such that the representative images are displayed in a predetermined order in a direction substantially orthogonal to a flat surface of a display unit on the basis of first information which is contained in information on photographic subjects included in the pieces of content when photographed. Due to said configuration, the display control device can present images in an intuitively recognizable manner to a user by using the information on the photographic subjects.

Description

Display control apparatus, display control method, and computer program

The present disclosure relates to a display control device, a display control method, and a computer program.

Digital cameras that capture still images and moving images are widely used. In order to confirm an image captured by the digital camera using a digital camera or a personal computer that captures the image, a thumbnail image is generally displayed on the digital camera or personal computer.

In recent years, the number of images to be stored has been greatly increased due to the increase in capacity of recording media for storing captured images. Therefore, when displaying thumbnail images, a device for displaying an image desired by the user has been devised. Patent Document 1 discloses an electronic device that allows a user to preview a plurality of images classified into a plurality of groups with a simple operation without expanding each group.

JP 2011-210138 A

The technique described in Patent Document 1 adds information about the imaging device itself (direction, position, etc.) to the captured image and performs preview display using the information about the imaging device itself. Here, it is considered that a more intuitive thumbnail image can be presented to the user by using the information of the captured subject instead of the information of the imaging device itself.

Therefore, the present disclosure provides a new and improved display control apparatus, display control method, and computer program capable of presenting a more intuitive image to a user using captured subject information. .

According to the present disclosure, the content is displayed in a predetermined order in a direction substantially perpendicular to the plane of the display unit based on the first information of the subject included in the content at the time of capturing the content. There is provided a display control device including a display control unit that controls display of a corresponding representative image.

According to the present disclosure, the content is displayed in a predetermined order in a direction substantially orthogonal to the plane of the display unit based on the first information of the subject included in the content at the time of capturing the content. A display control method is provided, which includes a display control step for controlling display of a representative image corresponding to.

Further, according to the present disclosure, on the computer, the information is displayed in a predetermined order in a direction substantially orthogonal to the plane of the display unit based on the first information of the subject included in the content when the content is captured. There is provided a computer program for causing a display control step for controlling display of a representative image corresponding to the content to be executed.

As described above, according to the present disclosure, a new and improved display control apparatus and display control method capable of presenting a more intuitive thumbnail image to a user using information of a captured subject. And a computer program can be provided.

It is explanatory drawing which shows the outline | summary of one Embodiment of this indication. FIG. 3 is an explanatory diagram illustrating a functional configuration example of an imaging apparatus 100 according to an embodiment of the present disclosure. 5 is a flowchart illustrating an operation of the imaging apparatus 100 according to an embodiment of the present disclosure. FIG. 26 is an explanatory diagram illustrating a concept of displaying thumbnail images of the imaging apparatus 100. FIG. 26 is an explanatory diagram illustrating a concept of displaying thumbnail images of the imaging apparatus 100. FIG. 26 is an explanatory diagram illustrating a concept of displaying thumbnail images of the imaging apparatus 100. FIG. 25 is an explanatory diagram showing functional blocks of the imaging apparatus 100. It is a flowchart which shows operation | movement of the functional block of the imaging device 100 shown in FIG. It is explanatory drawing which shows the state imaged in the some point from which altitude differs. FIG. 26 is an explanatory diagram illustrating a concept of displaying thumbnail images of the imaging apparatus 100. FIG. 25 is an explanatory diagram illustrating an example of a user interface for changing the arrangement reference of thumbnail images in the imaging apparatus. It is explanatory drawing which shows a hue ring and a color triangle. FIG. 26 is an explanatory diagram illustrating a concept of displaying thumbnail images of the imaging apparatus 100. FIG. 26 is an explanatory diagram illustrating a concept of displaying thumbnail images of the imaging apparatus 100.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

The description will be made in the following order.
<1. One Embodiment of the Present Disclosure>
[Overview of this embodiment]
[Functional configuration example of imaging device]
[Thumbnail image display processing example]
<2. Summary>

<1. One Embodiment of the Present Disclosure>
[Overview of this embodiment]
First, an outline of an embodiment of the present disclosure will be briefly described. In the present embodiment, a processing operation when displaying a thumbnail image of an image captured by an imaging device such as a digital camera will be described. In this embodiment, when displaying a thumbnail image of an image captured by an imaging device such as a digital camera, information on the subject of the captured image is used. In this embodiment, when displaying the thumbnail image, the thumbnail image is displayed with a spatial depth. In the present embodiment, by presenting thumbnail images in this way, it is possible to provide more intuitive content to the user.

FIG. 1 is an explanatory diagram showing an overview of an embodiment of the present disclosure. When the imaging apparatus 100 according to an embodiment of the present disclosure to be described later presents a thumbnail image on the display unit 120, the image capturing apparatus 100 presents the thumbnail image on a display (display unit 120) capable of stereoscopic display. Those that meet the conditions are presented in a predetermined order in a direction substantially orthogonal to the plane of the display unit 120. For example, a message that matches a certain condition is presented so as to be visible on the near side. Also, when a thumbnail image is presented on a display that cannot be stereoscopically displayed, the display size of the thumbnail image is changed so that the one that matches a certain condition is seen on the near side. In the following, an embodiment for realizing such thumbnail image presentation will be described.

[Functional configuration example of imaging device]
FIG. 2 is an explanatory diagram illustrating a functional configuration example of the imaging apparatus 100 according to an embodiment of the present disclosure. Hereinafter, a functional configuration example of the imaging apparatus 100 according to the embodiment of the present disclosure will be described with reference to FIG.

The imaging apparatus 100 shown in FIG. 2 is an apparatus having a function of capturing a still image or a moving image and displaying a thumbnail image of the captured image on a screen. As illustrated in FIG. 2, the imaging apparatus 100 according to an embodiment of the present disclosure includes a control unit 102, an optical system unit 104, an imaging element 106, an A / D conversion unit 108, and a digital signal processing unit 110. And an encoding / decoding unit 112, a recording controller 114, a recording unit 116, a display driver 118, a display unit 120, an operation unit 122, a ROM 124, a RAM 126, and an external I / F 128. Is done.

The control unit 102 controls the operation of each unit of the imaging apparatus 100. For example, the control unit 102 reads out a computer program stored in the ROM 124 and sequentially executes the computer program, thereby controlling the operation of each unit of the imaging apparatus 100.

The optical system unit 104 includes, for example, a zoom lens, a focus lens, a diaphragm, a shutter, and the like, and guides light from the subject to the image sensor 106. The operation of the optical system unit 104 is controlled by the control unit 102. Examples of the operation of the optical system unit 104 controlled by the control unit 102 include driving of a zoom lens and a focus lens, driving of a diaphragm, driving of a shutter, and the like.

The image sensor 106 generates an analog electrical signal from the light from the subject guided from the optical system unit 104. The operation of the image sensor 106 is controlled by the control unit 102. The operation of the image sensor 106 controlled by the control unit 102 includes, for example, exposure timing control and reset control of accumulated charge. The image sensor 106 sends the generated analog electrical signal to the A / D converter 108.

The A / D converter 108 converts the analog electrical signal generated by the image sensor 106 into a digital signal. The operation of the A / D conversion unit 108 is controlled by the control unit 102. When the A / D converter 108 converts the analog electrical signal into a digital signal, the A / D converter 108 sends the digital signal to the digital signal processor 110.

The digital signal processing unit 110 performs signal processing on the digital signal generated by the A / D conversion unit 108 to generate image data. The operation of the digital signal processing unit 110 is controlled by the control unit 102. When the digital signal processing unit 110 generates the image data, the digital signal processing unit 110 sends the generated image data to the encoding / decoding unit 112. Note that the digital signal processing unit 110 may temporarily store the generated image data in the RAM 126 under the control of the control unit 102.

The encoding / decoding unit 112 encodes and compresses the image data generated by the digital signal processing unit 110, or decodes the encoded data and restores the original data. When the image data generated by the digital signal processing unit 110 is encoded, the encoding / decoding unit 112 sends the encoded image data to the recording controller 114. Note that the encode / decode unit 112 may temporarily store the encoded data in the RAM 126 under the control of the control unit 102. Note that the encoding format by the encoding / decoding unit 112 is not limited to a specific format.

The recording controller 114 stores the image data encoded by the encoding / decoding unit 112 in the recording unit 116 and reads out the image data stored in the recording unit 116. The operation of the recording controller 114 is controlled by the control unit 102. The recording unit 116 records image data. The recording unit 116 is configured by a recording medium such as a flash memory or a hard disk, for example. In the present embodiment, in addition to the image data, the recording unit 116 records a thumbnail image of the image data and meta information obtained from a subject shown in the image data. The meta information obtained from the subject shown in the image data includes, for example, information on the distance between the subject and the imaging apparatus 100, the representative height of the subject, the result of structural analysis of the subject, and the brightness of the subject. . The imaging apparatus 100 controls the display of the thumbnail image on the display unit 120 using the meta information obtained from the subject shown in the image data.

The display driver 118 controls display of images, characters, and other information on the display unit 120. The operation of the display driver 118 is controlled by the control unit 102. In the present embodiment, the display driver 118 controls the display unit 120 to display thumbnail images as shown in FIG. Note that the thumbnail image display control as shown in FIG. 1 may be executed by the control unit 102 instead of the display driver 118.

Display unit 120 displays images, characters, and other information. The display unit 120 controls display of information by the display driver 118. The display unit 120 is configured by a flat display device such as a liquid crystal display or an organic EL display. The display unit 120 may be, for example, a display device that allows a user to visually recognize the image three-dimensionally. The stereoscopic display method may use glasses for making the user visually recognize stereoscopically, or may make the user visually recognize stereoscopically without using glasses. The display unit 120 may be provided with a touch panel on the surface.

The operation unit 122 is an operation member that operates the imaging apparatus 100, and includes, for example, a shutter button, a cursor button, and other operation buttons. When the operation unit 122 is operated by the user, a signal corresponding to the operation is sent to the control unit 102. The control unit 102 performs control of the imaging device 100 according to the operation of the operation unit 122. When a touch panel is provided on the surface of the display unit 120, the touch panel constitutes the operation unit 122.

The ROM 124 is a read-only memory that holds a computer program and setting information for operating the imaging apparatus 100. The computer program stored in the ROM 124 is read by the control unit 102 and executed sequentially. The setting information stored in the ROM 124 is read out by the control unit 102 when the computer program is executed.

The RAM 126 is a memory for temporarily storing data when the control unit 102 operates the imaging apparatus 100. For example, the RAM 126 may temporarily store image data generated by the digital signal processing unit 110.

The external I / F 128 is an interface with an external device connected to the imaging device 100. For example, a flash issued at the time of taking a picture, a sound collection microphone, an odor sensor, or the like may be connected to the external I / F 128. By connecting these external devices to the external I / F 128, the imaging device 100 can emit a flash during imaging or acquire information about sound and odor during imaging.

The image capturing apparatus 100 according to the present embodiment has such a configuration, so that the thumbnail image as shown in FIG. 1 can be displayed from information on the subject at the time of image capturing. The functional configuration of the imaging apparatus 100 according to an embodiment of the present disclosure has been described above with reference to FIG. Next, an example of a thumbnail image display process performed by the imaging apparatus 100 according to an embodiment of the present disclosure will be described.

[Thumbnail image display processing example]
FIG. 3 is a flowchart illustrating the operation of the imaging apparatus 100 according to an embodiment of the present disclosure. The flowchart shown in FIG. 3 shows the operation of the imaging apparatus 100 when displaying a thumbnail image on the display unit 120. Hereinafter, the operation of the imaging apparatus 100 according to the embodiment of the present disclosure will be described with reference to FIG.

The imaging apparatus 100 displays a thumbnail image on the display unit 120 by using a predetermined operation of the operation unit 122 by the user as a trigger. The imaging apparatus 100 first determines a thumbnail image to be displayed on the display unit 120 (step S101). For example, the control unit 102 determines the thumbnail image to be displayed. Which thumbnail image is displayed on the display unit 120 is determined by the operation of the operation unit 122 by the user. Then, the imaging apparatus 100 acquires the thumbnail image determined in step S101 and the meta information of the subject recorded along with the image from the recording unit 116 (step S102). For example, if the user instructs to display a thumbnail image of an image captured on a certain date, the control unit 102 receives one or more thumbnail images of the image captured on that date from the recording unit 116. Obtained via the recording controller 114.

In step S102, when the thumbnail image to be displayed on the display unit 120 is acquired from the recording unit 116, the imaging apparatus 100 displays the acquired thumbnail image on the display unit 120. The control unit 102 causes the display driver 118 to perform display on the display unit 120. At this time, the control unit 102 uses the meta information of the subject to perform control such that a thumbnail image that matches the meta information according to certain conditions is displayed on the front side in a direction substantially orthogonal to the plane of the display unit 120. Is performed (step S103). Since there are various conditions, an example of displaying thumbnail images on the display unit 120 will be described below.

For example, as the subject meta information used by the control unit 102 for display control of thumbnail images, there is distance information between the subject and the imaging apparatus 100. That is, thumbnail images of image data that are closer to the subject are arranged at positions farther from the display surface of the display unit 120 in a three-dimensional space. As described above, when the control unit 102 performs display control of the thumbnail image, the imaging apparatus 100 can intuitively express a sense of distance between the photographer and the subject.

FIG. 4 is an explanatory diagram illustrating a concept of displaying thumbnail images of the imaging apparatus 100 according to an embodiment of the present disclosure. The concept shown in FIG. 4 is a case where thumbnail images of image data that are closer to the subject are arranged at positions farther from the display surface of the display unit 120 in a three-dimensional space. As illustrated in FIG. 4, the control unit 102 performs display control on the three-dimensional space so that the closer to the subject, the farther from the display surface of the display unit 120.

Here, the control unit 102 may use information on the focal length at the time of imaging when expressing the distance between the subject and the imaging device 100. Since the distance of the focal length has the same meaning as the distance to the subject, the control unit 102 reflects the focal length information on the distance from the surface of the display unit 120.

Further, the control unit 102 may use information on a zoom state at the time of imaging when expressing the distance between the subject and the imaging device 100. If the imaging apparatus 100 has a zoom function, the imaging apparatus 100 can digitize the degree of the zoom state at the time of imaging and save it as meta information. The closer the zoom state is to the wide angle side, the closer the distance to the subject is, so the control unit 102 reflects the value of the degree of zoom state on the distance from the surface of the display unit 120.

Further, when expressing the distance between the subject and the imaging apparatus 100, the control unit 102 may use information on the intensity of the scent emitted by the subject. If an odor sensor is connected to the imaging apparatus 100, the imaging apparatus 100 can digitize the degree of odor during imaging and store it as meta information. The stronger the scent from the subject is, the closer the distance to the subject is, so the control unit 102 reflects the value of the degree of the subject in the distance from the surface of the display unit 120.

Further, when the control unit 102 expresses the distance between the subject and the imaging device 100, the strength of the sound emitted from the subject can be considered. If a sound collection microphone is connected to the imaging apparatus 100, the imaging apparatus 100 can digitize the degree of sound at the time of imaging and store it as meta information. The louder the sound from the subject, the closer the distance to the subject, so the control unit 102 reflects the value of the sound level of the subject in the distance from the surface of the display unit 120.

As the subject meta information used by the control unit 102 for the thumbnail image display control, there is information on the representative height of the subject. For example, if a building such as a mountain or a building is shown as a subject, the information on the height of the subject is attached to image data as meta information at the time of imaging. Then, thumbnail images of image data having a higher subject height are arranged at positions farther from the display surface of the display unit 120 in a three-dimensional space. As described above, the control unit 102 performs display control of the thumbnail image, so that the imaging apparatus 100 can intuitively express the height of the subject.

FIG. 5 is an explanatory diagram illustrating a concept of displaying thumbnail images of the imaging apparatus 100 according to an embodiment of the present disclosure. The concept shown in FIG. 5 is a case where thumbnail images of image data with a high subject height are arranged at positions farther from the display surface of the display unit 120 in a three-dimensional space. As shown in FIG. 5, the control unit 102 performs display control on the three-dimensional space such that the higher the subject height, the farther from the display surface of the display unit 120.

The control unit 102 may arrange the thumbnail images in the three-dimensional space according to the distance between a certain place and a place such as a building shown as a subject. In this way, the control unit 102 controls the display of thumbnail images, so that the imaging apparatus 100 can intuitively express the distance between a certain place and a place such as a building that is shown as a subject.

The meta information of the subject used by the control unit 102 for display control of thumbnail images includes information on the result of subject structure analysis. For example, image data for displaying a thumbnail image is analyzed, and the analysis result is attached to the content as meta information. Then, when displaying the thumbnail image on the display unit 120, the control unit 102 uses the meta information about the analysis result to display the three-dimensional spatial display of the display unit 120 as the subject matches a certain reference. Place it away from the surface.

Further, for example, the imaging apparatus 100 may attach, as meta information, information obtained by quantifying the degree of similarity between the reference image and the subject as information on the result of structural analysis of the subject. The information obtained by digitizing the degree of similarity may be generated by the control unit 102 at a timing when a reference image and an image for displaying a thumbnail image are selected.

When displaying a plurality of thumbnail images on the display unit 120, the control unit 102 is farther from the display surface of the display unit 120 in a three-dimensional space based on the meta information about the degree of similarity. Place at the position. As described above, the control unit 102 controls the display of thumbnail images, so that the imaging apparatus 100 can intuitively search for an image similar to a certain image. Further, at this time, the user can arbitrarily select a reference image from contents already recorded in the imaging apparatus 100.

Here, when expressing the distance between the subject and the imaging apparatus 100, the control unit 102 may use a facial expression as information on the result of the structural analysis of the subject. The control unit 102 performs structural analysis on the face of the subject, digitizes the degree of smile, and uses the value as meta information. The control unit 102 reflects the value of the degree of smile of the subject on the distance from the surface of the display unit 120.

Further, when expressing the distance between the subject and the imaging apparatus 100, the control unit 102 may use an image of an individual's face as a reference for the degree of similarity with the subject. The control unit 102 performs structural analysis on the face of the subject, digitizes the degree of similarity with a specific face image, and uses the value as meta information. The control unit 102 reflects the value of the degree of similarity with a specific face image on the distance from the surface of the display unit 120.

Further, when expressing the distance between the subject and the imaging apparatus 100, the control unit 102 may use an animal image as a reference for the degree of similarity with the subject. The control unit 102 quantifies the degree of similarity from animal individual characteristics such as the shape of the face and the color of the hair, and uses the value as meta information. The control unit 102 reflects the value of the degree of similarity with the animal in the distance from the surface of the display unit 120. Further, in this case, the control unit 102 may extract only an image of a specific animal by using an animal call or the like as a comparison target.

FIG. 6 is an explanatory diagram showing the concept of displaying thumbnail images of the imaging apparatus 100. The concept shown in FIG. 6 is a case where thumbnail images of image data having a high degree of similarity to a certain reference are arranged at positions far from the display surface of the display unit 120 in a three-dimensional space. As illustrated in FIG. 6, the control unit 102 performs display control on the three-dimensional space so that the higher the degree of similarity to a certain reference is, the farther from the display surface of the display unit 120.

Here, the degree of similarity with a specific face image is digitized, and display control of thumbnail images based on the value will be described. FIG. 7 is an explanatory diagram illustrating functional blocks of the imaging apparatus 100 according to an embodiment of the present disclosure. FIG. 8 is a flowchart showing the operation of the functional blocks of the imaging apparatus 100 shown in FIG.

As illustrated in FIG. 7, the imaging apparatus 100 according to an embodiment of the present disclosure includes a reproduction unit 151, a memory 152, a content library 153, an extraction unit 154, a comparison unit 155, a calculation unit 156, And a display unit 120.

The imaging apparatus 100 determines whether or not the user has selected an image desired to be an image similar to a certain reference image in the reproduction unit 151 (step S111). When an image is selected by the reproduction unit 151, the imaging apparatus 100 stores the image selected in step S111 in the memory 152 (step S112).

Subsequently, the imaging apparatus 100 extracts a reference image from the content library 153 by the extraction unit 154 (step S113). The reference image may be selected by the user. Subsequently, the imaging apparatus 100 performs comparison between the image extracted by the extraction unit 154 and an image that has been stored in the memory 152 and has not been compared yet with the comparison unit 155 (step S114). When the comparison unit 155 compares the images, the imaging apparatus 100 subsequently digitizes the similarity of the images compared by the comparison unit 155 (step S115).

The comparison of the images in the comparison unit 155 may be performed by, for example, extracting feature amounts of both images and comparing the feature amounts. The numerical value by the calculation unit 156 may be set based on the numerical value appropriately set for the comparison result in the comparison unit 155.

Subsequently, the imaging apparatus 100 determines whether all the images stored in the memory 152 have been compared with the image extracted by the extraction unit 154 (step S116). If all the images stored in the memory 152 have been compared with the image extracted by the extraction unit 154, the imaging apparatus 100 subsequently proceeds from the display surface of the display unit 120 based on the similarity quantified by the calculation unit 156. And the thumbnail image is displayed three-dimensionally on the display unit 120 (step S117). On the other hand, if there is an image that has not yet been compared with the image extracted by the extraction unit 154, the imaging apparatus 100 returns to the process of step S114.

In the above, the degree of similarity with a specific face image by the imaging device 100 is quantified, and the display control of thumbnail images based on the value has been described. Needless to say, display control of thumbnail images by the imaging apparatus 100 is not limited to such an example.

As the subject meta information used by the control unit 102 for display control of thumbnail images, there is information on the brightness of the subject. For example, image data for displaying a thumbnail image is analyzed, and the brightness of the subject is attached to the content as meta information. Then, when displaying the thumbnail image on the display unit 120, the control unit 102 uses the meta information about the brightness of the subject, and the display unit 120 is three-dimensionally spatially as the subject is brighter and clearer. Place it at a position far from the display surface.

FIG. 9 shows a state in which images are taken at a plurality of points at different altitudes, and FIG. 10 is an explanatory diagram showing the concept of displaying thumbnail images of the image pickup apparatus 100. The concept shown in FIG. 10 is a case where thumbnail images of image data captured at a high altitude are arranged at positions far from the display surface of the display unit 120 in a three-dimensional space. As shown in FIG. 9, when there is image data captured at higher positions in the order of content B> content C> content A, the control unit 102 captures images at a high altitude as shown in FIG. The thumbnail image is controlled to be displayed in the three-dimensional space so that it is far from the display surface of the display unit 120.

Up to this point, the example in which the meta information of the subject is used for the display control of the thumbnail image on the display unit 120 has been shown. However, the imaging apparatus 100 further uses the information of the imaging apparatus 100 to display the thumbnail image on the display unit 120. Display control may be performed.

The imaging altitude can be used as meta information of the imaging apparatus itself that the control unit 102 uses for thumbnail image display control. The imaging apparatus 100 records the altitude at the time of imaging as meta information. When displaying the thumbnail image on the display unit 120, the control unit 102 arranges the thumbnail image at a position farther from the display surface of the display unit 120 as the altitude at the time of imaging is higher. By arranging thumbnail images in this way, the imaging apparatus 100 can intuitively express the height at the time of imaging.

Further, the imaging apparatus 100 may perform display control of the thumbnail image on the display unit 120 using information added by user operation with respect to the meta information of the captured image data.

When the user selects image data in a state where thumbnail images of a plurality of image data are displayed on the display unit 120, the imaging apparatus 100 adds, adds, or appends / changes to the image data the number of selections as meta information. To do. When displaying the thumbnail image on the display unit 120, the control unit 102 arranges the image data with the larger number of selections at a position farther from the display surface of the display unit 120 based on the meta information of the number of selections. By arranging thumbnail images in this way, the imaging apparatus 100 can extract and present images that are frequently accessed.

When the user selects image data in a state where thumbnail images of a plurality of image data are displayed on the display unit 120, the imaging apparatus 100 adds, adds, or appends / changes to the image data the number of selections as meta information. To do. When displaying the thumbnail image on the display unit 120, the control unit 102 arranges the image data with the selection count of 0 at a position far from the display surface of the display unit 120 based on the meta information of the selection count. . By arranging thumbnail images in this way, the imaging apparatus 100 can extract and present images that have not been browsed by the user yet.

Further, when displaying the thumbnail image on the display unit 120, the control unit 102 displays the protected (or not) image data on the display unit based on the meta information indicating whether the image data is protected. It arrange | positions in the position far from 120 display surfaces. By arranging thumbnail images in this way, the imaging apparatus 100 can intuitively present whether or not image data is protected.

Further, when displaying the thumbnail image on the display unit 120, the control unit 102 selects the image data that has been uploaded (or not) based on the meta information indicating whether the image data has been uploaded on the network. The display unit 120 is disposed at a position far from the display surface. By arranging thumbnail images in this way, the imaging apparatus 100 can intuitively present whether or not image data has been uploaded.

When displaying thumbnail images on the display unit 120, the control unit 102 accesses (or has not) accessed images based on meta information indicating whether or not image data uploaded on the network has been accessed. Data is arranged at a position far from the display surface of the display unit 120. By arranging the thumbnail images in this way, the imaging apparatus 100 can intuitively present whether or not the image data uploaded on the network has been accessed.

By applying the technology described so far for statically arranging thumbnail images in a three-dimensional space based on certain specific meta information, the imaging apparatus 100 causes the user to intentionally switch the reference meta information. It can provide a mechanism that can Here, the switching of the meta information serving as a reference can be provided by a software operation using a hard key or a touch panel. With this mechanism, the imaging apparatus 100 can dynamically change the arrangement state of the thumbnail images in the three-dimensional space.

For example, the imaging apparatus 100 allows the user to select the subject height, the distance from the subject, the odor of the subject, the sound emitted by the subject, and the like that are the reference for arranging the thumbnail images in the three-dimensional space at any timing. A hard key or software mechanism may be provided. When the user switches the reference, the imaging apparatus 100 rearranges the thumbnail images arranged based on the currently selected reference based on the newly selected reference.

In addition, when the imaging apparatus 100 uses the contrast of the subject as a reference for arrangement of the thumbnail images in the three-dimensional space, the imaging apparatus 100 uses a hard key or software mechanism that can adjust the brightness level dynamically. It is also possible to adjust the standard of the brightness level. The imaging apparatus 100 can dynamically change the spatial arrangement of thumbnails using such a mechanism.

FIG. 11 is an explanatory diagram illustrating an example of a user interface that changes the arrangement reference of thumbnail images in the imaging apparatus 100 according to an embodiment of the present disclosure. FIG. 11 shows an example of a user interface when thumbnail images are arranged in a three-dimensional space according to the brightness of the subject. For example, when the meter is set to “bright”, the control unit 102 arranges a subject that is farther from the display surface of the display unit 120 in a three-dimensional space as the subject is brighter and clearer. . On the other hand, when the meter is set to “dark”, the control unit 102 arranges a subject that is farther from the display surface of the display unit 120 in a three-dimensional space as the subject appears darker.

Further, the imaging apparatus 100 may include software that can display a hue circle and a color triangle on the display unit 120 and can specify a specific point by the user. The imaging apparatus 100 allows a user to select a selection position of a color wheel or a color triangle displayed on the display unit 120, thereby displaying a thumbnail image of an image including many color schemes close to the selected color in a three-dimensional space. The display unit 120 is arranged at a position far from the display surface. By displaying the thumbnail image in the three-dimensional space in this way, the imaging apparatus 100 can extract content including more arbitrary colors. By extracting content including more arbitrary colors, the imaging apparatus 100 can extract a specific event or target. For example, the imaging device 100 extracts an image with a strong blue color if an image when going to the sea is extracted, and an image with a strong green color if an image when going to a mountain is extracted. FIG. 12 is an explanatory diagram showing a hue circle and a color triangle.

Further, the imaging apparatus 100 may include a hard key or software mechanism that allows the user to arbitrarily specify the number of subjects. The image capturing apparatus 100 allows the user to set the number of people, so that a thumbnail image of an image showing the number of subjects close to the set number of subjects is placed at a position far from the display surface of the display unit 120 in a three-dimensional space. Deploy. By displaying in this way, the imaging apparatus 100 can dynamically perform an image search with the number of subjects.

So far, the case where the thumbnail image is arranged in the three-dimensional space using one meta information has been described, but the present disclosure is not limited to the example. That is, the present disclosure may arrange thumbnail images in a three-dimensional space using a plurality of meta information.

For example, the imaging apparatus 100 may use two pieces of meta information, that is, the distance to the subject and the expression. When the imaging apparatus 100 uses two pieces of meta information, that is, the distance to the subject and the expression, for example, the thumbnail images are arranged from the left in the order of the distance from the subject, and the expression metadata is used to make the image appear more smiley. May be displayed at a position far from the display surface of the display unit 120.

For example, the imaging apparatus 100 may use two pieces of meta information, that is, the distance to the subject and the height of the subject. When the imaging apparatus 100 uses two pieces of meta information, that is, the distance to the subject and the height of the subject, the thumbnail images are arranged from the left in order of increasing distance to the subject, and further, using the metadata of the height of the subject, You may make it display a higher thing in the position far from the display surface of the display part 120. FIG. FIG. 13 is an explanatory diagram illustrating a concept of displaying a thumbnail image of the imaging apparatus 100. The imaging apparatus 100 displays a thumbnail image using two pieces of meta information, the distance to the subject and the height of the subject. It is explanatory drawing which shows. In FIG. 13, the control unit 102 performs display control on the three-dimensional space so that the higher the subject height, the farther from the display surface of the display unit 120. In addition, the control unit 102 performs display control so that the closer to the subject at the time of imaging with the imaging device 100, the closer to the left side of the display unit 120, and the farther the distance to the subject is to the right side of the display unit 120. That is, in the example shown in FIG. 13, the distance axis to the subject is orthogonal to the height axis of the subject, and the distance axis to the subject is parallel to the display unit 120. Needless to say, these axes may not be completely orthogonal or may not be completely parallel to the display unit 120. For example, the control unit 102 may perform display control of the thumbnail image so that the axes are shifted at an angle in a range of 5 degrees to 10 degrees, for example, from a state in which these axes are orthogonal or parallel.

For example, the imaging apparatus 100 may arrange thumbnail images using three different pieces of meta information. When three pieces of meta information are used, the imaging apparatus 100 performs display control so that the images are displayed in a predetermined order in a direction substantially orthogonal to the display surface of the display unit 120, a horizontal direction and a vertical direction with respect to the display surface of the display unit 120. May be.

In addition, for example, the imaging apparatus 100 includes information related to content other than information on the subject at the time of imaging, such as time information of content, altitude information of the imaging apparatus 100 at the time of imaging, image size information, and face size in an image including a face. Such information may be used or thumbnail images may be arranged.

For example, the imaging apparatus 100 may cause the display unit 120 to display the types of meta information used when the thumbnail images are arranged in the three-dimensional space and the types of usable meta information. FIG. 14 is an explanatory diagram illustrating the concept of displaying thumbnail images of the imaging apparatus 100. The display unit displays the types of meta information used when the thumbnail images are arranged in the three-dimensional space and the types of usable meta information. The example displayed on 120 is shown. In FIG. 14, the arrangement information 161 indicating that the thumbnail image S is displayed in the three-dimensional space using the information on the distance to the subject, and the display of the thumbnail image S in the three-dimensional space are displayed. Information and

available information

162 and 163 indicating that information on the height of the subject is available are shown. The imaging apparatus 100 can cause the user to select the

usable information

162 and 163. When the user selects, for example, the usable information 162 with a finger, the imaging apparatus 100 displays the thumbnail image S in the three-dimensional space using the light / dark information of the subject.

In the above description, it is assumed that the thumbnail image is reflected in the depth of the three-dimensional space when displaying the thumbnail image. However, even if the imaging device cannot express the three-dimensional space, for example, the size of the thumbnail image By enlarging or reducing the image, it is possible to display a thumbnail image with a pseudo depth.

<2. Summary>
As described above, the imaging device 100 according to an embodiment of the present disclosure is more intuitive to the user by using meta information representing a space such as the height of the subject and the distance from the imaging device 100 to the subject. Content can be provided. In addition, the imaging apparatus 100 according to an embodiment of the present disclosure allows a user to operate meta information used as a reference for spatial arrangement of thumbnail images at an arbitrary timing. It will be something.

In addition, the imaging apparatus 100 according to an embodiment of the present disclosure further uses content of face recognition as meta information, and easily provides content with a high degree of biological similarity such as a specific person and a family of the person. It becomes possible to detect. The imaging device 100 according to an embodiment of the present disclosure can extract a specific event or target when the color of content is displayed as a spatial arrangement reference.

Also, the imaging apparatus 100 according to an embodiment of the present disclosure can display the sound generated by the subject as a reference for the spatial arrangement of the thumbnail images. When the sound generated by the subject is displayed as a spatial arrangement reference, the position can be specified even when the subject is blocked by an obstacle. For example, when looking for an animal in a forest and making a sound, the sound source can be identified by displaying the thumbnail image in a three-dimensional space.

In addition, since the imaging apparatus 100 according to an embodiment of the present disclosure can provide the user with an arrangement of content by an arrangement method other than time, a new sense of content providing method that meets the user's preference can be realized. Even when the recording unit for recording image data and the display unit for displaying thumbnail images are provided in different devices, the above-described book is based on the meta information added to the content. Technology content is applicable. Specific examples of the external display device include a personal computer (PC), a mobile phone, a smartphone, a tablet, a portable music player, and a portable game machine.

The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present disclosure belongs can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that these also belong to the technical scope of the present disclosure.

For example, in the above-described embodiment, the example in which the thumbnail images are arranged in the three-dimensional space according to the similarity with the reference image has been described. However, the imaging apparatus 100 may be configured with the similarity with the reference image. After displaying the thumbnail image in the three-dimensional space, the user may be allowed to change the similarity. When the similarity is changed by the user, the similarity is changed by changing the position of the thumbnail image in the depth direction by, for example, pushing the thumbnail image arranged in the three-dimensional space to the user. May be.

For example, the imaging apparatus 100 may control the display of thumbnail images using distance information from a specific point to the subject. The position information of a specific point can be acquired from map information or the like. Further, the position of the subject can be acquired from the position information of the imaging point, the imaging direction, or the like, or the user can input the name of the subject. The image capturing apparatus 100 intuitively presents the distance between the specific point and the subject by controlling the display of the thumbnail image using the position information of the specific point and the position information of the subject thus acquired. I can do it.

Also, for example, each step in processing executed by each device in the present specification does not necessarily have to be processed in time series in the order described as a sequence diagram or a flowchart. For example, each step in the processing executed by each device may be processed in an order different from the order described as the flowchart, or may be processed in parallel.

In addition, it is possible to create a computer program for causing hardware such as CPU, ROM, and RAM incorporated in each device to exhibit functions equivalent to the configuration of each device described above. A storage medium storing the computer program can also be provided. Moreover, a series of processes can also be realized by hardware by configuring each functional block shown in the functional block diagram with hardware.

In addition, this technique can also take the following structures.
(1)
Display of the representative image corresponding to the content so that the content is displayed in a predetermined order in a direction substantially orthogonal to the plane of the display unit based on the first information of the subject included in the content at the time of capturing the content A display control device comprising a display control unit for controlling the display.
(2)
The display control unit is further configured to arrange the content in the direction parallel to the plane of the display unit based on second information different from the first information among the content information. The display control device according to (1), which controls display.
(3)
The display control apparatus according to (2), wherein the second information is information on a subject included in the content.
(4)
The display control device according to any one of (1) to (3), wherein the display control unit controls display of the representative image so as to be seen from the near side from the one that matches the first information.
(5)
The display control device according to any one of (1) to (3), wherein the display control unit controls display of the representative image so as to be seen from the side that matches the first information.
(6)
The display control unit further displays selectable information other than the first information, and controls the display of the representative image by changing the first information when the selectable information is selected. The display control device according to any one of (1) to (5).
(7)
The display control device according to any one of (1) to (6), wherein the display control unit controls display of the representative image using information added to the content after imaging the content.
(8)
The display control device according to (7), wherein the display control unit controls display of the representative image using information on the number of times the content is selected after the content is captured.
(9)
The display control apparatus according to (7) or (8), wherein the display control unit controls display of the representative image using information indicating whether the content is protected after the content is captured.
(10)
The display control device according to any one of (7) to (9), wherein the display control unit controls display of the representative image using information indicating whether or not the content has been uploaded on a network after imaging the content.
(11)
The display control device according to any one of (1) to (10), wherein the display control unit controls display of the representative image using distance information to a subject as the first information.
(12)
The display control device according to any one of (1) to (10), wherein the display control unit controls display of the representative image using a representative height of a subject as the first information.
(13)
The display control device according to any one of (1) to (10), wherein the display control unit controls display of the representative image using a result of structural analysis of a subject as the first information.
(14)
The display control according to any one of (1) to (10), wherein the display control unit controls display of the representative image using distance information from a specific point to a subject as the first information. apparatus.
(15)
Display of the representative image corresponding to the content so that the content is displayed in a predetermined order in a direction substantially orthogonal to the plane of the display unit based on the first information of the subject included in the content at the time of capturing the content A display control method comprising a display control step for controlling the display.
(16)
The display control step further includes, based on the second information different from the first information among the information on the content, the content of the representative image so that the content is arranged in a direction parallel to the plane of the display unit. The display control method according to (16), wherein the display is controlled.
(17)
Based on the first information of the subject included in the content at the time of capturing the content, the representative corresponding to the content is displayed in a predetermined order in a direction substantially orthogonal to the plane of the display unit A computer program for executing a display control step for controlling display of an image.
(18)
An imaging unit for imaging a subject;
Corresponding to the content so as to display in a predetermined order in a direction substantially orthogonal to the plane of the display unit based on the first information of the subject included in the content at the time of imaging the content by the imaging unit An imaging apparatus including a display control unit that controls display of a representative image.

DESCRIPTION OF SYMBOLS 100 Image pick-up device 102 Control part 104 Optical system part 106 Image pick-up element 108 A / D conversion part 110 Digital signal processing 112 Encoding / decoding part 114 Recording controller 116 Recording part 118 Display driver 120 Display part 122 Operation part 124 ROM
126 RAM
128 External I / F

Claims

Display of the representative image corresponding to the content so that the content is displayed in a predetermined order in a direction substantially orthogonal to the plane of the display unit based on the first information of the subject included in the content at the time of capturing the content A display control device comprising a display control unit for controlling the display.
The display control unit is further configured to arrange the content in the direction parallel to the plane of the display unit based on second information different from the first information among the content information. The display control apparatus of Claim 1 which controls a display.
The display control apparatus according to claim 2, wherein the second information is information on a subject included in the content.
The display control apparatus according to claim 1, wherein the display control unit controls the display of the representative image so as to be shown to the near side from the one that matches the first information.
The display control apparatus according to claim 1, wherein the display control unit controls the display of the representative image so as to be seen from the back side in accordance with the first information.
The display control unit further displays selectable information other than the first information, and controls the display of the representative image by changing the first information when the selectable information is selected. The display control apparatus according to claim 1.
The display control apparatus according to claim 1, wherein the display control unit controls display of the representative image using information added to the content after the content is captured.
The display control apparatus according to claim 7, wherein the display control unit controls display of the representative image using information on the number of times the content is selected after the content is captured.
The display control apparatus according to claim 7, wherein the display control unit controls display of the representative image using information indicating whether or not the content is protected after the content is captured.
The display control apparatus according to claim 7, wherein the display control unit controls display of the representative image using information indicating whether or not the content has been uploaded on a network after imaging of the content.
The display control apparatus according to claim 1, wherein the display control unit controls display of the representative image using distance information to a subject as the first information.
The display control apparatus according to claim 1, wherein the display control unit controls display of the representative image using a representative height of a subject as the first information.
The display control apparatus according to claim 1, wherein the display control unit controls display of the representative image using a result of structural analysis of a subject as the first information.
The display control apparatus according to claim 1, wherein the display control unit controls display of the representative image using distance information from a specific point to a subject as the first information.
Display of the representative image corresponding to the content so that the content is displayed in a predetermined order in a direction substantially orthogonal to the plane of the display unit based on the first information of the subject included in the content at the time of capturing the content A display control method comprising the step of controlling.
The step of controlling the display further includes, based on the second information different from the first information among the information of the content, the representative so as to arrange the content in a direction parallel to the plane of the display unit. The display control method according to claim 15, wherein the display of the image is controlled.
Based on the first information of the subject included in the content at the time of capturing the content, the representative corresponding to the content is displayed in a predetermined order in a direction substantially orthogonal to the plane of the display unit A computer program for executing a step of controlling display of an image.