JP6712058B2 - Terminal device, information processing method, information processing program, and information processing device - Google Patents

Description

The present invention relates to a terminal device, an information processing method, an information processing program, and an information processing device.

In some cases, a digital camera or smartphone (hereinafter, referred to as a smartphone, etc.) in possession is given to a third party, and a photograph or a video (hereinafter, referred to as a photograph, etc.) is requested to be taken.

JP, 2005-95082, A

In many cases, smartphones and the like also store private content that the third party does not want to view, such as private photos of the owner. Therefore, if a smartphone or the like is handed over to a third party, the private content may be viewed by the third party. Therefore, it is conceivable to set the access right to the content before handing the smartphone or the like to a third party, but the setting takes time and effort. Further, if the access right setting is inappropriate, there is a possibility that a third party can view the private content, or the content that may be viewed by the third party cannot be displayed.

Therefore, it is an object of one aspect of the disclosed technology to provide a terminal device that can easily limit the reproduction of content that a third party does not want to reproduce.

One aspect of the disclosed technique is exemplified by the following terminal device. The terminal device includes a recording unit and a control unit. The recording unit records the feature information acquired from the operator who performed the recording operation and the content recorded by the recording operation in association with each other. When requested to reproduce the recorded content, the control unit reproduces the content associated with the characteristic information that matches the characteristic information of the requester. The control unit deletes the characteristic information associated with the recorded content when a certain time has elapsed since the recorded content was recorded.

The terminal device can easily limit the reproduction of the content that the third party does not want to reproduce.

FIG. 1 is a diagram illustrating an example of a front view of a smartphone according to an embodiment. FIG. 2 is a diagram showing an example of a rear view of the smartphone according to the embodiment. FIG. 3 is a diagram illustrating an example of a hardware configuration of a smartphone. FIG. 4 is a diagram illustrating an example of processing blocks of a smartphone. FIG. 5 is an example of an image diagram of a state in which a subject photograph and a photographer photograph are associated with each other. FIG. 6 is a diagram exemplifying a case where the owner of the smartphone requests a third party to shoot. FIG. 7 is a diagram showing an example of a scene in which a third party confirms a subject photograph of himself/herself with a smartphone. FIG. 8 is a diagram showing an example of a processing flow at the time of photographing a subject. FIG. 9 is a diagram showing an example of a scene where a picture is taken in OP2 and OP3 of FIG. FIG. 10 is a diagram showing an example of a processing flow at the time of browsing a photo. FIG. 11: is a figure which illustrates the state which the third party is browsing the photo which the browsing photo extraction part extracted. FIG. 12 is a diagram illustrating an example of a processing flow for deleting a photographer photograph. FIG. 13 is a diagram illustrating an example of a smartphone including a fingerprint authentication unit. FIG. 14 is a diagram showing an example of a system according to the fifth modification. FIG. 15 is a diagram illustrating an example of the hardware configuration of the server according to the fifth modification. FIG. 16: is a figure which shows an example of the processing block of the smart phone which concerns on a 5th modification. FIG. 17 is a diagram illustrating an example of processing blocks of the server according to the fifth modification. FIG. 18 is a diagram showing an example of a processing flow of the smartphone at the time of photographing a subject. FIG. 19 is a diagram showing an example of a processing flow of the server at the time of photographing a subject. FIG. 20 is a diagram illustrating an example of a processing flow of the smartphone when browsing a photo. FIG. 21 is a first diagram showing an example of the processing flow of the server when browsing a photograph. FIG. 22 is a second diagram showing an example of the processing flow of the server at the time of browsing a photograph.

Hereinafter, a smartphone according to an embodiment will be described with reference to the drawings. The configurations of the embodiments described below are examples, and the disclosed technology is not limited to the configurations of the embodiments.

<Embodiment>
In the embodiment, a smartphone that can restrict the reproduction of content is exemplified. The content may be, for example, either an image or a sound. The image may be either a still image or a moving image. In the embodiment, a photograph is exemplified as the content. The reproduction of the content includes the display of the image and the reproduction of the sound. 1 and 2 are diagrams illustrating an example of the smartphone 10 according to the embodiment. FIG. 1 is a diagram showing an example of a front view of the smartphone 10, and FIG. 2 is a diagram showing an example of a rear view of the smartphone 10. The smartphone 10 is a portable information processing device. The smartphone 10 includes an in-camera 11 a, a speaker 12, a display 13, a touch panel 14 and a microphone 15 which are arranged so as to overlap with the display 13, on the front surface thereof. Further, the smartphone 10 includes an out camera 11b on the back surface thereof. A shooting button 16 is displayed on the display 13. In addition, the front surface of the smartphone 10 is, for example, a surface provided with the display 13, and the back surface of the smartphone 10 is, for example, a surface opposite to the side provided with the display 13. The smartphone 10 is an example of a “terminal device”.

The speaker 12 is a device that outputs sound. The microphone 15 is a device that receives a voice input. The display 13 is a device capable of displaying still images and moving images. The touch panel 14 is provided so as to be superimposed on the display 13 and detects an input by a touch operation. Hereinafter, in this specification, the detection by the touch panel 14 of the input by the touch operation is referred to as “touched”.

The display 13 outputs, for example, data processed by the CPU included in the smartphone 10 or data stored in the storage unit. Examples of the display 13 include devices such as Liquid Crystal Display (LCD), Electroluminescence (EL) panel, and organic EL panel.

The shooting button 16 is a button that triggers shooting with the in-camera 11a and the out-camera 11b. The shooting button 16 is displayed on the display 13. When the shooting button 16 is touched, the in-camera 11a and the out-camera 11b shoot.

The out camera 11b is an optical camera. The out-camera 11b is provided on the back surface of the smartphone 10. The out-camera 11b shoots a person, a landscape, and the like by touching the shooting button 16, for example. In FIG. 2, the out camera 11b is provided on the upper part of the back surface of the smartphone 10, but the position of the out camera 11b is not limited to the upper part of the back surface of the smartphone 10. The out-camera 11b may be provided in the lower part of the back surface of the smartphone 10, for example. The out-camera 11b may be provided at a position where a person, a landscape, or the like can be photographed when the user holds and operates the smartphone 10. The out-camera 11b is an example of a “first camera”.

The in-camera 11a is an optical camera. The in-camera 11a is provided on the front surface of the smartphone 10. The in-camera 11a, for example, when the shooting button 16 is touched, shoots the user who uses the out-camera 11b to shoot. In FIG. 1, the in-camera 11 a is provided above the display 13, but the position of the in-camera 11 a is not limited to the upper part of the display 13. The in-camera 11a may be provided below the display 13, for example. The in-camera 11a should just be provided in the position which can image the said user, when a user hold|maintains the smart phone 10 and operates it. The in-camera 11a is an example of a "second camera". Hereinafter, in this specification, the in-camera 11a and the out-camera 11b are collectively referred to as the camera 11.

FIG. 3 is a diagram illustrating an example of the hardware configuration of the smartphone 10. The smartphone 10 includes a Central Processing Unit (CPU) 101, a main storage unit 102, and an auxiliary storage unit 1.
03, display 13, touch panel 14, in-camera 11a, out-camera 11b, microphone 15, and communication unit 109. The CPU 101, the main storage unit 102, the auxiliary storage unit 103, the display 13, the touch panel 14, the in-camera 11a, the out-camera 11b, the microphone 15, and the communication unit 109 are mutually connected by the connection bus C1.

In the smartphone 10, the CPU 101 expands the program stored in the auxiliary storage unit 103 into the work area of the main storage unit 102, and controls the peripheral devices through the execution of the program. As a result, the smartphone 10 can execute the processing that matches the predetermined purpose. The main storage unit 102 and the auxiliary storage unit 103 are recording media that the smartphone 10 can read.

The main storage unit 102 is exemplified as a storage unit that is directly accessed by the CPU 101. The main storage unit 102 includes a Random Access Memory (RAM) and a Read Only Memory (ROM).

The auxiliary storage unit 103 stores various programs and various data in a recording medium in a readable and writable manner. The auxiliary storage unit 103 is also called an external storage device. The auxiliary storage unit 103 stores an operating system (OS), various programs, various tables, and the like. The OS includes a communication interface program that exchanges data with an external device or the like connected via the communication unit 109. The external device and the like include, for example, another information processing device and an external storage device connected by a computer network or the like. Further, the auxiliary storage unit 103 stores, for example, image data of an image captured by the camera 11 and voice data of voice input to the microphone 15.

The auxiliary storage unit 103 is, for example, an Erasable Programmable ROM (EPROM), a solid state drive (Solid State Drive, SSD), a hard disk drive (Hard Disk).
Drive, HDD). The auxiliary storage unit 103 is, for example, a Compact Disc (CD) drive device, a Digital Versatile Disc (DVD) drive device, a Blu-ray (registered trademark) Disc (BD) drive device, or the like. The auxiliary storage unit 103 may be, for example, a part of a cloud system that is a computer group on the network.

The recording medium that can be read by the smartphone 10 refers to a recording medium that can store information such as data and programs by electrical, magnetic, optical, mechanical, or chemical action and can be read by the smartphone 10. Among such recording media, those removable from the smartphone 10 include, for example, a flexible disk, a magneto-optical disk, a CD-ROM, a CD-R/W, a DVD, a Blu-ray disk, a DAT, an 8 mm tape, a flash memory, and the like. There are cards, etc. A hard disk, SSD, ROM, or the like is a recording medium fixed to the smartphone 10.

As described above, the display 13 outputs the data processed by the CPU 101 and the data stored in the main storage unit 102 or the auxiliary storage unit 103. As described above, the touch panel 14 is a device that receives an input by a touch operation, and is provided so as to be superimposed on the display 13.

The communication unit 109 is, for example, an interface with a wireless or wired computer network. The communication unit 109 communicates with an external device via a wireless or wired computer network.

<Processing block of smartphone 10>
FIG. 4 is a diagram illustrating an example of processing blocks of the smartphone 10. The smartphone 10 includes an authentication processing unit 201, a tag processing unit 202, a browsing photo extraction unit 203, a subject photo storage unit 204, and a photographer photo storage unit 205. In the smartphone 10, when the CPU 101 executes the computer program that is executably expanded in the main storage unit 102, the authentication processing unit 201, the tagging processing unit 202, the browsing photo extraction unit 203, and the subject photo storage of the smartphone 10 described above. Processing is performed as each unit such as the unit 204 and the photographer photo storage unit 205. The CPU 101 is also called a Microprocessor (MPU) or processor. The CPU 101 is not limited to a single processor, and may have a multiprocessor configuration. Also, a single CPU 101 connected by a single socket may have a multi-core configuration. At least a part of the processing of each of the above units may be performed by a processor other than the CPU 101, for example, a dedicated processor such as a Digital Signal Processor (DSP), a Graphics Processing Unit (GPU), a numerical operation processor, a vector processor, or an image processing processor. good. Further, the processing of at least a part of each of the above units may be performed by an integrated circuit (IC) or other digital circuits. Further, an analog circuit may be included in at least part of each of the above units. Integrated circuits include LSI, Application Specific Integrated Circuit (ASIC),
Includes a programmable logic device (PLD). The PLD includes, for example, a Field-Programmable Gate Array (FPGA). Each of the above units may be a combination of a processor and an integrated circuit. The combination is called, for example, a microcontroller (MCU), System-on-a-chip (SoC), system LSI, chip set, or the like.

The subject photo storage unit 204 stores the image file of the subject photo taken by the out camera 11b in the auxiliary storage unit 103. The photographer photo storage unit 205 stores the image file of the photographer photo taken by the in-camera 11 a in the auxiliary storage unit 103. The subject photograph is an example of “content”. The subject photograph storage unit 204 is an example of a “recording unit”.

The tagging processing unit 202 associates the image file of the subject photograph taken by the out camera 11b with the image file of the photographer photographed by the in camera 11a when the subject photograph was taken. The association is performed, for example, by registering the path name of the image file relating to the photographer's photograph in the Exchangeable image file format (Exif) area of the image file relating to the subject photograph. The Exif area is, for example, an area for storing metadata including information indicating the date and time when the photograph was taken. FIG. 5 is an example of an image diagram of a state in which a subject photograph and a photographer photograph are associated with each other. The tagging processing unit 202, for example, registers the path name of the image file relating to the photographer's photograph in the Exif area. By registering the path name of the image file relating to the photographer's photograph in the Exif area, as illustrated in FIG. 5, the subject photograph and the photographer photograph of the photographer who photographed the subject photograph are associated with each other. Hereinafter, in the present specification, the path name of the image file related to the subject photograph and the path name of the image file related to the photographer photograph are also referred to as a path name of the subject photograph and a path name of the photographer photograph, respectively. The tagged processing unit 202 is an example of a “recording unit”.

The browsing photo extraction unit 203 receives a browsing request for the subject photo stored in the auxiliary storage unit 103. When the browsing photo extraction unit 203 receives a browsing request for the subject photo, the browsing photo extraction unit 203 reads an image file of the subject photo from the auxiliary storage unit 103. The browsing photo extraction unit 203 instructs the authentication processing unit 201 to perform an authentication process on the read image file of the subject photo. The browsing photo extraction unit 203 extracts the image file of the subject photo authenticated by the authentication processing unit 201 as a browsable image file. The browsing photo extraction unit 203 is an example of a “control unit”.

The authentication processing unit 201 takes a requester photograph including the face of the browse requester with the in-camera 11a. The authentication processing unit 201 extracts the feature information of the face of the browse requester from the photographed requester photograph. The authentication processing unit 201 extracts the photographer photograph associated with the image file of the subject photograph requested to be authenticated by the browse photograph extracting unit 203. The browsed photo extraction unit 203 extracts feature information of the photographer's face from the extracted photographer's photo. The authentication processing unit 201 determines whether or not the face feature information of the browse requester and the face feature information of the photographer match. The authentication processing unit 201 notifies the browsing photo extraction unit 203 of the determination result. The authentication processing unit 201 is an example of a “control unit”.

FIG. 6 is a diagram illustrating a case where the owner A of the smartphone 10 requests the third party B to shoot. As illustrated in FIG. 6, when the principal A requests the third party B to take a picture, the principal A hands the smartphone 10 owned by the person A to the third party B. The third party B holds the handed out camera 11b of the smartphone 10 toward the person A. When the out-camera 11b is turned to the person A, the in-camera 11a of the smartphone 10 is turned to the third party B. The third party B touches the shooting button 16 while holding the smartphone 10 toward the person A. When the shooting button 16 is touched, a picture of the person A is taken by the out camera 11b and a picture of the third party B is taken by the in camera 11a.

FIG. 7 is a diagram showing an example of a scene in which the third party B confirms a subject photograph of the person A with the smartphone 10. The smartphone 10 also stores a photograph taken by a person other than the third party B. The pictures stored in the smartphone 10 include, for example, a private picture of the person A. Here, in order to confirm the shooting result of the subject photograph, the third party B only needs to be able to browse the photographs taken by the third party B, and may not be able to browse the other photographs. Therefore, the smartphone 10 according to the embodiment allows the third party B to browse the photos taken by the third party B and prohibits the browsing of other photos. Hereinafter, with reference to the drawings, a processing flow according to the embodiment during photographing and browsing will be described.

<Processing flow when shooting>
FIG. 8 is a diagram showing an example of a processing flow at the time of photographing a subject. The process of FIG. 8 is executed, for example, when the third party B requested to shoot touches the shooting button 16.

In OP1, the photographer photo storage unit 205 focuses the in-camera 11a on the third party B who is the photographer. In OP2, the photographer photograph storage unit 205 takes a photographer photograph, which is a photographer's photograph, with the in-camera 11a. Here, since the photographer is the third party B, the in-camera 11a takes a photograph of the third party B as the photographer's photograph. The photographer photograph storage unit 205 stores the photographed photographer of the third party B in the auxiliary storage unit 103. The third party B is an example of the “operator who performed the recording operation”. The photographer's photograph is an example of “feature information acquired from the operator who performed the recording operation”.

In OP3, the subject photo storage unit 204 takes a subject photo of the subject to which the out camera 11b is directed. Here, since the out-camera 11b is aimed at the person A, the out-camera 11b takes a subject photograph of the person A. The subject photograph storage unit 204 stores the photographed subject photograph of the person A in the auxiliary storage unit 103. FIG. 9 is a diagram showing an example of a scene where a picture is taken in OP2 and OP3 of FIG. As illustrated in FIG. 9, when the photographing button 16 is touched by the third party B, the in-camera 11 a directed to the third party B takes a photographer's photograph of the third party B, and the person A is given to the person A. The aimed out-camera 11b takes a photograph of the subject of the person A. The operation of touching the shooting button 16 to shoot a subject photograph is an example of a “recording operation”.

In OP4, the tagging processing unit 202 associates the subject photograph of the principal A photographed in OP3 with the photographer photograph of the third party B photographed in OP2. The association is performed, for example, by registering the path name of the photographer photograph of the third party B in the Exif area related to the image data of the subject photograph of the principal A.

<Processing flow when browsing>
FIG. 10 is a diagram showing an example of a processing flow at the time of browsing a photo. Hereinafter, with reference to FIG. 10, an example of a processing flow at the time of browsing a photo will be described.

In OP11, the browsed photo extraction unit 203 receives a photo browse request. The browsing photo extraction unit 203 instructs the authentication processing unit 201 to photograph the third party B who has requested the browsing using the in-camera 11a. The authentication processing unit 201 uses the in-camera 11a to take a photograph of the face of the third party B who has made a browsing request. The authentication processing unit 201 extracts feature information of the face of the third party B from the photographed image. In OP12, the browsed photo extracting unit 203 determines whether or not the browsing of the photo is completed. When the browsing of the photo ends, the termination of the browsing program for browsing the photo is exemplified. When the browsing ends (YES in OP12), the browsing ends. If the browsing has not ended (NO in OP12), the process proceeds to OP13.

In OP13, the browsing photo extraction unit 203 determines whether or not the subject photo is stored in the auxiliary storage unit 103. If the subject photograph is not stored (NO in OP13), the process proceeds to OP12. If the subject photograph is stored (YES in OP13), the process proceeds to OP14.

In OP14, the browsing photo extraction unit 203 reads out one of the subject photos stored in the auxiliary storage unit 103. The browsing photo extraction unit 203 requests the authentication processing unit 201 to authenticate the read subject photo. The authentication processing unit 201 extracts the feature information of the photographer's face included in the photographer's photograph associated with the subject photograph whose authentication is requested.

In OP15, the authentication processing unit 201 determines whether the feature information extracted in OP11 and the feature information extracted in OP14 match. If they match (YES in OP15), the process proceeds to OP16. If they do not match (NO in OP15), the process proceeds to OP13.

In OP16, the browsed photo extraction unit 203 outputs the subject photo read in OP14 to the display 13 as a viewable photo. By the processing of OP13 to OP16, a photograph in which the characteristic information extracted in OP11 and the characteristic information extracted in OP14 match is output to the display 13. FIG. 11 is a diagram exemplifying a state in which the third party B is browsing the photos extracted by the browsing photo extraction unit 203. The third party B can browse the photo determined to be taken by the third party B by the browsed photo extraction unit 203 and the authentication processing unit 201. On the other hand, the browsing of the photo that is not determined by the browsing photo extraction unit 203 and the authentication processing unit 201 to be taken by the third party B is restricted.

<Processing flow for deleting photographer photo>
It is not preferable from the viewpoint of protecting the privacy of the third party B to keep the photographer's photograph of the third party B stored in the smartphone 10 even after the confirmation of the subject photograph by the third party B is finished. There are cases. Furthermore, if the third party B who requested the shooting is a stranger who is passing by, it may be sufficient if the photograph of the subject can be confirmed after the shooting. On the other hand, when the third party B who requested the photographing is a family member or a friend of the person A, it may be preferable for the third party B to maintain a state in which the subject photograph can be viewed. Therefore, the smartphone 10 according to the embodiment executes a process of deleting the photographer photograph after a certain period of time has elapsed. Furthermore, the smartphone 10 according to the embodiment does not delete the photographer photograph for which retention is set even after a certain period of time has elapsed. FIG. 12 is a diagram illustrating an example of a processing flow for deleting a photographer photograph. An example of the processing flow for deleting the photographer's photograph will be described with reference to FIG.

In OP21, the tagged processing unit 202 refers to the auxiliary storage unit 103 and determines whether or not there is a subject photograph to be processed. The subject photograph to be processed is, for example, a subject photograph that is not set to be retained. The setting of holding will be described later. If there is a subject photograph to be processed (YES in OP21), the process proceeds to OP22. When there is no subject photograph to be processed (NO in OP21), the processing flow of FIG. 12 ends.

In OP22, the tagged processing unit 202 reads one of the subject photographs stored in the auxiliary storage unit 103. The tagging processing unit 202 determines whether or not there is a photographer photograph associated with the read subject photograph. In this determination, for example, when the path name of the photographer photograph is registered in the Exif information of the subject photograph, it is determined that there is a photographer photograph associated with the subject photograph. Further, in this determination, for example, when the path name of the photographer photograph is not registered in the Exif information of the subject photograph, it is determined that there is no photographer photograph associated with the subject photograph. If there is a photographer photograph associated with the subject photograph (YES in OP22), the process proceeds to OP23. If there is no photographer photograph associated with the subject photograph (NO in OP22), the process proceeds to OP21.

In OP23, the tagged processing unit 202 determines whether or not the subject photograph read in OP22 is set to be retained. In this determination, for example, when information indicating retention is registered in the Exif information of the subject photograph, it is determined that retention is set. Further, in this determination, for example, when information indicating retention is not registered in the Exif information of the subject photograph, it is determined that retention is not set. If the holding setting has been made (YES in OP23), the process proceeds to OP21. When the holding setting is not made (NO in OP23), the process proceeds to OP24.

In OP24, the tagging processing unit 202 determines whether or not a certain time has elapsed since the subject photograph read in OP22 was taken. The certain period of time may be appropriately set, for example, assuming a period of time from when the subject photograph is taken by the third party B until the confirmation of the subject photograph taken by the third party B is completed. When the fixed time has elapsed (YES in OP24), the process proceeds to OP27. When the fixed time has not elapsed (NO in OP24), the process proceeds to OP25.

In OP25, the tagged processing unit 202 determines whether or not the holding setting has been requested. The holding setting request can be received by a touch operation on the touch panel 14, for example. When the request for holding setting is received (YES in OP25), the process proceeds to OP26. When the request for holding setting is not accepted (NO in OP25), the process proceeds to OP27.

In OP26, the tagged processing unit 202 makes a setting for holding the subject photograph read in OP22. The tagging processing unit 202 registers, for example, information indicating retention in the Exif information of the subject photograph.

In OP27, the tagged processing unit 202 deletes the path name of the photographer photograph from the Exif area of the subject photograph read in OP22. Furthermore, the tagging processing unit 202 deletes the photographer photo that is not associated with any of the subject photos from the photographer photo storage unit 205. After that, the processing advances to OP21.

<Operation and effect of the embodiment>
In the embodiment, the tagged processing unit 202 associates the subject photograph with the photographer photographer of the photographer who took the subject photograph. When the browsing photo extraction unit 203 receives the browsing request, the browsing photo extracting unit 203 takes a photograph including the face of the browsing requester who has issued the browsing request. The authentication processing unit 201 extracts the feature information that identifies the browse requester from the photograph of the browse requester taken. Furthermore, the authentication processing unit 201 extracts the photographer's characteristic information from the photographer's photograph associated with the subject photograph. The browsed photo extraction unit 203 determines that a subject photo in which the feature information of the photographer and the feature information of the browse requester match is viewable, and determines that the subject photo that does not match is unviewable. Therefore, according to the embodiment, it is possible to easily restrict the browsing requester from browsing the photos that have not been taken by the browsing requester. In other words, it is possible to restrict the browsing of the photos that have not been taken by the browsing requester without making a troublesome setting.

In the embodiment, when the photographing button 16 is touched, the photographer photograph including the photographer's face is photographed by the in-camera 11a. The photographer photographed was used to authenticate the request to view the subject photograph. Therefore, according to the embodiment, it is possible to restrict the browsing of the subject photograph without setting the access right. Further, according to the embodiment, even if the access right is not set, the photographer who took the subject photograph is permitted to browse. Furthermore, by using the photographer's photograph including the photographer's face as the characteristic information, it is possible to restrict viewing of the subject photograph without using an additional device such as a fingerprint authentication device.

In the embodiment, the photographer photograph associated with the subject photograph is deleted when a certain period of time has elapsed after the subject photograph was taken. Therefore, according to the embodiment, the photographer's privacy is taken into consideration by deleting the photographer's photograph of the photographer who took the subject photograph.

In the embodiment, by setting the retention setting, the photographer photograph associated with the subject photograph is not deleted even after a certain time has elapsed after the subject photograph was taken. Therefore, according to the embodiment, the photographer identified by the photographer's photograph for which the holding setting has been performed can browse the subject photograph even after the elapse of a certain time.

<First Modification>
In the embodiment, the tagging processing unit 202 associates the subject photograph with the photographer by registering the path name of the photographer photograph in the Exif area of the subject photograph. However, the association between the subject photograph and the photographer is not limited to such a method. To associate the subject photograph with the photographer, for example, data indicating the characteristic information extracted from the photograph of the photographer may be registered in the Exif area of the subject photograph. Further, as for the association between the subject photograph and the photographer, for example, a table that associates the path name of the subject photograph with the path name of the photographer photograph may be stored in the auxiliary storage unit 103.

<Second Modification>
In the embodiment, the face feature information is used as the photographer feature information. However, the feature information of the photographer is not limited to the face feature information. For example, the photographer's fingerprint may be adopted as the photographer's characteristic information. FIG. 13 is a diagram illustrating an example of the smartphone 10 a including the fingerprint authentication unit 17. The fingerprint authentication unit 17 is a device that reads a fingerprint from a finger superimposed on the fingerprint authentication unit 17. When the fingerprint is used as the information for identifying the photographer, the smartphone 10a may read the fingerprint superimposed on the fingerprint authentication unit 17 at the time of photographing the subject photograph and associate the read fingerprint with the photographed subject photograph. Further, the photographer's characteristic information may be biometric information such as an iris or a voice print.

<Third Modification>
Although the embodiment is exemplified by the smartphone 10, the embodiment may be exemplified by another information processing device. The other information processing device is, for example, a tablet personal computer.
(Tablet PC), laptop computer, digital camera, digital video camera, mobile phone or voice recorder.

<Fourth Modification>
In the embodiment, browsing of a subject photograph that has not been taken by the browsing requester is restricted. However, the browsing is not limited to the subject photograph, and the browsing of the moving image may be limited, for example. In this case, the moving image file may be associated with the characteristic information of the photographer who took the moving image. Also, the reproduction of audio data may be restricted. When the reproduction of the audio data is restricted, the audio data and the characteristic information of the person who recorded the audio data may be associated with each other.

<Fifth Modification>
In the embodiment, the taken photograph is stored in the auxiliary storage unit 103 of the smartphone 10. In addition, in the embodiment, the smartphone 10 performs authentication and the like when browsing a photo. In the fifth modified example, the photographed picture is stored in a storage connected to the network. Further, in the fifth modified example, a server that can access the storage in which the photos are stored performs processing such as authentication. The same components as those in the embodiment and the first to fourth modifications are designated by the same reference numerals, and the description thereof will be omitted. Hereinafter, the fifth modified example will be described with reference to the drawings.

FIG. 14 is a diagram showing an example of a system 30 according to the fifth modification. The system 30 includes a smartphone 10b and a server 31. The server 31 includes a storage 32. The smartphone 10b and the server 31 are mutually connected by the network N1.

The network N1 is a network that connects the information processing devices so that they can communicate with each other. The network N1 may be wireless or wired. The network N1 is, for example, the Internet.

The smart phone 10b is different from the smart phone 10 according to the embodiment in that the smart phone 10b transmits the taken photo to the server 31 and requests the server 31 to perform an authentication process when viewing the photo. The smartphone 10b has the same configuration as the hardware configuration illustrated in FIG. 3, for example.

The server 31 is, for example, an information processing device having a CPU faster than the smartphone 10b, a large capacity memory, and high fault tolerance. The server 31 receives a login request from the smartphone 10b. The image file of the photo transmitted from the smartphone 10b is stored in the storage 32. The server 31 is an example of an “information processing device”.

The storage 32 is a storage device. The storage 32 is, for example, a redundant array of independent disks (RAID) system in which a plurality of HDDs are combined and made redundant. The storage 32 includes, for example, Universal Serial Bus (USB), Fiber Channel (
FC), Small Computer System Interface (SCSI), and Internet Small Computer System Interface (iSCSI) to connect to the server 31. The storage area on the storage 32 includes an area associated with an account that logs in to the server 31. Hereinafter, in this specification, the area associated with the logged-in account is referred to as an account area. The image file received from the server 31 is stored in the account area. The storage 32 is an example of a “recording unit”.

<Hardware configuration>
FIG. 15 is a diagram illustrating an example of the hardware configuration of the server 31 according to the fifth modification. The server 31 includes a CPU 101, a main storage unit 102, an auxiliary storage unit 103, and a communication unit 109. In the server 31, the CPU 101, the main storage unit 102, the auxiliary storage unit 103, and the communication unit 109 are mutually connected by the connection bus B1. The auxiliary storage unit 103 of the server 31 includes a storage 32 that is a storage device.

The server 31 may further include, for example, an input unit that receives an operation instruction or the like from a user or the like. Examples of such an input unit include an input device such as a keyboard, a pointing device, a touch panel, an acceleration sensor, or a voice input device.

The server 31 may include, for example, an output unit that outputs data processed by the CPU 101 and data stored in the main storage unit 102. As such an output unit, an output device such as a Cathode Ray Tube (CRT) display, a Liquid Crystal Display (LCD), a Plasma Display Panel (PDP), an Electroluminescence (EL) panel, an organic EL panel or a printer can be exemplified.

<Processing block>
FIG. 16: is a figure which shows an example of the processing block of the smart phone 10b which concerns on a 5th modification. In FIG. 16, the login requesting unit 201a, the tagging requesting unit 202b, the extraction requesting unit 203b, the subject photograph photographing unit 204b, and the photographer photograph photographing unit 205b are illustrated.

The login request unit 201a requests the server 31 to log in. The login request is made, for example, by transmitting a login request including a set of user ID and password.

The subject photograph taking unit 204b takes a subject photograph with the out camera 11b. The photographer photographer 205b photographs the photographer with the in-camera 11a.

The tagging request unit 202b associates the image file of the subject photographed by the out-camera 11b with the image file of the photographer photographed by the in-camera 11a when the subject photograph is photographed with the server 31. Request.

The extraction requesting unit 203b receives a browsing request for the subject photograph. When the extraction requesting unit 203b receives the browse request for the subject photograph, the in-camera 11a takes a photograph of the requester including the face of the browse requester. The extraction requesting unit 203b transmits the photographed requester photograph to the server 31 and requests the server 31 to extract a viewable subject photograph.

FIG. 17 is a diagram illustrating an example of processing blocks of the server 31 according to the fifth modification. In FIG. 17, the authentication processing unit 301, the tagging processing unit 302, the browsed photo extraction unit 303, the photo storage unit 304, and the login reception unit 305 are illustrated. Hereinafter, an example of a processing block of the server 31 will be described with reference to FIG.

The authentication processing unit 301 receives the requester photograph from the smartphone 10b. The authentication processing unit 301 extracts the face feature information of the browse requester from the received requester photo. The authentication processing unit 301 extracts the photographer photograph associated with the image file of the subject photograph requested to be authenticated by the smartphone 10b. The browsing photo extraction unit 303 extracts feature information of the photographer's face from the extracted photographer's photograph. The authentication processing unit 301 determines whether or not the facial feature information of the browse requester and the facial feature information of the photographer match.

The tagging processing unit 302 associates the image file of the subject photograph received from the smartphone 10b with the image file of the photographer photograph. The association is performed, for example, by registering the Uniform Resource Identifier (URI) of the image file of the photographer's photograph in the Exif area of the image file of the subject photograph. The Exif area is, for example, an area for storing metadata including information indicating the date and time when the photograph was taken. Hereinafter, in the present specification, the URI of the image file related to the subject photograph and the URI of the image file related to the photographer photograph are also referred to as the URI of the subject photograph and the URI of the photographer photograph, respectively.

The browsed photo extraction unit 303 receives a browse request for a subject photo. When the browsing photo extraction unit 303 receives the browsing request for the subject photo, the browsing photo extraction unit 303 reads the subject photo from the storage 32. The browsing photo extraction unit 303 instructs the authentication processing unit 301 to perform an authentication process on the read subject photograph. The browsed photo extraction unit 303 transmits the image file of the subject photo authenticated by the authentication processing unit 301 to the smartphone 10b as a viewable image file.

The photo storage unit 304 stores the image file of the subject photograph and the image file of the photographer photograph received from the smartphone 10b in the storage 32.

The login reception unit 305 receives a login request from the smartphone 10b. The login reception unit 305 performs login authentication, for example, based on whether or not the set of user ID and password included in the login request matches the set of user ID and password stored in the server 31.

<Processing flow>
18 to 22 are diagrams showing an example of the processing flow of the fifth modified example. Hereinafter, an example of the processing flow of the fifth modification will be described with reference to FIGS. 18 to 22.

FIG. 18 is a diagram showing an example of a processing flow of the smartphone 10b at the time of photographing a subject. 18 is a modification of the processing described in FIG. 8 according to the fifth modification. Hereinafter, with reference to FIG. 18, an example of a processing flow of the smartphone 10b at the time of photographing a subject will be described.

In SP1, the login request unit 201a sends a login request to the server 31 to request login. If the login is successful (YES in SP2), the process proceeds to SP3. If the login fails (NO in SP2), the server 31 is notified of the login failure, and the process ends.

In SP3, the photographer photograph taking section 205b takes a photographer photograph, which is a photograph of the photographer, with the in-camera 11a. The photographer is assumed to be the third party B as in FIG. Therefore, the in-camera 11a takes a photograph of the third party B as a photographer's photograph. The photographer photograph taking unit 205b temporarily stores the photographed photographer of the third party B in the main storage unit 102 of the smartphone 10b.

In SP4, the subject photograph taking unit 204b takes a subject photograph of the subject to which the out camera 11b is directed. The subject is the person A as in FIG. Therefore, the out-camera 11b takes a subject photograph of the person A. The subject photograph photographing unit 204b temporarily stores the photographed subject photograph of the person A in the main storage unit 102 of the smartphone 10b.

In SP5, the tagging requesting unit 202b transmits an association request for associating the subject photograph temporarily stored in the main storage unit 102 with the photographer photograph to the server 31. The association request includes the subject photograph and the photographer photograph. The association request transmitted in SP5 is an example of a “storage request”.

FIG. 19 is a diagram showing an example of a processing flow of the server 31 at the time of photographing a subject. Hereinafter, with reference to FIG. 19, an example of a processing flow of the server 31 at the time of photographing a subject will be described.

In SP11, the login reception unit 305 receives a login request from the smartphone 10b. The login request accepted in SP11 is transmitted from the smartphone 10b in SP1 of FIG. 18, for example. If the login is successful (YES in SP12), the process proceeds to SP13. If the login fails (NO in SP12), the process proceeds to SP16.

In SP13, the photograph storage unit 304 receives the subject photograph and the photographer photograph transmitted from the smartphone 10b. The photo storage unit 304 that executes the processing of SP13 is an example of a “reception unit”.

In SP14, the photo storage unit 304 stores the received subject photo and photographer photo in the account area on the storage 32. In SP15, the tagged processing unit 302 associates the subject photograph and the photographer photograph stored in the storage 32 in SP14. The association is performed, for example, by registering the URI of the photographer's photograph in the Exif area related to the image data of the subject photograph. The photo storage unit 304 that executes the process of SP14 and the tagged processing unit 302 that executes the process of SP15 are examples of a “recording unit”.

FIG. 20 is a diagram illustrating an example of a processing flow of the smartphone 10b when browsing a photo. The same processes as those in FIG. 18 are designated by the same reference numerals, and the description thereof will be omitted. Hereinafter, with reference to FIG. 20, an example of a processing flow of the smartphone 10b at the time of browsing a photo will be described.

The process of SP2 is the same as the process of SP2 of FIG. 18 except that the process proceeds to SP21 if the login is successful (YES in SP2). Therefore, the description is omitted.

In SP21, the extraction requesting unit 203b receives a photo browsing request from the third party B. The extraction requesting unit 203b uses the in-camera 11a to take a facial photograph of the third party B who has requested the browsing.

In OP22, the extraction requesting unit 203b transmits an extraction request including the facial photograph of the third party B taken in OP41 to the server 31. The extraction request transmitted in OP22 is an example of “reproduction request”.

In OP23, the extraction requesting unit 203b receives the browse target photo extracted by the server 31. In OP24, the extraction requesting unit 203b displays the photograph received in OP43 on the display 13.

21 and 22 are diagrams illustrating an example of a processing flow of the server 31 when browsing a photo. The same processes as those in FIG. 19 are designated by the same reference numerals, and the description thereof will be omitted. “A”, “B”, and “C” in FIG. 21 are connected to “A”, “B”, and “C” in FIG. 22, respectively. Hereinafter, with reference to FIG. 21, an example of a processing flow of the server 31 at the time of browsing a photo will be described.

The process of SP12 is the same as the process of SP12 of FIG. 19 except that the process proceeds to SP31 when the login is successful (YES in SP12). Therefore, the description is omitted.

In SP31, the authentication processing unit 301 receives, from the smartphone 10b, a request for extracting a photo to be browsed. The authentication processing unit 301 extracts the feature information of the face of the third party B from the face photograph of the third party B included in the received extraction request.

In SP32, the browsing photo extraction unit 303 reads out one subject photo from the account area. The browsing photo extraction unit 303 requests the authentication processing unit 301 to authenticate the read subject photo. The authentication processing unit 301 extracts the feature information of the photographer's face included in the photographer's photograph associated with the subject photograph requested to be authenticated.

In OP33, the authentication processing unit 301 determines whether the feature information extracted in OP31 and the feature information extracted in OP32 match. If they match (YES in OP33), the process proceeds to OP34. If they do not match (NO in OP33), the process proceeds to OP32.

In OP34, the browsed photo extraction unit 303 temporarily stores the subject photo read in OP32 as a viewable photo in the main storage unit 102 of the server 31. When the determination in SP33 has been completed for all the subject photographs stored in the account area (YES in SP35), the process proceeds to SP36. If the subject photograph for which the determination in SP33 has not been completed is in the account area (NO in SP35), the process proceeds to SP32.

In OP36, the browsing photo extraction unit 303 transmits the subject photo temporarily stored in the main storage unit 102 in the process of SP34 to the smartphone 10b. The browsed photo extraction unit 303 that executes the processing of OP36 is an example of a “return unit”.

In the fifth modified example, the smartphone 10b transmits the photographed subject photograph and photographer photograph to the server 31. The server 31 stores the received subject photograph and photographer photograph in the storage 32. Therefore, the smartphone 10b according to the fifth modified example has a storage capacity of the auxiliary storage unit 103 that is at least better than that of the smartphone 10 according to the embodiment. Further, even if the smartphone 10b is broken or lost, it is possible to prevent the photographed subject photograph from disappearing.

In the fifth modified example, the smartphone used for browsing may be different from the smartphone 10b used for shooting. The server 31 receives the extraction request from a smartphone (hereinafter, referred to as a smartphone 10c) different from the smartphone 10b used at the time of shooting. The server 31 extracts the subject photograph associated with the feature information that matches the feature information included in the extraction request. The server 31 returns the extracted subject photograph to the smartphone 10c that is the transmission source device of the extraction request. As a result, the smartphone 10c can display the extracted photo.

In the fifth modification, the server 31 executes the process of extracting the characteristic information from the photographer's photograph. Therefore, according to the fifth modification, the processing load on the smartphone 10b can be reduced.

The embodiments and modifications disclosed above can be combined with each other.

10...Smartphone 11...Camera 11a...In camera 11b...Out camera 12...Speaker 13...Display 14...Touch panel 15...Microphone 16...Shooting button 17. ..Fingerprint authentication unit 30...System 31...Server 32...Storage N1...Network 101...CPU
102... Main storage 103... Auxiliary storage 109... Communication C1, B1... Connection bus 201... Authentication processing 202... Tagging processing 203... Browse photo extraction Part 204... Subject photo storage unit 205... Photographer photo storage unit

Claims (7)

A recording unit that records the characteristic information acquired from the operator who performed the recording operation and the content recorded by the recording operation in association with each other,
A control unit for reproducing the content associated with the characteristic information that matches the characteristic information of the requester when the reproduction of the recorded content is requested ,
Wherein, said the recorded content is a predetermined time has elapsed since the recording, to delete the feature information associated with the recorded content,
Terminal device. A first camera provided on the back surface of the terminal device;
A second camera provided on the front surface of the terminal device;
The content is an image captured by the first camera,
The feature information is information extracted from a photograph including a photographer's face photographed by the second camera when the image is photographed,
The terminal device according to claim 1 . When the control unit is requested to reproduce the recorded content, the control unit causes the second camera to take a photograph including the face of the requester, and extracts feature information of the requester from the photographed image. To do
The terminal device according to claim 2 . Computer
The characteristic information acquired from the operator who performed the recording operation is recorded in association with the content recorded by the recording operation,
When the reproduction of the recorded content is requested, the content associated with the characteristic information that matches the characteristic information of the requester is reproduced ,
When a certain period of time has passed since the recorded content was recorded, the characteristic information associated with the recorded content is deleted .
Information processing method. On the computer,
The feature information acquired from the operator who performed the recording operation is recorded in association with the content recorded by the recording operation,
When the reproduction of the recorded content is requested, the content associated with the characteristic information that matches the characteristic information of the requester is reproduced ,
When the recorded content is a predetermined time has elapsed since the recorded, Ru is deleting the feature information associated with the recorded content,
Information processing program. A receiving unit that receives from the terminal device a storage request including characteristic information of an operator who performed a recording operation in the terminal device and content acquired by the terminal device according to the recording operation, and requesting storage of the content. When,
A recording unit that records the characteristic information included in the received storage request and the content in association with each other;
When the reproduction request including the characteristic information of the requester requesting the reproduction of the recorded content is received and the reproduction request requesting the reproduction of the recorded content is received, the content associated with the characteristic information matching the characteristic information of the requester And a return unit for returning the reproduction request to the transmission source device,
A processing unit that deletes the characteristic information associated with the recorded content when a predetermined time has elapsed after the recorded content was recorded .
Information processing device. Computer
Including the characteristic information of the operator who has performed the recording operation in the terminal device and the content acquired by the terminal device according to the recording operation, receiving a storage request for storing the content from the terminal device,
The characteristic information included in the received storage request and the content are recorded in association with each other,
When the reproduction request including the characteristic information of the requester requesting the reproduction of the recorded content is received and the reproduction request requesting the reproduction of the recorded content is received, the content associated with the characteristic information matching the characteristic information of the requester To the device that sent the playback request ,
When a certain period of time has passed since the recorded content was recorded, the characteristic information associated with the recorded content is deleted .
Information processing method.

Images