JP2009171176A - Reproduction apparatus, its control method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To automatically reproduce favorite images and voices for each user with no troublesome operation, even if shared by a plurality of users. <P>SOLUTION: While a registration mode is being set with a mode setting button 40b, favorite image files and voice files selected by users are related to a face (feature value) extracted by facial recognition after photographing the user with a camera 32, and then registered in an internal memory 42. With a reproduction mode being set with the mode setting button 40b, if a face extracted by facial recognition, having been photographed with the camera 32, is determined to be that of a registered user, the favorite image files and voice files related and registered are set as reproduction files and the image and voice are reproduced based on the set reproduction file. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a playback apparatus, a control method therefor, and a program, and more particularly, to a playback apparatus connected to storage means for storing image data or audio data and playing back the stored image data or audio data, and a control method therefor, and The present invention relates to a program for causing one or more computers to implement each step of a control method of a playback apparatus.

Conventionally, as a playback device, an electronic photo frame (digital photo frame) that displays an ornamental image stored in a card-type memory inserted in a card slot has been proposed (see, for example, Patent Document 1). In this apparatus, when a plurality of images are stored in the memory, various modes such as a photo mode for sequentially changing images to be displayed by a button operation by a user and a slide show mode for automatically displaying a plurality of images sequentially Has a display mode.
JP 2001-67004 A

  However, in the above-described playback device, considering the case of sharing by a plurality of users, the favorite image is usually different for each user, so that the user can operate the desired image every time the user to be used changes. Must be called by

  The main purpose of the playback apparatus, control method, and program of the present invention is to automatically play back favorite images and sounds for each user without troublesome operations.

  In order to achieve the above-mentioned main object, the playback apparatus, its control method, and program of the present invention employ the following means.

The playback device of the present invention
A playback device connected to storage means for storing image data or audio data, and for reproducing the stored image data or audio data,
Imaging means capable of capturing a person image;
Face recognition means for recognizing the face of the person image captured by the imaging means;
When a person image is picked up by the image pickup means in a state where the registration mode is set, the person of the person image whose face is recognized by the face recognition means is selected from the image data or the sound data stored in the storage means A registration means for registering in association with image data or audio data selected by the user;
When a person image is picked up by the image pickup means in a state where the reproduction mode is set, the person of the person image whose face is recognized by the face recognition means is a person registered by the registration means. And a reproducing means for reproducing the image data or the audio data.

  In the reproducing apparatus of the present invention, the face of the person image captured by the imaging unit is recognized, and when the person image is captured by the imaging unit with the registration mode set, the person of the person image whose face is recognized Is registered in association with the image data or sound data selected by the user from the image data or sound data stored in the storage means, and a person image is picked up by the image pickup means with the playback mode set When the person of the person image whose face is recognized is a registered person, the associated image data or audio data is reproduced. Therefore, even when a plurality of users share, favorite images and sounds can be automatically reproduced for each user without accompanying troublesome operations.

  In such a playback apparatus of the present invention, the playback unit includes a plurality of playback modes selected by a user, and the plurality of playback modes play back all image data or audio data stored in the storage unit. The mode may include a normal playback mode and an imaging / playback mode for playing back image data or audio data associated with a person of the person image captured by the imaging unit. In this way, the imaging reproduction mode can be executed according to the user's selection.

  In the playback apparatus of the present invention, the playback means may be a means for performing a slide show display as a playback mode of the image data.

The playback apparatus control method of the present invention includes:
A control method for a playback device connected to a storage means for storing image data or sound data and an image pickup means capable of capturing a person image, and for reproducing the stored image data or sound data,
(A) recognizing the face of a human image imaged by the imaging means;
(B) When a person image is picked up by the image pickup means in a state where the registration mode is set, the person of the person image whose face is recognized by the face recognition means is stored in the image data or sound stored in the storage means Register in association with the image data or audio data selected by the user among the data,
(C) When a person image is picked up by the image pickup means in a state in which the reproduction mode is set, and a person whose face is recognized by the face recognition means is a person registered by the registration means The associated image data or audio data is reproduced.

  According to the control method of the playback apparatus of the present invention, the face of the person image captured by the imaging unit is recognized, and the face is recognized when the person image is captured by the imaging unit in a state where the registration mode is set. The person of the person image is registered in association with the image data or sound data selected by the user from the image data or sound data stored in the storage means, and the image is picked up by the image pickup means in a state where the reproduction mode is set. When the person of the person image whose face is recognized when is captured is a registered person, the associated image data or audio data is reproduced. Therefore, even when a plurality of users share, favorite images and sounds can be automatically reproduced for each user without accompanying troublesome operations. In this playback apparatus control method, various aspects of the playback apparatus of the present invention described above may be employed,

  The program of the present invention is for causing one or a plurality of computers to implement the steps of the above-described playback apparatus control method. This program may be recorded on a computer-readable recording medium (for example, hard disk, ROM, FD, CD, DVD, etc.), or from a computer via a transmission medium (communication network such as the Internet or LAN). It may be distributed to another computer, or may be exchanged in any other form. If this program is executed by a single computer or if each step is shared and executed by a plurality of computers, each step of the above-described playback apparatus control method is executed. Is obtained.

  Next, the best mode for carrying out the present invention will be described with reference to the drawings. FIG. 1 is a block diagram and a functional block diagram of an electrophotographic frame 20 as a playback apparatus according to an embodiment of the present invention. The electronic photo frame 20 of the present embodiment is configured as an electronic photo frame that inserts a memory card 35 that stores image files, audio files, and the like and reproduces images and music. As shown in FIG. A display panel 22 as a liquid crystal display device for displaying images such as images and a predetermined menu screen, a display controller 24 for controlling display of the display panel 22, a speaker 26 for outputting sound such as music, and a speaker A speaker controller 28 that controls the output of the camera 26; a camera 32 that has an image sensor such as a charge coupled device (CCD) and a complementary metal oxide semiconductor (CMOS); receives light from an object and performs photoelectric conversion; 32, a camera controller 34 for driving 32, a memory card 35 inserted in the memory card slot 36, and an image. A memory card controller 38 for exchanging data and audio data, an operation button 40 arranged on the back side for various operations by a user, an image file and an audio file, and other data. A built-in memory 42 and a main controller 50 that controls the controller of the entire apparatus.

  The memory card controller 38 inputs and outputs data with the memory card 35 inserted into the memory card slot 36. When the memory card 35 is connected to the memory card slot 36, the memory card controller 38 reads a file stored in the memory card 35 and transmits it to the main controller 50 or inputs a command from the main controller 50. Data is written to the memory card 35 based on the command.

  The operation button 40 includes a power button 40a for turning on / off the power, a mode setting button 40b for setting various playback modes, a menu button 40c for calling a menu screen for performing various settings, and various settings. The selection button 40d includes a determination button 40e for determining the setting selected by the selection button 40d. Here, the playback mode set by the mode setting button 40b includes a normal playback mode in which only one image stored in the memory card 35 or the built-in memory 42 is played back, or a mode stored in the memory card 35 or the built-in memory 42. There is a slide show reproduction mode in which images are reproduced in a predetermined order (for example, the order of file names, the order of file update times, etc.) or randomly. In the slide show playback mode, a normal slide show playback for playing back all images stored in the memory card 35 or the built-in memory 42, or a favorite image for each user from images stored in the memory card 35 or the built-in memory 42. There is a favorite slideshow playback that plays back only registered favorite images. Note that, in any playback mode, playback of sound (music) based on an audio file stored in the memory card 35 or the built-in memory 42 as well as displaying images is supported.

  The main controller 50 is configured as a microprocessor centered on the CPU 52. In addition to the CPU 52, a ROM 54 that stores a processing program, a RAM 56 that temporarily stores data, and an input / output port (not shown). Prepare. An image signal from the camera controller 34, an operation signal from the operation button 40, and the like are input to the main controller 50 via an input port. From the main controller 50, the display controller 24, the speaker controller 28, and the camera controller are input. 34, a control signal to the memory card controller 38, etc. is output via the output port. The main controller 50 reads a file from the memory card 35 inserted in the memory card slot 36 via the memory card controller 38 and stores it in the built-in memory 42, or reads and reads a file in the built-in memory 42. A file can be stored in the memory card 35 via the memory card controller 38.

  Next, the operation of the electronic photo frame 20 of the present embodiment configured as described above, particularly the operation when registering a favorite image for each user and the operation when reproducing the registered favorite image will be described. FIG. 2 is a flowchart showing an example of a registration processing routine executed by the main controller 50. This routine is executed when the registration mode is set by the user operating the mode setting button 40b.

  When the registration processing routine is executed, the CPU 52 of the main controller 50 first outputs a control command to the camera controller 34 and takes a picture of a person with the camera 32 (step S100), and recognizes the face of the photographed person image. Face recognition processing is executed (step S110). Here, the face recognition process is for identifying an individual using the biological characteristics of a person. For example, the positions of both eyes, mouth, nose and the like are detected from a person image taken by the camera 32. However, it can be performed by extracting these feature amounts. Since the face recognition process itself is a well-known technique, further detailed description is omitted. When the facial feature amount of the person image is extracted by the face recognition process, a favorite image file or an audio file is selected (step S120). In this embodiment, the favorite image file and the audio file are selected by calling the menu screen by the menu button 40c and selecting the “select favorite image / sound” item from the menu screen by using the selection button 40d. This can be done by selecting a desired file from the list of image files and audio files displayed by pressing using the selection button 40d and pressing the decision button 40e. When the favorite image file or sound file is selected in this way, the face (feature amount) recognized by the face recognition process described above in association with the selected favorite image file or sound file is registered in the internal memory 42 (step S130), and this routine is executed. Exit.

  Next, the operation in the playback mode will be described. FIG. 3 is a flowchart showing an example of a reproduction processing routine executed by the main controller 50. This routine is executed when the slide show reproduction mode is set by the user operating the mode setting button 40b.

  When the playback processing routine is executed, the CPU 52 of the main controller 50 first checks whether playback in the slide show playback mode is normal slide show playback or favorite slide show playback (step S200). A reproduction file is set so that all image files and audio files stored in the memory 42 are sequentially reproduced (step S210), and a control signal is sent to the display controller 24 so that an image is reproduced based on the set reproduction file. At the same time, a control signal is output to the speaker controller 28 so that sound is reproduced (step S260), and this routine is terminated. On the other hand, at the time of favorite slide show playback, a control signal is output to the camera controller 34, and a person is photographed by the camera 32 (step S220), and a face recognition process for recognizing the face of the photographed person image is executed (step S230). The facial feature quantity extracted by this face recognition process is compared with the facial feature quantity of the registered person registered in advance by the registration processing routine of FIG. 2 described above (step S240), and the facial feature quantities match ( If the image is similar, the person photographed by the camera 32 is determined to be a registrant, and a favorite image file or audio file registered in association with the registered person is set as a playback file (step S250). Based on this, a control signal is output to the display controller 24 so that an image is reproduced, and sound is reproduced. Yo outputs a control signal to the speaker controller 28 (step S260, S270), and terminates this routine. If the facial feature values do not match in step S240 (there are no registered facial feature values that match the extracted facial feature values), it is determined that the person is not a registrant, and the aforementioned steps S210, S260, The process of S270 is executed and this routine is terminated.

  Here, the correspondence between the components of the present embodiment and the components of the present invention will be clarified. The camera 32 and camera controller 34 of the present embodiment and the main controller 50 that executes the processing of step S100 of FIG. 2 and step S220 of FIG. 3 correspond to the “imaging means” of the present invention, and step S110 of FIG. 3 corresponds to the “face recognition means”, and the main controller 50 that executes the processes of steps S120 and S130 in FIG. 2 corresponds to “registration means”. The main controller 50 that executes the processes of S250, S260, and S270 corresponds to “reproducing means”. In the present embodiment, an example of the control method of the playback apparatus of the present invention is also clarified by describing the operation of the electrophotographic frame 20.

  According to the electronic photo frame 20 of this embodiment described in detail above, when the registration mode is set, the user selects a face (feature amount) extracted by the camera 32 by photographing the person with the camera 32 and performing face recognition. When the playback mode is set and the playback mode is set, the camera 32 captures a person and the face extracted by face recognition is the registered user. Since image and sound files are set as playback files and images and sound are played back based on the set playback files, even if shared by multiple users, favorite images can be created for each user without complicated operations. And audio can be played automatically.

  In the present embodiment, as a slide show playback mode, normal slide show playback for playing back all image files and sound files in the memory card 35 and the built-in memory 42 and favorite slide show playback for playing back only the registrant's favorite image files and sound files are performed. These are made selectable by the user, but may be provided with a function only for favorite slide show reproduction.

  In this embodiment, when the favorite slide show playback is set, the favorite audio file stored in the memory card 35 or the built-in memory 42 is played back. However, the present invention is not limited to this. For example, A voice file that includes a microphone for recording voice, and that creates a voice file by recording with the microphone when the registration mode is set, and creates a face extracted by face recognition by photographing a person with the camera 32 When the playback mode is set, the camera 32 captures a person and the face extracted by face recognition is a registrant. A file may be set and played back. In this case, the user who registers the audio file and the user who reproduces the audio file may be the same person or different persons. In the latter case, a person who has photographed a person with the camera 32 in advance and has registered a face (user) extracted by face recognition, and a user who registers a voice selects a user who plays a sound file from among the registered users. This can be done by specifying. Thereby, for example, it becomes possible to use for the purpose of reproducing a message message for other users. In addition, what is reproduced toward such other users is not limited to an audio file, and may be an image file.

  In this embodiment, in addition to the reproduction of the image file stored in the memory card 35 or the built-in memory 42, the reproduction of the audio file is also supported. However, the reproduction may be performed only for the reproduction of the image file.

  In the present embodiment, the playback device of the present invention has been described as applied to an electrophotographic frame. However, the present invention is not limited to this, and if an image pickup device is mounted and an image or sound can be played back, the image pickup device may be used. A playback device such as a mobile phone, a personal computer, or a PDA (Personal Digital Assistant) to which the device is connected or built-in, or a voice playback device that is connected or built-in but does not have an image display function. The present invention may be applied to any other reproducing apparatus. In addition to the form of such a playback apparatus, the form of a control method of the playback apparatus may be used, or the form of a program for realizing such a control method of the playback apparatus with one or a plurality of computers. It is good.

  The embodiments of the present invention have been described above, but the present invention is not limited to the above-described embodiments, and can of course be implemented in various modes as long as they belong to the technical scope of the present invention.

The block diagram and functional block diagram of the electrophotographic frame 20 of this embodiment. The flowchart which shows an example of a registration process routine. The flowchart which shows an example of a reproduction | regeneration processing routine.

Explanation of symbols

  20 playback device, 22 display panel, 24 display controller, 26 speaker, 28 speaker controller, 32 camera, 34 camera controller, 35 memory card, 36 memory card slot, 38 memory card controller, 40 operation button, 40a power button, 40b mode Setting button, 40c menu button, 40d selection button, 40e determination button, 42 built-in memory, 50 main controller, 52 CPU, 54 ROM, 56 RAM.

Claims (5)

A playback device connected to storage means for storing image data or audio data, and for reproducing the stored image data or audio data,
Imaging means capable of capturing a person image;
Face recognition means for recognizing the face of the person image captured by the imaging means;
When a person image is picked up by the image pickup means in a state where the registration mode is set, the person of the person image whose face is recognized by the face recognition means is selected from the image data or the sound data stored in the storage means A registration means for registering in association with image data or audio data selected by the user;
When a person image is picked up by the image pickup means in a state where the reproduction mode is set, the person of the person image whose face is recognized by the face recognition means is a person registered by the registration means. A playback device comprising: playback means for playing back image data or audio data. The playback device according to claim 1,
The playback means comprises a plurality of playback modes selected by the user,
The plurality of reproduction modes include a normal reproduction mode for reproducing all image data or audio data stored in the storage unit, and image data or audio data associated with a person of a human image captured by the imaging unit. A playback device that includes an imaging playback mode for playing back video.   3. A playback apparatus according to claim 2, wherein the playback means is means for performing a slide show display as a mode of playback of the image data. A control method for a playback device connected to a storage means for storing image data or sound data and an image pickup means capable of capturing a person image, and for reproducing the stored image data or sound data,
(A) recognizing the face of a human image imaged by the imaging means;
(B) When a person image is picked up by the image pickup means in a state where the registration mode is set, the person of the person image whose face is recognized by the face recognition means is stored in the image data or sound stored in the storage means Register in association with the image data or audio data selected by the user among the data,
(C) When a person image is picked up by the image pickup means in a state in which the reproduction mode is set, and a person whose face is recognized by the face recognition means is a person registered by the registration means A method of controlling a playback apparatus, wherein the associated image data or audio data is played back.   A program for causing one or more computers to realize each step of the method for controlling a playback apparatus according to claim 4.

Images