JP2007013286A - Data processing apparatus, data processing method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a data processing apparatus capable of attaching information associated with music or the like having been heard by a user in imaging to imaging data. <P>SOLUTION: The data processing apparatus includes: imaging data capturing means (22, 21a) for capturing imaging data; an attachment processing means (21d) for attaching audio related data with respect to audio data having been reproduced at a date and time of the imaging data to the imaging data; and a recording control means (21c) for recording the image data to which the audio related data are attached by the attachment processing means to a recording medium (25). <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a data processing apparatus, a data processing method, and a program, and can be applied as an apparatus such as a digital still camera apparatus or a personal computer, or an operation program thereof.

JP 2004-32129 A

In a digital still camera that is widely used, an image signal of a subject is obtained using a solid-state imaging device such as a CCD sensor or a CMOS sensor, and is recorded on a recording medium as captured image data. As a recording medium for recording imaging data (still image data), a memory card incorporating a flash memory is used, or a disk medium such as an optical disk, a magneto-optical disk, or an HDD (Hard Disc Drive) is used.
The imaging data recorded on these recording media can be displayed on a display unit or transferred to a personal computer or the like according to a user operation.

Also, portable music players using disc media such as CD (Compact Disc), MD (Mini Disc), DVD (Digital Versatile Disc), Blu-ray Disc (Blu-Ray Disc), or HDD or memory card were used. Portable music players are also widely used.
In addition, a variety of electronic devices have been developed in accordance with situations such as an increase in media capacity and a combination of devices. For example, a portable music player using a disk medium having an image display function and a digital camera function has been developed.

  As such various devices become widespread, it has become possible for users to take pictures with a digital still camera while listening to music with a portable music player. Furthermore, according to a music player having a camera function, it is easy to take a picture while enjoying music playback with a single device.

Pictures are a memorial to the user, but music often reflects the situation, environment, and emotions of the user. For example, at a later point in time, music sometimes reminds me of my feelings. In other words, not only images as photos, but also the music that users listened to at that time is an important element for commemoration and memories.
In particular, when there are many opportunities to take a picture while listening to music, it is preferable for the user to record the music that has been heard together with the picture (imaging data) in some form.
Accordingly, an object of the present invention is to enable information related to music or the like that was being listened to when a user took an image to be pasted on the image data.

  The data processing apparatus of the present invention includes imaging data capturing means for capturing imaging data, and pasting processing means for pasting audio-related data related to audio data reproduced at the imaging date and time of the imaging data to the imaging data. And recording control means for recording on the recording medium the imaging data to which the audio-related data is pasted by the pasting processing means.

The imaging data capturing unit is configured as an imaging unit that captures a subject image, or configured to capture imaging data transmitted from an external device through data communication with the external device.
That is, for example, the data processing apparatus of the present invention can be realized in an apparatus that captures imaging data transmitted from a camera apparatus or an external camera apparatus.

In the case where the imaging data capturing unit is configured as an imaging unit, the imaging data capturing unit further includes an audio reproducing unit that reproduces audio data, and the pasting processing unit is the audio reproducing unit when the imaging unit executes imaging. Audio-related data related to the audio data that has been reproduced is acquired and pasted to the image data captured by the image capturing unit.
That is, when the data processing device of the present invention is realized as an apparatus in which the camera device and the audio playback device are integrated, audio-related data regarding music or the like that was being listened to at the time of imaging can be acquired within the device, Audio-related data is acquired, and this is attached to the imaging data.

When the imaging data capturing means is configured as an imaging unit, listening data including playback date / time information and audio related data for audio data played back by the audio playback device is acquired from an external audio playback device. Further comprising listening data acquisition means, wherein the pasting processing means uses imaging date / time information included in the imaging data imaged by the imaging unit and reproduction date / time information in the listening data acquired by the listening data acquisition means. Then, the audio data included in the listening data is attached to the image data.
For example, when the data processing device of the present invention is realized as a camera device, in order to attach audio-related data related to music or the like that was being listened to by another audio playback device, the above listening data is obtained from an external audio playback device You just have to do it. Then, by comparing the date and time information, the imaging data and the audio-related data can be associated with each other, and thereby the audio-related data can be attached to the imaging data.

Further, when the imaging data capturing means is configured to capture imaging data transmitted from an external device, reproduction date and time information and audio information about audio data reproduced by the audio reproducing device from an external audio reproducing device. It further includes listening data acquisition means for acquiring listening data including related data, and the pasting processing means is acquired by the imaging date and time information included in the imaging data acquired by the imaging data acquisition means and the listening data acquisition means. Using the reproduction date and time information in the listening data, a process of attaching audio-related data included in the listening data to the imaging data is performed.
That is, when the data processing apparatus of the present invention is an apparatus for attaching audio-related data such as music reproduced by an external audio reproducing apparatus to image data captured by an external camera apparatus or the like, the external audio reproducing apparatus can Listening data is acquired and acquired from an external camera device or the like. Then, by comparing the date and time information, the imaging data and the audio-related data are associated with each other, and the audio-related data is attached to the imaging data.

The data processing method of the present invention includes an imaging data capturing step for capturing imaging data, and a pasting processing step for pasting audio-related data relating to audio data reproduced at the imaging date and time of the imaging data to the imaging data, And a recording control step of recording the imaging data to which the audio-related data is pasted in the pasting step in a recording medium.
The program of the present invention is a program for causing a data processing apparatus to execute the data processing method.

The audio-related data refers to, for example, the title of audio data such as music, the title of the album in which the song is stored, the name of the performer, the name of the song composer, the name of the song, the ID information of the song, etc. This is data that allows the user to recognize music at a later point in time and identify music etc. with the system. The audio related data may be audio data itself, for example, a part of a song.
The attachment of audio-related data to imaging data refers to recording audio-related data in association with imaging data, and the recording format, file format, management form, etc. are not questioned.

  According to the present invention, audio-related data about music or the like that the user listened to at the time of imaging is pasted and recorded on the imaging data captured by the user. As a result, when browsing the image data, audio-related data such as song titles are presented together, or the music indicated by the audio-related data is played back on the playback device, so that the user can listen to the music, etc. that was being listened to when taking the photo It can remind you and can increase the added value of photography.

Hereinafter, embodiments of the present invention will be described in the following order.
[1. First Embodiment: Camera Device with Audio Playback Function]
[2. Second Embodiment: Computer Device]
[3. Third Embodiment: Camera Device]
[4. Modifications and Program]

[1. First Embodiment: Camera Device with Audio Playback Function]

An example of realizing the data processing apparatus of the present invention in a digital still camera with an audio playback function will be described as a first embodiment.
FIG. 1 shows a configuration of a main part of a camera device 20 with an audio playback function. A specific configuration example as a camera device with an audio playback function will be described later with reference to FIGS.

In the camera device 20 of FIG. 1, a control unit 21, an imaging unit 22, an audio reproduction processing unit 23, a recording / reproducing unit 24, and an imaging lens mechanism 26 are provided.
The imaging unit 22 receives subject light incident from the imaging lens mechanism 26, converts it into an electrical signal, performs various processes, and obtains imaging data.
The recording / reproducing unit 24 records and reproduces data on the recording medium 25. The recording medium 25 may be a portable medium that can be attached to and detached from the apparatus, such as an optical disk or a memory card with a built-in nonvolatile memory, or a hard disk (magnetic disk) or a solid memory that is detachably incorporated into the apparatus. It may be a thing. The recording / reproducing unit 24 performs data modulation / demodulation, error correction code processing, and media access processing in accordance with these recording media 25 to record / reproduce various data.
The recording / reproducing unit 24 performs processing for recording the imaging data (still image data) obtained by the imaging unit 22 on the recording medium 25. In addition, the recording / reproducing unit 24 performs a process of reading the captured image data recorded on the recording medium 25 so as to be displayed on a display unit not shown in FIG.
When audio data is recorded on the recording medium 25, the recording / reproducing unit 24 also performs processing for reproducing audio data from the recording medium 25.

For example, image data and audio data can be recorded on the recording medium 25 as schematically shown in FIG. Imaging data obtained by the imaging unit 22 is recorded as imaging data files PH1, PH2, PH3. Each imaging data file is stored in a state managed by imaging file management data.
Audio data such as music is recorded as audio content files M1, M2, M3. Each audio content file M1, M2, M3... Is stored in a state managed by audio management data.
The imaging data file PH is, for example, an Exif (Exchangeable Image File Format) standard file. As shown in FIG. 3B, the data content includes a file header and image data as, for example, JPEG (Joint Photographic Experts Group) compressed data. The file header includes information such as a file name, data size, file format, imaging date and time.

  The audio playback processing unit 23 performs audio data processing on the audio content file read by the recording / playback unit 24. That is, data decoding, digital audio processing, D / A conversion, analog audio processing, and the like are performed to obtain a reproduced audio signal as an analog audio signal. The reproduced audio signal is reproduced and output by the connected headphones 90, for example.

  The control unit 21 includes a CPU (Central Processing Unit) that controls the operation of each unit of the camera device 20. As software functions formed by the operation program, an imaging control unit 21 a that controls the imaging operation of the imaging unit 22, an audio processing control unit 21 b that controls the audio processing operation of the audio playback processing unit 23, and a recording of the recording and playback unit 24 A recording / playback control unit 21c for controlling the playback operation, a pasting processing unit 21d for performing processing for pasting music-related data to imaging data, which will be described later, and a clock unit 21e for counting date and time are provided.

In the configuration of FIG. 1, the constituent features of the claims of the present invention correspond to the following.
Imaging data capturing means: imaging unit 22, imaging control unit 21a.
Pasting processing means: pasting processing unit 21d.
Recording control means: a recording / reproducing control unit 21c.
Audio reproduction means: a reproduction system of the audio reproduction processing unit 23, the audio processing control unit 21b, and the recording / reproduction unit 24.

The processing at the time of imaging by such a camera device 20 will be described with reference to FIG.
When the user operates a shutter button (not shown), an imaging process for capturing a subject image is performed by the imaging unit 26 accordingly. In step F101, the control unit 21 (imaging control unit 21a) controls the imaging unit 22 according to the shutter operation, and executes an imaging process, that is, a still image data capturing process.
At this time, in step F102, the control unit 21 determines whether or not the audio is being played back at the shutter operation time point (image pickup time point), and branches the processing.
If the audio is not being reproduced, the control unit 21 (imaging control unit 21a) causes the imaging data captured by the imaging unit 22 to be filed in step F106. That is, the file name, date / time information (year / month / day / hour / minute / second) obtained by the clock unit 21e, header information such as a file format, etc. are given to the imaging unit 22, and compression encoding is performed on the imaging data. ) Is generated as an imaging data file.
Then, the control unit 21 (the imaging control unit 21a and the recording / playback control unit 21c) records the imaging data file on the recording medium 25 in step F105. That is, data as an imaging data file generated by the imaging unit 22 is transferred to the recording / reproducing unit 24 and recorded on the recording medium 25 by performing a recording encoding process or the like according to the media type.

On the other hand, if it is determined in step F102 that audio is being reproduced, the process proceeds to step F103. During the audio playback, the recording / playback unit 24 reads the audio content file from the recording medium 25 based on the control of the recording / playback control unit 21c and the audio processing control unit 21b, and the audio playback processing unit 23 performs the audio processing and playback. This is the case where sound is output, that is, the user is listening to music or the like.
In this case, the control unit 21 (the pasting processing unit 21d) acquires music-related data such as the music being played back in step F103. For example, information such as a song name, album name, artist name, etc. described in the audio management data shown in FIG. 3 or the header information of the audio content file, information such as the file name and content ID as an audio content file is acquired. . Since the audio management data and the file header are read from the recording medium 25 prior to audio reproduction, the control unit 21 can acquire music related data from the contents of the management data.
In step F104, the control unit 21 (the imaging control unit 21a and the pasting processing unit 21d) generates an imaging data file. At this time, the music-related data is pasted.
That is, header information such as the file name of the imaging data, date / time information (year / month / day / hour / minute / second) obtained by the clock unit 21e, and the file format is given to the imaging unit 22, and compression encoding of the imaging data is executed. Further, the music-related data acquired in step F103 is given to the imaging unit 22 and pasted to the imaging data file. Thereby, for example, an imaging data file having the contents as shown in FIG. That is, music-related data about the music that was being listened to at that time is added to the imaging data.
Then, the control unit 21 (the imaging control unit 21a and the recording / playback control unit 21c) records the imaging data file on the recording medium 25 in step F105. That is, data as an imaging data file generated by the imaging unit 22 is transferred to the recording / reproducing unit 24 and recorded on the recording medium 25 by performing a recording encoding process or the like according to the media type. As a result, an imaging data file as shown in FIG. 3C is recorded.

As described above, when the user performs a photography operation while listening to music or the like, music-related data regarding the music or the like that has been listened to the captured image data is pasted and stored in the recording medium 25.
When the imaging data file with the music-related data attached is read from the recording medium 25 and displayed, the contents of the music-related data (song name, artist name, etc.) are displayed together or included in the music-related data. By executing the reproduction of the audio content file having the file name, the user can recall the music that he / she listened to at the time of imaging while viewing the photograph, or can view the photograph while listening to the music.

A specific configuration of the camera apparatus 20 of FIG. 1 performing such an operation will be described with reference to FIGS.
4 (a), (b), (c), (d), (e), and (f), a front view, a plan view, a left side view, and a right side view of an audio / camera composite device 1 corresponding to the camera device 20 of this example. A figure, a bottom view, and a rear view are shown.
The audio camera / camera combined device 1 has an upper case 2 and a lower case 3, and the upper case 2 is configured to be opened and closed with respect to the lower case 3. Although a detailed description of the mechanism is omitted, by operating the opening / closing operator 16 shown in FIG. 4E, the upper housing 2 is opened, and a so-called mini-disc type disk loading mechanism appears. . Then, by closing the upper housing 2 with the disc loaded, information is recorded or reproduced on the disc inside the housing.
The audio / camera combined apparatus 1 can play back audio data (music, etc.) recorded on the disc by loading the disc, and functions as a portable audio player. In addition, the image data can be recorded and reproduced with respect to the disc, and it functions as a digital still camera.

As shown in FIG. 4A, a display unit 4 such as a liquid crystal panel is provided on the front surface of the housing. The display unit 4 includes a list and an operation menu for selecting audio data recorded on the optical disc, a track number being played, time information such as a progress time and a total performance time, an operation guide, or an album during audio playback. A jacket image or an image associated with the track is displayed.
Also, when the camera is in operation, when it is in the imaging standby state, the subject image (actual moving image) captured by the image sensor at that time and the still image (photo image) captured when the shutter is operated are displayed. In the photo browsing state, a playback image or a thumbnail image of a photograph taken in the past (imaging data recorded on the optical disk) is displayed.

Various operators are provided at predetermined positions on the housing.
As shown in FIG. 4A, a central controller 5, a search key 6, a stop / cancel key 7, a slide show / display key 8, and a menu key 9 are provided as controls on the front of the casing. As shown in FIG. 4B, a camera on / off key 10 and a shutter button 11 are provided on the top surface of the housing. As shown in FIG. 4D, a volume key 12, a download key 13, and a hold switch 14 are provided on the side of the casing.

The centralized controller 5 is an operator that performs main operations regarding the audio reproduction operation and the imaging data browsing operation. The centralized controller 5 is capable of a push operation that first presses the projection as the central portion. In addition, an operation of tilting the projection at the center portion up, down, left and right is possible, and the up, down, left and right operations are an up operation, a down operation, a left operation, and a right operation. Further, the outer peripheral portion of the centralized controller 5 is formed so as to be rotatable as a so-called jog dial so that a clockwise or counterclockwise jog operation is possible.
Each of these push operations, up operations, down operations, left operations, right operations, and jog operations is assigned a predetermined function according to the mode state. For example, playback, pause, stop, menu or list display This is a controller for the main operation functions executed by the user, such as cursor movement, determination, mode switching, track forward / reverse, fast forward / rewind.

The search key 6 is a key for a search operation.
The stop / cancel key 7 is a key for stopping the reproduction operation and various cancel operations.
The slide show / display key 8 is, for example, a key for selecting a slide show instruction of image data, various display modes, display contents, and the like as a slide show.
The menu key 9 is a key for turning on / off the operation menu display on the display unit 4.
The camera on / off key 10 is a key for instructing activation and termination of camera operation.
The shutter button 11 is a key for instructing imaging timing in the camera mode. The shutter button 11 captures a photographic image.
The volume key 12 is a volume adjustment key for audio reproduction.
The download key 13 is a key for executing data download when the audio / camera combined apparatus 1 is connected to a personal computer, for example.
The hold switch 14 is a slide operation element for setting the key invalidation (hold state) of each operation element in order to eliminate an erroneous operation such as when carrying.

As shown in FIG. 4E, a USB terminal 3 is provided on the front surface of the housing, and can be connected to, for example, a personal computer through a USB interface.
As shown in FIG. 4C, a headphone / remote control terminal 18 is formed on the side of the housing, and a headphone with a remote controller is connected.
As shown in FIG. 4 (d), a battery box opening / closing part 3a is provided on the side of the housing. By opening the battery box opening / closing part 3a, the battery can be inserted / removed.

As shown in FIG. 4F, a lens cover 15 that can be slid is provided on the rear side of the housing. The lens cover 15 is provided for protecting the imaging lens.
5A and 5B show the open / closed state of the lens cover 15 by sliding.
The lens cover 15 is slidable between a closed state as shown in FIG. 5A and an open state as shown in FIG. By setting the opened state in FIG. 5B, the imaging lens 19a and the flash light emitting unit 19b are exposed, and the camera can be imaged. In the closed state of FIG. 5A, the imaging lens 19a and the flash light emitting unit 19b are shielded, and the lens is protected.

The internal configuration of the audio / camera combined apparatus 1 will be described with reference to FIG.
The CPU 30 functions as a control unit for the entire apparatus, and performs control for audio reproduction operation, imaging operation and image reproduction operation, display operation of the display unit 4, detection of user operation, communication control with external devices, and the like. The CPU 30 exchanges data and control information with each unit via the bus 50.
A RAM (Random Access Memory) 31 is used by the CPU 30 as a work area for computation, or for storing information during operation.
A ROM (Read Only Memory) 32 stores programs executed by the CPU 30, various processing coefficients, and the like.
The nonvolatile memory 33 (NV-RAM (Non Volatile RAM) or flash ROM) stores various coefficients, setting information, resume point (address when playback is stopped), and other information that should be retained even when the power is turned off. Used.

Under the control of the CPU 30, the media drive unit 34 performs recording / reproduction with respect to a disk 90, for example, a mini-disc type optical disk (or magneto-optical disk). For this reason, an encoding unit for recording format for data to be recorded on the disk 90, a decoding unit for reproducing data from the disk 90, a recording / reproducing head, a servo mechanism, a spindle motor mechanism, and the like are provided.
The buffer memory 35 is constituted by, for example, an SD-RAM. In the buffer memory 35, data that is transferred to the media drive unit 34 and recorded on the disk 90 is buffered, and data that is read from the disk 90 by the media drive unit 34. Buffering is performed. At the time of audio reproduction, audio data read from the disk 90 is buffered.
Also, management information recorded on the disk 90, that is, physical information of the disk 90 necessary for data recording / reproducing operation, area information, recorded data file information, and the like are stored in the CPU 30 when the disk 90 is loaded. However, the management information is stored in a partial area of the buffer memory 35 so that the CPU 30 can refer to the management information. Note that the CPU 30 may reference the management information stored in the buffer memory 35 by fetching it into the RAM 31.
The memory interface 36 performs transfer processing of data stored in the buffer memory 35 and control processing of write / read addresses in the buffer memory.

The compression encoding / decoding unit 37 performs compression encoding and decoding of audio data by a compression method such as ATRAC (Adaptive Transform Acoustic Coding).
Audio data converted into, for example, linear PCM data by being decoded by the compression encoding / decoding unit 37 is converted into an analog audio signal by the D / A converter 47 and supplied to the headphone amplifier 48. The headphone amplifier 48 performs amplification processing, impedance adjustment processing, and the like, and supplies an audio signal to the headphone terminal 49.
The headphone terminal 49 is a headphone terminal portion of the headphone / remote control terminal 18 in FIG. 4C, and reproduced sound is output from the connected headphone with a remote controller.

Although not shown, for example, when an analog audio signal or digital audio data is input by providing an input system such as a line input, a microphone input, or a digital audio input, the input audio signal is in a digital audio data form, for example. Is supplied to the compression encoding / decoding unit 37 so as to be compressed and encoded. The compressed and encoded data is transferred to the media drive unit 34 via the buffer memory 35 and recorded on the disk 90, thereby realizing an audio recording function.
For example, when audio data is downloaded by being connected to a personal computer or the like, the data may be subjected to compression encoding processing by the compression encoding / decoding unit 37.

The USB interface 39 performs data transfer processing with a device such as a personal computer connected via the USB terminal 17.
The serial interface 40 performs data input / output processing with a camera / LCD block 38 to be described later.
The A / D port 41 detects various user operations and supplies A / D conversion values to the CPU 30 as operation information. The operation key 44 includes the above-described centralized controller 5, search key 6, stop / cancel key 7, slide show / display key 8, menu key 9, camera on / off key 10, shutter button 11, volume key 12, and download key 13. The A / D port 41 transmits the operation information of these operators to the CPU 30 with a predetermined value.
Further, the remote control terminal 46 is a remote control terminal portion of the headphone / remote control terminal 18 in FIG. 1C, and operation information from a remote controller provided in the connected headphones is detected by the A / D port 41, and is predetermined. Is transmitted to the CPU 30 as a value of.
The serial interface 42 supplies display data instructed by the CPU 30 from the remote control terminal 46 to the remote controller. A display unit is formed in the remote controller provided in the headphones. In the display unit, a display operation based on display control information supplied from the CPU 30 via the serial interface 42 is performed.

The DSP interface 43 transfers data and control information between each unit on the bus 50 such as the CPU 30 and the USB interface 39 and the compression encoding / decoding unit 37.
The operation of the hold key 14 is detected by the CPU 30. When the hold key 14 is used to invalidate the key, the CPU 30 treats the operation information from the operation key 44 supplied via the A / D port 41 as invalid.

  The cover interlocking switch 45 is a switch that is turned on / off in accordance with the opening / closing of the lens cover 15 and functions as a detection unit for opening / closing the lens cover 15. The CPU 30 can detect whether the lens cover 15 is open or closed by detecting the on / off state of the cover interlock switch 45.

The camera / LCD block 38 is a part as a display processing system including the imaging processing system and the display unit 4.
As an imaging processing system, a pixel signal is transferred from a solid-state imaging device unit such as a CCD sensor or a CMOS sensor that detects the subject light incident by the imaging lens unit 19 described above, or a solid-state imaging device, and gain adjustment or A / D conversion is performed. Imaging signal transfer circuit that performs image processing, white balance for captured image data obtained by the imaging signal transfer circuit, digital processing system that performs Y / C processing, etc., encoding system that performs compression processing, format processing, etc. on captured image data, etc. Is provided.
The display processing system includes a display image processing unit that forms an image, characters, characters, and the like to be displayed on the LCD serving as the display unit 4, a display drive circuit that drives the LCD based on the display image, and the like.

In such an audio / camera combined apparatus 1, the audio data recorded on the disk 90 is reproduced. When the user performs a playback operation using the operation key 44 or the remote controller, the CPU 30 controls the media drive unit 34 to play back the audio content file (audio track) on the disc 90.
The audio data reproduced by the media drive unit 34 is stored in the buffer memory 35, and then sequentially read out, transferred to the compression encoding / decoding unit 37, and decoded. Then, the analog audio signal is converted by the D / A converter 47 and output from the headphones connected through the processing of the headphone amplifier 48.
During this audio reproduction, the display unit 4 and display processing system in the camera / LCD block 38, under the control of the CPU 30, reproduces a menu (displaying a list of song names etc.), the name of the song being played, artist name, and time information. Display operations such as jacket images and slide show images are performed.

When the camera is in the imaging standby state as a camera operation, the CPU 30 controls the camera / LCD block 38 to execute capturing of the subject image, image signal processing, and display of the subject image (actual moving image) on the display unit 4. Let
When the user presses the shutter button 11 in this state, the CPU 30 performs control to record the subject image (still image) at that time as imaging data. That is, one frame of image data at the time of the shutter operation is supplied as recording data to the media drive unit 34 via the buffer memory 35.
The media drive unit 34 records imaging data as one photographic image file on the disc 90.
When the camera mode is in the photo browsing state, the CPU 30 reads the data of the photo image file recorded on the disk 90 in the media drive unit 34. The read image data is transferred to the camera / LCD block 38 via the buffer memory 35 and displayed on the display unit 4.
Note that the photo image data may be displayed on the display unit 4 one by one, or a large number of images may be displayed as a list of thumbnail images. The CPU 30 controls to switch between single-image display and thumbnail display in accordance with the user's operation.

FIG. 7 shows the configuration of the camera / LCD block 38.
As described above, the camera / LCD block 38 is provided with an imaging processing system and a display processing system.
The imaging processing system includes a lens system 61 including the imaging lens 19a described above, a solid-state imaging device unit 62 as an image sensor, an imaging signal transfer unit 63, a digital signal processing unit 64, an encoder 65, a lens driving unit 66, and a light emission driving unit 67. A flash light emitting unit 19b, a camera controller 68, and a camera interface 69.

The lens system 61 is a lens optical system including an imaging lens 19a, a focus lens, and a zoom lens, and makes an imaging light of a subject incident on the solid-state imaging device unit 62.
The solid-state image sensor unit 62 is configured as, for example, a CCD sensor array or a CMOS sensor array.
The imaging signal transfer unit 63 performs transfer, sampling, gain adjustment, and the like of signals obtained by the respective imaging elements of the solid-state imaging element unit 62, and further performs A / D conversion to generate digital image data by imaging, thereby generating digital signals. Transfer to the processing unit 64.
The digital signal processing unit 64 performs white balance, Y / C processing, and the like on the captured image data obtained from the imaging signal transfer unit 63.
The encoder 65 performs compression processing, format processing, and the like on the captured image data processed by the digital signal processing unit 64. For example, JPEG (Joint Photographic Experts Group) still image imaging data is generated.
The camera interface 69 performs transfer output of imaging data via the serial interface 40 and input processing of control signals from the CPU 30.
The lens driving unit 66 drives the focus lens and zoom lens in the lens system 61.
The light emission drive unit 67 performs flash light emission drive from the flash light emission unit 19b.
The camera controller 68 controls the operation of the imaging processing system based on an instruction from the CPU 30.

As the display processing system in the camera / LCD block 38, the LCD 4 as the display unit, the display drive circuit 71, the display data processing unit 72, the display controller 73, and the display interface 74 are provided.
The display interface performs display data input processing via the serial interface 40 and control signal input processing from the CPU 30.
The display data processing unit 72 stores display data supplied from the display interface 74 or the imaging processing system described above. Further, necessary decoding processing for display output, RGB processing, and the like are performed.
The display drive circuit 71 captures display data stored in the display data processing unit 72 and subjected to necessary signal processing in the form of R, G, B signals, and drives the LCD 4 based on the display data to execute display. Let
The display controller 4 controls the operation of the display processing system.

In such a camera / LCD block 38, the camera controller 68 and the display controller 73 control as follows to execute necessary operations.
First, when the camera operation is instructed by the CPU 30, the camera controller 68 controls the signal transfer circuit 63, the digital signal processing unit 64, and the encoder 65 to capture a subject image and execute image signal processing. In this case, during a period until the user presses the shutter button 11, an image (moving image) output from the encoder 65 is transferred to the display data processing unit 72 and displayed on the LCD 4 by the display driving circuit 71. That is, the user can check the subject.
When the user presses the shutter button 11, the CPU 30 performs control to record the subject image (still image) at that time as imaging data. At this time, the camera controller 68 receives one frame of image data at the time of shutter operation. The data is output via the camera interface 69 and the serial interface 40. This imaging data is supplied as recording data to the media drive unit 34 via the buffer memory 35 under the control of the CPU 30 and recorded on the disk 90.
The captured image data is also supplied to the display data processing unit 72 and displayed on the LCD 4 by the display driving circuit 71 so that the image captured by the user can be confirmed.

In addition, the camera controller 68 controls the lens driving unit 66 by an instruction from the CPU 30 based on a user operation or automatic control, and executes autofocus and zoom operations. As for lens driving, the close-up mode and the normal mode are switched by an instruction from the CPU 30.
The camera controller 68 controls the charge accumulation time adjustment in the solid-state image sensor unit 62 and the signal processing in the digital signal processing unit 64 to adjust the exposure, and controls the digital signal processing unit 64 and the encoder 65. Also sets the image size of the image data.
The camera controller 68 also controls the light emission drive unit 67 to perform flash light emission control at the shutter timing. Whether the flash is emitted at the shutter timing is instructed by the CPU 30 as a flash setting mode.

In the camera mode, the display controller 73 controls the display data processing unit 72 and the display drive circuit 71 so as to display the subject moving image supplied from the imaging processing system and the still image at the time of imaging as described above.
Further, in response to an instruction from the CPU 30, display of image data transferred from the buffer memory 35 via the serial interface 40 and operation menu images, icons, list images, and the like supplied from the CPU 30 are executed. To control.

As the audio / camera combined apparatus 1 as described above, the camera apparatus 1 according to the embodiment of FIG. 1 can be realized, and recording with music-related data added to an imaging data file can be executed as described above.
The imaging processing system in the camera / LCD block 38 corresponds to the imaging unit 22 in FIG. The media drive unit 34 corresponds to the recording / playback unit 24 of FIG. Further, the compression encoding / decoding unit 37, the D / A converter 47, and the headphone amplifier 48 correspond to the audio reproduction processing unit 23 of FIG. The CPU 30 corresponds to the control unit 21 in FIG.

[2. Second Embodiment: Computer Device]

Next, an example in which the data processing apparatus of the present invention is realized by a computer apparatus will be described as a second embodiment.
FIG. 8 shows a configuration as a personal computer system, and a camera device 20A and an audio player 80 as external devices connected to the personal computer system.

The personal computer system includes a personal computer main body 100 (hereinafter referred to as a PC main body), a mouse 101, a keyboard 102, and a monitor device 103. Of course, in addition to this, various external devices such as a printer device, a scanner device, and a communication device may be connected.
The PC main body 100 includes a CPU, a ROM, a RAM, various interface units, and the like as a hardware configuration, but as a software configuration, an OS (Operating System) 111 operates as shown in FIG. The application is running. For example, various applications having functions such as document creation, spreadsheet, drawing / drawing, accounting, browser, game, music / video playback, and the like operate. Various applications receive and process user operations from the keyboard 102 and the mouse 101 via the OS 111, and display the results on the monitor device 103.
As applications that operate in the operation of this example, there are a music data synchronization application 112 and an imaging data copy application 113 shown in the figure.
The music data synchronization application 112 operates when communicating with the audio player 80.
The imaging data copy application 113 operates during communication with the camera device 20A.

As a storage device in the PC main body 100, a recording / reproducing unit 120 for recording / reproducing various data on the recording medium 121 is provided. For example, the recording / reproducing unit 120 is an HDD (Hard Disc Drive). Of course, an optical disk drive or a solid-state memory recording / reproducing unit other than the HDD may be used.
A communication unit 114 that performs data communication with an external device is provided as a communication interface in the PC main body 100. The communication unit 114 is formed as a USB (Universal Serial Bus) communication interface unit, for example. Of course, other communication interface methods such as IEEE (Institute of Electrical and Electronics Engineers) 1394 method, Ethernet (registered trademark), wireless LAN (Local Area Network), and Bluetooth communication may be adopted. .

The camera device 20A shown in FIG. 8 is shown as a camera device that does not have an audio playback function, that is, a camera device such as a normal digital still camera.
The camera device 20A includes a lens mechanism 26, an imaging unit 22, a recording / reproducing unit 24 for the recording medium 25, and a control unit 21, similar to the configuration of the camera device 20 of FIG. However, the audio processing control unit 21b of FIG. 1 is not provided as a function in the control unit 21, and the imaging control unit 21a and recording are performed in order to control the capturing operation of the imaging data and the recording operation of the imaging data file to the recording medium 25. A reproduction control unit 21c and a clock unit 21e are provided.
Further, the camera device 20A is provided with a communication unit 27 for performing data communication with a personal computer system, and the control unit 21 is provided with a function as a communication control unit 21f for performing data communication control.
The communication unit 27 is formed as a USB communication interface unit, for example. Of course, other communication interface methods such as IEEE 1394 method, Ethernet, wireless LAN, Bluetooth communication, etc., may be adopted.

  In response to the user's shutter button operation, the camera device 20A obtains imaging data by the imaging unit 22, and records an imaging data file in the recording medium 25 in the format of FIG. That is, it is an operation as a normal digital still camera.

The audio player 80 is, for example, a portable playback device, and includes a recording / playback unit 82, an audio playback processing unit 84, a communication unit 85, and a control unit 81 for the recording medium 83.
The recording / playback unit 82 performs an operation of reading an audio content file such as music from the recording medium 83. The recording / reproducing unit 82 records and reproduces listening data, which will be described later.
The recording / reproducing unit 82 can be realized as an HDD, and can also be realized as a disk drive device using an optical disk as a recording medium 83. Furthermore, a memory card playback unit using a memory card as the recording medium 83 may be used.

The audio reproduction processing unit 84 performs audio data processing on the audio content file read by the recording / reproducing unit 82. That is, data decoding, digital audio processing, D / A conversion, analog audio processing, and the like are performed to obtain a reproduced audio signal as an analog audio signal. The reproduced audio signal is reproduced and output by the connected headphones 90, for example.
The communication unit 85 performs data communication with the personal computer system. The communication unit 85 is formed as a USB communication interface unit, for example. Of course, other communication interface methods such as IEEE 1394 method, Ethernet, wireless LAN, Bluetooth communication, etc., may be adopted.

  The control unit 81 includes a CPU (Central Processing Unit) that controls the operation of each unit of the audio player 80. As software functions formed by the operation program, an audio processing control unit 81a that controls the audio processing operation of the audio playback processing unit 84, a recording / playback control unit 81b that controls the recording / playback operation of the recording / playback unit 82, and a listening process to be described later A listening data processing unit 81c that executes data generation processing, a clock unit 81d that counts the date and time, and a communication control unit 81e that controls data communication by the communication unit 27 are provided.

In FIG. 8, the PC main body 100 of the personal computer system is an embodiment as the data processing apparatus of the present invention. In this case, the constituent elements of the claims of the present invention correspond to the following.
Imaging data capture means: imaging data reception processing by the communication unit 114 and the imaging data copy application 113.
Pasting processing means: Pasting processing of music related data by the imaging data copy application 113.
Recording control means: recording / reproduction control by the imaging data copy application 113 and the OS 111.
Listening data acquisition means: Listening data reception processing by the communication unit 114 and the music data synchronization application 112.

The following usage pattern is assumed in the system of FIG.
The user can play music with the audio player 80 which is a portable music player. Then, while listening to the music reproduced by the audio player 80, the camera device 20A takes a picture (records image data).
Further, the user transfers the image data file imaged by the camera device 20 </ b> A to the PC main body 100 at an arbitrary time point and stores it in the recording medium 121.
The PC main body 100 performs processing for attaching music-related data to the imaging data file taken from the camera device 20A as processing as an embodiment of the data processing device of the present invention. As the music-related data and information necessary for pasting the data, the audio player 80 generates listening data in accordance with the music reproduction. At any time, data communication between the audio player 80 and the PC main body 100 is performed, and the listening data is transferred to the PC main body 100. In the PC main body 100, music-related data pasting processing is performed on the imaging data file using the listening data.

First, listening data generated by the audio player 80 will be described.
FIG. 9A shows an example of information stored in the recording medium 83 in the audio player 80.
For example, audio data such as music is recorded on the recording medium 83 as audio content files M1, M2, M3... As schematically shown in FIG. Each audio content file M1, M2, M3... Is stored in a state managed by audio management data.
Further, listening data that is sequentially generated and updated by the control unit 83 in accordance with the reproduction of the audio content file is stored.

An example of the contents of the listening data is shown in FIG. The listening data is information that adds the date and time and music-related data about the audio content file each time a certain audio content file is played back.
That is, as date / time information, the year / month / day / hour / minute / second at which playback of a certain audio content file is started is stored as the listening start date / time, and the year / month / day / hour / minute / second at which playback of the audio content file is ended is stored as the listening end date / time. . Then, as the music-related data, the music title, album name, performer name, file name, content ID, and other information of the reproduced audio content file are added.

FIG. 10 shows processing of the control unit 81 of the audio player 80 including such listening data generation / update processing.
When the user performs an operation to instruct playback of an audio content file, the process of the control unit 81 proceeds from step F201 to F202. At this time, the current date and time counted by the clock unit 81d is stored as the listening start date and time. In step F203, playback of the audio content file is started. That is, the recording / playback unit is instructed to reproduce the designated audio content file, and is also instructed to perform audio processing in the audio reproduction processing unit 84 to start reproduction audio output.
In step F204, the end of reproduction of the audio content file is monitored. The end of playback is when the playback performance of the audio content file being played back is completed, or even when the playback performance of the song is in progress, the user stops playback or finds another song ( The audio content file) is instructed, and the reproduction of the audio content file being reproduced is terminated.
When it is determined that the reproduction of the current audio content file is finished, the process proceeds to step F205, and the control unit 81 stores the current date and time counted by the clock unit 81d at that time as the listening end date and time.

In step F206, the control unit 81 generates the contents of the listening data regarding the audio content file that has been reproduced. That is, the listening data contents are generated by associating the listening start date and time saved in step F202, the listening end date and time saved in step F205 with the music-related data. The music related data is acquired from, for example, audio management data, header information of an audio content file, or the like.
In the process of step F206, one reproduced audio content file, that is, the listening data content for one song is generated.

  In step F207, the control unit 81 determines whether or not playback of the next song is continued. For example, when the playback of the next song is continued after the completion of the playback of a certain song, or when another song is played in response to the user's cueing operation, etc., the playback of the next song is continued. Return to step F202. In that case, the processes of steps F202 to F206 are similarly performed for the audio content file to be reproduced next.

When it is determined in step F207 that the next song is not played, for example, when the user ends the playback itself by a stop operation or the like, or when the playback of all or a part of the designated song is completed When the reproduction operation itself is terminated, the process proceeds to step F208, and the listening data in the recording medium 83 is updated.
That is, the update is performed by adding the contents of the listening data generated in step F207 to the listening data stored in the recording medium 83 until then. Of course, if the listening data itself is not recorded on the recording medium 83, the listening data is newly written.

Note that the processing of steps F202, F205, and F207 is executed by the function of the listening data processing unit 81c of the control unit 81, and the processing of step F208 is performed by the functions of the listening data processing unit 81c and the recording / playback control unit 81b.
Since the processing of FIG. 10 is performed at the time of reproduction of the audio content file, the content of the listening data is additionally updated each time one piece of music as the audio content file is reproduced. The data is always stored in the past reproduction history as reproduction date and music related data.

When the audio player 80 is connected to the PC main body 100 for communication, the listening data is transferred to the PC main body 100.
FIG. 11 shows processing when the audio player 80 and the PC main body 100 are connected to be communicable. Processing is performed by the music data synchronization application 112 on the PC main body 100 side, and processing by the control unit 81 is performed on the audio player 80 side.

When the audio player 80 is connected to the PC main body 100 and mutual communication is established between the communication unit 114 of the PC main body 100 and the communication unit 85 of the audio player 80, the music data synchronization application 112 is executed in step F301. Then, the audio player 80 is transmitted to request listening data.
When receiving the listening data request at step F311, the control unit 81 of the audio player 80 instructs the recording / playback unit 82 to read the listening data from the recording medium 83 at step F311. In step F313, the control unit 81 causes the communication unit 85 to transmit the listening data read from the recording medium 83 to the PC main body 100.
When the music data synchronization application 112 receives the listening data transmitted from the audio player 80 in step F302, the music data synchronization application 112 transfers the received listening data to the recording / playback unit 120 and stores it in the recording medium 121 in step F303.
FIG. 13B schematically shows a state in which the listening data is stored in the recording medium 121.

The processing of FIG. 11 is performed, and the listening data is copied to the PC main body 100, so that the reproduction date and time and music related to music (audio content file) played by the user with the audio player 80 in the PC main body 100 are reproduced. Data can be obtained.
Such listening data transfer may be automatically performed when the PC main body 100 and the audio player 80 are communicably connected.

Next, a process for attaching music-related data to image data captured by the camera device 20A will be described.
Here, an example in which music-related data pasting processing is performed when the camera device 20A and the PC main body 100 are communicably connected and image data is transferred from the camera device 20A to the PC main body 100 will be described.
FIG. 12 shows processing when the camera device 20A and the PC main body 100 are connected to be communicable. Processing is performed by the imaging data copy application 113 on the PC main body 100 side, and processing by the control unit 21 is performed on the camera device 20A side.

  When the camera device 20A is connected to the PC main body 100 and mutual communication is established between the communication unit 114 of the PC main body 100 and the communication unit 27 of the camera device 20A, the imaging data copy application 113 executes in step F401. Then, the camera device 20A is transmitted to request imaging data.

  When receiving the imaging data request in step F421, the control unit 21 of the camera device 20A instructs the recording / reproducing unit 24 to sequentially read the imaging data from the recording medium 25 in step F422, and the readout imaging data is transmitted to the communication unit 27. To the PC main body 100. If imaging data files PH1, PH2, PH3,... Are stored in the recording medium 25 of the camera device 20A as shown in FIG. 13A, these imaging data files PH1, PH2, PH3,. The data is read out and transferred to the PC main body 100.

In step F <b> 402, the imaging data copy application 113 of the PC main body 100 transfers the imaging data sequentially transmitted from the camera device 20 </ b> A to the recording / playback unit 120 and stores it in the recording medium 121.
The imaging data copy application 113 confirms whether or not the processing of receiving the imaging data transferred from the camera device 20A in step F403 and storing it in the recording medium 121 has been completed.
At the time of completion, all of the image data captured by the camera device 20A and stored in the recording medium 83 are copied to the PC main body 100 (recording medium 121).

When the storage of the imaging data on the recording medium 121 is completed, the processing of the imaging data copy application 113 proceeds to step F404, and requests listening data from the music data synchronization application 112.
The music data synchronization application 112 reads the listening data stored in the recording medium 121 by the processing of FIG. 11 described above, and if the listening data exists, transfers it to the imaging data copy application 113. That is, the imaging data copy application 113 proceeds from step F405 to F406, and acquires listening data.
Note that this processing does not necessarily have to be performed via the music data synchronization application 112, and the imaging data copy application 113 may instruct the recording / playback unit 120 to read out the listening data and take in the listening data.

If the processing of FIG. 11 has already been performed, the listening data transferred from the audio player 80 and the camera device 20 are transferred to the recording medium 121 as shown in FIG. The captured data files PH1, PH2, PH3,... Are stored. In this case, since the listening data exists, the imaging data copy application 113 can acquire the listening data in step F406.
On the other hand, if the process of FIG. 11 has not been performed before, the listening data is not stored in the recording medium 121, and in this case, the process ends from step F405.

If listening data can be obtained. The process of the imaging data copy application 113 proceeds to step F407, and an imaging data file is extracted. That is, one imaging data file (for example, PH1) is read out from the imaging data files stored in the recording medium 121 as shown in FIG.
In step F408, it is confirmed whether there is music or the like played back by the audio player 80 at the date and time when the captured image file PH1 was captured by the camera device 20A. As described in the first embodiment, the header of the imaging data file includes imaging date / time information. Also, the listening data includes information on the start date / time and the end date / time of the audio content file as described with reference to FIG.
Accordingly, in step F408, for example, the imaging date / time is confirmed from the header information of the imaging data file PH1, and the user is listening at the time of imaging by comparing the imaging date / time with the listening start date / time and listening end date / time in the listening data. Whether or not an audio content file exists.

If there is no audio content file that has been played back at the time corresponding to the imaging date and time, there is no music-related data to be attached to the imaging data file PH1, and the process advances from step F408 to F412.
On the other hand, if there is an audio content file that has been played back at the imaging date and time, the process proceeds from step F408 to F409 to check whether or not music-related data has already been attached to the imaging data file PH1. If pasting processing of music related data has been performed on the imaging data file PH1 extracted in step F407 in the past, the current processing is not necessary, and the process advances from step F409 to F412.
If it is determined in step F409 that music-related data is not attached to the imaging data file PH1, the process proceeds to step F410, and processing for attaching music-related data is performed.
That is, in the listening data, music-related data recorded corresponding to the listening start date and time and the listening end date and time including the imaging time point is read out and pasted to the imaging data file PH1. That is, the music-related data of the audio content file that was being listened to at the time of imaging.
After performing the pasting process, the imaging data file PH1 is overwritten and recorded on the recording medium 121 in step F411. That is, the imaging data file PH1 to which the music-related data is not pasted is rewritten to the imaging data file PH1 to which the music-related data is pasted.
Then, the process proceeds to Step F412.

In step F412, it is confirmed whether or not there is an unprocessed imaging data file for the processes in steps F407 to F411. If there is an unprocessed image data file, the process returns to step F407, an unprocessed image data file (for example, image data file PH2) is read, and the processes of steps F408 to F411 are performed in the same manner.
Thereafter, the same processing is performed for the imaging data files after the imaging data file PH3. In step F412, when it is determined that there is no unprocessed imaging data file, the music-related data pasting process by the imaging data copy application 113 is finished.
Through the above processing, for example, as shown in FIG. 13D, music-related data is added to the captured data files PH1, PH2, PH3.

As described above, when the user performs a photography operation with the camera device 20A while listening to music or the like with the audio player 80, the user listens to each imaging data file when the imaging data file is transferred to the PC body 100 thereafter. Music-related data about the music that has been stored is pasted and stored in the recording medium 121.
When the imaging data file with the music-related data attached is read from the recording medium 121 and displayed on the monitor device 103, for example, the contents of the music-related data (song name, artist name, etc.) are displayed together, so that the user Can recall the music he was listening to while taking photos while browsing.
Further, if the music-related data includes the file name or content ID of the audio content file and the audio content file is stored in the recording medium 121, the imaging data file is read from the recording medium 121 and monitored. 103, the audio content file can be identified from the music-related data, and the audio playback application installed in the PC main body 100 can be started and played back. You can also browse photos while listening.

Note that the processing in FIGS. 11 and 12 is merely an example.
For example, steps F401 to F403 and steps F404 to F412 in FIG. 12 may be executed as separate processes. That is, steps F401 to F403 are processes executed by communication between the camera device 20 and the PC main body 100, while steps F404 to F412 are processes performed only on the PC main body 100 side. Therefore, steps F401 to F403 may be executed when communication is established, and steps F404 to F412 may be executed when communication is not established.
Steps F401 to F403 are processes for taking an image data file captured by the camera device 20A into the PC main body 100, but are not necessarily executed by data communication. For example, when the recording medium 25 of the camera device 20A is a portable medium such as an optical disk or a memory card, the recording medium 25 is loaded into a disk drive or a memory card slot provided on the PC main body 100 side for reproduction, and image data You may make it take in a file.

Further, as the processing in FIG. 11, when the PC main body 100 acquires the listening data from the audio player 80, the processing in steps F404 to F412 in FIG. 12 may be executed following step F303. That is, in this example, the pasting of the music related data to the imaging data file transferred from the camera device 20A is executed when the listening data is acquired.
Of course, the processing in steps F404 to F412 in FIG. 12 may be executed at an arbitrary time point by a user operation or automatically according to the storage state of the imaging data file.

[3. Third Embodiment: Camera Device]

Next, an example in which the data processing device of the present invention is realized by a camera device without an audio playback function will be described as a third embodiment.
FIG. 14 shows a camera device 20B having no audio playback function and an audio player 80A as an external device for performing data communication with the camera device 20B.

A camera device 20B shown in FIG. 14 includes a lens mechanism 26, an imaging unit 22, a recording / reproducing unit 24 for a recording medium 25, a communication unit 27, and a control unit 21 in the same manner as the camera device 20A shown in FIG. However, as a function of the control unit 21, an imaging control unit 21a, a recording / playback control unit 21c, and a clock unit 21e are provided in order to control the capturing operation of the imaging data and the recording operation of the imaging data file to the recording medium 25. A pasting processing unit 21d that performs pasting processing of music-related data with respect to the imaging data is provided.
Further, the communication unit 27 of the camera device 20B is a communication unit that performs data communication with the audio player 80A, and the control unit 21 is provided with a function as a communication control unit 21f in order to perform data communication control.
The communication unit 27 is formed as a USB communication interface unit, for example. Of course, other communication interface methods such as IEEE 1394 method, Ethernet, wireless LAN, Bluetooth communication, etc., may be adopted.

  In response to the user's shutter button operation, the camera device 20B obtains image data with the operation unit 22, and records the image data file on the recording medium 25 in the format of FIG. That is, it is an operation of a normal digital still camera. Thereafter, in the process of FIG. 15 described later, a process of attaching music-related data to the imaging data file stored in the recording medium 25 is performed.

The audio player 80A is, for example, a portable playback device, and is provided with a recording / playback unit 82, an audio playback processing unit 84, a communication unit 85, and a control unit 81 for the recording medium 83, similarly to the audio player 80 of FIG. Similarly, the control unit 81 includes an audio processing control unit 81a, a recording / playback control unit 81b, a listening data processing unit 81c, a clock unit 81d, and a communication control unit 81e.
In this case, the communication unit 85 performs data communication with the camera device 20B. The communication unit 85 is formed as a USB communication interface unit, for example. Of course, other communication interface methods such as IEEE 1394 method, Ethernet, wireless LAN, Bluetooth communication, etc., may be adopted.

In FIG. 14, the camera device 20B is an embodiment as a data processing device of the present invention. In this case, the constituent features of the claims of the present invention correspond to the following.
Imaging data capturing means: imaging unit 22, imaging control unit 21a.
Pasting processing means: pasting processing unit 21d.
Recording control means: a recording / reproducing control unit 21c.
Listening data acquisition means: communication unit 27.

The following usage pattern is assumed in the system of FIG.
The user takes a picture (records image data) with the camera device 20B while reproducing the music with the audio player 80A, which is a portable music player.
Similar to the audio player 80 of the second embodiment, the audio player 80A additionally updates the listening data in accordance with the reproduction of the audio content file in the process of FIG. The audio player 80A and the camera device 20B perform data communication at an arbitrary time, and listening data is provided to the camera device 20B.
The camera device 20B performs processing for pasting music-related data using the listening data for the captured data file that has been captured and stored in the recording medium 25.

The transfer of the listening data and the music-related data pasting process to the imaging data file performed in accordance therewith will be described with reference to FIG.
FIG. 15 shows processing when the audio player 80A and the camera device 20B are connected to be communicable. The processing is performed by the control unit 21 on the camera device 20B side, and the processing by the control unit 81 is performed on the audio player 80A side.

When the mutual communication between the communication unit 85 of the audio player 80A and the communication unit 27 of the camera device 20B is established, the control unit 21 of the camera device 20B requests the audio player 80 for listening data in step F501. Send.
When receiving the listening data request in step F511, the control unit 81 of the audio player 80 instructs the recording / playback unit 82 to read the listening data from the recording medium 83 in step F512. In step F513, the control unit 81 causes the communication unit 85 to transmit the listening data read from the recording medium 83 to the camera device 20B.
The control unit 21 of the camera device 20B receives the listening data transmitted from the audio player 80 in step F502, transfers the received listening data to the recording / playback unit 24, and stores it in the recording medium 25.

When the listening data is acquired from the audio player 80A in this way, the control unit 21 of the camera device 20B advances the process to Step F503, and extracts an imaging data file. That is, one imaging data file is read out from the imaging data files recorded on the recording medium 25 by the imaging operation so far.
In step F504, it is confirmed whether or not there is music or the like reproduced by the audio player 80A at the date and time when the imaged data file was imaged. As described in the second embodiment described above, the user at the time of imaging is compared by comparing the listening start date / time and listening end date / time in the listening data with the imaging date / time included in the header information of the imaging data file. It is possible to confirm whether or not there is an audio content file that has been listened to.

If there is no audio content file being played back at the time corresponding to the imaging date and time, there is no music-related data to be attached to the imaging data file currently being processed, and the process advances from step F504 to F508.
On the other hand, if there is an audio content file that has been played back at the imaging date and time, the process proceeds from step F504 to F505 to check whether music-related data has already been attached to the imaging data file. If pasting processing of music-related data has been performed on the imaging data file extracted in step F503, the current processing is not necessary, and the process advances from step F505 to F508.
If it is determined in step F505 that music-related data is not attached to the imaging data file to be processed, the process proceeds to step F506 to perform processing for attaching music-related data.
That is, in the listening data, the music related data recorded corresponding to the listening start date and time and the listening end date and time including the imaging time point, that is, the music related data of the audio content file that was being listened to at the imaging time point is read out, and this data is read out Affix to file.
After performing the pasting process, in step F507, the recording / playback unit 24 causes the recording data 25 to be overwritten and recorded on the recording medium 25 by pasting the music related data. Then, the process proceeds to Step F508.

In step F508, it is confirmed whether or not there is an unprocessed imaging data file for the processes in steps F504 to F507. If an unprocessed imaging data file exists in the recording medium 25, the process returns to step F503, the unprocessed imaging data file is read, and the processes of steps F504 to F507 are performed in the same manner.
The control unit 21 ends the music-related data pasting process when it is determined in step F508 that there is no unprocessed imaging data file.
Through the above processing, the music-related data is added to the imaging data file and stored in the recording medium 25.

As described above, when the user performs a photo shooting operation with the camera device 20B while listening to music or the like with the audio player 80, the camera device 20B then acquires the listening data from the audio player 80A with respect to each imaging data file. Music-related data about the music that was being listened to is pasted and stored in the recording medium 25.
When the imaging data file with the music-related data attached is read out from the recording medium 25 and displayed in this manner, the contents of the music-related data (song title, artist name, etc.) are displayed together so that the user can browse the photo. , I can recall the music I was listening to at the time of imaging.
In addition, the imaging data file to which the music-related data is pasted in the camera device 20B can be transferred to a personal computer or the like thereafter. Then, when browsing the imaging data file with a personal computer or the like, the music related data can be displayed together or the corresponding music can be reproduced based on the music related data.

Note that the process of FIG. 15 is merely an example.
For example, the control unit 21 may execute steps F501 to F502 and steps F503 to F508 in FIG. 15 as separate processes. That is, steps F501 to F502 are processes performed by communication with the audio player 80A, while steps F503 to F508 are processes performed only on the camera device 20B side. Therefore, steps F501 to F502 may be executed when communication is established, and steps F503 to F508 may be executed when communication is not established.
Of course, the processing of steps F503 to F508 may be executed at an arbitrary time point by a user operation or automatically according to the storage status of the imaging data file.

[4. Modifications and Program]

Although the embodiments have been described above, various modifications can be considered as the present invention.
In the embodiment, an example in which the data processing apparatus of the present invention is realized in a camera device or a personal computer has been described. However, the present invention can be realized by various devices that handle imaging data files. For example, the present invention can be implemented even with a portable personal computer, a PDA (Personal Digital Assistant), a mobile phone, and the like.

As music-related data, a song name, album name, artist name, songwriter name, partial text of lyrics, audio data itself, a part of audio data, and the like can be considered. Any data may be used as long as it is related to the music to be reproduced.
In addition, the explanation has been given by taking the example in which the audio content file is a music piece as the music related data, but it is of course not limited to the music piece. For example, reading audio such as novels, speech audio, entertainment audio such as rakugo, natural sounds such as wind sounds and wave sounds are recorded as audio content files, and related to those played by the user at the time of imaging It is only necessary that the data to be attached is attached to the imaging data file.

The program of the present invention is a program for executing processing for attaching audio-related data to an imaging data file. For example, it is a program for executing the processing described with reference to FIG. 2, FIG. 11, FIG. 12, and FIG.
Such a program of the present invention can be recorded in advance in a system HDD as a recording medium in a camera device or a computer system, a ROM in a microcomputer having a CPU, or the like.
Alternatively, the program is temporarily or permanently stored on a removable recording medium such as a flexible disk, CD-ROM (Compact Disc Read Only Memory), MO (Magnet optical) disk, DVD (Digital Versatile Disc), magnetic disk, and semiconductor memory. Can be stored (recorded). Such a removable recording medium can be provided as so-called package software. For example, it can be installed in a computer system by being provided by a CD-ROM, a DVD-ROM, or the like. In addition to installing from a removable recording medium, the program can be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet.

It is a block diagram of the structure of the camera apparatus of the 1st Embodiment of this invention. It is a flowchart of the music related data sticking process of 1st Embodiment. It is explanatory drawing of the imaging data file of 1st Embodiment. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a front view, a plan view, a left side view, a right side view, a bottom view, and a rear view of an audio / camera combined apparatus that is a camera apparatus according to a first embodiment; It is explanatory drawing of the opening / closing state of the lens cover of the audio camera composite apparatus used as the camera apparatus of 1st Embodiment. 1 is a block diagram of an audio / camera combined apparatus as a camera apparatus according to a first embodiment. FIG. 1 is a block diagram of a camera / LCD block of an audio / camera combined apparatus as a camera apparatus according to a first embodiment; FIG. It is explanatory drawing of the structure of 2nd Embodiment. It is explanatory drawing of the listening data used in 2nd, 3rd embodiment. It is a flowchart of the process of the audio player of 2nd, 3rd embodiment. It is a flowchart of the process at the time of communication of the audio player and PC main body of 2nd Embodiment. It is a flowchart of the process at the time of communication of the camera apparatus and PC main body of 2nd Embodiment. It is explanatory drawing of the recording state until sticking of the music related data of 2nd implementation. It is explanatory drawing of a structure of 3rd Embodiment. It is a flowchart of the process at the time of communication of the camera apparatus of 3rd Embodiment and an audio player.

Explanation of symbols

  20, 20A, 20B Camera device, 21 control unit, 21a imaging control unit, 21b audio processing control unit, 21c recording / playback control unit, 21d pasting processing unit, 21e clock unit, 21f communication control unit, 22 imaging unit, 23 audio playback Processing unit, 24 recording / playback unit, 25 recording medium, 100 PC main body, 111 OS, 112 music data synchronization application, 113 imaging data copy application, 120 recording / playback unit, 121 recording medium

Claims (8)

Imaging data capturing means for capturing imaging data;
Affixing processing means for affixing audio-related data related to audio data reproduced at the imaging date and time of the imaging data to the imaging data;
Recording control means for recording on the recording medium the imaging data to which the audio-related data is pasted by the pasting processing means;
A data processing apparatus comprising:   The data processing apparatus according to claim 1, wherein the imaging data capturing unit is configured as an imaging unit that captures a subject image. It further comprises audio playback means for playing back audio data,
The pasting processing means acquires audio-related data related to audio data reproduced by the audio reproduction means at the time when imaging is performed by the imaging section, and pastes the data to the imaging data captured by the imaging section. The data processing apparatus according to claim 2. It further comprises listening data acquisition means for acquiring listening data including playback date and time information and audio related data for audio data played back by the audio playback device from an external audio playback device,
The pasting processing means uses the imaging date and time information included in the imaging data imaged by the imaging unit and the reproduction date and time information in the listening data acquired by the listening data acquisition means, and uses the listening data as imaging data. The data processing apparatus according to claim 2, wherein processing for pasting audio-related data included in the data is performed.   The data processing apparatus according to claim 1, wherein the imaging data capturing unit captures imaging data transmitted from an external device through data communication with the external device. It further comprises listening data acquisition means for acquiring listening data including playback date and time information and audio related data for audio data played back by the audio playback device from an external audio playback device,
The pasting processing means uses the imaging date / time information included in the imaging data captured by the imaging data capturing means and the reproduction date / time information in the listening data acquired by the listening data acquisition means, to the imaging data, 6. The data processing apparatus according to claim 5, wherein processing for attaching audio-related data included in the listening data is performed. An imaging data capturing step for capturing imaging data;
Affixing processing step of affixing audio-related data related to audio data reproduced at the imaging date and time of the imaging data to the imaging data;
A recording control step for recording the imaging data to which the audio-related data is pasted in the pasting step on a recording medium;
A data processing method comprising: An imaging data capturing step for capturing imaging data;
Affixing processing step of affixing audio-related data related to audio data reproduced at the imaging date and time of the imaging data to the imaging data;
A recording control step for recording the imaging data to which the audio-related data is pasted in the pasting step on a recording medium;
That causes a data processing device to execute

Images