JP2007011452A - Program, data processing method, data processor, audio reproducing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To raise an added value of electronic data by making information relevant to music listened to when a user creates electronic data such as an electronic diary automatically stuck on the electronic data. <P>SOLUTION: When the user creates the electronic data such as electronic diary data, audio related data relevant to music etc. which the user listens to is acquired and stuck on the electronic data. In addition, search of audio data is carried out complying with specified operation to audio related data stuck on the electronic data and the music shown with the audio related data is reproduced or enabled to be obtained from a music sales site etc. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a program for creating electronic data, a data processing device realized by the program, and a data processing method. Furthermore, the present invention relates to an audio playback device suitable for processing by a data processing device.

JP 2004-32129 A

The spread of information processing devices such as personal computers has created an environment in which general users can easily create various types of electronic data. For example, it is easy to create and edit document data, spreadsheet data, drawing data, illustration data, image data, etc. using arbitrary application software.
Further, in recent years, general users have widely made public the created electronic data to an unspecified number of people due to improvements in the network environment such as the Internet. For example, there is an electronic diary generally called a blog.
In the electronic diary, a user creates diary data using text data and image data and uploads it to a server. Then, an unspecified number of users can browse the diary via the network.

In recent years, there are many opportunities for general users to create electronic data while listening to music. For example, it is a case where electronic diary data is created while music is played on a personal computer.
The user's favorite music creates a comfortable environment as BGM (Back Ground Music) when proceeding with work, but it also reflects the mood and situation at that time and revives memories.
For example, when you are looking at electronic diary data you wrote in the past, remembering the music you were listening to at that time may remind you of the memories and emotions you created when creating the electronic diary.
In addition, in the case of publishing electronic diary data etc. via the Internet etc., if the viewer can know the music etc. that the creator listened to, the creator's feelings and music preferences can be estimated, The enjoyment of data browsing is also increased.

  Accordingly, an object of the present invention is to automatically add data related to music or the like that the user listened to at the time of creation to the electronic data created by the user, thereby improving the added value of the electronic data.

The program of the present invention includes a data creation step for creating electronic data, an audio-related data acquisition step for acquiring audio-related data related to audio data that was played back at the time of electronic data creation in the data creation step, and the data creation step Is a program that causes the data processing device to execute the pasting process step of pasting the audio-related data acquired in the audio-related data acquisition step to the electronic data created in step (b).
For example, the electronic data created in the data creation step is electronic diary data.
That is, audio-related data for music or the like that was played back when electronic data was created by the data processing apparatus according to the program of the present invention is pasted on the automatically created electronic data.

In the audio-related data acquisition step, listening data including playback date / time information and audio-related data for audio data played back by the audio playback device is acquired from an external audio playback device. In the pasting process step, the electronic data is created in the electronic data using the creation date information of the electronic data created in the data creation step and the reproduction date information in the listening data obtained in the audio related data obtaining step. A process for pasting audio-related data included in the listening data is performed.
For example, when electronic data is created by a data processing apparatus according to the program of the present invention, even when music or the like is played on an external audio playback device, audio related data about the music or the like is pasted on the electronic data. It can be so. For this purpose, the listening data may be acquired from an external audio playback device. Then, by comparing the date and time information, the created electronic data can be made to correspond to the audio-related data, so that the audio-related data can be attached to the electronic data.

In the electronic data creation step, imaging data can be attached to the electronic data being created. In the audio-related data acquisition step, listening data including playback date / time information and audio-related data for audio data played back by the audio playback device is acquired from an external audio playback device. In the pasting processing step, the imaging date / time information of the imaging data pasted on the electronic data created in the data creation step and the reproduction date / time information in the listening data obtained in the audio-related data obtaining step are further used. Then, the audio data included in the listening data is attached to the electronic data.
That is, when imaging data is affixed to electronic data such as electronic diary data, audio-related data regarding music or the like that was being listened to at the time of imaging is also affixed to the electronic data. In that case, the audio-related data to be pasted can be determined and pasted by comparing the date and time information with the listening data and the imaging data.

In the electronic data creation step, imaging data can be attached to the electronic data being created. In the pasting process step, a process of pasting audio related data pasted on the imaging data pasted on the electronic data created in the data creating step to the electronic data is further performed.
That is, when audio-related data about music or the like that was being listened to at the time of imaging is already affixed to the imaging data affixed to the electronic data, the audio-related data is affixed to the electronic data.

Further, when there are a plurality of audio-related data to be attached to the electronic data, a selection step of selecting the audio-related data to be attached is further provided.
When there are multiple audio-related data to be pasted, for example, when multiple songs are played back when creating electronic data, or audio-related data about music that was listened to when creating electronic data, and pasting to electronic data When there is audio-related data for music or the like that was being listened to at the time of imaging of the captured image data, a plurality of imaging data is affixed to the electronic data, and audio-related data exists for each imaging data, etc. is there.
In these cases, for example, a selection step for selecting audio-related data to be pasted based on user operation input or presetting is provided. For selection, various selection methods are envisaged, such as selecting one audio-related data, selecting all audio-related data, and selecting some audio-related data.

The program of the present invention has audio-related data related to audio data reproduced when electronic data was created and / or audio-related data related to audio data reproduced when imaging data attached to electronic data was attached. A display control step for displaying electronic data, a detection step for detecting a designation operation for audio-related data attached to the displayed electronic data, and designation according to the designation operation being detected in the detection step A program for causing a data processing apparatus to execute a search step for searching for an audio content file from the contents of audio-related data to be operated and a processing step for performing processing related to the audio content file searched in the search step.
The processing related to the audio content file in the processing step is a reproduction request processing for the audio data searched in the searching step.
Alternatively, in the search step, an external server that provides the audio data is searched from the contents of the audio-related data to be designated, and in the processing step, a process of presenting the external server is performed. For example, a music sales site as an external server is presented.
That is, when browsing electronic data with audio-related data attached, the viewer can listen to music or the like indicated by the audio-related data by performing a designation operation (for example, a click operation) on the audio-related data. Make it possible to obtain music data.

The data processing method of the present invention includes a data creation step for creating electronic data, an audio-related data acquisition step for acquiring audio-related data related to audio data that was reproduced at the time of electronic data creation in the data creation step, and the data A pasting process step of pasting the audio-related data acquired in the audio-related data acquiring step to the electronic data generated in the generating step.
In the data processing method of the present invention, audio-related data relating to audio data reproduced at the time of creation of electronic data and / or audio-related data relating to audio data reproduced at the time of imaging of imaging data attached to the electronic data are attached. A display control step for displaying the displayed electronic data, a detection step for detecting a designation operation of audio-related data attached to the displayed electronic data, and in response to the designation operation being detected in the detection step And a search step for searching for audio data from the contents of the audio-related data to be designated, and a processing step for performing processing related to the audio data searched in the search step.

A data processing apparatus according to the present invention includes a data creation unit that creates electronic data in response to an input, an audio-related data acquisition unit that acquires audio-related data related to audio data that was reproduced when the electronic data was created by the data creation unit, and And a pasting processing unit for pasting the audio related data acquired by the audio related data acquiring unit to the electronic data generated by the data generating unit.
Also, the data processing apparatus of the present invention attaches audio-related data related to audio data reproduced at the time of electronic data creation and / or audio-related data related to audio data reproduced at the time of imaging of image data attached to the electronic data. Display control means for displaying the displayed electronic data on the display unit, detection means for detecting the designation operation of the audio-related data attached to the displayed electronic data, and the designation operation being detected by the detection means And a processing unit for performing processing relating to the audio data searched by the search unit.

The audio reproducing apparatus of the present invention performs reproduction in accordance with reproduction means for reproducing audio data from a recording medium, date and time counting means for counting the current date and time, and reproduction of audio data by the reproduction means. Listening data for acquiring the playback date / time information from the date / time counting means, generating audio-related data for the played back audio data, and generating and storing the listening data including the playback date / time information and the audio-related data Generating means and transmitting means for transmitting the listening data in response to a request from an external device.
In other words, the audio playback device can transmit listening data to the data processing device so that audio-related data can be attached to the electronic data created by the data processing device.

The audio-related data refers to, for example, the title of audio data such as music, the title of the album in which the song is stored, the name of the performer, the name of the song composer, the name of the song, the ID information of the song, etc. This is data that allows the user to recognize music at a later point in time and identify music etc. with the system. The audio related data may be audio data itself, for example, a part of a song.
The electronic data referred to in the present invention is data created by a user using a data processing device such as a personal computer. For example, various text data, e-mail data, graphic data, drawing data, graphic data, statistical data, spreadsheet data, homepage data, and the like are also included. The attachment of audio-related data to electronic data refers to recording the audio-related data in association with the electronic data, and the format of the attachment recording, the file format, the management form, etc. are not questioned.

According to the present invention, when electronic data such as electronic diary data is created by the user, audio-related data about music or the like that the user has been listening to is automatically attached. As a result, audio-related data such as song titles can be presented together when browsing electronic data, and the added value of the electronic data can be increased.
In addition, by specifying the audio-related data pasted on the electronic data, the music-related data indicated by the audio-related data can be played back or obtained from a music sales site, etc. You can also increase the utility value of

Embodiments of a program, a data processing method, and a data processing apparatus according to the present invention will be described below in the following order. As an embodiment, an example of a personal computer that operates according to the program of the present invention will be described. An example of electronic data is electronic diary data.
In each embodiment, the diary creation / viewing application 23 corresponds to the program of the present invention, and the personal computer (PC main body 20) in which the diary creation / viewing application 23 is installed corresponds to the data processing apparatus of the present invention. . A processing method executed by the PC main body 20 based on the diary creation / viewing application 23 corresponds to the data processing method of the present invention.

[1. First Embodiment: Attaching music-related data when creating a diary]
[2. Second Embodiment: Attaching Music Related Data Related to Playback of External Device]
[3. Third Embodiment: Attaching music-related data for playback of external devices when creating a diary]
[4. Fourth Embodiment: Attaching Music Related Data on Photos Pasted in a Diary]
[5. Fifth Embodiment: Pasting a Photo with Music-Related Data on Diary]
[6. Pre-setting for pasting music related data]
[7. Processing when music related data in the diary is selected]
[8. Effect of embodiment, modification and program]

[1. First Embodiment: Attaching music-related data when creating a diary]

As a first embodiment, a personal computer system in which a user creates electronic diary data is shown.
FIG. 1 shows a configuration as a personal computer system and a blog server 1 connected to the personal computer system via a network 10 such as the Internet.

The personal computer system includes a personal computer main body 20 (hereinafter referred to as a PC main body), a mouse 11, a keyboard 12, and a monitor device 13. Of course, in addition to this, various external devices such as a printer device, a scanner device, and a communication device may be connected.
The PC main body 20 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), various interface units, and the like as a hardware configuration. (Operating System) 21 is activated, and various applications are activated thereon. For example, various applications having functions such as document creation, spreadsheet, drawing / drawing, accounting, browser, game, music / video playback, and the like operate. Various applications accept user operations from the keyboard 12 and mouse 11 via the OS 21, process them, and display the results on the monitor device 13.

As applications related to the operation of the present embodiment, there are a reproduction application 22 and a diary creation / viewing application 23 shown in the figure.
The playback application 22 is software that plays back an audio content file. When the playback application 22 is activated, a music playback window is displayed on the monitor device 13, and the user can specify and play back a desired music piece. For example, when an audio content file recorded on the recording medium 25 of the recording / playback unit 24 is selected, the playback application 22 performs playback control of the audio content file and plays back from a speaker unit (not shown) or connected headphones. Output music.
The diary creation / viewing application 23 is an application for browsing and creating electronic diary data. That is, by starting up the diary creation / viewing application 23, it is possible to access the blog server 1 via the network 10, browse the electronic diary data, and write / update the diary into one's own electronic diary data. . Details of processing by the diary creation / browsing application 23 will be described later.

In addition, as a storage device in the PC main body 20, a recording / reproducing unit 120 that records and reproduces various data with respect to the recording medium 121 is provided. For example, the recording / reproducing unit 120 is an HDD (Hard Disc Drive).
Of course, other than HDDs, optical disc drives using optical disc media such as CD (Compact Disc), MD (Mini Disc), DVD (Digital Versatile Disc), Blu-ray Disc (Blu-Ray Disc), solid-state memory or solid-state memory May be a recording / reproducing unit corresponding to a memory card or the like with a built-in memory.
In addition, a communication unit 27 for accessing an external website or the like via the network 50 is provided as a communication interface in the PC main body 20.

The blog server 1 manages electronic diary data of a large number of users via a network 10 such as the Internet by an electronic diary management system 2.
The electronic diary data created by the user is uploaded to the blog server 1 and stored in the recording medium 4 of the recording / playback unit 3 by the electronic diary management system 2.
In addition, the user can browse the electronic diary data of others stored in the recording medium 4 by accessing the blog server 1.
An example of electronic diary data is shown in FIG. FIG. 3 shows an example in which a diary image 300 is displayed on the monitor device 13 by an Internet browser function, for example, as an electronic diary data browsing screen. In the diary image 300, diaries 301 and 302 created by the user so far are displayed in a predetermined layout.

Next, the characteristic processing operation of this example, particularly the processing at the time of diary creation based on the control of the diary creation / viewing application 23 will be described with reference to FIG.
In step F101 of FIG. 2, as the diary creation process, the diary creation / browsing application 23 performs a process of creating diary data in accordance with a user operation.
For example, a diary creation image 310 as shown in FIG. 4 is displayed on the monitor device 13 as a user interface screen when creating a diary in response to a user link operation from the diary browsing screen as shown in FIG.
The diary creation image 310 includes a title input unit 311, a text input unit 312, a photo designation unit 313 for designating a photo to be pasted (imaging data), a diary registration operation unit 314, and the like.
The user performs input on such a diary creation image 310. That is, the title of the diary is entered in the title input unit 311 and the text of the diary is input in the text input unit 312. Furthermore, it is possible to input an imaging data file to the photo designation unit 313 and attach a photo to the diary. When these inputs are completed, the user clicks the diary registration operation unit 314.

When the user's click operation on the diary registration operation unit 314 is detected, the process of the diary creation / viewing application 23 proceeds from step F102 to F103, and at this time, it is confirmed whether or not the audio is being reproduced. That is, the diary creation / browsing application 23 confirms whether or not the audio content file is being reproduced by the reproduction application 22.
If audio reproduction is not performed, the process proceeds to step F106, where the diary data created this time is stored in the recording medium 25, uploaded to the blog server 1 via the communication unit 27, and stored in the recording medium 4 of the blog server 1. Store. By uploading, newly created diary data can be viewed on a diary browsing screen as shown in FIG. 3 by an unspecified number of users.

If it is determined in step F103 that the audio is being reproduced, the process proceeds from step F103 to F104. This is a case where the user has created a diary using the diary creation image 310 of FIG. 4 while listening to music or the like.
In this case, in step F104, music related data such as music being reproduced is acquired. For example, information such as the header information of the audio content file being played back, the song name, album name, artist name, file name of the audio content file, content ID, etc. described in the audio management data for managing the audio content file is acquired. To do. Since the playback application 22 reads audio management data, file headers, and the like from the recording medium 25 during playback of the audio content file, the diary creation / viewing application 23 receives these music-related data from the playback application 22. What should I do? Alternatively, the music-related data may be acquired by directly accessing the recording medium 25.

Subsequently, in step F105, the diary creation / browsing application 23 pastes music-related data on the diary data.
In step F106, the diary data with the music-related data attached is stored in the recording medium 25, uploaded to the blog server 1 via the communication unit 27, and stored in the recording medium 4 of the blog server 1.

FIG. 5 shows a display example when the diary data with the music-related data attached is created in this way, when the diary data is browsed.
When music related data is attached to the diary 301 included in the diary image 300, all or a part of the music related data is displayed as a music related data display 320 in the diary 301. Here, an example in which a song name and an artist name are displayed is shown.
Note that the music-related data is, for example, the title of audio data such as music, the title of the album in which the song is stored, the name of the performer, the name of the song composer, the file name of the song, the ID information of the song, etc. There are various types of music-related data to be attached to the diary data, such as data that allows the user to recognize music at a later point in time or identify music by the system, or audio data that is part of the music. Further, it is not necessary to display all the music related data pasted on the data as the music related data display 320.
For example, the music title data, the album title, the performer name, the song composer name, the file name, and the ID information may be affixed to the diary data as music related data. Of these, as shown in FIG. 5, it is possible to display only the song name and the player name.

If it is determined in step F103 that the audio is not being played back, that is, if the user has not played the music by the playback application 22 while the diary is being created and the music-related data pasting in step F105 has not been performed, As a display example at the time of browsing the diary, as shown in FIG. 6, a display 321 that music related data is not attached may be displayed, or any display related to music related data is performed as shown in FIG. It may not be possible.

[2. Second Embodiment: Attaching Music Related Data Related to Playback of External Device]

Subsequently, a second embodiment of the present invention will be described. In the second embodiment, even if a user is listening to music with an external audio playback device such as a portable audio player or a home audio player while creating a diary, This is an example in which music-related data can be attached to diary data.

  FIG. 7 shows an audio player 80 in addition to the computer system centering on the PC main body 20 and the blog server 1. Although the PC main body is an embodiment for realizing the data processing apparatus and data processing method of the present invention by the program of the present invention, the audio player 80 is an embodiment of the audio reproducing apparatus of the present invention.

Since the blog server 1 is the same as that shown in FIG.
The PC main body 20 in FIG. 7 shows a communication unit 26 and a music data synchronization application 28 in addition to the already described configuration given the same reference numerals as in FIG.
The music data synchronization application 28 is an application that runs on the OS 21 in the PC main body 20, and this music data synchronization application 112 runs when communicating with the audio player 80.

  The communication unit 26 is a communication unit that performs data communication with an external device as a communication interface in the PC main body 20. The communication unit 26 is formed as a USB (Universal Serial Bus) communication interface unit, for example. Of course, other communication interface methods such as IEEE (Institute of Electrical and Electronics Engineers) 1394, Ethernet (registered trademark), wireless LAN (Local Area Network), and Bluetooth (Bluetooth) communication may be adopted. .

The audio player 80 is, for example, a portable or home playback device, and includes a recording / playback unit 82, an audio playback processing unit 84, a communication unit 85, and a control unit 81 for the recording medium 83.
The recording / playback unit 82 performs an operation of reading an audio content file such as music from the recording medium 83. The recording / reproducing unit 82 records and reproduces listening data, which will be described later.
The recording / reproducing unit 82 can be realized as an HDD, and can also be realized as a disk drive device using an optical disk as a recording medium 83. Furthermore, a memory card playback unit using a memory card as the recording medium 83 may be used.

The audio reproduction processing unit 84 performs audio data processing on the audio content file read by the recording / reproducing unit 82. That is, data decoding, digital audio processing, D / A conversion, analog audio processing, and the like are performed to obtain a reproduced audio signal as an analog audio signal. The reproduced audio signal is reproduced and output by the connected headphones 90, for example.
The communication unit 85 performs data communication with the personal computer system. The communication unit 85 is formed as a USB communication interface unit, for example. Of course, other communication interface methods such as IEEE 1394 method, Ethernet, wireless LAN, Bluetooth communication, etc., may be adopted.

  The control unit 81 includes a CPU (Central Processing Unit) that controls the operation of each unit of the audio player 80. As software functions formed by the operation program, an audio processing control unit 81a that controls the audio processing operation of the audio playback processing unit 84, a recording / playback control unit 81b that controls the recording / playback operation of the recording / playback unit 82, and a listening process to be described later A listening data processing unit 81c that executes data generation processing, a clock unit 81d that counts the date and time, and a communication control unit 81e that controls data communication by the communication unit 27 are provided.

In the system of FIG. 8, the following processing mode is assumed.
The user can play music with the audio player 80. Then, while listening to the music reproduced by the audio player 80, a diary is created using a personal computer system.
The PC main body 20 creates the diary data in accordance with the input operation of the user by the process of the diary creation / viewing application 23. At a certain time after the creation, the process of pasting the music related data is performed. As the music-related data and information necessary for pasting the data, the audio player 80 generates listening data in accordance with the music reproduction. Then, data communication between the audio player 80 and the PC main body 20 is performed at an arbitrary time, and the listening data is transferred to the PC main body 20. In the PC main body 20, music-related data pasting processing is performed on the diary data using the listening data.

First, listening data generated by the audio player 80 will be described.
FIG. 8A shows an example of information stored in the recording medium 83 in the audio player 80.
For example, audio data such as music is recorded on the recording medium 83 as audio content files M1, M2, M3... As schematically shown in FIG. Each audio content file M1, M2, M3... Is stored in a state managed by audio management data.
Further, listening data that is sequentially generated and updated by the control unit 83 in accordance with the reproduction of the audio content file is stored.

An example of the content of the listening data is shown in FIG. The listening data is information that adds the date and time and music-related data about the audio content file each time a certain audio content file is played back.
That is, as date / time information, the year / month / day / hour / minute / second at which playback of a certain audio content file is started is stored as the listening start date / time, and the year / month / day / hour / minute / second at which playback of the audio content file is ended is stored as the listening end date / time. . Then, as the music-related data, the music title, album name, performer name, file name, content ID, and other information of the reproduced audio content file are added.

FIG. 9 shows processing of the control unit 81 of the audio player 80 including such listening data generation / update processing.
When the user performs an operation to instruct playback of an audio content file, the process of the control unit 81 proceeds from step F201 to F202. At this time, the current date and time counted by the clock unit 81d is stored as the listening start date and time. In step F203, playback of the audio content file is started. That is, the recording / playback unit is instructed to reproduce the designated audio content file, and is also instructed to perform audio processing in the audio reproduction processing unit 84 to start reproduction audio output.
In step F204, the end of reproduction of the audio content file is monitored. The end of playback is when the playback performance of the audio content file being played back is completed, or even when the playback performance of the song is in progress, the user stops playback or finds another song ( The audio content file) is instructed, and the reproduction of the audio content file being reproduced is terminated.
When it is determined that the reproduction of the current audio content file is finished, the process proceeds to step F205, and the control unit 81 stores the current date and time counted by the clock unit 81d at that time as the listening end date and time.

In step F206, the control unit 81 generates the contents of the listening data regarding the audio content file that has been reproduced. That is, the listening data contents are generated by associating the listening start date and time saved in step F202, the listening end date and time saved in step F205 with the music-related data. The music related data is acquired from, for example, audio management data, header information of an audio content file, or the like.
In the process of step F206, one reproduced audio content file, that is, the listening data content for one song is generated.

  In step F207, the control unit 81 determines whether or not playback of the next song is continued. For example, when the playback of the next song is continued after the completion of the playback of a certain song, or when another song is played in response to the user's cueing operation, etc., the playback of the next song is continued. Return to step F202. In that case, the processes of steps F202 to F206 are similarly performed for the audio content file to be reproduced next.

When it is determined in step F207 that the next song is not played, for example, when the user ends the playback itself by a stop operation or the like, or when the playback of all or a part of the designated song is completed When the reproduction operation itself is terminated, the process proceeds to step F208, and the listening data in the recording medium 83 is updated.
That is, the update is performed by adding the contents of the listening data generated in step F207 to the listening data stored in the recording medium 83 until then. Of course, if the listening data itself is not recorded on the recording medium 83, the listening data is newly written.

Note that the processing of steps F202, F205, and F207 is executed by the function of the listening data processing unit 81c of the control unit 81, and the processing of step F208 is performed by the functions of the listening data processing unit 81c and the recording / playback control unit 81b.
9 is performed at the time of reproduction of the audio content file, the content of the listening data is additionally updated each time one piece of music as the audio content file is reproduced. The data is always stored in the past reproduction history as reproduction date and music related data.

When the audio player 80 is connected to the PC main body 20 for communication, the listening data is transferred to the PC main body 20.
FIG. 10 shows processing when the audio player 80 and the PC main body 20 are connected to be communicable. The processing is performed by the music data synchronization application 28 on the PC main body 20 side, and the processing by the control unit 81 is performed on the audio player 80 side.

When the audio player 80 is connected to the PC main body 20 and the mutual communication between the communication unit 114 of the PC main body 20 and the communication unit 85 of the audio player 80 is established, the music data synchronization application 28 in step F301. Then, the audio player 80 is transmitted to request listening data.
When receiving the listening data request at step F311, the control unit 81 of the audio player 80 instructs the recording / playback unit 82 to read the listening data from the recording medium 83 at step F311. In step F313, the control unit 81 causes the communication unit 85 to transmit the listening data read from the recording medium 83 to the PC main body 20.
When the music data synchronization application 28 receives the listening data transmitted from the audio player 80 in step F302, the music data synchronization application 28 transfers the received listening data to the recording / playback unit 120 and stores it in the recording medium 25 in step F303.

The processing of FIG. 10 is performed, and the listening data is copied to the PC main body 20, so that the reproduction date / time and music related to music (audio content file) played by the user with the audio player 80 in the PC main body 20. Data can be obtained.
Note that such listening data transfer may be automatically performed when the PC body 20 and the audio player 80 are communicably connected.

Processing of the diary creation / browsing application 23 will be described.
The processing at the time of diary creation by the diary creation / viewing application 23 may be the same as that in FIG. That is, if music or the like is being listened to by processing by the playback application 22, music related data is pasted when the diary is created, and if music or the like is not being listened to by the playback application 22, the diary data is not pasted. Generated. The diary data is stored in the recording medium 25 and uploaded to the blog server 1. Therefore, if the user listens to music or the like with the audio player 80 while creating the diary, the diary data is saved in the recording medium 25 and uploaded to the blog server 1 without the music-related data being attached. Become.

  Here, the diary creation / browsing application 23 performs the pasting process of the music related data by the process of FIG. 11 at the time after the listening data is taken into the PC main body 20 by the process of the music data synchronization application 28 of FIG. . That is, the music-related data corresponding to the listening status in the audio player 80 is attached to the already created diary data.

The process of FIG. 11 by the diary creation / viewing application 23 will be described.
As step F401 in FIG. 11, the diary creation / browsing application 23 selects one piece of listening data content (listening start date and time, listening end date and time for one audio content file) from the listening data captured in the recording medium 25 in the process of FIG. , Music related data) is taken out, and the diary data created in the past is searched using the listening date and time (listening start date and time and listening end date and time) in the contents of the listening data. That is, it is searched whether there is diary data that has been created on the listening date and time.
Since the created diary data is stored in the recording medium 25 and uploaded to the blog server 1 in step F106 of FIG. 2 described above, the creation date and time of the diary data stored in the recording medium 25 is stored in step F401. Search by (save date). If the processing method is not stored in the recording medium 25 when the diary is created, the diary is browsed by connecting to the blog server 1 and the date and time of the past diary data may be confirmed.

The process branches in step F402 according to the search result in step F401.
If there is no diary data whose creation date / time corresponds to the listening date / time of a certain listening data content, the process proceeds from step F402 to F410 to check whether the processing has been completed for all the listening data content. If there is still unprocessed listening data content, the process returns to step F401, the next listening data content is taken out, and similarly searched.

In step F401, when diary data whose creation date / time corresponds to the listening date / time of a certain piece of listening data content is searched, the process proceeds from step F402 to F403. Then, it is confirmed whether or not music-related data has already been attached to the retrieved diary data.
The case where the music-related data has already been pasted is the case where the searched diary data has been pasted with the music-related data after the processing of FIG. 11 has been performed, or when the diary is created. This is the case when music-related data is attached in the above process.
If the music related data is not pasted on the retrieved diary data, the process proceeds to step F408, and the process of pasting the music related data in the contents of the listening data currently being processed to the diary data is performed. That is, the diary data is updated with the music-related data attached.
In step F409, the updated diary data is stored in the recording medium 25. The diary data is overwritten and saved on the recording medium 25.
Then, the process proceeds to step F410, and if there is any other unprocessed listening data content, the process returns to step F401.

If it is determined in step F403 that music-related data has already been attached to the retrieved diary data, the process proceeds to step F404. Then, it is confirmed whether or not all the music-related data attached to the diary data is the same as the music-related data in the listening data content currently being processed.
If the data is the same, the diary data is pasted with the music-related data of the listening data in the process of FIG. 11 at the past time point, and thus the pasting process of the music-related data is unnecessary. The process proceeds from step F404 to F410.

If it is determined in step F404 that music-related data different from the music-related data in the currently processed listening data content is attached to the diary data, the process proceeds to step F405.
The case where different music-related data is pasted means that when the diary data is created, music playback is performed by the audio player 80 and music playback is also performed by the playback application 22 on the PC main body 20. In some cases, music-related data of music reproduced by the reproduction application 22 is affixed. Alternatively, if the user can paste music-related data manually in the diary data, the user has pasted arbitrary music-related data. As will be described in the fourth and fifth embodiments described later, music-related data such as music that was listened to at the time of photographing may be attached to the diary data for the photo data attached to the diary data. Even when music-related data for such a pasted photograph is pasted, different music-related data is pasted.

If music-related data different from music-related data in the content of the listening data being processed has already been attached to the diary data, in step F405, the user selects which music-related data is to be attached.
For example, a window 200 as shown in FIG. 12A is displayed on the monitor device 13 and waits for user input. In this window 200, a message requesting an answer indicating whether or not music-related data of music has already been pasted to the diary data and whether or not music-related data regarding the music that has been listened to by the audio player 80 is to be pasted is displayed. At the same time, as shown in the figure, one of “Yes”, “No”, and “Attach both” is selected.
In this example, the image of the simple window 200 as shown in FIG. 12A is used. However, in order to make it easier for the user to perform the selection operation, the target diary data and the music-related information already attached are displayed. The data and the music-related data in the listening data content may be respectively displayed to select whether or not to adopt the music-related data in the listening data content.

When the user selects not to paste new music-related data and clicks “No”, the music-related data pasting process is not performed for the contents of the listening data currently being processed. That is, the process proceeds from step F405 to F410.
If the user selects to paste new music-related data in addition to the music-related data that has already been pasted and clicks “Both Paste”, the process proceeds from step F405 to F407, and the current processing is in progress. A process for pasting music-related data in the listening data content to the diary data is performed. That is, the music related data in the listening data content being processed is additionally pasted to the diary data. In step F409, the updated diary data is overwritten and saved in the recording medium 25. Then, the process proceeds to step F410, and if there is any other unprocessed listening data content, the process returns to step F401.

When the user clicks “Yes” in the window 200, the music-related data as the listening data content is pasted instead of the music-related data already pasted. In this case, in step F406, the music-related data specified in the music-related data already attached is deleted, and the music-related data in the listening data content is attached to the diary data. As music-related data to be deleted at this time, the window 201 in FIG. 12B is displayed on the monitor device 13 and the user is requested to specify it. In the case of this window 201, the music-related data already pasted can be individually designated as music-related data 1, music-related data 2,..., And all music-related data can be designated. I have to.
In this example, the image of the simple window 201 as shown in FIG. 12B is used. However, in order to make it easier for the user to perform the selection operation, the target diary data and the music-related information already attached are displayed. It is preferable that the music-related data to be deleted can be selected after displaying the data and the music-related data in the contents of the listening data.
In step F406, the music related data designated by the user is deleted from the window 201, and then the process proceeds to step F408, where the music related data in the contents of the listening data is pasted to the diary data. Then, the process proceeds to Step F410.

When the processing of steps F401 to F409 is completed for all the listening data contents in the listening data, the process proceeds from step F410 to F411. In step F411, the diary data to which the music related data is pasted, that is, the diary data overwritten on the recording medium 25 in step F409 is uploaded to the blog server 1. As a result, the diary data is updated on the blog server 1. When the updated diary data is browsed, a music related data display 320 as shown in FIG. 5 is added on the image.

[3. Third Embodiment: Attaching music-related data for playback of external devices when creating a diary]

In the second embodiment, the example in which music-related data of music reproduced by the audio player 80 that is an external device when viewed from the PC main body 20 is pasted by acquiring listening data has been described. If the PC main body 20 can always communicate, the music related data of the music reproduced by the audio player 80 can be pasted during the creation of the diary data by the process of FIG.

For example, the PC main body 20 and the audio player 80 are devices having a LAN configuration as a wireless LAN communication, Bluetooth communication, or home network and can always communicate, and the audio content file being played from the PC main body 20 to the audio player 80 is related to If there is an environment in which an inquiry can be made, the processing of steps F103 and F104 in FIG. 2 may be executed via the communication. That is, the diary creation / browsing application 23 inquires of the external audio player 80 whether or not the audio content file is being reproduced in step F103 when the diary is created. If playback is being executed, in step F104, the audio player 80 may be requested to transfer music-related data related to the audio content file being played back, and the transferred music-related data may be acquired.
When such processing is performed, it is not necessary to attach music-related data to the diary data based on the listening data and to update the diary data accordingly, as in the second embodiment.

[4. Fourth Embodiment: Attaching Music Related Data on Photos Pasted in a Diary]

As a fourth embodiment, an example will be described in which music-related data can be attached to a photo attached to a diary. Note that “photograph” in the present specification refers to still image data captured by a digital still camera.
As described in the diary creation image 310 of FIG. 4, a photograph can be attached to the diary data by designating an imaging data file (such as a still image file) by the photo designation unit 313. FIG. 13 shows a diary 303 with a photo 330 attached thereto.
When the photograph is attached to the diary data in this way, it is conceivable to attach the music related data of the music that the user was listening to when the photograph was taken.

For example, consider the audio player 80 of FIG. 7 as a portable music player.
It is assumed that the user carries the audio player 80 on the go, etc., and takes a picture using a digital still camera (not shown) while playing music.
A user can save a photograph (imaging data) captured by a digital still camera in the recording medium 25 in the PC main body 20 by, for example, USB communication or loading of a portable recording medium.
The PC main body 20 (diary creation / browsing application 23) attaches, for example, a photograph saved in the recording medium 25 to the diary data in accordance with the user's diary creation operation.
In such a case, by obtaining the listening data from the audio player 80, the music-related data of the music that was being listened to at the time of imaging can be attached to the photo attached to the diary data.

Such processing will be described with reference to FIG. 14 as processing that can be executed by the personal computer system of FIG.
The process of FIG. 14 is a process performed after listening data is transferred from the audio player 80 and stored in the recording medium 25 by the process described with reference to FIG. FIG. 14 is basically the same as FIG. 11 described above, and the same process is denoted by the same step number and description thereof is omitted.

In the case of FIG. 14, the processing of step F412 is different from that of FIG. 11 when it is determined in step F402 that there is no diary data corresponding to the listening date / time of the listening data content to be processed.
In step F412, a search is performed to determine whether there is diary data to which a photograph taken at the listening date and time of the listening data content being processed exists.
In other words, if there is no diary data whose listening date and time match the creation date and time for a certain piece of listening data to be processed, then all photos attached to all diary data are examined, and the shooting date and time is determined. In this case, it is confirmed whether or not there is a thing that matches the listening date and time.

If there is no diary data including a photograph taken at the listening date and time, no processing is required for the contents of the listening data, and the process advances from step F412 to F410.
On the other hand, when diary data including a photograph taken at the listening date and time is searched, the process proceeds from step F412 to F408, and the music related data in the contents of the listening data being processed is pasted to the diary data (photo on the diary data). Process. In step F409, the updated diary data to which the music related data is pasted is overwritten and saved in the recording medium 25.

Other processes are the same as those in FIG. By performing the processing of FIG. 14, the music-related data of the music that was listened to by the audio player 80 on the date and time of imaging can be attached to the photo attached to the diary data.
For example, FIG. 15 shows an image example as a diary 303 in which music-related data is attached to a photograph. Music related data display 322 is performed on the photo 330.
FIG. 16 shows the music related data of the music that was being listened to when creating the diary data of the diary 303 as the music related data display 323, and further the music related data of the music that was being listened to by the audio player 80 at the date and time when the photo 330 was captured. Shows an example shown as a music-related data display 322.

[5. Fifth Embodiment: Pasting a Photo with Music-Related Data on Diary]

In the fourth embodiment, the processing example of pasting the music related data of the music that was being listened to at the time of the image capturing to the photograph pasted on the diary in the PC main body 20 has been described. However, in the fifth embodiment, A case will be described in which a photograph (imaging data file) with music-related data already attached is taken into the PC main body 20 and stored in the recording medium 25. That is, this is a case where music-related data has already been pasted on the photo selected to be pasted when creating the diary data.

Here, before explaining the processing of the fifth embodiment, an example in which music-related data is pasted together with imaging data together with imaging in a digital still camera, for example, will be described with reference to FIGS. 19, 20, and 21.
For example, consider a digital still camera with an audio playback function.

FIG. 19 shows a configuration of a main part of the camera device 120 with an audio playback function.
In the camera device 120 of FIG. 19, a control unit 121, an imaging unit 122, an audio reproduction processing unit 123, a recording / reproduction unit 124, and an imaging lens mechanism 126 are provided.
The imaging unit 122 receives subject light incident from the imaging lens mechanism 126, converts it into an electrical signal, performs various processes, and obtains imaging data.
The recording / reproducing unit 124 performs data recording / reproduction with respect to the recording medium 125. The recording medium 125 may be a portable medium that can be attached to and detached from the apparatus, such as an optical disk or a memory card with a built-in nonvolatile memory, or a hard disk (magnetic disk) or a solid memory that is detachably incorporated into the apparatus. It may be a thing. The recording / reproducing unit 124 performs data modulation / demodulation, error correction code processing, and media access processing according to these recording media 125 to record / reproduce various data.
The recording / playback unit 124 performs processing for recording the imaging data (still image data) obtained by the imaging unit 122 on the recording medium 125. In addition, the recording / playback unit 124 performs a process of reading the captured image data recorded on the recording medium 125 so as to be displayed on a display unit not shown in FIG.
When audio data is recorded on the recording medium 125, the recording / reproducing unit 124 also performs processing for reproducing audio data from the recording medium 125.

For example, image data and audio data can be recorded on the recording medium 125 as schematically shown in FIG. Imaging data obtained by the imaging unit 122 is recorded as imaging data files PH1, PH2, PH3. Each imaging data file is stored in a state managed by imaging file management data.
Audio data such as music is recorded as audio content files M1, M2, M3. Each audio content file M1, M2, M3... Is stored in a state managed by audio management data.
The imaging data file PH is, for example, an Exif (Exchangeable Image File Format) standard file. As shown in FIG. 21 (b), the data content includes a file header and imaging data such as JPEG (Joint Photographic Experts Group) compressed data. The file header includes information such as a file name, data size, file format, imaging date and time.

  The audio playback processing unit 123 performs audio data processing on the audio content file read by the recording / playback unit 124. That is, data decoding, digital audio processing, D / A conversion, analog audio processing, and the like are performed to obtain a reproduced audio signal as an analog audio signal. The reproduced audio signal is reproduced and output by the connected headphones 90, for example.

  The control unit 121 includes a CPU that controls the operation of each unit of the camera device 120. As software functions formed by the operation program, the imaging control unit 121a that controls the imaging operation of the imaging unit 122, the audio processing control unit 121b that controls the audio processing operation of the audio playback processing unit 123, and the recording of the recording / playback unit 124 A recording / playback control unit 121c for controlling the playback operation, a pasting processing unit 121d for performing processing for pasting music-related data to imaging data, which will be described later, and a clock unit 121e for counting the date and time are provided.

The processing at the time of imaging by such a camera device 120 will be described with reference to FIG.
When the user operates a shutter button (not shown), an imaging process for capturing a subject image is performed by the imaging unit 126 accordingly. In step F701, the control unit 121 (imaging control unit 121a) controls the imaging unit 122 according to the shutter operation, and executes an imaging process, that is, a still image data capturing process.
At this time, in step F702, the control unit 121 determines whether or not the audio is being played back at the shutter operation time point (imaging time point), and branches the process.
If the audio is not being reproduced, the control unit 121 (imaging control unit 121a) causes the imaging data captured by the imaging unit 122 to be filed in step F706. That is, the file name, date / time information (year / month / day / hour / minute / second) obtained by the clock unit 121e, header information such as a file format, and the like are given to the imaging unit 122, and compression encoding is performed on the imaging data, for example, FIG. ) Is generated as an imaging data file.
In step F705, the control unit 121 (the imaging control unit 121a and the recording / playback control unit 121c) records the imaging data file on the recording medium 125. In other words, data as an imaging data file generated by the imaging unit 122 is transferred to the recording / reproducing unit 124, and recording encoding processing or the like corresponding to the media type is executed and recorded on the recording medium 125.

On the other hand, if it is determined in step F702 that the audio is being reproduced, the process proceeds to step F703. During the audio playback, the recording / playback unit 124 reads the audio content file from the recording medium 125 based on the control of the recording / playback control unit 121c and the audio processing control unit 121b, and the audio playback processing unit 123 performs the audio processing and playback. This is the case where sound is output, that is, the user is listening to music or the like.
In this case, in step F703, the control unit 121 (the pasting processing unit 121d) acquires music related data such as the music being played. For example, information such as a song name, album name, and artist name described in the audio management data shown in FIG. 21 or the header information of the audio content file, information such as a file name and content ID as an audio content file is acquired. . Since the audio management data and the file header are read from the recording medium 125 prior to audio reproduction, the control unit 21 can acquire music related data from the contents of the management data.
In step F704, the control unit 121 (the imaging control unit 121a and the pasting processing unit 121d) generates an imaging data file, and pastes music-related data at this time.
That is, header information such as a file name of imaging data, date / time information (year / month / day / hour / minute / second) obtained by the clock unit 121e, and a file format is given to the imaging unit 122, and compression encoding of the imaging data is executed. Further, the music-related data acquired in step F703 is given to the imaging unit 122 and pasted on the imaging data file. Thereby, for example, an imaging data file having the contents as shown in FIG. 21C is generated. That is, music-related data about the music that was being listened to at that time is added to the imaging data.
In step F705, the control unit 121 (the imaging control unit 121a and the recording / playback control unit 121c) records the imaging data file on the recording medium 125. In other words, data as an imaging data file generated by the imaging unit 122 is transferred to the recording / reproducing unit 124, and recording encoding processing or the like corresponding to the media type is executed and recorded on the recording medium 125. As a result, an imaging data file as shown in FIG. 21C is recorded.

As described above, when the user performs a photography operation while listening to music or the like using the camera device 120, the music-related data about the music or the like that has been listened to the captured image data is affixed to the recording medium 125 is stored.
Then, when the camera device 120 and the PC main body 20 are connected, and the image data file is transferred to the PC main body 20 by, for example, USB communication or the like, a photograph (music-related data already attached to the recording medium 25 of the PC main body 20) (Imaging data file) is captured.
In other words, when a user creates diary data, if such a photo is selected as a photo to be pasted in the diary, a photo with music-related data already pasted is pasted into the diary data. At this time, whether or not the music related data should be pasted to the diary data is determined by the processing of the diary creation / viewing application 23.

  Note that music-related data is affixed to a photograph not only by the camera device 120 but also variously. For example, for the photos stored in the recording medium 25 of the PC main body 20, the listening data is acquired from the audio player 80 described above, and the listening date / time of the listening data content is compared with the imaging date / time in the imaging data file. If there is an imaging data file that matches the above, it is also possible to perform processing such as attaching music-related data in the contents of the listening data to it.

The processing of the diary creation / viewing application 23 as the fifth embodiment will be described with reference to FIGS.
FIG. 17 shows the processing when creating diary data. Steps F501 to F505 are the same as steps F101 to F105 in FIG. 2 and will not be described in detail. However, if it is detected that audio is being played back when the diary is created, it was played back in steps F504 and F505. Music related data of music is pasted to diary data.

In step F506, it is determined whether or not a photograph is attached to the diary data created and registered by the user. If no photo is attached, the process proceeds to step F508, where the created diary data is stored in the recording medium 25 and uploaded to the blog server 1 to finish the process.
If one or more photos are attached to the diary data, in step F507, processing related to music related data for the photos is performed.
The processing in step F507 is shown in detail in FIG.

As step F601 in FIG. 18A, the diary creation / browsing application 23 confirms whether or not music-related data is affixed to one of the photos affixed to the diary data.
If no music-related data is attached to the photo, the process proceeds to step F608, and it is confirmed whether another photo is attached to the diary data. If there is no other attached photo, the process in FIG. 18A, that is, the process in step F507 in FIG. 17 is finished.
If another photo is pasted, the process returns to step F601 to check whether music-related data is pasted for the photo.

If it is determined in step F601 that music related data is attached to a certain photo attached to the diary data, the process proceeds to step F602 to check whether or not music related data has already been attached to the diary data. Check. That is, it is a confirmation as to whether or not music-related data has been attached in step F505 of FIG.
If the music related data is not attached to the diary data, the process proceeds to step F603, and the music related data attached to the photograph is directly attached to the diary data. Then, the process proceeds to Step F608.
That is, music is not played back at the time of creating the diary, and the process of FIG. 17 proceeds from step F503 to F506 to F507. In this case, the music related data attached to the photo, that is, the photo The music related data of the music that the user was listening to at the imaging date and time will be affixed to the diary data.

On the other hand, if it is determined in step F602 that music-related data has already been pasted on the diary data, that is, if the processing in FIG. 17 has proceeded from step F503 → F504 → F505 → F506 → F507, the process proceeds to step F604. move on. In step F604, it is confirmed whether or not the music related data attached to the diary data is the same as the music related data attached to the photograph.
If they are the same, there is no need to affix them again, so the process proceeds from step F604 to F608.

If it is determined in step F604 that music related data different from the music related data attached to the photograph is attached to the diary data, the process proceeds to step F605.
In step F605, the user selects which music related data is to be pasted.
For example, a window 202 as shown in FIG. 18B is displayed on the monitor device 13 and waits for user input. This window 202 displays a message asking for an answer indicating that the music-related data of the music has already been pasted to the diary data and whether to paste the music-related data pasted on the photo instead of the music-related data. At the same time, as shown in the figure, one of “Yes”, “No”, and “Attach both” is selected.
Here, the image of the simple window 202 as shown in FIG. 18B is used. However, in order to make it easier for the user to perform the selection operation, the music-related data already attached to the diary data and the image attached to the photograph are used. The music-related data thus displayed may be displayed, respectively, so as to select which data is finally adopted as music-related data to be attached to the diary.

If the user selects not to paste the music-related data attached to the photo to the diary data and clicks “No”, the music-related data attached to the photo does not require any particular processing, so step F605 is performed. To F608.
If the user selects to paste the music related data of the photograph in addition to the music related data already pasted and clicks “Paste both”, the process proceeds from step F605 to F607 and the photo is added to the diary data. A process for pasting music-related data pasted on the diary data is performed. Then, the process proceeds to Step F608.

When the user clicks “Yes” in the window 202, the music related data attached to the photograph is pasted in place of the music related data already pasted. In this case, first, in step F606, the music related data designated among the music related data already pasted is deleted. As the music-related data to be deleted at this time, the window 201 shown in FIG. 12B may be displayed on the monitor device 13 and the user may be requested to specify it.
In step F603, the music-related data pasted on the photo is pasted on the diary data, and the flow proceeds to step F608.

When all the photos pasted on the created diary data have been processed in steps F601 to F607, the processing from step F608 to FIG. 18A, that is, the processing in step F507 in FIG.
Then, the process proceeds to step F508 in FIG. 17, and the created diary data is recorded on the recording medium 25 and uploaded to the blog server 1.
17 and 18 (a), when music-related data of reproduced music at the time of imaging is already attached to a photograph attached to diary data, the music-related data is also created as a diary. Along with or related to the music-related data of the reproduced music at the time, it is pasted to the diary data.

[6. Pre-setting for pasting music related data]

By the way, in step F405 of FIG. 14 (or FIG. 11), the process of allowing the user to select music related data to be pasted to the diary data using the window 200 of FIG.
Also in step F605 of FIG. 18A, the music related data to be pasted on the diary data is selected by the user through the window 202 of FIG. 18B.
In addition to the process of sequentially prompting the user to select as described above, the music-related data to be pasted may be determined based on the user's presetting.

For example, FIG. 22 shows an example as the preset image 204. This preset image 204 indicates which of music-related data of music that was listened to when creating a diary and music-related data of music that was listened to at the shooting date and time of a photo attached to the diary should be preferentially pasted to the diary data. This is an example in which the user selects in advance.
The diary creation / browsing application 23 stores user input by the preset image 204. If the user has checked the check box 205, the music related data of the music that was being listened to when creating the diary is always prioritized and pasted to the diary data. That is, when music-related data of reproduction music at the time of creating a diary is pasted, even if music-related data is pasted on a photo pasted on the diary data, it is ignored.
If the user has checked the check box 206, the music related data of the music that was being listened to at the time of taking a picture is always preferentially attached to the diary data. In other words, if music-related data is attached to the photo attached to the diary data, the music-related data is preferentially attached to the diary data, and other music-related data is deleted.

For example, if the user performs such pre-setting and uses it for the determination in the music-related data pasting process, it is possible to execute the appropriate music-related data pasting process without requiring the user to make a sequential selection. .

[7. Processing when music related data in the diary is selected]

The process for pasting music related data to the diary data has been described above. Here, a case will be described in which a browsing user selects and operates music-related data displayed in the diary as in the music-related data display 320 of FIG. For example, the music-related data display 320 can be clicked, and the user clicks on the music-related data display 320.
The diary data uploaded to the blog server 1 can be viewed by an unspecified number of users. Therefore, the user who has an opportunity to click on the music-related data display may be the person who created the diary or the other person.

FIG. 23 shows the process when the diary creation / browsing application 23 browses the diary.
Step F800 shows processing for accessing the blog server 1 and browsing the diary. The diary creation / browsing application 23 accesses the diary page of the person or other person of the blog server 1 and displays the diary image 300 as shown in FIG.
In FIG. 23, the processing when the user who is browsing clicks the portion of the music-related data display 320 is shown as step F801 and subsequent steps.

When the portion of the music related data display 320 is clicked, the diary creation / browsing application 23 first acquires the content of the clicked music related data as step F802. In step F803, the audio content file stored in the recording medium 25 is searched using the contents of the music-related data, for example, information such as the song name or the audio content file name or the content ID.
If a corresponding audio content file is found by this search, the process proceeds from step F804 to F805, and the playback application 22 is requested to play back the audio content file.
In response to this, the playback application 22 is activated and playback of the corresponding audio content file is started.

With this process, the user who is browsing the diary created by the person can read the diary again while listening to the music he was listening to when creating the diary. In other words, the situation at the time of diary creation can be recalled with music.
If you are not a diary creator, you can browse the diary while listening to the music that the diary creator was listening to, and you can browse the diary more happily. You can imagine the situation of time.

  Although the audio content file is searched in the recording medium 25 here, for example, if the PC main body 20 is connected to an audio device or the like through a home network or the like, the audio content file that can be played back on the audio device or the like. It is also possible to perform a search and play back the corresponding audio content file if it exists.

By the way, if the viewer does not own the corresponding audio content file, it cannot be reproduced naturally.
Therefore, if it is determined in step F804 that the corresponding audio content file is not found, the corresponding audio content file is searched for on the music sales site via the network 10 in step F806. That is, it is determined whether or not the user can receive the corresponding audio content file at a site where the user can receive the audio content file. An audio content file is provided when a user purchases music distribution or downloads it as free music distribution. Furthermore, the case where it can purchase with package media, such as CD (Compact Disc) and DVD (Digital Versatile Disc), may be included.

If the sales site of the corresponding audio content file is found by the search in step F806, the URL (Uniform Resource Locator) of the sales site is acquired in step F808. In step F809, the URL is accessed, and an image of the sales site is displayed on the monitor device 13 and presented to the user. In other words, the sales site is introduced to the user, and the audio content file can be downloaded according to the user's will.
Therefore, the diary reader can easily obtain the audio content file when he / she wants to listen to music attached to the diary.

[8. Effect of embodiment, modification and program]

As described above, the embodiment has been described. According to the embodiment, when the user creates the electronic diary data, the music-related data about the music that the user has listened to is automatically attached. As a result, music-related data such as song names are presented together when browsing the diary data, so that the added value of the diary data can be increased.
For example, when the diary creator later browses the diary, the music-related data display 320 or the like can be used to remember the music that was being listened to when creating the diary, thereby recalling the situation and feelings at that time.
Also, by specifying (clicking) the music-related data pasted on the diary data, the music indicated by the music-related data can be played back or made available from a music sales site. The use value of music related data is enhanced and the enjoyment of browsing the diary is improved.

According to the first embodiment, the music-related data of the music that has been played on the PC main body 20 when the diary is created is automatically attached to the diary data.
Furthermore, if the processing of the second and third embodiments is performed, even if music is played on the external audio player 80 when the diary is created, the music related data of the music can be automatically pasted to the diary data. Become.
In particular, in order to perform the processing of the second embodiment, the audio player 80 corresponding to the audio playback device of the present invention is a useful device.
According to the fourth and fifth embodiments, the music-related data of the music that was listened at the time of taking the picture attached to the diary can be appropriately attached to the diary data.

Various modifications can be considered for the present invention.
In the embodiment, the example in which the data processing apparatus and the data processing method of the present invention are realized in a personal computer has been described. However, the present invention can be realized by various other devices. For example, the present invention can be implemented even with a portable personal computer, a PDA (Personal Digital Assistant), a mobile phone, and the like.

As music-related data, a song name, album name, artist name, songwriter name, partial text of lyrics, audio data itself, a part of audio data, and the like can be considered. Any data may be used as long as it is related to the music to be reproduced.
In addition, the explanation has been given by taking the example in which the audio content file is a music piece as the music related data, but it is of course not limited to the music piece. For example, reading sounds such as novels, speech sounds, entertainment sounds such as rakugo, natural sounds such as wind sounds and wave sounds are recorded as audio content files, which are played by the user when creating diary data or taking pictures. In such a case, data related to them may be attached to the diary data.

  In addition, there are various timings for judging music or the like that was played when the diary was created. For example, it may be a song that has been played when the diary creation is completed (when the registration operation is detected in step F102 in FIG. 2), or may be a song that was played when the diary creation started. Furthermore, the music related data of all the songs reproduced from the start to the completion of diary creation may be attached.

  Moreover, although the photograph attached to the diary data has been described as being captured image data of a still image, a case of moving image data is also conceivable. That is, when moving image data captured by a digital video camera is pasted to diary data, audio-related data such as music played back at the time of capturing may be pasted to the diary.

Although electronic diary data is given as an example of electronic data, the present invention can be applied not only to electronic diaries but also to various electronic data created by users.
For example, writing as a document other than a diary, text data such as essays, novels, introductions, drawings, graphic data, graphic data, statistics, spreadsheet data, e-mail data, writing data to an electronic bulletin board on the Internet, homepage For various electronic data such as update data, it may be possible to attach audio-related data that was heard at the time of creation. Therefore, the program of the present invention can be applied not only to an application program for creating diary data but also to various programs such as a document creation application, a graphic editor, a drawing creation application, a spreadsheet application, an Internet browser, and an email creation application. is there.

The program of the present invention is a program for executing processing for pasting audio-related information such as music that the user was listening to when creating electronic data to the created electronic data, for example, FIG. 2, FIG. 11, FIG. 14, FIG. FIG. 18 is a program for executing the processing described in FIG. Furthermore, the program of the present invention is a program for executing, for example, the processing of FIG. 23 as processing when audio-related data attached to electronic data is selected and operated.
Such a program of the present invention can be recorded in advance in a system HDD as a recording medium in a data processing apparatus such as a computer system, a ROM in a microcomputer having a CPU, or the like.
Alternatively, the program is temporarily or permanently stored on a removable recording medium such as a flexible disk, CD-ROM (Compact Disc Read Only Memory), MO (Magnet optical) disk, DVD (Digital Versatile Disc), magnetic disk, and semiconductor memory. Can be stored (recorded). Such a removable recording medium can be provided as so-called package software. For example, it can be installed in a computer system by being provided by a CD-ROM, a DVD-ROM, or the like. In addition to installing from a removable recording medium, the program can be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet.

It is a block diagram of the system configuration of an embodiment of the invention. It is a flowchart of the process at the time of the diary preparation of 1st Embodiment. It is explanatory drawing of a diary browsing screen. It is explanatory drawing of the image for diary creation of embodiment. It is explanatory drawing of the diary image with which the music relevant data of embodiment was affixed. It is explanatory drawing of the diary image to which the music related data of embodiment is not affixed. 1 is a block diagram of a system configuration to which an audio player according to an embodiment is added. It is explanatory drawing of the listening data used in 2nd Embodiment. It is a flowchart of the process of the audio player of 2nd Embodiment. It is a flowchart of the process at the time of communication of the audio player and PC main body of 2nd Embodiment. It is a flowchart of the music related data sticking process of 2nd Embodiment. It is explanatory drawing of the window for the user's selection of embodiment. It is explanatory drawing of the diary image on which the photograph was stuck. It is a flowchart of the music related data sticking process of 4th Embodiment. It is explanatory drawing of the state by which the music related data was affixed on the photograph affixed on the diary of embodiment. It is explanatory drawing of the state by which the music related data was affixed on the photograph affixed on the diary of embodiment. It is a flowchart of the process at the time of the diary preparation of 5th Embodiment. It is a flowchart of the process regarding the music related data of the photograph of 5th Embodiment. It is a block diagram of the structure of the camera apparatus which pastes music related data on a photograph. It is a flowchart of the process which pastes the music related data of a camera apparatus on a photograph. It is explanatory drawing of the imaging data file in a camera apparatus. It is explanatory drawing of the preset image of selection of the music related data of embodiment. It is a flowchart of the process at the time of the diary browsing of embodiment.

Explanation of symbols

  1 blog server, 10 network, 20 PC body, 21 OS, 22 playback application, 23 diary creation / viewing application, 24 recording / playback unit, 25 recording media, 26, 27 communication unit, 28 music data synchronization application, 80 audio player, 81 Control unit

Claims (14)

A data creation step for creating electronic data;
An audio-related data acquisition step for acquiring audio-related data related to the audio data that was being reproduced at the time of electronic data creation in the data creation step;
A pasting process step of pasting the audio-related data obtained in the audio-related data acquisition step to the electronic data created in the data creation step;
That causes a data processing device to execute   2. The program according to claim 1, wherein the electronic data created in the data creation step is electronic diary data. In the audio-related data acquisition step, acquisition data including reproduction date / time information and audio-related data for audio data reproduced by the audio reproduction device is obtained from an external audio reproduction device,
In the pasting processing step, the listening date / time information of the electronic data created in the data creating step and the reproduction date / time information in the listening data obtained in the audio-related data obtaining step are used for the electronic data. The program according to claim 1, wherein processing for attaching audio-related data included in the data is performed. In the electronic data creation step, imaging data can be attached to the electronic data being created,
In the audio-related data acquisition step, acquisition data including reproduction date / time information and audio-related data for audio data reproduced by the audio reproduction device is obtained from an external audio reproduction device,
In the pasting processing step, the imaging date / time information of the imaging data pasted on the electronic data created in the data creation step and the reproduction date / time information in the listening data obtained in the audio-related data obtaining step are further used. The program according to claim 1, wherein processing for attaching audio-related data included in the listening data to the electronic data is performed. In the electronic data creation step, imaging data can be attached to the electronic data being created,
The paste processing step further includes a process of pasting audio-related data attached to imaging data attached to the electronic data created in the data creation step to the electronic data. The program according to 1.   The program according to claim 1, further comprising a selection step of selecting audio-related data to be pasted when there are a plurality of audio-related data to be pasted on the electronic data. Display control for displaying audio-related data related to audio data reproduced at the time of electronic data creation and / or electronic data attached with audio-related data related to audio data reproduced at the time of imaging of the image data attached to the electronic data. Steps,
A detection step of detecting a designation operation of audio-related data attached to the displayed electronic data;
A search step of searching for audio data from the contents of the audio-related data to be specified in response to the detection of the specifying operation in the detecting step;
A processing step for performing processing related to the audio data searched in the search step;
That causes a data processing device to execute   8. The program according to claim 7, wherein in the processing step, a reproduction request for the audio data searched in the searching step is made. In the search step, an external server that provides the audio data is searched from the contents of the audio-related data to be designated, and the audio data is provided.
8. The program according to claim 7, wherein in the processing step, processing for presenting the external server is performed. A data creation step for creating electronic data;
An audio-related data acquisition step for acquiring audio-related data related to the audio data that was being reproduced at the time of electronic data creation in the data creation step;
A pasting process step of pasting the audio-related data obtained in the audio-related data acquisition step to the electronic data created in the data creation step;
A data processing method comprising: Display control for displaying audio-related data related to audio data reproduced at the time of electronic data creation and / or electronic data attached with audio-related data related to audio data reproduced at the time of imaging of the image data attached to the electronic data. Steps,
A detection step of detecting a designation operation of audio-related data attached to the displayed electronic data;
A search step of searching for audio data from the contents of the audio-related data to be specified in response to the detection of the specifying operation in the detecting step;
A processing step for performing processing related to the audio data searched in the search step;
A data processing method comprising: Data creation means for creating electronic data in response to input;
Audio-related data acquisition means for acquiring audio-related data related to audio data that was being reproduced at the time of electronic data creation by the data creation means;
A pasting processing means for pasting the audio-related data obtained by the audio-related data obtaining means to the electronic data created by the data creating means;
A data processing apparatus comprising: The display unit displays audio data related to audio data that was played back when the electronic data was created and / or audio data related to audio data that was played back when imaging data attached to the electronic data. Display control means,
Detection means for detecting a designation operation of audio-related data affixed to the displayed electronic data;
Search means for searching for audio data from the contents of audio-related data to be designated in response to the designation operation being detected by the detection means;
Processing means for performing processing related to the audio data searched by the search means;
A data processing apparatus comprising: Reproducing means for reproducing audio data from a recording medium;
A date and time counting means for counting the current date and time;
In response to the reproduction of the audio data by the reproduction means, the reproduction date and time information at which the reproduction was performed is obtained from the date and time counting means, and audio related data for the reproduced audio data is generated, Listening data generating means for generating and storing listening data including reproduction date and time information and audio-related data;
A transmission means for transmitting the listening data in response to a request from an external device;
An audio playback apparatus comprising:

Images