JP2008154183A - Device, method and program for processing content data - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To generate audio data capable of enabling a user to easily reproduce sound data from a part in the middle of track from audio data of existing format. <P>SOLUTION: Audio data 100 have sound data 120 of one track and content text data 114 corresponding to words of the sound data 120 of the track. The content text data 114 are displayed in synchronism with reproduction of the sound data 120. A multifunction machine 20 creates display data 148 from the content text data 114. The display data 148 are constituted by associating text data 178 and 198 of words and hyper link data 172 and 192 with timing attribute data 176 and 196 corresponding to reproduction time axis of the sound data 120 respectively. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a technique for processing content data. The “content data” in this specification means data having sound data and / or video data and text data regarding the contents of the sound data and / or video data.

For example, content data is widely downloaded from a server on the Internet to a personal computer (hereinafter referred to as “PC”). The content data includes sound data and / or video data. The PC can reproduce sound data and video data. Further, the PC can output the downloaded sound data and video data to a content reproduction device (for example, a portable audio reproduction device). In this case, sound data and video data are reproduced in the content reproduction apparatus.
Normally, sound data and video data are managed in units of tracks. A track is an arbitrary unit determined by a creator of sound data and video data. For example, in the case of music sound data, one song often becomes one track.

Content data having sound data and text data is known. For example, content data in MP3 format (MPEG Audio Layer-3) has sound data and ID3 data of at least one track. The ID3 data is disclosed in detail in Non-Patent Document 1 below. The ID3 data includes various display data displayed on a PC or content reproduction device.
For example, the ID3 data includes title text data related to the track title. The PC and the content reproduction apparatus can display the track title based on the title text data included in the ID3 data.
Further, the ID3 data may include content text data related to the content (for example, lyrics) of the sound data. The content text data in one form is obtained by associating each of a plurality of timing data corresponding to the reproduction time axis of the sound data with a part of lyrics (text data) corresponding to the timing data. If content text data in which timing data and lyrics are associated with each other is used, the PC or the content reproduction apparatus can display the lyrics in synchronization with the reproduction of the sound data. Patent Document 1 below discloses displaying content text data in synchronization with reproduction of sound data.

'ID3 tag', [online], S. S Planning, [Search December 4, 2006], Internet <URL: http: // www. e-ssp. net / id3. html> JP 2003-157091 A

  There is a demand for reproducing sound data and video data from a position in the middle of one track in a PC or content reproduction apparatus. In the conventional content data format, sound data and video data are reproduced from a position in the middle of a track when a user fast-forwards or rewinds the reproduced sound data and video data. However, with this method, the user may fast forward or rewind beyond the point desired by the user. In this case, the user must perform fast forward or rewind again so that it can be played from the desired location.

  The present invention has been created in view of the above circumstances. The present invention provides a technique for creating content data that allows a user to easily reproduce sound data and video data from an intermediate position of a track from content data in an existing format.

  In general, the content data includes sound data and / or video data of at least one track and display data for the track (ID3 tag data in the above example). In general, the display data includes text data such as a track title. Moreover, a general content reproduction apparatus has a text browsing function corresponding to a hyperlink structure. In this type of content playback apparatus, the title of a track can be displayed, and when the title is selected by the user from the display screen, the track can be played back from the beginning. In the present invention, this hyperlink structure data format is used to add a hyperlink structure to each part of content text data (for example, lyrics) included in display data. That is, in the present invention, the hyperlink structure is added in units smaller than the track.

One aspect of the present invention is a content data processing apparatus that is used by being connected to an external device. The content data processing device includes an input device that inputs content data output from an external device, and a data creation device that generates other data from the content data input to the input device.
The “external device” is a concept including various devices that can output content data to a content data processing apparatus. For example, the external device may be a content data distribution server on a communication network. Further, for example, the external device may be a device (memory) directly connected to the content data processing apparatus.

The content data includes sound data and / or video data of at least one track and first display data of the track. The first display data of the track includes a portion of sound data corresponding to the first timing data in each of the plurality of first timing data corresponding to the reproduction time axis of the sound data and / or video data of the track. And / or text data related to the contents of the video data.
The above “contents of sound data and / or video data” includes lyrics of the sound data, a score, a code, and the like. For example, when the sound data is a song, the text data may be the lyrics of the song, a score, a chord, or the like. Further, for example, when the sound data is a sound that is not a song (for example, a foreign language conversation course), the text data may be a character corresponding to the sound. For example, when the video data is a movie, the text data may be a caption of the movie.
The first display data may be data in which only text data is associated with the first timing data, or text data and other data are associated with the first timing data. May be.
Further, the timing data (first timing data or second timing data described later) may be expressed in units of time or may be expressed in other units. In the former case, the timing data may be the playback time from the beginning of the sound data of the track. In the latter case, the timing data may be the number of frames from the head of the sound data of the track.

The data creation device creates second display data from the first display data of the track. The second display data includes a plurality of second timing data corresponding to the reproduction time axis of the track sound data and / or video data, a portion of the sound data corresponding to the second timing data, and / or Alternatively, text data relating to the contents of video data is associated with a hyperlink structure.
As described above, the first display data of the track includes a plurality of first timing data corresponding to the reproduction time axis of the sound data and / or video data of the track. The data creation device can set the second timing data based on the first timing data. The “plurality of second timing data” may or may not match the above “plurality of first timing data”.
In the second display data, each of the plurality of second timing data is associated with text data relating to the contents of the sound data and / or video data corresponding to the second timing data. Therefore, the content data processing device and / or another content reproduction device can display the text data in synchronization with the reproduction of the sound data and / or video data of the track. The content data processing device and / or another content reproduction device may display the text data without reproducing the sound data and / or video data of the track. That is, text data may be displayed asynchronously. The association between the second timing data and the text data has a hyperlink structure. When the second display data is used, the content data processing device and / or another content playback device can display a part of the text data displayed in synchronization (or asynchronously) with the playback of the sound data and / or video data. When selected by the user, sound data and / or video data can be reproduced from the selected location.
The content data processing apparatus of the present invention creates new second display data from content data in an existing format. The second display data has a hyperlink structure added in units smaller than the track. Content data capable of reproducing sound data and / or video data from a portion (a portion in the middle of a track) selected by the user on the display screen is realized. The user can easily reproduce the sound data and / or video data from a position in the middle of the track.

The data creation device sets the second display data so that the total number of second timing data included in the second display data is smaller than the total number of first timing data included in the first display data of the track. It is preferable to create.
For example, each of the plurality of first timing data included in the first display data of the track may be set in units of syllables. In this case, it is preferable that the data creation device sets each of the plurality of second timing data included in the second display data in units of words or more.
In this way, the total number of timing data included in the second display data can be reduced, and the data amount of the second display data can be reduced.

  The content data processing device may further include a storage device that stores second display data. The first display data includes first timing data including numerical values along the reproduction time axis of the sound data and / or video data of the track, and sound data and / or video of a portion corresponding to the first timing data. You may comprise from several combination data with which the text data regarding the content of data are matched. In this case, the data creation device may create the second display data by the following processing (1) or (2).

(1) The data creation device reads a plurality of combination data included in the first display data, and for each combination data, a numerical value included in the first timing data of the first timing data of the combination data and the combination thereof Data associated with the text data of the data by the hyperlink structure is written in the storage device.
In this case, the numerical value of each first timing data included in the first display data is used as the second timing data.

(2) The plurality of combination data may be arranged in the order of numerical values included in the first timing data of each combination data. In this case, the data creation device sequentially reads a plurality of combination data included in the first display data, and for at least two consecutive combination data, the first timing data of the first combination data in the combination data Is stored in the storage device by associating the numerical values included in the data and the text data of the combination data with the hyperlink structure.
In this case, the numerical value of the first timing data included in the first combination data of at least two consecutive combination data is used as the second timing data.

The content data processing apparatus may be used by being connected to the above external device, and may be used by being connected to a content reproduction apparatus having a display screen. In this case, the content data processing device may further include an output device that outputs the sound data and / or video data of the track and the second display data created by the data creation device to the content reproduction device. Good.
In this way, the content reproduction apparatus can reproduce sound data and / or video data, and text data (lyrics) included in the second display data on the display screen in synchronization (or asynchronously) with the reproduction. Etc.) can be displayed. When a part of lyrics or the like displayed on the display screen is selected by the user, the content reproduction apparatus can reproduce sound data and / or video data from the selected portion.

  The content reproduction apparatus can display lyrics and the like on the display screen using the second display data without the first display data. Therefore, the output device does not have to output the first display data of the track to the content reproduction device.

The technique of the present invention can also be defined as the following content data processing apparatus. The content data processing device includes an input device that inputs content data output from an external device, and a data creation device that generates other data from the content data input to the input device.
The content data includes sound data and / or video data of at least one track and content text data relating to the contents of the sound data and / or video data of the track.
The content text data of the track can be displayed on the content data processing device and / or another content playback device in synchronization with the playback of the sound data and / or video data of the track.
The data creation device creates linked content text data in which a hyperlink structure is added to each of a plurality of small text data included in the track content text data. When this linked content text data is used, the content data processing device and / or another content playback device can display a part of the content text data displayed in synchronization (or) with the playback of the sound data and / or video data ( When (small text data) is selected by the user, sound data and / or video data can be reproduced from the selected portion.
According to the content data processing apparatus of the present invention, new linked content text data is created from content data in an existing format. Content data capable of reproducing sound data and / or video data from a portion (a portion in the middle of a track) selected by the user on the display screen is realized. The user can easily reproduce the sound data and / or video data from a position in the middle of the track.

The technique of the present invention can also be expressed as the following method. This method is a method of processing content data by a data processing apparatus that is connected to an external device and used. This method includes an input process of inputting content data output from an external device, and a data generation process of generating other data from the content data input in the input process.
The content data includes sound data and / or video data of at least one track and first display data of the track.
The first display data of the track includes a plurality of first timing data corresponding to the reproduction time axis of the sound data and / or video data of the track, and a portion of the sound corresponding to the first timing data. Text data relating to the contents of data and / or video data is associated with the data.
In the data creation step, second display data is created from the first display data of the track. The second display data includes a plurality of second timing data corresponding to the reproduction time axis of the above-described track sound data and / or video data, a portion of the sound data corresponding to the second timing data, and / or Alternatively, text data relating to the contents of video data is associated with a hyperlink structure.
According to this data processing method, it is possible to create content data that can reproduce sound data and / or video data from a location selected by the user on the display screen (a location in the middle of the track).

The technique of the present invention can also be expressed as the following computer program. This program is executed by a computer mounted on a data processing apparatus that is connected to an external device and used. This program causes a computer to execute data creation processing for creating other data from content data output from an external device and input to a data processing device.
The content data includes sound data and / or video data of at least one track and first display data of the track.
The first display data of the track includes a plurality of first timing data corresponding to the reproduction time axis of the sound data and / or video data of the track, and a portion of the sound corresponding to the first timing data. Text data relating to the contents of data and / or video data is associated with the data.
In the data creation process, second display data is created from the first display data of the track. The second display data includes a plurality of second timing data corresponding to the reproduction time axis of the above-described track sound data and / or video data, a portion of the sound data corresponding to the second timing data, and / or Alternatively, text data relating to the contents of video data is associated with a hyperlink structure.
According to this computer program, it is possible to realize a data processing apparatus that creates content data capable of reproducing sound data and / or video data from a location selected by the user (a location in the middle of a track) on the display screen. .

Here, the main features of the techniques described in the following examples are summarized.
(Mode 1) The content data processing apparatus is built in the multi-function device. The multi-function device has at least a printing function.
(Mode 2) The multi-function device is connected to the Internet. A portable audio playback device is connected to the multi-function device. The multi-function device downloads audio data from a server on the Internet. The multi-function device creates second display data from the first display data included in the downloaded audio data, and outputs the sound data and second display data included in the audio data to the portable audio playback device.
(Mode 3) The multi-function device sets the second timing data in units previously selected by the user. This unit is selected from syllables, words (words), sentences (sentences), and paragraphs (paragraphs).
(Mode 4) The multi-function device creates print data from the first display data included in the downloaded audio data. The multi-function device prints based on the print data.

  Embodiments of the present invention will be described with reference to the drawings. FIG. 1 shows a multi-function device system 10 of this embodiment. The multi-function device system 10 includes a multi-function device 20, a PSTN 50, the Internet 52, a portable audio playback device 56, a PC 58, and the like.

(System configuration)
The multi-function device 20 includes a scanner 22, a printing device 24, a FAX device 26, a control device 28, an operation device 30, a display device 32, a telephone line interface 34, a LAN interface 36, a USB host controller 38, and the like. The devices 22, 24, 26, 28, 30, 32, 34, 36, and 38 are connected to each other via a bus line 40 so as to communicate with each other.
The scanner 22 scans a document and generates image data. The printing device 24 prints image data. The image data may be sent from the outside of the multi-function device 20 (Internet 52 or PC 58), or may be generated by the scanner 22. The FAX device 26 outputs the image data generated by the scanner 22 to the outside as facsimile data. Further, the FAX apparatus 26 causes the printing apparatus 24 to print facsimile data sent from the outside. The control device 28 comprehensively controls each device 22, 24, 26, 30, 32, 38, etc. mounted on the multi-function device 20. The configuration of the control device 28 will be described in detail later. The operating device 30 is operated by a user. The user can input various instructions to the multi-function device 20 by operating the operation device 30. The display device 32 can display various information.

The telephone line interface 34 is connected to a PSTN (general telephone line network) 50. The telephone line interface 34 can output the facsimile data generated by the multi-function device 20 to the PSTN 50. The telephone line interface 34 can input facsimile data sent from the outside.
The LAN interface 36 is connected to the Internet 52. The LAN interface 36 can acquire data from various devices (such as a server) on the Internet 52. In this embodiment, an audio data distribution server 54 is connected to the Internet 52. The LAN interface 36 can acquire audio data from the audio data distribution server 54. Hereinafter, the audio data distribution server 54 may be simply referred to as a “server”. The LAN interface 36 is connected to the PC 58. The LAN interface 36 can input various data sent from the PC 58.
The USB host controller 38 is connected to the portable audio playback device 56. The USB host controller 38 outputs audio data to be described later to the portable audio playback device 56. The portable audio playback device 56 includes a sound data playback device 56a, a display screen 56b, an operation device 56c, and the like. Hereinafter, the portable audio playback device 56 may be simply referred to as a “playback device”.

(Configuration of control device)
Next, the configuration of the control device 28 of the multi-function device 20 will be described. FIG. 2 shows a block diagram of the control device 28.
The control device 28 includes a CPU 60, a ROM 62, an NVRAM 64 and a RAM 68.
The CPU 60 executes various processes according to various programs stored in the ROM 62.
The ROM 62 stores various programs for the multi-function device 20 to operate. An example of programs stored in the ROM 62 is listed below. (1) A program for executing a process of downloading audio data from the server 54. (2) A program for executing processing for creating another display data from ID3 data (details will be described later) included in the downloaded audio data. (3) A program for executing a process of outputting the sound data included in the downloaded audio data and the generated display data to the playback device 56. (4) A program for executing processing for creating print data from display data included in downloaded audio data.

The NVRAM 64 stores a content update table 66. FIG. 3 shows an example of the content update table 66.
The content update table 66 is a table in which the index number, device ID, URL, last update time, next update time, and synchronization unit are associated with each other.
The index number is a number that identifies a group of data associated with the index number. In the example of FIG. 3, numbers from zero to M are used. The device ID is an ID that identifies the playback device 56. URL (RSS URL) is an address on the Internet 52 where audio data is stored. For example, the address of the server 54 in FIG. The last update time means the time when the audio data stored in the URL associated with the time is last downloaded to the multi-function device 20. The next update time means a time at which the audio data stored in the URL associated with the time is to be downloaded to the multi-function device 20. The synchronization unit means a unit for adding hyperlink data described later. This point will be described in detail later.
The user can create the content update table 66 by operating the operation device 30 or the PC 58 of the multi-function device 20. However, the last update time is automatically updated by the multi-function device 20. This point will be described in detail later.

  The RAM 68 shown in FIG. 2 includes an audio data storage area 70, a display data storage area 72, a print data storage area 74, other work areas 76, and the like. The contents of the data stored in each of the storage areas 70, 72, 74, 76 will be described in detail later.

(Content update process)
Next, the contents of processing executed by the CPU 60 will be described. When the playback device 56 is connected to the multi-function device 20, the CPU 60 executes content update processing. FIG. 4 shows a flowchart of the content update process.
The CPU 60 executes content update processing based on the content update table 66 (see FIG. 3). First, the CPU 60 initializes an index number (k) and stores “k = 0” (S10). This “k” is an index number to be processed. The CPU 60 starts processing from the first index number (that is, zero) included in the content update table 66.
Next, the CPU 60 determines whether k is larger than M (S12). M is the maximum index number stored in the content update table 66. If YES here, it means that the processing of S14 to S26 described later has been executed for all index numbers. In this case, the CPU 60 ends the content update process. On the other hand, if NO in S12, the process proceeds to S14.

In S14, the CPU 60 reads the content update information of the index number currently being processed. For example, when the index number currently being processed is “0” (when k = 0), the CPU 60 determines the information (device ID, URL, last update time, Next update time and synchronization unit) are read.
Next, the CPU 60 determines whether or not the next update time read in S14 has passed the current time (S16). If NO here, the process from S18 to S24 is skipped, and the process proceeds to S26. On the other hand, if YES in S16, the process proceeds to S18.
In S <b> 18, the CPU 60 acquires the ID from the playback device 56 connected to the multi-function device 20. Next, the CPU 60 determines whether or not the acquired ID matches the device ID read in S14. If NO here, the process from S20 to S24 is skipped and the process proceeds to S26. On the other hand, if YES in S18, the process proceeds to S20.

In S20, the CPU 60 downloads content (audio data) from the URL read in S14. As a result, the LAN interface 36 (see FIG. 1) of the multi-function device 20 inputs audio data. The input audio data is stored in the audio data storage area 70 (see FIG. 2) of the RAM 68.
Next, the CPU 60 executes processing for processing the downloaded audio data (S22). This processing will be described in detail later.
When executing the processing (S22), the CPU 60 updates the content update information (S24). Specifically, the CPU 60 updates the last update time (see FIG. 3) corresponding to the currently processed index number to the current time, and updates the next update time to a predetermined time. The next update time may be a time indicated by a server (for example, the server 54 in FIG. 1) to which audio data is output, or may be a time set by the user.
When the content update information is updated (S24), the CPU 60 adds 1 to the currently processed index number (k) (S26). Thereby, the process after S12 is performed about the next index number. When the process is executed for all index numbers included in the content update table 66, YES is determined in S12, and the content update process ends.

(Audio data structure)
Before describing the content processing process in S22, the structure of the audio data downloaded in S20 will be described. FIG. 5 schematically shows the structure of audio data.
The audio data 100 is MP3 format data. The audio data 100 includes ID3 data (ID3 tag) 102 and sound data 120. The sound data 120 includes sound data of at least one track. The sound data 120 of this embodiment is assumed to have sound data for only one track.

The ID3 data 102 includes data that can be displayed on the playback device 56, and can also be referred to as display data. The ID3 data 102 includes title text data 106, content data 110, and the like.
When the audio data 100 is stored in the playback device 56, the playback device 56 can display a title corresponding to the title text data 106 on the display screen 56b (see FIG. 1). Note that the user can select the title displayed on the display screen 56b by operating the operation device 56c (see FIG. 1) of the playback device 56. In this case, the playback device 56 can play back the tracks included in the sound data 120 from the beginning.

  The content data 110 includes a SYLT marker 112 and content text data 114. The SYLT marker 112 is a marker indicating that the content text data 114 can be displayed in synchronization with the reproduction of the sound data 120. A USLT marker may be added to the content data 110 instead of the SYLT marker 112. In this case, it means that the content text data cannot be displayed in synchronization with the reproduction of the sound data 120. The content text data 114 of this embodiment can be displayed in synchronization with the reproduction of the sound data 120.

The content text data 114 is text data relating to the content of the sound data 120.
For example, if the sound data 120 is a song, the content text data 114 is the lyrics, score, code, etc. of the song. If the sound data 120 is sound data other than music (for example, sound data of an English conversation course), the content text data 114 is a character string corresponding to the sound. In this embodiment, it is assumed that the sound data 120 is a song of one track and the content text data 114 is the lyrics of the song.

FIG. 6 shows the data structure of the content text data 114. As described above, the content text data 114 of this embodiment can be displayed in synchronization with the reproduction of the sound data 120.
The content text data 114 has a plurality of combination data 128. In FIG. 6, only the first combination data 128 is given a reference numeral, and the other combination data is omitted.
One combination data 128 includes character data 130, a synchronization code 132, and timing data 134. The character data 130 corresponds to a part of the lyrics of the sound data 120. The synchronization code 132 is a code indicating that the subsequent four characters are timing data 134. The timing data 134 is the time from the beginning of the sound data 120. In this embodiment, the timing data 134 of each combination data 128 is set for each syllable unit of the lyrics of the sound data 120. For example, when the lyrics “Information” exist, the timing data 134 is set for each of “In”, “for”, “ma”, and “tion”. That is, in this example, there is combination data 128 in which the character data 130 corresponding to “In”, the synchronization code 132, and the timing data 134 indicating the timing at which “In” is reproduced are associated with each other. Similarly, there is combination data 128 in which character data 130 corresponding to “for”, synchronization code 132, and timing data 134 indicating the timing at which “for” is reproduced are associated with each other. Similar combination data 128 exists for each of “ma” and “tion”. Therefore, when the lyrics “Information” exist, four combination data 128 exist.

In FIG. 6, the character data 130 is indicated by “x”. The character data 130 includes “x”, which is the number of characters that is a syllable unit. For example, in the example of “Information” described above, the character data 130 corresponding to “In” is two characters, and the character data 130 corresponding to “for” is three characters. For example, the character data 130 of the first combination data 128 in FIG. 6 includes three characters 130a, 130b, and 130c. For example, the character data 130 of the next combination data 128 includes two characters 130d and 130e. Also, as shown in FIG. 6, the character data 130 may include a space 136, a comma 138, or a period 140. In addition, other characters (tab, colon, semicolon, parentheses, etc.) may be included in the character data 130.
The timing data 134 is expressed by “ssss” in units of time (μsec) by a 32-bit value represented by 4 characters. Note that the timing data 134 may not be expressed by the time from the head of the sound data 120. For example, the timing data 134 may be expressed by the number of frames from the head of the sound data 120. The timing data 134 may be expressed in any format as long as it corresponds to the reproduction time axis of the sound data 120.
The content text data 114 may include a line feed code 142.

The ID3 data 102 may include other data. In the example of FIG. 5, creator information 104 a, copyright description 104 b, creation date information 104 c, image data 116, and comment data 118 are included in the ID3 data 102.
The creator information 104 a is information about the creator of the audio data 100. The copyright description 104b is information relating to copyright. The creation date information 104c is information on the creation date of the audio data 100.
The image data 116 is image data that is displayed synchronously or asynchronously with the reproduction of the sound data 120. The comment data 118 is text data corresponding to a comment inserted by the creator of the audio data 100.

(Content processing)
Next, the content processing process in S22 of FIG. 4 will be described. FIG. 7 shows a flowchart of content processing.
As described above, the audio data 100 downloaded in S20 of FIG. 4 is stored in the audio data storage area 70 (see FIG. 2). The CPU 60 reads the ID3 data 102 included in the audio data 100 (S30).
Next, the CPU 60 determines whether or not the SYLT marker 112 (see FIG. 5) is included in the ID3 data 102 (S32). In the case of NO here, S34 to S40 are skipped, and the process proceeds to S42. On the other hand, if YES in S32, the process proceeds to S34. In S34, display data creation processing is executed. The contents of this process will be described in detail later. When executing the display data creation process (S34), the CPU 60 outputs the created display data to the playback device 56 (see FIG. 1) (S36). As a result, the display data is stored in the playback device 56.
Subsequently, a print data creation process is executed (S38). The contents of this process will be described in detail later. When executing the print data creation process (S38), the CPU 60 executes a process for printing based on the created print data (S40).
Finally, the CPU 60 executes a process of outputting the sound data 120 included in the audio data 100 to the playback device 56 (see FIG. 1) (S42). As a result, the sound data 120 is stored in the playback device 56.

(Display data creation process)
The display data creation process in S34 will be described in detail. 8 and 9 are flowcharts of the display data creation process. The CPU 60 executes display data creation processing based on the index update information (see FIG. 3) corresponding to the currently processed index number and the ID3 data 102 included in the audio data 100.
First, the CPU 60 stores a delimiter list corresponding to the synchronization unit of index update information corresponding to the currently processed index number (S50). The delimiter list is stored in the work area 76 (see FIG. 2) of the RAM 68. There are four types of synchronization units in the present embodiment: “none”, “word (word)”, “sentence (sentence)”, and “paragraph (paragraph)”. When the synchronization unit is “none”, nothing is stored in the delimiter list. When the synchronization unit is “word”, “space, tab, comma, period, line feed code” is stored in the delimiter list. When the synchronization unit is “sentence”, “comma, period, line feed code” is stored in the delimiter list. When the synchronization unit is “paragraph”, “line feed code” is stored in the delimiter list.
For example, when the currently processed index number is “0”, the synchronization unit is a sentence (see FIG. 3). In this case, “comma, period, line feed code” is stored in the delimiter list. For example, when the index number currently processed is “1”, the synchronization unit is a paragraph (see FIG. 3). In this case, “line feed code” is stored in the delimiter list. A combination of the synchronization unit and the character code (group) stored in the delimiter list is preset and stored in the ROM 62 or the like.

Subsequently, the CPU 60 executes the process of S52. In S52, “−1” is stored as the synchronization value, the character string buffer is initialized, the display data storage area 72 (see FIG. 2) is initialized, and “FALSE” is stored as the synchronization flag. The synchronization value is stored in the work area 76 (see FIG. 2) of the RAM 68. The character string buffer is a predetermined storage area in the work area 76 of the RAM 68. The synchronization flag is also stored in the work area 76 of the RAM 68.
Next, the CPU 60 writes the header portion in the display data storage area 72 (S54). FIG. 10 shows an example of display data 148 that is finally created by executing the display data creation process. The portion indicated by reference numeral 150 in FIG. 10 is the header portion written in S54. The header unit 150 includes a data group 152 corresponding to a title and a data group 160 defining a data format. The data group 152 includes a code 154 that means that the description of the title is started, text data 156 of the title, and a code 158 that means that the description of the title has ended. The CPU 60 writes the text data 156 according to the title text data 106 (see FIG. 5) included in the ID3 data 102. The data group 160 has a code 162 that means that the data format is “xml” and a code 164 that means that the code system is “utf-8”.

As shown in FIG. 8, when the CPU 60 finishes the process of writing the header (S54), it reads one character included in the content text data 114 (see FIG. 6) (S56). In the first process of S56, the first character of the content text data 114 is read. For example, in the case of the content text data 114 shown in FIG. 6, the character 130a is read. In the process of S56 after the second time, the next character after the character read in S56 (or S112 of FIG. 9 described later) before that is read.
The CPU 60 determines whether or not the character read in S56 means an end code (S58). The end code is a code added to the end of the content text data 114. Note that the end code is not shown in the content text data 114 of FIG. If YES in S58, the process proceeds to S60. On the other hand, if NO in S58, the process proceeds to S70.

In S60, the CPU 60 determines whether or not the synchronization value is “−1”. The synchronization value is stored in the work area 76 (see FIG. 2) of the RAM 68. When the determination is NO, the CPU 60 writes the hyperlink data, the character string stored in the character string buffer (may be one character), and the synchronization value in the display data storage area 72 (S62). .
Hyperlink data is data that defines a hyperlink to sound data in an xml format data structure. Reference numeral 172 (or 192) in FIG. 10 is hyperlink data.
The character string buffer is included in the work area 76 of the RAM 68 (see FIG. 2). The CPU 60 writes the character string stored in the character string buffer into the display data storage area 72. As a result, the text data indicated by reference numeral 178 (or 198) in FIG. 10 is stored in the display data storage area 72. The character string buffer stores characters in S76, S108, or S110 described later.
The synchronization value is stored in the work area 76 (see FIG. 2) of the RAM 68. The CPU 60 writes the synchronization value stored in the work area 76 in the display data storage area 72. As a result, the timing data indicated by the reference numeral 176 (or 196) in FIG. 10 is stored in the display data storage area 72. In the work area 76, a synchronization value is stored in S86 or S118 described later.

  When the process of S62 is completed, the process proceeds to S64. If YES in S60, S62 is skipped and the process proceeds to S64. In S <b> 64, the CPU 60 writes the footer portion in the display data storage area 72. In FIG. 10, the footer portion is indicated by reference numeral 220. The footer unit 220 is a known code added at the end of data in the xml format. For this reason, FIG. 10 does not specifically show the content of the footer unit 220. When the footer unit 220 is written, the display data creation process ends.

  In S70, the CPU 60 determines whether any character code is stored in the delimiter list in S50. When the synchronization unit is “word”, “sentence”, or “paragraph”, the character code (group) is stored in the delimiter list in S50. In this case, NO is determined in S70. On the other hand, if the synchronization unit is “none”, nothing is stored in the delimiter list in S50. In this case, YES is determined in S70.

If YES in S70, the process proceeds to S72. In S72, the CPU 60 determines whether or not the character read in S56 is the synchronization code 132 (see FIG. 6). In the case of YES here, the process proceeds to S118 of FIG. Further, in the case of NO here, the process proceeds to S74.
In S74, the CPU 60 stores “FALSE” in the synchronization flag. The synchronization flag is stored in the work area 76 (see FIG. 2) of the RAM 68. If the synchronization flag “FALSE” is stored before executing S74, the synchronization flag “FALSE” is maintained even if S74 is executed. On the other hand, if the synchronization flag “TRUE” is stored before executing S74, the synchronization flag “FALSE” is changed by executing S74. The synchronization flag “TRUE” is stored in S90 described later.
Subsequently, the CPU 60 stores the character read in S56 in the character string buffer of the work area 76 (see FIG. 2). When S76 ends, the CPU 60 returns to S56 and reads the next one character.

On the other hand, if NO in S70, the process proceeds to S80. In S80, the CPU 60 determines whether or not the character read in S56 is included in the delimiter list stored in S50.
For example, if the character code stored in the delimiter list in S50 corresponds to the synchronization unit “word” and the character read in S56 is “space”, YES is determined in S80. In this case, the process proceeds to S100 in FIG.
For example, if the character code stored in the delimiter list in S50 corresponds to the synchronization unit “sentence” and the character read in S56 is “space”, it is determined NO in S80. In this case, the process proceeds to S82.

In S82, the CPU 60 determines whether or not the character read in S56 is the synchronization code 132 (see FIG. 6). If YES here, the process proceeds to S84. On the other hand, in the case of NO here, the process proceeds to S74 described above.
In S84, the CPU 60 determines whether or not the synchronization value is “−1” (S84). This process is the same as the process of S60 described above. If YES here, the CPU 60 stores the next four characters of the synchronization code 132 read in S56 (that is, the timing data 134 (see FIG. 6)) in the work area 76 as a synchronization value (S86). On the other hand, if NO in S84, the CPU 60 skips the next four characters (that is, timing data 134) of the synchronization code 132 read in S56 (S88). That is, the timing data 134 is not stored as a synchronization value.
When S86 or S88 ends, the CPU 60 stores “TRUE” in the synchronization flag (S90). When S90 ends, the CPU 60 returns to S56 and reads the next one character. That is, the next character of the timing data 134 (or the timing data 134 skipped in S88) stored as the synchronization value in S86 is read.

Next, with reference to FIG. 9, processing after the determination of YES in S80 will be described. The determination of YES in S80 means that the character read in S56 matches the character code of the delimiter list. In this case, the CPU 60 determines whether or not the synchronization value is “−1” (S100). In the case of NO here, the CPU 60 determines whether or not “TRUE” is stored in the synchronization flag (S102). In the case of YES here, the CPU 60 executes the same processing as S62 described above (S104). That is, in S104, the CPU 60 writes the hyperlink data, the character string stored in the character string buffer, and the synchronization value in the display data storage area 72. When S104 ends, the process proceeds to S106.
In S106, the CPU 60 stores “−1” as the synchronization value, initializes the character string buffer, and stores “FALSE” as the synchronization flag. Next, the CPU 60 stores the character read in S56 in the character string buffer initialized in S106 (S108). When S108 ends, the CPU 60 returns to S56 and reads the next one character.

If YES in S100, or NO in S102, the process proceeds to S110. In S110, the CPU 60 stores the character read in S56 in the character string buffer. Next, the CPU 60 reads the next one character (S112). Subsequently, the CPU 60 determines whether or not the character read in S112 is the synchronization code 132 (see FIG. 6) (S114). If YES here, the process proceeds to S116. On the other hand, if NO in S114, the process proceeds to S74 in FIG.
In S116, the CPU 60 determines whether or not the synchronization value is “−1”. In the case of YES here, the CPU 60 stores the next four characters of the synchronization code 132 read in S112 (that is, the timing data 134 (see FIG. 6)) as a synchronization value (S118). On the other hand, if NO in S116, the CPU 60 skips the next four characters (that is, the timing data 134) of the synchronization code read in S112 (S120).
When S118 or S120 is executed, the CPU 60 executes the same processing as S62 or S104 described above (S122). That is, in S122, the CPU 60 writes the hyperlink data, the character string stored in the character string buffer, and the synchronization value in the display data storage area 72. When S122 ends, the process proceeds to S124.
In S124, the CPU 60 stores “−1” as the synchronization value, initializes the character string buffer, and stores “FALSE” as the synchronization flag. When S124 ends, the CPU 60 returns to S56 and reads the next one character.

  When the processing from S70 to S124 is executed for all characters (character data 130, synchronization code, timing data 134, etc.) included in the content text data 114, YES is determined in S58. As a result, the footer unit 220 (see FIG. 10) is written in the display data storage area 72 (S64), and the display data creation process ends.

When the display data creation process is completed, display data 148 (see FIG. 10) is stored in the display data storage area 72.
The display data 148 includes synchronized reproduction data 170 and 190 in addition to the header section 150 and the footer section 220 described above. The synchronized playback data 170 includes hyperlink data 172, timing attribute data 176, lyrics text data 178, and an end code 188. The hyperlink data 172 includes text data 174 of the title of the link destination.
The hyperlink data 172 is data that defines a hyperlink. The title text data 174 is a title that matches the title text data 156 of the header section 150. The timing attribute data 176 is the time from the beginning of the sound data 120 (see FIG. 5). Lyric text data 178 is a part of the lyrics included in the content text data 114. In the example of FIG. 10, synchronous reproduction data 170 created in units of sentences or paragraphs is shown. That is, the synchronous reproduction data 170 created when the character code corresponding to the sentence or paragraph is stored in the delimiter list in S50 of FIG. For this reason, the lyrics text data 178 includes a plurality of words 180 and 182. The end code 188 is a code that means that the description of one synchronized reproduction data 170 is ended.
Similar to the synchronized playback data 170, the synchronized playback data 190 includes hyperlink data 192, timing attribute data 196, lyrics text data 198, and an end code 208. The lyrics text data 198 includes a plurality of words 200, 202, and 204.

In the example of FIG. 10, synchronized playback data 170 and 190 are created in units of sentences or paragraphs. The synchronized playback data 170, 190 may be created in other units (syllable units, word units). FIG. 11 also includes synchronized playback data created in other units. In FIG. 11, synchronous reproduction data is indicated by reference numeral 170, hyperlink data is indicated by reference numeral 172, timing attribute data is indicated by reference numeral 176, and lyrics text data is indicated by reference numeral 178.
FIG. 11A shows an example of lyrics included in the content text data 114 (see FIG. 5). Squares in the figure mean spaces. There is a line break between “... Box.” And “I.
FIG. 11 (b) shows the lyrics of FIG. 11 (a) divided in syllable units. The parentheses in FIG. 11 (b) are inserted to delimit each syllable and are not included in the lyrics. One combination data 128 (see FIG. 6) described above is constituted by one syllable. Therefore, it can be said that FIG. 11B shows a plurality of combination data 128 (that is, content text data 114). Although not shown in FIG. 11B, each combination data 128 includes timing data (see reference numeral 134 in FIG. 6).
FIG. 11C shows a plurality of synchronous reproduction data 170 (that is, display data 148) created in syllable units from the content text data 114 of FIG. 11B. Each synchronous reproduction data 170 includes hyperlink data 172, timing attribute data 176, and lyrics text data 178. One synchronized reproduction data 170 is created from one combination data 128 of FIG. That is, the timing data 176 of each synchronized reproduction data 170 matches the timing data of each combination data 128. For example, the timing data 176 of the synchronized reproduction data 170 including “I” matches the timing data included in the combination data 128 including “I”.

  FIG. 11D shows a plurality of synchronized playback data 170 created in units of words from the content text data 114 of FIG. 11B. One synchronized reproduction data 170 may be created from one combination data 128, and one synchronized reproduction data 170 may be created from two or more combination data 128. In the former case, the timing data 176 of the synchronized reproduction data 170 matches the timing data of the combination data 128 corresponding thereto. For example, the timing data 176 of the synchronized reproduction data 170 including “I” matches the timing data included in the combination data 128 including “I”. On the other hand, in the latter case, the timing data 176 of the synchronized reproduction data 170 matches the timing data included in the first combination data 128 of the two or more combination data 128 corresponding thereto. For example, the timing data 176 of the synchronized reproduction data 170 including “have” matches the timing data included in the combination data 128 including “ha”.

FIG. 11E shows a plurality of synchronized playback data 170 created in units of sentences from the content text data 114 of FIG. 11B. When one synchronized reproduction data 170 is created from two or more combination data 128, the timing data 176 of the synchronized reproduction data 170 is the first combination data 128 in the two or more combination data 128 corresponding thereto. Matches the included timing data. For example, the timing data 176 of the synchronized reproduction data 170 including “I have a pen,” matches the timing data included in the combination data 128 including “I”.
FIG. 11 (f) shows a plurality of synchronous reproduction data 170 created in units of paragraphs from the content text data 114 of FIG. 11 (b).

As described above, the display data 148 created in the display data creation process is output to the playback device 56 in the process of S36 in FIG. How the display data 148 is used in the playback device 56 will be described later.
When the CPU 60 finishes the process of outputting the display data 148 (S36), it executes a print data creation process (S38) described below.

(Print data creation process)
Next, the contents of the print data creation process (S38) will be described. FIG. 12 shows a flowchart of print data creation processing. In this embodiment, the XHTML format is adopted as print data.
The CPU 60 executes print data creation processing based on the index update information (see FIG. 3) corresponding to the currently processed index number and the ID3 data 102 included in the audio data 100.
First, the CPU 60 stores the line feed code in the delimiter list (S130). The delimiter list is stored in the work area 76 (see FIG. 2) of the RAM 68. Subsequently, the CPU 60 executes the process of S132. In S132, the character string buffer is initialized, and the print data storage area 74 (see FIG. 2) is initialized. The character string buffer is a predetermined storage area in the work area 76 of the RAM 68.
The CPU 60 writes the header part in the print data storage area 74 (S134). FIG. 13 shows an example of the print data 230 that is finally created by the print data creation process. The portion indicated by reference numeral 232 in FIG. 13 is the header portion written in S134.

Subsequently, the CPU 60 reads one character included in the content text data 114 (see FIG. 6) (S136). In the first process of S136, the first character (the character 130a in FIG. 6) of the content text data 114 is read. In the process of S136 after the second time, the next character after the character read in the previous S136 is read.
The CPU 60 determines whether or not the character read in S136 means an end code (S138). If YES here, the CPU 60 writes the footer portion in the print data storage area 74 (S140). A portion indicated by reference numeral 240 in FIG. 13 is a footer portion. When the footer unit 240 is written, the print data creation process ends.

On the other hand, if NO in S138, the CPU 60 determines whether or not the character read in S136 is included in the delimiter list stored in S130 (S150). That is, the CPU 60 determines whether or not the character read in S136 is a line feed code.
If NO in S150, the CPU 60 determines whether or not the character read in S136 is the synchronization code 132 (see FIG. 6) (S152). If YES is selected, the next four characters of the synchronization code 132 read in S136 (that is, the timing data 134 (see FIG. 6)) are skipped (S156). On the other hand, if NO in S152, the CPU 60 stores the character read in S136 in the character string buffer (S154). When S154 or S156 ends, the CPU 60 returns to S136 and reads the next one character.

If YES in S150, the CPU 60 writes the character string stored in the character string buffer into the print data storage area 74 (S160). Next, the CPU 60 writes the <br/> tag in the print data storage area 74 (S162). The tags written in S162 are indicated by reference numerals 236 and 238 in FIG. This tag means a line break.
Subsequently, the CPU 60 initializes the character string buffer (S164). When S164 ends, the CPU 60 returns to S136 and reads the next one character.

  When the processing from S136 to S164 is executed for all characters (character data 130, synchronization code 132, timing data 134, etc.) included in the content text data 114, YES is determined in S138. As a result, the footer unit 240 (see FIG. 13) is written in the print data storage area 74 (S140), and the print data creation process ends.

When the print data creation process is completed, the print data 230 (see FIG. 13) is stored in the print data storage area 74.
The print data 230 includes a header part 232, lyrics text data 234, and a footer part 240. The text data 234 of the lyrics includes codes 236 and 238 that mean line breaks.

  As described above, the print data 230 created by the print data creation process is printed by the process of S40 of FIG. The CPU 60 instructs the printing apparatus 24 (see FIG. 1) to perform printing based on the printing data 230. The printing device 24 performs printing in accordance with the descriptions of the header portion 232, the lyrics text data 234, and the footer portion 240 of the printing data 230. The text data 234 of the lyrics is printed in a form in which line breaks are made at the line break tabs 236 and 238.

(Operation of audio playback device)
The configuration and processing of the multi-function device 20 have been described in detail. Next, how the display data 148 and the sound data 120 are used in the playback device 56 (see FIG. 1) will be described.
As described above, the display data 148 is output to the playback device 56 and stored in the playback device 56 in the process of S36 of FIG. The original content text data 114 (see FIG. 5) from which the display data 148 is created is also output to the playback device 56.

  The playback device 56 can display a title list of a plurality of tracks stored by itself. When one title is selected from a plurality of titles displayed on the display screen 56b by the user, the playback device 56 can execute a process of playing back the sound data 120 of the title from the beginning. The sound data 120 is reproduced by the sound data reproducing device 56a (see FIG. 1) of the reproducing device 56. The user can select the title displayed on the display screen 56b by operating the operation device 56c (see FIG. 1) of the playback device 56.

  When the sound data 120 is reproduced, the reproduction device 56 can display the lyrics on the display screen 56b based on the content text data 114 (see FIGS. 5 and 6). FIG. 14 shows an example of the display screen 56b on which lyrics are displayed. A title 252 and lyrics are displayed on the display screen 56b. The content text data 148 includes timing data 134 (see FIG. 6) corresponding to the reproduction time axis of the sound data 120. For this reason, the playback device 56 can indicate the position of the lyrics in synchronization with the playback of the sound data 120. For example, the playback device 56 can highlight and display a portion corresponding to the playback position of the sound data 120 (underline addition, inversion, marker addition). In the example of FIG. 14, an underline 250 is added. The underline 250 moves as the sound data 120 is reproduced.

The playback device 56 can also display lyrics on the display screen 56b based on the display data 148 (see FIG. 10). Note that the playback device 56 may display the lyrics of the display data 148 in synchronization with the playback of the sound data 120, or display the lyrics of the display data 148 asynchronously without playing the sound data 120. May be. Each of the synchronous reproduction data 170 and 190 of the display data 148 includes hyperlink data 172 and 192. The playback device 56 has a text browsing function corresponding to the hyperlink structure. When this text browsing function is used, the text (lyrics) can be displayed by interpreting the hyperlink structure included in the display data 148. FIG. 15 shows an example of a display screen 56b on which lyrics are displayed by the text browsing function.
When a part of the lyrics displayed on the display screen 56b is selected by the user, the reproducing device 56 can execute a process of reproducing the sound data 120 from the selected portion. In FIG. 15, a selection bar 260 displayed on the display screen 56b is shown. The user can select a part of the lyrics by moving the selection bar 260 displayed on the display screen 56b by operating the operation device 56c. The selection bar 260 moves in units (syllables, words, sentences, or paragraphs) in which the synchronized playback data 170 and the like are created.
The user can select a part of the lyrics displayed on the display screen 56b in a unit in which the synchronized reproduction data 170 and the like are created. For example, when the synchronized playback data 170 or the like is created in syllable units (in the case of FIG. 11C), the user can select one syllable from the lyrics displayed on the display screen 56b. . Further, for example, when the synchronized playback data 170 or the like is created in units of sentences (in the case of FIG. 11E), the user selects one sentence from the lyrics displayed on the display screen 56b. Can do. An example of this case is shown in FIG.

The multi-function device 20 of the present embodiment creates display data 148 (see FIG. 10) to which hyperlinks are added in units smaller than the track from the existing audio data 100 (see FIGS. 5 and 6). The multi-function device 20 can create display data 148 having a hyperlink that can jump to the sound data 120 without processing the sound data 120. Since there is no need to process the sound data 120, the display data 148 can be easily created.
The playback device 56 can display the lyrics based on the display data 148 to which the hyperlink is added. When a part of the lyrics displayed in synchronization (or asynchronously) with the reproduction of the sound data 120 is selected by the user, the reproduction device 56 can reproduce the sound data 120 from the selected portion. The user can easily reproduce the sound data 120 from a position in the middle of the track.

  The content text data 114 (see FIG. 6) is created in units of syllables. The multi-function device 20 can create display data 148 (see FIG. 10) from the content text data 114 in units of words, sentences, or paragraphs. In this case, the user can specify the playback position in the synchronization unit (word, sentence, or paragraph) intended by the user. This leads to improved usability by the user.

(Modification of Example)
The playback device 56 can display lyrics based on the display data 148 without the content text data 114. For this reason, the multi-function device 20 may not send the content text data 114 to the playback device 56. In this way, the amount of data that the playback device 56 should store can be compressed.

Specific examples of the present invention have been described in detail above, but these are merely examples and do not limit the scope of the claims. The technology described in the claims includes various modifications and changes of the specific examples illustrated above.
The multi-function device 20 may send the sound data 120 and the display data 148 to the PC 58 (see FIG. 1). In this case, the PC 58 can reproduce the sound data 120 and display lyrics in synchronization (or asynchronously) with the reproduction. The multi-function device 20 may have a function of reproducing the sound data 120. In this case, the multi-function device 20 may display the lyrics on the display device 32 (see FIG. 1) in synchronization (or asynchronously) with the reproduction of the sound data 120.
Further, the technical elements described in the present specification or drawings exhibit technical usefulness alone or in various combinations, and are not limited to the combinations described in the claims at the time of filing. In addition, the technology illustrated in the present specification or the drawings achieves a plurality of objects at the same time, and has technical utility by achieving one of the objects.

1 shows a schematic diagram of a multi-function device system. The block diagram of the control apparatus of a multi-function machine is shown. An example of a content update information table is shown. The flowchart of a content update process is shown. An example of the data structure of audio data is shown. An example of a data structure of content text data is shown. The flowchart of a content update process is shown. The flowchart of the display data creation process is shown. FIG. 9 shows a flowchart of display data creation processing (continuation of FIG. 8). An example of the data structure of the display data is shown. (A) An example of lyrics is shown. (B) A state in which lyrics are divided in syllable units. (C) Synchronous reproduction data created in syllable units. (D) Synchronous reproduction data created in units of words. (E) Synchronous reproduction data created in sentence units. (F) Synchronized playback data created in units of paragraphs. 6 shows a flowchart of print data creation processing. An example of the data structure of the data for printing is shown. An example of the lyrics displayed on the display screen is shown. The display screen on which the selection bar is displayed is shown.

Explanation of symbols

10: Multi-function device system 20: Multi-function device 28: Control device 52: Internet 54: Server 56: Portable audio playback device 100: Audio data 102: ID3 data 114: Content text data 120: Sound data 128: Combination data 130: Character data 132: Sync code 134: Timing data 150: Header part 170, 190: Synchronized playback data 172, 192: Hyperlink data 176, 196: Timing attribute data 178, 198: Text data of lyrics 220: Footer part

Claims (10)

A content data processing apparatus that is used by being connected to an external device,
An input device for inputting content data output from an external device, and a data generation device for generating other data from content data input to the input device;
The content data includes sound data and / or video data of at least one track, and first display data of the track,
The first display data of the track includes a plurality of first timing data corresponding to a reproduction time axis of the sound data and / or video data of the track, a portion of the sound data corresponding to the first timing data, and / Or text data related to the contents of video data,
The data creation device creates second display data from the first display data of the track,
The second display data includes a plurality of second timing data corresponding to the reproduction time axis of the track sound data and / or video data, a portion of the sound data corresponding to the second timing data, and / or A content data processing apparatus, wherein text data relating to the content of video data is associated with a hyperlink structure.   The data creation device creates the second display data so that the total number of second timing data included in the second display data is smaller than the total number of first timing data included in the first display data of the track. The content data processing apparatus according to claim 1, wherein: Each of the plurality of first timing data included in the first display data of the track is set in units of syllables,
3. The content data processing apparatus according to claim 2, wherein the data creation device sets each of the plurality of second timing data included in the second display data in units of words or more. A storage device for storing second display data;
The first display data includes first timing data including numerical values along the reproduction time axis of the sound data and / or video data of the track, and sound data and / or video data of a portion corresponding to the first timing data. It consists of multiple combination data that is associated with text data related to the contents of
The data creation device reads a plurality of combination data included in the first display data, and for each combination data, hyperlinks the numerical value included in the first timing data of the combination data and the text data of the combination data. 2. The content data processing apparatus according to claim 1, wherein data associated with the structure is written in the storage device. A storage device for storing second display data;
The first display data includes first timing data including numerical values along the reproduction time axis of the sound data and / or video data of the track, and sound data and / or video data of a portion corresponding to the first timing data. It consists of multiple combination data that is associated with text data related to the contents of
The plurality of combination data are arranged in the order of numerical values included in the first timing data of each combination data,
The data creation device sequentially reads a plurality of combination data included in the first display data, and at least two consecutive combination data are included in the first timing data of the first combination data in the combination data. 2. The content data processing apparatus according to claim 1, wherein data in which numerical values and text data of their combination data are associated with each other by a hyperlink structure is written in the storage device. The content data processing device according to any one of claims 1 to 5, wherein the content data processing device is used by being connected to the external device and being connected to a content reproduction device having a display screen.
A content data processing apparatus, further comprising: an output device that outputs the sound data and / or video data of the track and the second display data created by the data creation device to a content playback device.   7. The content data processing apparatus according to claim 6, wherein the output device does not output the first display data of the track to the content reproduction device. A content data processing apparatus that is used by being connected to an external device,
An input device for inputting content data output from an external device, and a data generation device for generating other data from content data input to the input device;
The content data includes sound data and / or video data of at least one track, and content text data regarding the contents of the sound data and / or video data of the track,
The content text data of the track can be displayed on the content data processing device and / or another content playback device in synchronization with the playback of the sound data and / or video data of the track,
The data creation device creates linked content text data in which a hyperlink structure is added to each of a plurality of small text data included in the track content text data. A method of processing content data by a data processing device connected to an external device and used.
An input process for inputting content data output from an external device, and a data creation process for creating another data from the content data input in the input process,
The content data includes sound data and / or video data of at least one track, and first display data of the track,
The first display data of the track includes a plurality of first timing data corresponding to a reproduction time axis of the sound data and / or video data of the track, a portion of the sound data corresponding to the first timing data, and / Or text data related to the contents of video data,
In the data creation step, second display data is created from the first display data of the track,
The second display data includes a plurality of second timing data corresponding to the reproduction time axis of the track sound data and / or video data, a portion of the sound data corresponding to the second timing data, and / or A content data processing method, wherein text data relating to the contents of video data is associated with a hyperlink structure. It is a program executed by a computer mounted on a data processing device that is used by being connected to an external device,
The program causes the computer to execute a data creation process for creating another data from content data output from an external device and input to a data processing device.
The content data includes sound data and / or video data of at least one track, and first display data of the track,
The first display data of the track includes a plurality of first timing data corresponding to a reproduction time axis of the sound data and / or video data of the track, a portion of the sound data corresponding to the first timing data, and / Or text data related to the contents of video data,
In the data creation process, second display data is created from the first display data of the track,
The second display data includes a plurality of second timing data corresponding to the reproduction time axis of the track sound data and / or video data, a portion of the sound data corresponding to the second timing data, and / or A content data processing program characterized in that text data relating to the contents of video data is associated with a hyperlink structure.

Images