JP2009225354A - Slide reproducer, slide reproduction system, and slide reproduction program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a slide reproducer, a slide reproduction system and a slide reproduction program, can make it possible to view image information and audio information of one slide in a fixed period of time regardless of the length of the audio information of each slide. <P>SOLUTION: There are provided a reproducing means (5) for reproducing a slide to be reproduced using a visible display of the image information of the slide and an audible display of the audio information corresponding to the image information of the slide, a calculating means (4) for calculating a skip width based on the length of the audio information and a predetermined number of skips, and a control means (4) for determining a reproduction point of the destination of the skip based on the calculation result of the calculating means in response to a skip instruction and controlling the reproduction point of the audio information by the reproducing means based on the determined reproduction point. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a slide reproduction technique for reproducing a slide used in a presentation at a conference or the like together with sound. More specifically, the present invention relates to a slide playback device, a slide playback system, and a slide playback program that play back a slide image captured at a meeting or the like and a sound captured simultaneously.

  By capturing slide images used in presentations at meetings, etc., and capturing the audio in the conference room when the slide image was displayed on the screen, the slide image and corresponding sound are later played back as a slide playback device. Can be viewed. By doing so, it becomes possible to view a presentation at a meeting or the like that could not be attended later. If there is not enough time for viewing, it is possible to view while appropriately skipping the playback position.

  Conventionally, as a reproduction technique of this type, the sound reproduction apparatus according to the first conventional technique reproduces sound by fast-forwarding or rewinding for a predetermined time (for example, 30 seconds). In addition, the voice to be heard is found by automatically repeating fast forward or rewind and subsequent playback. Since the skip time can be changed by the user, the user can view the audio while skipping the voice within the user's preferred time width (see Patent Document 1). When viewing while skipping the audio associated with the slide, it is effective to skip and reproduce at regular intervals.

  In the second prior art, there is a reproduction method in which the jump amount of the address is determined by the time of pressing the operation button corresponding to the fast forward / reverse function when reproducing recorded video or audio data (patent) Reference 2).

  Further, in the video recording / reproducing apparatus as the third prior art, the video reproduction time is divided into 10 equal parts, and the head of each time is assigned to the keys of 10 remote controllers. By pressing a key, a corresponding time zone video can be viewed (see Patent Document 3).

JP 09-147534 A Japanese Patent Laid-Open No. 08-051589 JP 2005-303871 A

  However, in the first prior art, when applied to a playback apparatus that plays back audio information corresponding to slide image information, the number of skips within one slide differs depending on the length of the audio information. Time to watch one slide is different. I want the same skimming time for a single slide, whether it is short or long. Also, if one slide is less than a preset skip amount, it will not be played back.

  In the second prior art, since the skip amount is not clear to the user, it is difficult to understand how much to skip, and it takes time to jump to a specific position.

  In the third prior art, regardless of the length of the video, the 10 divided positions can be randomly accessed, but 10 keys need to be prepared. Further, for example, when playback is performed from the position 3 and playback is performed up to the position 4 and subsequent times, if the key 4 is pressed, playback is performed from the position 4 again. .

  The present invention has been made in view of the above problems, and its purpose is to view a piece of slide image information and audio information at a certain time regardless of the length of audio information corresponding to each slide image information. An object of the present invention is to provide a slide playback device, a slide playback system, and a slide playback program.

  In order to solve the above problems, in the slide playback device according to the first embodiment of the present invention, playback is performed by visual display of slide image information to be played back and audible display of audio information corresponding to the slide image information. Reproduction means for performing, calculation means for calculating a skip width based on the length of the audio information and a predetermined number of skips, and a skip destination reproduction position based on the calculation result of the calculation means in response to a skip instruction And control means for controlling the reproduction position of the audio information by the reproduction means based on the determined reproduction position. Accordingly, it is possible to view one piece of slide image information and audio information in a certain time regardless of the length of the audio information of each slide image information.

  In the image recording apparatus according to the second embodiment of the present invention, in contrast to the first embodiment, the control means sets a fixed playback position determined by the skip width and the number of skips as a skip playback position, and skips the skip. Control is performed to skip the time between the playback position at the time of the instruction and the next skip playback position. Thereby, skipping and reproduction can be performed with a simple configuration.

  In the image recording apparatus according to the third embodiment of the present invention, in contrast to the first embodiment, the control means adds an essential reproduction position and controls it in a fixed manner. This makes it possible to easily and quickly reproduce important parts in the presentation.

  In the image recording apparatus according to the fourth embodiment of the present invention, the control means controls the first embodiment by adding an essential reproduction position based on the volume of the audio information. is there. This makes it possible to reproduce important points in the presentation in a proper manner.

  In the image recording apparatus according to the fifth embodiment of the present invention, as compared with the first embodiment, the calculation means calculates the skip width based on the total length of a plurality of audio information. Thereby, slide image information and audio information over a plurality of sheets can be easily and quickly reproduced.

  In the image recording apparatus according to the sixth embodiment of the present invention, in contrast to the first embodiment, when the skip instruction is continued for a plurality of skip widths, a playback period in which playback is performed for a predetermined time during the skip width. Is provided to control to skip and reproduce. Thereby, it can reproduce | regenerate easily and rapidly by simple operation.

  In the image recording apparatus according to the seventh embodiment of the present invention, the calculation means calculates the skip width changed based on the number of characters in the slide image information in the first embodiment. This makes it possible to easily and quickly reproduce slide image information and audio information that have a large number of characters and require time for browsing.

  In the image recording / reproducing apparatus according to the eighth embodiment of the present invention, the calculation means calculates the skip width changed based on the number of characters of a specific color in the slide image information, as compared with the first embodiment. Is. This makes it possible to easily and quickly reproduce slide image information and audio information emphasized with a predetermined color indicating that an important sentence or keyword is included.

  In the image recording / reproducing apparatus according to the ninth embodiment of the present invention, the control means adds an essential reproduction position to the slide according to the first embodiment on the basis of position instruction information with respect to the slide indicated by the slide image. The control which performs is performed. Thereby, slide image information and audio | voice information can be reproduced | regenerated easily and rapidly according to description amount.

  In the image recording / reproducing system according to the tenth embodiment of the present invention, in contrast to the first embodiment, the reproducing means displays at least one of the slide image information and the reduced image information corresponding to the slide image information. The past reproduction period of the audio information corresponding to the reduced image information is displayed on the time axis at a position adjacent to. Accordingly, it is possible to reduce the burden on the user because it serves as a mark when listening to what has been heard once again, avoiding overlapping viewing.

  In the slide reproduction system according to the eleventh embodiment of the present invention, a storage means for storing slide image information to be reproduced and a set of audio information corresponding to the slide image, and slide image information and audio to be reproduced from the storage means. Read means for reading information, reproduction means for reproducing by means of visible display of slide image information to be reproduced read by the read means, and audible display of audio information corresponding to the slide image information, and the audio information Calculating means for calculating a skip width based on the length of the image and a predetermined number of skips, and determining a playback position to be skipped based on the calculation result of the calculating means in response to the skip instruction, and based on the determined playback position Control means for controlling the reproduction position of the audio information by the reproduction means. Accordingly, it is possible to view one piece of slide image information and audio information in a certain time regardless of the length of the audio information of each slide image information captured and recorded.

  In the slide reproduction program according to the twelfth embodiment of the present invention, the first step is performed by the reproduction means by visible display of slide image information to be reproduced and audible display of audio information corresponding to the slide image information. A second step in which the calculation means calculates a skip width based on the length of the audio information and a predetermined number of skips, and a control means responds to the skip instruction and skips based on the calculation result of the calculation means And a third step of controlling the playback position of the audio information by the playback means based on the determined playback position. Accordingly, it is possible to view one piece of slide image information and audio information in a certain time regardless of the length of the audio information of each slide image information.

  According to the present invention, it is possible to view one piece of slide image information and audio information in a certain time regardless of the length of the audio information of each slide image information.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, exemplary embodiments of the invention will be described with reference to the drawings.

  FIG. 1 is a block diagram illustrating a hardware configuration example of a slide playback apparatus according to an embodiment of the present invention. The slide playback apparatus 100 includes an input device 51, a display device 52, a main storage device 53, a storage device 54, a central processing unit (CPU) 55, a communication control device 56 that communicates with an external device via a network, and connects these. And an information processing apparatus such as a PC (personal computer) including the bus 57.

An input device 51 cooperates with a display device 52 together with a keyboard on which a user inputs execution instruction (command) information and various information for instructing execution of an application program (software) by key operation, and this keyboard. A position indicating device such as a mouse constituting the interface may be included, and an optical reading device (scanner) that optically reads a document or the like written on a document may be included.

  The display device 52 includes a visual display device that displays a target document such as a presentation material on a display screen, and an audible display device that includes an audible display device that displays information such as audio information corresponding to a slide image. A permanent visible display device that displays information permanently on the sheet-like medium may also be included. Permanent visible display is equivalent to printing as a record, and is a high-level term indicating the display concept, and the display period only needs to be displayed on the recording medium within a period corresponding to the type of recording to be used. There is no point in limiting the period to a specific period.

  The main storage device 53 includes a ROM or a RAM, and stores a program for performing slide reproduction processing, data calculated by the CPU 55, and the like in a work area. More preferably, an image buffer for displaying an image on display device 52 is included. The storage device 54 includes a large-capacity storage device such as a hard disk device, for example, and may store a large amount of data collected via a network or the like.

A CPU (Central Processing Unit) 55 controls each unit according to a program stored in the main storage device 53.

The communication control device 56 includes a communication interface that connects to external devices via a network such as the Internet and inputs / outputs data (information) to / from them.

As described above, the slide playback apparatus 100 is realized by being configured with one or more information processing apparatuses in the basic configuration, but the client apparatus and the server apparatus are connected via a network using a plurality of information processing apparatuses. It may be realized by a client-server model configured as described above.

  FIG. 2 is a block diagram illustrating a functional configuration of the slide device according to the first embodiment. The slide playback device 110 includes a data storage unit 1, a data reading unit 2, an instruction receiving unit 3, a data control unit 4, and a data playback unit 5.

  In FIG. 2, the data storage unit 1 stores a plurality of sets of captured slide image information and audio information. The slide image information is an image displayed at the time of presentation, and the audio information paired with the image is an audio file recorded when the image is displayed. Therefore, the presentation can be reproduced by displaying the image and reproducing the audio information as a set.

In order to represent a set, for example, it is conceivable that the same set of slide image information and audio information have the same file name. For example, if the file name is 001 in common, the extension of the slide image information is jpg corresponding to the type, and similarly the extension of the audio information is mp3, the set is (001.jpg, 001.mp3) Can be expressed as In order to determine the playback order of each set, it may be possible to prepare a list in which file names are listed. Here, it is assumed that numbers are simply given to the file names and the order of the numbers is the playback order.
(001.jpg, 001.mp3), (002.jpg, 002.mp3), (003.jpg, 003.mp3), ... (123.jpg, 123.mp3), ...

  The data reading unit 2 reads slide image information and audio information in accordance with an instruction from the data control unit 4, and passes the read information to the data control unit 4.

  The instruction receiving unit 3 has an interface for receiving instructions from the user. Specifically, as will be described later, like a playback browser, it has a front slide button, a next slide button, a slider and a knob, a playback button, a stop button, a progress skip button, a backward skip button, a thumbnail display area, and the like. These interfaces may be configured as a GUI (graphic user interface) displayed on a display (for example, the display device 52), or may use actual buttons or sliders. The instruction receiving unit 3 receives instructions from the user through these interfaces, and passes the contents to the data control unit 4.

  The data control unit 4 instructs the data reading unit 2 to read slide image information and audio information and commands the data reproduction unit 5 to perform reproduction processing in accordance with a command from the instruction receiving unit 3.

  The data reproduction unit 5 receives an instruction from the data control unit 4 and performs reproduction by displaying the slide image information visually and reproduction by displaying the slide image information audibly. Specifically, like a playback browser described later, an image for which playback is instructed is displayed in the slide display area, and similarly, the audio for which playback has been instructed is played back using a speaker or the like included in the data playback unit 5. I do.

  FIG. 3 shows, as an example, a playback browser (also referred to as a slide viewer) that is displayed on the display screen of the display device and realized by a GUI. The reproduction browser 10 has a slide display area 10a for displaying slide images to be reproduced on the upper side and a thumbnail display area 12a for displaying thumbnails of a plurality of slide images on the lower side of this area.

  On the left and right of the slide display area 10a, a previous slide button 10b for instructing display of a slide image before the currently displayed slide image and a next slide button 10c for instructing display of the subsequent slide image are provided. .

  Immediately below the slide display area 10a, the rider 11a that displays the playback position on the time axis of the audio information corresponding to the slide image currently displayed in the slide display area 10a, and the current playback position are shown. A knob 11b for instructing this is provided. Further, a group of buttons 11c to 11f for giving instructions relating to the reproduction of audio information are included immediately below the slider 11a. Among these buttons, a reproduction button 11e for instructing reproduction and skip in the fast-forward direction are provided from the center to the right. An advance skip button 11f for instructing, a stop button 11d for instructing to stop reproduction of audio information, and a backward skip button 11c for instructing skip in the rewind direction are provided on the right side.

  In the thumbnail display area 12a, a plurality of thumbnail images 12b can be displayed (in the figure, four images can be displayed). Immediately below that, a scroll bar 12c for selecting a thumbnail to be displayed in the slide display area 10a among the thumbnail images 12b, a button 10e for sending in the forward direction, and a button 10d for sending in the backward direction are included. A thumbnail is selected by an instruction operation such as a scroll bar 12c, buttons 12e, 12d or a thumbnail click. As a result, the slide image corresponding to the thumbnail is selected and displayed in the slide display area 10a, and the corresponding audio information can be reproduced. In the present specification, the thumbnail image is also referred to as a reduced image.

  4 is an overall flow of the reproduction process, FIG. 5 is an initialization process flow, FIG. 6 is a reproduction control process flow, and FIG. 7 is a skip instruction process flow. The overall operation of the reproduction process will be described with reference to these flows in sequence.

  First, after performing the initialization process, the reproduction control process is performed (steps S1 and S2). As a routine for this initialization process, first, the data control unit 4 instructs the data reading unit 2 to acquire the first slide image information and audio information. Here, 001.jpg and 001.mp3 are the first slide image information and audio information.

  The data reading unit 2 reads 001.jpg and 001.mp3 from the data storage unit 1 and passes them to the data control unit 4. The data control unit 4 stores the received file name as the current file name, and passes slide image information and audio information to the data reproduction unit 5. The data reproduction unit 5 receives slide image information and audio information, and displays the slide image information in the slide display area 10a. Audio information is stored in a buffer, and 0 is set as a playback point (steps S11 and S12).

In addition, the data control unit 4 instructs the data reading unit 2 to acquire all the remaining slide image information. As a result, the data control unit 4 generates thumbnails for all the slide image information received from the data storage unit 1 via the data reading unit 2, and stores all thumbnails in the thumbnail display area 12 a via the data reproduction unit 5. Slide image information is displayed as thumbnails (also called thumbnail images) (steps S13 and S14).
The above is the initialization operation. When the initialization operation is completed, the playback control processing routine is executed. The user waits for a finger and determines whether there is a reproduction-related instruction (step S21). When there is an instruction related to reproduction, processing according to the instruction is performed. Each type of instruction will be described below.

  When the playback button 11e is pressed, a playback instruction is issued and the following processing is performed (step S22).

  The instruction receiving unit 3 notifies the data control unit 4 that the play button 11e has been pressed. The data control unit 4 instructs the data reproduction unit 5 to reproduce the audio information. The data reproduction unit 5 reproduces the audio information stored in the buffer from the reproduction point. When the reproduction is started, the position where the reproduction is performed is sequentially stored as a reproduction point. The position of the knob 11a on the slider 11a reflects the playback point.

  When the stop button 11d is pressed, a stop instruction is issued and the following processing is performed (step S22).

  The instruction receiving unit 3 notifies the data control 4 that the stop button 11d has been pressed. The data control unit 4 instructs the data reproduction unit 5 to stop the reproduction of audio information. In response to the stop instruction, the data reproduction unit 5 stops the reproduction of the audio information. The stop position at this time becomes the playback point.

When the next slide button 10c is pressed, the next slide instruction is issued, and the following processing is performed (step S23).
When the next slide button 10c is pressed, the instruction receiving unit 3 notifies the data control unit 4 of the next slide instruction. The data control unit 4 requests the data reading unit 2 for a file next to the current file name. If the current file name is 001, the audio information corresponding to the slide image information having 002 as the file name is requested. The data reading unit 2 reads the corresponding slide image information and audio information from the data storage unit 1 and passes them to the data control unit 4. However, if the corresponding file does not exist, the data control unit 4 is notified that the file does not exist. The data control unit 4 stores the file name received from the data reading unit 2 as the current file name, and passes slide image information and audio information to the data reproduction unit 5. The data reproduction unit 5 receives slide image information and audio information, and displays the slide image information in the slide display area 10a. Audio information is stored in a buffer and 0 is set as a playback point. If the file does not exist, do nothing.

  When the front slide button 10b is pressed, a front slide instruction is issued and the following processing is performed (step S23).

The data control unit 4 requests the data reading unit 2 for file data before the current file name, receives the corresponding file from the data storage unit 1 via the data reading unit 2,
Similar to the next slide instruction, the data reproducing unit 5 is controlled by the received file.

  When a thumbnail displayed in the thumbnail display area 12a is selected by an operation instruction such as a scroll bar 12c, buttons 12e, 12d or a thumbnail click, the thumbnail instruction is given and the following processing is performed (step S24).

  The instruction receiving unit 3 notifies the data control unit 4 that a thumbnail has been selected. At this time, the file name corresponding to the thumbnail is also notified. For example, 012. The data control unit 4 requests the data reading unit 2 for slide image information and audio information of the received file name. The data reading unit 2 reads the corresponding slide image information and audio information from the data storage unit 1 and passes them to the data control unit 4. The data control unit 4 stores the received file name as the current file name, and passes slide image information and audio information to the data reproduction unit 5. The data reproduction unit 5 receives slide image information and audio information, and displays the slide image information in the slide display area 10a. Audio information is stored in a buffer and 0 is set as a playback point.

  When the progress / reverse skip buttons 11f and 11c are pressed, an advance / reverse skip instruction is issued, and the following processing is performed (step S25).

  Playback is performed by moving the playback point forward / back by a predetermined time (skip width). Since the method of determining the skip width is the central part of the present invention, the skip instruction processing routine will be described in detail below.

  In the skip instruction process, first, pre-processing is performed, and then viewing-time processing is performed (steps S26 and S27). In the skip instruction process, the control process of the data control unit 4 is performed, and the data reproduction unit 5 performs the actual skip and reproduction process operation according to the control instruction. As will be understood from the description below, this pre-processing corresponds to calculation means, and the viewing-time processing corresponds to control means for performing control corresponding to the skip instruction.

  Next, as a specific skip instruction process, first, skip is a process of skimming audio information corresponding to one slide image with a predetermined number of skips or less regardless of the length of audio information corresponding to the slide image. Method 1 will be described. Hereinafter, for convenience, the aspect of the skip instruction processing is referred to as a skip method in this specification, but can be understood from both sides of the invention of the product and the invention of the method. Further, the skip instruction processing portion is expressed as a procedure such as a flowchart for the sake of convenience in the following, but it can also be functionally regarded as an object.

  FIG. 8 is an explanatory diagram showing skip / reproduction in time series by a process of skimming audio information corresponding to one slide image with a predetermined number of skips or less, FIG. 9 is a flow of preprocessing, and FIG. 10 is a process of viewing processing. It is a flow.

First, as preprocessing, the length l of the audio file is acquired, and the skip width a is obtained (steps S31 and S32). When there is a predetermined skip number s (> 0) and the length l of the audio information corresponding to the displayed slide, the skip width a is
a = 1 / (s + α)
Calculate by the following formula. Here, α = 0. For example, when l = 10 minutes and s = 5, a = 2 minutes.

  Next, when the skip buttons 11f and 11c are pressed as viewing processing, first, after determining whether the instruction direction is the rewind direction or the fast forward direction, the skip destination position x is obtained (steps S33, S34a, S34b). ). Assuming that the current playback position is c, in the fast forward direction, x = c + a, and in the rewind direction, x = c−a.

  Next, in the fast forward direction, x = 1 is set if x> l, and in the rewind direction, x = 0 is set if x <0 (steps S35a, S35b, S36). Then, reproduction is started from the obtained position x. In the above, x = 1 is not necessarily exactly 1 but may be several seconds before.

  As shown in FIG. 8, each time the skip buttons 11f and 11c are pressed, the playback point is advanced by two. After proceeding, normal playback is performed. When the skip buttons 11f and 11c are further pressed, the playback position is advanced by 2 minutes. By doing so, one slide can be skimmed with up to five skips regardless of the length of the audio information regardless of the length of the audio information, so that it can be skimmed with good rhythm regardless of the length of the audio information. Since it is actually played after skipping, the number of skips is less than S times.

  When skipping to the end, the next image is displayed and the sound is reproduced from the beginning. At this time, a new skip width a is newly calculated.

  Since the skip is simply performed by pressing the buttons 11f and 11c, it can be operated more easily than moving the slider bar 11a with the knob 11b and determining the playback point. Move to the next or previous page using the skip buttons 11f and 11c.

  The skip method 2 in the case where the playback point is fixed in the above-described skip method 1 will be described. FIG. 11 is an explanatory diagram showing a time series of skip and playback when the playback point is fixed, and FIG. 12 is a flow of processing during viewing.

  As described above, the skip width a is obtained as preprocessing, and the position of a * n (= 0, 1, 2,...) Is fixed as the reproduction start point. In the flowchart, n is i.

  Next, when the skip buttons 11f and 11c are pressed as viewing processing, first, after determining whether the instruction direction is the rewind direction or the fast forward direction, the skip destination position x is obtained (steps S41, S42a, S42b). ). In the fast forward direction, ai satisfying c <ai and i being the smallest is set as the next reproduction position with respect to the current reproduction position c (step S42b). In the rewind direction, ai satisfying c> ai and i being the largest is set as the next reproduction position with respect to the current reproduction position c (step S42a). Playback is started from the next set playback position (ai) (step S43).

As shown in FIG. 11, each time the skip buttons 11f and 11c are pressed, the position of a * n (= 0, 1, 2,...), For example, 0 minutes, 2 minutes, 4 minutes. . . Play from the position.
Here, for example, if playback is started from the 2 minute position and the skip button 11f is pressed during normal playback up to 5 minutes, the current playback time is not moved to the 4 minute position. Skip to the next point, 6 minutes, and start playback.

The function is similar to the function of skipping to the next chapter in a normal DVD playback device or the like, except that the segmentation corresponding to the chapter is automatically determined depending on the length of the audio file.
This is similar to the technique disclosed in Japanese Patent Application Laid-Open No. 2005-303871 described in the background section, except that only one button is required and reproduction is possible without duplication.

  Next, a description will be given of the skip method 3 in the case where a reproduction position that is fixed in advance is further added in the skip method 1 or the skip method 2 regardless of the length of the audio file. FIG. 15 is a viewing-time processing flow in this case. In this specification, the fixed reproduction position is also referred to as an essential reproduction position.

  In the case of a presentation, the first part is the first part and the last part, because the slide outline is spoken at the beginning, the summary is spoken at the end of the slide, and the introduction is moved to the next slide. To be included.

  For example, as the fixed playback point added to the example of the skip method 1, the beginning of the file (0 seconds), the end of the file (file length 1-β seconds (for example, 5 seconds)), the center of the file (fill length) By adding (l / 2 seconds) as a fixed playback position, it is possible to skip the file so that it always includes the beginning, middle and end of the file. FIG. 13 shows time-series skip / reproduction when the three reproduction points are added as a case where a reproduction position fixed in advance is added.

  FIG. 15 is a processing flow at the time of viewing when a reproduction position fixed in advance by the skip method 2 is added. Similarly to the skip method 2 described above, when the skip buttons 11f and 11c are pressed as viewing processing, first, after determining whether the instruction direction is the rewind direction or the fast forward direction, the skip destination position x is obtained ( Steps S45, S46a, S46b). In the fast-forwarding direction, ai satisfying c <ai and i being the smallest is set as the next reproduction position with respect to the current reproduction position c (step S46b). In the rewind direction, ai satisfying c> ai and i having the largest value is set as the next reproduction position with respect to the current reproduction position c (step S46a). Further, the next fixed reproduction position fi is searched. That is, in the fast-forward direction, the one with the largest i and fi satisfying c> fi is set as the next fixed reproduction position fi (step S47b). In the rewinding direction, fi satisfying c <fi and i being the smallest is set as the next fixed reproduction position fi (step S47a). Next, in the fast forward direction, the obtained ai and fi are compared, and the larger one is set as the reproduction point p (step S48b). In the rewind direction, the obtained ai and fi are compared, and the smaller one is set as the reproduction point p (step S48a). Playback is started from the set p (step S49).

  Next, the skip method 4 in the case of fixing an arbitrary reproduction point in the skip method 3 will be described. That is, a case where a specific reproduction position is added regardless of the length of the audio file in the skip method 1 or 2 will be described.

  For example, as a specific position, an audio file is analyzed in advance, a certain volume is set as a threshold value, and if there is a part where the volume is equal to or higher than the threshold value, the head position of that part is added as a fixed playback point. FIG. 14 shows a time series of skip / playback in that case. In this case, the process such as the viewing time process can be processed in the same manner as the flow of FIG.

  Next, the skip method 5 in the case of skipping over a plurality of continuous slide audio files by the above-described skip method will be described. The skip methods 1 to 4 are used to skip over a plurality of audio files. The slide image information is also switched corresponding to the audio file.

  FIG. 16 is an explanatory view showing skip / reproduction in time series when skipping over a plurality of continuous slide image information audio files, FIG. 18 is a flow of preprocessing, and FIG. 19 is a flow of viewing processing.

First, as pre-processing, when there is audio information associated with a plurality of slide image information collected as a group such as one presentation, the sum L of reproduction times for all audio files is obtained, and a predetermined skip is performed. When the number is S, the skip width A is obtained by the following equation (steps S50 to S52).
A = L / (S + α)
Here, α = 0. For example, if there are four audio files 1 to 4, L = 60 minutes when 10 minutes, 30 minutes, 5 minutes, and 15 minutes, respectively, and A = 12 minutes when S = 5.

  Next, when the skip buttons 11f and 11c are pressed as viewing processing, first, after determining whether the instruction direction is the rewind direction or the fast forward direction, the skip destination position, that is, the playback position x after skipping, is determined. Obtained (steps S33, S34a, S34b). Assuming that the current playback position is c, x = c + A in the fast forward direction, and x = c−A in the rewind direction.

  Next, the relationship with the length l of the audio information of the current file is determined, and the skip destination position x is determined (steps S55a and S55b). In the fast forward direction, if x> l, the playback point is moved to the first position in the next file, and further advanced by xl. Further, if x> l, move to the next file. Otherwise, the position is set as the reproduction position x. When the rewind direction is x <0, the playback point is moved to the last position in the previous file, and is further rewound by a minus amount. If the file does not become negative, that position is set as the playback point x after skipping. If it is negative, the playback point is moved to the previous file. Then, reproduction is started from the obtained position x (step S55).

  The example shown in FIG. 16 is an example in the case where playback points similar to those in the skip method 2 are fixed. As in the skip method 1, the skip width S may be moved from the actual reproduction position. Also, as in skip method 3, any playback point may be fixed. For example, the beginning, middle, and end of each file.

  Next, the operation of the skip method 6 when the skip button is pressed for a long time will be described.

  When the skip buttons 11f and 11c are pressed for a long time in the skip operation (press state), the skip is repeated during that time. At this time, reproduction is performed during skipping only during a predetermined long-press reproduction time B. For example, when the skip width a is 2 minutes and B is 2 seconds, an example of skip long press is shown in FIG. That is, when the skip instruction by the skip operation continues for more than a plurality of skip widths (strictly, when the time for a period corresponding to the plurality of skip widths and the time including the long press playback time B between them continues) This process is performed.

  Next, a skip method 7 for changing the number of skips depending on the number of characters as the content of the slide image information will be described.

  FIG. 20 shows a flow of preprocessing when the skip number is changed depending on the number of characters in the skip method 1, and FIG.

  A character string is extracted from the slide image, and the number of skips is increased or decreased according to the number of characters. If the number of characters is small, for example, it may be a cover, etc., and the content of the conversation is not so important, so the number of skips is reduced. Since you want to look through, you can increase the display time per sheet by increasing the number of skips. In order to extract characters from a slide image, a character string can be extracted by using an optical character reader (hereinafter also referred to as OCR).

  As preprocessing, first, the length l of the audio file is acquired and the number of characters T in the slide image is acquired as in the skip method 1 (steps S60 and S61). Next, as described below, α and skip width a are obtained (steps S62 and S63).

When there is a predetermined skip number s (> 0) and the audio length l corresponding to the displayed slide, the skip width a is set to
a = 1 / (s + α)
Calculate by the following formula. Where α = integer value (number of displayed slide characters T / constant P)
And For example, if the constant P is fixed to 100, when the number of characters matches 350, it becomes 3.5, and the positive value is taken to add 3 to the skip number.

  Next, as skip processing, when the skip buttons 11f and 11c are pressed in the viewing time process, first, after determining whether the instruction direction is the rewind direction or the fast forward direction, the skip destination position x is obtained. (Steps S64, S65a, S65b). Assuming that the current playback position is c, x = c + a in the fast forward direction and x = c−a in the rewind direction.

  Next, in the fast forward direction, x = 1 is set if x> l, and in the rewind direction, x = 0 is set if x <0 (steps S66a and S66b). Then, reproduction is started from the obtained position x (step S67).

  By doing this, the skip details can be adjusted based on the number of characters in the slide, and the number of skips can be increased for slides with many characters, so the user can see the slide image. Makes it easier to read.

  Next, a skip method 8 in the case where the number of skips is changed depending on the character color as the content of the slide image information will be described.

FIG. 22 shows a flow of pre-processing when the skip number is changed depending on the number of characters of a specific color with respect to the skip method 1, and FIG.
A character string is extracted from the slide image, and the number of tickets is increased or decreased based on the color of the character.

  Important sentences and keywords are often written in prominent colors such as red. The explanation of a slide including such a sentence or keyword is also considered important. Therefore, by increasing the number of skips, skimming is performed more finely than other slides. In order to extract characters and character colors from a slide image, they can be extracted by using OCR, as in the skip method 7 described above.

  As pre-processing, first, as in the skip method 1, the length l of the audio file is acquired, and the number U of characters of a specific color in the slide image is acquired (steps S70 and S71). Next, as described below, α and skip width a are obtained (steps S72 and S73).

When there is a predetermined skip number s (> 0) and the audio length l corresponding to the displayed slide, the skip width a
a = 1 / (s + α)
Ask for. Where α = integer value (number of characters of a certain color U / constant Q)
And For example, when red is specified as a specific color and the constant Q is fixed to 10, if there are 25 red characters in a slide, the number of characters 25 is divided by 10; The integer part 2 is the value of α.

  Next, as a process at the time of viewing, as with skip method 1, when the skip buttons 11f and 11c are pressed, first, after determining whether the instruction direction is the rewind direction or the fast forward direction, the skip destination position x is determined. Obtained (steps S74, S75a, S75b). Assuming that the current playback position is c, x = c + a in the fast forward direction, and x = c−a in the rewind direction. Next, in the fast forward direction, x = 1 is set if x> l, and in the rewind direction, x = 0 is set if x <0 (steps S76a and S76b). Then, reproduction is started from the obtained position x (step S77).

  In this way, when important characters are displayed in a specific color, the skip width becomes finer and the number of skips increases, so that skip viewing can be performed more closely.

  Next, a skip method 9 in the case where the fixed skip position is determined by the movement of the position pointing operation by the position pointing device such as a mouse will be described.

  In the skip method 3, the beginning, middle, and end of each slide are used as fixed points that are always played regardless of the skip width. However, in the case of a presentation, the mouse pointer may be used. When the pointer moves from a stationary state, it can be considered that the item in the slide image is spoken. By reproducing this position as a fixed point, the content linked to the slide image can be viewed.

In order to acquire the position of the mouse pointer, a program for acquiring the position of the mouse pointer may be executed in advance on a PC (personal computer) that performs the presentation. Specifically, it is only necessary to acquire the XY coordinates of the mouse at a certain time interval, and then record the time and coordinates. The file name for saving is the file name of the corresponding image file, such as 001.xml, and the recording destination may be recorded in the data storage unit 1 in the same manner as the slide image or audio file. The format of the file can be, for example, a format using an XML tag, but it is only necessary to record a set of time and XY coordinates. In the following example, a certain slide image is displayed, and the position of the mouse pointer is displayed every second. The first number is seconds, the next number is the X coordinate of the mouse pointer, and the last number is the Y coordinate. The mouse pointer is moved 3 seconds after the slide is displayed.
Example)
00000,334,201
00001,334,201
00002,334,201
00003,342,222
00004,354,245
:

  FIG. 24 is an explanatory diagram showing a time series of skip / playback in the case of changing the number of skips depending on the number of characters in the skip method 1, FIG. 25 is a flow of preprocessing, and FIG.

  As pre-processing, first, the length l of the audio file is acquired in the same manner as in the skip method 1, and then α and skip width a are obtained as described below (steps S80 and S81).

When the skip width is a predetermined skip count s (> 0) as in skip method 1 and there is an audio length l corresponding to the displayed slide, skip width a
a = 1 / s
Ask from.

  Further, the time at which the pointer starts moving from the stationary state is acquired from the file storing the position of the mouse pointer as a fixed playback point fi (i = 0, 1, 2,...) And registered (step S82).

  Next, when the skip button 11f, 11c is pressed as the viewing time process when the skip button 11f, 11c is pressed, first, after determining whether the instruction direction is the rewind direction or the fast forward direction, the skip destination position x is determined. Obtained (steps S83, S84a, S84b). Assuming that the current playback position is c, in the fast forward direction, x = c + a, and in the rewind direction, x = c−a.

  Next, in both the fast forward direction and the rewind direction, if there is a fixed playback point that satisfies the current playback position c <fi <x, x = fi is set (steps S85a and S85b).

  Next, in the fast forward direction, x = 1 is set when x> l, and in the rewind direction, x = 0 is set when x <0 (steps S86a and S86b). Then, reproduction is started from the obtained position x (step S87).

  As shown in FIG. 24, when skip playback is performed, skip and playback is performed with a skip width a, and when a fixed playback point is reached, playback is started from that point (time) without skipping. .

  FIG. 27 shows the configuration of the playback browser of the slide playback apparatus according to the second embodiment of the present invention, and the configuration and operation thereof will be described.

  27, differences in configuration from the playback browser of FIG. 3 will be described. A function for displaying the reproduced position on each thumbnail and a function for reproducing by indicating the displayed position are provided. In FIG. 27, the essential parts and details of the common parts with respect to FIG. 3 are omitted in order to emphasize the characteristic parts of the second embodiment in an easy-to-understand manner.

  Specifically, the timeline 13 (13a, 13b, 13c) is provided on or near each thumbnail in the thumbnail display area 12a, and the reproduced position is displayed. When a position on the timeline shown with the thumbnail is clicked with a position indicating device such as a mouse, a slide image corresponding to the thumbnail is displayed in the slide display area 10a, and playback starts from the position of the clicked timeline. . FIG. 27 shows a state in which the second playback position corresponding to the central thumbnail (2) is clicked and displayed in the slide display area 10a. In the example shown in the figure, the timeline 14 corresponding to the display of the timeline 13b of the thumbnail (2) selected by clicking is also slided below the slider 10a below the slide display area 10a. Since the display area 10a is enlarged and displayed and can be operated on the timeline 14, an instruction operation for actual voice information is facilitated. In this specification, the timeline is also expressed as a time axis.

  By doing so, it is possible to avoid duplicating viewing, and it is a mark when listening to what has been heard once, so the burden on the user is reduced.

  In the embodiments described above, the case of skipping and playing back slide image information such as presentation materials such as slides has been described. However, the present invention is not limited to this, and similar still image information and corresponding audio image information are played back. The present invention can also be applied to cases.

  The present invention is used in a slide playback device, a slide playback system, and a slide playback program that play back slide image information and audio information.

It is a block diagram which shows the structural example of the hardware of the slide reproducing | regenerating apparatus which concerns on 1st Example of this invention. It is a block diagram which shows the functional structural example of the slide reproducing | regenerating apparatus which concerns on 1st Example of this invention. It is a display screen figure which shows the structure of the reproduction | regeneration browser of the slide reproduction | regeneration apparatus which concerns on 1st Example of this invention. It is a flowchart which shows the whole reproduction | regeneration processing of the slide reproducing | regenerating apparatus based on 1st Example of this invention. It is a flowchart which shows the routine of the initialization process of a reproduction | regeneration process. It is a flowchart which shows the routine of the reproduction | regeneration control processing of reproduction | regeneration processing. It is a flowchart which shows the whole procedure of a skip instruction | indication process. It is explanatory drawing which shows the skip and reproduction | regeneration of the skip method 1 in time series. 10 is a flowchart showing a preprocessing procedure of a skip method 1. It is a flowchart which shows the procedure of the process at the time of viewing of the skip method 1. It is explanatory drawing which shows the skip and reproduction | regeneration of the skip method 2 in time series. It is a flowchart which shows the procedure of the process at the time of viewing of the skip method 2. It is explanatory drawing which shows the skip and reproduction | regeneration of the skip method 3 in time series. It is explanatory drawing which shows the skip and reproduction | regeneration of the skip method 4 in time series. It is a flowchart which shows the procedure of the process at the time of viewing of the skip method 3. It is explanatory drawing which shows the skip and reproduction | regeneration of the skip method 5 in time series. It is explanatory drawing which shows the skip and reproduction | regeneration of the skip method 6 in time series. 10 is a flowchart showing a preprocessing procedure of skip method 5. 10 is a flowchart showing a procedure of viewing time processing in skip method 5. 10 is a flowchart showing a preprocessing procedure of a skip method 7. It is a flowchart which shows the procedure of the process at the time of viewing of the skip method 7. 10 is a flowchart showing a preprocessing procedure of skip method 8. 10 is a flowchart showing a procedure of a viewing time process in skip method 8. It is explanatory drawing which shows the skip and reproduction | regeneration of the skip method 9 in time series. 10 is a flowchart showing a preprocessing procedure of a skip method 9; It is a flowchart which shows the procedure of the process at the time of viewing of the skip method 9. It is a display screen figure which shows the structure of the reproduction | regeneration browser of the slide reproducing | regenerating apparatus which concerns on 2nd Example of this invention.

Explanation of symbols

1: Data storage unit 2: Data reading unit 3: Instruction receiving unit 4: Data control unit 5: Data playback unit 10: Playback browser 10a: Slide display area 12a: Thumbnail display area 11c, f: Skip button 13 (13a, 13b 13c), 14: Timeline 51: Input device 53: Main storage device 55: CPU
56: Communication control device 57: Bus 100, 110: Slide playback device 200: Image playback device 300, 301: Image recording / playback system

Claims (12)

Reproduction means for performing reproduction by visual display of slide image information to be reproduced and audible display of audio information corresponding to the slide image information;
Calculating means for calculating a skip width based on the length of the audio information and a predetermined number of skips;
In response to a skip instruction, a control unit that determines a playback position of a skip destination based on a calculation result of the calculation unit and controls a playback position of audio information by the playback unit based on the determined playback position;
A slide playback apparatus comprising:   The control means performs a control for setting a fixed reproduction position determined by the skip width and the number of skips as a skip reproduction position and skipping by a time between the reproduction position at the time of the skip instruction and the next skip reproduction position. The slide reproducing apparatus according to claim 1, wherein   2. The slide playback apparatus according to claim 1, wherein the control means adds and controls an essential playback position.   2. The slide playback apparatus according to claim 1, wherein the control means adds and controls an essential playback position based on the volume of the audio information.   The slide reproducing apparatus according to claim 1, wherein the calculating means calculates a skip width based on a total length of a plurality of pieces of audio information.   2. The slide playback device according to claim 1, wherein when the skip instruction continues for a plurality of skip widths, a control is performed to perform skip and playback by providing a playback period for playback for a predetermined time between the skip widths. .   2. The slide playback apparatus according to claim 1, wherein the calculation means calculates a skip width changed based on the number of characters in the slide image information.   2. The slide playback apparatus according to claim 1, wherein the calculating means calculates a skip width that is changed based on the number of characters of a specific color in the slide image information.   2. The slide playback apparatus according to claim 1, wherein the control means performs control for adding an indispensable playback position based on position instruction information for the slide indicated by the slide image.   The reproduction means displays a past reproduction period of audio information corresponding to reduced image information on a time axis at a position adjacent to at least one display position of the slide image information and reduced image information corresponding to the slide image information. The slide reproducing apparatus according to claim 1, wherein the apparatus is a slide reproducing apparatus. Storage means for storing a set of slide image information to be reproduced and audio information corresponding to the slide image;
Reading means for reading slide image information and audio information to be reproduced from the storage means;
Reproduction means for performing reproduction by visual display of slide image information to be reproduced read by the reading means and audible display of audio information corresponding to the slide image information;
Calculating means for calculating a skip width based on the length of the audio information and a predetermined number of skips;
In response to a skip instruction, a control unit that determines a playback position of a skip destination based on a calculation result of the calculation unit and controls a playback position of audio information by the playback unit based on the determined playback position;
A slide playback system comprising: A first step in which the reproduction means reproduces by visual display of slide image information to be reproduced and audible display of audio information corresponding to the slide image information;
A second step in which the calculating means calculates a skip width based on the length of the audio information and a predetermined number of skips;
In response to the skip instruction, the control means determines a reproduction position to be skipped based on the calculation result of the calculation means, and controls the reproduction position of the audio information by the reproduction means based on the determined reproduction position. When,
A slide playback program comprising:

Images