JPH0330176A - Automatic display method for still picture and audio signal - Google Patents

Abstract

PURPOSE:To improve the synchronizing performance of a still picture and an audio signal by executing the preparation of reproduction of an audio reproducer by a prescribed time before a designated time and executing an audio reproduction instruction and a picture reproduction instruction for a prescribed time based on a designated program. CONSTITUTION:The reproduction of an audio reproducing device is prepared and an audio reproduction instruction and a picture reproduction instruction are executed based on a designated program for a designated time. For example, in the case of a compact disk, sound output requires several seconds, because an audio read head is moved to the designated address (read position) to read an audio data. When the preparation of reproduction is implemented several seconds before a designated time desiring to output the audio signal, accurate output is attained for a desired designation time and the synchronization with the reproduction of a still picture is facilitated.

Description

DETAILED DESCRIPTION OF THE INVENTION (a) Industrial Application Field The present invention relates to an automatic still image and audio display method, particularly for displaying high-definition still images, for example, used in art museums, museums, showrooms, etc. The present invention relates to an automatic display method for still images and audio in an image filing system in which an audio explanation (narration) is added in synchronization with the still images.

(B) Conventional technology An example of a playback device that synchronizes and plays back still images and audio is disclosed in, for example, Japanese Patent Laid-Open No. 63-205849, which was published on August 25, 1988. has been done. This playback device records synchronous operation control signals in advance on each of an optical disk for recording image information and a magnetic tape for recording audio information, and when playing back, it compares the synchronous operation control signals from both. and play the audio synchronously.

(c) Problems to be Solved by the Invention In conventional playback devices, synchronized operation control signals necessary for automatic display of still images and audio must be recorded in advance on each of the optical disk and magnetic tape. Moreover,
The operation ii11 control signals must be made to correspond to each other, which has the disadvantage that recording on optical disks and magnetic tapes becomes complicated.

Therefore, the main purpose of this invention is to easily improve the synchronization performance of still images and audio without pre-recording special signals such as synchronized operation control for automatic exhibition. An object of the present invention is to provide an automatic image and audio display method.

(2) Means for Solving the Problems Simply put, this invention transfers the image data of a still image read out by an image reproducing device to a memory, displays the still image on a monitor, and uses the audio reproducing device to transfer the image data of a still image to a memory. In an image file system that has a control device that plays back audio and controls each playback device, the control device is used to set the order of image playback and audio playback commands together with the designated execution time, and automatically execute the commands according to the set program. In an automatic exhibition method that controls images and audio devices automatically, the step of preparing the audio playback device for playback a certain period of time before the designated execution time of the audio playback command, and specifying the audio playback command and the image playback command at the designated execution time. Execute based on the program.

(E) When specifying a command to output audio from the operational audio playback device 1
Preparation for reproduction of the audio reproduction device is executed a certain period of time before 71. For example, in the case of a compact disc (hereinafter abbreviated as CD), it takes several seconds for sound to be output. This is because the audio reading head moves to the specified address (reading position) and reads the audio data. The present invention
Prepare for playback a few seconds before the specified time you want to output audio. That is, since the reading head is moved to a specified address in advance, output can be performed accurately at a desired specified time, and synchronization with still image reproduction is facilitated.

(f) Example FIG. 2 is a block diagram showing an embodiment of the present invention.

The image file system 10 of this embodiment includes a computer 12 that controls the operation of the entire system. The computer 12 includes a CPU 14, and the CPU 14 has an RO
M/RAMI 6 and hard disk 18 are connected. A system program for control is stored in the ROM of the ROM/RAM 16, and the RAM is provided with various flag areas and counter areas necessary for control, and also temporarily stores data. hard disk 18
Stores program data of a user program input by operating the keyboard 20.

An I/O interface 22 is connected to the computer 12, and a CD-R
OM device 24 is connected. The CD-ROM device 24 is
A device for playing a CD (not shown), the CD
Controlled by driver 26. And CD-RO
The M device 24 includes S C S I (Small Co
computer system interface)2
8 is built-in. Therefore, the CD-ROM device 24
For example, 8-bit parallel data can be sent and received between the I/O interface 22 and the I/O interface 22 via the SCSI bus. That is, the S of the CD-ROM device 24
The CSI 28 is given control data from the CPU 14 of the computer 12 through the I/O interface 22 to designate modes such as play, stop, rewind, and fast forward, as well as addresses, track numbers, and the like. On the other hand, subcode data such as time information and song numbers read from the CD are input to the I/O interface 22, ie, the computer 12, via the SCSI 28.

Note that the audio data from the CD played by the CD-ROM device 24 is converted into an analog signal and amplified 53.
0 and is output as audio from the speaker 32.

A clock generation circuit 34, which is connected to the I/O interface 22 and receives a clock generation control data from the computer 12, divides the basic clock from the reference oscillator 36, converts the timing using a timing ROM, etc., as appropriate. Check the format of required clock signals and R/W signals. Note that the R/W signal is a signal for instructing reading or writing to the frame memory 42 or display memory 46, which will be described later.

Further, through the I/O interface 22, the image interface 38 is provided with sector designation data from the computer l2. The image interface 38 controls the optical disc device 40 to read desired image data designated by the sector designation data from the optical disc. Then, the image data is transmitted to the clock circuit generation circuit 3.
In synchronization with the evening lock signal given from 4, the data is transferred to the frame memory 42 as pit para data.

In this embodiment, a write-once optical disc is used as the optical disc, and a high-definition image is recorded on the optical disc.
Recorded in full band of A standard.

The image data from the optical disk device 40 is RGB
The data is output as data and temporarily stored in the frame memory 42.

The frame memory 42 writes the image data inputted from the image interface 38 to the address specified by the address control circuit 44 based on the R/W signal given from the clock generation circuit 34. Therefore, the address control circuit 44 is given address preset data from the computer 12 via the I/O interface 22. Then, the specified address is incremented every time a clock signal is applied from the clock generation circuit 34. In this way, image data of a still image to be displayed next on the monitor 52, which will be described later, is stored in the frame memory 42.

The image data written in the frame memory 42 is transferred to the display memory 46. The timing of transfer from frame memory 42 to display memory 46 is controlled by computer 12 in this embodiment.

The display memory 46 is supplied with an R/W signal from the clock generation circuit 34 that instructs the writing or reading of image data. The write or read address of the display memory 46 is specified by write address data and read address data given from the address control circuit 48. Like the address control circuit 44, the address control circuit 48 is connected to the I/O interface 2.
The image data to be displayed is constantly read out. Along with this reading, a synchronization signal is provided from address control circuit 48 to clock generation circuit 34, I/O interface 22, and D/A converter 50.

The image data read from the display memory 46 is input to the D/A converter 50, and the D/A converter 50 converts the image data based on the synchronization signal given from the address control circuit 48 and the sampling clock given from the clock generation circuit 34. , converts image data into RGB analog signals. In this way, the image data read from the display memory 46 is displayed on the high-definition monitor 52.

When the above system is used to automatically reproduce images and sound, that is, to perform automatic exhibition, WtFli. While referring to the diagram, create an image file system (IO) based on Figures 2, 3, 4 and 5.
)'s operation or operation will be explained. FIG. 3 shows an example of an automatic exhibition program list. Item (6) indicates the order of instructions to be executed. Time (7) indicates the instruction execution time. Operation (8) indicates the content of execution. In this way, a computer (12) is used to create a program by arranging the time and operations.The flowchart of the execution procedure when completing and executing the program is shown in Fig. 4 and Fig. 1. In step (551), the computer (l
Set the absolute time of 2) to a certain time. (For example -
10 seconds). Then, start counting the absolute time. Next, in step (S52), the item number N of the automatic exhibition program representing the order of the still images displayed on the monitor (52) and the audio output from the speaker (32) is initialized to "0". That is, the order of still images and sounds is determined by a user program created by operating the keyboard 20, and commands are added to the user program in the order of item numbers. Therefore, in the first step (S52), initialize the item number N and
"O". Then, the process proceeds to step (S53) and executes a subroutine. This subroutine sets the item number of the user program in which the still image is to be displayed next, and
This is executed to know the number of the still image to be displayed.

That is, the step (S1) of the subroutine shown in FIG.
), the term number N plus "1'' is set as the term number (variable) M.

For example, if the process advances from step S52 to step S53, in step Sl, the term number N is set to "0" in step S52, so the term number M is "
1”.

Next, in step S3, it is determined whether the set item number M is programmed to display a still image, that is, whether the command for item number M is for displaying an image. If there is no command to display a still image, the process advances to step S5.

In step S5, "1" is further added to the item number M set in the previous step Sl, and a new item number M is reset. Thereafter, in step S3, it is determined whether the item number M command is for image display. In this way, by repeating steps S3 and S5, the item number M in which the next command to display a still image is programmed is found.

When it is confirmed in step S3 that the command with item number M is for displaying an image, image data corresponding to the still image number programmed in item number M is sent from the optical disk device 40 in step S7. It is read out and stored in the frame memory 42 via the image interface 38. After that, the step (S) shown in FIG.
Return to 54).

In step (554), the item number is set as "N" again. That is, in step (S54), only the item number of the user program is incremented.

In the next step (S55), the contents of the command of item number N are read (time and operation are read). Next, the computer (l2
) is read in step (S56). This is the most important point of the present invention. Step (561
) Check to see if there is an item within the absolute time read by adding n seconds. Considering the case where n is 5 seconds in the example in Figure 3, if the absolute time is 3 seconds, 8 seconds is added by 5 seconds.
Since there is no item within seconds, the process advances from step (561) to step (S62). However, if the absolute time is 5 seconds, items 2 and 3 are within 10 seconds of the 5 seconds. In this case, the process advances to step (S57) and its operation (content) is examined to determine whether it is a voice-PLAY command. If it is not a voice 1 PLAY command, the process directly advances to step (S62), but in this example, since item 3 is a voice 1 PLAY command, the process advances to step (358) to determine whether or not the following processing is being performed. Then, in the next step (S59), the audio reproduction device prepares for reproduction. (e.g. move the read head to a specified address). Then the next step (560
) flags the instruction as processed and steps (S
Proceed to step 62). By performing steps (S57) to (S60), it becomes possible to output audio accurately at the specified time. To explain the reason for this with reference to FIG. 5 using a CD as an example, when a CD (1>) receives a command to output audio, it moves the reading head (2) to the specified address (
Move to 3) (5) and read the audio data. In this case, it takes about 2 seconds to move the reading head to the designated address, and the actual sound is not output until 2 seconds after the designated time, making accurate control impossible. However, according to the present invention, the reading head is moved to the designated address n seconds (in this case, 5 seconds) before the audio output command, so the audio can be output accurately at the designated time. Then step (S
Proceed to step 62). In step (S62), the absolute time and the designated time (time) are compared, and if they are equal, the process proceeds to the next step. In steps (S63) to (S66), it is determined whether the item number N of the set user program is programmed to output an image, to output audio, or to stop audio. It is also determined whether the program is programmed to terminate.

In step (S63), the item number N of the user program is
Determine whether a command is programmed to display a still image. If the command with item number N at this time is for image display, the process advances to step (S67), and the image data previously stored in the frame memory 42 in step S7 of the subroutine shown in FIG. 1 is transferred to the display memory 46. Then, a still image is displayed on the monitor 52.

Then, in step (968), the subroutine shown in FIG. 1 is executed again. Therefore, this step (
In S68), the image data of the still image to be displayed next is stored in the frame memory 42.

In step (S64), it is determined whether a command to output audio is programmed in item number N of the user program that was determined not to output an image in the previous step (S63).

If the item number N is a program step that outputs audio, then in step (S69) the CD-ROM device 24 is controlled to play the CD and output audio from the speaker 32.

Then, the process returns to step (S54), and the item number N is further incremented to set the item number N.

In step (S65), if the item number N is a program step for stopping audio, in step (S70) CD-ROM! ! control and stop the position (24). Then, the process returns to step (S54), and the item number N is further incremented to set the item number N.

Note that if it is determined in the previous step (S65) that the command with item number N is not to stop the voice, step (S66)
At , it is determined whether the command with item number N indicates termination. Therefore, when the determination is "NO", the process returns to the previous step (S54).If the command with item number N indicates termination, the series of operations ends.

As described above, by implementing the present invention, it becomes possible to accurately control the audio reproduction device and to create an automatic exhibition program that is easily synchronized with still images.

Further, regarding other embodiments, the operation or operation of the image file system (10) will be explained with reference to FIG. 1, and based on FIGS. 2, 3, 6, and 7. Since the explanation of FIGS. 1, 2, and 3 is the same as that of the previous embodiment, the explanation will be omitted here, and the explanation will focus on FIGS. 6 and 7. In the first step (381) the computer (12)
The absolute time (t1) of is set to a certain time (for example, -10 seconds).

Then, start counting the absolute time. Next, in step (S82), the time obtained by adding n seconds to the absolute time is set as t2. For example, following the above example, the initial value of t2 is -5 seconds. Next, in step (S83), the item numbers N and K of the automatic exhibition program are set to 0. Initialize to 1. Next, in step (S84), an image subroutine is executed.

The contents of this subroutine are the same as the example shown in FIG. 1 described above, and therefore will be omitted.

Next, the term number N is incremented in step (S85). Next, in step (S86), a voice subroutine is executed. This subroutine is executed to determine whether or not there is a command for audio output within absolute time + n seconds, and to prepare the audio device if there is.

That is, the steps of the subroutine shown in FIG.
571) reads the specified time of the command in item K. Next, in step (S72), the specified time (K) and t2 are compared. If the designated time (K) has not reached t2, the process returns to the main routine. When the specified time (.K) reaches t2, the process advances to step (S73), and it is determined whether the command in item K is a voice output command.If it is not a voice output command, step (S73) is executed.
375) and increment K. In the case of an audio output command, the process advances to step (S74), where the audio reproducing device prepares for reproduction. (For example, move the reading head to the designated address.) Then, in step (S75)
Increment and return to the main routine. That is, the process returns to step (S87). By executing this subroutine, preparation for reproduction is performed n seconds before the designated audio reproduction time.

In step (S87), the designated time of item N and 11 are compared, and if they are the same, the process advances to step (588). Step (
588) to (S95) are the same as in the above-described embodiment, so their explanation will be omitted here.

The present invention will be specifically explained using FIGS. 6 and 7 according to an example of an automatic display program shown in FIG. 3.

In step (S81) of the execution flowchart of FIG. 6, the absolute time t1 is initialized to -10 seconds and counting is started.

In step (582), the time t2 is the sum of t1 and 5 seconds.
It is defined as In other words, the initialization of t2 is -5 seconds, and t
It is counted according to 1. In step (S83), the program item numbers N and K are "O" and "O", respectively.
1''. Next, the process proceeds to the image subroutine (S84). In this case, image 5 of item 1 is recorded in the 7-frame memory in (S84). (Details are shown in FIG. 1) Step (S85) Then, the program item number N is incremented to 1. Next, the voice subroutine of step (S86) is executed.The contents of the subroutine are shown in FIG. Read.Now K=1, so the specified time is OO
MinuteOO. It becomes 0 seconds. Next, in step (S72) t2
Make a comparison with This step (S
Since the determination in step 72) is "NO", the process returns from the subroutine and proceeds to step (S87). Step (S87)
Then, read the specified time O minutes 00,0 seconds of item N (ie l) and compare it with t1. [2 is -5 seconds to 0 seconds (tl is -1
Since the judgment in this step (S87) is also "No" between 0 seconds and -5 seconds, time passes by going through steps (586) and (S87). t 2=O seconds (tl=
-5 seconds), the judgment in step (S72) in FIG. 7 becomes "YES", so proceed to step (S73).
Determine whether the command of item K (K = 1) is a voice output.The command of item K (K = 1) is "image 5 output", so the judgment is "N"
o'', the process advances to step (S75) and increments K. In other words, K=2, and the process returns to the main routine.Then, since step (S87) is still ``No'', the process immediately proceeds to step (S71) and increments item K (K = 2) is read and compared with t2 in step (S72). Until t2 = lO seconds (tl = 5 seconds), step (
The judgment in step S72) is "No", and the step (S87)
Time passes as the vehicle returns to step (S86) and (S87).

When t2=5 seconds (tl=o seconds), step (S87
) is ``YES'' and the process advances to step (388). Since the command for item N (N=1) is "output image 5", the process advances to step (S92) and step (S93), and image 5 is displayed on the display (52). (The details are omitted as they have been described above.) Then, the item N is incremented in step (S85) and becomes N=2, and the item N is incremented in step (S86).
) (S87) as time progresses.

When t2=10 seconds (tl=5 seconds), step (S
72) becomes “YES” and step (S73)
Then, it is determined whether the command of item K (K=2) is a voice output. In the case of item 2 as well, since it is "output 3 images", the answer is "No", and K is incremented to 3 and the process returns. In step (S87), the specified time 10 seconds of item number N (N=2) is read and compared with t1.

In other words, this judgment is tl = 10 seconds (t 2 = 1 5 seconds)
If the answer is "No", the process advances to step (581). In step (S71) of the subroutine, the specified time of 10 seconds for item K (K=3) is read, and in step (S72) it is compared with t2. In this case, t2 = 10 seconds, so step (5.73)
Then, it is determined whether the command of item K (K=3) is a voice output. Item 3 is “audio output” so the answer is “YES”
Then, the process proceeds to step (S74), where the reading head of the audio device is moved to the specified address (sound 1), and the audio device (CD-ROM) is prepared for reproduction. Then, the item K is incremented to K=4 and the process returns to the main routine.

When tl=10 seconds (t2=15 seconds), step (S8
The judgment in step 7) becomes "YES", and the command in item N (N=2) is executed. Item 2 is “image 3 output”, so item 1
The image is output by following the same steps as in the case of . In step (S85), item N is incremented to 3, and the steps proceed to (S86) (S87). Since the specified time of item 3 is 10 seconds, the judgment in step (587) is "YES" and step (S87) is incremented. S88). (389) and proceed. Since item 3 is a command to "output audio 1", step (S89) becomes "YES" and step (S94)
), and the music I is output from the audio device you just prepared. In this case, since the audio device is already ready for reproduction, it is possible to quickly output audio.

By implementing the above example, an automatic exhibition program that can accurately control the audio reproduction device and easily synchronize with still images becomes possible.

(G) Effects of the Invention According to the present invention, accurate time control of an audio playback device can be performed by a computer, and it is also easy to synchronize with still image playback, so that image recording is not possible as with conventional playback devices. This eliminates the need for complicated processing such as recording special synchronous operation control signals on the medium.

[Brief explanation of drawings]

1 to 4 show an embodiment of the present invention, FIG. 1 is a flowchart showing an image subroutine, FIG. 2 is a diagram showing the structure of the invention, and FIG. 3 is a diagram showing an example of an automatic exhibition program. , Figure 4 is an automatic exhibition program execution flowchart (I
) Figure 5 shows a general CD (compact disc).
An explanatory diagram of a reading operation is shown. FIG. 6 is an automatic exhibition program execution flowchart showing another embodiment of the present invention}
FIG. 7 is a flowchart showing a subroutine of the flowchart shown in FIG. 6. (40)...Optical disc device, (42)(46)...
・Memory, (52)...Monitor, (24)...CD
-ROM device, (l2)...computer.

Claims (2)

[Claims] (1) Transfer the image data of the still image read by the image playback device to the memory, display the still image on a monitor, play the audio by the audio playback device, and have a control device that controls each playback device. In this image file system, the order of image playback and audio playback commands is set in advance together with the specified execution time using the control device, and the audio playback command is automatically controlled in accordance with the set program. A method of still image and audio processing, characterized in that: a step of preparing an audio reproduction device for reproduction a certain period of time before a specified execution time; and executing the audio reproduction instruction and the image reproduction instruction at the specified execution time based on a specified program. Automatic display method. (2) The audio playback device is a CD (compact disc)
2. The method for automatically displaying still images and audio according to claim 1, wherein the audio reproducing device is prepared for reproduction a time before the time necessary for the audio reproducing device to output audio using a CD-ROM device or a CD-ROM device.