JP4816447B2 - Data registration device - Google Patents

Description

  The present invention relates to a technique for registering image data and audio data in association with each other, and more particularly, to a technique for performing registration processing of audio data obtained corresponding to image data excluded from registration targets.

Using a computer that operates with presentation software or various application software, a presentation, a conference, a lecture, etc. (in the description of the present application, these are collectively referred to as a presentation) while displaying still images as materials. Widely used in today's business and educational environments.
Various methods for recording and sharing the contents of such presentations have been proposed. Among them, there are several methods for recording the displayed image and the sound when the image is displayed (such as the explanation of the presenter) in synchronization, and for reproducing the recorded image and sound in synchronization. Or has been proposed.
Such a method basically records all displayed still images by comparing the operation information of the presenter and the displayed images.

For example, an invention is known in which information on operation instruction contents related to a presentation given by a presenter to a computer is acquired and the contents of the presentation are recorded (see Patent Document 1).
Also, there is known an invention relating to a projector that can acquire, reproduce, and distribute a displayed image and a sound at that time in a presentation using the projector (see Patent Document 2).
Also, an invention relating to a system that automatically captures a document image and sound that are presented in association with each other is known (see Patent Document 3).
JP 2004-227514 A JP 2005-284196 A JP 2006-127518 A

In general, in a presentation, a presenter displays a document image and explains it. When the presentation is finished, the next document image is switched and displayed in order to explain the document image.
However, in actual presentations, there is a need to omit explanation of a plurality of consecutive document images, or to display a document image out of the order prepared in advance for answering a question, etc. It is possible to switch the document images at a high speed (turn the document images).

Since the document image that is beaten by such an operation is not intended to be displayed by the presenter, it is difficult to view the document image when it is played back later. It will also consume.
On the other hand, in order to make the contents easy to understand in later playback, the document image and the sound acquired when the document image is displayed are recorded in correspondence with each other, but the sound when the hit document image is displayed is recorded. It is necessary to devise how to treat.

  The present invention has been made in view of the above-described conventional circumstances, and an object of the present invention is to make it possible to reproduce stored image data and audio data without feeling uncomfortable while omitting unnecessary image data.

  The data registration apparatus according to claim 1 includes an image capturing unit that captures image data indicating a displayed and output image, a sound capturing unit that captures sound data indicating sound corresponding to the image, image data, and sound data. Storage means for associating and storing, determination means for determining image data to be registered based on the display time of the image indicated by the image data captured by the image capture means, and registration target by the determination means The determined image data and the audio data captured by the audio capturing unit are stored in the storage unit in association with a period during which the image indicated by the image data is displayed, and the determination unit determines that the image is not registered. The determined image data is excluded from the registration target stored in the storage unit and is captured by the voice capturing unit during the display period of the image indicated by the non-registered image data. Voice data characterized by comprising a registration means for registering process to be stored in said storage means is continuously the audio data associated with the image data to be registered immediately adjacent to the image.

  According to a second aspect of the present invention, there is provided the data registration device according to the first aspect, wherein the determination unit registers the image data as an image to be registered based on whether or not the display time of the image indicated by the image data is displayed and output for a predetermined time or more. It is characterized by determining whether to use data.

  According to a third aspect of the present invention, in the data registration device according to the second aspect, the determination unit periodically samples the images captured by the image capturing unit, compares the images before and after the sampling, and compares them. The time during which the image changes is determined as the image display time.

  According to a fourth aspect of the present invention, there is provided the data registration apparatus according to any one of the first to third aspects, wherein the registration unit obtains audio data captured during a display period of an image indicated by the image data determined to be non-registered from the image. It is characterized in that it is stored in the storage means in succession with the sound data associated with the image data to be registered that is displayed immediately before.

  According to a fifth aspect of the present invention, there is provided the data registration device according to any one of the first to third aspects, wherein the registration unit obtains audio data captured during a display period of an image indicated by the image data determined to be non-registered from the image. It is characterized in that it is stored in the storage means in succession to the audio data associated with the image data to be registered that is displayed most recently.

  A data registration device according to a sixth aspect of the present invention is the data registration device according to any one of the first to third aspects, wherein the registration unit divides audio data captured during a display period of an image indicated by the image data determined to be non-registered. These audio data are stored in the storage means in succession to the audio data associated with the nearest registration target image data displayed before and after the image.

  The data registration device according to claim 7 is a connection unit for connecting to a computer, a storage unit that stores image data and audio data in association with each other, and captures image data indicating an image displayed and output to the computer. Image capturing means, sound capturing means for capturing sound data indicating sound corresponding to the image, and image data to be registered based on the display time of the image indicated by the image data captured by the image capturing means And storing the image data determined to be registered by the determination unit and the audio data captured by the audio capture unit in a period during which the image indicated by the image data is displayed. The image data that is determined to be non-registered by the determination unit and excluded from the registration target that is stored in the storage unit. Performs a registration process in which the audio data captured by the audio capture means during the display period of the image indicated by the data is stored in the storage means in succession to the audio data associated with the image data to be registered closest to the image. And a program storage means for storing the registration program constituting the registration means in a readable manner by the computer.

  9. A data registration system according to claim 8, comprising: an image display device that displays and outputs an image; a microphone that inputs sound; and a data registration device that registers image data and sound data in association with each other; The image capturing means for capturing image data indicated by the image displayed and output by the image display device, the sound capturing means for capturing the sound data input by the microphone, and the image data and the sound data are associated with each other. A storage unit for storing; a determination unit for determining image data to be registered based on a display time of an image indicated by the image data captured by the image capturing unit; and a determination unit determined by the determination unit as a registration target The storage unit associates the image data with the audio data captured by the audio capturing unit during a period in which the image indicated by the image data is displayed. And storing the image data determined to be non-registered by the determination unit from the registration target stored in the storage unit, and the sound capturing unit during the display period of the image indicated by the non-registered image data Registration means for performing a registration process in which the audio data captured in step S is stored in the storage means in succession to the audio data associated with the image data to be registered closest to the image.

  The presentation data registration system according to claim 9 registers an image display device that displays and outputs a material image used in a presentation, a microphone that inputs sound spoken in the presentation, and image data and audio data in association with each other. A data registering device, wherein the data registering device captures image data indicated by an image displayed and output by the image display device, and a sound capturing device captures sound data input by the microphone. And storage means for storing image data and audio data in association with each other, and determination means for determining image data to be registered based on an image display time indicated by the image data captured by the image capture means Image data determined to be registered by the determination means and the image data Is stored in the storage unit in association with the voice data captured by the voice capturing unit during the period when the image indicated by the image is displayed, and the image data determined to be non-registered by the determination unit is the storage unit The audio data captured by the audio capturing means during the display period of the image indicated by the non-registered image data is associated with the registration target image data closest to the image. Registration means for performing a registration process to be stored in the storage means in succession to audio data.

  The data registration program according to claim 10 includes: an image capturing unit that captures image data indicating an image displayed and output to a computer; an audio capturing unit that captures sound data indicating sound corresponding to the image; and image data; A storage unit that stores audio data in association with each other, a determination unit that determines image data to be registered based on a display time of an image indicated by the image data captured by the image capture unit, and the determination unit The image data determined to be registered and the audio data captured by the audio capturing means during the period in which the image indicated by the image data is displayed are stored in the storage means in association with each other and registered by the determining means Image data determined to be non-target is excluded from registration targets stored in the storage unit, and the sound data is displayed during the display period of the image indicated by the non-target image data. A registration unit configured to perform registration processing in which the audio data captured by the capturing unit is stored in the storage unit in succession to the audio data associated with the image data to be registered closest to the image. And

  According to the data registration device of the first aspect, it is possible to reproduce the stored image data and audio data without a sense of incongruity.

  According to the data registration device of the second aspect, it is possible to reproduce the stored image data and audio data according to the length of the display time of the image without a sense of incongruity.

  According to the data registration device of the third aspect, it is possible to reliably determine the display switching of the image as compared with the case where the present invention is not adopted.

  According to the data registration device of the fourth aspect, as compared with the case where the present invention is not adopted, the audio data corresponding to the image excluded from the recording target can be recorded so as to explain the introduction of the subsequent image.

  According to the data registration device of the fifth aspect, compared with the case where the present invention is not adopted, the audio data corresponding to the image excluded from the recording target can be recorded so as to be related explanation of the previous image.

  According to the data registration device of the sixth aspect, compared with the case where the present invention is not adopted, the audio data corresponding to the image excluded from the recording target is recorded so that it can be related explanation and introduction explanation of the preceding and succeeding images. Can do.

  According to the data registration device of claim 7, by using a computer, a data registration device corresponding to claim 1 can be configured as necessary.

  According to the data registration system of the eighth aspect, since unnecessary image data can be recorded, consumption of unnecessary data storage area can be avoided, and the stored image data and audio data are not uncomfortable. It can be possible to play.

  According to the presentation data registration system of claim 9, since unnecessary recording of document image data can be omitted, consumption of unnecessary data storage area can be avoided, and stored document image data and speech audio data are stored. Can be reproduced without a sense of incongruity.

  According to the data registration program of claim 10, by using a computer, a data registration apparatus corresponding to claim 1 can be configured as necessary.

FIG. 1 shows the configuration of a data registration system according to an example of the present invention.
In the following description, the data registration system of this example is used as a presentation data registration system for registering presentation data, and the main part of the presentation data registration system is composed of a data registration device.

  The system shown in FIG. 1 projects a document image based on still image data that is switched according to the operation of a computer (PC) 1 and a computer (PC) 1 operated by a presenter (or an assistant) who performs a presentation on a screen. The projector 2 for displaying the speech, the microphone 3 for inputting the speech voice of the presenter or the participant, and the data registration device for capturing and associating and recording the projected image data of the document image and the voice data input from the microphone 3 4 is provided.

At least the screen for displaying the document image and the microphone 3 are installed in the presentation venue, and sound corresponding to the document image displayed in the presentation is input from the microphone 3.
In addition, the data registration device 4 may be installed in another place without being installed in the presentation venue, as long as it has a connection relationship capable of capturing the displayed document image and audio data.
In the example shown in FIG. 1, the data registration device 4 captures image data output from the computer 1 to the projector 2, but the data registration device 4 may capture image data of a printed matter read by the image reading device. .

  The data registration device 4 includes an image capturing unit 11 that captures image data output from the computer 1 to the projector 2, an image temporary storage unit 12 that temporarily stores image data, and an audio capturing unit that captures audio data input from the microphone 3. Means 13, temporary sound storage means 14 for temporarily storing sound data, image sampling means 15 for sampling the image data acquired by the image capturing means 11 at a predetermined period, and image comparison for comparing the sampled image data before and after Means 16, image determining means 17 for determining whether or not there is a change between the images before and after the comparison, image storage means 18 for storing image data to be registered, and each image data stored in the image storage means 18 The voice data input by the microphone 3 is stored in a correspondence relationship with Has a voice storage means 19.

  In this example, each of the functional units 11 to 19 is configured by executing the data registration program according to the present invention with computer hardware provided in the data registration device 4. Each may be configured with dedicated hardware.

An overview of processing performed by the data registration device 4 of this example will be described.
While the voice data is continuously captured by the voice capturing unit 13, the image comparing unit 16 determines whether the image captured by the image capturing unit 11 has changed from the previously captured image. When the image changes, it is determined whether or not to register the data of the new image (that is, the material image switched in the presentation).

For this new image data, the image determination means 17 determines whether or not the image has been displayed for a predetermined time or more. When the image is displayed for a predetermined time or more, the image data is stored and registered in the image storage means 18. When the image is displayed for less than a predetermined time, the image data is not stored in the image storage means 18.
Of the continuously captured audio, audio data corresponding to a period during which an image stored in the image storage unit 18 is displayed is stored in the audio storage unit 19 corresponding to the image. On the other hand, the audio data corresponding to the period in which the image not stored in the image storage unit 18 is displayed is connected to the audio data in the period corresponding to the stored image before or after that period. Save to.

The process performed by the data registration device 4 of this example will be described in more detail with reference to FIG. 2 showing the relationship between the displayed image and sound.
Using the computer 1 for presentation, a presentation is performed while displaying a document image by projection onto a screen by a projector 2 (or display on a large monitor screen).
The material image displayed in this presentation is input to the data registration device 4 through the image capturing means 11. This image capturing means 11 is a means for capturing an image signal (image data). Specifically, when an image is displayed using the projector 2, the image signal is branched and input. The signal can be captured. It is also possible to execute a screen capture program on the presentation computer 1 and input the image signal.

The image data input by the image capturing means 11 is acquired by the image sampling means 15 every predetermined period ΔT. This period is a time set for detecting a change in the image, and is set to a very short time such as 1 second, for example.
Then, the image data sequentially obtained by the image sampling means 15 is stored in the image temporary storage means 12, and the sampled image and the image sampled one cycle before are compared by the image comparison means 16, and these images are compared. If there is a change between them, it is determined that the image has been switched.

Then, when the image determination means 17 determines that the image determined to be switched has not changed for a predetermined time or more after that, the newly acquired image is assumed to have been intentionally displayed by the presenter, The images are recorded in the order displayed on the image storage means 18.
On the other hand, an image that has been displayed for less than a predetermined time is not recorded in the image storage means 18 on the assumption that it has not been intentionally displayed, such as an image that has just been turned over. This predetermined time is set to a very short time such as 1 second, for example, when it is simply detected whether or not the image is turned.

  As described above, an image that has not been displayed for a predetermined time or longer is discarded and is not recorded in the image storage unit 18, but audio corresponding to a period in which the discarded image is displayed is displayed before or after the discarded image. It is recorded in the voice storage means 19 in a form that is continued to the voice data corresponding to the most recently registered image.

  In this example, the image sampling unit 15, the image comparison unit 16, and the image determination unit 17 that perform the above-described series of processing are acquired during the display period of the image data for which display output has been performed for a predetermined time or more. The image data that has been displayed for less than a predetermined time is excluded from the object to be stored in the image storage unit 19 and the image data that has been displayed for less than the predetermined time is stored. The registration unit is configured to store the audio data acquired in the display period in the audio storage unit 19 continuously with the audio data associated with the data of the image displayed for a predetermined time or more closest to the image.

  In FIG. 2, among the document images P1 to P5 that are sequentially switched and displayed, P1 and P5 are images that are displayed for a predetermined time or longer (images that are intentionally displayed for presentation), and P2 that is displayed in the meantime. , P3, and P4 are images that are displayed for a short period of time less than a predetermined time when the document images are sent one after another at a high speed for image turning.

As described above, the image data P1 and P5 are recorded in the image storage means 18, but the image data P2, P3, and P4 are discarded.
The audio data input by the audio capturing means 13 is stored in the audio temporary storage unit 14 after being divided at the timing when it is determined that the image has been switched.
Of the audio data temporarily stored in this way, the audio data V1 and V5 at the time when the recorded images P1 and P5 were displayed are recorded in the audio storage means 19 in association with the respective images, but discarded. The audio data V2, V3, V4 at the time when the images P2, P3, P4 are displayed is recorded in the audio storage means 19 in a form that is connected to the audio data V1 or V5 that is immediately before or immediately after that.

Next, the data registration method that can be implemented by the data registration device 4 of this example according to the setting for selecting the method will be specifically described.
FIG. 3 and FIG. 4 show that the audio data V2, V3, V4 at the time when the discarded images P2, P3, P4 are displayed are recorded in a form to be connected to the audio V5 at the time when the subsequent image P5 is displayed. FIG. 6 and FIG. 7 show audio data V2, V3, and V4 at the time when the discarded images P2, P3, and P4 are displayed, and an image P1 that precedes them. An example of a second method of recording in a form connected to the time voice V1 is shown.

In FIG. 3, from the state in which the image P1 is displayed, it is switched to the image P2 at the time t2, then the image P3 at the time t3, the image P4 at the time t4, the image P5 at the time t5, and the image P6 at the time t6. It shows the state of switching sequentially.
FIG. 4 shows a processing procedure according to the first method.

The displayed image is sampled at a predetermined period ΔT and stored in the image temporary storage unit 12, and is different from the image sampled one cycle before, that is, before ΔT and stored in the image temporary storage unit 12. The image comparison means 16 determines whether or not there is (step S1).
In addition, the image determination means 17 is provided with a flag indicating a state in order to determine whether or not a predetermined time has elapsed since the image was displayed. This flag is determined to indicate that the image has been displayed for a predetermined time or more. And “1”, and when this is in the state of “1”, it is set to “0” when the image changes.

Initially, in a state where the image P1 is stably displayed, the state flag is “1” (step S2). When switching to the image P2 at time t2, a change in the image is detected at the next sampling timing, and the audio data obtained up to that point acquired by the audio capturing means 13 is written to the audio storage means 19, and the flag is It is set to “0” (step S3).
Next, when the image changes to P3 at time t3, the change of the image is detected at the next sampling timing, but since the flag is “0”, the audio data is not written to the storage means 19.

Although the image P4 is displayed at time t4, the image P4 is ignored because it is switched to the next image before the next sampling timing. When switching to the image P5 at the time t5, a change in the image is detected by the next sampling, but since the flag is “0”, the audio data is not written to the storage means 19 (step S4).
Then, when a change of the image is detected and a predetermined time α or more for confirming the image has passed (step S5), it is determined that the image is displayed for the predetermined time or more and is registered in the image storage means 18, and at the same time The flag is set to “1” (step S6).
The time α can be determined independently of the sampling period, but may be an integral multiple of the sampling period.

After that, when the image P5 is displayed for a while and then switched to the image P6 at time t6, a change in the image is detected at the next sampling timing. At that time, since the flag is “1” (step S2), the voice data up to that point is written to the voice storage means 19 and the flag is set to “0” (step S3).
As a result of such processing, images that are unintentionally displayed for a short time are not stored in the image storage means 18, and audio data uttered during a period in which these images are displayed for a short time is then stored for a predetermined time. The sound is stored in the sound storage means 19 in the form preceding the sound corresponding to the image displayed and stored in the image storage means 18.

As shown in a simplified manner in FIG. 5, in the first method, the data of the images (1) and (5) displayed for a predetermined time or longer are stored in the image storage means 18 and acquired during the display period of these images. The data of the voices (1) and (5) are stored in the voice storage means 19 in association with each image data by a known method (for example, association by an identifier).
Then, the data of the images (2), (3), and (4) that have been displayed for a short period of time shorter than the predetermined time are discarded and not stored in the image storage means 18, and the images (2), (3), and (4) are displayed. The audio data (2), (3), and (4) acquired during the period are stored in the audio storage means 19 in succession to the audio data (5) corresponding to the immediately subsequent display image (5).
That is, the audio data (2), (3), and (4) are stored in the audio storage means 19 as audio data that precedes the audio data (5) immediately after the audio data (5). Can fulfill.

In the second method, voices uttered during a period in which images are unintentionally displayed for a short time are recorded in association with images displayed for a predetermined time or more before those images, contrary to the first method. To do.
In FIG. 6, the state where the image P1 is displayed is switched to the image P2 at the time t2, then the image P3 at the time t3, the image P4 at the time t4, the image P5 at the time t5, and the image P6 at the time t6. It shows how it can be switched.
FIG. 7 shows a processing procedure according to the first method.

In the second method, as in the first method, the image is sampled at a predetermined period ΔT and stored in the image primary storage means 12 and whether it is different from the image sampled one period before, that is, ΔT or not. Is determined (step S11).
In addition, a flag indicating a state is prepared to determine whether or not a predetermined time has elapsed since the image was displayed. This flag is set to “1” when it is determined that the image has been displayed for a predetermined time or more. If the image changes when it is in the “1” state, it is reset to “0”.

Initially, in a state where the image P1 is stably displayed, the state flag is “1”. When switching to the image P2 at time t2, a change in the image is detected at the next sampling timing (step S12), the sound up to that point is written to the sound storage means 19, and the flag is reset to 0. (Step S13).
Next, when the image changes to P3 at time t3, a change in the image is detected at the next sampling timing. Since the flag is “0”, the sound up to that point is added to the end of the previous sound data. Writing is performed in such a manner that it is continuously added (step S14).

Although the image P4 is displayed at time t4, the image P4 is ignored because it is switched to the next image before the next sampling timing. When switching to the image P5 at the time t5, a change in the image is detected in the next sampling, but the flag is “0” (step S12), so that the sound up to that point is the last of the previous sound data. Writing is performed in such a manner that it is continuously added (step S14).
Then, when a change in the image is detected and a predetermined time α or more has elapsed (steps S15 and S16), it is determined that the image has been displayed for a predetermined time or more and is registered in the image storage means 18, and at the same time, the flag is set to “1”. Is set (step S17).
The magnitude of the time α can be determined independently of the sampling period, but may be an integral multiple of the sampling period.

After that, after the image P5 is displayed for a while, when it is switched to the image P6 at time t6 (step S11), a change in the image is detected at the next sampling timing. At that time, since the flag is “1” (step S12), the sound up to that point is written to the voice storage means 19 and the flag is set to “0” (step S13).
By such processing, images that are unintentionally displayed for a short time are not stored in the image storage means 18, and audio data uttered during a period in which these images are displayed for a short time are stored for a predetermined time before that. The audio data is stored in the audio storage unit 19 following the audio corresponding to the image displayed and stored in the image storage unit 18.

As shown in a simplified manner in FIG. 8, in the second method, the data of the images (1) and (5) displayed for a predetermined time or longer are stored in the image storage means 18 and acquired during the display period of these images. The data of the voices (1) and (5) are stored in the voice storage means 19 in association with each image data by a known method (for example, association by an identifier).
Then, the data of the images (2), (3), and (4) that have been displayed for a short period of time shorter than the predetermined time are discarded and not stored in the image storage means 18, and the images (2), (3), and (4) are displayed. The audio data (2), (3), and (4) acquired during the period are stored in the audio storage means 19 in succession to the audio data (1) corresponding to the immediately preceding display image (1).
That is, the audio data (2), (3), and (4) are stored in the audio storage means 19 as audio data subsequent to the immediately preceding audio data (1), and play a role such as an explanation of the display image (1), for example. Can fulfill.

In the first method or the second method, audio corresponding to a period in which an image is unintentionally displayed only for a short time (less than a predetermined time) is collectively added and recorded continuously either immediately before or after. However, in the present invention, as shown in FIG. 9, the voices V2, V3, and V4 corresponding to the period in which the image is displayed for less than a predetermined time are divided into two, and the divided voices V2 and V3 on the front side are divided. A third method may be used in which the immediately following voice V1 is added and recorded, and the divided rear voice V4 is added and recorded before the immediately following voice V5.
As a method for dividing the sound in this way, a period in which an image that does not need to be stored is displayed is divided according to the characteristics of the sound (for example, a silent section), and is divided into front and rear and connected to the respective front and rear sounds. Record.

  By such processing, images that are unintentionally displayed for a short time are not stored in the image storage means 18, and audio data uttered during a period in which these images are displayed for a short time are predetermined before and after that. The sound is stored in the sound storage means 19 in such a manner that it is distributed to the sound corresponding to the image displayed for at least the time and stored in the image storage means 18.

As shown in a simplified manner in FIG. 10, in the third method, the data of the images (1) and (5) displayed for a predetermined time or longer are stored in the image storage means 18 and acquired during the display period of these images. The data of the voices (1) and (5) are stored in the voice storage means 19 in association with each image data by a known method (for example, association by an identifier).
Then, the data of the images (2), (3), and (4) that have been displayed for a short period of time shorter than the predetermined time are discarded and not stored in the image storage means 18, and are acquired during the display period of the image (3). The audio data (3) is divided into front audio data (3-front) and rear audio data (3-rear), and the front audio data (3-front) corresponds to the immediately preceding display image (2). Along with the audio data (2), the audio data (1) is continuously stored in the audio storage means 19, and the rear audio data (3-after) is the audio data (4) corresponding to the display image (4) immediately after. At the same time, the audio data (5) is stored in the audio storage means 19 continuously.
That is, the audio data (3) is stored in the audio storage means 19 after being divided into the preceding and succeeding audio data (1) (2) and (4) (5).

FIG. 11 shows the configuration of a data registration system according to another example of the present invention.
The system shown in FIG. 11 stores a personal computer 21 used by a user (presenter or the like who makes a presentation), a program that constitutes a function necessary for the present invention, and registration data in the personal computer 21. And a small portable data registration device 31.

  The personal computer 21 has a known configuration, and displays a document image on the display screen 22 based on image data stored in the internal memory and switches the displayed document image in accordance with a user operation. Can do. Further, the personal computer 21 has a microphone 23 and can take in a voice spoken while looking at a document image.

The data registration device 31 is composed of a small memory device called a USB memory device, for example, and can be connected to the personal computer 21 from an input / output terminal (for example, a USB terminal) of the personal computer 21. It can be removed from the computer 21 and carried.
The data registration device 31 has a built-in memory 32. The memory 32 is provided with a storage area for storing registration data 33 in which image data and audio data are associated with each other, and the personal computer 21 according to the present invention. A registration program 34 for configuring functional means for data registration is stored in advance. In the memory 32 of this example, a browsing program 35 for reproducing the registration data 33 stored in the memory 32 in the personal computer 21 is also stored in advance.

  In this example, when the data registration device 31 is connected to the personal computer 21 and a program reading instruction is input to the personal computer 21, the personal computer 21 reads the registration program 34 or the browsing program 35 stored in the data registration device 31, When the personal computer 21 executes the registration program 34 or the browsing program 35, functional means necessary for data registration in the personal computer 21 or functional means necessary for reproducing the registration data 33 stored in the memory 32 Is configured.

That is, as shown in FIG. 12, by executing a registration program 34 in the personal computer 21, main functional units 11 to 17 included in the data registration device 4 are configured.
Specifically, the personal computer 21 captures image data that is input to the display screen 22, image capture means 11 that captures image data that is output, temporary image storage means 12 that temporarily stores image data, and microphone 23. Audio capturing means 13, audio temporary storage means 14 for temporarily storing audio data, image sampling means 15 for sampling image data acquired by the image capturing means 11 at a predetermined period, and sampled image data before and after being compared An image comparison unit 16 and an image determination unit 17 for determining whether there is a change between the compared images are included.

  On the other hand, an image storage unit 18 that stores image data to be registered, and an audio storage unit 19 that stores audio data input from the microphone 23 in correspondence with each image data stored in the image storage unit 18. The registration data storage area of the memory 32, and the image data and the audio data registered as described above by the personal computer 21 are input to the data registration device 31 from the personal computer 21 in association with each other. 31 stores the image data and the sound data in the registered data storage area 33 of the memory 32 in association with each other.

  The feature of the present invention is to determine whether or not an image is displayed for a predetermined time or more. When the image is displayed for a predetermined time or more, the image data is stored and registered, and when the image is displayed for less than a predetermined time, the image is stored. However, for the audio data acquired during the image display period, the audio data for the period corresponding to the unsaved image is recorded as the audio for the period corresponding to the stored image, so that the audio data is recorded without being lost. It means that the data is linked and recorded, and the division and connection of the audio data are not limited to the above example, and various methods can be adopted.

  Further, in the present invention, the image data to be captured may be a file or the like from which the image is displayed and output, and is not intended to only capture image data that is being displayed. Specifically, for example, corresponding image data may be acquired from the image data file corresponding to the identification information (page number, display time, etc.) of the displayed image.

In the present invention, the audio data to be stored is not necessarily all input, and for example, audio data in which a silent period is omitted may be stored.
In the present invention, data such as silence data and sound effect data may be inserted and stored in the input voice data.

  In the present invention, image data and audio data are stored as they are, and are registered and stored as a list in which image data and audio data are associated (for example, a play list with a playback order determined). Also good.

It is a figure which shows the structure of the presentation data registration system which concerns on one Example of this invention. It is a figure explaining the data registration process based on one Example of this invention. It is a figure explaining the data registration process based on one Example of this invention. It is a figure explaining the data registration processing procedure which concerns on one Example of this invention. It is a figure explaining the registration data based on one Example of this invention. It is a figure explaining the data registration process based on one Example of this invention. It is a figure explaining the data registration processing procedure which concerns on one Example of this invention. It is a figure explaining the registration data based on one Example of this invention. It is a figure explaining the data registration process based on one Example of this invention. It is a figure explaining the registration data based on one Example of this invention. It is a figure which shows the structure of the presentation data registration system which concerns on another one Example of this invention. It is a figure which shows the structure of the presentation data registration system which concerns on another one Example of this invention.

Explanation of symbols

2: Projector, 3: Microphone,
4: Data registration device, 11: Image capturing means,
12: Image temporary storage means, 13: Audio capturing means,
14: sound temporary storage means, 15: image sampling means,
16: Image comparison means, 17: Image determination means,
18: Image storage means, 19: Audio storage means,
21: Personal computer 22: Display screen
23: Microphone, 31: Data registration device,
32: Built-in memory, 33: Registered data storage area,
34: Data registration program,

Claims (7)

Image capturing means for capturing image data indicating the displayed and output image;
Audio capturing means for capturing audio data indicating audio corresponding to the image;
Storage means for storing image data and audio data in association with each other;
A determination unit that determines image data to be registered based on a display time of an image indicated by the image data captured by the image capture unit;
The image data determined to be registered by the determination means and the audio data captured by the sound capture means during the period when the image indicated by the image data is displayed are stored in the storage means in association with each other, and The image data determined as non-registered by the determining unit is excluded from the registration target stored in the storage unit, and the audio captured by the audio capturing unit during the image display period indicated by the non-registered image data data is divided by a silent interval, registers for registering process of storing in the storage means each is continuous with the audio data associated with the image data of a subject in last displayed before and after these audio data the image Means,
A data registration device comprising:   The determination unit determines whether or not the image data is to be registered based on whether or not the display time of the image indicated by the image data is displayed and output for a predetermined time or more. The data registration device according to claim 1.   The determination means periodically samples the images captured by the image capture means, compares the images before and after the successive sampling, and determines the time during which these images change as the image display time. The data registration apparatus according to claim 2, wherein: Connection means for connecting to the computer;
Storage means for storing image data and audio data in association with each other;
Image capturing means for capturing image data indicating an image displayed and output to the computer, sound capturing means for capturing sound data indicating sound corresponding to the image, and image data captured by the image capturing means Determining means for determining the image data to be registered based on the display time of the image indicated by the image, and the audio capture during a period in which the image data determined to be registered by the determining means and the image indicated by the image data are displayed. The audio data captured by the importing unit is associated with the storage unit and stored in the storage unit, and the image data determined to be non-registered by the determination unit is excluded from the registration target stored in the storage unit, and the registration is performed. the audio data captured by the non-target image data is the sound capturing means during the display period of the image shown by dividing by silent section, these audio data of the image The computer registration program constituting the registration means, the performing the registration process, each is continuous with the audio data associated with the image data of a subject in last displayed stored in the storage means is readable storage after Program storage means;
A data registration device comprising: An image display device for displaying and outputting an image;
A microphone for voice input,
A data registration device that registers image data and audio data in association with each other,
The data registration device includes:
Image capturing means for capturing image data indicated by an image displayed and output by the image display device;
Audio capturing means for capturing audio data input by the microphone;
Storage means for storing image data and audio data in association with each other;
A determination unit that determines image data to be registered based on a display time of an image indicated by the image data captured by the image capture unit;
The image data determined to be registered by the determination means and the audio data captured by the sound capture means during the period when the image indicated by the image data is displayed are stored in the storage means in association with each other, and The image data determined as non-registered by the determining unit is excluded from the registration target stored in the storage unit, and the audio captured by the audio capturing unit during the image display period indicated by the non-registered image data data is divided by a silent interval, registers for registering process of storing in the storage means each is continuous with the audio data associated with the image data of a subject in last displayed before and after these audio data the image Means,
A data registration system comprising: An image display device for displaying and outputting document images used in the presentation;
A microphone for inputting voice spoken in the presentation;
A data registration device that registers image data and audio data in association with each other,
The data registration device includes:
Image capturing means for capturing image data indicated by an image displayed and output by the image display device;
Audio capturing means for capturing audio data input by the microphone;
Storage means for storing image data and audio data in association with each other;
A determination unit that determines image data to be registered based on a display time of an image indicated by the image data captured by the image capture unit;
The image data determined to be registered by the determination means and the audio data captured by the sound capture means during the period when the image indicated by the image data is displayed are stored in the storage means in association with each other, and The image data determined as non-registered by the determining unit is excluded from the registration target stored in the storage unit, and the audio captured by the audio capturing unit during the image display period indicated by the non-registered image data data is divided by a silent interval, registers for registering process of storing in the storage means each is continuous with the audio data associated with the image data of a subject in last displayed before and after these audio data the image Means,
A presentation data registration system characterized by comprising: On the computer,
Image capturing means for capturing image data indicating the displayed and output image;
Audio capturing means for capturing audio data indicating audio corresponding to the image;
Storage means for storing image data and audio data in association with each other;
A determination unit that determines image data to be registered based on a display time of an image indicated by the image data captured by the image capture unit;
The image data determined to be registered by the determination means and the audio data captured by the sound capture means during the period when the image indicated by the image data is displayed are stored in the storage means in association with each other, and The image data determined as non-registered by the determining unit is excluded from the registration target stored in the storage unit, and the audio captured by the audio capturing unit during the image display period indicated by the non-registered image data data is divided by a silent interval, registers for registering process of storing in the storage means each is continuous with the audio data associated with the image data of a subject in last displayed before and after these audio data the image Means,
A data registration program comprising:

Images