KR100585678B1 - Motion effect providing and editing system through video signal and method thereof - Google Patents

Abstract

The present invention relates to a motion effect providing and editing system and method using a video signal configured to provide physical vibration or motion in synchronization with audio / video (hereinafter referred to as AV) playback to a user, The system for controlling a separate driving means with a specific motion effect control signal uses a digital audio signal provided by the AV playback unit as a means for synchronizing the playback and motion effects, so that the AV playback unit cannot output a digital audio signal of a specific format. It is not applicable, and it is easy to cause malfunction due to similar audio signals, and because it is not possible to generate synchronizing audio information and motion effect information corresponding to the AV medium to be reproduced by itself, the relevant information must be obtained separately. Is difficult to obtain information for synchronization The. In view of the above problems, the present invention obtains a video signal of a portion of a video image to be reproduced to generate motion image data, sets motion effect information accordingly, and generates data for a synchronization database. When the playback is performed, the playback video image data is compared with the pre-generated sync image data to detect a portion requiring an operation effect, and the user may experience the motion effect using the motion effect information corresponding to the sync image data. The driving means may be operated to acquire the video image being played back according to the user's needs, to generate the synchronous image data, and to set the motion effect information according to the editing operation of the user, and to synchronize the synchronization database data corresponding to the synchronous image data. By creating it, Regardless of the audio / video data format, malfunction-free synchronization is possible, and users can edit synchronized image data and motion effect information for a specific audio / video medium, and manage the edited data in various ways. It can also be shared with others, eliminating the limitation of audio / video media that can provide motion effects.

Description

MOTION EFFECT PROVIDING AND EDITING SYSTEM THROUGH VIDEO SIGNAL AND METHOD THEREOF

1 is a simple block diagram showing a conventional operation effect providing system using a simple audio signal.

2 is a simple block diagram showing a conventional operation effect providing system using an audio signal as a synchronization signal.

3 is a system conceptual diagram of one embodiment of the present invention;

4 is a system block diagram of an embodiment of the present invention.

5 illustrates an example of a process of acquiring synchronous image data used in the present invention.

6 is a view showing a video signal synchronization confirmation method according to an embodiment of the present invention.

7 is a view showing a video signal synchronization confirmation method according to another embodiment of the present invention.

8 is a list of operational effects and variations of an embodiment of the present invention.

9 is a system block diagram of another embodiment of the present invention.

10 is an example showing an operation effect editing screen using the system shown in FIG.

11 is a block diagram of an editing system of another embodiment of the present invention.

12 is an example showing an operation effect editing screen using the system shown in FIG.

Figure 13 is a flow chart showing a driving procedure of the operation effect providing system according to an embodiment of the present invention.

* Description of the symbols for the main parts of the drawings *

100: normal AV disc 200: AV playback unit

300: display and sound generating unit 400: motion effect providing device

410: motion effect data extractor 420: motion effect database

430: motion effect generator 440: synchronization database

450: edit screen display unit 460: edit control unit

470: input processing unit 500: driver control and drive signal generation unit

550: driving unit 700: operation effect edit screen

710: Video playback screen 720: Motion effect designation area for each drive unit

730: operation effect confirmation area 800: AV playback unit

850: computer / editor 855: data storage

870: display unit 890: input processing unit

900: Effect Editor 910: Video Stream Display Area

920: motion effect editing area 930: motion effect selection area

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system and method for providing and editing motion effects using a video signal configured to provide physical vibration or movement in synchronization with audio / video (hereinafter referred to as AV) playback to a user. After synchronizing the timing of the motion effect generation with the set synchronous image data, at the time when the specified video data is reproduced, one or more driving units are driven with the motion effect information stored corresponding to the synchronous image data so that the user can feel the virtual reality. A system and method for providing and editing motion effects using video signals are provided.

A century after the debut of silent films, technology in video and sound has made great strides. This makes it easy to find a wide range of AV playback systems around, ranging from large systems that provide wide, clear screens and stereoscopic sound to personal systems that make up home theaters.

This is due to the desire of modern people who have more leisure time to watch video at a higher level, and the desire for wider, clearer screens and more surround stereo sound with more channels is more inclined to those who want to enjoy more realistic video and sound. Well represented.

Thus, recent advances in AV technologies are making efforts to allow viewers to obtain realism through other senses besides sight and hearing. In other words, systems have been developed to enable AV viewers to experience motion in real video by using new means for stimulating the sense of touch or balance.

These sensational AV systems are systems that provide specific motion effects according to movements in the AV image, and are used as haptic devices in amusement parks or as haptic devices in virtual reality systems. However, the haptic devices in the haptic rides or the virtual reality system have dedicated playback means, and acquires synchronization information through the specific communication channel with the dedicated playback means, and then uses the dedicated drive to synchronize the motion effects to the AV being played. Since there is a need for a motion effect providing means configured to provide, it is difficult for an individual to possess a motion effect only when all dedicated means are provided. In addition, such an effect can be experienced only through dedicated AV data, and such an operation effect cannot be obtained through an AV medium or a general image according to a standard video format.

Accordingly, the AV system has been developed for individual or family units that minimize the volume of the system while stimulating the sense of touch or balance while reproducing general AV media or images.

FIG. 1 is a block diagram of a system for providing a conventional motion effect in the related art, and has a configuration in which vibration is provided to a user using a simple audio signal as shown. In other words, in view of the fact that the speaker causes severe vibration in the bass sound, the silent vibration speaker 35, which does not sound but generates more vibration, is brought into contact with the viewer's skin or mounted on a viewing chair, The filtering and amplifying the audio signal through the amplifying unit 30 is configured to provide an operation effect providing means to vibrate the silent vibration speaker 35. Only by adding this to the AV playback environment including the general AV player 10, the display unit and the sound generator 20, the viewer can feel the physical vibration in the portion where the bass sound is generated.

This can provide a stimulating experience to the viewer through a relatively inexpensive and simple configuration, but simply responds to the bass generated from the audio signal, so it often does not respond to on-screen motions and is mounted on a viewing chair. Vibration felt by the viewer is very weak, the reality is extremely low. In other words, it is merely a novelty that provides only a slight vibration and does not give the viewer a sense of reality because it is impossible to control the motion.

FIG. 2 is a block diagram of an individual or family unit effect effect providing system that provides a relatively superior reality, and includes one or more individually controllable drivers 75a to 75d and a driver control and drive signal generator capable of precisely controlling the same. 70 is a full-fledged realistic AV system including a driving means composed of 70) and an operation effect providing apparatus 60 capable of providing an operation effect specific to the driving means in synchronization with the AV data. A feature of this system is that in addition to the AV playback environment consisting of the general AV playback section 10, the display section and the sound generating section 20, it is possible to provide a realistic operating effect while playing back the general AV media. For this purpose, it is important to synchronize the playback time and the operation effect of the general AV media.

Referring to the structure shown, a general AV disc (DVD, BD, etc.) 41 is played back through the AV playback unit 40, which is a general playback means, and is used as a sound generator such as a display unit such as a television, a projector, and an audio system. The display unit and the sound generating unit 50 are provided to implement a typical reproduction environment. However, the AV reproducing unit 40 used herein must be able to output a packetized audio signal according to a specific digital format, which will be described later.

Here, referring to the structure of the motion effect providing apparatus 60 which provides the driving means with appropriate motion effects according to the AV progress state to be reproduced, the audio decoder 45 for decoding the audio signal obtained in the typical playback environment into a digital data packet. And a synchronization database 63 which analyzes in advance the general AV disc 41 to be reproduced and stores audio signals for a portion requiring a specific operation effect together with data indicative of a specific operation effect from the audio decoder 45. A synchronization analyzer 61 which determines whether there is a corresponding by comparing the received packet audio data with the audio signals stored in the synchronization database 63, a motion effects database 64 in which pre-made motion effect data is stored, and The copper judged by the synchronization analyzer 61 to match the portion being played back After receiving the motion effect instruction data corresponding to the existing audio signal from the synchronization database 63 and obtaining the indicated motion effect data from the motion effect database 64, based on this, drive the motion effect signal to control the driving means. Motion effect generation unit 62 provided by means.

In this case, the data of the synchronization database 63 is a motion effect instruction data that pre-extracts audio data of a desired position among audio data of a general AV medium to be reproduced, and defines motion effects to be executed when the corresponding audio data is reproduced. This means that if the AV medium to be reproduced, i.e., the general AV disc 41, is replaced, the stored synchronization database 63 becomes useless.

Accordingly, a separate disk (mostly a digital data compact disk) 42 for a synchronization database in which the developer samples the audio portion at the point of time when an operation effect is required in accordance with the general AV disk 41 and generates the motion effect instruction data accordingly. In order to accomplish this, a media player 65 for reproducing the dedicated disk 42 may be added to the operation effect providing apparatus 60. Alternatively, this information may be provided through a personal computer or the like, so that communication means for this may be added. As a result, the synchronization database 63 comprises a hard disk capable of updating contents. If there is free space on the hard disk, the motion effect data stored in the motion effect database 64 may also be stored in a predetermined area by configuring a specific set of files.

That is, in order to synchronize the progress and operation effects of a general AV medium to be reproduced using the audio signal, data that has been pre-analyzed and sampled from the audio signal of the AV medium to be reproduced and the corresponding motion effect indication data are required each time. Whenever the media is purchased, the data for the synchronization database produced for this purpose must be obtained in the state of a dedicated disc or information data.Whenever the AV media is replaced, the contents of the synchronization database must be checked to see if there is any data in the synchronization database. do. In other words, since the system does not sample the audio portion at the time when the motion effect is needed by itself, and generates the data for the synchronization database that generated the motion effect indication data accordingly, the system always acquires the data for the synchronization database from the outside. There is an inconvenience that must be done. First of all, it is impossible to provide an operation effect with an AV disc on which data for a synchronization database is not made, and such an operation editing is not possible with the system.

In addition, since an audio signal is used, a read error may occur if a portion of the AV content in which a similar audio signal is used exists.

In addition, the audio signal used herein is a digital audio signal adapted to a specific format, and has a limitation in that the audio signal can be classified in packet units through a decoder. If a general analog audio signal is used as the synchronization data, the audio data for a certain period of time is not compared to the static point of view, so it is ambiguous where to compare and where the comparison time is very long, so the fast search is difficult. Problems that are difficult to apply occur.

In other words, the system for providing a conventional operation effect is designed to allow a home or a small number of people to feel a virtual reality, but since the design concept uses a digital audio signal as a synchronization means, it cannot be applied to an AV system that outputs an analog audio signal. When a new AV disc is released, additional costs are continuously generated because a dedicated disc or data that is supplied later is separately purchased, and operation costs are not achieved with an AV disc without the corresponding data.

As described above, a system for controlling a separate driving means of a conventional operation effect providing system using a specific operation effect control signal uses a digital audio signal provided by the AV reproducing unit as a means for synchronizing the reproduction and operation effects. It is not applicable to an AV playback unit that cannot output a digital audio signal, and it is easy to cause malfunction due to a similar audio signal, and because it cannot generate synchronization audio information and motion effect information corresponding to the AV medium to be reproduced by itself, The information must be obtained separately, and it is difficult to obtain synchronization information for personal AV media.

In view of the above problems, the present invention obtains a video signal of a portion of a video image to be reproduced to generate motion image data, sets motion effect information accordingly, and generates data for a synchronization database. When the image is played back, the playback video image data is compared with the previously generated synchronous image data to detect a portion that requires an operation effect, and the user may experience the motion effect using the motion effect information corresponding to the synchronous image data. The driving means is operated so as to acquire the video image being reproduced according to the user's needs, to generate the synchronous image data, and to set the motion effect information according to the editing operation of the user, thereby obtaining the synchronization database data corresponding to the synchronous image data. Video signal to be generated To provide an effect provided by the operation and the editing system and method it is an object.

The present invention for achieving the above object, the media playback unit for reproducing the audio / video medium; Acquire the video signal of the medium reproducing unit and compare it with previously prepared and stored synchronous image data to provide an operation effect to the video image stored in the medium. An operation effect providing apparatus for acquiring operation effect information stored in correspondence with the control unit and outputting a control signal for providing a predetermined operation effect; And driving means for providing a physical stimulus to a user by a control signal of the operation effect providing device.

The apparatus for providing motion effects may include: a synchronization database configured to analyze in advance a video / audio medium reproduced by the medium reproducing unit and store synchronized image data of a portion requiring a specific motion effect together with motion effect information; An image synchronization analyzer configured to compare the image according to the video signal of the media player and the image data of the synchronization database to obtain motion effect information corresponding to the synchronized image data; And an operation effect generator for generating a control signal for controlling the driving means by using the operation effect information provided by the image synchronization analyzer.

In addition, the present invention includes a media player for reproducing an audio / video medium; A display unit which displays a screen by an externally provided video signal; By synchronizing the video signal of the media player to the display unit, a video signal being reproduced according to a user input is obtained and stored as synchronized image data, and the display unit provides its own editing screen to synchronize operation effect information specified by the user. And an operation effect editing device for connecting and storing the image data.

The operation effect editing apparatus may include an input processing unit which receives a user input; A synchronization database for storing the synchronized image data and motion effect information; An editing screen display unit which relays a video signal of the media player to the display unit and directly controls a part of the video signal to be relayed to output a desired operation effect editing screen on an on-screen display; Operation effect information designated as the user input while acquiring a media playback unit video signal provided from the edit screen display unit as synchronous image data by a user input of the input processing unit, and controlling the edit screen display unit to provide an operation effect edit screen. And an editing control unit for acquiring the data and storing it in the synchronization database.

In addition, the present invention is a media playback unit capable of audio / video playback; An input processing unit which receives a user input; A display unit for displaying image and information data; The display unit provides the display unit with the image processing the video data of the medium playback unit and the editing information for setting the motion effect information, obtains the desired video data by user operation through the input processing unit, and stores the desired video data as synchronous image data. And an operation effect editing apparatus for storing the operation effect information linked to the synchronous image data.

In addition, the present invention is a media playback unit for playing back audio / video media; A display unit which displays a screen by an externally provided video signal; By synchronizing the video signal of the media player to the display unit, a video signal being reproduced according to a user input is obtained and stored as synchronized image data, and the display unit provides its own editing screen to synchronize operation effect information specified by the user. The video signal of the media player is acquired and compared with the stored synchronous image data. When a matched video signal is reproduced, the user acquires the stored motion effect information corresponding to the synchronous image data. An operation effect providing and editing device for outputting a control signal for providing a specified operation effect; And driving means for providing a physical stimulus to a user by a control signal of the operation effect providing and editing apparatus.

In addition, the present invention obtains the image of the position of the video signal of the particular audio / video medium that requires the operation effect as the synchronous image data, and assigns the operation effect information according to the linked to the synchronous image data to reproduce the audio / video medium Storing as independent data corresponding to the data; Reproducing the medium by a medium reproducing means to output a video signal; Acquiring the reproduced video signal and comparing the stored synchronous image data to reproduce a matched video signal, extracting motion effect information linked to the corresponding synchronous image data, and generating a driver control signal according to the corresponding motion effect information; Steps; And controlling the driving unit with the generated driving unit control signal.

The acquiring and comparing the reproduced video signal with the stored synchronous image data may include comparing a partial region of an image represented by the reproduced video signal and an identical region of each image represented by the stored synchronous image data; Incrementally comparing the areas of the image to be compared if there is a synchronization image data matched at the step; The method may further include determining that the corresponding synchronous image data matches the video signal to be reproduced, even if the entire image region is compared by repeating the step of expanding and comparing the regions of the images to be compared.

In addition, the present invention provides a method comprising the steps of: playing back a specific audio / video medium by means of medium reproducing means; Pausing the operation of the reproduction means if it is determined that an operation effect is required among the reproduced video signals; Editing an operation effect to be performed using the video signal as a synchronization signal by using the operation effect editing means when the operation of the reproduction means is paused; And when the operation effect editing for the predetermined video reproduction time point is completed, acquiring and storing the paused reproduction video signal as synchronous image data and storing the edited motion effect information in association with the synchronous image data. It is characterized by.

When described in detail with reference to the accompanying drawings an embodiment of the present invention according to the above configuration.

3 is a conceptual diagram illustrating an example of a system configuration according to an exemplary embodiment of the present invention. As shown in FIG. 3, an AV disk 100 having general AV data stored therein and a general AV playback unit 200 capable of playing the AV disk 100 are illustrated. And a basic AV viewing device including a general display unit and a sound generating unit 300, and an output video signal of the general AV reproducing unit 200, in which the AV disc 100 is analyzed in advance and stored together with motion effect information. An operation effect providing apparatus 400 for synchronizing a time point in which an operation effect is required in comparison with image data, and outputting a driving control signal for implementing an appropriate operation effect; and a driving control signal provided from the operation effect providing apparatus 400 By using the drive control and the drive signal generator 500 for properly driving the plurality of drives 550 to provide a physical stimulus to the user as a basic configuration All.

The audio / video medium described as the AV disk 100 may be a compact disk (CD), a digital versatile disk (DVD), a blue-ray disk (BD), and a multimedia storage medium in which audio / video data may be stored. (Memory stick, memory card, etc.).

The basic operation of the present invention through the above configuration is to analyze the AV disc 100 to be reproduced in advance, to generate synchronous image data from a video signal of a point in time at which a motion effect is needed, and to define motion effect information to be provided at the time point. The first feature is to generate a specific AV disk dedicated synchronization data by interlocking them, storing the generated dedicated synchronization data in an internal database of the operation effect providing apparatus 400, and then playing the AV disk 100. The operation effect providing apparatus 400 continuously compares the reproduced video signal with the stored synchronous image data, and when synchronous image data corresponding to the reproduced video signal is detected, obtains operation effect information corresponding to the synchronous image data. Based on that information, the driver generates control signals There is a second feature.

The driving means (500, 550) that can provide a physical stimulus to the user may have a configuration that can be applied to a grandstand watching the AV to increase the realism by moving the grandstand three-dimensionally, for this purpose The driving means 500 and 550 may be mounted on a grandstand and grandstand support (legs). Although the operation effect providing apparatus 400 is shown separated from the grandstand, the operation effect providing apparatus 400 may also be mounted inside the grandstand.

Through the above configuration, the user can feel the excellent virtual reality in the grandstand that provides a three-dimensional motion effect in synchronization with the movement of the video image while watching the video image and the sound according to the playback of the general AV disk 100.

FIG. 4 is a block diagram illustrating the structure of the system for providing an operation effect shown in FIG. 3 in detail. In order to provide a realistic AV environment to a user, a driver control and driving signal generator 500 and a plurality of drivers ( Referring to the structure of the operation effect providing apparatus 400 which provides a driving control signal to a driving means composed of 550, the general AV disc 100 reproduced by the AV reproducing unit 200 is analyzed in advance for a specific operation effect. Compares the synchronization database 440 storing the synchronization image data for the required portion with the motion effect information with the image according to the video signal of the AV playback unit 200 and the synchronization image data of the synchronization database 440. An image synchronization analyzer 410 for acquiring operation effect information corresponding to the synchronized image data, and an operation effect definition provided by the image synchronization analyzer 410. By using the motion effect generator 430 for generating a control signal for controlling said drive means (500, 550) it is included by default.

In this configuration, the motion effect information stored in the synchronization database 440 includes all the motion effect pattern data for generating the actual motion effect, and the motion effect generator 430 is included in the motion effect information. The driving means control signal is generated by the operation effect pattern data.

However, in the present exemplary embodiment, the standardized specific motion effect data is separately configured into the motion effect database 420, so that the standardized specification of the motion effect database 420 is not performed without inserting specific motion effect pattern data into the motion effect information. While referring to the motion effect data (ie, specifying the desired specific motion effect data), it includes information that transforms the referring motion effect data. In this case, the motion effect generator 430 obtains suitable motion effect data from the motion effect database 420 by using specific motion effect data designation information included in the motion effect information and information for modifying the same. This may be modified to generate a control signal for controlling the driving means.

As described above, when the standardized specific motion effect data is stored in the motion effect database 420 and embedded in the motion effect providing apparatus 400, the size of motion effect information stored in the synchronization database 440 is reduced. When editing data stored in the synchronization database 440 through other editing means, compatibility can be easily maintained. This enables sharing of synchronization data corresponding to a particular AV medium to be stored in the synchronization database 440. Of course, even in the case of directly embedding specific motion effect data in the motion effect information, it is possible to share and distribute the corresponding synchronization database data if standardizing the specific motion effect, but the size of the data to be shared is increased, so as shown in FIG. The motion effect database 420 is preferably embedded in the motion effect providing apparatus 400.

Since the synchronous image data stored in the synchronization database 440 and the operation effect information connected thereto are data created for a specific AV disc 100, the contents of the corresponding synchronization database 440 are changed when another AV disc is played. Should be. Alternatively, at least the synchronous video data for the newly reproduced AV disc and the operation effect information connected thereto should be further added.

Therefore, the synchronization database 440 is preferably a storage means for storing information, it should be easy to modify, delete, copy, move the stored data, and should be able to easily store data provided from the outside. In addition, it must be able to read data at high speed to analyze image synchronization. Therefore, the synchronization database 440 may use a nonvolatile memory device (eg, EEPROM, FLASH ROM, etc.), a hard disk, a multimedia memory card, or the like. However, it is desirable to use a hard disk in terms of cost for capacity or to retain a large amount of data. If the capacity of the storage means is sufficient, as shown, the motion effect database 420 in which specific motion effect data are stored may also be located in a part of the same storage means storing the synchronization database 440.

As the information stored in the synchronization database 440 is newly added as the AV disk 100 to be played back is changed as described above, or existing contents should be changed, synchronization data to be used externally should be provided. Since it can be delivered to the outside to preserve the contents, wired and wireless communication means for exchanging data in the synchronization database 440 may be further added to the operation effect providing apparatus 400.

In addition, as shown, any of the storage media 402, 403 can be provided if the data for the synchronization database 440 can be provided from various storage media 402, 403 in which the synchronization data can be stored. A media reproducing unit 401 capable of reproducing support storage media may be added to the operation effect providing apparatus 400 to provide new data to the synchronization database 440.

Now, a description will be given of a method of generating synchronous image data stored in the synchronization database 440 and a content of the image synchronous analyzer 410 for synchronizing time points that require an operation effect by comparing them with a reproduced video signal.

First, FIG. 5 illustrates a concept of generating pre-generated synchronous image data before reproducing a corresponding media in order to synchronize a time point at which an operation effect is performed with a specific audio / video medium.

As shown, the synchronous image data to be stored in the synchronization database is image data of the time point at which an operation effect is required among the reproduced video signals of the specific audio / video medium, and has a high compression ratio image in order to reduce the data size and simplify the comparison process. The simplification algorithm compresses the original video image data into thumbnail images. Such compression is simply a method of converting the image to gray scale, extracting only the outline of the image, and reducing the data size by high-level compression (JPEG, GIF, etc.), so that only the features of the image remain. This reduces the size of the synchronous image data to be stored and simplifies the comparison process when comparing with the original video signal. Of course, in comparison, the original video signal should also be compressed by the compression method used to generate the synchronous image data.

6 illustrates a process of comparing the synchronous video data generated by the above process with the AV video output video signal. Here, only one synchronous video data is described. It should be compared with the video signal being played. This process is performed in the synchronous image analyzer. Here, the output video signal of the AV playback unit may be either an analog video signal or a digital video signal, and note that a specific signal method does not pose a problem in implementing the present invention.

In the simplest case, the video signal of the reproduced AV medium is compressed in the same manner as the synchronous video data, and then the information is compared with all the stored synchronous video data and the entire area. There is a fear that the real-time performance is lowered.

Therefore, in an exemplary embodiment of the present invention, as shown, basically, only a comparison of a partial region is performed, and when a matching image is found for a corresponding region, the comparison region is gradually expanded, and the comparison is performed in comparison with the entire image region. If it is confirmed that the operation, as a ratio, it is a method for determining that there is motion effect information synchronized with the video signal to be reproduced.

6A to 6D show video signals of an AV playback unit which are reproduced sequentially, and proceed from left to right. And the compared thumbnail image is one of the synchronous image data, and all the synchronized image data stored with respect to one AV reproduction unit video signal are compared.

First, at the time when FIG. 6A is reproduced, the video signal of FIG. 6A is reproduced and the image data is simplified by a simplification algorithm used when generating synchronous image data. The area is divided into several pieces that are promised, and one of them (here 9 pieces are used) is used as the comparison area. After acquiring the data for the comparison region, the same first comparison region s1 data is extracted from one of the stored synchronous image data, and it is determined whether or not it matches the comparison region a1 of the reproduced video image data. In this case, since there is no matching image, the synchronization image data is performed regardless of whether the first comparison region of the next synchronization image data is extracted again and compared.

Then, the same comparison process is also performed at the time when FIG. 6B is reproduced. This comparison process may be performed for all AV player output video image data, and may be performed at a predetermined interval (for example, every fifth frame or one second). Each time).

Next, when it is found that the comparison area c1 of the playback video image and the comparison area s1 of the specific synchronous image data coincide with each other when FIG. 6C is reproduced, the comparison area of the playback video image is further extended and expanded. The areas c1, c2, c4 and c5 are compared with the extended comparison areas s1, s2, s4 and 5 of the synchronous image data. In this case, when the comparison result is matched, the entire image area is compared. When the result is determined to be matched, motion effect information stored in association with the corresponding synchronous image data is acquired to implement the motion effect.

The same comparison is also performed at the time point when FIG. 6D is reproduced.

In this case, since the same screen may be output for a predetermined time, when the reproduction time coinciding with the synchronized image data is provided to provide an operation effect, the above-described image synchronization analysis may not be performed until all the operation effects are provided. .

FIG. 7 illustrates an example in which a comparison area between a reproduced video signal and synchronous image data is differently defined. As shown in FIG. 6, the image is not divided into nine equal parts as shown in FIG. Vdata, Hdata) to compare only the image data of the corresponding part. In this case, if there is synchronous video data consistent with the playback video of the corresponding part, the corresponding synchronous video data may be gradually grasped over the entire video area by expanding the area a little and comparing the expanded areas as shown in FIG. 7B. Can be.

By using the above-described methods, it is possible to compare the synchronous image data matched with the reproduced video signal relatively quickly, thereby minimizing time delay caused by the comparison.

FIG. 8 illustrates synchronization image data synchronized with video data reproduced in the same manner as FIGS. 6 to 7, acquires motion effect information stored in a synchronization database in association with the same, and generates motion effects based on the same. It is for explaining the operation of the motion effect generator. The motion effect information used in the present embodiment includes data designation information of a predetermined motion effect database and information for modifying the designated motion effect data (time, size, etc.).

The motion effect data table on the left shows specific motion effect pattern data pre-stored in the motion effect database. The motion effect examples on the right generate an operation control signal by appropriately modifying one motion effect selected from the motion effect database. The output of the effect generator is shown.

The operation effect database data on the left is made of digital data representing a predetermined waveform, and may simply be a simple wave file (.WAV). That is, it consists of a set of continuous displacement values composed of appropriate sampling frequencies. The length, amplitude, and sampling frequency can be determined by the designer's design intention and the operating characteristics of the driver.

8B to 8E of the right side transform one of them (data 3) into simple displacement values, and the resulting operation is appropriately presenting a time ratio value for adjusting the length and a size ratio value for adjusting the amplitude. The effect is a big difference, which means it can deliver more delicate and diverse physical stimuli to the user.

FIG. 9 is a block diagram illustrating a configuration of another embodiment of the present invention, in which motion effect editing means is further added to the motion effect providing apparatus of the motion effect providing system shown in FIG.

As shown in the drawing, the video output of the AV playback unit 200 is not directly provided to the display unit and the display unit of the sound generator 300, but the connection is changed so as to be connected through the operation effect providing and editing apparatus 400. This is because the operation effect providing and editing apparatus 400 transmits the video signal of the AV playback unit 200 to the display unit as it is, extracts the video signal, and provides the display unit to the display unit according to the user's selection. This is to superimpose on the video signal of 100) to further provide a screen for motion effect editing. A technique for inserting a screen for editing such an operation effect into a reproduced AV video image may use a known on-screen display technique.

That is, in the motion effect providing and editing apparatus 400, the motion effect editing part relays a video signal of the AV playback unit 200 to a display unit, acquires a video signal being reproduced according to a user input, and converts the video signal into synchronous image data. It stores the motion effect editing screen on the display unit and stores the motion effect information specified by the user through the input means in connection with the synchronous image data and stores it in the synchronization database 440. Even if there is no synchronization data for the AV disc 100 to be reproduced through this, the user can directly generate it, and the already created synchronization data can be edited.

If the operation effect editing portion is further classified, an input processing unit 470 for generating a specific signal by receiving a user input using a panel switch or a remote controller, and the video signal of the AV playback unit 200 as a display unit. And an editing screen display unit 450 for directly controlling a part of the video signal to be relayed and outputting a predetermined operation effect editing screen on an on-screen display, if necessary, by a user input of the input processing unit 470. The AV playback unit 200 provided by the edit screen display unit 450 acquires a video signal as synchronous image data, and controls the edit screen display unit 450 to provide a motion effect edit screen to the display unit to accept user input. Editing control unit for acquiring the motion effect information on the synchronized image data and storing this information in the synchronization database 440 460.

Note that the motion effect editing portion may further add a synchronization database 440 to implement an independent motion effect editing apparatus.

However, when the motion effect providing and editing apparatus 400 in which the motion effect editing portion is added to the motion effect providing apparatus is integrally implemented, the user himself / herself synchronizes the synchronization data even for an AV medium that does not have special synchronization data. It can be created and realized, and if it is managed as a predetermined data file, it can be shared or distributed with multiple users. To this end, a wired / wireless communication unit for exchanging information of the synchronization database with the outside may be further added, and data input / output through this may be managed by the editing control unit 460 according to a user specification through the input processing unit 470. have.

As described above, if the user can directly generate the synchronization data while executing the AV disc 100, the possibility of popularization of the operation effect providing system according to the present invention is greatly increased. That is, by using the present embodiment, it is possible to accommodate the industry's analysis and demands that the diversification of contents contributes to the popularization of the system rather than the high performance of the system.

FIG. 10 illustrates an operation effect editing screen 700 provided in the configuration of FIG. 9, and menus for editing operation effects are displayed on a portion of the video playback screen 710. To this end, the user can pause the video image being played back and edit the operation effect to be provided from the time point at which the image is played.

In the illustrated example, a motion effect pattern may be selected using a motion effect designation region 720 for each driver, which is divided into tabs on the upper part of the screen, and a start time, duration, and size of the corresponding motion effect pattern may be specified for each driver. Make sure The designated content may be visually and globally confirmed through the operation effect checking area 730 located at the bottom of the screen. If necessary, you can also demonstrate motion effects specified by specific user input.

After all the desired motion effects are designated through the screen as described above and the editing is completed, the still video image is properly processed and stored in the synchronization database as synchronous image data, and the user-specified motion effect information is linked to the corresponding synchronous image data. It is stored in the synchronization database.

FIG. 11 shows a configuration of another embodiment capable of editing synchronized image data and motion effect information, showing a motion effect editing system based on a personal computer or a dedicated editor 850. As shown in FIG. Through this, the synchronization database data to be applied to the above-described operation effect providing apparatus may be separately generated.

The motion effect editing system using the video signal controls the AV playback unit 800 capable of playing the general AV disk 100 as a target, and has a computer / editor 850 having a predetermined data storage unit 855 therein. And an input processing unit 890 and a display unit 870 connected to the computer / editor 850. The display unit 870 is a dedicated display means such as a monitor, and may display both a program screen provided by the computer / editor 850 and a video image through the AV playback unit 800.

Therefore, when the user manipulates the input processor 890 to designate a desired video playback position while viewing the screen provided to the display unit 870, and edits the operation effect accordingly, the computer / editor 850 synchronizes the image data. And motion effect information are stored in the data storage 855.

FIG. 12 illustrates the operation effect editor 900 that the computer / editor 850 outputs to the display unit 870 in the configuration of FIG. 11. The illustrated user interface is intended for basic editing, and can be further refined and added with many functions, and the concept of editing can be varied. However, the user interface can be edited by a certain time unit simply through a screen frame.

The motion effect editor 900 may be used by a general user or a company that sells AV media to generate data for a synchronization database for a specific AV medium. When the specific AV media is played, the motion effect editor 900 may be displayed in the video stream display area 910. Images are displayed frame by frame, and the user adjusts them to determine a desired motion effect indication data insertion position.

Listed at the bottom of the motion effect editing area 920, which provides an editing area for each driving means (here, four separate driving means) to edit the effect for a predetermined time based on the determined position of the motion effect instruction data insertion frame. You can edit motion effects by selecting and pasting motion effects and adjusting their size and length.

The motion effects provided in the motion effect selection area 930 of the lower portion visually represent standard motion effect data.

When the desired insertion position, the desired motion effect and the deformation degree value of the motion effect are determined using the above means, the screen motion at the insertion position is stored as the synchronous image data, and the specified motion effect information is interlocked and stored. .

The stored synchronization database data may be generated as a file or folder in which files corresponding to the specific AV medium are stored, or a compressed file in which a plurality of files are compressed. , Sharing or distributing via the Internet).

FIG. 13 is a flowchart illustrating an operation of an operation effect providing system according to an exemplary embodiment of the present invention, in which synchronization image data and corresponding operation effect information of a video signal of a medium to be reproduced in advance are stored in a synchronization database.

First, when a normal AV medium without any action is played back using a media player, a video signal for viewing on a general display unit is output, and the motion effect providing apparatus acquires the simplified or used to generate the synchronous image data. Compression is performed by a compression algorithm and data of a certain area to be compared is obtained.

When there is no synchronous image data that matches the obtained compressed compressed video image of the predetermined region with the same region data of the previously stored synchronous image data, it returns to the initial operation state of acquiring a new reproduced video image.

If, as a result of the comparison, the predetermined synchronization image data or the synchronization image data coincide with each other, the area to be compared is increased to repeat the process of comparing the increased synchronization image data or the increased region of the image data with each other. Determine whether there is the same sync image data in the entire area. If there is no synchronous video data corresponding to the entire region of the compressed playback video image during the process, the process returns to the initial operation state of acquiring a new playback video image.

If there is synchronized image data corresponding to the entire region of the compressed video image compressed in the above process, the stored motion effect information is obtained corresponding to the synchronized image data, and the motion effect is generated using the same.

If the motion effect information is information including standard motion effect data designation information and information indicating a modification thereof, the motion effect database provided in the motion effect providing apparatus is searched based on the content indicating the standard motion effect from the data. Obtain the desired standard motion effect data. If the specified motion effect data does not exist in the database, all of the motion effect indication data are ignored. When the desired operation effect data is obtained in the above process, the driving unit is operated by providing the signal as a control signal to the driving means according to time while transforming it into the change values included in the operation effect instruction data.

The above process is repeated until the reproduction of the corresponding sensory AV medium is completed, and whether or not the completion of the corresponding sensory AV medium is completed may be confirmed by analyzing the video signal.

The operation method of the operation effect providing system is provided to summarize the essential parts of the present invention. In addition, the operation method and the process of the operation effect editing system mentioned in the present specification are omitted while describing the system. Do it.

As described above, the present invention stores the image of the portion requiring the operation effect as synchronous image data separately for the AV image requiring the operation effect, stores the operation effect information accordingly, and then reproduces the stored data. By continuously comparing with, it is possible to synchronize playback time points that require motion effects, thereby providing a physical stimulus to a user at a desired time point.

In addition, in the case of using the various editing system provided by the present invention, the user can edit a variety of AV images to which the motion effects are applied at a point in time desired by the user, and manage the edited data in various ways. It can be shared with others, so the playable AV video is not limited. In addition, if the data for the synchronization database is distributed and shared in the form of a motion effect file, such as a subtitle file provided as a separate file in the AV image, it may be easy to secure the contents of the motion effect providing system.

First of all, the present invention is configured to add an operation effect providing and editing device and driving means to the existing system, so that it is not necessary to change the AV playback system already in use for the virtual reality experience, and is insensitive to the type of the AV playback system. The wide range of applications is expected to attract a wider user base.

 As described above, the system and method for providing and editing motion effects using the video signal of the present invention acquire the video signal of the portion of the video image to be reproduced, and generate the synchronous image data, and set the motion effect information accordingly. After creating the data for the synchronization database, and when the corresponding video image is reproduced by comparing the reproduction video image data and the pre-generated synchronous image data to detect the portion that requires the operation effect, the motion effect information corresponding to the synchronous image data By operating the driving means so that the user can feel the motion effect by using, obtain the video image being reproduced according to the user's needs, create synchronous image data, and set the motion effect information according to the user's editing operation Synchronization to correspond to synchronous image data By generating the data for the database, it is possible to synchronize without malfunction regardless of the data format of the audio / video being played, and the user can edit the synchronized image data and motion effect information for a specific audio / video medium. The edited data can be managed in various ways and shared with others, thereby eliminating the limitation of audio / video media that can provide motion effects.

Claims (28)

A medium reproducing unit for reproducing an audio / video medium; Acquire the video signal of the medium reproducing unit and compare it with previously prepared and stored synchronous image data to provide an operation effect to the video image stored in the medium. An operation effect providing apparatus for acquiring operation effect information stored in correspondence with the control unit and outputting a control signal for providing a predetermined operation effect; And a driving means for providing a physical stimulus to a user by a control signal of the motion effect providing apparatus. The method of claim 1, wherein the driving means for providing a physical stimulus to the user comprises a plurality of driving units configured to move the viewing seat three-dimensionally and a driving control unit for controlling the driving seats. Effect providing system. The apparatus of claim 1, wherein the apparatus for providing motion effects comprises: a synchronization database configured to analyze in advance a video / audio medium reproduced by the medium reproducing unit and store synchronized image data of a portion requiring a specific motion effect together with motion effect information; An image synchronization analyzer configured to compare the image according to the video signal of the media player and the image data of the synchronization database to obtain motion effect information corresponding to the synchronized image data; And a motion effect generator for generating a control signal for controlling the driving means by using the motion effect information provided by the image synchronization analyzer. The apparatus of claim 3, wherein the apparatus for providing motion effects further includes a motion effect database in which specific motion effect data are pre-stored, and the motion effect generator generates motion effect data designation information included in the motion effect information and information for modifying the same. And acquiring suitable motion effect data from the motion effect database, and modifying the same to generate a control signal for controlling the driving means. The system of claim 1, wherein the medium reproducing unit output video signal provided to the apparatus for providing motion effects is an analog video signal or a digital video signal. 4. The system of claim 3, wherein the synchronization database is implemented as a storage means capable of managing data including a nonvolatile memory device, a hard disk, and a multimedia memory card. 4. The operation according to claim 3, wherein the synchronous image data stored in the synchronization database obtains image data of a desired position among video data of a reproduced audio / video medium and simplifies it through a simplification algorithm. Effect providing system. The apparatus of claim 3 or 7, wherein the image synchronization analyzer simplifies the video signal received from the media playback unit with a simplification algorithm used in generating the synchronous image data and compares it with the synchronous image data that is simplified and stored in a synchronization database. System for providing an operation effect using a video signal, characterized in that checking whether or not. The method of claim 7 or 8, wherein the simplification algorithm is an algorithm that changes the color of the image to gray scale, extracts only outlines, or leaves only the features of the image while reducing the data size through high-level compression. A system for providing motion effects using a video signal. The apparatus of claim 3, wherein the image synchronization analyzer compares only a partial region of the image signal of the received video signal with the same region of the synchronization image data stored in the synchronization database, and then compares the entire region data if there is a matching synchronization image data. System for providing a motion effect using a video signal, characterized in that for checking the match. The video signal according to claim 3, wherein the motion effect information corresponding to the synchronous image data stored in the synchronization database includes motion effect pattern information for each driver and information for modifying the motion effect pattern. Motion effect providing system using. The system of claim 3, further comprising a wired and wireless communication unit configured to exchange information of the synchronization database with the outside. 5. The video signal using the video signal of claim 3, further comprising a data storage medium dedicated playback unit for playing back a data storage medium storing predetermined synchronization data to provide synchronization data for a new playback medium to the synchronization database. Motion effect providing system. A medium reproducing unit for reproducing an audio / video medium; A display unit which displays a screen by an externally provided video signal; By synchronizing the video signal of the media player to the display unit, a video signal being reproduced according to a user input is obtained and stored as synchronized image data, and the display unit provides its own editing screen to synchronize operation effect information specified by the user. Motion effect editing system using a video signal, characterized in that it comprises a motion effect editing device for connecting and storing the image data. The apparatus of claim 14, wherein the motion effect editing apparatus comprises: an input processing unit which receives a user input; A synchronization database for storing the synchronized image data and motion effect information; An editing screen display unit which relays a video signal of the media player to the display unit and directly controls a part of the video signal to be relayed to output a desired operation effect editing screen on an on-screen display; Operation effect information designated as the user input while acquiring a media playback unit video signal provided from the edit screen display unit as synchronous image data by a user input of the input processing unit, and controlling the edit screen display unit to provide an operation effect edit screen. And an editing control unit for acquiring the data and storing the same in the synchronization database. The apparatus of claim 15, wherein the motion effect editing apparatus further comprises a wired / wireless communication unit for exchanging information of a synchronization database with an external device, and the editing control unit manages the same according to a designation of a user input processing unit. Motion effect editing system using signals. A media player capable of playing audio / video; An input processing unit which receives a user input; A display unit for displaying image and information data; The display unit provides the display unit with the image processing the video data of the medium playback unit and the editing information for setting the motion effect information, obtains the desired video data by user operation through the input processing unit, and stores the desired video data as synchronous image data. And a motion effect editing device for storing the motion effect information in association with the synchronous image data. 18. The motion effect editing system according to claim 17, wherein the motion effect editing apparatus is a personal computer or an image editing apparatus having data storage means capable of exchanging data with an external device. 18. The method of claim 17, wherein the synchronous image data and the motion effect information stored in connection thereto are stored in a folder for storing a file or files corresponding to a specific audio / video medium, or a plurality of files are compressed. Motion effect editing system using a video signal. 18. The apparatus of claim 14 or 17, wherein the motion effect editing apparatus for acquiring and storing video data from the medium reproducing unit and storing the video data as synchronous image data reduces the size of the acquired video data and retains only the features of the image. Motion effect editing system using a video signal, characterized in that it further comprises a compression means. A medium reproducing unit for reproducing an audio / video medium; A display unit which displays a screen by an externally provided video signal; By synchronizing the video signal of the media player to the display unit, a video signal being reproduced according to a user input is obtained and stored as synchronized image data, and the display unit provides its own editing screen to synchronize operation effect information specified by the user. The video signal of the media player is acquired and compared with the stored synchronous image data. When a matched video signal is reproduced, the user acquires the stored motion effect information corresponding to the synchronous image data. An operation effect providing and editing device for outputting a control signal for providing a specified operation effect; And a driving means for providing a physical stimulus to a user by a control signal of the motion effect providing and editing apparatus. The medium of claim 21, wherein the medium reproduced by the media player is a compact disk (CD), a digital versatile disk (DVD), a blue-ray disk (BD), or a multimedia storage medium capable of storing audio / video data. System for providing and editing motion effects using video signals. An image corresponding to an audio / video medium to be reproduced is obtained by acquiring an image of a position requiring an operation effect among video signals of a specific audio / video medium as the synchronized image data, and assigning the operation effect information according to the synchronized image data. Storing as data; Reproducing the medium by a medium reproducing means to output a video signal; Acquiring the reproduced video signal and comparing the stored synchronous image data to reproduce a matched video signal, extracting motion effect information linked to the corresponding synchronous image data, and generating a driver control signal according to the corresponding motion effect information; Steps; And controlling a driving unit using the generated driving unit control signal. 24. The method of claim 23, wherein acquiring, as synchronous image data, an image of a position requiring an operation effect among the video signals of the specific audio / video medium by acquiring a video signal of a position requiring an operation effect and simplifying the corresponding video signal. And reducing the size of the synchronous image data to be stored by processing with a high compression algorithm so as to reveal the characteristics of the image. 24. The method of claim 23, wherein the acquiring of the reproduced video signal and comparing the stored synchronous image data comprises: acquiring the reproduced video signal and processing the same by using a simplified and high compression algorithm used to generate the synchronous image data. Comprising the step of comparing with the image data further comprising the operation effect providing and editing method using a video signal. The method of claim 23, wherein the acquiring of the reproduced video signal and comparing the stored synchronous image data comprises: comparing a partial region of an image represented by the reproduced video signal with a same region of each image represented by the stored synchronous image data. Wow; Incrementally comparing the areas of the image to be compared if there is a synchronization image data matched at the step; The method may further include determining that the corresponding synchronous image data matches the video signal to be reproduced, even if the entire image region is compared by repeating the step of expanding and comparing the regions of the images to be compared. How to provide and edit motion effects using false signals. Playing the specific audio / video medium by the medium reproducing means; Pausing the operation of the reproduction means if it is determined that an operation effect is required among the reproduced video signals; Editing an operation effect to be performed using the video signal as a synchronization signal by using the operation effect editing means when the operation of the reproduction means is paused; And when the operation effect editing for the predetermined video reproduction time point is completed, acquiring and storing the paused reproduction video signal as synchronous image data and storing the edited motion effect information in association with the synchronous image data. Motion effect editing method using a video signal, characterized in that. 28. The method of claim 27, wherein the stored synchronous image data and motion effect information are stored in a storage means independent of the audio / video medium, and the data can be moved to another storage means, or the stored data can be edited or deleted. Motion effect editing method using a video signal.

Images