CN100518238C - Action effect providing system and its method using video signal - Google Patents
Action effect providing system and its method using video signal Download PDFInfo
- Publication number
- CN100518238C CN100518238C CNB2005101119432A CN200510111943A CN100518238C CN 100518238 C CN100518238 C CN 100518238C CN B2005101119432 A CNB2005101119432 A CN B2005101119432A CN 200510111943 A CN200510111943 A CN 200510111943A CN 100518238 C CN100518238 C CN 100518238C
- Authority
- CN
- China
- Prior art keywords
- action effect
- signal
- mentioned
- image
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Abstract
The invention relates to a system and method about the movement-effect of video signals, which is used to provide users with physical effects of vibration movements which are synchronized with the audio / video broadcast. The system includes: a unit for broadcasting audio/the audio of video media/ video, a supplying unit which is used for receiving the video signals of the audio/ video broadcaster and detecting the information about the effects of movements and detecting the inserted information of movement-effect and providing the controlling signals about the effects of movements with the same synchronization with the video signal, and a driving unit which is used to offering the physical stimulation to users.
Description
Technical field
The present invention relates to a kind of for provide the physical vibration or the movable action effect of making that are synchronized with audio/video (hereinafter to be referred as AV) broadcast that system and method thereof are provided to the user, refer in particular to the action effect that utilizes vision signal system and method thereof are provided, its effect is: the user can not be cognitive situation under will be used for indicating the action effect designation data of specific action to be inserted in video data after, when playing the associated video data, extract above-mentioned action effect designation data, drive the drive division more than 1 as indicated, thereby can make user's personal understanding to sensation on the spot in person.
Background technology
Film century so far from be born, during obtained the development of advancing by leaps and bounds about the technology of image and sound equipment.Greatly to super wide and picture and stereophonic very-large-scale system clearly can be provided, little of the ps that can constitute home theater, various AV Play Systems are seen everywhere.
Its explanation free time becomes many moderns and more and more wishes to see higher levels of image works, to super wide and clearly picture and more multichannel highlight people around stereophonic demand and like the trend of image and sound equipment more really.
Therefore, the AV technology that obtains develop rapidly recently just efforts be made so that spectators can obtain the sense of reality by vision and the outer another kind impression of the sense of hearing.That is, utilization can stimulate the new equipment of people's sense of touch or equilibrium sensation that the system of can the own experience actual image action of spectators AV is further developed.
This 3 D stereo AV system is meant the system that the specific action effect is provided according to the activity in the AV image, and the take a risk games of recreation (Resort Game) or the experience apparatus of virtual reality system of present a kind of experience is commonly used.But, the experience apparatus of this game experiencing utensil or virtual phenomenon system needs dedicated play equipment and action effect that equipment is provided, it is after obtaining synchronizing information by above-mentioned dedicated play equipment and specific communications channel that this action effect provides equipment, in order to provide the action effect that is synchronized with the AV in the broadcast to make by special-purpose drive unit.Thereby, have only whole special equipments of outfit could experience action effect, the individual is difficult to reach.In addition, can only could experience this effect by special-purpose AV data, and can't reach this action effect by the AV medium or the common image of standard video form.
Therefore, Yi Bian play common AV medium or image,, can improve the sense of reality Yi Bian stimulate people's equilibrium sensation.Thereby, make the body sense AV system of minimized individual of system bulk or home unit also obtain exploitation.
Fig. 1 is that original prevailing action effect provides system to constitute calcspar.As shown in the figure, it has the formation that can utilize simple audio signal that vibration is provided to the user, promptly refer to: be conceived to make loud speaker produce serious vibration at bass, not speaking but the skin or be installed in that produces the noiseless vibrating speaker 35 contact spectators of bigger vibration view and admire with on the chair, the audio signal that is used to play AV by 30 pairs in amplification portion is filtered (Filtering) and amplification then, and the action effect that vibrates above-mentioned noiseless vibrating speaker 35 provides equipment.With its additional AV playing environment that constitutes by common AV broadcast portion 10, display part and sound equipment generating unit 20 of giving, can make spectators feel physical vibration in the part that produces bass.
Though it can provide the experience that stimulates sense of touch by relatively cheaply and simply constituting to spectators, but owing to be reflected at merely from the bass of audio signal generation, so exist following problem: can not be complementary with the action on the picture in the time of mostly, and when be installed in view and admire with chair on the time, the vibration that spectators experience is very faint, and the sense of reality is extremely low.That is, only make the people merely the vibration a little that provides be felt novel, the control that can't move etc. at all, thereby can not give spectators' sense of reality.
Fig. 2 is that the individual of the sense of reality that can provide more true to nature or the action effect of home unit provide system block diagrams.This real 3 D stereo AV system comprises following two parts: control the driving arrangement that constitutes with drive signal generating unit 70 by the drive division 75a～75d that can carry out indivedual controls more than 1 with the drive division that can correctly control it; The action effect generator of the specific action effect that is synchronized with the AV data can be provided to above-mentioned driving arrangement.The system is characterized in that: the additional AV playing environment that is made of common AV broadcast portion 10, display part and sound equipment generating unit 20 of giving can provide the action effect that is rich in the sense of reality when playing common AV medium.For this reason, the broadcast time point of common AV medium and action effect most important synchronously, this just need pay close attention aspect the audio signal utilizing.
From illustrated structure, it plays common AV dish (DVD, BD etc.) 41 by ordinary playing equipment-AV broadcast portion 40, and having embodied typical playing environment, that is used display part that the sound equipment generating unit by TV, projector display parts such as (projector) and audio system etc. constitutes and sound equipment generating unit to listen to exactly and watches.But employed here above-mentioned AV broadcast portion 40 must can be according to the audio signal of specific number format dateout packetize, and it be the reasons are as follows:
The action effect generator 60 here can carry out state according to the AV that plays the action effect that is fit to is offered above-mentioned driving arrangement, from the formation of this action effect generator, it comprises following part: the audio decoder 45 that the audio signal decoding (decoding) that obtains is become the numerical data packet from above-mentioned typical playing environment; The general AV dish 41 that will play is carried out ex ante analysis, with the sync database 63 that needs specific action effect audio signal partly to store with the data of indicating the specific action effect; The packet voice data that receives from above-mentioned audio decoder 45 and the audio signal of above-mentioned sync database 63 stored are compared, judge whether the synchronous analysis portion 61 of relevant information; Store the action effect database 64 of the action effect data of prior making; From above-mentioned sync database, receive by above-mentioned synchronous analysis portion 61 be judged as with play in consistent synchronous of part with the pairing action effect designation data of audio signal, obtain the action effect data of indication from above-mentioned action effect database 64 after, the action effect signal that will be used for controlling and driving equipment based on this offers the action effect generating unit 62 of driving arrangement.
Here, the data of above-mentioned sync database 63 are meant the voice data of the position of wanting in the voice data of the general AV medium that will play of prior extraction, and the action effect designation data to defining at the action effect that the time point of playing the related audio data is implemented.It means that the sync database of having stored 63 will have no the ample scope for abilities if substituting the AV medium that will play is general AV dish 41.
Therefore, be to be fit to common AV dish 41, development company takes a sample to the audio-frequency unit of the time point that needs action effect, and the production and sales sync database that generated corresponding actions effect designation data is with Special disc (most of mean numerical data CD dish) 42 separately.For this reason, also can add the media play portions 65 that are used to play above-mentioned Special disc 42, perhaps also can provide this information, and then add communication equipment for this reason by PC to above-mentioned action effect generator 60.Therefore, the hard disk of above-mentioned sync database 63 usefulness renewable contentses is finished.If above-mentioned hard disk has clearance spaces, can constitute by the action effect data set of specific file just of being stored in the action effect database 64, it is stored in certain zone.
Promptly, for utilizing audio signal to make the process of carrying out and the action effect synchronization of the general AV medium of broadcast, need carry out the data and the corresponding action effect designation data of ex ante analysis sampling to the audio signal of the AV medium that will play, so when buying new AV medium, all will want to buy the sync database data of making for this reason by Special disc state or information data state.And, when changing the AV medium, all whether there are relevant data in the GPRS sync database, if just must update content.
In addition, because what utilize is audio signal, so if the part that similar audio signal is used in the AV content exists, then can produce the interpretation mistake, and when the user changes the AV play position, for carrying out carrying out the synchronization of position, also need the retrieval time of several seconds, thereby can delay problem advancing or retreat to produce much to operate when some for searching desired scene corresponding to the new AV that changes.
And employed here audio signal is the digital audio and video signals that meets specific format, and it is limited in and must be distinguished into packet unit by decoder.If with the words of general simulated audio signal as synchrodata, voice data in the specified time limit of necessary more non-static time point, thereby cause where comparing wherefrom smudgy, and need the long comparison time, thereby be difficult to retrieve fast, produce the problem of practical application difficulty.
Above-mentioned synchronous analysis portion even if say the audio signal that obtains to be distinguished into packet, and the voice data of itself and sync database compared, but should reduce the processing time as much as possible, so must be made of the high performance signal processor.Because what utilize is hard disk, think and the I/O control of implementation data not only also need extra control part, and when additional media broadcast portion, also must control it data are moved on to work on the hard disk, can produce the problem of the burden of above-mentioned control part like this.
Promptly, original action effect provides system can experience the virtual reality sense by family or minority personnel and designs, but utilize digital audio and video signals with synchronizer on its design concept, thereby the work of treatment of this respect is very complicated, system realizes that expense is high.And as mentioned above,, thereby can produce the problem that needs continuous additional expenses if new AV card generation then must additionally be bought the Special disc or the data that later just can provide.
Summary of the invention
The present invention proposes for addressing the above problem just, and its purpose is to provide the action effect that utilizes vision signal that system and method thereof are provided.Promptly, can not under the cognitive situation action effect designation data be hidden in the general vision signal the user, when playing it, the action effect designation data that is hidden in the above-mentioned vision signal is extracted, utilize in the action effect of having set by the action effect of above-mentioned action effect designation data indication, come the drive division control that is used to control 1 above drive division is controlled with drive signal generation equipment, just can provide the action effect of physical stimulation that system and method thereof are provided to the user thereby need not extra synchronization procedure.
To achieve these goals, the action effect of vision signal that utilizes of the present invention provides system, comprise following part: action effect information is inserted in the audio/video media in the vision signal, the audio/video media that this audio/video playback portion plays is the 3 D stereo medium that comprise action effect information in the video data, and the mode to this audio/video media insert action effect information comprises: need the time point of action effect to detect in the indivedual images to general video data, with above-mentioned image is benchmark, generates the action effect kind of operating in the stipulated time, the drive division kind of the relevant action of implementing and action effect change; This action effect information being inserted the method for reference images takes after said reference picture interpolation is gone into watermark, replace image data image originally with the image that inserts watermark, or with action effect information but not image information be inserted in a part of picture-display-region territory of said reference imaged image, or be not presented at when action effect information is inserted in final variation said reference signal of video signal in the signal area in the display frame; Play the audio/video playback portion of above-mentioned audio/video media; Obtain the vision signal of above-mentioned media play portion, extract the action effect information of being inserted, export control signal control on this basis action effect generator with the synchronous action effect of vision signal is provided; The driving arrangement of physical stimulation is provided to provide to the user according to the control signal of above-mentioned action effect generator.
Above-mentioned action effect generator comprises following part: the vision signal to above-mentioned media play portion is analyzed, and extracts the action effect data extract portion of action effect information; Store the action effect database of specific action effect data; The action effect information of utilizing above-mentioned action effect data extract portion to be obtained is obtained suitable action effect data from above-mentioned action effect database, generate the action effect generating unit that control signal is controlled above-mentioned driving arrangement on this basis.
In addition, the present invention utilizes the action effect of vision signal to provide system also to comprise following part: can play and the medium of record audio/video; Can play and the media play and the recording equipment of record audio/video; The display device of the video image that produces in the time of can confirming to play above-mentioned medium; After according to user's operation desired action effect information being inserted in the video image of the shown position of above-mentioned display device, by controlling above-mentioned media play and recording equipment, the action effect editing machine of video image storage on above-mentioned medium of above-mentioned action effect information will be inserted with, wherein, and to the mode of this audio/video media insert action effect information comprise: the image of wanting the time point of insert action effect information with the user is a benchmark; This action effect information being inserted the method for reference images takes after said reference picture interpolation is gone into watermark, replace image data image originally with the image that inserts watermark, or with action effect information but not image information be inserted in a part of picture-display-region territory of said reference imaged image, or be not presented at when action effect information is inserted in final variation said reference signal of video signal in the signal area in the display frame.
And, the present invention utilizes the action effect of vision signal to provide method to comprise following step: the video data that generates insert action effect information, and it is stored in step on the regulation medium, wherein, mode to this audio/video media insert action effect information comprises: need the time point of action effect to detect in the indivedual images to general video data, with above-mentioned image is benchmark, and the drive division kind and the action effect that generate the action effect kind of operating in the stipulated time, the relevant action that will implement change; This action effect information being inserted the method for reference images takes after said reference picture interpolation is gone into watermark, replace image data image originally with the image that inserts watermark, or with action effect information but not image information be inserted in a part of picture-display-region territory of said reference imaged image, or be not presented at when action effect information is inserted in final variation said reference signal of video signal in the signal area in the display frame; Play above-mentioned medium with general playback equipment, and the step of the vision signal of output and standard exchange; Obtain above-mentioned vision signal, extract action effect information, generate the step of the drive division control signal of relevant action effect information then; Come the step of controlling and driving portion with the drive division control signal of above-mentioned generation.
Effect of the present invention:
In sum, the present invention utilizes the action effect of vision signal to provide system and method thereof to have following effect: action effect information is inserted in the vision signal, when playing it, extract the action effect information of being inserted in the above-mentioned vision signal, action effect with the above-mentioned action effect information of indication in the action effect of having set is that more than one driving arrangement is controlled on the basis, the action effect that thereby the comparison program that need not extra synchronization procedure or complexity just can extract in the vision signal easily to be comprised, the physical stimulation that has no to delay is provided to the user, and hardware constitutes simple, expense is cheap, and high-caliber virtual reality sense can be provided.
For further specifying above-mentioned purpose of the present invention, design feature and effect, the present invention is described in detail below with reference to accompanying drawing.
Description of drawings
Fig. 1 utilizes original action effect of audio signal that the simple block diagram of system is provided merely;
Fig. 2 is the simple block diagram that audio signal is provided system as original action effect of synchronizing signal;
Fig. 3 is the present invention's the 1st embodiment concept map;
Fig. 4 is the present invention's the 1st embodiment calcspar;
Fig. 5 is action effect catalogue and the variation of the present invention the 1st embodiment;
Fig. 6 is the action effect designation data form (format) of the present invention the 1st embodiment;
Fig. 7 is the 1st embodiment of the present invention's vision signal of including the action effect designation data;
Fig. 8 is that the common simulation vision signal constitutes schematic diagram;
Fig. 9 is other embodiment of the present invention's vision signal of including the action effect designation data;
Figure 10 is the another embodiment of the present invention's vision signal of including the action effect designation data;
Figure 11 is the formation calcspar that is used for extracting from the vision signal of Fig. 8 or Fig. 9 the action effect designation data;
Figure 12 is PC application program (application) example that the present invention is used to generate the audio/video data that includes the action effect designation data;
Figure 13 is the driver precedence diagram that the action effect of the present invention the 1st embodiment provides system.
The symbol description of major part in the accompanying drawing:
100: 3 D stereo AV dish 200:AV (audio/video) broadcast portion
300: display part and sound equipment generating unit 400: action effect generator
410: action effect data extract portion 411: synchronization extractor (extractor)
412: calculator (counter) 413:ADC and data extractor
420: action effect database 430: the action effect generating unit
500: drive division control and drive signal generating unit 550a-d: drive division
600: action effect designation data 700: action effect editing machine (editor)
710: video flowing viewing area 720: the action effect editing area
730: action effect is selected the zone
Embodiment
Provide the embodiment of system and method thereof to be elaborated to the aforesaid action effect of vision signal that utilizes of the present invention with reference to the accompanying drawings.
Fig. 3 is system's configuration example concept map of the present invention the 1st embodiment.As shown in the figure, this system comprises following part: according to the identical form of general AV medium, comprise the 3 D stereo AV dish 100 of action effect information in the video data; By playing the basic AV Observating appts that the general AV broadcast portion 200 of the standard A V dish that comprises above-mentioned 3 D stereo AV dish 100, general display part and sound equipment generating unit 300 constitute; Extract action effect information from the outputting video signal of above-mentioned general AV broadcast portion 200, output is used for the action effect generator 400 of the drive control signal of execution effect on this basis; The drive control signal that utilization provides from above-mentioned action effect generator 400 provides several drive divisions 550a-d of physical stimulation to the user; The appropriate drive division control and drive signal generating unit 500 that drives above-mentioned several drive divisions.
Can provide the driving arrangement (comprising: drive division control and drive signal generating unit 500, drive division 550a-d) of physical stimulation to be applicable to that the user is viewing and admiring to listen on the seat to the user here, watches AV, can three-dimensionally move the above-mentioned seat of viewing and admiring, thereby improve the sense of reality.For this reason, above-mentioned driving arrangement (500,550a-d) can be installed in to be viewed and admired seat and views and admires on the seat support portion (leg), though Fig. 3 with view and admire the state that seat separates and shown action effect generator 400, also can be installed in the just above-mentioned seat inside of viewing and admiring of above-mentioned action effect generator 400.
By above-mentioned formation, on one side can listening to, the user watches that playing 3 D stereo AV coils video image and sound equipment at 100 o'clock, on one side in the vivid virtual reality sense of impression on the seat of viewing and admiring that provides with the synchronous three-dimensional motion effect of video image activity.
Fig. 4 is that action effect shown in Figure 3 provides the system configuration detailed block diagram.As shown in the figure, for 3 D stereo AV is provided to the user environment, above-mentioned action effect generator 400 is responsible for to providing drive control signal by drive division control and the driving arrangement that drive signal generating unit 500 and several drive divisions 550a-d constitute, on the structure of above-mentioned action effect generator, it comprises following part: the outputting video signal to general AV broadcast portion 200 is analyzed, inspection have or not can not be cognitive the user situation under be inserted in action effect information in the cohered video data of action effect (that is: be used to indicate), extract the action effect data extract portion 410 of related data; For generating 3 D stereo AV vision signal, storing by the action effect database 420 of several action effect data of standard definition; Based on the action effect designation data of from above-mentioned action effect data extract portion 410, extracting, from above-mentioned action effect database 420, obtain the action effect data of indication, export the action effect generating unit 430 of the driving arrangement control signal that has changed.
Here, above-mentioned action effect database 420 is to store standardization action effect section data, therefore can utilize non-volatility memorizer basically.When in the face of appending or changing (Version up: edition upgrading) during standardized action effect, (for example: flash memory etc.) also can utilize recordable non-waving property memory.Even thisly be used to obtain memory of data merely and utilize low side (low-end) controller, also can obtain data fast, so can alleviate in above-mentioned action effect data extract portion 410 or the action effect generating unit 430 or the burden of the control appliance that all can comprise.
Above-mentioned action effect data extract portion 410 receives with general vision signal (NTSC/PAL, SVHS) or digital video signal (VGA, SVGA, XGA etc.) the video output of the AV broadcast portion 200 that provides of form can not extract hiding action effect designation data under the cognitive situation the user.This part can great changes have taken place along with the action effect designation data being inserted in various embodiment in the general vision signal are different.That is, when using the method that needs complicated calculation, can use to comprise digital signal processor, when using fairly simple method, only just can carry out all work with simple microcontroller in interior formation.
And action effect generating unit 430 can be contained in the controller that above-mentioned action effect data extract portion 410 comprised., can from above-mentioned action effect database 420, obtain in the action effect data that number in accordance with regulations enumerates here, it is carried out appropriate change.Fig. 4 has shown this example.
Fig. 5 obtains one of them action effect data and to its example that suitably changes from the formation in action effect data storehouse 420 and above-mentioned action effect generating unit 430.
Shown in (a) among Fig. 5, above-mentioned each action effect data are made of the numerical data that shows specified waveform, briefly also can regard simple wave file (.WAV) as.Promptly refer to the set of the continuous displacement value that is made of suitable sampling frequency, its length and sampling frequency can be according to the operating characteristics of designer's intention and drive division and are decided.
(e) of (b) among Fig. 5 to Fig. 5 is varied to the schematic diagram of simple displacement value with one of them (example: be numbered 3 data) wave file of action effect.It has suitably indicated the time rate value of regulating length and the size ratio value of regulating amplitude, and there is bigger difference in shown finally action effect, and this means to provide fine and smooth more and various physical stimulation to the user.
Fig. 6 is that the invention described above constitutes the action effect designation data summary construction form schematic diagram that institute's core is used, and it should be noted that it can decide with extremely various form according to designer's intention or standardization policy.
(a) among Fig. 6 is the action effect designation data form 600 that is fit to the simple shape of structure of the present invention shown in Figure 4.It comprises following part: demonstration is the index field (IndexField) 610 of action effect designation data; The field (action effect numbering) 620 that shows desired standard operation effect data kind and driving arrangement kind; The field (time/size) 630 of the value of the above-mentioned standard operation effect data of relevant adjusting; Relevant odd even (parity) value of revisal error or the field (error correction) 640 of error correction code (ECC) of being used for.Also can list the relevant time of delay that is used for fine adjustments in addition in or fade in the indicated value of (fade in), diminuendo (fade out) etc., also can delete wherein unwanted data simultaneously.In addition, when utilizing several driving arrangements, also can enumerate in the action effect designation data form and be used for the indicated value of driving arrangement separately, for the action that intersects, in action effect designation data form also only record be used for the data of a driving arrangement.
(b) among Fig. 6 is not specified value action effect data but represent to be used for the schematic diagram of the Wave data of direct action effect itself with action effect data field 625 of action effect designation data inside.If use this action effect designation data, then can reduce the necessity that database is used for storage standards action effect data, but, preferably only select the form supported as having down in special situation (situation that is used for unexistent effect defined by the user in the additional standard action effect) in order more effectively to drive.
Therefore, obtain and resolve above-mentioned action effect designation data 600, and be one of basic driver principle of the present invention with this controlling and driving equipment by the action effect generator 400 that has illustrated.
Here, have any to merit attention: the formation by the foregoing description as can be known, indicate the action effect kind and providing the action effect designation data of method (comprising the variation of time that the standard operation effect is provided or its intensity etc.) to be inserted in the vision signal, the AV medium that will play thus (for example: must can store the video data that is inserted with this action effect designation data illustrated 3 D stereo AV dish 100), and necessary can by general AV broadcast portion 200 normal play it.
Promptly, in the present invention, no matter the kind of 3 D stereo AV dish 100 be general CD (VCD), DVD, or BD all unimportant, must insert and provide the action effect designation data in the vision signal that general AV broadcast portion 200 by regulation plays, and the user can not be discovered to some extent to it, can have no to carry out relatively normal play with action effect generator of the present invention.
In other words, the present invention can operate by continuing to hold the present conventional system of the AV broadcast portion 200 of use always, and its available great advantage is to comprise that AV broadcast portion 200, display part and sound equipment generating unit 300 by high price constitute the user of home theater.
For this reason, the present invention proposes to making the user can not cognitive in the normal video specification, comprise many methods of action effect designation data.
Fig. 7 is the 3 D stereo AV medium generation method of the present invention the 1st embodiment, be the user can not be cognitive situation under the action effect designation data is inserted in a kind of method explanation concept map in the common image data.
Shown in the (a) and (b) among Fig. 7, the method that it adopts is: after watermark (watermark) is gone in an image interpolation in the many picture images (image) that provide image data, replace image data image originally with the image that inserts watermark.Though exist the various algorithms (algorithm) that generate watermark, but basic condition is: utilize most of keyboard (secret key) value, (hidden data) inserts relevant copyright information by hiding Info, generation has the image of watermark, utilize above-mentioned specific keyboard value again, can from the image that watermark is arranged, obtain above-mentioned hiding information.Because the customizing messages that is hidden in this image that has a watermark can observed person's cognition, so as shown in Figure 7, the user can not perceive when inserting the image that has watermark in an image frame of moment process.
But the action effect data extract portion 410 of action effect generator 400 must confirm whether the image of moment process is the image that has watermark.Above-mentioned action effect data extract portion 410 converts the vision signal of output to indivedual digital picture images on one side, detect and extract the action effect designation data that have watermark in vision signal inserted on one side, for this reason, it comprises watermark decoder.In addition, above-mentioned action effect data extract portion 410 in inside with analog image (NTSC/PAL, SVHS) etc. convert numerical data to, obtain a digital image information, utilize keyboard (secret key) value then, judge whether relevant image has watermark, perhaps can need digital signal processor to extract hiding data (that is: action effect designation data) at short notice.Because general vision signal includes picture signal and the vertical synchronizing signal that adopts scan line (scan line) mode, so after obtaining a view data fully, there are some vacant times before obtaining next image.And, owing to from the image that has watermark, do not extract the data of hiding, can detect band watermark whether algorithm merely but additionally exist, so when utilizing it, can detect the action effect designation data without delay and whether be inserted in the two field picture that moment carries out.
If the vision signal that is provided is a digital video signal, then there is no need above-mentioned this image transitions is become numerical data, but thereby the digital image data of former state utilization reception.In addition, just can change mutually, so the vision signal kind that is provided can not be construed as limiting the present invention analog video signal and digital video signal by fairly simple element.
If mode monitoring video signal as described above detects the image that has watermark then, can from the image that has watermark, obtain the action effect designation data so, drive drive division with this by the corresponding action effect.
Fig. 8 is the formation schematic diagram of the general analog video signal that proposes for another action effect designation data insertion method that explanation the present invention proposes, illustrates the vision signal of NTSC mode here.But the PAL mode also only is a scan line figure difference, and most of similar.The vision signal of SVHS mode also just improves image quality by separating synchronizing signal and color signal, is easy to convert thereof into the NTSC/PAL signal, thereby followingly only the vision signal of illustrated NTSC mode is described.
(a) among Fig. 8 is the actual signal apperance schematic diagram of horizontal scanning line shown on the picture, and illustrated one-period signal (Hdata) has a horizontal line image information (Idata).Also some is adding colour signal that is used for synchronized horizontal-drive signal of horizontal line (Hsyn) and related levels line etc. to this one-period signal (Hdata).In addition, though not shown, also exist forward position (front porch) and back along (backporch) part.Here, the image that is presented at a line on the real screen is meant horizontal line image information (Idata) part, has the length of about 52 μ s usually.During this period of time, represent pixel (pixel) data with the continuous analogue value to a line.If sort signal except that with the correlation of colour burst (color burst) signal, will singly refer to brightness (brightness) value.Therefore, if regard the time of 52 μ s the scope of picture transverse axis coordinate appointment as, will determine pairing coordinate position of stipulated time.If will with belong to 52 μ s any a period of time spot correlation the analogue value involuntary conversion one-tenth voltage relevant with red value, perhaps be transformed into the words of the voltage relevant with white value, the point that will occur associated luminance on the picture, specific level (level) data can be presented on the actual displayed picture by it, further developing this technology (technique) is exactly screen display (OSD).
Therefore, can utilize digital-analog conversion equipment to insert desired data but not desired horizontal image, so just the action effect designation data can be transformed into analog signal and insert by appropriate time span.From this being carried out the situation of interpretation, after the particular horizontal line signal being judged by the figure (figure) of horizontal-drive signal (Hsyn), if be benchmark with related levels synchronizing signal (Hsyn) at the interpretation time point, the words of desired data being taken a sample by desirable sample interval, horizontal line signal (Hdata) from one-period reads the signal value that is comprised so, with analog-to-digital conversion equipment it is carried out conversion, just can obtain the action effect designation data of being inserted.
(b) among Fig. 8 be in the video data of making a picture of a pair of odd-numbered frame and even frame in the odd/even frame signal of a frame constitute schematic diagram.As shown in the figure, be used for the horizontal signal (Hdata) that the vertical synchronizing signal (Vsyn) of the certain-length of vertical synchronization and being used to constitutes a frame picture (Fdata) and enumerating formation such as Fig. 7 of each horizontal signal (Hdata) from the upside down extreme direction of picture.Here the part that merits attention is that frame data (Fdata) all are not presented on the picture.That is, in frame data (Fdata),, be not presented on the real screen though a part of horizontal line data (Inr1) of picture upper end and a part of horizontal line data (Inr2) of picture lower end are included in the vision signal.At present, aerial ripple is broadcasted this part and is contained temporal information, and a part of captions (caption) video contains caption data.
Therefore, as mentioned above, when adopting the method for data being inserted the part zone in the picture image zone to come insert action effect designation data as can be known, perhaps related data can be inserted in the horizontal image signal in shown zone on the real screen, perhaps related data can be inserted on the real screen not in the horizontal image signal of viewing area.Especially, because the above data of tens of bytes (bite) can be inserted in the horizontal line signal, so tens of action effect designation data to hundreds of bytes can be inserted in the horizontal signal about one or two.
Fig. 9 is meant the 3 D stereo AV medium generation method of other embodiments of the invention, in order can not under the cognitive situation action effect designation data to be inserted in the common image data the user, utilizes one of illustrated method of above-mentioned Fig. 8 below.
That is method, shown in Figure 9 is meant: because many frame (1F
1-1F
n) constitute the vision signal of a scene, so in the image of a frame that constitutes it, the action effect designation data is inserted in the picture boundary part that a part zone, the especially user of picture are difficult to be familiar with.Take this and only almost can't in the cognitive time action effect designation data be inserted in a part of horizontal signal of display frame the user.Especially, the action effect designation data insertion portion that moment provides is the simple noise (noise) that has no in all senses, because in the concentrated part moment appearance of user's sight line, so can not cause perceiveing of user.
Figure 10 is meant the similar method with above-mentioned Fig. 9, but this method is applicable on one side playing the AV medium by general AV broadcast portion, on one side with the video data of medium serve as the basis generate and output comprise picture not the viewing area signal in the situation of interior vision signal.
Promptly, as shown in the figure, this method is meant the action effect designation data is inserted in the method that is positioned at the not viewing area of top and the bottom, actual video viewing area (vertical synchronization zone) on the formation of the odd/even field that is used for showing a picture, it can insert desired data and image quality is reduced, and can use the vacant zone in zone to be used to from aerial ripple or other standards, detaching, also can ignore this existing standard in case of necessity and insert, this is because the possibility that clashes with aerial ripple or other standards when utilizing specific appreciation with medium is little.
Figure 11 is the simple configuration example schematic diagram of action effect data extract portion that is used to extract above-mentioned Fig. 9 or action effect designation data shown in Figure 10.From figure as can be known, only just can from vision signal, extract the action effect designation data with illustrated fairly simple and cheap hardware.
At first, the vision signal of the general AV broadcast of 411 pairs of synchronization extractor portion output is analyzed the signal that vertical synchronizing signal and horizontal-drive signal is provided and distinguishes the odd/even field.In order to be used as multiple purpose, can utilize the most frequently used ordinary video synchronization extractor.
If utilize calculator 412 to calculate the above-mentioned synchronizing signal that is extracted, know the beginning time point of the horizontal-drive signal of the position of wanting.Therefore, ADC and data extract portion 413 position or ad-hoc location scope as can be known.
Above-mentioned ADC and data extract portion 413 analyze vision signal according to the signal of aforementioned calculation device 412, convert analog luminance signal to numerical data, utilize the numerical data of this conversion to detect to show it is the index information of action effect designation data then, if detect index, then can extract all follow-up action effect designation datas by the form of having set.Therefore, above-mentioned ADC and data extract portion 413 also can be the common microcontrollers that simply has the ADC function, also can comprise the function of aforementioned calculation device 412.
Figure 12 is PC action effect editing machine 700 schematic diagrames that the present invention the 1st embodiment is used to generate 3 D stereo AV medium.Illustrated user interface is used for basic edit, can further segment and can add many functions.Though editor's notion also can be varied, be meant here and can be merely edit action effect by certain hour unit by image frame.
Above-mentioned action effect editing machine 700 is that general user or the enterprise that sells the AV medium use for specific making video being become support 3 D stereo AV medium.If show specific image, image will be presented at video flowing viewing area 710 by each frame, and the user decides the insertion position of desired action effect designation data by regulating it.
Edit effect in the stipulated time in order to be changed to benchmark with the insertion framing bit of this action effect designation data that is determined, the action effect of selecting the lower end to enumerate, be added on the action effect editing area 720 that is used to provide each driving arrangement (being meant 4 indivedual driving arrangements here) editing area, just can edit action effect by regulating size and length then.
If utilize the said equipment to determine desired insertion position and desired action effect and action effect changing value, then utilize in the foregoing method one can not be inserted in above-mentioned frame image under the cognitive situation the user.
After this process that is all over, the frame image store that will have above-mentioned variation becomes to adapt to the dedicated video data of specific medium (for example: VCD, DVD, BD etc.) form, then it is recorded on the related media.In addition, also this content edited can be extracted into action effect designation data and insertion position information, manage by extra file.The medium of this generation are supported 3 D stereo AV, also can have no to play singularly by general AV broadcast portion simultaneously.
AV image media sales person but also have the individual that can write down particular media device (CD register, DVD register, BD register) and all can generate above-mentioned 3 D stereo AV medium not only, and the action effect designation data and the insertion position information that are extracted into extra file also can be shared by many paths.
Figure 13 is to the additional action effect generator of general playing environment and the course of action precedence diagram of driving arrangement when playing the 3 D stereo AV medium that generate by said process.
S1-S3, as shown in the figure, at first, if by the general AV broadcast broadcast 3 D stereo AV of portion medium, then export the vision signal that available general display part is appreciated, the action effect generator obtains it then, in internal actions effect data extraction unit vision signal is analyzed.
S4-S8, to the analysis of vision signal is only to judge preferentially that whether the action effect designation data insert, whether insert if judge the action effect designation data, the action effect designation data that then is docked at behind the index information of its standard is extracted and is analyzed, and is made into the data that can be used.Rely on the content that is used in reference to the accurate action effect of indicating in the related data, the action effect database that above-mentioned action effect generator is had is retrieved, obtain desired standard operation effect data.If when not having the action effect data of appointment in the database, then ignore relevant action effect designation data fully.
Said process carries out finishing up to relevant 3 D stereo AV media play repeatedly, confirms whether be whether effective video signal (various synchronizing signal) just knows end by analyzing vision signal.
Aforesaid the present invention the user can not be cognitive situation under will indicate the data of action effect to be inserted in to provide in the AV of the action effect image self, thereby need not extra synchronization process, and only just can obtain the action effect designation data that is inserted in the image, the physical stimulation that has no to delay is provided to the user with fairly simple hardware.In addition, there is no need to change AV Play System in using, the kind of AV Play System is not had too much requirement yet for experiencing virtual reality sense provided by the present invention, thereby the non-constant width of its scope of application, can guarantee client layer widely.
Those of ordinary skill in the art will be appreciated that, above embodiment is used for illustrating the present invention, and be not to be used as limitation of the invention, as long as in connotation scope of the present invention, all will drop in the scope of claims of the present invention variation, the modification of the above embodiment.
Claims (15)
1, a kind of action effect of vision signal that utilizes provides system, it is characterized in that comprising following part:
The audio/video playback portion of audio plays/video media; The audio/video media that this audio/video playback portion plays is the 3 D stereo medium that comprise action effect information in the video data;
To the action effect editing machine of described audio/video media insert action effect information, described actions editor comprises action time point test section and action effect information insertion section;
Need the time point of action effect to detect in the individual frame image of described action time point test section to general video data, with above-mentioned image is benchmark, generate action effect information, described action effect information comprises that the drive division kind of the action effect kind of operating in the stipulated time, the relevant action that will implement and action effect change;
Take after said reference picture interpolation is gone into watermark described action effect information insertion section, replace image data image originally with the image that inserts watermark, or with action effect information but not image information is inserted in the central area with picture of said reference imaged image is the image of benchmark up and down in the outer limit zone, though or action effect information be inserted in video data, transmit in the reference images signal area that is not presented in the display frame; Though the above-mentioned zone of transmitting in video data but not being presented in the display frame comprises following two zones: in image frame signal from the non-reveal competence signal area when real screen shows beginning behind the vertical synchronizing signal zone; Real screen shows the non-reveal competence signal area when finishing back to next vertical synchronizing signal begins;
Obtain the vision signal of above-mentioned audio/video playback portion, extract the action effect information that is inserted into, on this basis the action effect generator of the control signal of the synchronous action effect of output and vision signal;
Rely on the next driving arrangement that physical stimulation is provided to the user of control signal of above-mentioned action effect generator.
2, the action effect of vision signal that utilizes as claimed in claim 1 provides system, it is characterized in that:
Describedly provide the driving arrangement of physical stimulation to be included as three-dimensional moving to the user to view and admire several drive divisions that dispose with seat and the drive division control and the drive signal generating unit of controlling and driving portion.
3, the action effect of vision signal that utilizes as claimed in claim 1 provides system, it is characterized in that also comprising:
Vision signal to above-mentioned audio/video playback portion is analyzed, and extracts the action effect data extract portion of action effect information;
Store the action effect database of specific action effect data;
The action effect information of utilizing above-mentioned action effect data extract portion to obtain is obtained suitable action effect data from above-mentioned action effect database, generate the action effect generating unit of the control signal that is used to control above-mentioned driving arrangement then based on this.
4, the action effect of vision signal that utilizes as claimed in claim 1 provides system, it is characterized in that:
The action effect information of being inserted in the above-mentioned vision signal comprises following part: demonstration is the field of action effect information; The field that shows desired action effect data class and driving arrangement kind; Be used to change the field of the value of above-mentioned action effect data.
5, the action effect of vision signal that utilizes as claimed in claim 1 provides system, it is characterized in that:
Outputting video signal to the audio/video playback portion that above-mentioned action effect generator provides is meant analog video signal.
6, the action effect of vision signal that utilizes as claimed in claim 1 provides system, it is characterized in that:
Outputting video signal to the audio/video playback portion that above-mentioned action effect generator provides is meant digital video signal.
7, the action effect of vision signal that utilizes as claimed in claim 1 provides system, it is characterized in that:
Above-mentioned action effect data extract portion converts the vision signal of output to indivedual digital picture images on one side, detect on one side and also extract the action effect designation data of inserting in the vision signal that has watermark, above-mentioned for this reason action effect data extract portion comprises watermark decoder.
8, the action effect of vision signal that utilizes as claimed in claim 1 provides system, it is characterized in that above-mentioned action effect data extract portion comprises following part:
Vertical and the horizontal-drive signal that is presented at the video data on the display part is extracted into the synchronization extractor of several colour signals;
Calculate the calculator of the above-mentioned synchronizing signal that is extracted;
Judge the upright position of the picture of wanting by the output of aforementioned calculation device, reception is from the analog signal of the video data of want position input, after converting thereof into digital signal, be the action effect data extract portion that the basis extracts action effect information with this digital signal.
9, a kind of action effect of vision signal that utilizes provides system, it is characterized in that comprising following part:
Can play and the medium of record audio/video;
Can play and to play and the medium of record audio/video, perhaps specified data can be recorded in media play and recording equipment on the related media;
The display device of the video image in the time of can confirming above-mentioned media play;
After the operation according to the user is inserted in desired action effect information in the video image of the shown position of above-mentioned display device, control above-mentioned media play and recording equipment, the action effect editing machine of video image storage on above-mentioned medium of above-mentioned action effect information will be inserted with, wherein, and to the mode of this audio/video media insert action effect information comprise:
The image of wanting the time point of insert action effect information with the user is a benchmark;
This action effect information being inserted the method for reference images takes after said reference picture interpolation is gone into watermark, replace image data image originally with the image that inserts watermark, or with action effect information but not image information is inserted in the central area with picture of said reference imaged image is the image of benchmark up and down in the outer limit zone, though or action effect information be inserted in video data, transmit in the reference images signal area that is not presented in the display frame; Though the above-mentioned zone of transmitting in video data but not being presented in the display frame comprises following two zones: in image frame signal from the non-reveal competence signal area when real screen shows beginning behind the vertical synchronizing signal zone; Real screen shows the non-reveal competence signal area when finishing back to next vertical synchronizing signal begins.
10, the action effect of vision signal that utilizes as claimed in claim 9 provides system, it is characterized in that:
Above-mentioned action effect editing machine is meant that having equipment controls above-mentioned media play/recording equipment and display device on one side, on one side action effect information is inserted in PC or video editing apparatus in the image information.
11, the action effect of vision signal that utilizes as claimed in claim 9 provides system, it is characterized in that:
Above-mentioned action effect editing machine will be inserted with the video image storage of action effect information on above-mentioned medium after finishing the repetitive process that action effect information is inserted in the video image.
12, the action effect of vision signal that utilizes as claimed in claim 9 provides system, it is characterized in that:
When above-mentioned action effect editing machine is inserted in the video image that writes down in the media whenever action effect information, all the video image Data Update that is write down to be become be inserted with the video image data of action effect information.
13, the action effect of vision signal that utilizes as claimed in claim 9 provides system, it is characterized in that:
Above-mentioned action effect editing machine is stored as extra editing files with action effect information and the positional information that will insert the vision signal of above-mentioned action effect information, read the editing files of regulation then, if associated documents are applicable to corresponding script vision signal, then insert action effect information.
14, the action effect of vision signal that utilizes as claimed in claim 9 provides system, it is characterized in that:
Above-mentioned medium are meant CD, DVD or BD.
15, a kind of action effect of vision signal that utilizes provides method, it is characterized in that comprising following step:
Generate the video data be inserted with action effect information, and it be stored in step on the regulation medium, wherein, comprise to the mode of this audio/video media insert action effect information:
Need the time point of action effect to detect in indivedual images to general video data, with above-mentioned image is benchmark, generate action effect information, described action effect information comprises that the drive division kind of the action effect kind of operating in the stipulated time, the relevant action that will implement and action effect change;
This action effect information being inserted the method for reference images takes after said reference picture interpolation is gone into watermark, replace image data image originally with the image that inserts watermark, or with action effect information but not image information is inserted in the central area with picture of said reference imaged image is the image of benchmark up and down in the outer limit zone, though or action effect information be inserted in video data, transmit in the reference images signal area that is not presented in the display frame; Though the above-mentioned zone of transmitting in video data but not being presented in the display frame comprises following two zones: in image frame signal from the non-reveal competence signal area when real screen shows beginning behind the vertical synchronizing signal zone; Real screen shows the non-reveal competence signal area when finishing back to next vertical synchronizing signal begins;
Play above-mentioned medium with general playback equipment, the step of the vision signal that output and standard are exchanged;
Obtaining above-mentioned vision signal, extract action effect information after, generate the step of relevant action effect information corresponding driving portion control signal;
Come the step of controlling and driving portion with the drive division control signal of above-mentioned generation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2005101119432A CN100518238C (en) | 2005-12-23 | 2005-12-23 | Action effect providing system and its method using video signal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2005101119432A CN100518238C (en) | 2005-12-23 | 2005-12-23 | Action effect providing system and its method using video signal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1988595A CN1988595A (en) | 2007-06-27 |
| CN100518238C true CN100518238C (en) | 2009-07-22 |
Family
ID=38185216
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2005101119432A Expired - Fee Related CN100518238C (en) | 2005-12-23 | 2005-12-23 | Action effect providing system and its method using video signal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100518238C (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104735513B (en) * | 2015-03-26 | 2019-01-15 | 杭州磐景智造文化创意有限公司 | Image acts integrated control system and method |
| TWI606365B (en) * | 2015-11-13 | 2017-11-21 | 威盛電子股份有限公司 | Multimedia system and method of controlling environment by way of multimedia file |
| CN105477858A (en) * | 2016-01-28 | 2016-04-13 | 罗振宇 | Real-time interaction somatosensory interaction intelligent human body wearing device |
| WO2020089144A1 (en) * | 2018-11-01 | 2020-05-07 | Signify Holding B.V. | Determining light effects based on video and audio information in dependence on video and audio weights |
| EP3959896A1 (en) * | 2019-04-22 | 2022-03-02 | Soclip! | Automated audio-video content generation |
-
2005
- 2005-12-23 CN CNB2005101119432A patent/CN100518238C/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN1988595A (en) | 2007-06-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100562084C (en) | Synchronously use the equipment and the method for audio-visual data | |
| RU2495539C2 (en) | Display device with object-oriented 3-dimensional representation of sound origin coordinates | |
| US7356248B2 (en) | Apparatus and method of reproducing subtitle recorded in digital versatile disk player | |
| CN103297794B (en) | Data structure, record medium, playback equipment and player method and program | |
| US20130142496A1 (en) | Information recording and reproducing method using management information including mapping information | |
| KR101339535B1 (en) | Contents reproduction device and recording medium | |
| CN100518238C (en) | Action effect providing system and its method using video signal | |
| CN1739138B (en) | Information transmission method and device, information recording or reproduction method and device, and recording medium | |
| CN100534129C (en) | System providing and editing action effect using video signal and its method | |
| CN105763923A (en) | Video and video template editing methods and device thereof | |
| US20100034519A1 (en) | Video reproducing apparatus, video display system and record medium | |
| US20090088879A1 (en) | Audio reproduction device and method for audio reproduction | |
| JPH08147939A (en) | Recording medium and recording medium reproducing device | |
| KR20060007845A (en) | Motion effect providing system through video signal and method thereof | |
| KR20100104892A (en) | A caption system for commercial-dvd contents | |
| KR100585678B1 (en) | Motion effect providing and editing system through video signal and method thereof | |
| JP4244030B2 (en) | Digital broadcast receiver and digital broadcast receiving method | |
| KR100818926B1 (en) | Apparatus and method for handling presentation graphic of optical disk | |
| JP2007265558A (en) | Data recording and reproducing device and method | |
| KR20050117391A (en) | Method for writing data in combo system | |
| JP2005051587A (en) | Contents recoding and reproducing apparatus | |
| JPH0968959A (en) | Device for forming character information recording medium and character information cooperative display device | |
| JPH01272275A (en) | Video signal processing method | |
| JP2006339797A (en) | Information attaching apparatus and program, and computer readable medium recording information attaching program | |
| JP2005058780A (en) | Receiver and receiving method of digital broadcast |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090722 Termination date: 20100125 |