Summary of the invention
The above-mentioned technical problem of the present invention for existing in the solution background technology, and propose the image video signal is converted to image display system and the method thereof with image key diagram picture.
Technical solution of the present invention is that the present invention a kind ofly is converted to the image display system with image key diagram picture with the image video signal, and its special character is: this system comprises: receiver module is used for receiving the image video signal; The first acquisition module, timing acquisition image video signal is for obtaining image; The second acquisition module obtains out the image explanation corresponding with timing according to the timing that obtains image from the image video signal; The comparison integrate module is used for adjacent obtaining overlapped comparison between the image, when the coincidence factor that obtains image surpasses pre-set ratio, integrate obtaining image explanation corresponding to image, and the timing that will obtain image evening obtain image-erasing; Configuration module illustrates that according to image the configured letters viewing area is in obtaining image; Storage module will obtain image, image explanation and literal viewing area correspondence and be stored in the database; Display module, be used for showing and obtain image, and image illustrated that correspondence is presented in the literal viewing area, described receiver module is connected with the first acquisition module, described the first acquisition module respectively with the second acquisition module be connected integrate module and be connected, described the second acquisition module with compare integrate module and be connected, described comparison integrate module is connected with configuration module, described configuration module is connected with storage module, and described storage module is connected with display module.
Above-mentioned image display system also comprises modular converter, when modular converter is illustrated as speech explanation when image, is used for speech explanation is converted to explanatory note, and described comparison integrate module is connected with configuration module by modular converter.
Above-mentioned image display system also comprises playing module, when playing module has speech explanation when the image explanation, is used for playing speech explanation, and described playing module is connected with display module.
Above-mentioned image display system comprises image processing module, is used for carrying out obtaining image the image of editor, modification, replacement, replacement and ordering of image to process, and described image processing module is connected with storage module.
Above-mentioned image display system comprises setting module, is used for to the first acquisition module, and the time of regularly the image video signal being obtained is set, and described setting module is connected with receiver module.
The present invention also provides a kind of the image video signal is converted to the method for displaying image with image key diagram picture, and its special character is: the method includes the steps of:
1) receives the image video signal;
2) timing acquisition image video signal is for obtaining image;
3) obtain out the image explanation corresponding with timing according to the timing that obtains image;
4) adjacent this obtained overlap comparison between the image;
5) when the adjacent coincidence factor that obtains between the image surpasses pre-set ratio, integrate obtaining image explanation corresponding to image;
The timing that 6) will obtain image evening obtain image-erasing;
7) illustrate that according to image the configured letters viewing area is in obtaining image;
8) will obtain image, image explanation and literal viewing area correspondence is stored in the database;
9) image is obtained in demonstration, and image is illustrated that correspondence is presented in the literal viewing area.
Above-mentioned steps 2) comprising the time of regularly the image video signal being obtained sets.
Above-mentioned steps 3) comprises when image is illustrated as speech explanation, be used for speech explanation is converted to explanatory note.
Above-mentioned steps 7) comprising the image that carries out picture editting, modification, replacement, replacement and ordering to obtaining image processes.
Above-mentioned steps 9) comprises the broadcast speech explanation.
Difference between the present invention and the prior art is that the present invention regularly is retrieved as the image video signal and obtains image, and according to the timing that obtains image to obtain corresponding image explanation, and the image explanation is disposed at corresponding obtaining in the image, so that can be fast and the image video signal is converted to has image key diagram picture easily, can be applied on the different computers, on the handheld apparatus, electronic book device, electric paper apparatus.The present invention can solve the existing prior art of prior art and is converted to image for the image video signal and has operation inconvenience and carry out the time-consuming problem of repeated image processing thus, and then reaches and filter a large amount of repeated images and the image video signal is converted to the technology effect with image key diagram picture.
Embodiment
Referring to Fig. 1, the present invention is converted to the image display system with image key diagram picture with the image video signal, and image display system 10 comprises: receiver module 11, the first acquisition module 12, the second acquisition module 13, comparison integrate module 14, configuration module 15, storage module 16, database 17 and display module 18.
The user at first can receive the image video signal that need to be converted by the receiver module 11 of image display system 10, after the receiver module 11 when image display system 10 receives the image video signal, can be again the first acquisition module 12 by image display system 10 carry out obtaining of image video signal.
The first acquisition module 12 of image display system 10 can regularly obtain the image video signal for obtaining image, for instance, the first acquisition module 12 of supposing image display system 10 can be retrieved as the image video signal and to obtain image in per 5 seconds, at first, the first acquisition module 12 of image display system 10 can obtain first in 0 minute 1 second in the image video signal and obtain image, then, the first acquisition module 12 of image display system 10 can obtain second in 0 minute 6 seconds in the image video signal and obtain image, and, the first acquisition module 12 of image display system 10 can obtain the 3rd in 0 minute 10 seconds in the image video signal and obtain image, the rest may be inferred, until the image video signal finishes, namely the first acquisition module 12 of image display system 10 can regularly be retrieved as the image video signal and obtain image.
And can regularly obtain the image video signal for obtaining image for the first acquisition module 12 of image display system 10, the image video signal is retrieved as technology and the method for obtaining image can be with reference to existing image capturing technology.
The first acquisition module 12 of image display system 10 regularly obtained out by the image video signal obtain image after, then, can from the image video signal, obtain out the image explanation corresponding with timing according to the timing that obtains image by the second acquisition module 13 of image display system 10, the timing that obtains image is the time of 12 timing acquisitions of the first acquisition module of image display system 10, for instance, suppose that the first acquisition module 12 of image display system 10 was respectively at 0 minute and 10 seconds, 0 minute 20 seconds and 0 minute and 30 seconds obtain the image video signal, and the timing that then obtains image namely was respectively 0 minute and 10 seconds, 0 minute 20 seconds and 0 minute and 30 seconds.
The second acquisition module 13 of image display system 10 namely can obtain according to each the timing of image, from the image video signal, obtain out respectively the image explanation corresponding with timing, generally speaking, usually include explanatory note in the image video signal, speech explanation or literal are in conjunction with the image explanation of speech explanation, so that the people who watches the image video signal can clearly be understood image video signal content to be expressed, and these image explanations are carried out the demonstration of explanatory note and the broadcast of speech explanation according to the timing of image respectively, therefore, namely can find the image explanation corresponding with timing by the timing of image video signal is counter.
For instance, the first acquisition module 12 of supposing image display system 10 was retrieved as at the timing of image video signal and obtains image in 0 minute 30 seconds, and suppose to have the image explanation in 0 minute 29 seconds to 0 minute and 32 seconds at the timing shadow of image video signal, 13 of the second acquisition modules of image display system 10 can fall within according to the timing of image video signal between the timing shadow 0 minute 29 seconds to 0 minute and 32 seconds of image video signal in 0 minute in 30 seconds, namely 0 minute 29 seconds to 0 minute and 32 seconds image of the timing shadow explanation corresponding to the image video signal can be obtained out.
Then, each is obtained after image explanation corresponding to image obtain at the second acquisition module 13 of image display system 10, namely can overlap comparison between the image by 14 pairs of adjacent obtaining of comparison integrate module of image display system 10, be about to that the first acquisition module 12 of image display system 10 obtains first obtains image and obtains image and overlap and compare with second, obtain image with second again and obtain image and overlap and compare with the 3rd, the rest may be inferred.
When the adjacent coincidence factor that obtains image of comparison integrate module 14 comparisons of image display system 10 surpasses pre-set ratio, the second acquisition module 13 of image display system 10 can be obtained out from the image video signal with image explanation corresponding to image of obtaining that is compared and be integrated, and can with the timing that obtains image evening obtain image-erasing.
For instance, the first acquisition module 12 of supposing image display system 10 obtains out first and obtains image and second and obtain image from the image video signal, and the second acquisition module 13 of image display system 10 from the image video signal, obtain out with first obtain the corresponding image of image be illustrated as the first image explanation and with second obtain the corresponding image of image and be illustrated as the second image explanation, suppose that pre-set ratio is " 85% ", and the comparison integrate module 14 of image display system 10 comparison first to obtain the coincidence factor that image and second obtains image be " 90% ", at this moment, first obtains image and second obtains the coincidence factor 90% of image above pre-set ratio " 85% ", the comparison integrate module 14 of image display system 10 namely can with first obtain the corresponding image of image be illustrated as the first image explanation and with second obtain the corresponding image of image and be illustrated as the explanation of the second image and be integrated into the image explanation, and because the second timing that obtains image is later than the first timing that obtains image, then second obtain image will be deleted.
Then, configuration module 15 that namely can be by image display system 10 according to image explanation dispose at least the literal viewing area in obtaining image, content in the respectively corresponding image explanation in literal viewing area, for instance, suppose that the image explanation includes two explanatory notes, then 15 of the configuration modules of image display system 10 can dispose two literal viewing areas in obtaining image, and two explanatory notes of corresponding image explanation then can be distinguished in two literal viewing areas that the configuration module 15 of image display system 10 disposes.
Then, the storage module 16 of image display system 10 can obtain image with each, obtain image explanation corresponding to image with each, and literal viewing area mutual corresponding be stored in database 17 corresponding with image explanation, so namely the image video signal can be converted to and have image key diagram picture.
At last, namely can obtain image by 18 pairs of the display modules of image display system 10 and show, when image is obtained in demonstration, image can be illustrated that correspondence is presented in the literal viewing area, the user namely can see the image with image explanation.
The present invention can be applied in the image display system 10 that the image video signal is converted to the image with image explanation in the different device, for example: on the computer, on the handheld apparatus, electronic book device, electric paper apparatus, this have an effect that image key diagram picture namely is similar to caricature, and can be fast and easily the image video signal is converted to the image with image explanation by the present invention.
In the present invention the image video signal is converted in the image display system 10 with image key diagram picture, can comprises modular converter 21, playing module 22, image processing module 23 and setting module 24.
Because the explanation of the image in the image video signal not necessarily can have explanatory note, when in the image explanation, only having speech explanation, modular converter 21 that namely can be by comprising in the image display system 10 of the present invention is converted to explanatory note with speech explanation, and be that the technological means of literal can be with reference to prior art with speech conversion, for example: dynamic time axis calibration method (Dynamic Time Warping) or concealed markov model method (Hidden Markov Model), the present invention no longer gives unnecessary details at this, the technological means that existing voice is converted to literal all can be contained among the application category of the present invention, and the present invention is not limited to specific conversion regime.
Because the image explanation also can comprise speech explanation, therefore, 18 pairs of the display modules of image display system 10 obtain image and show, and the explanatory note correspondence in the image explanation is presented in the literal viewing area, can play by the speech explanation in the 22 pairs of image explanations of playing module that comprise in the image display system 10 of the present invention, by the broadcast of speech explanation, the user can know from experience impression and obtain the meaning that image will present.
The image processing module 23 that the present invention comprises can carry out to obtaining image the image of editor, modification, replacement, replacement and the ordering of image to be processed, and can allow the image with image explanation can press close to presenting of caricature effect.
In that regularly being retrieved as, obtain in the image first acquisition module 12 of image video signal by image display system 10, the time that can regularly obtain the image video signal by the first acquisition module 12 of 24 pairs of image display systems 10 of setting module of comprising in the image display system 10 of the present invention is set, adjust the most suitable present the image video signal have an image key diagram picture.
Referring to Fig. 2, image video signal " abc.wmv " need to be carried out the conversion of image this hypothesis user, can receive image video signal " abc.wmv " (step 110) by the receiver module 11 of image display system 10.
Referring to Fig. 3 .1 and Fig. 3 .2, the first acquisition module 12 of image display system 10 can be retrieved as the image video signal at per 5 seconds and obtain image, therefore, in image video signal " abc.wmv " in the time of 0 minute 1 second, the first acquisition module 12 of image display system 10 can obtain first and obtain image 31, and in image video signal " abc.wmv " in the time of 0 minute 6 seconds, the first acquisition module 12 of image display system 10 can obtain second and obtain image 32 (step 120), only obtain image 32 with the first acquisition module 12 and second at this and carry out the explanation of embodiment, image video signal " abc.wmv " obtain all the other obtain image and illustrate and illustrate at this, in fact the first acquisition module 12 of image display system 10 can regularly be retrieved as the image video signal and obtain image.
Referring to Fig. 4, the first acquisition module 12 of image display system 10 obtains first and obtains image 31 and second and obtain after the image 32, owing to usually include explanatory note in the image video signal, speech explanation or literal are in conjunction with the image explanation of speech explanation, therefore, meeting is obtained timing " 0 minute and 1 second " and " 0 minute and 6 seconds " that image 31 and second obtains image 32 according to first respectively by the second acquisition module 13 of image display system 10 again, first obtains the timing that image 31 and second obtains image 32 can be temporary in the internal memory, or store with the form of archives, obtain out corresponding with timing " 0 minute and 1 second " and " 0 minute and 6 seconds " respectively image explanation (step 130), timing " 0 minute and 1 second " falls between the timing " 0 minute 1 second to 0 minute and 2 seconds ", namely the image explanation corresponding to the timing shadow " 0 minute 1 second to 0 minute and 2 seconds " of image video signal can be obtained out, i.e. the first image explanation 33 is " ABC "; And timing " 0 minute and 6 seconds " falls between the timing " 0 minute 5 seconds to 0 minute and 7 seconds ", namely the image explanation corresponding to the timing shadow " 0 minute 5 seconds to 0 minute and 7 seconds " of image video signal can be obtained out, i.e. the second image explanation 34 is " XYZ ".
Referring to Fig. 5, each is obtained after image explanation corresponding to image obtain out at the second acquisition module 13 of image display system 10, namely can obtain by 14 pairs first of the comparison integrate modules of image display system 10 image 31 and second obtains image 32 and overlaps comparison (step 140), suppose that first obtains the coincidence factor that image 31 and second obtains image 32 and be " 90% ", and when pre-set ratio is " 85% ", at this moment, first obtains image 31 and second obtains the coincidence factor " 90% " of image 32 above pre-set ratio " 85% ", the comparison integrate module 14 of image display system 10 namely can obtain image 31 and second with first and obtain image 32 and distinguish corresponding the first image explanation 33 " ABC " and the second image explanation 34 " XYZ " and will be integrated into and integrate image explanation " ABC XYZ " (step 150), and because the second timing that obtains image 32 is " 0 minute and 1 second " for " 0 minute and 6 seconds " are later than the first timing that obtains image 31, therefore, second obtains image 32 will deleted (step 160), namely integrate image explanation " ABC XYZ " can and first to obtain image 31 corresponding.
Referring to Fig. 6, after the comparison integrate module 14 of image display system 10 obtains image 31 and corresponding integration image explanation " ABC XYZ " is finished dealing with first, meeting is obtained in the image 31 first by the configuration module 15 of image display system 10 again, dispose the first literal viewing area 35 according to integrating image explanation " ABCXYZ ", and the first literal viewing area 35 namely can illustrate " ABC XYZ " corresponding (step 170) with the integration image.
Then, the storage module 16 of image display system 10 can obtain image 31 with first, obtain integration image explanation " ABC XYZ " corresponding to image 31 with first, and first literal viewing area 35 mutual corresponding are stored in database 17 (step 180) corresponding with integrating image explanation " ABC XYZ ", so image with image explanation that namely the image video signal can be converted to.
Referring to Fig. 7, namely can obtain image 31 by 18 pairs first of the display modules of image display system 10 at last shows, when image 31 is obtained in demonstration first, integration image explanation " ABC XYZ " correspondence can be shown in the first literal viewing area 35 (step 190), the user namely can see the image with image explanation.
Referring to Fig. 8 .1 " and Fig. 8 .2; each is obtained after image explanation corresponding to image obtain out at the second acquisition module 13 of image display system 10; namely can obtain by 14 pairs first of the comparison integrate modules of image display system 10 image 31 and second and obtain image 32 and overlap comparison (step 140); can know that first obtains the coincidence factor that image 31 and second obtains image 32 and be " 0% "; therefore; first obtains image 31 and second obtains image 32 and distinguish corresponding the first image explanation 33 " ABC " and the second image explanation 34 " XYZ " and will not need integratedly, and does not need according to late first the obtaining image 31 or second and obtain image 32 and delete of timing.
Obtaining image 31 and second at the second acquisition module 13 of image display system 10 with first obtains after the first image explanation 33 " ABC " of image 32 correspondences and the second image explanation 34 " XYZ " obtain out, can be again configuration module 15 by image display system 10 obtain image 31 and second first respectively and obtain in the image 32, respectively according to the first image explanation 33 " ABC " and the second image explanation 34 " XYZ " configuration the first literal viewing area 35 and the second literal viewing area 36, and the first literal viewing area 35 namely can be corresponding with the first image explanation 33 " ABC ", and the second literal viewing area 36 namely can illustrate 34 " XYZ " corresponding (step 170) with the second image.
Then, the storage module 16 of image display system 10 can obtain image 31 and second with first and obtain image 32, obtain image 31 and second and obtain the first image explanation 33 " ABC " corresponding to image 32 and the second image explanation 34 " XYZ " with first, and first literal viewing area 35 and second literal viewing area 36 mutual corresponding are stored in database 17 (step 180) corresponding with the first image explanation 33 " ABC " and the second image explanation 34 " XYZ ", so namely the image video signal can being converted to has image key diagram picture.
Referring to Fig. 9 .1 and Fig. 9 .2, namely can obtain by 18 pairs first of the display modules of image display system 10 at last image 31 or second obtains image 32 and shows, show first obtain image 31 or second and obtain image 32 in, the first image can be illustrated that 33 " ABC " or the second image illustrate that 34 " XYZ " correspondence is shown in the first literal viewing area 35 or the second literal viewing area 36 (step 190), the user namely can see the image with image explanation.
Because above-described embodiment is the embodiment that image is illustrated as explanatory note, and the explanation of the image in the image video signal not necessarily can have explanatory note, when in the image explanation, only having speech explanation, can speech explanation be converted to explanatory note (step 210) by the modular converter 21 that comprises in the image display system 10 of the present invention, namely can the processing mode identical with the explanatory note of image explanation.
And because the image explanation also can comprise speech explanation, therefore, 18 pairs of the display modules of image display system 10 obtain image and show, and the explanatory note correspondence in the image explanation is shown in the literal viewing area, can play (step 220) by the speech explanation in the 22 pairs of image explanations of playing module that comprise in the image display system 10 of the present invention, by the broadcast of speech explanation, the user more can know from experience impression and obtain the meaning that image will present.
And the image processing module 23 that the present invention comprises can carry out to obtaining image the image processing (step 230) of editor, modification, replacement, replacement and the ordering of image, can also allow the image with image explanation more can press close to presenting of caricature effect.
In that regularly being retrieved as, obtain in the image first acquisition module 12 of image video signal by image display system 10, the time that can regularly obtain the image video signal by the first acquisition module 12 of 24 pairs of image display systems 10 of setting module of comprising in the image display system 10 of the present invention is set (step 240), adjust thus the most suitable present the image video signal have an image key diagram picture.