CN103428575A - Modulating and demodulating control method of information overlaid in media stream or media file images - Google Patents
Modulating and demodulating control method of information overlaid in media stream or media file images Download PDFInfo
- Publication number
- CN103428575A CN103428575A CN201310363978XA CN201310363978A CN103428575A CN 103428575 A CN103428575 A CN 103428575A CN 201310363978X A CN201310363978X A CN 201310363978XA CN 201310363978 A CN201310363978 A CN 201310363978A CN 103428575 A CN103428575 A CN 103428575A
- Authority
- CN
- China
- Prior art keywords
- information
- coding
- pattern
- pixels
- media file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Studio Circuits (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention relate to a control method, in particular to a modulating and demodulating control method of information overlaid in media stream or media file images, and solves the problem that readable characters or icon information overlaid in the media streams or the media file images can not be automatically and reliably recognized and further cannot be controlled by computers in the prior art. The modulating and demodulating control method includes setting an information displaying area on the media stream or the media file images, separating the information displaying area into various information areas corresponding to different accumulated information respectively and one enable code area; coding information to be accumulated respectively, and accumulating coded information on images; decoding information in all information areas, and transmitting the decoded information to a PC (personal computer) to be displayed or be used for follow-up control signals. The modulating and demodulating control method of the information overlaid in the media stream or the media file images can be used for display and demonstration atmosphere exaggeration, television studio atmosphere exaggeration, digital film, 4D movie theatre, process control and the like.
Description
Technical field
The present invention relates to control method, particularly by the autocontrol method of stack automatic identification information on the picture of the Media Stream for showing or media file, be specially the modulation of overlapped information on Media Stream or media file picture and separate control method.
Background technology
As everyone knows, adopting prior art has not been a difficult problem at Media Stream (video file produced as on-the-spot broadcasting) or media file (as picture, video file, Flash, PPT etc.) the readable character of upper stack or icon class information, IT industry, Industry Control, monitoring trade, display and demonstration and even whole relating in the application that screen message shows, as the date timing code, for the Quick Response Code etc. of the identification of manually taking pictures, but these information can not be advantageously used in computer identification and further realize on this basis controlling reliably automatically.Along with the raising of photo resolution, the raising of video resolution and code stream, and the raising of the network bandwidth and storage condition, the possibility that these media files can carry information further improves.
Summary of the invention
The present invention solves readable character that prior art superposes on Media Stream or media file or icon class information and can not, for computer identification and further realize on this basis the problem of controlling reliably automatically, the modulation of overlapped information on a kind of Media Stream or media file picture be provided and separate control method.
The present invention adopts following technical scheme to realize: the modulation of overlapped information and solution control method on Media Stream or media file picture, by following steps, realized: an information display area (corner location of normally not obvious obstruction key frame) 1) is set on Media Stream or media file picture, and information display area is divided into to some from different wish the overlapped informations information area and an enable code district one to one, 2) information of wish stack is encoded respectively, and the information after encoding according to Media Stream (video flowing produced as on-the-spot broadcasting) or the media file of press the time shaft broadcasting (as video file, Flash, PPT etc.) reproduction time axle be added to Media Stream or a certain corresponding picture of the media file play by time shaft on information display area in the corresponding informance district in, perhaps the information after coding directly is added to and is late for media file that countershaft plays (as picture, webpage etc.) in the corresponding informance district in the information display area on picture, in the stack of enable code district, for confirming effective predefined the enabling of information in each information area, encode simultaneously, 3) Media Stream after overlapped information or media file are transmitted and play or directly play, 4) in playing process, with special software (can be that the PC program can be also the embedded type program) to each information area and enable code district real time scan, enable coding while occurring when the enable code district is predefined, effective information is contained in the expression information area, then the information in each information area is decoded (i.e. the reverse procedure of coding) and obtained the information in each information area with identical coding definition, 5) information decoding obtained sends PC to, and the information that PC obtains decoding is shown or for the control signal (such as for demonstration, warning, record, control etc.) of subsequent control,
The information of described wish stack can be comment, or with Media Stream or press the control information corresponding to picture plot in a certain moment on the time shaft of the media file that time shaft plays, as earthquake appears in a certain picture plot, now corresponding control information be one can vibrative control information; A certain picture plot occurs that a snowstorm is raging, and now corresponding control information is a control information that can produce cold wind; Or synchronize the information of Real-time Collection of stack with Media Stream, as physical quantitys such as the on-the-spot switching signal that gathers, button signal, temperature, humidity, pressure, gas density, GPS positional information, speed etc., just can be additionally many these information of transmission of Media Stream or media file like this, be used for Real time identification, demonstration and the control of far-end;
It is to adopt one of following coding method to realize that the information of wish stack is encoded: i) information after the coding is a pattern of pixels or pattern of pixels sequence, by the RGB colour of pattern of pixels or the RGB colour sequence of pattern of pixels sequence formation, carrys out predefine or characterizes the information that needs coding; Ii) with one-dimensional bar code, come predefine or sign to need the information (coding rule of one-dimensional bar code is existing known technology, therefore with one-dimensional bar code, comes predefine or sign to need the information of coding easily to realize) of coding; Iii) with Quick Response Code, come predefine or sign to need the information (coding rule of Quick Response Code is existing known technology, therefore with Quick Response Code, comes predefine or sign to need the information of coding easily to realize) of coding;
Described for confirming that the effective predefined coding that enables of information in each information area consists of the pattern of pixels sequence, the RGB colour sequence formed by the pattern of pixels sequence realizes enabling the predefine of coding.
The described coding method i that the information of wish stack is encoded) in, its pattern of pixels or pattern of pixels sequence are to adopt known method exploitation (as Delphi, C, Deng language) specific software, some customizing messages are encoded to colour pixel that RGB is different and original Media Stream or media file synthetic, perhaps adopt known software to work out in the manual edit mode, the media file of picture/mb-type adopts the image processing software Photoshop of Adobe company can be to such as " * .jpg, * .png, * .gif, * .GIF, * .bmp, * .tga " etc. format-pattern carry out Edit and Compose.Wherein the picture of " * .png, * .GIF, * .bmp, * .tga " form has been used the Lossless Image Compression method or has not used compression, even if the picture record for certain the single pattern of pixels in a picture, when reduction, its RGB colour does not have error, and we can define accurate information on each pattern of pixels like this.Use 24 color depths of RGB (2 24 power kind colors=16777216 kinds of colors) can express many information.Such as the RGB tristimulus values of using a pattern of pixels mean respectively three analog quantitys (as temperature, humidity, pressure), a pattern of pixels can mean three analog quantitys, use for another example the pattern of pixels of 24 color depths, its RGB arrangement value can be encoded and be represented that a Chinese character is (as GBK code Chinese character base, it is the ISN extension specification on the GB2312-80 standard base, used the double-byte encodings scheme, its coding range is from 8140 to FEFE, totally 23940 code bits, 21003 Chinese characters have been included altogether, with 16777216 coding representatives, have enough and to spare), the pattern of pixels sequential coding of such 100 pixel x100 pixels can hold 10000 Chinese characters (or other character), so undoubtedly coding can effectively promote the ability of picture/mb-type media file carry information.
If manually adopt camera (or handheld terminal camera) to take the ad-hoc location pixel colour obtained, owing to affected by display characteristics, ambient lighting, acquisition parameters etc., may introduce larger error.Manually take at present only applicable to one dimension code and Quick Response Code.If by computer software, the scanning of ad-hoc location pixel colour is obtained, as long as display card supports true color to show (current video card is all supported basically), can not have error ground to obtain the colour of this pixel, can reduce exactly its information contained, and be not subject to the impact of display characteristics, ambient lighting, make also original reliable assurance of information.
Represent that with pattern of pixels or pattern of pixels sequence digital quantity is more convenient, more reliable.Pattern of pixels rgb value such as certain XY coordinate figure place, during coding, define: R=0 interval scale " 0 ", when R=255 is representative " 1 ", during decoding, define: when R<100 interval scales " 0 ", work as R > 150 interval scales " 1 ", like this R in XY colour herein to be coded in 0 ~ 255 decoding just very light, even if due to the colour error brought of compression (as the compression of jpg picture), can not affect correctly reading of data yet, fault-tolerance and the reliability of data have been improved, read R=4 representative " 0 " during such as decoding, read R=245 representative " 1 ".(as pictures such as png, the pixel colour does not have error)
The pattern of pixels sequence can also adopt known various coded systems, such as binary-coded decimal (8421 yards, 5421 yards, 2421 yards), every like this four pixels represent a binary-coded decimal, and the Multi-encoding mode that so can inherit like this in digital circuit is carried out the Code And Decode to digital information.Such as 8421 yards, 5421 yards, 2421 yards of decimal number " 5 " are respectively 0101,1000,1011, just can these data have been expressed reliably by four pixels with different RGB values like this.
Video media file can adopt Video processing software After Effects, Premiere Pro, the Apple-Final Cut Pro X of Adobe company to being edited such as format videos such as " * .avi, * .wmv, * .mp4, * .mov ", adopt the two-dimensional vector animation software Adobe Flash of Adobe company to * .fla * .swf animation file, on some frame of time shaft, specific region at picture, by information coding, be that pattern of pixels or the stack of pattern of pixels sequence are synthetic, such as the representative of the pattern of pixels with certain position is controlled.Detailed process is the presumptive area at image, after each pattern of pixels position is selected, by the RGB palette, recalls corresponding color (a certain RGB colour means), corresponding pattern of pixels position (information area) is filled synthetic.
Its pattern of described pattern of pixels can be square, pane, circle etc., in compression ratio larger picture or video, recommend large pattern of pixels, to the error of pattern of pixels rgb value modulation-decompress(ion), especially adopt the method for RGB gray value (colour) direct representation analog quantity to the reduction that reduces image sharpness.
Synthetic for the coding of the physical simulation amount in video or digital quantity is the same with picture, different is that video has good multiframe " picture ", at that frame video of different moment correspondences or the ad-hoc location of those a few frame videos, representative have the pattern of pixels of special information or pattern of pixels sequence and corresponding two field picture synthetic, when playing, engrave the information that can solve at that time when corresponding in corresponding position, for showing or controlling.
Described pattern of pixels also can be formed by color lump type spcial character coding, such as characters such as pictures " ●, zero, ■, ", can produce in the mode of captions and superpose, and characterizes equally some information.The script of captions can define character in captions and the color of character, the position in picture, the synthetic video file that carries customizing messages of mode that can pixel
On, such as the Video processing software Premiere Pro with Adobe company edits captions and synthetic.Captions also can be preserved with the form of independent subtitle file in addition, such as form subtitle files such as SubViewer (* .SUB), SubRip (* .SRT), during broadcasting, can synchronously play with main video file, predefined spcial character captions will appear in the predetermined moment picture preposition.Caption editing software can be edited with SrtEdit.
The least unit of above-described pattern of pixels is a pixel, in order to increase reliability, can adopt the pixels such as 2x2,4x4 to represent a pattern of pixels unit, the colour error that adopts certain compression to bring with reply, the reliability of raising system.
Information after coding and enable the be added to corresponding information area and enable district of coding, its stacked system is known technology, stacked system is also very flexible, such as by manually clicking the mouse, using existing software (as After Effects, Premiere Pro, Photoshop, Apple-Final Cut Pro X) to operate, in addition also can be by script files such as XML, smil, JS by the information after coding and on enable to encode implantation Media Stream or media file picture.
As everyone knows, the role of Media Stream or media file normally shows picture and text and video information, such as in a control system, flow for displaying and various input/output states in the display frame of Media Stream or media file, and in the present invention, the information that the information display area of Media Stream or media file picture additionally can superpose is controlled for transmission of information with as output, the benefit of doing like this is outside guaranteeing Media Stream or the main displaying contents of media file, the information of these stacks can be used as the output of the some links in control system and controls source, as before and the bridge of program part data-interface afterwards, more separate flexibly with deployment afterwards before making, picture by Media Stream or media file output just can be controlled output, make more universal and grasp of programming, even to the editor of one section video, or to editor's interactive operation of webpage, by screen display, decode, just can control or some equipment of remote control.
The present invention is by Media Stream or media file picture overlapped information, can, not changing under the technological accumulation and inheritance that Media Stream or media file originally stored, and sent, transmit, play, can additionally carry more information, for purposes such as demonstration, record, controls.Such as a short essay word explanation is encoded to the information may be superimposed on picture, this picture is not lost original characteristic, still can in Photo Browser, show, transmit in network; On it, the content of stack can be identified for purposes such as real-time or synchronous demonstration, record, controls by the software of computer custom-made automatically automatically, effectively improves the efficiency of system.Such as for a typical graph text information, originally comment may be stored in lane database, at lane database, may be simultaneously picture file name, picture file is stored on a medium in path, when these picture and text are transmitted, picture and text need respectively read and transmit, show, after adopting technology of the present invention, as long as there is picture just having comment to exist, even if downloaded picture in the browsing pictures time like this, with special-purpose software, this demodulation is being read in the future, also can see original comment content, like this except conveniently browsing added text, also the original creation word content of picture had to certain protective effect, to preserving starting information of original news, anti-tamper have certain meaning.
For the media file of the live images such as FLASH, video, equally also can be by adopting technology of the present invention.This media file (stream) is not lost original characteristic, still can in corresponding browser, show, transmit in network, and specific information can be by corresponding specific software demodulation out.As long as have like this this media file to exist at the customizing messages just carried to some extent, with special-purpose software, this demodulation is read in the future, realize the functions such as synchronous demonstration, control.
The present invention can be used for controlling predetermined target, as curtain, light, platform motor, fog machine, bubble generating machine, fan etc.; Typical case's application scenarios as display and demonstration atmosphere is played up, TV broadcast Room atmosphere is played up, digital movie, 4D movie theatre, process control etc.
The accompanying drawing explanation
The schematic diagram that Fig. 1 is an information display area arranging on Media Stream or media file picture.
In figure: 1-information display area, 2-1,2-2,2-3,2-4,2-5,2-6, the 2-7-information area, 3-enable code district.
Embodiment
The modulation of overlapped information and solution control method on Media Stream or media file picture, by following steps, realized: the corner location that 1) a normally not obvious obstruction key frame of information display area 1(is set on Media Stream or media file picture), and information display area is divided into to some from different wish the overlapped informations information area (2-1,2-2,2-3,2-4,2-5,2-6,2-7) (i.e. corresponding information in the information area) and an enable code district 3 one to one, 2) information of wish stack is encoded respectively, and the information after encoding according to Media Stream (video flowing produced as on-the-spot broadcasting) or the media file of press the time shaft broadcasting (as video file, Flash, PPT etc.) reproduction time axle be added to Media Stream or a certain corresponding picture of the media file play by time shaft on information display area in the corresponding informance district in, perhaps the information after coding directly is added to and is late for media file that countershaft plays (as picture, webpage etc.) in the corresponding informance district in the information display area on picture, in the stack of enable code district, for confirming effective predefined the enabling of information in each information area, encode simultaneously, 3) Media Stream after overlapped information or media file are transmitted and play or directly play, 4) in playing process, with special software, (can be that the PC program can be also the embedded type program, this is that easily realize or known to those skilled in the art) to each information area and enable code district real time scan, enable coding while occurring when the enable code district is predefined, effective information is contained in the expression information area, then the information in each information area is decoded (i.e. the reverse procedure of coding) and obtained the information in each information area with identical coding definition, 5) information decoding obtained sends PC to, and the information that PC obtains decoding is shown or for the control signal (such as for demonstration, warning, record, control etc.) of subsequent control,
The information of described wish stack can be comment, or with Media Stream or press the control information corresponding to picture plot in a certain moment on the time shaft of the media file that time shaft plays, as earthquake appears in a certain picture plot, now corresponding control information be one can vibrative control information; A certain picture plot occurs that a snowstorm is raging, and now corresponding control information is a control information that can produce cold wind; Or synchronize the information of Real-time Collection of stack with Media Stream, as physical quantitys such as the on-the-spot switching signal that gathers, button signal, temperature, humidity, pressure, gas density, GPS positional information, speed etc.;
It is to adopt one of following coding method to realize that the information of wish stack is encoded: i) information after the coding is a pattern of pixels or pattern of pixels sequence, by the RGB colour of pattern of pixels or the RGB colour sequence of pattern of pixels sequence formation, carrys out predefine or characterizes the information that needs coding; Ii) with one-dimensional bar code, come predefine or sign to need the information (coding rule of one-dimensional bar code is existing known technology, therefore with one-dimensional bar code, comes predefine or sign to need the information of coding easily to realize) of coding; Iii) with Quick Response Code, come predefine or sign to need the information (coding rule of Quick Response Code is existing known technology, therefore with Quick Response Code, comes predefine or sign to need the information of coding easily to realize) of coding;
Described for confirming that the effective predefined coding that enables of information in each information area consists of the pattern of pixels sequence, the RGB colour sequence formed by the pattern of pixels sequence realizes enabling the predefine of coding.
Further, when adopting i) coding method the time, can also to be that information area is corresponding be less than or equal to 3 different information for different wish overlapped informations and the corresponding relation of the information area 2, and carry out respectively predefine or characterize the information that needs coding with R, G, the B colour of pattern of pixels or pattern of pixels sequence.When the information of need stack is more, with this, reduce the quantity of the information area.
Described pattern of pixels also can be formed by color lump type spcial character coding, such as characters such as pictures " ●, zero, ■, ", can produce in the mode of captions and superpose, and characterizes equally some information.The script of captions can define character in captions and the color of character, the position in picture, and the synthetic video file that carries customizing messages of mode that can pixel, such as the Video processing software Premiere Pro with Adobe company edit captions and synthesizes.Captions also can be preserved with the form of independent subtitle file in addition, such as form subtitle files such as SubViewer (* .SUB), SubRip (* .SRT), can synchronously play with main video file, caption editing software can be edited with SrtEdit.
Embodiment 1
The information of the present embodiment wish stack is comment.
1) corner location of a normally not obvious obstruction key frame of information display area 1(is set on Media Stream or media file picture), and information display area is divided into to some from different wish the overlapped informations information area (2-1,2-2,2-3,2-4,2-5,2-6,2-7) (i.e. corresponding information in the information area) and an enable code district 3 one to one, in several informations area, can predefine information area 2-1 be the comment information area, 2) comment of wish stack is encoded respectively, and the comment after encoding according to Media Stream (video flowing produced as on-the-spot broadcasting) or the media file of press the time shaft broadcasting (as video file, Flash, PPT etc.) reproduction time axle be added to Media Stream or a certain corresponding picture of the media file play by time shaft on information display area in corresponding informance district 2-1 in, perhaps the comment after coding directly is added to and is late for media file that countershaft plays (as picture, webpage etc.) in the corresponding informance district 2-1 in the information display area on picture, in the enable code district, 3 stacks are encoded for effective predefined the enabling of the information in confirmation district 2-1 simultaneously, 3) Media Stream after overlapped information or media file are transmitted and play or directly play, 4) in playing process, with special software (can be that the PC program can be also the embedded type program) to information area 2-1 and enable code district real time scan, enable coding while occurring when the enable code district is predefined, mean that information area 2-1 contains effective information, then the information in the 2-1 of the information area is decoded (i.e. the reverse procedure of coding) with identical coding definition and obtained the comment in the 2-1 of the information area, 5) comment decoding obtained sends PC to, and the comment that PC obtains decoding is shown,
It is to adopt one of following coding method to realize that comment is encoded:
I) the comment information after the coding is a pattern of pixels sequence, the RGB colour sequence that the pattern of pixels sequence forms is carried out predefine or is characterized comment, by the RGB colour of each pattern of pixels in the pattern of pixels sequence, carrys out predefine or characterizes a word in comment, use the pattern of pixels of 24 color depths, its RGB colour can be encoded and be represented a Chinese character, as GBK code Chinese character base, it is the ISN extension specification on the GB2312-80 standard base, used the double-byte encodings scheme, its coding range is from 8140 to FEFE, totally 23940 code bits, 21003 Chinese characters have been included altogether, with 16777216 coding representatives, have enough and to spare, as, certain pattern of pixels that is 8140 by the RGB colour represents a specific Chinese character, certain pattern of pixels that is 8141 by the RGB colour represents another specific Chinese character, the pattern of pixels sequential coding of such 100 pixel x100 pixels can hold 10000 Chinese characters (or other character).GBK code Chinese character base is one and gives an example, also can adopt other known encoding Chinese characters storehouse as the four-corner system, or predefined other any coded font, as, but predefine RGB hexadecimal colour is " 56AF78 " interval scale " he ", RGB hexadecimal colour is " 62F084 " interval scale " you " ..., as long as the rule that Code And Decode adopts unanimously.
Ii) with one-dimensional bar code, come predefine or sign to need the comment (coding rule of one-dimensional bar code is existing known technology, therefore with one-dimensional bar code, comes predefine or sign to need the information of coding easily to realize) of coding;
Iii) with Quick Response Code, come predefine or sign to need the comment (coding rule of Quick Response Code is existing known technology, therefore with Quick Response Code, comes predefine or sign to need the information of coding easily to realize) of coding;
Described for confirming that the effective predefined coding that enables of information in each information area consists of the pattern of pixels sequence, the RGB colour sequence formed by the pattern of pixels sequence realizes enabling the predefine of coding.Such as, can select five pattern of pixels to form the pattern of pixels sequence (more much more reliable) that enables coding, and predefine is when the colour of five pattern of pixels that enable coding
MeanDuring for " 10101 " (digital quantity), or be enabled state when " 8-10-100-7-11 ".
Embodiment 2
The information of the present embodiment wish stack is control information corresponding to the picture plot in a certain moment on the time shaft with Media Stream or the media file play by time shaft, as earthquake appears in a certain picture plot, now corresponding control information be one can vibrative control information; A certain picture plot occurs that a snowstorm is raging, and now corresponding control information is a control information that can produce cold wind;
1) corner location of a normally not obvious obstruction key frame of information display area 1(is set on Media Stream or media file picture), and information display area is divided into to some from different wish the overlapped informations information area (2-1,2-2,2-3,2-4,2-5,2-6,2-7) (i.e. corresponding information in the information area) and an enable code district 3 one to one; It can predefine information area 2-2 in several informations area be the information area of the corresponding control information of picture plot; 2) to the picture plot of wish stack, corresponding control information is encoded respectively, and the information after coding is added to Media Stream according to the reproduction time axle of Media Stream (video flowing produced as on-the-spot broadcasting) or the media file (as video file, Flash, PPT etc.) play by time shaft or the picture of a certain correspondence of the media file play by time shaft (the respective picture plot is arranged) on information display area in corresponding informance district 2-2 in, simultaneously in the enable code district 3 stacks for confirm information in each information area effectively predefined enabling encode; 3) Media Stream after overlapped information or media file are transmitted and play or directly play; 4) in playing process, with special software (can be that the PC program can be also the embedded type program) to information area 2-2 and enable code district 3 real time scans, enable coding while occurring when the enable code district is predefined, mean that information area 2-2 contains effective information, then the information in the 2-2 of the information area is decoded (i.e. the reverse procedure of coding) with identical coding definition and obtained the corresponding control information of picture plot in the 2-2 of the information area; 5) the corresponding control information of picture plot decoding obtained sends PC to, the corresponding control information of the picture plot that PC obtains decoding is for the control signal of subsequent control, realize corresponding control, as start one and can produce the device of vibrations and match with the earthquake plot of picture or start blower fan and produce cold wind and match with the picture plot that a snowstorm is raging, so subsequent control be one of ordinary skill in the art particularly the automatic control those skilled in the art easily realize;
To the picture plot, encode be to adopt one of following coding method realization in corresponding control information:
I) information after the coding is a pattern of pixels or pattern of pixels sequence, by the RGB colour of pattern of pixels or the RGB colour sequence of pattern of pixels sequence formation, carrys out predefine or characterizes the information that needs coding; As, the pattern of pixels that is 100 by a RGB colour, or the RGB colour sequence pattern of pixels sequence that is " 11001010 " carry out predefine or characterize can vibrative control information.The pattern of pixels that is 200 by a RGB colour, or the pattern of pixels sequence that RGB colour sequence is " 20-40-60-80 " is carried out predefine or is characterized the control information that can produce cold wind.
Ii) with one-dimensional bar code, carry out predefine or characterize the picture plot correspondence control information (coding rule of one-dimensional bar code is existing known technology, and the information of therefore with one-dimensional bar code, coming predefine or sign to encode easily realizes) that need encode;
Iii) with Quick Response Code, carry out predefine or characterize the picture plot correspondence control information (coding rule of Quick Response Code is existing known technology, and the information of therefore with Quick Response Code, coming predefine or sign to encode easily realizes) that need encode;
Described for confirming that the effective predefined coding that enables of information in each information area consists of the pattern of pixels sequence, the RGB colour sequence formed by the pattern of pixels sequence realizes enabling the predefine of coding.Enable coded system identical with embodiment 1 for example.
Different information can superpose in information display area 1 simultaneously.As a certain picture plot be in the evening that a snowstorm is raging, occur earthquake, control information corresponding to this picture plot be one can vibrative control information and a control information that can produce cold wind; Can predefine information area 2-2 in several informations area be can vibrative control information the information area, the information area that information area 2-3 is the control information that can produce cold wind; In the 2-3 of the 2-2He information area, the information area respectively stack with one of three kinds of modes codings can vibrative control information and the control information that can produce cold wind.Other is identical with embodiment 2.
Embodiment 4
The information of the present embodiment wish stack is the information of the Real-time Collection that superposes of synchronize with Media Stream.The described Media Stream of the present embodiment (as the video file of on-the-spot broadcasting generation) comes from the real time monitoring picture of coal-face under coal mine, needs the information of Real-time Collection to comprise temperature, humidity, pressure, gas density, wind speed etc.
1) on the Media Stream picture, (being the real time monitoring picture of coal-face under coal mine) arranges the corner location of a normally not obvious obstruction key frame of information display area 1(), and information display area is divided into to some from different wish the overlapped informations information area (2-1,2-2,2-3,2-4,2-5,2-6,2-7) (i.e. corresponding information in the information area) and an enable code district 3 one to one; In several informations area, can predefine information area 2-3 be the temperature information district, information area 2-4 be the humidity information district, and information area 2-5 is the pressure information district, and information area 2-6 is the gas density information area, and information area 2-7 is the wind speed information district; 2) by the aforesaid various information of different sensors Real-time Collection (temperature, humidity, pressure, gas density, wind speed), information to the wish stack is encoded respectively, and in the corresponding informance district in the information display area that the information after coding is added on a certain correspondence (constantly corresponding with the information gathering) picture of Media Stream according to the reproduction time axle of Media Stream, simultaneously the stack of enable code district for confirm information in each information area effectively predefined enabling encode; 3) Media Stream after overlapped information or media file are transmitted (as transferring to aboveground) and play or directly play; 4) in playing process, with special software, (can be that the PC program can be also the embedded type program, this is that easily realize or known to those skilled in the art) to each information area and enable code district real time scan, enable coding while occurring when the enable code district is predefined, effective information is contained in the expression information area, then the information in each information area is decoded (i.e. the reverse procedure of coding) and obtained the information in each information area with identical coding definition; 5) information decoding obtained sends PC to, the information that PC obtains decoding is shown (showing temperature, humidity, pressure, gas density, wind speed under different pictures) or for the control signal of subsequent control (realize exceeding standard such as the value of information by real-time and set point compare and report to the police or record or control corresponding equipment while exceeding standard, as gas exceeds standard to start blower fan or regulate, increase rotation speed of fan);
It is to adopt one of following coding method to realize that the information of wish stack is encoded:
I) information after the coding is a pattern of pixels or pattern of pixels sequence, by the RGB colour of pattern of pixels or the RGB colour sequence of pattern of pixels sequence formation, carrys out predefine or characterizes the information that needs coding; As, the analog quantity that the pattern of pixels that is 10 by a RGB colour is carried out predefine or characterized a certain Real-time Collection information (temperature, humidity, pressure, gas density, wind speed) is 10, or the pattern of pixels sequence that is " 10010 " by a RGB colour sequence is carried out predefine or characterized the digital quantity of a certain Real-time Collection information (temperature, humidity, pressure, gas density, wind speed);
Ii) with one-dimensional bar code, carry out predefine or characterize the physical quantity (coding rule of one-dimensional bar code is existing known technology, therefore with one-dimensional bar code, carrys out predefine or characterizes that the information that needs coding easily realizes) of temperature, humidity, pressure, gas density, wind speed;
Iii) with Quick Response Code, carry out predefine or characterize the physical quantity (coding rule of Quick Response Code is existing known technology, therefore with Quick Response Code, carrys out predefine or characterizes that the information that needs coding easily realizes) of temperature, humidity, pressure, gas density, wind speed;
Described for confirming that the effective predefined coding that enables of information in each information area consists of the pattern of pixels sequence, the RGB colour sequence formed by the pattern of pixels sequence realizes enabling the predefine of coding.Enable giving an example of coding similar to Example 1 or identical.
Embodiment 5
When adopting i) coding method the time, can also to be that information area is corresponding be less than or equal to 3 different information for different wish overlapped informations and the corresponding relation of the information area 2, and carry out respectively predefine or characterize the information that needs coding with R, G, the B colour of pattern of pixels or pattern of pixels sequence.When the information of need stack is more, with this, reduce the quantity of the information area.
, in embodiment 4, in several informations area, can predefine information area 2-5 be for example temperature, humidity, pressure information district, information area 2-6 be the gas density information area, and information area 2-7 is the wind speed information district; In the 2-5 of the information area with the R representation temperature, and characterize the value of temperature with the colour scope 0-255 of R, represent humidity with G, and characterize the value of humidity with the colour scope 0-255 of G, with the B representative pressure, and characterize the value of pressure with the colour scope 0-255 of B.
Embodiment 6
Described pattern of pixels also can be formed by color lump type spcial character coding, such as characters such as pictures " ●, zero, ■, ", can produce in the mode of captions and superpose, and characterizes equally some information.The script of captions can define character in captions and the color of character, the position in picture, and the synthetic video file that carries customizing messages of mode that can pixel, such as the Video processing software Premiere Pro with Adobe company edit captions and synthesizes.Captions also can be preserved with the form of independent subtitle file in addition, such as form subtitle files such as SubViewer (* .SUB), SubRip (* .SRT), can synchronously play with main video file, caption editing software can be edited with SrtEdit.All the other are identical with other embodiment.
Claims (5)
1. the modulation of overlapped information and separate control method on Media Stream or media file picture, it is characterized in that being realized by following steps: 1) information display area is set on Media Stream or media file picture, and information display area is divided into to some from different wish the overlapped informations information area and an enable code district one to one; 2) information of wish stack is encoded respectively, and the information after coding is added to Media Stream according to the reproduction time axle of Media Stream or the media file play by time shaft or a certain corresponding picture of the media file play by time shaft on information display area in the corresponding informance district in, in corresponding informance district in the information display area perhaps information after coding directly is added on the picture of being late for the media file that countershaft plays, simultaneously in the stack of enable code district for confirming the effectively predefined coding that enables of information in each information area; 3) Media Stream after overlapped information or media file are transmitted and play or directly play; 4) in playing process, with special software to each information area and enable code district real time scan, enable coding while occurring when the enable code district is predefined, effective information is contained in the expression information area, then the information in each information area is decoded and obtained the information in each information area with identical coding definition; 5) information decoding obtained sends PC to, and the information that PC obtains decoding is shown or for the control signal of subsequent control;
The information of described wish stack is comment, or with Media Stream or press the control information corresponding to picture plot in a certain moment on the time shaft of the media file that time shaft plays, or synchronizes the information of the Real-time Collection that superposes with Media Stream;
It is to adopt one of following coding method to realize that the information of wish stack is encoded: i) information after the coding is a pattern of pixels or pattern of pixels sequence, by the RGB colour of pattern of pixels or the RGB colour sequence of pattern of pixels sequence formation, carrys out predefine or characterizes the information that needs coding; Ii) with one-dimensional bar code, carry out predefine or characterize the information that needs coding; Iii) with Quick Response Code, carry out predefine or characterize the information that needs coding;
Described for confirming that the effective predefined coding that enables of information in each information area consists of the pattern of pixels sequence, the RGB colour sequence formed by the pattern of pixels sequence realizes enabling the predefine of coding.
2. the modulation of overlapped information and solution control method on Media Stream according to claim 1 or media file picture, is characterized in that its pattern of described pattern of pixels can be square, pane, circle.
3. the modulation of overlapped information and separate control method on Media Stream according to claim 1 and 2 or media file picture, is characterized in that described pattern of pixels is formed by color lump type spcial character coding, in the mode of captions, produces and superpose.
4. the modulation of overlapped information and separate control method on Media Stream according to claim 1 and 2 or media file picture, it is characterized in that when adopting i) coding method the time, can also to be that information area is corresponding be less than or equal to 3 different information for different wish overlapped informations and the corresponding relation of the information area, and carry out respectively predefine or characterize the information that needs coding with R, G, the B colour of pattern of pixels or pattern of pixels sequence.
5. the modulation of overlapped information and separate control method on Media Stream according to claim 3 or media file picture, it is characterized in that when adopting i) coding method the time, can also to be that information area is corresponding be less than or equal to 3 different information for different wish overlapped informations and the corresponding relation of the information area, and carry out respectively predefine or characterize the information that needs coding with R, G, the B colour of pattern of pixels or pattern of pixels sequence.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310363978.XA CN103428575B (en) | 2013-08-19 | 2013-08-19 | Encoding and decoding control method of information overlaid in media stream or media file images |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310363978.XA CN103428575B (en) | 2013-08-19 | 2013-08-19 | Encoding and decoding control method of information overlaid in media stream or media file images |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103428575A true CN103428575A (en) | 2013-12-04 |
| CN103428575B CN103428575B (en) | 2017-04-12 |
Family
ID=49652632
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310363978.XA Active CN103428575B (en) | 2013-08-19 | 2013-08-19 | Encoding and decoding control method of information overlaid in media stream or media file images |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103428575B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105120318A (en) * | 2015-08-24 | 2015-12-02 | 天脉聚源（北京）科技有限公司 | Television interactive system interactive information display position selecting method |
| CN105120360A (en) * | 2015-08-24 | 2015-12-02 | 天脉聚源（北京）科技有限公司 | Television interactive system interactive information generation method |
| CN106428933A (en) * | 2015-10-01 | 2017-02-22 | 海南亚元防伪技术研究所（普通合伙） | Code-scanned goods with color-changing background |
| WO2022037026A1 (en) * | 2020-08-21 | 2022-02-24 | Oppo广东移动通信有限公司 | Information processing method, encoder, decoder, storage medium, and device |
| CN115251126A (en) * | 2021-10-29 | 2022-11-01 | 智锐达仪器科技南通有限公司 | Two-dimensional code, corresponding coding and decoding method and code spraying and reading device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060013489A1 (en) * | 2004-07-16 | 2006-01-19 | Pospischil Robert R | Methods of representing a color with a compressed code |
| CN100589544C (en) * | 2007-03-22 | 2010-02-10 | 中兴通讯股份有限公司 | Method for obtaining barcode information for terminal video business |
| CN101510269B (en) * | 2009-02-18 | 2011-02-02 | 华为终端有限公司 | Method and device for acquiring two-dimensional code in video |
| US20120050620A1 (en) * | 2010-08-27 | 2012-03-01 | Naohisa Kitazato | Receiver, reception method, transmitter, transmission method, program and broadcasting system |
| CN102737318A (en) * | 2011-04-07 | 2012-10-17 | 北京龙腾睿信科技有限公司 | Method for superimposing two-dimensional code information on outdoors multimedia information terminal |
-
2013
- 2013-08-19 CN CN201310363978.XA patent/CN103428575B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060013489A1 (en) * | 2004-07-16 | 2006-01-19 | Pospischil Robert R | Methods of representing a color with a compressed code |
| CN100589544C (en) * | 2007-03-22 | 2010-02-10 | 中兴通讯股份有限公司 | Method for obtaining barcode information for terminal video business |
| CN101510269B (en) * | 2009-02-18 | 2011-02-02 | 华为终端有限公司 | Method and device for acquiring two-dimensional code in video |
| US20120050620A1 (en) * | 2010-08-27 | 2012-03-01 | Naohisa Kitazato | Receiver, reception method, transmitter, transmission method, program and broadcasting system |
| CN102737318A (en) * | 2011-04-07 | 2012-10-17 | 北京龙腾睿信科技有限公司 | Method for superimposing two-dimensional code information on outdoors multimedia information terminal |
Non-Patent Citations (1)
| Title |
|---|
| 袁远松: "具有高压缩比汉字编码能力的彩色二维条码的设计与实现", 《中国优秀硕士学术论文电子期刊网》, 15 June 2009 (2009-06-15) * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105120318A (en) * | 2015-08-24 | 2015-12-02 | 天脉聚源（北京）科技有限公司 | Television interactive system interactive information display position selecting method |
| CN105120360A (en) * | 2015-08-24 | 2015-12-02 | 天脉聚源（北京）科技有限公司 | Television interactive system interactive information generation method |
| CN106428933A (en) * | 2015-10-01 | 2017-02-22 | 海南亚元防伪技术研究所（普通合伙） | Code-scanned goods with color-changing background |
| WO2022037026A1 (en) * | 2020-08-21 | 2022-02-24 | Oppo广东移动通信有限公司 | Information processing method, encoder, decoder, storage medium, and device |
| CN115251126A (en) * | 2021-10-29 | 2022-11-01 | 智锐达仪器科技南通有限公司 | Two-dimensional code, corresponding coding and decoding method and code spraying and reading device |
| CN115251126B (en) * | 2021-10-29 | 2023-11-21 | 智锐达仪器科技南通有限公司 | Two-dimensional code, corresponding coding and decoding method, code spraying and code reading device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103428575B (en) | 2017-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10334285B2 (en) | Apparatus, system and method | |
| US20230119262A1 (en) | System and Method of Controlling Equipment Based on Data Transferred In-Band in Video via Optically Encoded Images | |
| EP3192256B1 (en) | Image processing apparatus and image processing method | |
| CN103428575A (en) | Modulating and demodulating control method of information overlaid in media stream or media file images | |
| KR102266224B1 (en) | Reproduction device, reproduction method, and recording medium | |
| TWI595777B (en) | Transmitting display management metadata over hdmi | |
| CN100531291C (en) | Method and system for mastering and distributing enhanced color space content | |
| US10460501B2 (en) | System and method for processing digital video | |
| CN101682793B (en) | Creating three dimensional graphics data | |
| CN102771109B (en) | The method, apparatus and system of delivery of video and control are carried out by overwrite video data | |
| CN1218574C (en) | Interactive video equipment and its caption superposition method | |
| US20080101456A1 (en) | Method for insertion and overlay of media content upon an underlying visual media | |
| US20180005449A1 (en) | System and method for processing digital video | |
| US20070009099A1 (en) | Tag information display control apparatus, information processing apparatus, display apparatus, tag information display control method and recording medium | |
| KR102706741B1 (en) | Display of video slice height in video subpictures | |
| CN105144729A (en) | Transmitting display management metadata over HDMI | |
| CN102577366A (en) | System and method for distributing auxiliary data embedded in video data | |
| US20200005831A1 (en) | Systems and methods for processing digital video | |
| CN111818295B (en) | Image acquisition method and device | |
| CN103559527A (en) | Method and system for generating two-dimension codes with graphic features | |
| CN110662086A (en) | 5G high-definition live broadcast system and video processing method | |
| CN106664442A (en) | Transmitting apparatus, transmitting method, receiving apparatus, and receiving method | |
| US20070014405A1 (en) | Tag information production apparatus, tag information production method and recording medium | |
| KR20240032899A (en) | A transmitting device for point cloud data and a method performed in the transmitting device, and a receiving device for point cloud data and a method performed in the receiving device | |
| CN103037169A (en) | Picture split joint combination method of embedded hard disk video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |