CN103428575B - Encoding and decoding control method of information overlaid in media stream or media file images - Google Patents

Encoding and decoding control method of information overlaid in media stream or media file images Download PDF

Info

Publication number
CN103428575B
CN103428575B CN201310363978.XA CN201310363978A CN103428575B CN 103428575 B CN103428575 B CN 103428575B CN 201310363978 A CN201310363978 A CN 201310363978A CN 103428575 B CN103428575 B CN 103428575B
Authority
CN
China
Prior art keywords
information
area
pattern
coding
pixels
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310363978.XA
Other languages
Chinese (zh)
Other versions
CN103428575A (en
Inventor
符晓友
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201310363978.XA priority Critical patent/CN103428575B/en
Publication of CN103428575A publication Critical patent/CN103428575A/en
Application granted granted Critical
Publication of CN103428575B publication Critical patent/CN103428575B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention relate to a control method, in particular to a modulating and demodulating control method of information overlaid in media stream or media file images, and solves the problem that readable characters or icon information overlaid in the media streams or the media file images can not be automatically and reliably recognized and further cannot be controlled by computers in the prior art. The modulating and demodulating control method includes setting an information displaying area on the media stream or the media file images, separating the information displaying area into various information areas corresponding to different accumulated information respectively and one enable code area; coding information to be accumulated respectively, and accumulating coded information on images; decoding information in all information areas, and transmitting the decoded information to a PC (personal computer) to be displayed or be used for follow-up control signals. The modulating and demodulating control method of the information overlaid in the media stream or the media file images can be used for display and demonstration atmosphere exaggeration, television studio atmosphere exaggeration, digital film, 4D movie theatre, process control and the like.

Description

The encoding and decoding control method of overlapped information on Media Stream or media file picture
Technical field
The present invention relates to control method, more particularly to by folding on the picture of the Media Stream for showing or media file Plus the autocontrol method of automatic identification information, the encoding and decoding of overlapped information specially on Media Stream or media file picture Control method.
Background technology
It is well known that using prior art in Media Stream(Such as broadcast live the video file of generation)Or media file(Such as Picture, video file, Flash, PPT etc.)Upper superposition readability character or icon category information have not been a difficult problems, in IT industries, work Industry control, monitoring trade, display and demonstration or even to be entirely related to the application that screen message shows inner, such as date-time code, it is used for Take pictures manually Quick Response Code of identification etc., but these information can not be advantageously used in computer and reliably recognize automatically and further exist Control is realized on the basis of this.With the raising of the raising of photo resolution, video resolution and code stream, and the network bandwidth and deposit The raising of storage condition, these media files can carry the possibility of information and further improve.
The content of the invention
The present invention solves the readable character that is superimposed on Media Stream or media file of prior art or icon category information not Computer can be used for and reliably recognize and further realize on this basis the problem for controlling automatically, there is provided a kind of Media Stream or matchmaker The encoding and decoding control method of overlapped information on body file picture.
The present invention adopts the following technical scheme that realization:On Media Stream or media file picture the coding of overlapped information and Decoding control method, is realized by following steps:1)One information display area is set on Media Stream or media file picture(Generally It is the corner location for not interfering significantly with key frame), and by information display area be divided into it is some from different desire overlapped informations one by one The corresponding information area and an enable code area;2)The information to be superimposed is encoded respectively, and by the information after coding according to Media Stream(Such as broadcast live the video flowing of generation)Or the media file that on time countershaft is played(Such as video file, Flash, PPT Deng)Reproduction time axle be added to Media Stream or on time countershaft play media file it is a certain correspondence picture on presentation of information In corresponding informance area in area, or the information after coding is directly superimposed to be late for the media file of countershaft broadcasting(As schemed Piece, webpage etc.)Picture on information display area in corresponding informance area in, while being superimposed for confirming each letter code area is enabled Information in breath area is effectively predefined to enable coding;3)Media Stream or media file after overlapped information is transmitted and broadcasts Put or directly play out;4)In playing process, with special software(Can be PC programs can also be embedded type journey Sequence)To each information area and enable code area real time scan, when the predefined enable coding in enable code area occurs, represent that the information area contains There is effective information, then the information in each information area is decoded with the definition of identical coding(The reverse procedure for encoding) And obtain the information in each information area;5)The information transmission that decoding is obtained is carried out to PC, PC to the information that decoding is obtained Show or for the control signal of subsequent control(Such as it is used to show, report to the police, record, control);
The information to be superimposed can be comment, or with Media Stream or on time countershaft play media file Time shaft on a certain moment the corresponding control information of picture plot, there is earthquake in such as a certain picture plot, now corresponding Control information is a control information that can produce vibration;A snowstorm is raging for a certain picture plot appearance, now corresponding control letter Breath is a control information that can produce cold wind;Or the information of the Real-time Collection of superposition synchronous with Media Stream, such as collection Physical quantitys such as live switching signal, button signal, temperature, humidity, pressure, gas density, GPS position information, speed etc., so Media Stream or media file just additionally can transmit these information more, for the Real time identification of distal end, show and control;
The information to be superimposed is carried out encoding to be realized using one of following coding method:i)Information after coding is one Individual pattern of pixels or pattern of pixels sequence, the RGB color value formed with the RGB color value or pattern of pixels sequence of pattern of pixels Sequence is predefining or characterize the information that need to be encoded;ii)The information that need to be encoded is predefined or characterized with one-dimensional bar code(It is one-dimensional The coding rule of bar code is existing known technology, therefore easy come the information for predefining or sign need to be encoded with one-dimensional bar code Realize);iii)The information that need to be encoded is predefined or characterized with Quick Response Code(The coding rule of Quick Response Code is existing known skill Art, therefore predefined with Quick Response Code or characterize what the information that need to be encoded easily was realized);
It is described for confirming that effectively predefined enable coding is by pattern of pixels sequence to the information in each information area Constitute, realized enabling the predefined of coding with the RGB color value sequence of pattern of pixels sequence formation.
The described coding method i that the information to be superimposed is encoded)In, its pattern of pixels or pattern of pixels sequence are Developed using known method(Such as Delphi, C, language)Some customizing messages are encoded to the different colors of RGB by specific software Value pixel and original Media Stream or media file synthesis, or adopt known software to work out in manual edit mode, scheme The media file of sheet type can be to such as " * .jpg, * .png using the image processing software Photoshop of Adobe companies , * .gif, * .GIF, * .bmp, * .tga " etc. format-pattern carry out Edit and Compose.Wherein " * .png, * .GIF, * .bmp, * .tga " picture of form has used Lossless Image Compression method or has not used compression, even for certain in a picture The picture record of single pixel pattern, in reduction, its RGB color value will not have error, and so we can be in each pattern of pixels It is upper to define accurate information.Using 24 color depths of RGB(2 24 power kind color=16777216 kind colors)Can express many Information.Such as three analog quantitys are represented respectively using the RGB tristimulus values of a pattern of pixels(Such as temperature, humidity, pressure), i.e., One pattern of pixels can represent three analog quantitys;For another example using the pattern of pixels of 24 color depth, its RGB arrangement value can With one Chinese character of coding stands(It is the ISN extension specification in GB2312-80 standard bases such as GBK code Chinese character basies, uses Double-byte encodings scheme, from 8140 to FEFE, totally 23940 code bits, have included altogether 21003 Chinese characters to its coding range, use 16777216 coding stands have enough and to spare), the pattern of pixels sequential coding of such 100 pixel x100 pixel can accommodate 10000 Chinese characters(Or other characters), undoubtedly such coding can effectively be lifted picture/mb-type media file carry information energy Power.
If manually adopting camera(Or handheld terminal camera)The ad-hoc location pixel colour that shooting is obtained, due to being shown Device characteristic, ambient lighting, acquisition parameters etc. affect, and may introduce larger error.Shoot at present manually only to one-dimension code and Quick Response Code is suitable for.If obtained by scanning of the computer software to ad-hoc location pixel colour, as long as it is very color to show that card is supported Color shows(Current video card is substantially all support), the colour of the pixel can not be with errors obtained, can reduce exactly Its information for containing, and not affected by display characteristics, ambient lighting, makes also original reliable guarantee of information.
Digital quantity is represented with pattern of pixels or pattern of pixels sequence then more convenient, more reliable.Such as certain XY coordinate value The pattern of pixels rgb value at place, defines during coding:R=0 interval scales " 0 ", when R=255 is to represent " 1 ", define during decoding:Work as R<100 Interval scale " 0 ", works as R>150 interval scales " 1 ", the coding of the R in such XY colours herein 0 ~ 255 decoding just very easily, Even if due to compression(Such as the compression of jpg pictures)The colour error brought, does not interfere with the correct reading of data yet, improves number According to fault-tolerance and reliability, such as decode when read R=4 represent " 0 ", read R=245 represent " 1 ".(The pictures such as picture png, as Plain color value does not have error)
Pattern of pixels sequence can also adopt known various coded systems, such as binary-coded decimal(8421 yards, 5421 yards, 2421 Code), a binary-coded decimal is so represented per four pixels, the various coded systems that so so can be inherited in digital circuit come right The coding of digital information and decoding.8421 yards of such as decimal number " 5 ", 5421 yards, 2421 code divisions be not 0101,1000 , 1011, so this data just can reliably be expressed with different RGB values with four pixels.
Video media file can adopt Video processing software After Effects, Premiere of Adobe companies Pro, Apple-Final Cut Pro X are compiled to format videos such as " * .avi, * .wmv, * .mp4, * .mov " Volume, using the two-dimensional vector animation software Adobe Flash of Adobe companies to * .fla * .swf animation files, in time shaft On some frames, in the specific region of picture, it is that pattern of pixels or pattern of pixels its superimposition synthesize to encode information onto, such as with certain The pattern of pixels of individual position represents control.Detailed process is the presumptive area in image, is selected in each pattern of pixels position After selecting, corresponding color is recalled by RGB palettes(A certain RGB color value is represented), to corresponding pattern of pixels position(Information Area)Filling synthesis.
Described pattern of pixels its pattern can be square, pane, circle etc., compression ratio is than larger picture or regards In frequency, recommend big pattern of pixels, error pattern of pixels rgb value modulated-is decompressed to reducing the reduction of image sharpness, In particular by RGB gray values(Colour)The method for directly representing analog quantity.
As being with picture for the coding synthesis of the physical simulation amount in video or digital quantity, except for the difference that video There are a lot of frames " picture ", in the ad-hoc location of different moment corresponding that frame video or that a few frame video, representative is had especially The pattern of pixels or pattern of pixels sequence of information and corresponding two field picture synthesize, when playing, when corresponding position is corresponding Information at that time is solved by engraving, for showing or controlling.
Described pattern of pixels also can be formed by color lump type spcial character coding, such as characters such as " ●, zero, ■, ", Can be produced in the way of captions and be superimposed, equally characterizing some information.The script of captions can define the character in captions And the position in color, the picture of character, can be synthesized in the way of pixel on the video file for carrying customizing messages, such as Captions and synthesis are edited with the Video processing software Premiere Pro of Adobe companies.In addition captions can also be with independent captions The form of file is preserved, such as the form subtitle file such as SubViewer (* .SUB), SubRip (* .SRT), during broadcasting, Can synchronously play with main view frequency file, predefined spcial character captions will occur in the predetermined position of picture at the predetermined moment Put.Caption editing software can be edited with SrtEdit.
The least unit of above-described pattern of pixels is a pixel, and in order to increase reliability 2x2,4x4 can be adopted Represent a pattern of pixels unit etc. pixel, with tackle using certain compression strap come colour error, improve system reliability.
Information after coding and enable coding and be added to and the corresponding information area and enable area, its stacked system is known skill Art, stacked system also very flexibly, such as manually click on mouse using existing software (as After Effects, Premiere Pro, Photoshop, Apple-Final Cut Pro X) it is i.e. operable, in addition can also by XML, The script files such as smil, JS are by the information after coding and enable on coding implantation Media Stream or media file picture.
It is well known that the role of Media Stream or media file typically shows picture and text and video feeds, such as at one In control system, flow for displaying and various input/output states in the display picture of Media Stream or media file, and this In bright, the information that the information display area of Media Stream or media file picture then additionally can be superimposed is for transmission information and conduct Output control, advantage of this is that and ensureing outside Media Stream or the main display content of media file, the information of these superpositions Can as the output control source of the link of some in control system, the program part data-interface as before and after Bridge so that before and after deployment more it is separate flexibly, the picture exported by Media Stream or media file just can be with Controlled output so that programming is easily popularized and grasped, or even the editor to one section of video, or the editor interaction behaviour to webpage Make, decoded by screen display, it is possible to control or remote control some equipment.
The present invention is not by Media Stream or media file picture overlapped information, changing Media Stream or media file Originally under storage, transmission, transmission, the technological accumulation and inheritance of broadcasting, more information can be additionally carried, for showing, recording, control Etc. purposes.One short explanatory note is such as encoded to the information that may be superimposed on picture, the picture does not lose original spy Property, still can show in Photo Browser, transmit in network;The content being superimposed thereon can be automatically specially fixed by computer The software automatic identification of system is used for the purposes such as real-time or synchronous display, record, control, effectively improves the efficiency of system.Than Such as a typical graph text information, originally comment is possibly stored in lane database, while in lane database Possibility be picture file name, and picture file is then stored on the medium in a path, when this picture and text is transmitted When, picture and text are respectively necessary for reading and transmitting, show, after using technology of the present invention, as long as there is picture being just described Word exists, even if so having downloaded picture in the browsing pictures time, in the future with special software to this demodulation reading, can also see To original comment content, so in addition to conveniently browsing added text, also the original creation word content of picture is had Certain protective effect, to preserving starting information of original news, anti-tamper having certain meaning.
For the media file of the live images such as FLASH, video, equally can also be by using of the present invention Technology.The media file(Stream)Original characteristic is not lost, still can be shown in corresponding browser, in network Transmission, and specific information then can be demodulated by corresponding specific software.As long as so there is this media file just having The customizing messages for being carried exists, and in the future with special software to this demodulation reading, realizes the functions such as synchronous display, control.
The present invention can be used to control predetermined target, such as curtain, light, platform motor, fog machine, bubble generating machine, fan; Typical application scenarios such as display and demonstration atmosphere is rendered, TV broadcast Room atmosphere is rendered, digital movie, 4D movie theatres, process control etc..
Description of the drawings
Fig. 1 is the schematic diagram of the information display area arranged on Media Stream or media file picture.
In figure:1- information display areas, 2-1,2-2,2-3,2-4,2-5,2-6,2-7- information area, 3- is enabled Code area.
Specific embodiment
The encoding and decoding control method of overlapped information on Media Stream or media file picture, is realized by following steps:1) One information display area 1 is set on Media Stream or media file picture(The corner position of key frame is not typically interfered significantly with Put), and information display area is divided into some from the different one-to-one informations area of desire overlapped information(2-1,2-2,2- 3rd, 2-4,2-5,2-6,2-7)(I.e. one information area one information of correspondence)Code area 3 is enabled with one;2)To what is be superimposed Information is encoded respectively, and by the information after coding according to Media Stream(Such as broadcast live the video flowing of generation)Or countershaft on time The media file of broadcasting(Such as video file, Flash, PPT)Reproduction time axle be added to Media Stream or on time countershaft play Media file a certain correspondence picture on information display area in corresponding informance area in, it is or the information after coding is direct It is added to and is late for the media file of countershaft broadcasting(Such as picture, webpage)Picture on information display area in corresponding informance In area, while being superimposed for confirming that effectively predefined enable encodes the information in each information area code area is enabled;3)Superposition Media Stream or media file after information is transmitted and plays or directly play out;4)In playing process, with specially Software(Can be PC programs can also be embedded type program, this readily will suggest themselves to persons of ordinary skill in the art realize or It is known)To each information area and enable code area real time scan, when the predefined enable coding in enable code area occurs, letter is represented Effective information is contained in breath area, then the information in each information area is decoded with the definition of identical coding(What is encoded is anti- To process)And obtain the information in each information area;5)The letter that the information transmission that decoding is obtained is obtained to PC, PC to decoding Breath is shown or for the control signal of subsequent control(Such as it is used to show, report to the police, record, control);
The information to be superimposed can be comment, or with Media Stream or on time countershaft play media file Time shaft on a certain moment the corresponding control information of picture plot, there is earthquake in such as a certain picture plot, now corresponding Control information is a control information that can produce vibration;A snowstorm is raging for a certain picture plot appearance, now corresponding control letter Breath is a control information that can produce cold wind;Or the information of the Real-time Collection of superposition synchronous with Media Stream, such as collection Physical quantitys such as live switching signal, button signal, temperature, humidity, pressure, gas density, GPS position information, speed etc.;
The information to be superimposed is carried out encoding to be realized using one of following coding method:i)Information after coding is one Individual pattern of pixels or pattern of pixels sequence, the RGB color value formed with the RGB color value or pattern of pixels sequence of pattern of pixels Sequence is predefining or characterize the information that need to be encoded;ii)The information that need to be encoded is predefined or characterized with one-dimensional bar code(It is one-dimensional The coding rule of bar code is existing known technology, therefore easy come the information for predefining or sign need to be encoded with one-dimensional bar code Realize);iii)The information that need to be encoded is predefined or characterized with Quick Response Code(The coding rule of Quick Response Code is existing known skill Art, therefore predefined with Quick Response Code or characterize what the information that need to be encoded easily was realized);
It is described for confirming that effectively predefined enable coding is by pattern of pixels sequence to the information in each information area Constitute, realized enabling the predefined of coding with the RGB color value sequence of pattern of pixels sequence formation.
Further, when adopting i)Coding method when, the different overlapped informations that are intended to may be used also with the corresponding relation of the information area 2 To be that an information area correspondence is less than or equal to 3 different information, and with pattern of pixels or R, G, B color of pattern of pixels sequence Value is come to predefine or characterize the information that need to be encoded respectively.When the information that need to be superimposed is more, the quantity of the information area is reduced with this.
Described pattern of pixels also can be formed by color lump type spcial character coding, such as characters such as " ●, zero, ■, ", Can be produced in the way of captions and be superimposed, equally characterizing some information.The script of captions can define the character in captions And the position in color, the picture of character, the video file for carrying customizing messages can be synthesized in the way of pixel, such as use The Video processing software Premiere Pro of Adobe companies edit captions and synthesis.In addition captions can also be with independent captions text The form of part is preserved, such as the form subtitle file such as SubViewer (* .SUB), SubRip (* .SRT), can and main view Frequency file is synchronously played, and caption editing software can be edited with SrtEdit.
Embodiment 1
The present embodiment information to be superimposed is comment.
1)One information display area 1 is set on Media Stream or media file picture(Key frame is not typically interfered significantly with Corner location), and information display area is divided into some from the different one-to-one informations area of desire overlapped information(2-1, 2-2,2-3,2-4,2-5,2-6,2-7)(I.e. one information area one information of correspondence)Code area 3 is enabled with one;If Can be with Predefined information area 2-1 as the comment information area in the dry information area;2)The comment to be superimposed is carried out respectively Coding, and by the comment after coding according to Media Stream(Such as broadcast live the video flowing of generation)Or the matchmaker that on time countershaft is played Body file(Such as video file, Flash, PPT)Reproduction time axle be added to Media Stream or on time countershaft play media text It is in the corresponding informance area 2-1 in information display area on a certain correspondence picture of part or the comment after coding is direct It is added to and is late for the media file of countershaft broadcasting(Such as picture, webpage)Picture on information display area in corresponding informance In area 2-1, while being superimposed for the effective predefined enable coding of the information in confirmation area 2-1 code area 3 is enabled; 3)Media Stream or media file after overlapped information is transmitted and plays or directly play out;4)In playing process, With special software(Can be PC programs can also be embedded type program)To information area 2-1 and code area real time scan is enabled, when When the predefined enable coding in enable code area occurs, represent that information area 2-1 contains effective information, then in the 2-1 of the information area Information is decoded with the definition of identical coding(The reverse procedure for encoding)And obtain the expository writing in the 2-1 of the information area Word;5)Send the comment that decoding is obtained to PC, PC shows to the comment that decoding is obtained;
Comment is carried out encoding to be realized using one of following coding method:
i)Comment information after coding is a pattern of pixels sequence, the RGB color value sequence that pattern of pixels sequence is formed Row predefining or characterize comment, i.e., with the RGB color value of each pattern of pixels in pattern of pixels sequence come predefined or Characterize a word in comment;Using the pattern of pixels of 24 color depth, its RGB color value can be with coding stands one Chinese character, such as GBK codes Chinese character base, are the ISN extension specifications in GB2312-80 standard bases, have used double-byte encodings side Case, from 8140 to FEFE, totally 23940 code bits, have included altogether 21003 Chinese characters to its coding range, with 16777216 codings Representative is had enough and to spare, and e.g., with certain pattern of pixels that RGB color value is 8140 a specific Chinese character is represented, and is with RGB color value 8141 certain pattern of pixels represents another specific Chinese character ... ..., the pattern of pixels sequence of such 100 pixel x100 pixel Coding can accommodate 10000 Chinese characters(Or other characters).GBK code Chinese character basies are a citing, and other have may also be employed The encoding Chinese characters storehouse such as four-corner system known, or predefined other any coded fonts, e.g., can predefine RGB 16 and enter Colour processed is " 56AF78 " interval scale " he ", and RGB hexadecimals colour is " 62F084 " interval scale " you " ... ..., as long as coding It is regular consistent with what decoding was adopted.
ii)The comment that need to be encoded is predefined or characterized with one-dimensional bar code(The coding rule of one-dimensional bar code is Existing known technology, therefore predefined with one-dimensional bar code or characterize what the information that need to be encoded easily was realized);
iii)The comment that need to be encoded is predefined or characterized with Quick Response Code(The coding rule of Quick Response Code is existing known Technology, therefore predefined with Quick Response Code or characterize what the information that need to be encoded easily was realized);
It is described for confirming that effectively predefined enable coding is by pattern of pixels sequence to the information in each information area Constitute, realized enabling the predefined of coding with the RGB color value sequence of pattern of pixels sequence formation.Such as, five can be selected Individual pattern of pixels constitutes the pattern of pixels sequence for enabling coding(It is more much more reliable), and it is predefined when five pixels for enabling coding The colour of pattern is expressed as " 10101 "(Digital quantity)When, or for " 8-10-100-7-11 " when be enabled state.
Embodiment 2
The present embodiment information to be superimposed is a certain on the time shaft of the media file with Media Stream or countershaft broadcasting on time There is earthquake in the corresponding control information of picture plot at moment, such as a certain picture plot, and now corresponding control information is one The control information of vibration can be produced;A snowstorm is raging for a certain picture plot appearance, and now corresponding control information is one can produce The control information of cold wind;
1)One information display area 1 is set on Media Stream or media file picture(Key frame is not typically interfered significantly with Corner location), and information display area is divided into some from the different one-to-one informations area of desire overlapped information(2-1, 2-2,2-3,2-4,2-5,2-6,2-7)(I.e. one information area one information of correspondence)Code area 3 is enabled with one;If Can be with Predefined information area 2-2 as the information area of picture plot correspondence control information in the dry information area;2)To the picture to be superimposed Face plot correspondence control information is encoded respectively, and by the information after coding according to Media Stream(Such as broadcast live the regarding of generation Frequency flows)Or the media file that on time countershaft is played(Such as video file, Flash, PPT)Reproduction time axle be added to Media Stream Or a certain correspondence of the media file of countershaft broadcasting on time(There is respective picture plot)Picture on information display area in Corresponding informance area 2-2 in, while enable code area 3 be superimposed it is effectively predefined for confirming the information in each information area Enable coding;3)Media Stream or media file after overlapped information is transmitted and plays or directly play out;4)Broadcasting During putting, with special software(Can be PC programs can also be embedded type program)To information area 2-2 and enable code area 3 Real time scan, when the predefined enable coding in enable code area occurs, represents that information area 2-2 contains effective information, then to information Information in area 2-2 is decoded with the definition of identical coding(The reverse procedure for encoding)And obtain information area 2-2 Interior picture plot correspondence control information;5)The picture plot correspondence control information that decoding is obtained sends PC to, and PC will The picture plot correspondence control information that decoding is obtained realizes corresponding control for the control signal of subsequent control, such as starts One device that can produce vibrations and with the earthquake plot of picture be engaged or start one blower fan generation cold wind and and picture The plot that a snowstorm is raging is engaged, and subsequent control so is that one of ordinary skill in the art are particularly automatic control art personnel appearance Easily realize;
Picture plot correspondence control information is carried out encoding to be realized using one of following coding method:
i)Information after coding is a pattern of pixels or pattern of pixels sequence, with the RGB color value of pattern of pixels or The RGB color value sequence that person's pattern of pixels sequence is formed is predefining or characterize the information that need to be encoded;Such as, it is with a RGB color value 100 pattern of pixels, or RGB color value sequence shakes for the pattern of pixels sequence of " 11001010 " to predefine or characterize to produce Dynamic control information.With the pattern of pixels that RGB color value is 200, or RGB color value sequence is " 20-40-60-80 " Pattern of pixels sequence is predefining or characterize the control information that can produce cold wind.
ii)The picture plot that need to be encoded correspondence control information is predefined or characterized with one-dimensional bar code(One-dimensional bar code Coding rule be existing known technology, therefore predefined with one-dimensional bar code or characterize the information that need to encode and easily realize 's);
iii)The picture plot that need to be encoded correspondence control information is predefined or characterized with Quick Response Code(The coding rule of Quick Response Code It is then existing known technology, therefore is predefined with Quick Response Code or characterize what the information that need to be encoded easily was realized);
It is described for confirming that effectively predefined enable coding is by pattern of pixels sequence to the information in each information area Constitute, realized enabling the predefined of coding with the RGB color value sequence of pattern of pixels sequence formation.Enable coded system citing It is same as Example 1.
Embodiment 3
Different information can be simultaneously superimposed in information display area 1.If a certain picture plot is an evening that a snowstorm is raging On there is earthquake, this corresponding control information of picture plot is that a control information that can produce vibration and one can produce cold wind Control information;Can be with information that Predefined information area 2-2 is the control information that can produce vibration in several informations area Area, information area 2-3 is the information area of the control information that can produce cold wind;Fold respectively in information area 2-2 and information area 2-3 Plus the control information of the produced vibration encoded with one of three kinds of modes and the control information that cold wind can be produced.Other and embodiment 2 is identical.
Embodiment 4
The present embodiment information to be superimposed is the information of the Real-time Collection of superposition synchronous with Media Stream.Described in the present embodiment Media Stream(Such as broadcast live the video file of generation)Come from the real-time monitoring picture of underground coal mine coal-face, need real-time The information of collection includes temperature, humidity, pressure, gas density, wind speed etc..
1)On Media Stream picture(That is the real-time monitoring picture of underground coal mine coal-face)One presentation of information is set Area 1(The corner location of key frame is not typically interfered significantly with), and information display area is divided into some is intended to be superimposed from different The one-to-one information area of information(2-1,2-2,2-3,2-4,2-5,2-6,2-7)(I.e. one information area correspondence one Information)Code area 3 is enabled with one;Can be with Predefined information area 2-3 as temperature information area, the information area in several informations area 2-4 be humidity information area, information area 2-5 be pressure information area, information area 2-6 be the gas density information area, information area 2-7 For wind speed information area;2)By the aforesaid various information of different sensors Real-time Collection(Temperature, humidity, pressure, gas density, Wind speed), the information to be superimposed is encoded respectively, and the information after coding is added to according to the reproduction time axle of Media Stream The a certain correspondence of Media Stream(It is i.e. corresponding with the information gathering moment)In corresponding informance area in information display area on picture, together When enable coding for confirming that the information in each information area is effectively predefined enabling code area and be superimposed;3)After overlapped information Media Stream or media file are transmitted(Such as transmit to well)And play or directly play out;4)In playing process, With special software(Can be PC programs can also be embedded type program, this readily will suggest themselves to persons of ordinary skill in the art realize Or it is known)To each information area and enable code area real time scan, when the predefined enable coding in enable code area occurs, Represent that effective information is contained in the information area, then the information in each information area is decoded with the definition of identical coding(Compile The reverse procedure of code)And obtain the information in each information area;5), to PC, PC is to decoding for the information transmission that decoding is obtained To information shown(Show temperature, humidity, pressure, gas density, the wind speed under different pictures)Or for follow-up The control signal of control(Such as by the real-time value of information and setting value be compared and realize exceeded warning or record or Corresponding equipment is controlled when exceeded, such as gas is exceeded starts blower fan or adjust increase rotation speed of fan);
The information to be superimposed is carried out encoding to be realized using one of following coding method:
i)Information after coding is a pattern of pixels or pattern of pixels sequence, with the RGB color value of pattern of pixels or The RGB color value sequence that person's pattern of pixels sequence is formed is predefining or characterize the information that need to be encoded;Such as, it is with a RGB color value 10 pattern of pixels is predefining or characterize a certain Real-time Collection information(Temperature, humidity, pressure, gas density, wind speed)Mould Analog quantity is 10, or a certain is adopted in real time to predefine or characterize for the pattern of pixels sequence of " 10010 " with a RGB color value sequence Collection information(Temperature, humidity, pressure, gas density, wind speed)Digital quantity;
ii)The physical quantity of temperature, humidity, pressure, gas density, wind speed is predefined or characterized with one-dimensional bar code(One The coding rule of dimension bar code is existing known technology, therefore the information that need to be encoded appearance is predefined or characterized with one-dimensional bar code Easily realize);
iii)The physical quantity of temperature, humidity, pressure, gas density, wind speed is predefined or characterized with Quick Response Code(Quick Response Code Coding rule be existing known technology, therefore predefined with Quick Response Code or characterize what the information that need to encode easily was realized);
It is described for confirming that effectively predefined enable coding is by pattern of pixels sequence to the information in each information area Constitute, realized enabling the predefined of coding with the RGB color value sequence of pattern of pixels sequence formation.Enable coding citing with Embodiment 1 is similar or identical.
Embodiment 5
When adopting i)Coding method when, the different overlapped informations that are intended to can also be one with the corresponding relation of the information area 2 Information area correspondence is less than or equal to 3 different information, and is come respectively with R, G, B colour of pattern of pixels or pattern of pixels sequence The information that predefined or sign need to be encoded.When the information that need to be superimposed is more, the quantity of the information area is reduced with this.
For example in example 4, in several informations area can with Predefined information area 2-5 as temperature, humidity, pressure The information area, information area 2-6 is the gas density information area, and information area 2-7 is wind speed information area;With R generations in the 2-5 of the information area Table temperature, and the value of temperature is characterized with colour scope 0-255 of R, humidity is represented with G, and with colour scope 0- of G 255 characterizing the value of humidity, with B representative pressures, and the value of pressure is characterized with colour scope 0-255 of B.
Embodiment 6
Described pattern of pixels also can be formed by color lump type spcial character coding, such as characters such as " ●, zero, ■, ", Can be produced in the way of captions and be superimposed, equally characterizing some information.The script of captions can define the character in captions And the position in color, the picture of character, the video file for carrying customizing messages can be synthesized in the way of pixel, such as use The Video processing software Premiere Pro of Adobe companies edit captions and synthesis.In addition captions can also be with independent captions text The form of part is preserved, such as the form subtitle file such as SubViewer (* .SUB), SubRip (* .SRT), can and main view Frequency file is synchronously played, and caption editing software can be edited with SrtEdit.Remaining is identical with other embodiments.

Claims (5)

1. on Media Stream or media file picture overlapped information encoding and decoding control method, it is characterised in that by following steps Realize:1)On Media Stream or media file picture arrange an information display area, and by information display area be divided into it is some with The different one-to-one information area of desire overlapped information and one enable code area;2)The information to be superimposed is encoded respectively, And by the information after coding according to Media Stream or on time countershaft play media file reproduction time axle be added to Media Stream or In the corresponding informance area in information display area on a certain correspondence picture of the media file that on time countershaft is played, or will coding Information afterwards is directly superimposed to be late for the corresponding informance area in the information display area on the picture of the media file of countershaft broadcasting It is interior, while being superimposed for confirming that effectively predefined enable encodes the information in each information area code area is enabled;3)Superposition letter Media Stream or media file after breath is transmitted and plays or directly play out;4)In playing process, with special Software is to each information area and enables code area real time scan, when the predefined enable coding in enable code area occurs, represents the information area Containing effective information, then the information in each information area is obtained in each information area so that the definition of identical coding is decoded Information;5)The information transmission that decoding is obtained is shown or for follow-up to PC, PC to the information that decoding is obtained The control signal of control;
The information to be superimposed is comment, or with Media Stream or on time countershaft play media file time shaft The corresponding control information of picture plot at upper a certain moment, or the information of the Real-time Collection of superposition synchronous with Media Stream;
The information to be superimposed is carried out encoding to be realized using one of following coding method:i)Information after coding is a picture Sketch map case or pattern of pixels sequence, the RGB color value sequence formed with the RGB color value or pattern of pixels sequence of pattern of pixels To predefine or characterize the information that need to be encoded;ii)The information that need to be encoded is predefined or characterized with one-dimensional bar code;iii)With two Tie up code to predefine or characterize the information that need to be encoded;
It is described for confirming that effectively predefined enable coding is by pattern of pixels Sequence composition to the information in each information area , realized enabling the predefined of coding with the RGB color value sequence of pattern of pixels sequence formation.
2. on Media Stream according to claim 1 or media file picture overlapped information encoding and decoding control method, It is characterized in that described pattern of pixels its pattern can be square, pane, circle.
3. on Media Stream according to claim 1 and 2 or media file picture overlapped information encoding and decoding controlling party Method, it is characterised in that described pattern of pixels is formed by color lump type spcial character coding, is produced in the way of captions and is superimposed.
4. on Media Stream according to claim 1 and 2 or media file picture overlapped information encoding and decoding controlling party Method, it is characterised in that when adopting i)Coding method when, the different overlapped informations that are intended to can also be with the corresponding relation of the information area One information area correspondence is less than or equal to 3 different information, and with R, G, B colour of pattern of pixels or pattern of pixels sequence point Do not come to predefine or characterize the information that need to be encoded.
5. on Media Stream according to claim 3 or media file picture overlapped information encoding and decoding control method, It is characterized in that when using i)Coding method when, the different overlapped informations that are intended to can also be one with the corresponding relation of the information area Information area correspondence is less than or equal to 3 different information, and is come respectively with R, G, B colour of pattern of pixels or pattern of pixels sequence The information that predefined or sign need to be encoded.
CN201310363978.XA 2013-08-19 2013-08-19 Encoding and decoding control method of information overlaid in media stream or media file images Active CN103428575B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310363978.XA CN103428575B (en) 2013-08-19 2013-08-19 Encoding and decoding control method of information overlaid in media stream or media file images

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310363978.XA CN103428575B (en) 2013-08-19 2013-08-19 Encoding and decoding control method of information overlaid in media stream or media file images

Publications (2)

Publication Number Publication Date
CN103428575A CN103428575A (en) 2013-12-04
CN103428575B true CN103428575B (en) 2017-04-12

Family

ID=49652632

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310363978.XA Active CN103428575B (en) 2013-08-19 2013-08-19 Encoding and decoding control method of information overlaid in media stream or media file images

Country Status (1)

Country Link
CN (1) CN103428575B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105120360A (en) * 2015-08-24 2015-12-02 天脉聚源(北京)科技有限公司 Television interactive system interactive information generation method
CN105120318A (en) * 2015-08-24 2015-12-02 天脉聚源(北京)科技有限公司 Television interactive system interactive information display position selecting method
CN105253393A (en) * 2015-10-01 2016-01-20 海南亚元防伪技术研究所 Interference method for two-dimension code of product wrapped by transparent film
WO2022037026A1 (en) * 2020-08-21 2022-02-24 Oppo广东移动通信有限公司 Information processing method, encoder, decoder, storage medium, and device
CN114027351A (en) * 2021-10-29 2022-02-11 智锐达仪器科技南通有限公司 Marking system and decoding system for livestock carcasses

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100589544C (en) * 2007-03-22 2010-02-10 中兴通讯股份有限公司 Method for obtaining barcode information for terminal video business
CN101510269B (en) * 2009-02-18 2011-02-02 华为终端有限公司 Method and device for acquiring two-dimensional code in video
CN102737318A (en) * 2011-04-07 2012-10-17 北京龙腾睿信科技有限公司 Method for superimposing two-dimensional code information on outdoors multimedia information terminal

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060013489A1 (en) * 2004-07-16 2006-01-19 Pospischil Robert R Methods of representing a color with a compressed code
JP5765558B2 (en) * 2010-08-27 2015-08-19 ソニー株式会社 Reception device, reception method, transmission device, transmission method, program, and broadcasting system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100589544C (en) * 2007-03-22 2010-02-10 中兴通讯股份有限公司 Method for obtaining barcode information for terminal video business
CN101510269B (en) * 2009-02-18 2011-02-02 华为终端有限公司 Method and device for acquiring two-dimensional code in video
CN102737318A (en) * 2011-04-07 2012-10-17 北京龙腾睿信科技有限公司 Method for superimposing two-dimensional code information on outdoors multimedia information terminal

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
具有高压缩比汉字编码能力的彩色二维条码的设计与实现;袁远松;《中国优秀硕士学术论文电子期刊网》;20090615;摘要、第1.2,1.5,3.1节 *

Also Published As

Publication number Publication date
CN103428575A (en) 2013-12-04

Similar Documents

Publication Publication Date Title
CN103428575B (en) Encoding and decoding control method of information overlaid in media stream or media file images
CN101682793B (en) Creating three dimensional graphics data
CN100531291C (en) Method and system for mastering and distributing enhanced color space content
US10334285B2 (en) Apparatus, system and method
JP2022051787A (en) Signal processing device and method
US8019183B2 (en) Production apparatus for index information with link information, production apparatus for image data with tag information, production method for index information with link information, production method for image data with tag information and recording medium
US20070009099A1 (en) Tag information display control apparatus, information processing apparatus, display apparatus, tag information display control method and recording medium
CN1218574C (en) Interactive video equipment and its caption superposition method
CN101431690B (en) Image processing apparatus, image processing method
KR101658239B1 (en) Method and apparatus for generating of animation message
US20080101456A1 (en) Method for insertion and overlay of media content upon an underlying visual media
CN111899322B (en) Video processing method, animation rendering SDK, equipment and computer storage medium
JP2006515965A (en) Method and apparatus for encoding / decoding items of subtitling data
CN104813666A (en) Decoding device and decoding method, and coding device and coding method
TW411715B (en) Pixel colour value encoding and decoding
CN111899155A (en) Video processing method, video processing device, computer equipment and storage medium
KR20200017534A (en) Method and apparatus for transmitting and receiving media data
US10290110B2 (en) Video overlay modification for enhanced readability
CN106664442A (en) Transmitting apparatus, transmitting method, receiving apparatus, and receiving method
CN107767437B (en) Multilayer mixed asynchronous rendering method
US8055076B2 (en) Tag information production apparatus, tag information production method and recording medium
CN101730278A (en) Method for processing printing multimedia system consisting of mobile phone
CN111095918B (en) Reproduction device, reproduction method, program, and recording medium
CN105376593B (en) A kind of information processing method, terminal and system
Jamil et al. Overview of JPEG Snack: A Novel International Standard for the Snack Culture

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant