CN106507172A - Information coding method, coding/decoding method and device - Google Patents
Information coding method, coding/decoding method and device Download PDFInfo
- Publication number
- CN106507172A CN106507172A CN201611089313.4A CN201611089313A CN106507172A CN 106507172 A CN106507172 A CN 106507172A CN 201611089313 A CN201611089313 A CN 201611089313A CN 106507172 A CN106507172 A CN 106507172A
- Authority
- CN
- China
- Prior art keywords
- information
- environmental
- multimedia messages
- unit
- environmental data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 230000007613 environmental effect Effects 0.000 claims abstract description 246
- 230000001360 synchronised effect Effects 0.000 claims abstract description 40
- 241001269238 Data Species 0.000 claims abstract description 14
- 230000002123 temporal effect Effects 0.000 claims description 33
- 230000009467 reduction Effects 0.000 claims description 31
- 238000013481 data capture Methods 0.000 claims description 11
- 238000013461 design Methods 0.000 abstract description 2
- 230000010365 information processing Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 14
- 230000015654 memory Effects 0.000 description 13
- 238000004891 communication Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 238000004378 air conditioning Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 230000005611 electricity Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000004549 pulsed laser deposition Methods 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The present invention provides a kind of information coding method, coding/decoding method and device, is related to technical field of information processing.Information coding method includes：Obtain multimedia messages and the environmental information including multiple environmental datas；And the multimedia messages and environmental information are encoded, make the multimedia messages of per unit obtain corresponding environmental data.By above-mentioned design, environmental information synchronously can be added in multimedia messages, realize that environmental information and the synchronous decoding of multimedia messages are played.
Description
Technical field
The present invention relates to technical field of information processing, in particular to a kind of information coding method, coding/decoding method and dress
Put.
Background technology
In prior art, in order to scene reproduction is better achieved, it will usually add environment on the basis of multimedia messages
Information, so that user experiences scene more true to nature.But after adding environmental information, how to realize that environmental information is believed with multimedia
The synchronization of breath is still a big problem, in use, if environmental information can not be with multimedia messages reproduced in synchronization, it will make user's body
Test and have a greatly reduced quality, it is impossible to meet the demand of user.
Content of the invention
In view of this, it is an object of the invention to provide a kind of information coding method, coding/decoding method and device, with solution
State problem.
To achieve these goals, present pre-ferred embodiments are adopted the following technical scheme that：
A kind of information coding method, methods described include：Obtain multimedia messages and the environment including multiple environmental datas
Information；And
The multimedia messages and environmental information are encoded, makes the multimedia messages of per unit obtain corresponding ring
Border data.
Present pre-ferred embodiments also provide a kind of information decoding method, and methods described includes：
The multimedia code stream and environment code stream in the information coding method that the present invention is provided is obtained, and to the multimedia bitstream
Stream is decoded broadcasting；And
The temporal information of currently playing unit multimedia messages is obtained, is found out from the environmental information and is currently broadcast
The environmental data is sent to environmental information reduction and is set by time corresponding environmental data residing for the unit multimedia messages that puts
Standby, control the environmental information reduction apparatus and execute operation corresponding with the environmental data.
Present pre-ferred embodiments also provide a kind of information coding device, and described information code device includes：
Data obtaining module, the environmental information for obtaining multimedia messages and including multiple environmental datas；And
Synchronous coding module, for encoding, makes many matchmakers of per unit to the multimedia messages and environmental information
The corresponding environmental data of body information acquisition.
Present pre-ferred embodiments also provide a kind of information decoding device, and described information decoding apparatus include：
Code stream acquisition module, for obtaining multimedia code stream and environment code in the information coding device that the present invention is provided
Stream, and broadcasting is decoded to the multimedia code stream；And
Synchronous decoding module, for obtaining the temporal information of currently playing unit multimedia messages, believes from the environment
Environmental data corresponding with the time residing for currently playing unit multimedia messages is found out in breath, and the environmental data is sent
To environmental information reduction apparatus, control the environmental information reduction apparatus and execute operation corresponding with the environmental data.
Information coding method provided in an embodiment of the present invention, coding/decoding method and device, can pass through synchronous coding and decoding,
Realize the reproduced in synchronization of environmental information and multimedia messages, it is possible to increase Consumer's Experience, preferably meet the demand of user.
Description of the drawings
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, below by to be used attached needed for embodiment
Figure is briefly described, it will be appreciated that the following drawings illustrate only certain embodiments of the present invention, and it is right to be therefore not construed as
The restriction of scope, for those of ordinary skill in the art, on the premise of not paying creative work, can be with according to this
A little accompanying drawings obtain other related accompanying drawings.
Fig. 1 is the connection block diagram of scenario reduction system provided in an embodiment of the present invention.
Fig. 2 is the block diagram of electronic equipment provided in an embodiment of the present invention.
Fig. 3 is a kind of functional block diagram of information coding device provided in an embodiment of the present invention.
Fig. 4 is the connection block diagram of the multimedia coding submodule shown in Fig. 3.
Fig. 5 is the synchronous coding schematic diagram of video information and audio-frequency information.
Fig. 6 is the connection block diagram of the environmental data synchronous coding submodule shown in Fig. 3.
Fig. 7 is the synchronous coding schematic diagram of video information and environmental information.
Fig. 8 is a kind of functional block diagram of information decoding device provided in an embodiment of the present invention.
Fig. 9 is a kind of schematic flow sheet of information coding method provided in an embodiment of the present invention.
Figure 10 is the sub-step schematic diagram of step S102 shown in Fig. 9.
The sub-step schematic diagram of the step of Figure 11 is shown in Figure 10 S201.
The sub-step schematic diagram of the step of Figure 12 is shown in Figure 10 S202.
Figure 13 is a kind of schematic flow sheet of information decoding method provided in an embodiment of the present invention.
Icon：10- scenario reduction systems；100- electronic equipments；110- memories；120- processors；130- communication units；
140- audio units；150- display units；200- information collecting devices；300- environmental information reduction apparatus；400- networks；500-
Information coding device；501- data obtaining modules；502- synchronous coding modules；510- multimedia coding submodules；The 511- times
Information acquisition unit；512- synchronous coding units；520- environmental data synchronous coding submodules；The detection of 521- environmental informations is single
Unit；522- first environment data capture units；5221- environmental datas search subelement；5222- environmental data computation subunits；
523- second environment data capture units；600- information decoding devices；601- code stream acquisition modules；602- synchronous decoding modules.
Specific embodiment
Purpose, technical scheme and advantage for making the embodiment of the present invention is clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, to the embodiment of the present invention in technical scheme be clearly and completely described, it is clear that described embodiment is
The a part of embodiment of the present invention, rather than whole embodiments.Present invention enforcement generally described and illustrated in accompanying drawing herein
The component of example can be arranged and be designed with a variety of configurations.
Therefore, below the detailed description of the embodiments of the invention for providing in the accompanying drawings is not intended to limit claimed
The scope of the present invention, but be merely representative of the present invention selected embodiment.Embodiment in based on the present invention, this area are common
The every other embodiment obtained under the premise of creative work is not made by technical staff, belongs to the model of present invention protection
Enclose.
It should be noted that：Similar label and letter represent similar terms in following accompanying drawing, therefore, once a certain Xiang Yi
It is defined in individual accompanying drawing, then in subsequent accompanying drawing which further need not be defined and be explained.
Information coding method provided in an embodiment of the present invention, coding/decoding method and device go for needing multimedia messages
The scene of broadcasting synchronous with environmental information, for example：Three-dimensional movie is played, and for example：Truly reduce a certain scene (e.g., to monitor
Scene etc.).
As shown in figure 1, being the connection block diagram of the scenario reduction system 10 that present pre-ferred embodiments are provided.The scene is also
Original system 10 includes electronic equipment 100, at least one information collecting device 200 and environmental information reduction apparatus 300.The electricity
Sub- equipment 100, information collecting device 200 and environmental information reduction apparatus 300 are communicated to connect by network 400, to realize number
According to interaction or communication.
Described information collecting device 200 is used for gathering multimedia messages and environmental information, and wherein described multimedia messages can
Think that audio-frequency information and/or video information, the environmental information can include temperature information, humidity information, wind-force information and wind
To at least one in information.Alternatively, in the present embodiment, described information collecting device 200 can include microphone, camera
And at least one in temperature sensor, humidity sensor, wind sensor, wind transducer.
According to the actual requirements, described information collecting device 200 can be connected to Internet of Things sensing cloud by network 400 and put down
Platform, by Internet of Things sensing cloud platform described in data Cun Chudao for collecting.Described information collecting device 200 can also directly with
Storage device (e.g., USB flash disk or hard disk) is electrically connected with, by the information Store for collecting to the storage device.
The environmental information reduction apparatus 300 can include air-conditioning, humidistat and fan etc., for collecting
Environmental information reduction.
The electronic equipment 100 can be arbitrary equipment with audio and video playing function and data processing function (e.g.,
Computer, server etc.), the present embodiment is without limitation.
The network 400 may be, but not limited to, cable network or wireless network.
As shown in Fig. 2 being the block diagram of a kind of electronic equipment 100 that present pre-ferred embodiments are provided.
The electronic equipment 100 can include information coding device 500, information decoding device 600, memory 110, process
Device 120, communication unit 130, audio unit 140 and display unit 150.
The memory 110, processor 120, communication unit 130,150 each element phase of audio unit 140 and display unit
Directly or indirectly it is electrically connected between mutually, to realize the transmission or interaction of data.For example, these elements can pass through each other
One or more communication bus or holding wire are realized being electrically connected with.Described information code device 500 is wrapped with information decoding device 600
Include at least one to be stored in the memory 110 in the form of software or firmware (firmware) or be solidificated in the electronics
Software function module in the operating system (operating system, OS) of equipment 100.The processor 120 is used for executing
The executable module stored in the memory 110, such as described information code device 500 are wrapped with information decoding device 600
The software function module for including and computer program etc..
Wherein, the memory 110 may be, but not limited to, random access memory (Random Access
Memory, RAM), read-only storage (Read Only Memory, ROM), programmable read only memory (Programmable
Read-Only Memory, PROM), erasable read-only memory (Erasable Programmable Read-Only
Memory, EPROM), electricallyerasable ROM (EEROM) (Electric Erasable Programmable Read-Only
Memory, EEPROM) etc..
The processor 120 can be a kind of IC chip, the disposal ability with signal.Above-mentioned processor can
To be general processor, including central processing unit (Central Processing Unit, CPU), network processing unit (Network
Processor, NP) etc.；Can also be digital signal processor (DSP)), special IC (ASIC), field programmable gate
Array (FPGA) or other PLDs, discrete gate or transistor logic, discrete hardware components.Can be real
Disclosed each method, step and logic diagram now or in the execution embodiment of the present invention.General processor can be microprocessor
Device or the processor can also be any conventional processors etc..
In the present embodiment, the memory 110 be used for storage program, the processor 120 after execute instruction is received,
Execute described program.The communication unit 130 be used for by network 400 set up electronic equipment 100, information collecting device 200 and
Communication connection between environmental information reduction apparatus 300, and for by 400 transceiving data of the network.
The audio unit 140 provides a user with COBBAIF, its can include one or more microphones, one or
Multiple loudspeakers and voicefrequency circuit.
The display unit 150 is used for showing the video information, or carries between the electronic equipment 100 and user
For an interactive interface (such as user interface).In the present embodiment, the display unit 150 can be liquid crystal display
Or touch control display.
As shown in figure 3, be present pre-ferred embodiments provide a kind of information coding device 500, described information coding dress
Putting 500 includes data obtaining module 501 and synchronous coding module 502.
Wherein, described information acquisition module 501 is used for obtaining multimedia messages and environmental information.
In the present embodiment, the multimedia messages can include audio-frequency information and/or video information, and the audio-frequency information can
To be acquired by microphone or other audio collecting devices, the video information can be acquired by camera.
The environmental information can include at least one in temperature information, humidity information, wind-force information and wind direction information.
The multimedia messages can be stored in storage device (such as USB flash disk, hard disk) with environmental information, it is also possible to be stored in
Internet of Things senses cloud platform.During enforcement, the electronic equipment 100 is according to the multimedia messages and the actual storage of environmental information
Position, obtains the multimedia messages and environmental information.
The environmental information includes multiple discrete environmental datas.For example, when the environmental information is temperature information, described
Temperature information includes multiple temperature datas.When the environmental information is humidity information, the humidity information includes multiple humidity
Data.
The synchronous coding module 502 is used for synchronously encoding the multimedia messages and environmental information, makes every
The multimedia messages of one unit obtain corresponding environmental data.
In the present embodiment, after the multimedia messages and environmental information is obtained, need to the multimedia messages and ring
Environment information is encoded, so that the multimedia messages of per unit have at least one environmental data corresponding therewith.
It should be noted that when a certain unit multimedia messages and an environmental data to corresponding when it is meant that the list
The multimedia messages of position are identical with the time residing for the environmental data.Wherein, the multimedia messages of per unit can continue a timing
Between, multiple environmental datas may be collected within the time, therefore, the multimedia messages of per unit can be with one, two
Or multiple environmental datas are corresponding.According to the actual requirements, the present embodiment is with the multimedia messages of per unit and an environment number
According to illustrating as a example by corresponding.
Alternatively, the synchronous coding module 502 can include the volume synchronous with environmental data of multimedia coding submodule 510
Numeral module 520.
The multimedia coding submodule 510 is used for encoding the multimedia messages, obtains multimedia code stream.
In the present embodiment, when the multimedia messages only include audio-frequency information or video information, can directly to institute
State multimedia messages to be encoded, to realize data compression.When the multimedia messages include that audio-frequency information and video are believed simultaneously
During breath, need to encode residing time identical unit video information and unit audio-frequency information simultaneously.
Fig. 4 is referred to, when the multimedia messages include audio-frequency information and video information simultaneously, the multimedia coding
Submodule 510 can include temporal information acquiring unit 511 and synchronous coding unit 512.
Wherein, the temporal information acquiring unit 511 be used for synchronously to residing time identical unit video information and
Unit audio-frequency information is encoded.
It should be noted that the unit video information can be a frame video, two frame videos or multi-frame video, described
Audio-frequency information can also be a frame audio frequency, two frame audio frequency or multiframe audio frequency.Below will be with a frame video and a frame audio frequency as list
Position citing is illustrated.
In the present embodiment, in each frame video and each frame audio frequency, temporal information is marked with all, the temporal information is used for
Characterize the actual acquisition time of the frame video and audio frequency.Alternatively, the mark mode of the temporal information can be：Collecting
The first frame video in mark the first system timestamp, after the first frame video gather each frame video in mark this to regard
Frequency frame is stabbed with the relative time of the first system timestamp.The second system time is marked with the first frame audio frequency for collecting
Stamp, is marked with the audio frequency in each frame audio frequency for gathering relative with the second system timestamp after the first frame audio frequency
Timestamp.
The synchronous coding unit 512 is used for synchronously believing residing time identical unit video information and unit audio frequency
Breath is encoded.
Illustrated in units of a frame video and a frame audio frequency, in the present embodiment, the electronic equipment 100 can be according to each
Timestamp in frame video and each frame audio frequency is encoded.Refer to Fig. 5, straight line L1 represents video information, L1 include A0,
Multiple frame of video such as A1, A2, A3 and A4, straight line L2 represent that audio-frequency information, L2 include multiple audio frames such as B0, B1 and B2.
Wherein, A0 is the first frame of video for being marked with the first system timestamp, and B0 is to be marked with second system timestamp
First audio frame.When system timing starts and reaches A0, the electronic equipment 100 starts to video information coding, when being
When reaching B0 during statistics, electronic equipment 100 starts to coded audio information.Also, when encoding to each frame video, electricity
Sub- equipment 100 checks whether there is the audio frame for reaching corresponding relative time stamp in the audio-frequency information, does not carry out appointing if not
What operates, and the audio frame is encoded if having.For example, when electronic equipment 100 is encoded to A2 frame of video, Ke Yijian
The relative time stamp that the B1 audio frames in audio-frequency information have arrived at mark is measured, is shown residing for A2 frame of video and B1 audio frames
Time is identical, should be to both synchronous codings.
Referring again to Fig. 3, the environmental data synchronous coding submodule 520 be used for obtain from the environmental information with per
The corresponding environmental data of time residing for the multimedia messages of one unit, obtains the multiple of multimedia messages corresponding to multiple units
The plurality of environmental data for obtaining is encoded into the environment code synchronous in time with the multimedia code stream by environmental data
Stream.
" synchronous in time " described herein refers to, in residing time identical unit multimedia messages and environmental data
The time characterized by temporal information is identical.
In the present embodiment, include temporal information in the multimedia messages of per unit and each environmental data, each ring
Temporal information in the data of border is used for the actual acquisition time for characterizing the environmental data.Alternatively, mark in the environmental information
The mode of temporal information can be identical with the multimedia messages.That is, being marked with first environmental data for collecting
One system timestamp (or second system timestamp), marks in each environmental data for collecting after first environmental data
There are the environmental data and the relative time of the first system timestamp (or second system timestamp) to stab.
It should be noted that when only audio-frequency information is included in the multimedia messages, can be by the audio frequency of per unit
Information is corresponding with environmental data.When video information is included in the multimedia messages, can be by the video information of per unit
Corresponding with environmental data.When video information and audio-frequency information is included in the multimedia messages simultaneously, can be by each list
The audio-frequency information of video information and the per unit of position is corresponded, then by the video information of per unit and environmental data pair
Should.
Refer to Fig. 6, the environmental data synchronous coding submodule 520 can include environmental information detector unit 521, the
One environmental data acquiring unit 522 and second environment data capture unit 523.
Wherein, the environmental information detector unit 521 is used for the multimedia messages for per unit, detects the environment
Whether there is environmental data corresponding with the time residing for the multimedia messages of the unit in information.
" environmental data corresponding with the time residing for the multimedia messages of the unit " described herein refers to, many with the unit
The residing time identical environmental data of media information, that is, the environmental data of time residing for the multimedia messages of the unit.
First environment data capture unit 522 is used for the multimedia messages for not having with the unit in the environmental information
During residing time corresponding environmental data, the relative time relationship according to the environmental information and the multimedia messages calculate with
The corresponding environmental data of time residing for the multimedia messages of the unit, using the time residing for the multimedia messages of the unit as calculating
The temporal information of the environmental data for obtaining, obtains the environmental data.
In the present embodiment, for the multimedia messages of per unit, the electronic equipment 100 obtains the multimedia of the unit
Relative time stamp in information, while the ring stabbed with the presence or absence of the relative time for having arrived at mark in the detection environmental information
Border data, if having, show that the environmental data is identical with the time residing for the multimedia messages of the unit, can be to the environment number
According to being encoded.If no, need to calculate the environmental data of time residing for the multimedia messages of the unit, then to calculating
Environmental data is encoded.
Include only including video information with the multimedia messages, or include that video information and audio-frequency information are simultaneously
Example, as shown in fig. 7, straight line L1 represents video information, the video information includes the continuous videos of many of A0, A1, A2, A3 and A4
Frame, straight line L3 represent that environmental information, the environmental information include many discrete environmental datas of C0, C1, C2 and C3.
Wherein, A0 is the first frame of video, is wherein marked with the first system timestamp.C0 is first environmental data, wherein
It is marked with and identical system timestamp in the first frame of video, i.e. the first system timestamp.When implementing, when system starts timing
And when reaching the time represented by the first system timestamp, start simultaneously at and the video information and environmental information are compiled
Code.
In an encoding process, for each frame video, such as A2 frame of video, in the detection environmental information of electronic equipment 100 whether
There is the environmental data of the relative time stamp for having arrived at mark, if existing, show residing for the environmental data and A2 frame of video
Time is identical, while to A2 coding video frames, the environmental data is encoded.If not existing, need to calculate A2 videos
The environmental data of time residing for frame, its concrete calculating process can be realized by the first environment data capture unit 522.
When the multimedia messages only include audio-frequency information, can be with audio-frequency information as reference, by the ring
Environment information synchronizes coding with the audio-frequency information, and its specific implementation is same with environmental information to video information with above-mentioned
Step process is identical, and here is omitted.
Alternatively, the first environment data capture unit 522 can include environmental data search subelement 5221 and
Environmental data computation subunit 5222.
The environmental data searches subelement 5221 to be used for finding out the multimedia with the unit in the environmental information
The immediate predetermined number environmental data of time residing for information.
The environmental data computation subunit 5222 is used for the mean value for calculating the predetermined number environmental data, as
Environmental data in time residing for the multimedia messages of the unit.
Referring again to Fig. 7, when encoding to A2 frame of video, the environment number for calculating the time residing for A2 frame of video is needed
According to.The predetermined number can be one, during enforcement, can be by environmental data C1 or environmental data C2 directly as A2 frame of video
The environmental data of residing time.The predetermined number can also be two or more, as a example by two, during enforcement, regard with A2
The immediate environmental data of time residing for frequency frame is C1 and C2, then can obtain the average of environmental data C1 and environmental data C2
Value, and the environmental data using the time residing for the mean value as A2 frame of video.
After the environmental data of time residing for A2 frame of video is calculated, can be converted into the time residing for A2 frame of video relative
Stab in the relative time of the first system timestamp, be tagged in the environmental data of time residing for A2 frame of video.
Second environment data capture unit 523 is used for the multimedia messages institute for having with the unit in the environmental information
During place's time identical environmental data, the environmental data is obtained.
After coding obtains multimedia code stream and environment code stream, the multimedia code stream and environment code stream can be packaged into
One multimedia file, and the multimedia file is stored in cloud platform or storage device.
Present pre-ferred embodiments also provide a kind of information decoding device 600, for the information coding provided by the present invention
The multimedia code stream and environment code stream that the coding of device 500 is formed is decoded broadcasting.
As shown in figure 8, described information decoding apparatus 600 include code stream acquisition module 601 and synchronous decoding module 602.
Wherein, the code stream acquisition module 601 is used for obtaining the multimedia bitstream that the coding of described information code device 500 is formed
Stream and environment code stream, and broadcasting is decoded to the multimedia code stream.
In the present embodiment, after the electronic equipment 100 obtains the multimedia code stream of encoded formation and environment code stream, directly
Broadcasting is decoded to the multimedia code stream.When the multimedia code stream includes video code flow and audio code stream, it is right to need
Residing time identical unit video information and unit audio-frequency information in the video code flow and audio code stream is solved simultaneously
Code is played.
The synchronous decoding module 602 is used for obtaining the temporal information of currently playing unit multimedia messages, from described
Environmental data corresponding with the time residing for currently playing unit multimedia messages is found out in environmental information, by the environment number
According to environmental information reduction apparatus 300 is sent to, the execution of environmental information reduction apparatus 300 is controlled corresponding with the environmental data
Operation.
In the present embodiment, need to be decoded environmental information with reference to the temporal information in currently playing multimedia messages
Reduction.The temporal information is assumed for timestamp, when implementing, electronic equipment 100 obtains currently playing unit multimedia letter
Timestamp in breath, finds out the environmental data of arrival time stamp in the environmental information, then the environment number of the arrival time stamp
According to identical with the time residing for currently playing unit multimedia messages, the environmental data is sent to environmental information reduction apparatus
300 are reduced.
Alternatively, the environmental information reduction apparatus 300 can include at least in air-conditioning, humidistat and fan
Kind.Wherein, when the environmental information includes temperature information, the environmental information reduction apparatus 300 at least includes air-conditioning,
That is, described air-conditioning is used for reducing the temperature information.When the environmental information includes humidity information, the environmental information reduction
Equipment 300 at least includes humidistat, that is, the humidistat is used for reducing the humidity information.When the environment
When information includes wind direction information and wind-force information, the environmental information reduction apparatus 300 at least includes fan, that is, the wind
Fan for reducing the wind direction information and wind-force information.
As shown in figure 9, present pre-ferred embodiments also provide a kind of information coding method, methods described is applied to the electricity
Sub- equipment 100.Defined in the relevant flow process of methods described, method and step can be by the processor in the electronic equipment 100
120 realizing.Idiographic flow shown in Fig. 9 will be explained in detail below.
Step S101：Obtain multimedia messages and the environmental information including multiple environmental datas.
In the present embodiment, step S101 can by Fig. 3 in data obtaining module 501 execute.
Step S102：The multimedia messages and environmental information are encoded, obtains the multimedia messages of per unit
Obtain corresponding environmental data.
In the present embodiment, step S102 can by Fig. 3 in synchronous coding module 502 execute.
Alternatively, as shown in Figure 10, step S102 can include two sub-steps of step S201 and step S202.
Step S201：The multimedia messages are encoded, multimedia code stream is obtained.
In the present embodiment, step S201 can by Fig. 3 in multimedia coding submodule 510 execute.
Step S202：Time identical environment residing for the multimedia messages with per unit is obtained from the environmental information
Data, obtain multiple environmental datas of the multimedia messages corresponding to multiple units, and the plurality of environmental data for obtaining is compiled
Code is into the environment code stream synchronous in time with the multimedia code stream.
Wherein, the multimedia messages of per unit include temporal information, and each environmental data includes temporal information.This
In embodiment, step S202 can by Fig. 3 in environmental data synchronous coding submodule 520 execute.
Alternatively, the environmental information can include video information and/or audio-frequency information, as shown in figure 11, when described many
When media information includes video information and audio-frequency information simultaneously, step S201 can include step S301 and step S302 two
Sub-steps.
Step S301：Obtain the video information and the temporal information in audio-frequency information.
In the present embodiment, step S301 can by Fig. 4 in temporal information acquiring unit 511 execute.
Step S302：Residing time identical unit video information and unit audio-frequency information are encoded simultaneously, is obtained
The video code flow and audio code stream of synchronization in time.
In the present embodiment, step S302 can by Fig. 4 in synchronous coding unit 512 execute.
Alternatively, as shown in figure 12, step S202 can include step S401, step S402 and step S403 tri-
Secondary sub-step.
Step S401：For the multimedia messages of per unit, detect in the environmental information and whether there is and the unit
Multimedia messages residing for time corresponding environmental data.If not existing, execution step S402.If existing, execution step
S403.
Step S402：Calculated and the unit according to relative time relationship of the environmental information with the multimedia messages
The corresponding environmental data of time residing for multimedia messages, using the time residing for the multimedia messages of the unit as calculated ring
The temporal information of border data, obtaining includes the environmental data of the temporal information.
Step S403：Obtain the environmental data.
In the present embodiment, step S401 can by Fig. 6 in environmental information detector unit 521 execute, step S402 can be with
First environment data capture unit 522 in by Fig. 6 is executed, step S403 can by Fig. 6 in second environment data acquisition list
Unit 523 executes.
Wherein, in step S402, the relative time relationship according to the environmental information and the multimedia messages calculate with
The mode of the corresponding environmental data of time residing for the multimedia messages of the unit can be as follows：
First, time immediate present count residing for the multimedia messages with the unit is found out in the environmental information
Amount environmental data.
In the present embodiment, this step can be searched subelement 5221 by the environmental data shown in Fig. 6 and be executed.
Secondly, the mean value of the predetermined number environmental data is calculated, as residing for the multimedia messages with the unit
Time corresponding environmental data.
In the present embodiment, this step can be executed by the environmental data computation subunit 5222 shown in Fig. 6.
As shown in figure 13, present pre-ferred embodiments also provide a kind of information decoding method, for being carried by the present invention
For information coding method encode the multimedia code stream to be formed and environment code stream is decoded broadcasting.The relevant flow process of methods described
Defined method and step can be realized by the processor 120 in the electronic equipment 100.Below by the tool shown in Figure 13
Body flow process is explained in detail.
Step S203：Multimedia code stream and environment code stream is obtained, and broadcasting is decoded to the multimedia code stream.
Wherein, the multimedia code stream and environment code stream information coding method provided by the present invention encode to be formed.This reality
Apply in example, step S203 can be executed by the code stream acquisition module 601 shown in Fig. 8.
Step S204：The temporal information of currently playing unit multimedia messages is obtained, is searched from the environmental information
Go out environmental data corresponding with the time residing for currently playing unit multimedia messages, the environmental data is sent to environment letter
Breath reduction apparatus 300, controls the environmental information reduction apparatus 300 and executes operation corresponding with the environmental data.
Wherein, the environmental information reduction apparatus 300 includes at least one in air-conditioning, humidistat and fan.This
In embodiment, step S204 can be executed by the synchronous decoding module 602 shown in Fig. 8.
In sum, information coding method provided in an embodiment of the present invention, coding/decoding method and device, by collecting
Environmental information synchronizes coding with multimedia messages and decodes, and environmental information is synchronously added in multimedia messages, from
And realize that environmental information and the synchronous decoding of multimedia messages are played.Above-mentioned design causes the scene of final reduction more life-like,
The demand of user can preferably be met.
The preferred embodiments of the present invention are the foregoing is only, the present invention is not limited to, for the skill of this area
For art personnel, the present invention can have various modifications and variations.All within the spirit and principles in the present invention, made any repair
Change, equivalent, improvement etc., should be included within the scope of the present invention.
Claims (16)
1. a kind of information coding method, it is characterised in that methods described includes：
Obtain multimedia messages and the environmental information including multiple environmental datas；And
The multimedia messages and environmental information are encoded, makes the multimedia messages of per unit obtain corresponding environment number
According to.
2. information coding method according to claim 1, it is characterised in that the multimedia messages and environmental information are entered
Row coding, make per unit multimedia messages obtain corresponding environmental data the step of, including：
The multimedia messages are encoded, multimedia code stream is obtained；And
For the multimedia messages of per unit, the time residing for the multimedia messages with the unit is obtained from the environmental information
Corresponding environmental data, obtains multiple environmental datas of the multimedia messages corresponding to multiple units, the plurality of by obtained
Environmental data is encoded into the environment code stream synchronous in time with the multimedia code stream；
Include temporal information in the multimedia messages of the per unit and each environmental data.
3. information coding method according to claim 2, it is characterised in that for the multimedia messages of per unit, from
The step of environmental data corresponding with the time residing for the multimedia messages of the unit is obtained in the environmental information, including：
For the multimedia messages of per unit, detect in the environmental information with the presence or absence of the multimedia messages institute with the unit
Place's time corresponding environmental data；And
When there is no the corresponding environmental data of time residing for the multimedia messages with the unit in the environmental information, according to institute
State environmental information corresponding with the time residing for the multimedia messages of the unit with the calculating of the relative time relationship of the multimedia messages
Environmental data, temporal information of the time as calculated environmental data residing for the multimedia messages of the unit is obtained
Environmental data including the temporal information；
When there is environmental data corresponding with the time residing for the multimedia messages of the unit in the environmental information, the ring is obtained
Border data.
4. information coding method according to claim 3, it is characterised in that according to the environmental information and the multimedia
The step of relative time relationship of information calculates environmental data corresponding with the time residing for the multimedia messages of the unit, including：
The immediate predetermined number environment of time residing for the multimedia messages with the unit is found out in the environmental information
Data；And
The mean value of the predetermined number environmental data is calculated, corresponding as the time residing for the multimedia messages with the unit
Environmental data.
5. information coding method according to claim 2, it is characterised in that the multimedia messages include video information
And/or audio-frequency information, the environmental information includes at least in temperature information, humidity information, wind-force information and wind direction information
Kind.
6. information coding method according to claim 5, it is characterised in that when the multimedia messages include video information
During with audio-frequency information, the step of coding to the multimedia messages, including：
Obtain the video information and the temporal information in audio-frequency information；And
Residing time identical unit video information and unit audio-frequency information are encoded simultaneously, synchronization in time is obtained
Video code flow and audio code stream.
7. a kind of information decoding method, it is characterised in that methods described includes：
The multimedia code stream and environment code stream described in claim 2～6 any one is obtained, and the multimedia code stream is carried out
Decoding is played；And
Obtain the temporal information of currently playing unit multimedia messages, find out from the environmental information with currently playing
The environmental data is sent to environmental information reduction apparatus by the corresponding environmental data of time residing for unit multimedia messages, control
Make the environmental information reduction apparatus and execute operation corresponding with the environmental data.
8. information decoding method according to claim 7, it is characterised in that the environmental information reduction apparatus includes sky
At least one in tune, humidistat and fan.
9. a kind of information coding device, it is characterised in that described information code device includes：
Data obtaining module, the environmental information for obtaining multimedia messages and including multiple environmental datas；And
Synchronous coding module, for encoding to the multimedia messages and environmental information, believes the multimedia of per unit
Breath obtains corresponding environmental data.
10. information coding device according to claim 9, it is characterised in that the synchronous coding module includes：
Multimedia coding submodule, for encoding to the multimedia messages, obtains multimedia code stream；And
Environmental data synchronous coding submodule, for the multimedia messages for per unit, obtains from the environmental information
Environmental data corresponding with the time residing for the multimedia messages of the unit, obtains many of multimedia messages corresponding to multiple units
The plurality of environmental data for obtaining is encoded into the environment code synchronous in time with the multimedia code stream by individual environmental data
Stream；
Include temporal information in the multimedia messages of the per unit and each environmental data.
11. information coding devices according to claim 10, it is characterised in that the environmental data synchronous coding submodule
Including：
Environmental information detector unit, for the multimedia messages for per unit, detects and whether there is in the environmental information
Environmental data corresponding with the time residing for the multimedia messages of the unit；And
First environment data capture unit, during for not existing residing for the multimedia messages with the unit in the environmental information
Between corresponding environmental data when, the relative time relationship according to the environmental information and the multimedia messages is calculated and the unit
Multimedia messages residing for time corresponding environmental data, using the time residing for the multimedia messages of the unit as calculated
The temporal information of environmental data, obtaining includes the environmental data of the temporal information；
, for there is the time residing for the multimedia messages with the unit in the environmental information in second environment data capture unit
During corresponding environmental data, the environmental data is obtained.
12. information coding devices according to claim 11, it is characterised in that the first environment data capture unit bag
Include：
Environmental data searches subelement, for finding out the time residing for the multimedia messages with the unit in the environmental information
Immediate predetermined number environmental data；And
Environmental data computation subunit, for calculating the mean value of the predetermined number environmental data, as with the unit
The corresponding environmental data of time residing for multimedia messages.
13. information coding devices according to claim 10, it is characterised in that the multimedia messages include video information
And/or audio-frequency information, the environmental information includes at least in temperature information, humidity information, wind-force information and wind direction information
Kind.
14. information coding devices according to claim 13, it is characterised in that when the multimedia messages include that video is believed
When breath and audio-frequency information, the multimedia coding submodule includes：
Temporal information acquiring unit, for obtaining the video information and the temporal information in audio-frequency information；And
Synchronous coding unit, for encoding to residing time identical unit video information and unit audio-frequency information simultaneously,
Obtain video code flow synchronous in time and audio code stream.
15. a kind of information decoding devices, it is characterised in that described information decoding apparatus include：
Code stream acquisition module, for obtaining multimedia code stream and environment code stream described in claim 10～14 any one, and
Broadcasting is decoded to the multimedia code stream；And
Synchronous decoding module, for obtaining the temporal information of currently playing unit multimedia messages, from the environmental information
Environmental data corresponding with the time residing for currently playing unit multimedia messages is found out, the environmental data is sent to ring
Environment information reduction apparatus, controls the environmental information reduction apparatus and executes operation corresponding with the environmental data.
16. information decoding devices according to claim 15, it is characterised in that the environmental information reduction apparatus includes sky
At least one in tune, humidistat and fan.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611089313.4A CN106507172B (en) | 2016-11-30 | 2016-11-30 | Information coding method, coding/decoding method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611089313.4A CN106507172B (en) | 2016-11-30 | 2016-11-30 | Information coding method, coding/decoding method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106507172A true CN106507172A (en) | 2017-03-15 |
| CN106507172B CN106507172B (en) | 2019-10-18 |
Family
ID=58329389
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611089313.4A Active CN106507172B (en) | 2016-11-30 | 2016-11-30 | Information coding method, coding/decoding method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106507172B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110166796A (en) * | 2018-05-16 | 2019-08-23 | 腾讯科技（深圳）有限公司 | Processing method, device, computer-readable medium and the electronic equipment of video frame |
| CN113206912A (en) * | 2021-04-26 | 2021-08-03 | 瑞声光电科技(常州)有限公司 | Information processing method, information processing device, electronic equipment and storage medium |
| CN113766279A (en) * | 2021-08-24 | 2021-12-07 | 沈阳风驰软件股份有限公司 | Information processing method, server and mobile terminal |
| CN114205649A (en) * | 2021-12-08 | 2022-03-18 | 无锡英菲感知技术有限公司 | Image data processing method, device, equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090322955A1 (en) * | 2006-06-13 | 2009-12-31 | Takuya Iwanami | Data transmitting device, data transmitting method, audio-visual environment control device, audio-visual environment control system, and audio-visual environment control method |
| CN201594888U (en) * | 2009-12-14 | 2010-09-29 | 北京全景多媒体信息系统公司 | System for synchronously changing environments and playing videos |
| CN102090058A (en) * | 2008-07-15 | 2011-06-08 | 夏普株式会社 | Data transmission device, data reception device, method for transmitting data, method for receiving data, and method for controlling audio-visual environment |
| WO2015129029A1 (en) * | 2014-02-28 | 2015-09-03 | パイオニア株式会社 | Video information generation device |
| CN105933664A (en) * | 2016-06-01 | 2016-09-07 | 胡渐佳 | System and method for synchronously displaying environment information in video |
-
2016
- 2016-11-30 CN CN201611089313.4A patent/CN106507172B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090322955A1 (en) * | 2006-06-13 | 2009-12-31 | Takuya Iwanami | Data transmitting device, data transmitting method, audio-visual environment control device, audio-visual environment control system, and audio-visual environment control method |
| CN102090058A (en) * | 2008-07-15 | 2011-06-08 | 夏普株式会社 | Data transmission device, data reception device, method for transmitting data, method for receiving data, and method for controlling audio-visual environment |
| CN201594888U (en) * | 2009-12-14 | 2010-09-29 | 北京全景多媒体信息系统公司 | System for synchronously changing environments and playing videos |
| WO2015129029A1 (en) * | 2014-02-28 | 2015-09-03 | パイオニア株式会社 | Video information generation device |
| CN105933664A (en) * | 2016-06-01 | 2016-09-07 | 胡渐佳 | System and method for synchronously displaying environment information in video |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110166796A (en) * | 2018-05-16 | 2019-08-23 | 腾讯科技（深圳）有限公司 | Processing method, device, computer-readable medium and the electronic equipment of video frame |
| CN110166796B (en) * | 2018-05-16 | 2021-09-17 | 腾讯科技（深圳）有限公司 | Video frame processing method and device, computer readable medium and electronic equipment |
| CN113206912A (en) * | 2021-04-26 | 2021-08-03 | 瑞声光电科技(常州)有限公司 | Information processing method, information processing device, electronic equipment and storage medium |
| CN113206912B (en) * | 2021-04-26 | 2023-07-04 | 瑞声光电科技(常州)有限公司 | Multimedia information processing method, device, electronic equipment and storage medium |
| CN113766279A (en) * | 2021-08-24 | 2021-12-07 | 沈阳风驰软件股份有限公司 | Information processing method, server and mobile terminal |
| CN114205649A (en) * | 2021-12-08 | 2022-03-18 | 无锡英菲感知技术有限公司 | Image data processing method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106507172B (en) | 2019-10-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106507172A (en) | Information coding method, coding/decoding method and device | |
| CN104284098B (en) | The processing method and system of video data | |
| US8925019B2 (en) | Synchronous display streaming system and synchronous displaying method | |
| CN105979332A (en) | Video data detection method and device | |
| CN104967903A (en) | Video play detection method and device | |
| CN104660916A (en) | Screen splicing system and processing method of video data streams | |
| CN104918136A (en) | Video positioning method and device | |
| CN202998337U (en) | Video program identification system | |
| CN104837052A (en) | Playing method of multimedia data and device | |
| CN103517135B (en) | Method, system and television capable of playing MP4-format video files continuously | |
| CN107295352B (en) | Video compression method, device, equipment and storage medium | |
| CN107018406B (en) | Video information processing method and device | |
| CN106095413B (en) | A kind of configuration method and device of bluetooth driver | |
| CN109992264A (en) | Window management method | |
| CN105338564B (en) | A kind of client adaptation method, client, server and system | |
| CN103049238A (en) | Method and device for transmitting image data | |
| CN109151505A (en) | A kind of video transcoding method, system, device and computer readable storage medium | |
| WO2017020737A1 (en) | Video stream storage method, reading method and device | |
| CN107018360B (en) | A kind of adding method of IPC, apparatus and system | |
| CN104837046A (en) | Multi-media file processing method and device | |
| CN104038825A (en) | Virtual channel management method and network multimedia reproduction system | |
| KR101964230B1 (en) | System for processing data | |
| CN111741247B (en) | Video playback method and device and computer equipment | |
| CN114650111A (en) | Broadcasting method and device for emergency broadcast message and intelligent household equipment | |
| CN110751120A (en) | Detection method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240605 Address after: Room 212, Building 14, No. 350 Xianxia Road, Changning District, Shanghai, 200050 Patentee after: SHANGHAI ISMARTV NETWORK TECHNOLOGIES Co.,Ltd. Country or region after: China Address before: 201210 3rd floor, building e, Shangtou Shengyin building, 666 shengxia Road, Pudong New Area, Shanghai Patentee before: WHALEY TECHNOLOGY Co.,Ltd. Country or region before: China |