CN107197327B - Digital media manufacturing method - Google Patents

Digital media manufacturing method Download PDF

Info

Publication number
CN107197327B
CN107197327B CN201710494522.5A CN201710494522A CN107197327B CN 107197327 B CN107197327 B CN 107197327B CN 201710494522 A CN201710494522 A CN 201710494522A CN 107197327 B CN107197327 B CN 107197327B
Authority
CN
China
Prior art keywords
video
audio
data
independent
control information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710494522.5A
Other languages
Chinese (zh)
Other versions
CN107197327A (en
Inventor
张小波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Tianyiyun Information Technology Co ltd
Original Assignee
Guangzhou Tianyiyun Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Tianyiyun Information Technology Co ltd filed Critical Guangzhou Tianyiyun Information Technology Co ltd
Priority to CN201710494522.5A priority Critical patent/CN107197327B/en
Publication of CN107197327A publication Critical patent/CN107197327A/en
Application granted granted Critical
Publication of CN107197327B publication Critical patent/CN107197327B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/233Processing of audio elementary streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs

Abstract

The invention discloses a digital media manufacturing method, which comprises the following steps: the method comprises the steps of firstly, acquiring audio and video, secondly, processing the audio and video, thirdly, forming a digital media file, fourthly, independently storing, fifthly, generating independent time control information, sixthly, generating video and audio control information, and seventhly, establishing and calling an independent inter-cut database.

Description

Digital media manufacturing method
Technical Field
The invention relates to a multimedia manufacturing method, in particular to a digital media manufacturing method, and belongs to the technical field of digital media manufacturing.
Background
The digital media is a media that comprehensively processes, transmits and displays information such as video, voice, data and the like in accordance with a single signal processing method called a digital signal, and is characterized in that it provides not only a communication environment integrating information of different properties and types of signals but also a network by using the digital signal, and thus people connected to the media system can communicate various information with each other through the digital network, and thus it can be said that the digital media has a great significance in expressing the bidirectionality and interactivity of the media through the digital network; the existing digital media production methods are various, for example, chinese patent application No.: 200610081465.X, discloses an interactive digital multimedia making method based on video and audio, making multimedia files through man-machine interaction; the method comprises the following steps: starting; the method comprises the following steps of firstly, acquiring a field video image in real time and preprocessing the field video image to obtain primary video information; step two, processing and converting the preliminary video information into video control information; acquiring field audio data in real time, and preprocessing the field audio data to acquire preliminary audio information; step four, processing and converting the preliminary audio information into audio control information; step one, step two constitute step group one, step three, step four constitute step group two, step group one, step group two are independent each other, and enter step five after finishing carrying out; step five, fusing the video control information and the audio control information, outputting an ontology control command, and changing and outputting ontology content; finishing; the invention adopts interactive control of video and audio to realize direct control of virtual elements in the multimedia file; but the starting interactivity is not strong, and the modification of the later-stage interactive response is complicated.
Disclosure of Invention
In order to solve the above problems, the present invention provides a digital media production method, which has diversified interaction schemes, and can implement either individual interaction control or hybrid binding interaction control.
The invention relates to a method for manufacturing a digital media, which comprises the following steps:
firstly, audio and video acquisition, namely acquiring video and audio data through pickup equipment and digital optical equipment;
secondly, audio and video processing, namely processing the audio and video acquired in the first step through a digital processing system and converting the audio and video into video digital data and audio digital data;
thirdly, forming a digital media file, and synthesizing the video digital data and the audio digital data into the digital media file;
fourthly, independently storing, and respectively sending the video digital data and the audio digital data to a video data memory and an audio data memory through a control system;
fifthly, generating independent time control information, firstly forming a video independent time axis by taking each frame picture as a time point for video data in a video data memory, and forming an audio independent time axis by taking millisecond unit time for audio data in an audio data memory; then, establishing an independent time axis control system, and synchronizing the time point of the video independent time axis with the time point of the audio independent time axis;
sixthly, generating video and audio control information, timing time points through an independent time axis control system, and extracting frame picture characteristics of one frame of the current video or extracting global motion information and local attitude information of continuous frame pictures after triggering a certain preset time point to convert the video and audio control information into video control information; the frequency value, the amplitude value and the syllable of the audio sound are extracted and analyzed and converted into audio control information;
and step seven, establishing and calling an independent inter cut database, and triggering data in the independent inter cut database through independent time control information and video and/or audio control information.
In a preferred embodiment, the data in the independent inter-cut database is video digital data and/or audio digital data.
As a preferred embodiment, the independent spot database is provided with an update interface.
As a preferred embodiment, the control system is further provided with an information acquisition response system.
As a preferred embodiment, the information collection response system comprises the following steps: and data are collected through the information collection response system and are sent to the control system, and the control system controls and calls the data in the independent inter-cut database.
In a preferred embodiment, the information collection response system collects data and generates independent time control information and/or generates video and audio control information.
As a preferred embodiment, the information acquisition response system includes an environment information acquisition device and a posture information acquisition device.
As a preferred embodiment, the information acquisition response system further comprises a voice acquisition device and a physiological information acquisition device.
Compared with the prior art, the digital media production method provided by the invention has the advantages that the interaction is triggered through the independent time control information and the video and/or audio control information, the interaction information can be modified in a later stage, the interaction scheme is diversified, the single interaction control can be realized, the mixed binding interaction control can also be carried out, the use flexibility is strong, and the setting can be automatically carried out according to the scene application.
Drawings
Fig. 1 is a schematic view of the overall structure of embodiment 1 of the present invention.
Detailed Description
Example 1:
as shown in fig. 1, the method for manufacturing a digital media of the present invention specifically includes the following steps:
firstly, audio and video acquisition, namely acquiring video and audio data through pickup equipment and digital optical equipment;
secondly, audio and video processing, namely processing the audio and video acquired in the first step through a digital processing system and converting the audio and video into video digital data and audio digital data;
thirdly, forming a digital media file, and synthesizing the video digital data and the audio digital data into the digital media file;
fourthly, independently storing, and respectively sending the video digital data and the audio digital data to a video data memory and an audio data memory through a control system;
fifthly, generating independent time control information, firstly forming a video independent time axis by taking each frame picture as a time point for video data in a video data memory, and forming an audio independent time axis by taking millisecond unit time for audio data in an audio data memory; then, establishing an independent time axis control system, and synchronizing the time point of the video independent time axis with the time point of the audio independent time axis;
sixthly, generating video and audio control information, timing time points through an independent time axis control system, and extracting frame picture characteristics of one frame of the current video or extracting global motion information and local attitude information of continuous frame pictures after triggering a certain preset time point to convert the video and audio control information into video control information; the frequency value, the amplitude value and the syllable of the audio sound are extracted and analyzed and converted into audio control information;
and step seven, establishing and calling an independent inter cut database, and triggering data in the independent inter cut database through independent time control information and video and/or audio control information.
In one example, the data within the separate break-in database is video digital data and/or audio digital data.
In one example, the independent spot database is provided with an update interface.
Example 2:
in the digital media manufacturing method, the control system is also provided with an information acquisition response system; the information acquisition response system comprises the following methods: data are collected through an information collection response system and are sent to a control system, and the control system controls and calls data in the independent inter-cut database; the information acquisition response system binds the acquired data with the generated independent time control information and/or the generated video and audio control information; the information acquisition response system comprises an environment information acquisition device and a posture information acquisition device; the information acquisition response system also comprises a voice acquisition device and a physiological information acquisition device.
The digital media manufacturing method provided by the invention triggers interaction through the independent time control information and the video and/or audio control information, the interaction information can be modified in a later period, the interaction scheme is diversified, the independent interaction control can be realized, the mixed binding interaction control can also be performed, the use flexibility is strong, and the setting can be automatically carried out according to the scene application.
In light of the foregoing description of the preferred embodiment of the present invention, many modifications and variations will be apparent to those skilled in the art without departing from the spirit and scope of the invention. The technical scope of the present invention is not limited to the content of the specification, and must be determined according to the scope of the claims.

Claims (1)

1. A method of digital media production, the method comprising:
firstly, audio and video acquisition, namely acquiring video and audio data through pickup equipment and digital optical equipment;
secondly, audio and video processing, namely processing the audio and video acquired in the first step through a digital processing system and converting the audio and video into video digital data and audio digital data;
thirdly, forming a digital media file, and synthesizing the video digital data and the audio digital data into the digital media file;
it is characterized in that the preparation method is characterized in that,
fourthly, independently storing, and respectively sending the video digital data and the audio digital data to a video data memory and an audio data memory through a control system;
fifthly, generating independent time control information, firstly forming a video independent time axis by taking each frame picture as a time point for video data in a video data memory, and forming an audio independent time axis by taking millisecond unit time for audio data in an audio data memory; then, establishing an independent time axis control system, and synchronizing the time point of the video independent time axis with the time point of the audio independent time axis;
sixthly, generating video and audio control information, timing time points through an independent time axis control system, and extracting frame picture characteristics of one frame of the current video or extracting global motion information and local attitude information of continuous frame pictures after triggering a certain preset time point to convert the video and audio control information into video control information; the frequency value, the amplitude value and the syllable of the audio sound are extracted and analyzed and converted into audio control information;
step seven, establishing and calling an independent inter cut database, and triggering data in the independent inter cut database through independent time control information and video and/or audio control information; the data in the independent inter-cut database is video digital data and/or audio digital data; the independent inter-cut database is provided with an updating interface.
CN201710494522.5A 2017-06-26 2017-06-26 Digital media manufacturing method Active CN107197327B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710494522.5A CN107197327B (en) 2017-06-26 2017-06-26 Digital media manufacturing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710494522.5A CN107197327B (en) 2017-06-26 2017-06-26 Digital media manufacturing method

Publications (2)

Publication Number Publication Date
CN107197327A CN107197327A (en) 2017-09-22
CN107197327B true CN107197327B (en) 2020-11-13

Family

ID=59880034

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710494522.5A Active CN107197327B (en) 2017-06-26 2017-06-26 Digital media manufacturing method

Country Status (1)

Country Link
CN (1) CN107197327B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111726692B (en) * 2019-03-22 2022-09-09 北京图音数码科技有限公司 Interactive playing method of audio-video data

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1716273A (en) * 2004-06-28 2006-01-04 李剑华 Outer shape structure of commercial guest greeting robot and identifying method
CN101079996A (en) * 2006-05-22 2007-11-28 北京盛开交互娱乐科技有限公司 An interactive digital multimedia making method based on video and audio
CN103186227A (en) * 2011-12-28 2013-07-03 北京德信互动网络技术有限公司 Man-machine interaction system and method
CN103686315A (en) * 2012-09-13 2014-03-26 深圳市快播科技有限公司 Synchronous audio and video playing method and device
CN103974143A (en) * 2014-05-20 2014-08-06 北京速能数码网络技术有限公司 Method and device for generating media data
CN104391924A (en) * 2014-11-21 2015-03-04 南京讯思雅信息科技有限公司 Mixed audio and video search method and system
CN105791950A (en) * 2014-12-24 2016-07-20 珠海金山办公软件有限公司 Power Point video recording method and device

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7428000B2 (en) * 2003-06-26 2008-09-23 Microsoft Corp. System and method for distributed meetings
US7395508B2 (en) * 2005-01-14 2008-07-01 International Business Machines Corporation Method and apparatus for providing an interactive presentation environment
US7495667B2 (en) * 2006-02-24 2009-02-24 Michael Bruggeman Post production integration platform
CN103237191B (en) * 2013-04-16 2016-04-06 成都飞视美视频技术有限公司 The method of synchronized push audio frequency and video in video conference
CN203661162U (en) * 2014-01-24 2014-06-18 浙江京都世纪影视文化有限公司 Video and audio fragment one-time synchronization synthesis system
CN105988369B (en) * 2015-02-13 2020-05-08 上海交通大学 Content-driven intelligent household control method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1716273A (en) * 2004-06-28 2006-01-04 李剑华 Outer shape structure of commercial guest greeting robot and identifying method
CN101079996A (en) * 2006-05-22 2007-11-28 北京盛开交互娱乐科技有限公司 An interactive digital multimedia making method based on video and audio
CN103186227A (en) * 2011-12-28 2013-07-03 北京德信互动网络技术有限公司 Man-machine interaction system and method
CN103686315A (en) * 2012-09-13 2014-03-26 深圳市快播科技有限公司 Synchronous audio and video playing method and device
CN103974143A (en) * 2014-05-20 2014-08-06 北京速能数码网络技术有限公司 Method and device for generating media data
CN104391924A (en) * 2014-11-21 2015-03-04 南京讯思雅信息科技有限公司 Mixed audio and video search method and system
CN105791950A (en) * 2014-12-24 2016-07-20 珠海金山办公软件有限公司 Power Point video recording method and device

Also Published As

Publication number Publication date
CN107197327A (en) 2017-09-22

Similar Documents

Publication Publication Date Title
CN102006453B (en) Superposition method and device for auxiliary information of video signals
EP1298933A3 (en) Video telecommunication system
JPH0823530A (en) Method and apparatus for processing stream of audio signal and video signal
AU2011200857A1 (en) Method and system for adding translation in a videoconference
CN103841358B (en) The video conferencing system and method for low code stream, sending ending equipment, receiving device
DE202017007466U1 (en) System for providing object-oriented zoom in multimedia messaging
CN103442280B (en) Realize the method, apparatus and its television and mobile terminal of distributed remote control
CN107578777A (en) Word-information display method, apparatus and system, audio recognition method and device
CN109361527A (en) Voice conferencing recording method and system
CN108650484A (en) A kind of method and device of the remote synchronous translation based on audio/video communication
CN106792013A (en) A kind of method, the TV interactive for television broadcast sounds
CN109168059A (en) A kind of labial synchronization method playing audio & video respectively on different devices
CN107197327B (en) Digital media manufacturing method
CN108198551A (en) The processing method and processing device of echo cancellor delay
CN104606882A (en) Motion sensing game interaction method and system
CN107707866A (en) A kind of remote video communication method based on Internet of Things
CN107483872A (en) Video call system and video call method
CN108320331B (en) Method and equipment for generating augmented reality video information of user scene
CN201226563Y (en) Picture-divided video input apparatus
CN103826084A (en) Audio encoding method
CN109714603A (en) The method and device of multichannel audio-video frequency live streaming
CN107135407B (en) Synchronous method and system in a kind of piano video teaching
CN113875227A (en) Information processing apparatus, information processing method, and program
CN107566863A (en) A kind of exchange of information methods of exhibiting, device and equipment, set top box
CN110324702A (en) Information-pushing method and device in video display process

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant