CN104394420A - Video processing device and method and terminal device - Google Patents
Video processing device and method and terminal device Download PDFInfo
- Publication number
- CN104394420A CN104394420A CN201410714669.7A CN201410714669A CN104394420A CN 104394420 A CN104394420 A CN 104394420A CN 201410714669 A CN201410714669 A CN 201410714669A CN 104394420 A CN104394420 A CN 104394420A
- Authority
- CN
- China
- Prior art keywords
- video
- acquisition device
- described video
- notification
- copy
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
Abstract
An embodiment of the invention discloses a video processing method which includes receiving a locking inform transmitted by a video collection device, wherein the locking inform is used for showing that the video collection device finishes locking operation of a generated video image; judging whether a video encoder is in the idle state, on yes judgment, converting the video image into the copy with preset format; transmitting an unlocking inform to the video collection device after the format conversion operation is finished, wherein the unlocking inform is used for showing that the video collection device unlocks the video image; transmitting the copy of the preset format to the video encoder to enable the video encoder to compress and code the copy with the preset format. A video processing device and a client are further disclosed. By means of the device and method and the terminal device, the hardware resource consumption is reduced.
Description
Technical field
The present invention relates to field of video processing, particularly relate to a kind of video process apparatus, method and terminal equipment.
Background technology
Video flowing live broadcast system comprises server and client side, client is divided into main broadcaster's client and spectator client, by server, a channel is set, virtual room in other words conj.or perhaps, main broadcaster can carry out the control of live content and upload in channel, these contents are pushed to client by server, show in client.
Channel is a kind of information exchange platform that server provides for user, video flowing uploads onto the server by main broadcaster's client, the video flowing of server announcing play-by-play client upload in channel, after spectator client enters the channel of main broadcaster's client, server, to spectator client pushing video stream, is resolved video flowing by spectator client.Meanwhile, spectator client in channel can and this channel in main broadcaster's client and enter this channel other spectator client between carry out information interaction.
The method of current main broadcaster's client generating video stream is: main broadcaster's client carries out collection generating video image by video acquisition device to video source, the video image collected is carried out copying ghost, copy is sent to video encoder and carries out compression process, generate the video code flow preset after compression process and video code flow is uploaded onto the server.Applicant finds, current video compression coding scheme generates after raw video image in collection at video acquisition device, deposited by raw video image in buffer memory corresponding to video acquisition device, video encoder carries out follow-up video compression coding process after the raw video image in this buffer memory being copied to local buffer memory again.As can be seen here, need to copy raw video image before compressed encoding, because raw video image data volume is very huge, copy operation will certainly increase the consumption of CPU and take a large amount of memory spaces.
Summary of the invention
Embodiment of the present invention technical problem to be solved is, provides a kind of method for processing video frequency, device and client.Cpu resource consumption in video processing procedure can be solved in prior art large and take the large problem of memory space.
In order to solve the problems of the technologies described above, embodiments provide a kind of method for processing video frequency, comprising:
The lock notification that receiver, video harvester sends; Described lock notification is for representing that described video acquisition device completes the lock operation to the video image generated;
Judge whether video encoder is in idle condition, if yes, described video image is converted to the copy of preset format;
After format conversion operation completes, send unlock notification to described video acquisition device, described unlock notification is used to indicate the locking of described video acquisition device releasing to described video image;
The copy of described preset format is sent to described video encoder, to make described video encoder, compressed encoding process is carried out to the copy of described preset format.
Accordingly, embodiments provide a kind of video process apparatus, comprising:
Receiver module, for the lock notification that receiver, video harvester sends; Described lock notification is for representing that described video acquisition device completes the lock operation to the video image generated;
Modular converter, for judging whether video encoder is in idle condition, if yes, generating the copy of described video image, and the format conversion of described copy is become preset format;
Unlock notification module, for after format conversion operation completes, sends unlock notification to described video acquisition device, and described unlock notification is used to indicate the locking of described video acquisition device releasing to described video image;
Coding indicating module, for the copy of described preset format is sent to described video encoder, carries out compressed encoding process to make described video encoder to the copy of described preset format.
Accordingly, embodiments provide a kind of client, comprising:
Video acquisition device, video encoder and video process apparatus;
Described video acquisition device generating video image, locks described video image, and after completing lock operation, sends lock notification to described video process apparatus;
The lock notification that described video process apparatus receiver, video harvester sends; Described lock notification is for representing that described video acquisition device completes the lock operation to the video image generated;
Described video process apparatus judges whether video encoder is in idle condition, if yes, described video image is converted to the copy of preset format;
After format conversion operation completes, described video process apparatus sends unlock notification to described video acquisition device, and described unlock notification is used to indicate the locking of described video acquisition device releasing to described video image;
After described video acquisition device receives described unlock notification, remove the locking to described video image;
The copy of described preset format is sent to described video encoder by described video process apparatus;
Described video encoder carries out compressed encoding process to the copy of described preset format.
Implement the embodiment of the present invention, there is following beneficial effect:
Receive the lock notification of video acquisition device, when judging that video encoder is in idle condition, directly follow-up format conversion processing is carried out to the video image of the lock-out state that video acquisition device generates, avoid carrying out copy operation to unpressed video image, effectively can decrease the consumption of CPU and decrease taking of memory space.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is a kind of Living Network structure chart that the embodiment of the present invention provides;
Fig. 2 is the schematic flow sheet of a kind of method for processing video frequency that first embodiment of the invention provides.
Fig. 3 is the schematic flow sheet of a kind of method for processing video frequency that second embodiment of the invention provides;
Fig. 4 is the schematic flow sheet of a kind of video process apparatus that first embodiment of the invention provides;
Fig. 5 is the schematic flow sheet of a kind of video process apparatus that second embodiment of the invention provides;
Fig. 6 is the structural representation of a kind of client that the embodiment of the present invention provides.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
In order to better understand a kind of method for processing video frequency, device and client disclosed in the embodiment of the present invention, first the Living Network framework that the embodiment of the present invention is suitable for is described below.Refer to Fig. 1, Fig. 1 is a kind of Living Network framework schematic diagram disclosed in the embodiment of the present invention.As shown in Figure 1, this Living Network framework can comprise service equipment and multiple client, and wherein, service equipment is also by title background server, component server etc., and service equipment can be communicated to connect by the Internet and multiple client.
In the Living Network framework shown in Fig. 1, the part client in multiple client can as main broadcaster's client, and all the other clients can as spectator client.In the embodiment of the present invention, channel is exactly briefly a kind of Virtual Space (or virtual room) that service equipment creates, the spectator client being positioned at this Virtual Space not only can watch the live content of main broadcaster's client, can also and main broadcaster's client carry out the mutual of voice or word.Main broadcaster's client not only has access to all the other spectator client in its channel of access, kicks out of control, also has live initiative.In the embodiment of the present invention, main broadcaster's client, spectator client can realize comprising the several functions such as set group chat, net cast, channel K song, game on line, online video display.In the Living Network framework shown in Fig. 1, main broadcaster's client, spectator client may operate in and include but not limited on the subscriber equipment such as mobile phone, removable computer, panel computer, personal digital assistant (Personal Digital Assistant, PDA), media player, intelligent television, intelligent watch, intelligent glasses, Intelligent bracelet.
Below in conjunction with Fig. 1 and Fig. 2., a kind of method for processing video frequency that the embodiment of the present invention provides is described in detail.
See Fig. 1, be the schematic flow sheet of a kind of method for processing video frequency that first embodiment of the invention provides, in embodiments of the present invention, described method comprises:
The lock notification that S101, receiver, video harvester send; Described lock notification is for representing that described video acquisition device completes the lock operation to the video image generated.
Concrete, video acquisition device is for generating the video image of uncompressed, the video image generated comprises multiple frame of video, video acquisition device can utilize optical sensor to carry out external environment condition gathering the video image generated, such as, video acquisition device is camera, video tape recorder or camera etc.; Video acquisition device also can a kind of application software, such as film recording software, is carried out the video image of film recording generation by the appointed area of the user interface to subscriber equipment.Video acquisition device collection after generating the video image of uncompressed, the video image collected is stored in the buffer memory of video acquisition device, and the video image in buffer memory is conducted the locking operations, lock operation refers to that video process apparatus has the exclusive operating right to video image, entity (such as device, program and thread) except video process apparatus is not to the operating right of video image, and the video image be simultaneously in the lock state in buffer memory maps directly to the buffer memory of video process apparatus.After video acquisition device completes lock operation to video image, lock notification is sent to video process apparatus, video process apparatus receives lock notification can determine that video acquisition device completes the lock operation to video image, and video process apparatus can utilize the video image of locking to carry out follow-up process.
S102, judge whether video encoder is in idle condition, if yes, described video image is converted to the copy of preset format.
Concrete, video encoder is used for carrying out compressed encoding to video image, removes the data message of video image, to reduce the file size of video image.Video process apparatus judges whether video encoder is in idle condition, by inquiry, the method judged can represent that the idle condition of video encoder or the status indicator position of busy condition judge, if video encoder is in idle condition, video process apparatus directly utilizes the video image be in the lock state in the buffer memory of video acquisition device to carry out format conversion, generates the copy of preset format.Like this, avoid the video image in the buffer memory of video acquisition device to copy in the buffering of video process apparatus, reduce the consumption of hardware resource during video image copy.
S103, after format conversion operation completes, send unlock notification to described video acquisition device, described unlock notification is used to indicate described video acquisition device and removes locking to described video image.
Concrete, after the format conversion of copy becomes the operation of preset format to complete by video process apparatus, notice video acquisition device removes the locking to video image, and after unlocking, video acquisition device can seize the operating right of video image.
S104, the copy of described preset format is sent to described video encoder, to make described video encoder, compressed encoding process is carried out to the copy of described preset format.
Concrete, video encoder carries out compressed encoding process to the copy of the video image after format conversion, to reduce information redundancy, Coding Compression Algorithm can be any one Coding Compression Algorithm of the prior art, such as, MPEG-4, JVT, H.264 with AVC etc., the present invention is not restricted.
Implement embodiments of the invention, receive the lock notification of video acquisition device, when judging that video encoder is in idle condition, directly follow-up format conversion processing is carried out to the video image of the lock-out state that video acquisition device generates, avoid carrying out copy operation to unpressed video image, effectively can decrease the consumption of CPU and decrease taking of memory space.
See Fig. 2, be the schematic flow sheet of a kind of method for processing video frequency that second embodiment of the invention provides, in embodiments of the present invention, described method comprises:
The lock notification that S201, detection video acquisition device send.
Concrete, video acquisition device is for generating the video image of uncompressed, the video image generated comprises multiple frame of video, video acquisition device can utilize optical sensor to carry out external environment condition gathering the video image generated, such as, video acquisition device is camera, video tape recorder or camera etc.; Video acquisition device also can a kind of application software, such as film recording software, is carried out the video image of film recording generation by the appointed area of the user interface to subscriber equipment.Video acquisition device collection after generating the video image of uncompressed, the video image collected is saved in buffer memory, and the video image in buffer memory is conducted the locking operations, lock operation refers to that video process apparatus has the exclusive operating right to video image, and the entity (such as device, program and thread) except video process apparatus is not to the operating right of video image.After video acquisition device completes lock operation to video image, lock notification is sent to video process apparatus, video process apparatus receives video acquisition device and receives lock notification and can determine that video acquisition device completes the lock operation to video image, and video process apparatus can utilize the video image of locking to carry out follow-up process.Wherein, the quantity of the frame of video comprised in video image can be determined according to the disposal ability of video encoder.Video process apparatus start detection thread, waits for the lock notification that video acquisition device sends.
Optionally, video acquisition device can be locked the video image collected by resource lock, resource lock is for characterizing a kind of mutual exclusion mechanism, before target resource being operated to (such as read operation or write operation), need to get resource lock corresponding to target resource, after operation requests object acquisition to the resource lock of target resource, other operation requests objects can not operate target resource again.After video acquisition device generating video resource, resource lock corresponding for video image can be set to seizure condition, and the identification presentation of video process apparatus is added in owner's list of this resource lock, represent that video process apparatus has the operating right exclusive to video image.
The lock notification that S202, receiver, video harvester send.
Concrete, after the detection thread of video process apparatus detects the lock notification that video acquisition device sends, receive this lock notification, lock notification is for representing that video acquisition device completes the lock operation of the video image to generation.Wherein, the address realm of video image is also comprised in lock notification, video process apparatus can according to the video image that address realm determination video acquisition device is in the lock state, so that video process apparatus utilizes the video image of locking to carry out follow-up process.
S203, judge whether video encoder is in idle condition.
Concrete, after video encoder starts, corresponding coding thread can be generated in an operating system, video process apparatus determination video encoder moves into coding thread in an operating system, and the status indicator of inquiry coding thread, it is idle condition or busy condition that status indicator is used for presentation code thread, judges whether video encoder is in idle condition according to the status indicator inquired.Such as, be idle condition with " 0 " presentation code thread, " 1 " identification code thread is busy condition.
Optionally, the state of the status poll interface polls video encoder that video process apparatus can be provided by video encoder, what represented by status poll interface polls that the status indicator of the state of video encoder determines video encoder is in idle condition or busy condition.If video encoder is in idle condition, perform S206, if be in busy condition, perform S204.
S204, send unlock notification to described video acquisition device.
Concrete, video process apparatus is when determining that video encoder is in busy condition, video encoder cannot carry out compressed encoding process to the video image of video acquisition device input, video process apparatus sends unlock notification to video acquisition device, to notify that video acquisition device removes the locking to video image, after unlocking, other entities can obtain the operating right to video image by the mode of competing.
Exemplary, in the scene of resource lock, video process apparatus sends unlock notification to video acquisition device, the state of the resource lock of video image is set to idle condition by video acquisition device, and the identify label of video acquisition device is deleted from owner's list, to remove the locking to video image.
S205, do not receive time of lock notification that described video acquisition device sends and be greater than preset duration.
Concrete, the time interval between the moment that video process apparatus calculating current time and last time receive the lock notification that video acquisition device sends, if calculate interval greater than preset duration, the notice to be entered such as continuation then shows that video acquisition device does not all receive lock notification in preset duration, if will cause the waste of hardware resource.
Exemplary, video process apparatus detected whether receive lock notification every 1 minute, and arranging preset duration is 5 minutes, when namely still not receiving the lock notification of video acquisition device transmission when the 6th sense cycle, performed S209.Be understandable that, the sense cycle of video process apparatus and preset duration can set according to actual needs, and the present invention does not limit concrete numerical value.
S206, described video image is converted to the copy of preset format.
Concrete, the video image be in the lock state is carried out format conversion operation by video process apparatus, generates the copy of preset format after format conversion, to meet the requirement of video encoder.
Exemplary, video encoder requires that the format condition of the image to be encoded of input is: resolution 1024*768, color space is RGB, the resolution of the video image that video acquisition device generates is 2048*1024, color space is YIQ, and the copy of the video image of generation is identical with the attribute information of video image, and video process apparatus is according to the corresponding relation of YIQ color space and RGB color space, be RGB color space by YIQ color space conversion, the corresponding relation of the two is:
Y＝0.299R+0.587G+0.114B
I＝0.596R-0.275G-0.321B
Q＝0.212R-0.523G+0.311B
Meanwhile, video image carries out reducing process by video process apparatus, to meet the requirement of the resolution of video encoder.In an embodiment of the present invention, before carrying out compressed encoding to the copy of preset format, video process apparatus can also carry out other preliminary treatment to copy, such as, noise filtering, adds watermark or sample process etc.
S207, after format conversion operation completes, send unlock notification to described video acquisition device.
Concrete, after video process apparatus completes the process of format conversion,
Concrete, after video process apparatus completes the format conversion processing of copy, video process apparatus sends unlock notification to video acquisition device, to notify that video acquisition device removes the locking to video image, after unlocking, other entities can obtain the operating right to video image by the mode of competing.
Exemplary, in the scene of resource lock, video process apparatus sends unlock notification to video acquisition device, the state of the resource lock of video image is set to idle condition by video acquisition device, and the identify label of video acquisition device is deleted from owner's list, to remove the locking to video image.
S208, carry out compressed encoding process by the video image copy of described video encoder to described preset format.
Concrete, concrete, video encoder carries out compressed encoding process to the copy of the video image after format conversion, to reduce information redundancy, Coding Compression Algorithm can be any one Coding Compression Algorithm of the prior art, such as, MPEG-4, JVT, H.264 with AVC etc., the present invention is not restricted.
S209, exit mark and whether be set up.
Concrete, described in exit mark and be used to indicate Video processing processing unit and quit work, exiting mark can be undertaken arranging or being arranged by video acquisition device by user.Such as, after video acquisition device completes the acquisition operations to video source, follow-uply new video image can not generated, what video acquisition device arranged video process apparatus exits mark, when video process apparatus detects that exiting mark is set up, quit work and the hardware resource of release busy, hardware resource comprises memory source and cpu resource.Video process apparatus judges whether exit mark is set up, and if yes, performs S210, if NO, performs S201.
Again such as, when user does not need to carry out Video compression, perform and exit operation, what operating system arranged video process apparatus accordingly in a register exits mark, when video process apparatus detects that exiting mark is set up, quit work, the hardware resource of release busy.
The hardware resource of S210, release busy.
Implement embodiments of the invention, receive the lock notification of video acquisition device, when judging that video encoder is in idle condition, directly follow-up format conversion processing is carried out to the video image of the lock-out state that video acquisition device generates, avoid carrying out copy operation to unpressed video image, effectively can decrease the consumption of CPU and decrease taking of memory space.
See Fig. 3, be the structural representation of a kind of video process apparatus that first embodiment of the invention provides, in embodiments of the present invention, described video process apparatus comprises receiver module 10, modular converter 11, unlock notification module 12 and coding indicating module 13.
Receiver module 10, for the lock notification that receiver, video harvester sends; Described lock notification is for representing that described video acquisition device completes the lock operation to the video image generated.
Modular converter 11, for judging whether video encoder is in idle condition, if yes, converts the copy of preset format to by described video image.
Unlock notification module 12, for after format conversion operation completes, sends unlock notification to described video acquisition device, and described unlock notification is used to indicate the locking of described video acquisition device releasing to described video image.
Coding indicating module 13, for the copy of described preset format is sent to described video encoder, carries out compressed encoding process to make described video encoder to the copy of described preset format.
The embodiment of the present invention and embodiment of the method one are based on same design, and its technique effect brought is also identical, specifically please refer to the description of embodiment of the method one, no longer describes herein.
Implement embodiments of the invention, receive the lock notification of video acquisition device, when judging that video encoder is in idle condition, directly follow-up format conversion processing is carried out to the video image of the lock-out state that video acquisition device generates, avoid carrying out copy operation to unpressed video image, effectively can decrease the consumption of CPU and decrease taking of memory space.
See Fig. 5, for the structural representation of a kind of video process apparatus that second embodiment of the invention provides, in embodiments of the present invention, described device, except comprising receiver module 10, modular converter 11, unlock notification module 12 and coding indicating module 13, also comprises timeout treatment module 14 and status processing module 15.
Timeout treatment module 14, during for being greater than preset duration when the time not receiving the lock notification that described video acquisition device sends, judge whether exit mark is set up, if yes, the hardware resource of release busy, described hardware resource comprises cpu resource and memory source.
Status processing module 15, for judging whether described video encoder is in idle condition, if NO, sends unlock notification to described video acquisition device; If described in exit mark and be set up, the hardware resource of release busy.
Optionally, modular converter 11 for:
Determine that described video encoder is arranged in the coding thread of operating system, and inquire about the status indicator of described coding thread; Wherein, described status indicator is for representing that described coding thread is idle condition or busy condition;
Judge whether described video encoder is in idle condition according to described status indicator.
Optionally, described preset format comprises pre-set color space and/or pre-set dimension.
The embodiment of the present invention and embodiment of the method two are based on same design, and its technique effect brought is also identical, and detailed process please refer to the description of embodiment of the method two, repeats no more herein.
Implement embodiments of the invention, receive the lock notification of video acquisition device, when judging that video encoder is in idle condition, directly follow-up format conversion processing is carried out to the video image of the lock-out state that video acquisition device generates, avoid carrying out copy operation to unpressed video image, effectively can decrease the consumption of CPU and decrease taking of memory space.
See Fig. 6, for the structural representation of a kind of client that the embodiment of the present invention provides, in embodiments of the present invention, client 2 comprises video acquisition device 20, video process apparatus 21 and video encoder 22, client 2 can be the main broadcaster's client in Living Network framework, main broadcaster's client to upload onto the server equipment after being used for that the video image collected is carried out compressed encoding process, then by service equipment, the video image after process is sent to multiple spectator client.
In embodiments of the present invention, the course of work of client 2 is: video acquisition device 20 generating video image, locks described video image, and after completing lock operation, sends lock notification to video process apparatus 21; The lock notification that video process apparatus 21 receiver, video harvester 20 sends; Described lock notification is for representing that video acquisition device 20 completes the lock operation to the video image generated; Video process apparatus 21 judges whether video encoder is in idle condition, if yes, described video image is converted to the copy of preset format; After format conversion operation completes, video process apparatus 21 sends unlock notification to video acquisition device 20, and described unlock notification is used to indicate video acquisition device 20 and removes locking to described video image; After video acquisition device 20 receives described unlock notification, remove the locking to described video image; The copy of described preset format is sent to video encoder 22 by video process apparatus 21; Video encoder 22 carries out compressed encoding process to the copy of described preset format, and is uploaded onto the server by the copy of the preset format after compressed encoding process.
The detailed process related in the embodiment of the present invention see the description of embodiment of the method two, can repeat no more herein.
Implement embodiments of the invention, receive the lock notification of video acquisition device, when judging that video encoder is in idle condition, directly follow-up format conversion processing is carried out to the video image of the lock-out state that video acquisition device generates, avoid carrying out copy operation to unpressed video image, effectively can decrease the consumption of CPU and decrease taking of memory space.
One of ordinary skill in the art will appreciate that all or part of flow process realized in above-described embodiment method, that the hardware that can carry out instruction relevant by computer program has come, described program can be stored in a computer read/write memory medium, this program, when performing, can comprise the flow process of the embodiment as above-mentioned each side method.Wherein, described storage medium can be magnetic disc, CD, read-only store-memory body (Read-Only Memory, ROM) or random store-memory body (Random Access Memory, RAM) etc.
Above disclosedly be only a kind of preferred embodiment of the present invention, certainly the interest field of the present invention can not be limited with this, one of ordinary skill in the art will appreciate that all or part of flow process realizing above-described embodiment, and according to the equivalent variations that the claims in the present invention are done, still belong to the scope that invention is contained.
Claims (11)
1. a method for processing video frequency, is characterized in that, comprising:
The lock notification that receiver, video harvester sends; Described lock notification is for representing that described video acquisition device completes the lock operation to the video image generated;
Judge whether video encoder is in idle condition, if yes, described video image is converted to the copy of preset format;
After format conversion operation completes, send unlock notification to described video acquisition device, described unlock notification is used to indicate the locking of described video acquisition device releasing to described video image;
The copy of described preset format is sent to described video encoder, to make described video encoder, compressed encoding process is carried out to the copy of described preset format.
2. the method for claim 1, is characterized in that, also for:
When the time not receiving the lock notification that described video acquisition device sends is greater than preset duration, judge whether be set up, if yes, the hardware resource of release busy, described hardware resource comprises cpu resource and memory source if exiting mark.
3. method as claimed in claim 1 or 2, is characterized in that, describedly judges whether video encoder is in idle condition and comprises:
Determine that described video encoder moves into coding thread in an operating system, and inquire about the status indicator of described coding thread; Wherein, described status indicator is for representing that described coding thread is idle condition or busy condition;
Judge whether described video encoder is in idle condition according to the status indicator inquired.
4. method as claimed in claim 3, it is characterized in that, the described format conversion by described copy becomes in preset format, and described preset format comprises pre-set color space and/or pre-set dimension.
5. the method as described in claim 1-4 any one, is characterized in that, also comprises:
Judge whether described video encoder is in idle condition, if NO, send unlock notification to described video acquisition device; If described in exit mark and be set up, the hardware resource of release busy.
6. a video process apparatus, is characterized in that, comprising:
Receiver module, for the lock notification that receiver, video harvester sends; Described lock notification is for representing that described video acquisition device completes the lock operation to the video image generated;
Modular converter, for judging whether video encoder is in idle condition, if yes, converts the copy of preset format to by described video image;
Unlock notification module, for after format conversion operation completes, sends unlock notification to described video acquisition device, and described unlock notification is used to indicate the locking of described video acquisition device releasing to described video image;
Coding indicating module, for the copy of described preset format is sent to described video encoder, carries out compressed encoding process to make described video encoder to the copy of described preset format.
7. device as claimed in claim 6, is characterized in that, also comprise:
Timeout treatment module, during for being greater than preset duration when the time not receiving the lock notification that described video acquisition device sends, judge whether exit mark is set up, if yes, the hardware resource of release busy, described hardware resource comprises cpu resource and memory source.
8. device as claimed in claims 6 or 7, it is characterized in that, described modular converter is used for
Determine that described video encoder is arranged in the coding thread of operating system, and inquire about the status indicator of described coding thread; Wherein, described status indicator is for representing that described coding thread is idle condition or busy condition;
Judge whether described video encoder is in idle condition according to described status indicator.
9. device as claimed in claim 8, it is characterized in that, described preset format comprises pre-set color space and/or pre-set dimension.
10. the device as described in claim 6-9 any one, is characterized in that, also comprises:
Status processing module, for judging whether described video encoder is in idle condition, if NO, sends unlock notification to described video acquisition device; If described in exit mark and be set up, the hardware resource of release busy.
11. 1 kinds of clients, is characterized in that, comprise video acquisition device, video encoder and video process apparatus;
Described video acquisition device generating video image, locks described video image, and after completing lock operation, sends lock notification to described video process apparatus;
The lock notification that described video process apparatus receiver, video harvester sends; Described lock notification is for representing that described video acquisition device completes the lock operation to the video image generated;
Described video process apparatus judges whether video encoder is in idle condition, if yes, described video image is converted to the copy of preset format;
After format conversion operation completes, described video process apparatus sends unlock notification to described video acquisition device, and described unlock notification is used to indicate the locking of described video acquisition device releasing to described video image;
After described video acquisition device receives described unlock notification, remove the locking to described video image;
The copy of described preset format is sent to described video encoder by described video process apparatus;
Described video encoder carries out compressed encoding process to the copy of described preset format.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410714669.7A CN104394420B (en) | 2014-11-28 | 2014-11-28 | A kind of video process apparatus, method and terminal device |
| PCT/CN2014/095597 WO2016082285A1 (en) | 2014-11-28 | 2014-12-30 | Video processing apparatus and method and terminal device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410714669.7A CN104394420B (en) | 2014-11-28 | 2014-11-28 | A kind of video process apparatus, method and terminal device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104394420A true CN104394420A (en) | 2015-03-04 |
| CN104394420B CN104394420B (en) | 2017-09-12 |
Family
ID=52612248
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410714669.7A Active CN104394420B (en) | 2014-11-28 | 2014-11-28 | A kind of video process apparatus, method and terminal device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN104394420B (en) |
| WO (1) | WO2016082285A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104901820A (en) * | 2015-06-29 | 2015-09-09 | 广州华多网络科技有限公司 | System, device and method for speaking sequence control |
| CN106791895A (en) * | 2016-11-29 | 2017-05-31 | 北京小米移动软件有限公司 | Interactive approach and device in electric business application program |
| CN106846032A (en) * | 2016-11-24 | 2017-06-13 | 北京小米移动软件有限公司 | Interactive approach, apparatus and system in electric business application program |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003060954A (en) * | 2001-08-16 | 2003-02-28 | Fuji Photo Film Co Ltd | Digital camera |
| US20070212018A1 (en) * | 2006-02-20 | 2007-09-13 | Takahiro Kimura | Broadcast recording apparatus and broadcast recording method |
| CN101076106A (en) * | 2006-05-19 | 2007-11-21 | 孟智平 | Interdynamic video system of IPTV two-dimensional frame marked information |
| CN103024510A (en) * | 2012-12-17 | 2013-04-03 | 四川长虹电器股份有限公司 | Method capturing intelligent television pictures |
| CN104053014A (en) * | 2013-03-13 | 2014-09-17 | 腾讯科技（北京）有限公司 | Live broadcast system and method based on mobile terminal, and mobile terminal |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090273686A1 (en) * | 2008-05-02 | 2009-11-05 | Nokia Corporation | Methods, computer program products and apparatus providing improved image capturing |
| CN101977322A (en) * | 2010-11-10 | 2011-02-16 | 上海交通大学 | Screen coding system based on universal video coding standard |
-
2014
- 2014-11-28 CN CN201410714669.7A patent/CN104394420B/en active Active
- 2014-12-30 WO PCT/CN2014/095597 patent/WO2016082285A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003060954A (en) * | 2001-08-16 | 2003-02-28 | Fuji Photo Film Co Ltd | Digital camera |
| US20070212018A1 (en) * | 2006-02-20 | 2007-09-13 | Takahiro Kimura | Broadcast recording apparatus and broadcast recording method |
| CN101076106A (en) * | 2006-05-19 | 2007-11-21 | 孟智平 | Interdynamic video system of IPTV two-dimensional frame marked information |
| CN103024510A (en) * | 2012-12-17 | 2013-04-03 | 四川长虹电器股份有限公司 | Method capturing intelligent television pictures |
| CN104053014A (en) * | 2013-03-13 | 2014-09-17 | 腾讯科技（北京）有限公司 | Live broadcast system and method based on mobile terminal, and mobile terminal |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104901820A (en) * | 2015-06-29 | 2015-09-09 | 广州华多网络科技有限公司 | System, device and method for speaking sequence control |
| CN104901820B (en) * | 2015-06-29 | 2018-11-23 | 广州华多网络科技有限公司 | A kind of wheat sequence controlling method, device and system |
| CN106846032A (en) * | 2016-11-24 | 2017-06-13 | 北京小米移动软件有限公司 | Interactive approach, apparatus and system in electric business application program |
| US11227328B2 (en) | 2016-11-24 | 2022-01-18 | Beijing Xiaomi Mobile Software Co., Ltd. | Interactive method and device for e-commerce application program |
| CN106791895A (en) * | 2016-11-29 | 2017-05-31 | 北京小米移动软件有限公司 | Interactive approach and device in electric business application program |
| CN106791895B (en) * | 2016-11-29 | 2020-07-03 | 北京小米移动软件有限公司 | Interaction method and device in E-commerce application program |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2016082285A1 (en) | 2016-06-02 |
| CN104394420B (en) | 2017-09-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20130052993A1 (en) | Apparatus and method for managing application in wireless terminal | |
| CN102364945B (en) | Multi-picture image decoding display method and video monitoring terminal | |
| CN104012106A (en) | Aligning videos representing different viewpoints | |
| CN105379261A (en) | Server node arrangement and method | |
| CN112770059B (en) | Photographing method and device and electronic equipment | |
| JP2018129790A (en) | Method and system for playing recorded video | |
| CN110300322B (en) | Screen recording method, client and terminal equipment | |
| CN113225585A (en) | Video definition switching method and device, electronic equipment and storage medium | |
| WO2019041227A1 (en) | Onboard vehicle safety monitoring method, system, and terminal device | |
| CN104394420A (en) | Video processing device and method and terminal device | |
| WO2021196994A1 (en) | Encoding method and apparatus, terminal, and storage medium | |
| CN112764853A (en) | Screen projection method, equipment and system | |
| CN110740346A (en) | Video data processing method, device, server, terminal and storage medium | |
| CN111277800A (en) | Monitoring video coding and playing method and device, electronic equipment and storage medium | |
| CN112235600B (en) | Method, device and system for processing video data and video service request | |
| CN109299048A (en) | The method for handling data and issuing data | |
| CN111131777B (en) | Viewing method and device for video network monitoring | |
| JP6719932B2 (en) | Information setting device, information management device, information generating device, control method thereof, and program | |
| JP5310427B2 (en) | Communication terminal device, communication control method, and communication control program, | |
| CN110798700B (en) | Video processing method, video processing device, storage medium and electronic equipment | |
| CA2627064C (en) | Multiplexing video using a dsp | |
| CN107480437B (en) | Data transmission method and device | |
| US20170019643A1 (en) | Imaging apparatus and imaging system | |
| CN113141480A (en) | Screen recording method, device, equipment and storage medium | |
| JP2007324722A (en) | Moving picture data distribution apparatus and moving picture data communication system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 510000, Guangdong Province, Guangzhou, Panyu District Town, Huambo business district, Wanda Plaza, block B1, 28 floor Applicant after: Guangzhou Huaduo Network Technology Co., Ltd. Address before: 510655, Guangzhou, Whampoa Avenue, No. 2, creative industrial park, building 3-08, Applicant before: Guangzhou Huaduo Network Technology Co., Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20150304 Assignee: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd. Assignor: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd. Contract record no.: X2021980000101 Denomination of invention: A video processing device, method and terminal device Granted publication date: 20170912 License type: Common License Record date: 20210106 |
|
| EE01 | Entry into force of recordation of patent licensing contract |