CN105635774A - Image processing method and device - Google Patents

Image processing method and device Download PDF

Info

Publication number
CN105635774A
CN105635774A CN201510994009.3A CN201510994009A CN105635774A CN 105635774 A CN105635774 A CN 105635774A CN 201510994009 A CN201510994009 A CN 201510994009A CN 105635774 A CN105635774 A CN 105635774A
Authority
CN
China
Prior art keywords
described
video data
interconnecting application
data stream
application
Prior art date
Application number
CN201510994009.3A
Other languages
Chinese (zh)
Inventor
陈聪
宋晔
Original Assignee
百度在线网络技术(北京)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 百度在线网络技术(北京)有限公司 filed Critical 百度在线网络技术(北京)有限公司
Priority to CN201510994009.3A priority Critical patent/CN105635774A/en
Publication of CN105635774A publication Critical patent/CN105635774A/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41422Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance located in transportation means, e.g. personal vehicle
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network, synchronizing decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or inside the home ; Interfacing an external card to be used in combination with the client device
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network, synchronizing decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network, synchronizing decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/8547Content authoring involving timestamps for synchronizing content

Abstract

The invention provides an image processing method and device. Projection image data displayed in the projectable area of a display device of second terminal equipment connected with first terminal equipment in which an interconnecting application is installed are acquired and then video coding processing is performed on the projection image data so that a projection video data stream can be acquired, the projection video data stream can be transmitted to the interconnecting application and thus the interconnecting application is enabled to output the projection video data stream. Real-time content displayed on the display device of the terminal equipment in which a coordination application is installed is projected to the interconnecting application to be outputted so that the interconnecting application is enabled not to independently output related service content. Therefore, the interconnecting application is developed by aiming at the simple service realized by the interconnecting application, i.e. the content output service, and the interconnecting application does not need to be developed by aiming at the complex service content realized by the coordination application so that development time of the interconnecting application can be effectively reduced and development efficiency of the application can be enhanced.

Description

Image processing method and device

[technical field]

The present invention relates to the communication technology, particularly relate to a kind of image processing method and device.

[background technology]

Along with the development of the communication technology, terminating unit is integrated with more and more functions, so that contain more and more corresponding application (Application, APP) in the system function list of terminating unit. The application installed on some terminating unit, the present invention is called interconnecting application, need could normal to use by another terminating unit connected is installed a relevant fit applications, otherwise without any use value, particularly for some car machine interconnecting applications. Usually, two relevant application and interconnecting application can independently export its relevant service content separately to fit applications, user can by operating in interconnecting application, thus realization operates the fit applications on another terminating unit being connected with its place terminating unit, with the service using fit applications to provide.

But, owing to two relevant application and interconnecting application independently export its relevant service content separately to fit applications, make the service content needing to realize for fit applications, independently develop each application in two relevant application, thus result in the reduction of the development efficiency of application.

[summary of the invention]

The many aspects of the present invention provide a kind of image processing method and device, in order to improve the development efficiency of application.

An aspect of of the present present invention, it is provided that a kind of image processing method, comprising:

Obtaining in the display unit of the 2nd terminating unit that interconnecting application place first terminal equipment connects can projects images data shown by projected area;

To described projects images data, carry out video coding process, to obtain project video data stream;

Send project video data stream to described interconnecting application, export described project video data stream for described interconnecting application.

Aspect as above and arbitrary possible implementation, it is further provided a kind of implementation, described project video data stream comprises:

Video data frame with at least one in DTS and PTS; Or

The not video data frame of band DTS and PTS; Or

The video data transmitted are carried out based on RTP.

Aspect as above and arbitrary possible implementation, it is further provided a kind of implementation, described after described interconnecting application transmission project video data flow method, also comprise:

Described interconnecting application utilizes at least one assembly, described project video data stream is processed, to export described project video data stream.

Aspect as above and arbitrary possible implementation, it is further provided a kind of implementation, at least one assembly described comprises video source assembly, video filtering assembly, hard decoder assembly and video frequency output assembly.

Aspect as above and arbitrary possible implementation, it is further provided a kind of implementation,

Described first terminal equipment is vehicle-mounted terminating unit;

Described 2nd terminating unit is user terminal equipment.

Aspect as above and arbitrary possible implementation, it is further provided a kind of implementation, the operating system of described vehicle-mounted terminating unit is (SuSE) Linux OS, WinCE operating system, QNX operating system or Android operation system.

The another aspect of the present invention, it is provided that a kind of image processing apparatus, comprising:

Acquiring unit, can projects images data shown by projected area in the display unit obtaining the 2nd terminating unit that interconnecting application place first terminal equipment connects;

Coding unit, for described projects images data, carrying out video coding process, to obtain project video data stream;

Send unit, for sending project video data stream to described interconnecting application, export described project video data stream for described interconnecting application.

Aspect as above and arbitrary possible implementation, it is further provided a kind of implementation, described project video data stream comprises:

Video data frame with at least one in DTS and PTS; Or

The not video data frame of band DTS and PTS; Or

The video data transmitted are carried out based on RTP.

Aspect as above and arbitrary possible implementation, it is further provided a kind of implementation,

Described first terminal equipment is vehicle-mounted terminating unit;

Described 2nd terminating unit is user terminal equipment.

Aspect as above and arbitrary possible implementation, it is further provided a kind of implementation, the operating system of described vehicle-mounted terminating unit is (SuSE) Linux OS, WinCE operating system, QNX operating system or Android operation system.

From described technical scheme, the embodiment of the present invention can projects images data shown by projected area by obtaining in the display unit of the 2nd terminating unit that interconnecting application place first terminal equipment connects, and then to described projects images data, carry out video coding process, to obtain project video data stream, make it possible to send project video data stream to described interconnecting application, described project video data stream is exported for described interconnecting application, owing to exporting by the real time content shown by the display unit of fit applications place terminating unit is projected in interconnecting application, interconnecting application is made no longer independently to export its relevant service content, therefore, the simple services realized for interconnecting application and content is only needed to export service, develop this interconnecting application, without the need to the complex services content realized for fit applications, develop this interconnecting application, can effectively reduce the development time of interconnecting application, thus improve the development efficiency of application.

In addition, adopt technical scheme provided by the present invention, can raw image data shown by projected area by obtaining in the display unit of the 2nd terminating unit that interconnecting application place first terminal equipment connects, and then change parameter according to pre-set image, described raw image data is carried out image conversion process, to obtain projects images data, make it possible to described projects images data are stored as specific data form, for the projects images data to described specific data form, carry out video coding process, to obtain project video data flow to described interconnecting application, without the need to artificial participation, simple to operate, and accuracy height, thus improve efficiency and the reliability of image procossing.

In addition, adopting technical scheme provided by the present invention, once obtain raw image data, namely can automatically obtain the projects images data required for video coding process, the efficiency of image procossing can be effectively improved, and the level of automation of image procossing can be effectively improved.

[accompanying drawing explanation]

In order to the technical scheme being illustrated more clearly in the embodiment of the present invention, it is briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.

The schematic flow sheet of the image processing method that Fig. 1 provides for one embodiment of the invention;

The structural representation of the image processing apparatus that Fig. 2 provides for another embodiment of the present invention.

[embodiment]

For making the object of the embodiment of the present invention, technical scheme and advantage clearly, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is the present invention's part embodiment, instead of whole embodiments. Based on the embodiment in the present invention, those of ordinary skill in the art, not making other embodiments whole obtained under creative work prerequisite, belong to the scope of protection of the invention.

It should be noted that, user terminal equipment involved in the embodiment of the present invention can include but not limited to mobile phone, personal digital assistant (PersonalDigitalAssistant, PDA), radio hand-held equipment, panel computer (TabletComputer), PC (PersonalComputer, such as, PC), MP3 player, MP4 player, wearable device (intelligent glasses, intelligent watch, Intelligent bracelet etc.) etc. Vehicle-mounted terminating unit involved in the embodiment of the present invention, car machine can also be called, the abbreviation being mounted in the on-vehicle information amusing products inside automobile referred to, car machine is functionally wanted to realize people and car, the information communication of car and extraneous (car and car). The operating system of described vehicle-mounted terminating unit can be but be not limited to (SuSE) Linux OS, WinCE operating system, QNX operating system or Android operation system, and this is not particularly limited by the present embodiment.

In addition, term "and/or" herein is only a kind of association relation describing affiliated partner, and expression can exist three kinds of relations, such as, A and/or B, it is possible to represent: Individual existence A, exists A and B simultaneously, these three kinds of situations of Individual existence B. In addition, character "/" herein, general expression forward-backward correlation is to the relation liking a kind of "or".

The schematic flow sheet of the image processing method that Fig. 1 provides for one embodiment of the invention, as shown in Figure 1.

101, obtaining in the display unit of the 2nd terminating unit that interconnecting application place first terminal equipment connects can projects images data shown by projected area.

In the present invention, first terminal equipment is connected through but not limited to bluetooth with the 2nd terminating unit, general serial bus (UniversalSerialBus, USB) connect and Wireless Fidelity (WirelessFidelity, WI-FI) at least one item in connecting connects, and this is not particularly limited by the present embodiment.

102, to described projects images data, video coding process is carried out, to obtain project video data stream.

103, send project video data stream to described interconnecting application, export described project video data stream for described interconnecting application.

It should be noted that, the executive agent of 101��103 can for being positioned at the fit applications corresponding to the application of the 2nd terminating unit and interconnecting application, or the plug-in unit of the application that can also be arranged in the 2nd terminating unit for being arranged on (namely fit applications) corresponding to interconnecting application or Software development tool kit (SoftwareDevelopmentKit, the functional unit such as SDK), this is not particularly limited by the present embodiment.

It is understandable that, described application can be mounted in the local program (nativeApp) on the 2nd terminating unit, or can also being a web page program (webApp) of the browser on the 2nd terminating unit, this be particularly limited by the present embodiment.

Like this, can projects images data shown by projected area by obtaining in the display unit of the 2nd terminating unit that interconnecting application place first terminal equipment connects, and then to described projects images data, carry out video coding process, to obtain project video data stream, make it possible to send project video data stream to described interconnecting application, described project video data stream is exported for described interconnecting application, owing to exporting by the real time content shown by the display unit of fit applications place terminating unit is projected in interconnecting application, interconnecting application is made no longer independently to export its relevant service content, therefore, the simple services realized for interconnecting application and content is only needed to export service, develop this interconnecting application, without the need to the complex services content realized for fit applications, develop this interconnecting application, can effectively reduce the development time of interconnecting application, thus improve the development efficiency of application.

Can selection of land, in one of the present embodiment possible implementation, described first terminal equipment be preferably vehicle-mounted terminating unit; Described 2nd terminating unit is preferably user terminal equipment.

Conversely, described first terminal equipment can also be user terminal equipment; Described 2nd terminating unit can also be vehicle-mounted terminating unit. But, in actual applications, the application installed on user terminal equipment can perform separately, it is not necessary to relying on another terminating unit connected could normally use, or relies on installation normal use of corresponding fit applications ability on another terminating unit connected.

In the present invention, after the equipment connection completed between first terminal equipment and the 2nd terminating unit is set up, based on the equipment connection set up, in addition it is also necessary to set up the interconnecting application on first terminal equipment and the communication connection between the fit applications on the 2nd terminating unit further. Like this, user just can pass through interconnecting application, cooperation application or fit applications place the 2nd terminating unit.

It should be appreciated that described communication connection can include but not limited at least one item in bluetooth connection, USB connection and WI-FI connection, this is not particularly limited by the present embodiment.

Specifically, specifically by the interconnecting application on first terminal equipment and the communication connection between the fit applications on the 2nd terminating unit, project video data stream can be sent to described interconnecting application, exports described project video data stream for described interconnecting application.

Can selection of land, in one of the present embodiment possible implementation, in 101, specifically the interface shown by the display unit of described 2nd terminating unit can be carried out image interception process, to obtain raw image data. And then, then can according to operator according to Image Processing parameter set by the brand of the terminating unit at fit applications place and model, raw image data is carried out a series of conversion process, the projects images data that can process to obtain the video coding hardware of fit applications place the 2nd terminating unit. Like this, then the projects images data obtained can be carried out video coding process, to obtain video data stream, be sent to described interconnecting application and export.

But, owing to the type of the 2nd terminating unit at fit applications place is various, adopt manual operation to arrange different Image Processing parameter according to often kind of the 2nd terminating unit one by one, complicated operation can be made, and easily make mistakes, thus result in the efficiency of image procossing and the reduction of reliability. In order to address this problem, it is proposed that the implementation that another one is possible.

In the implementation that this is possible, specifically can obtain in the display unit of the 2nd terminating unit that interconnecting application place first terminal equipment connects can raw image data shown by projected area, and then, then can change parameter according to pre-set image, described raw image data is carried out image conversion process, to obtain projects images data. Then, then described projects images data can be stored as specific data form, for the projects images data to described specific data form, carry out video coding process, to obtain project video data flow to described interconnecting application.

In this implementation, it is also possible to obtain the dimensional data of the display unit of described 2nd terminating unit further, and then, then can according to the dimensional data of described display unit, acquisition is described can projected area.

Concrete realize in process at one, specifically can according to the dimensional data of display unit, such as, 720 pixels (width) �� 1280 pixel (height), by whole display areas of display unit, as described can projected area and starting point be (0,0), wide is 720 pixels, and height is the rectangular area of 1280 pixels.

Concrete realize in process at another, specifically can obtain the virtual key of described 2nd terminating unit and/or status bar position data on said display means, such as, carry out perpendicular screen display when showing, virtual key is in the downside of the display area of display unit, and status bar is in the upside of the display area of display unit; Carry out horizontal screen display when showing, virtual key is on the right side of the display area of display unit, status bar generally will not show, and then, then can according to the dimensional data of described display unit and described virtual key and/or status bar position data on said display means, by other display areas except virtual key and/or display area, status bar place in whole display areas of display unit, as described can projected area.

In this implementation, the described image transform parameter adopted, it is possible to include but not limited at least one item in following parameters:

Image zooming parameter;

Image cutting-out parameter; And

Image upset parameter.

Concrete realize in process at one, if described can projected area be display unit whole display areas in other display areas except virtual key and/or display area, status bar place, specifically can according to described can the dimensional data of projected area, and the pre-set dimension data consistent or close with the dimensional data of the display unit of first terminal equipment, directly determine image zooming parameter i.e. horizontal scaling and longitudinal scaling. Utilize this image zooming parameter, then can be pre-set dimension by the size conversion of the raw image data obtained.

Specifically, it is possible to pre-set some groups of pre-set dimension data i.e. wide high-parameters pair, according to the dimensional data of the display unit of first terminal equipment, select the one group of pre-set dimension data meeting conversion requirements, perform aforesaid operations.

Concrete realize in process at another, can projected area be whole display areas of display unit if described, specifically can according to described can the dimensional data of projected area, and the pre-set dimension data of dimensional data of the display unit less times greater than first terminal equipment, it is determined that image zooming parameter i.e. horizontal scaling and longitudinal scaling. Then according to the virtual key of pre-set dimension data and the 2nd terminating unit and/or status bar position data on said display means, obtain image cutting-out parameter then. Utilize this image cutting-out parameter, then can by image data extraction except the image of virtual key and/or status bar region in the view data after putting process through contracting out.

Specifically, it is possible to pre-set some groups of pre-set dimension data i.e. wide high-parameters pair, according to the dimensional data of the display unit of first terminal equipment, select the one group of pre-set dimension data meeting conversion requirements, perform aforesaid operations.

Concrete realize in process at another, according to the transverse and longitudinal of the raw image data obtained ratio, and the transverse and longitudinal ratio of the display unit of first terminal equipment, obtain image upset parameter. Such as, transverse and longitudinal ratio according to the raw image data obtained, determine that the raw image data obtained is perpendicular screen image data, the transverse and longitudinal ratio of the display unit according to first terminal equipment, determine that first terminal equipment is horizontal screen display device, therefore, then can obtain using specified point as rotation center, turn clockwise 270 �� image upset parameter. Utilize this image upset parameter, then can overturn through the view data after putting process that contracts, so that the starting point of the view data after the starting point and upset of the view data after putting process that contracts overlaps.

In this implementation, the hardware information of the video coding hardware of described 2nd terminating unit can also be obtained further, and then, then can according to the hardware information of described video coding hardware, it is determined that the described specific data form corresponding to described video coding hardware.

The hardware information of so-called video coding hardware, the base attribute such as data layout referring to the hardware names of video coding hardware, hardware type, pending view data. Hardware information according to described video coding hardware, then can determine the data layout of the pending view data that described video coding hardware is required when performing video coding and process, it is possible to using this data layout as described specific data form.

Concrete realize in process at one, specifically directly described projects images data can be stored as specific data form, such as, RGB_565, wherein, R represents red component, G green component, B blue component, respectively with 5,6 and 5 records rgb value, i.e. R=5, G=6, B=5, so, a pixel accounts for 5+6+5=16 position.

Such as, the storage form of the view data obtaining the interface shown by its display unit due to different terminal equipment is different, therefore, it is possible to obtain the view data of the arbitrary interface shown by display unit of the 2nd terminating unit in advance, according to this view data, it is determined that it stores form. If this storage form is described specific data form, so, then by follow-up obtained projects images data, stores processor can directly be carried out; If this storage form is not described specific data form, so, then by the projects images data of follow-up this obtained storage form, can first be converted to the projects images data of described specific data form, then carry out stores processor. Wherein, concrete transformation rule, it is possible to adopt the transformation rule provided in prior art, or the transformation rule that the present invention can also be adopted self-defined, this is not particularly limited by the present embodiment.

Concrete realize in process at another, specifically described projects images data can be stored as preset data form, such as, ARGB_8888, wherein, A represents transparency component, R represents red component, G green component, B blue component, ARGB value, i.e. A=8, R=8 is recorded respectively with 8, G=8, B=8, so, a pixel accounts for 8+8+8+8=32 position.

Such as, the storage form of the view data obtaining the interface shown by its display unit due to different terminal equipment is different, therefore, it is possible to obtain the view data of the arbitrary interface shown by display unit of the 2nd terminating unit in advance, according to this view data, it is determined that it stores form. If this storage form is described preset data form, so, then by follow-up obtained projects images data, stores processor can directly be carried out; If this storage form is not described preset data form, so, then by the projects images data of follow-up this obtained storage form, can first be converted to the projects images data of described preset data form, then carry out stores processor. Wherein, concrete transformation rule, it is possible to adopt the transformation rule provided in prior art, or the transformation rule that the present invention can also be adopted self-defined, this is not particularly limited by the present embodiment.

And then, then the projects images data of described preset data form can be stored as described specific data form. Specifically, it is possible to by the projects images data of described preset data form, be first converted to the projects images data of described specific data form, then carry out stores processor. Wherein, concrete transformation rule, it is possible to adopt the transformation rule provided in prior art, or the transformation rule that the present invention can also be adopted self-defined, this is not particularly limited by the present embodiment.

Like this, can raw image data shown by projected area by obtaining in the display unit of the 2nd terminating unit that interconnecting application place first terminal equipment connects, and then change parameter according to pre-set image, described raw image data is carried out image conversion process, to obtain projects images data, make it possible to described projects images data are stored as specific data form, for the projects images data to described specific data form, carry out video coding process, to obtain project video data flow to described interconnecting application, without the need to artificial participation, simple to operate, and accuracy height, thus improve efficiency and the reliability of image procossing.

Can selection of land, in one of the present embodiment possible implementation, the described project video data stream obtained, it is possible to include but not limited to:

The video data frame of at least one in band decode time label (DecodeTimeStamp, DTS) and displaying time label (PresentationTimeStamp, PTS); Or

The not video data frame of band DTS and PTS; Or

The video data transmitted are carried out based on real-time Transmission agreement (Real-timeTransportProtocol, RTP).

Wherein, when the project video data stream that DTS reads in internal memory for identifying starts to send in demoder and decodes; PTS is for measuring when decoded frame of video is revealed.

In this implementation, if the described project video data stream obtained is the video data frame of not band DTS and PTS, so, interconnecting application is after receiving described project video data, then can carry out in real time decoding and showing such that it is able to effectively improve the real-time of image procossing.

Can selection of land, in one of the present embodiment possible implementation, after 103, described interconnecting application can also utilize at least one assembly, described project video data stream is processed, to export described project video data stream.

Specifically, at least one assembly described can include but not limited to video source assembly, video filtering assembly, hard decoder assembly and video frequency output assembly, and this is not particularly limited by the present embodiment.

Video source assembly, for receiving in described project video data the frame of video comprised, and adjusts the transmission speed of frame of video, to ensure that the frame of video number transmitted for every second meets the condition pre-set.

Video filtering assembly, the frame of video exported by video source assembly carries out filtration treatment.

Hard decoder assembly, to the frame of video that video filtering assembly exports, carries out decoding process.

Video frequency output assembly, the frame of video after the decoding export hard decoder assembly, plays.

In the present embodiment, can projects images data shown by projected area by obtaining in the display unit of the 2nd terminating unit that interconnecting application place first terminal equipment connects, and then to described projects images data, carry out video coding process, to obtain project video data stream, make it possible to send project video data stream to described interconnecting application, described project video data stream is exported for described interconnecting application, owing to exporting by the real time content shown by the display unit of fit applications place terminating unit is projected in interconnecting application, interconnecting application is made no longer independently to export its relevant service content, therefore, the simple services realized for interconnecting application and content is only needed to export service, develop this interconnecting application, without the need to the complex services content realized for fit applications, develop this interconnecting application, can effectively reduce the development time of interconnecting application, thus improve the development efficiency of application.

In addition, adopt technical scheme provided by the present invention, can raw image data shown by projected area by obtaining in the display unit of the 2nd terminating unit that interconnecting application place first terminal equipment connects, and then change parameter according to pre-set image, described raw image data is carried out image conversion process, to obtain projects images data, make it possible to described projects images data are stored as specific data form, for the projects images data to described specific data form, carry out video coding process, to obtain project video data flow to described interconnecting application, without the need to artificial participation, simple to operate, and accuracy height, thus improve efficiency and the reliability of image procossing.

In addition, adopting technical scheme provided by the present invention, once obtain raw image data, namely can automatically obtain the projects images data required for video coding process, the efficiency of image procossing can be effectively improved, and the level of automation of image procossing can be effectively improved.

It should be noted that, for aforesaid each embodiment of the method, in order to simple description, therefore it is all expressed as a series of combination of actions, but those skilled in the art should know, the present invention is not by the restriction of described sequence of operation, because according to the present invention, some step can adopt other orders or carry out simultaneously. Secondly, those skilled in the art also should know, the embodiment described in specification sheets all belongs to preferred embodiment, and involved action and module might not be that the present invention is necessary.

In the described embodiment, the description of each embodiment is all emphasized particularly on different fields, certain embodiment there is no the part described in detail, it is possible to see the associated description of other embodiments.

The structural representation of the image processing apparatus that Fig. 2 provides for another embodiment of the present invention, as shown in Figure 2. The image processing apparatus of the present embodiment can comprise acquiring unit 21, coding unit 22 and send unit 23. Wherein, acquiring unit 21, can projects images data shown by projected area in the display unit obtaining the 2nd terminating unit that interconnecting application place first terminal equipment connects; Coding unit 22, for described projects images data, carrying out video coding process, to obtain project video data stream; Send unit 23, for sending project video data stream to described interconnecting application, export described project video data stream for described interconnecting application.

It should be noted that, the image processing apparatus of the present embodiment can for being positioned at the fit applications corresponding to the application of the 2nd terminating unit and interconnecting application, or the plug-in unit of the application that can also be arranged in the 2nd terminating unit for being arranged on (namely fit applications) corresponding to interconnecting application or Software development tool kit (SoftwareDevelopmentKit, the functional unit such as SDK), this is not particularly limited by the present embodiment.

It is understandable that, described application can be mounted in the local program (nativeApp) on the 2nd terminating unit, or can also being a web page program (webApp) of the browser on the 2nd terminating unit, this be particularly limited by the present embodiment.

Can selection of land, in one of the present embodiment possible implementation, described first terminal equipment be preferably vehicle-mounted terminating unit; Described 2nd terminating unit is preferably user terminal equipment.

Conversely, described first terminal equipment can also be user terminal equipment; Described 2nd terminating unit can also be vehicle-mounted terminating unit. But, in actual applications, the application installed on user terminal equipment can perform separately, it is not necessary to relying on another terminating unit connected could normally use, or relies on installation normal use of corresponding fit applications ability on another terminating unit connected.

Can selection of land, in one of the present embodiment possible implementation, the described project video data stream that described coding unit 22 obtains, it is possible to include but not limited to:

The video data frame of at least one in band decode time label (DecodeTimeStamp, DTS) and displaying time label (PresentationTimeStamp, PTS); Or

The not video data frame of band DTS and PTS; Or

The video data transmitted are carried out based on real-time Transmission agreement (Real-timeTransportProtocol, RTP).

It should be noted that, method in the embodiment that Fig. 1 is corresponding, it is possible to the image processing apparatus provided by the present embodiment realizes. Describe in detail see the associated viscera in embodiment corresponding to Fig. 1, can repeat no more herein.

In the present embodiment, being obtained by acquiring unit in the display unit of the 2nd terminating unit that interconnecting application place first terminal equipment connects can projects images data shown by projected area, and then by coding unit to described projects images data, carry out video coding process, to obtain project video data stream, make to send unit and can send project video data stream to described interconnecting application, described project video data stream is exported for described interconnecting application, owing to exporting by the real time content shown by the display unit of fit applications place terminating unit is projected in interconnecting application, interconnecting application is made no longer independently to export its relevant service content, therefore, the simple services realized for interconnecting application and content is only needed to export service, develop this interconnecting application, without the need to the complex services content realized for fit applications, develop this interconnecting application, can effectively reduce the development time of interconnecting application, thus improve the development efficiency of application.

In addition, adopt technical scheme provided by the present invention, can raw image data shown by projected area by obtaining in the display unit of the 2nd terminating unit that interconnecting application place first terminal equipment connects, and then change parameter according to pre-set image, described raw image data is carried out image conversion process, to obtain projects images data, make it possible to described projects images data are stored as specific data form, for the projects images data to described specific data form, carry out video coding process, to obtain project video data flow to described interconnecting application, without the need to artificial participation, simple to operate, and accuracy height, thus improve efficiency and the reliability of image procossing.

In addition, adopting technical scheme provided by the present invention, once obtain raw image data, namely can automatically obtain the projects images data required for video coding process, the efficiency of image procossing can be effectively improved, and the level of automation of image procossing can be effectively improved.

The technician of art can be well understood to, for convenience and simplicity of description, and the concrete working process of the system of described description, device and unit, it is possible to reference to the corresponding process in aforementioned embodiment of the method, do not repeat them here.

In provided by the present invention several embodiments, it should be appreciated that, disclosed system, device and method, it is possible to realize by another way. Such as, device embodiment described above is only schematic, such as, the division of described unit, being only a kind of logic function to divide, actual can have other dividing mode when realizing, such as multiple unit or assembly can in conjunction with or another system can be integrated into, or some features can ignore, or do not perform. Another point, shown or discussed coupling each other or directly coupling or communication connection can be the indirect coupling by some interfaces, device or unit or communication connection, it is possible to be electrical, machinery or other form.

The described unit illustrated as separating component or can may not be and physically separates, and the parts as unit display can be or may not be physical location, namely can be positioned at a place, or can also be distributed on multiple NE. Some or all of unit wherein can be selected according to the actual needs to realize the object of the present embodiment scheme.

In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, it is also possible to is that the independent physics of each unit exists, it is also possible to two or more unit are in a unit integrated. Described integrated unit both can adopt the form of hardware to realize, it is also possible to the form adopting hardware to add software functional unit realizes.

The described integrated unit realized with the form of software functional unit, it is possible to be stored in a computer read/write memory medium. Described software functional unit is stored in a storage media, comprise some instructions with so that a computer device (can be Personal Computer, audio frequency processing engine, or network equipment etc.) or treater (processor) perform the part steps of method described in each embodiment of the present invention. And aforesaid storage media comprises: USB flash disk, portable hard drive, read-only storage (Read-OnlyMemory, ROM), random access memory (RandomAccessMemory, RAM), magnetic disc or CD etc. various can be program code stored medium.

Last it is noted that above embodiment is only in order to illustrate the technical scheme of the present invention, it is not intended to limit; Although with reference to previous embodiment to invention has been detailed description, it will be understood by those within the art that: the technical scheme described in foregoing embodiments still can be modified by it, or wherein part technology feature is carried out equivalent replacement; And these amendments or replacement, do not make the spirit and scope of the essence disengaging various embodiments of the present invention technical scheme of appropriate technical solution.

Claims (10)

1. an image processing method, it is characterised in that, comprising:
Obtaining in the display unit of the 2nd terminating unit that interconnecting application place first terminal equipment connects can projects images data shown by projected area;
To described projects images data, carry out video coding process, to obtain project video data stream;
Send project video data stream to described interconnecting application, export described project video data stream for described interconnecting application.
2. method according to claim 1, it is characterised in that, described project video data stream comprises:
Video data frame with at least one in DTS and PTS; Or
The not video data frame of band DTS and PTS; Or
The video data transmitted are carried out based on RTP.
3. method according to claim 1, it is characterised in that, described after described interconnecting application transmission project video data flow method, also comprise:
Described interconnecting application utilizes at least one assembly, described project video data stream is processed, to export described project video data stream.
4. method according to claim 1, it is characterised in that, at least one assembly described comprises video source assembly, video filtering assembly, hard decoder assembly and video frequency output assembly.
5. method according to Claims 1 to 4 any claim, it is characterised in that,
Described first terminal equipment is vehicle-mounted terminating unit;
Described 2nd terminating unit is user terminal equipment.
6. method according to claim 5, it is characterised in that, the operating system of described vehicle-mounted terminating unit is (SuSE) Linux OS, WinCE operating system, QNX operating system or Android operation system.
7. an image processing apparatus, it is characterised in that, comprising:
Acquiring unit, can projects images data shown by projected area in the display unit obtaining the 2nd terminating unit that interconnecting application place first terminal equipment connects;
Coding unit, for described projects images data, carrying out video coding process, to obtain project video data stream;
Send unit, for sending project video data stream to described interconnecting application, export described project video data stream for described interconnecting application.
8. device according to claim 7, it is characterised in that, described project video data stream comprises:
Video data frame with at least one in DTS and PTS; Or
The not video data frame of band DTS and PTS; Or
The video data transmitted are carried out based on RTP.
9. device according to claim 7 or 8, it is characterised in that,
Described first terminal equipment is vehicle-mounted terminating unit;
Described 2nd terminating unit is user terminal equipment.
10. device according to claim 9, it is characterised in that, the operating system of described vehicle-mounted terminating unit is (SuSE) Linux OS, WinCE operating system, QNX operating system or Android operation system.
CN201510994009.3A 2015-12-25 2015-12-25 Image processing method and device CN105635774A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510994009.3A CN105635774A (en) 2015-12-25 2015-12-25 Image processing method and device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510994009.3A CN105635774A (en) 2015-12-25 2015-12-25 Image processing method and device
PCT/CN2016/088100 WO2017107424A1 (en) 2015-12-25 2016-07-01 Method, device, equipment and non-volatile computer storage medium for processing images

Publications (1)

Publication Number Publication Date
CN105635774A true CN105635774A (en) 2016-06-01

Family

ID=56050198

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510994009.3A CN105635774A (en) 2015-12-25 2015-12-25 Image processing method and device

Country Status (2)

Country Link
CN (1) CN105635774A (en)
WO (1) WO2017107424A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130314302A1 (en) * 2012-05-25 2013-11-28 Samsung Electronics Co., Ltd. Multiple display method with multiple communication terminals, machine-readable storage medium and communication terminal
CN104156258A (en) * 2013-05-14 2014-11-19 腾讯科技(深圳)有限公司 Application program sharing operation method, related equipment and system
CN104980326A (en) * 2014-04-03 2015-10-14 联想移动通信软件(武汉)有限公司 Method and device for sharing application content between terminal equipment
CN105094732A (en) * 2015-06-29 2015-11-25 小米科技有限责任公司 Screen display method and apparatus

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070171979A1 (en) * 2004-02-20 2007-07-26 Onno Eerenberg Method of video decoding
CN101155299A (en) * 2006-09-29 2008-04-02 明基电通股份有限公司 Image data updating method and broadcasting system using the same
CN103197910B (en) * 2013-04-17 2016-06-22 东软集团股份有限公司 Image updating method and device
CN104333762B (en) * 2014-11-24 2017-10-10 成都瑞博慧窗信息技术有限公司 A kind of video encoding/decoding method
CN105611357A (en) * 2015-12-25 2016-05-25 百度在线网络技术(北京)有限公司 Image processing method and device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130314302A1 (en) * 2012-05-25 2013-11-28 Samsung Electronics Co., Ltd. Multiple display method with multiple communication terminals, machine-readable storage medium and communication terminal
CN104156258A (en) * 2013-05-14 2014-11-19 腾讯科技(深圳)有限公司 Application program sharing operation method, related equipment and system
CN104980326A (en) * 2014-04-03 2015-10-14 联想移动通信软件(武汉)有限公司 Method and device for sharing application content between terminal equipment
CN105094732A (en) * 2015-06-29 2015-11-25 小米科技有限责任公司 Screen display method and apparatus

Also Published As

Publication number Publication date
WO2017107424A1 (en) 2017-06-29

Similar Documents

Publication Publication Date Title
CN104239617B (en) Thermodynamic chart shows method and device
US9224246B2 (en) Method and apparatus for processing media file for augmented reality service
US7982733B2 (en) Rendering 3D video images on a stereo-enabled display
CN101854493B (en) Image receiving apparatus and memory medium
CN103035134B (en) Image touch and talk playing system and mage touch and talk playing method
CN105447898A (en) Method and device for displaying 2D application interface in virtual real device
CN104020968B (en) Control the method and device that shared screen is shown
CN101930337B (en) Method for processing on-screen display and associated embedded system
CN105550756A (en) Vehicle rapid damage determination method based on simulation of vehicle damages
KR100963236B1 (en) System and Method of augmented reality-based product viewer
KR101573655B1 (en) Method, system and recording medium for providing information using image code
US8033469B2 (en) Apparatus for performing multimedia-based data transmission and associated method
TW200516988A (en) Method and system to display media content data
EP2546723A2 (en) Adapter module for portable electronic device
CN205353936U (en) Data interaction system based on VR equipment
EP2975555A1 (en) Method and apparatus for displaying point of interest
CN105354003B (en) A kind of display methods interconnected based on mobile terminal and car-mounted terminal and device
CN104144470A (en) Bluetooth connection method and client side
CN101368991A (en) Electronic device test device and method thereof
CN103902220B (en) A kind of interface display method of mobile terminal and mobile terminal
CN103747293A (en) Television program-associated product recommending method and recommending device
CN104866542A (en) POI data verification method and device
TW200516436A (en) Information display system and information display method
TW200507628A (en) Method for displaying high resolution picture in mobile communication terminal, mobile communication terminal and system for converting picture file format therefor
TWI269589B (en) Apparatus and method for updating television firmware therefor

Legal Events

Date Code Title Description
PB01 Publication
C06 Publication
SE01 Entry into force of request for substantive examination
C10 Entry into substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160601

RJ01 Rejection of invention patent application after publication