WO2013023514A1

WO2013023514A1 - Image processing method, device and system

Info

Publication number: WO2013023514A1
Application number: PCT/CN2012/078941
Authority: WO
Inventors: 陈大庆; 郭晓岩; 骆晓亮; 文聪
Original assignee: 中国移动通信集团公司
Priority date: 2011-08-17
Filing date: 2012-07-20
Publication date: 2013-02-21
Also published as: CN102957875A

Abstract

Disclosed in the present invention are an image processing method, device and system. The method comprises: 1) receiving multiple image processing signals to be displayed; 2) stitching the received multiple image processing signals to form one route image display signals; 3) and intercepting the image processing signals from the image display signals. The image processing method, device and system in the present invention enable the contents of a mobile terminal and an external video screen to be displayed separately, thus ensuring that the mobile terminal with low configuration can realize the technical effect that different contents can be displayed in multiple screens. In the present invention, an image processor is set in the mobile terminal, therefore, the reconstruction and modification of the external video screen are avoid, and the adaptability is improved.

Description

Image processing method, device and system

The present invention relates to video display technology in the field of communications, and in particular to a method and apparatus for image processing. Background technique

WiMo (Wireless Mobile Multimedia Transmission Protocol) is a technology protocol that supports high-definition audio and video wireless transmission. It can realize multi-screen of mobile terminals and home TVs, projection devices and display devices through WiFi. Share interactions. WiMo technology establishes a bridge between mobile terminals such as mobile phones and large-screen display devices, and realizes the interaction between the mobile phone transmitting end and the large-screen receiving side device, and can transmit the operation action of the receiving side device to the transmitting end, for example, When the receiving device supports touch screen control, WiMo can send the operation signal of the touch screen back to the mobile phone for processing.

To ensure interoperability, reduce equipment costs, and fully reuse the existing WiFi infrastructure, the WiMo protocol multiplexes the WiFi Mac layer and below protocols on the underlying layer. The WiMo protocol mainly defines the technical standards of the network adaptation layer and the media codec layer. In the network adaptation layer, two-way transmission can be implemented between the sender and the receiver in order to implement control signaling. WiMo designs a dedicated signaling message. The format is transmitted.

In the WiMo usage scenario, the mobile phone is generally used as the transmitting end of the WiMo, and the television and its WiMo accessory device are used as the receiving end. Currently, mobile phones can be classified into two types: single screen display and dual screen or multi screen display depending on their hardware capabilities. For a mobile phone that only supports single-screen display, due to the hardware capability, only the display of the big screen content of the mobile phone and the WiMo receiving end side can be realized. The control command can only operate on the content of the same screen; only the dual screen display is supported. The mobile phone can realize the differentiated display of the mobile phone screen and the large screen content to support a richer business experience. Summary of the invention

The object of the present invention is to fail to implement a low-profile video transmitting end in the existing image processing technology. A method, device and system for image processing are proposed for the defects of different content image processing.

To achieve the above object, according to an aspect of the present invention, an image processing method is provided. The image processing method method according to the embodiment of the present invention includes:

1) receiving a plurality of image processing signals to be displayed;

2) splicing the received multi-path image processing signals into one image display signal;

3) Intercepting the multi-path image processing signal before splicing in the image display signal.

In the above technical solution, after the multiplexed image processing signals before splicing are intercepted, the multiplexed image processing signals are respectively displayed on multiple screens.

In the above technical solution, in step 2), the multi-channel image processing signals are stitched by means of image placement, and the image placement manner includes placing and spacing in sequence, including:

Decoding and converting the multi-path image processing signal into a bitmap file;

Creating a temporary storage area according to the display range of the image display signal;

Creating a temporary bitmap file of the image display signal in the temporary storage area;

The bitmap files of the multiplexed image processing signals are sequentially or intermittently drawn in the plane coordinate system of the temporary storage area, and merged to form a temporary bitmap file.

In the above technical solution, the method further includes:

If the sum of the resolution ranges of the multi-path image processing signals is smaller than the resolution range of the image display signals, the image processing signals are subjected to image stretching or background filling processing;

If the sum of the resolution ranges of the multiplexed image processing signals is larger than the resolution range of the image display signals, the image processing signals are subjected to image reduction processing.

To achieve the above object, according to another aspect of the present invention, an image processing method is provided. An image processing method according to an embodiment of the present invention includes:

1) the application processor receives multiple image processing signals to be displayed;

2) the application processor splices the received multi-path image processing signals into one image display signal;

3) The image processor intercepts the multiplexed image processing signals before splicing in the image display signal.

In the above technical solution, after the image processor intercepts the multiplexed image processing signals before splicing, the multiplexed image processing signals are respectively displayed on multiple screens.

In the above technical solution, the multiple screens are respectively disposed on the mobile terminal and the external display screen.

In the above technical solution, in step 2), the multi-channel image processing signal is placed through the image. The method is completed by splicing, and the placement manner includes placing and spacing in sequence, including:

In the above technical solution, the application processor is disposed in the mobile terminal.

In the above technical solution, the image processor is disposed in the mobile terminal.

In the above technical solution, the method further includes:

In the above technical solution, the method further includes: 4) the operating device of the mobile terminal transmits a signal for controlling the image display thereof to the mobile terminal and the external display screen through the application processor.

In the above technical solution, the method further includes: 5) the operating device of the external display screen transmits a signal for controlling the image display thereof to the mobile terminal and the external display screen through the application processor.

In order to achieve the above object, according to another aspect of the present invention, an image processing apparatus is provided. An image processing apparatus according to an embodiment of the present invention includes:

An application processor, configured to receive multiple image processing signals to be displayed, and splicing the received multi-path image processing signals into one image display signal;

And an image processor, configured to intercept the multi-path image processing signals before splicing in the image display signal, respectively, on the mobile terminal and the external display screen.

In the above technical solution, the application processor includes:

a decoding conversion module, configured to decode and convert the multi-path image processing signal into a bitmap file; a storage creation module, configured to create a temporary storage area according to a display range of the image display signal; and a bitmap creation module, configured to be created in the temporary storage area The temporary bitmap file of the image display signal; the drawing merge module is configured to sequentially or interval the bitmap files of the multi-path image processing signals in the plane coordinate system of the temporary storage area, and merge to form a temporary bitmap file. In the above technical solution, an application processor is disposed in the mobile terminal.

In the above technical solution, an image processor is disposed in the mobile terminal.

In the above technical solution, the application processor further includes:

a resolution comparison module, configured to compare a magnitude relationship between a sum of resolution ranges of the multi-path image processing signals and a resolution range of the image display signal;

The image processing module is configured to process the image processing signal according to the magnitude relationship between the sum of the resolution ranges of the multi-path image processing signals and the resolution range of the image display signal:

In the above technical solution, the device further includes:

a mobile operating device, disposed in the mobile terminal, for transmitting a signal for controlling display of the image to the mobile terminal and the external display screen;

The control processing module is disposed in the application processor, and is configured to receive a control signal of the mobile operating device, and perform control processing on the display content of the mobile terminal and the external display screen according to the control signal.

In the above technical solution, the device further includes:

An external operating device, disposed in the external display, for transmitting a signal for controlling the display of the image to the mobile terminal and the external display;

The control conversion module is disposed in the application processor, and is configured to receive coordinate information of the operation position on the external display screen sent by the external operation device, and convert the coordinate information into position coordinate information on the display screen of the mobile terminal;

The control processing module is further configured to receive a control signal of the external operating device and position coordinate information on the display screen of the mobile terminal sent by the control conversion module, and display the mobile terminal and the external display screen according to the control signal and the position coordinate information Content is controlled.

To achieve the above object, according to another aspect of the present invention, an image processing system is provided. An image processing system according to an embodiment of the present invention includes a mobile terminal and an external display screen, and the mobile terminal includes:

An application processor, configured to receive multiple image processing signals to be displayed, and receive the multi-path map Like processing signals into a single image display signal;

The image processor is configured to intercept the multi-path image processing signals before splicing in the image display signal and display them on the mobile terminal and the external display screen.

In the above technical solution, the application processor includes:

a decoding conversion module, configured to decode and convert the multi-path image processing signal into a bitmap file; a storage creation module, configured to create a temporary storage area according to a display range of the image display signal; and a bitmap creation module, configured to be created in the temporary storage area The temporary bitmap file of the image display signal; the drawing merge module is configured to sequentially or interval the bitmap files of the multi-path image processing signals in the plane coordinate system of the temporary storage area, and merge to form a temporary bitmap file.

In the above technical solution, the application processor further includes:

In the above technical solution, the system further includes:

The control conversion module is disposed in the application processor, and is configured to receive coordinate information of the operation position on the external display screen sent by the external operation device, and convert the coordinate information into position coordinate information on the display screen of the mobile terminal; The control processing module is further configured to receive a control signal of the external operating device and control coordinate information on the display screen of the mobile terminal sent by the conversion module, and perform display content on the mobile terminal and the external display according to the control signal and the position coordinate information. Control processing.

The image processing method, device and system of the embodiments of the present invention independently display the content of the mobile terminal and the external display screen respectively, thereby ensuring the technical effect that the low-configuration mobile terminal can realize multi-screen display of different contents; wherein, the image processing The device is disposed in the mobile terminal, which avoids the modification and modification of the external display screen, and improves the adaptability.

The method, device and system for image processing of the embodiment further comprise a mobile operation device and an external operation device, which realize separate control of the operation device on the mobile terminal and the external display screen, and better realize the mobile terminal and the external display. Independent display of different content on the screen.

Other features and advantages of the invention will be set forth in the description which follows, The objectives and other advantages of the invention will be realized and attained by the <RTI

The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. DRAWINGS

The drawings are intended to provide a further understanding of the invention, and are intended to be a part of the description of the invention. In the drawings: FIG. 1 is a flowchart of an image processing method according to an embodiment of the present invention;

2 is a schematic diagram of splicing two image processing signals into one image display signal according to an embodiment of the present invention;

3 is a flow chart of an image processing method according to an embodiment of the present invention;

4 is a schematic diagram of splicing two image processing signals into one image display signal according to Embodiment 2 of the method of the present invention;

5 is a schematic diagram showing a display area of a television display screen according to Embodiment 2 of the present invention; and FIG. 6 is a schematic structural diagram of an image processing system according to an embodiment of the present invention. detailed description The preferred embodiments of the present invention are described in the following with reference to the accompanying drawings, which are intended to illustrate and illustrate the invention.

Method embodiment

According to an embodiment of the present invention, an image processing method is provided, including an LCD display of a mobile terminal (such as a mobile phone) and a plurality of large-screen display devices, such as a television, a computer display, a projector, a large-screen display wall, and the like. .

1 is a flow chart of an image processing method according to a first embodiment of the present invention. The embodiment includes a mobile phone and a television set. The mobile phone is provided with an LCD display. As shown in FIG. 1, the embodiment includes: Step S102: In order to realize image processing signals independently displayed on the LCD display screen and the television display screen of the mobile phone, the mobile phone receives two image processing signal resources respectively required to be displayed on the mobile phone and the television, and the two image processing signal resources are Having a peer relationship to facilitate signal splicing in step S104;

Step S104: The mobile phone splices the received two image resources into a complete unified image. The display area of the two image resources is not necessarily in the left-right mode or the up-and-down manner, as long as the two images can be placed into one image. The overall picture, and the picture does not exceed the maximum range that can be displayed on the TV display. For example, the maximum display range of the single-head display of the MARVELL PXA920 chip of the mobile phone is 720p, that is, 1280*720 pixels, and the DVD of the TV is drawn. The quality image is 480p, which is 640*480 pixels, while the mobile QVGA screen supports 320*240 pixels. It can be seen that a 480p image + QVGA image can be spliced into a 720p image, as shown in Figure 2;

In step S104, for example, when splicing BMP pictures, it can be completed by VC6.0 (requires GDI+), such as:

CombinePic(L "image/bmp ", "12.bmp ", "l.bmp ", "2.bmp ");

BOOL CombinePic(const WCHAR *format, const CString &strDst, const CString &strPicl, \

Const CString &strPic2)

{

BOOL bCombine = false;

Int nRet = 0;

CLSID clsid; nRet = GetEncoderClsid(format,&clsid);

If (nRet > =0)

{

USES—CONVERSION;

Bitmap bmpl(A2W(strPicl));

Bitmap bmp2(A2W(strPic2));

Int n Width = 0, nHeight = 0;

n Width = bmpl .GetWidth(); 〃 Suppose the two images are the same size

nHeight = bmpl .GetHeight();

Bitmap bmpCombine(2*nWidth, nHeight); 〃 height unchanged, width *2, horizontal merge

Graphics * pG = NULL;

pG = Graphics: : FromImage(&bmpCombine);

If (pG! = NULL)

{

pG- >DrawImage(&bmpl,0,0);

pG- >DrawImage(&bmp2,nWidth,0);

bmpCombine.Save(A2W(strDst),&clsid,NULL);

}

Return bCombine;

}

Int GetEncoderClsid(const WCHAR *format, CLSID *pClsid) {

Int nRet = -1 ;

ImageCodecInfo * pCodednfo = NULL;

Circle T nNum = O'nSize = 0;

GetImageEncodersSize(&nNum,&nSize);

If (nSize <0)

{ Return nRet;

}

pCodednfo = new ImageCodecInfo[nSize] ;

If (pCodednfo= = NULL)

{

Return nRet;

}

GetImageEncoders(nNunn, nSize, pCodecInfo);

For (UINT i =0; i <nNum; i ++)

{

If (wcscmp(pCodecInfo[i] . Mi meType, format) = =0)

{

*pClsid = pCodecInfo[i] .CIsid;

nRet = i ;

Delete port pCodednfo;

Return nRet;

}

Else

{

Continue;

}

Delete port pCodednfo;

Return nRet;

}

Step S106: intercepting two image resources (ie, image processing signals) before splicing in a complete unified image (ie, image display signal) stitched in step S104, respectively, on the LCD screen of the mobile phone and the television display screen display.

Among them, the area shown in Figure 2 illustrates: a) The whole area (the area where the image display signal is displayed) consists of four points: (XI, Yn), (Χη, Yl), (XI, Υ1), (Χη, Υη), which should be composed of mobile phones. The image splicing module in the application processor is spliced and processed, and then output by the application processor to a display bus such as RGB;

b) The rectangular area of the LCD display of the mobile phone is (X LCD1 , YLCDn ), ( Xl Dn, YLCDI ), ( XLCDI ,

YLCDI (XLCDn, Y _L CDn ) consists of four points. The image processor intercepts and displays the contents of the LCD display area from the display bus or display buffer such as RGB according to the parameter setting, and other content that does not belong to the LCD display area. throw away;

c) The rectangular area of the TV display area is (X _TV1 , Y _TVN ), (X _TVN , _{ΤΝΙ ΤΝΙ} ), (Χ _ΤΝΙ , Υ _ΤΝΙ ),

(XTVn, YTVn) consists of four points. The image processor intercepts and displays the contents of the TV display area from the display bus or display buffer such as RGB according to the parameter setting, and discards other content that does not belong to the TV display area.

The image processing method of the embodiment, taking the mobile phone LCD and the television display as an example, can ensure that when the mobile phone only supports single-head display, the content of the mobile phone LCD and the television display are separately displayed, thereby ensuring that the low-profile mobile phone can be The technical effect of realizing multi-screen display of different contents; wherein the image processor is disposed in the mobile terminal, the modification and modification of the external display screen are avoided, and the adaptability of the image processing method is improved.

3 is a flow chart of an image processing method according to a second embodiment of the present invention. The embodiment includes a mobile phone and a television set. The mobile phone is provided with an LCD display screen, and the mobile phone controls the display screen of the television through wireless transmission. The wireless transmission protocol includes, but is not limited to, a protocol such as Bluetooth, WiFi, and infrared. In this embodiment, a mobile phone transmits a signal resource to a television set by using a WiMo protocol as an example to implement a mobile phone LCD display and a television. The independent display of the display, the two can achieve the same content of the same or different display, can also achieve the same content or different display of different content, can also achieve the same content or interactive display of different content (ie LCD screen and The content displayed on the TV screen is related to each other).

It should be noted that, in conjunction with the implementation of the WiMo protocol, this embodiment includes a WiMo control device. The signal is used to receive the signal resource sent by the mobile terminal and displayed through the television display screen, and the control signal sent by the external operating device of the receiving television is sent to the mobile terminal. The WiMo control unit can be set inside the TV, or can be set outside the TV, and connected to the TV through an existing standard interface such as serial port, HDMI, color line, or wirelessly connected to the TV via infrared or Bluetooth.

As shown in FIG. 3, this embodiment includes:

Step S202: In order to realize that the image processing signals are separately displayed on the LCD display screen and the television display screen of the mobile phone, the application processor (ie, the AP processor) in the mobile phone receives the two-way image that needs to be separately displayed on the mobile phone and the television set. Processing signal resources, the two image processing signal resources have a homogenous relationship, so as to facilitate signal splicing in step S204;

Step S204: The application processor in the mobile phone splices the received two image resources into a complete unified image, and the display area of the two image resources is not necessarily in a left-right manner or an up-and-down manner, as long as the two channels can be The image is placed in a whole picture, and the picture does not exceed the maximum range that can be displayed on the TV display. For example, the maximum display range of the single-head display of the MARVELL920 chip of the mobile phone is 720p, that is, 1280*720 pixels, and the TV The DVD image quality of the machine is 480p, which is 640*480 pixels, while the QVGA screen of the mobile phone supports 320*240 pixels. It can be seen that a 480p image + QVGA image can be spliced into a 720p image, as shown in Figure 4. Shown

Step S206: The image processor in the mobile phone intercepts two image resources (ie, image processing signals) before splicing in a complete unified image (ie, image display signal) that is spliced in step S204, respectively, on the LCD of the mobile phone. Displayed on the screen and TV display;

Among them, the area shown in Figure 4 illustrates:

a) The whole area (the area where the image display signal is displayed) consists of four points: (XI, Yn), (Χη, Yl), (XI, Υ1), (Χη, Υη), which should be composed of mobile phones. The image splicing module in the application processor is spliced and processed, and then output by the application processor to a display bus such as RGB;

YLCDI (XLCDn, Y _L CDn ) consists of four points. The image processor in the image processor in the mobile phone intercepts and displays the contents of the LCD display area from the display bus or display buffer such as RGB according to the parameter setting, and other Content that is not part of the LCD display area is discarded;

c) WiMo shows the rectangular area of the WiMo display area through the TV display by (X _WLM()1 , YwiMon ), ( XwiMon' YwiMol ), ( XwiMol ' YwiMol ), ( XwiMon' YwiMon ) consist of four points. The image processor in the image processor of the mobile phone is displayed in the bus or display buffer from RGB, etc. according to the parameter setting. Intercepting and displaying the content of the WiMo display area, and discarding other content not belonging to the WiMo display area, and then transmitting the content displayed by the WiMo display area to the WiMo control device through the WiMo protocol, and the WiMo control device displays the transmission through the TV display screen. Content.

It should be noted that the image processor has image interception capability, that is, extracts desired image data information from data transmitted from the RGB data interface through a register or other means.

Step S208: The controller disposed in the mobile phone is connected to the operating device of the mobile phone, and the operating device of the mobile phone sends a signal for controlling the image display thereof to the mobile phone and the television display screen through the controller;

The control signal generated by the mobile phone's operating device can be controlled only for the content display of the LCD display, or can simultaneously control the content display of the LCD display of the mobile phone and the display of the TV on the WiMo side, but if the TV display on the WiMo side When there is an independent control signal, the operating device of the mobile phone only controls the LCD screen of the mobile phone, and the television display screen of the WiMo side is controlled by the control signal of the WiMo side.

The operating device of the mobile phone includes but is not limited to: a keyboard, a touch screen, a gravity sensor, and the like. Step S210: The controller disposed in the mobile phone is connected to the operating device on the WiMo side, and the operating device of the television transmits a signal for controlling the image display thereof to the mobile phone and the television display through the controller.

The operating device on the WiMo side is disposed in or connected to the television or the WiMo control device, including but not limited to: a remote controller, a mouse, a touch screen, and the like.

The control signal on the WiMo side can transmit only control information that is independent of the image display position of the TV display screen, or control information related to the image display position of the TV display screen; when the control signal on the WiMo side and the TV display When the image display position of the screen is related, the control signal of the WiMo side should include the image coordinate information of the TV display screen and the action attribute. Considering that the operation device on the WiMo side cannot obtain the coordinate system setting information of the complete image on the mobile phone side, the television display The coordinate information of the screen is usually described by the coordinate system of the TV display itself. We can, y _n ), (x _n , _yi ), ( _Xl , _yi ), (x _n , y _n ) To describe the coordinate system and display area of the TV display itself, as shown in Figure 5.

When the user operates on a certain position on the TV display screen using the operating device on the WiMo side, the coordinates of the operation position are (X, y), and when (X, y) is transmitted back to the mobile phone via WiMo, the mobile phone The control conversion module on the computer should convert the independent coordinate system of the TV display screen into the coordinates (x- Xi+ XwM, y- y _n + Y _WlM . _n ) in the unified coordinate system on the LCD screen of the mobile phone, and then transmit it to the mobile phone. The control processing module performs identification processing and converts it into a corresponding control signal.

It should be noted that in the coordinates (x-X+Xwufoi, y- y _n + Y _Wl Mon ), χι and y _n represent the starting coordinates of the independent coordinate system of the TV display screen in Figure 5, and the value should be constant. , ^! ^^ and

Y _WlM . _n represents the coordinates of the WiMo display area in FIG.

Preferably, in step S204, the two image resources are spliced into a complete and unified image by means of image placement, and the manner of placing the image includes placing and spacing in sequence, and taking the stitching of one frame as an example. Specific instructions:

Positioning in sequence: Decoding a picture of 100 X 100 and a picture of 100 X 200 into bitmap file 1 and bitmap file 2, respectively, to be stitched into a picture of 100 X 300, first created A temporary storage area tmp of drawing.bitmap, whose size is 100 X 300, creates a temporary bitmap file graphics in tmp, and draws bitmap file 1 to (0,0) of the plane coordinate system of tmp, which will be bit The drawing file 2 is drawn to (0, 100) of the plane coordinate system of tmp, and then the bitmap file 1 and the bitmap file 2 are merged into a temporary bitmap file graphics, and finally the graphics on the tmp are sent to the display buffer for display;

Interval placement: Decode a 100 X 100 picture 1 and a 100 X 200 picture 2 into a bitmap file 1 and a bitmap file 2, respectively, to be stitched into a picture of 100 X 400, according to the above The method maps the bitmap file 1 to (0,0) of the plane coordinate system of tmp, and then draws the bitmap file 2 to (0,200) of the plane coordinate system of tmp, and other steps are the same as above.

Preferably, in step S204, the two image resources are placed into an overall picture. If the sum of the resolution ranges of the two image resources is smaller than the resolution range of the overall picture, the image of the two image resources is performed. The stretching or background filling process performs image reduction processing on the two image resources if the sum of the resolution ranges of the two image resources is greater than the resolution range of the entire image.

The image processing method of the embodiment further includes the steps of the mobile terminal and the operation device of the external display screen for controlling the mobile terminal and/or the external display screen, and implementing the operation device to the mobile terminal. The separate control with the external display screen can better realize the independent display of different contents of the mobile terminal and the external display screen.

According to the third embodiment of the method of the present invention, an image processing method is provided, and the method is the third embodiment. The mobile terminal that supports only the single-head display in the prior art cannot improve the technical defects of displaying the different content on the display screen of the mobile terminal and the external display screen, and ensures that the mobile terminal supporting only the single-head display realizes the display of the mobile terminal. The screen and the external display show different content. This embodiment includes:

Step S302: The mobile terminal supporting the single-head display only has an image splicing module, and the image splicing module can be integrated into the application module using the WiMo function, or integrated with the operating system, and provided to the application module for calling. API interface;

Step S304: When an application module needs to use a multi-display function, the application module needs to provide image content displayed on the display of the mobile phone and image content displayed on the display screen of the television, and the two displays The association between the screen display content and the peer relationship logic should be handled by the application module;

Step S306: When the application module uses the WiMo function to perform multi-screen display, the image resource to be displayed on the two screens in step S304 is transmitted to the image splicing module, and the image splicing module integrates the two images into one overall picture. (as shown in Figure 2 and Figure 4), then save the entire image data to the display buffer memory controlled by the application processor by calling the underlying display driver;

Step S308: The application module sends the entire picture information in the display buffer to the data bus according to the display driver instruction in the operating system, and the image processor transmits the data according to the data bus according to the previous system power-on initialization process. Set the parameters of the picture display range (such as the area value of the displayed picture, or the address fragment of the display memory area mapped by the coordinate value) to transmit or display step S310: When the image data is simultaneously displayed on the LCD screen of the mobile phone When interacting with the TV display, the user can interact with the application module in two ways: one is to move the operation device on the mobile phone side through the LCD touch screen or the button provided by the mobile phone to control the application module, for example : The mobile phone is running the WiMo racing game. The video of the game track is displayed on the TV display. At the same time, the virtual control handle image is displayed on the LCD touch screen of the mobile phone. The user can process the I/O by clicking the analog button on the LCD touch screen of the mobile phone. The module passes the control signal to the application module for corresponding And it is reflected in the change of the game screen; the other is that the TV side supports the touch screen, which can be transmitted back to the mobile phone through WiMo, and received by the application module to generate relevant response and display to the image change, for example, the mobile phone is Via WiMo on TV Play a video on the machine, and display the virtual playback control panel on the LCD touch screen of the mobile phone. If the TV display can support touch, when the user clicks on a certain position on the TV display, the TV will click this time and The position information in the TV display coordinate system is transmitted back to the mobile phone through WiMo. After receiving the mobile phone, the mobile phone will perform a coordinate conversion through the control conversion module, and convert the position data in the TV coordinate system into the whole picture coordinate of the mobile phone. Positioning data and transmitting the information to the application module in an agreed format so that the application module can know which device and the specific coordinate location the touch operation actually takes to determine whether it is necessary to respond to the operation and how to respond, for example, on a television When the operation button is displayed on the machine side, the application module can determine that the user touches on the television by pressing the fast forward, rewind or pause button, and responds; Step S312: In some special cases, Users may operate simultaneously on the TV side and on the LCD touch of the mobile phone. , The LCD TV and mobile phone side side while the operation signal to an application program module, the processing module controls should be performed and determines the order of the queue, so that the application module orderly process.

The image processing method of the embodiment realizes interactive display of related content on the LCD display screen of the mobile phone and the display screen of the television, thereby better realizing independent display of different contents of the LCD display screen of the mobile phone and the display screen of the television, The LCD display is integrated with the display content of the TV display to improve the display of the LCD display and the TV display.

Device embodiment

According to an embodiment of the present invention, an image processing apparatus is provided. This embodiment includes an application processor and an image processor disposed within the mobile terminal:

Application processors include:

a decoding conversion module, configured to decode and convert the multi-path image processing signal into a bitmap file; a storage creation module, configured to create a temporary storage area according to a display range of the image display signal; and a bitmap creation module, configured to be created in the temporary storage area a temporary bitmap file of the image display signal; The merging module is configured to draw the bitmap files of the multiplexed image processing signals sequentially or at intervals in the plane coordinate system of the temporary storage area, and merge to form a temporary bitmap file.

The multi-channel image processing signals in the image receiving module have a peer relationship. The application processor also includes:

The image processing apparatus further includes:

a control processing module, configured to receive a control signal of the mobile operating device, control the display content of the mobile terminal and the external display screen according to the control signal, and further, receive the control of the external operating device The position coordinate information on the display screen of the mobile terminal sent by the signal and control conversion module, and the display content of the mobile terminal and the external display screen is controlled according to the control signal and the position coordinate information.

The control conversion module is disposed in the application processor, and is configured to receive coordinate information of the operation position on the external display screen sent by the external operation device, and convert the coordinate information into position coordinate information on the display screen of the mobile terminal.

The image processing apparatus of the embodiment realizes that the content of the mobile terminal and the external display screen are separately displayed, thereby ensuring the technical effect that the low-configuration mobile terminal can realize multi-screen display of different contents; wherein the image processor is disposed in the mobile terminal, The modification and modification of the external display screen are avoided, and the adaptability of the image processing apparatus is improved. The image processing apparatus of the embodiment further includes a mobile operation device and an external operation device, which realizes separate control of the operation device on the mobile terminal and the external display screen, and better realizes independent content of the mobile terminal and the external display screen. display.

System embodiment

According to an embodiment of the invention, an image processing system is provided. FIG. 6 is a schematic structural diagram of an image processing system according to an embodiment of the present invention. As shown in FIG. 6, the embodiment includes: a mobile phone and a television set, the mobile phone is provided with an LCD display, and the mobile phone is remotely controlled by WiMo. Transmitting signal resources to the TV to realize independent display of the LCD display of the mobile phone and the display of the TV. Both can achieve the same content or different display of the same content, and can also achieve the same or different display of different contents. The interactive display of the same content or different content can be realized (ie, the contents displayed by the LCD screen and the TV screen are related to each other).

The phone includes:

The application processor 10 is connected to the application module 90, and is configured to receive multiple image processing signals to be displayed, and splicing the received multiple image processing signals into one image display signal;

The image processor 20 is configured to intercept the multiplexed image processing signals before splicing in the image display signal and display them on the LCD display 50 and the television display 60 of the mobile phone respectively.

The application processor 10 includes:

a decoding conversion module, configured to decode and convert the multi-path image processing signal into a bitmap file; a storage creation module, configured to create a temporary storage area according to a display range of the image display signal; and a bitmap creation module, configured to be created in the temporary storage area a temporary bitmap file of the image display signal;

The merging module is configured to draw the bitmap files of the multiplexed image processing signals sequentially or at intervals in the plane coordinate system of the temporary storage area, and merge to form a temporary bitmap file.

The multi-channel image processing signals in the application processor 10 have a peer relationship. The application processor also includes:

The image processing module is configured to process the image processing signal according to the magnitude relationship between the sum of the resolution ranges of the multi-path image processing signals and the resolution range of the image display signal: If the sum of the resolution ranges of the multi-path image processing signals is smaller than the resolution range of the image display signal, performing image stretching or background filling processing on the image processing signals;

The image processing system further includes:

The mobile operating device 70 is disposed in the mobile phone and configured to send a signal for controlling the display of the image to the mobile phone and the television display 60;

The control processing module 13 is disposed in the application processor 10, and is configured to receive a control signal of the mobile operating device 70, perform control processing on the display content of the mobile phone and the television display screen 60 according to the control signal, and also receive the external The control signal of the operating device 80 and the position coordinate information on the LCD display 50 of the mobile phone sent by the control conversion module 14 are controlled, and the display content of the LCD display 50 of the mobile phone and the mobile phone is controlled according to the control signal and the position coordinate information.

An external operating device 80, disposed in the television display 60, is configured to send signals to the mobile phone and the television display 60 to control the display of the image;

The control conversion module 14 is disposed in the application processor 10 for receiving the operation position coordinate information sent by the external operation device 80 on the television display screen 60, and converting the coordinate information into the LCD display 50 of the mobile phone. Location coordinate information.

In order to realize the purpose of remotely transmitting signal resources to the television through the WiMo protocol, the WiMo code transceiver module 30 is provided on the mobile phone side, the WiMo transceiver module 40 is provided on the WiMo side, and the WiMo code transceiver module 30 is provided on the mobile phone side and the WiMo side. The WiMo transceiver module 40 implements the purpose of transmitting display signal resources through the WiMo protocol.

The image processing system of the embodiment realizes that the content of the mobile terminal and the external display screen are separately displayed, thereby ensuring the technical effect that the low-configuration mobile terminal can realize multi-screen display of different contents; wherein the image processor is disposed in the mobile terminal, The modification and modification of the external display screen are avoided, and the adaptability of the image processing system is improved.

The image processing system of the embodiment further includes a mobile operation device and an external operation device, which realizes separate control of the operation device on the mobile terminal and the external display screen, and better realizes independent content of the mobile terminal and the external display screen. display.

Finally, it should be noted that: The above description is only a preferred embodiment of the present invention, and is not intended to be limiting. The present invention has been described in detail with reference to the foregoing embodiments, and those skilled in the art can still modify the technical solutions described in the foregoing embodiments or equate some of the technical features. replace. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Claims

Claim

An image processing method, comprising:

1) receiving a plurality of image processing signals to be displayed;

3) intercepting the multiplexed image processing signal before splicing in the image display signal.

2. The method according to claim 1, wherein after the multi-path image processing signals before splicing are intercepted, the multiplexed image processing signals are respectively displayed on multiple screens.

The method according to claim 1, wherein in the step 2), the multi-path image processing signal is stitched by way of image placement, and the image placement manner comprises Place and interval, including:

Decoding and converting the multiplexed image processing signal into a bitmap file;

Creating a temporary storage area according to a display range of the image display signal;

The bitmap files of the multiplexed image processing signals are sequentially or intermittently drawn in the plane coordinate system of the temporary storage area, and merged to form the temporary bitmap file.

The method according to claim 1 or 2, further comprising:

If the sum of the resolution ranges of the multiplexed image processing signals is smaller than the resolution range of the image display signal, performing image stretching or background filling processing on the image processing signals;

If the sum of the resolution ranges of the multiplexed image processing signals is larger than the resolution range of the image display signal, the image processing signal is subjected to image reduction processing.

5. An image processing method, comprising:

3) the image processor intercepts the multi-path image processing signal before splicing in the image display signal number.

The method according to claim 5, wherein after the image processor intercepts the multiplexed image processing signals before the splicing, the multiplexed image processing signals are respectively displayed on multiple screens.

7. The method according to claim 6, wherein the plurality of screens are respectively disposed on the mobile terminal and the external display screen.

The method according to claim 5 or 6, wherein in the step 2), the multiplexed image processing signal is spliced by means of image placement, and the placing manner comprises splicing Place and interval, including:

9. The method according to claim 7, wherein the application processor is disposed in the mobile terminal.

10. The method according to claim 7, wherein the image processor is disposed in the mobile terminal.

The method according to claim 5 or 6, further comprising:

12. The method according to claim 7, further comprising:

4) The operating device of the mobile terminal transmits a signal for controlling its image display to the mobile terminal and the external display through the application processor.

13. The method according to claim 12, further comprising:

5) The operating device of the external display screen transmits a signal for controlling the image display thereof to the mobile terminal and the external display screen through the application processor.

An image processing apparatus, comprising:

The device according to claim 14, wherein the application processor comprises: a decoding conversion module, configured to decode and convert the multi-path image processing signal into a bitmap file; and a storage creation module, configured to a display area of the image display signal creates a temporary storage area; a bitmap creation module, configured to create a temporary bitmap file of the image display signal in the temporary storage area;

And drawing a merging module, wherein the bitmap files of the multiplexed image processing signals are sequentially or intermittently drawn in a plane coordinate system of the temporary storage area, and merged to form the temporary bitmap file.

16. The apparatus according to claim 14, wherein the application processor is disposed in the mobile terminal.

17. The apparatus according to claim 14, wherein the image processor is disposed in the mobile terminal.

The device according to claim 14, wherein the application processor further comprises: a resolution comparison module, configured to compare a magnitude relationship between a sum of resolution ranges of the multi-path image processing signals and a resolution range of the image display signal;

An image processing module, configured to process the image processing signal according to a magnitude relationship between a sum of resolution ranges of the multi-path image processing signals and a resolution range of the image display signal: if the multi-path image processing signal When the sum of the resolution ranges is smaller than the resolution range of the image display signal, the image processing signal is subjected to image stretching or background filling processing;

19. The device according to claim 14, further comprising:

And a control processing module, configured to receive a control signal of the mobile operating device, and perform control processing on the display content of the mobile terminal and the external display screen according to the control signal.

The device according to claim 19, further comprising:

An external operating device, disposed in the external display, for transmitting a signal for controlling the image display thereof to the mobile terminal and the external display;

a control conversion module, disposed in the application processor, configured to receive operation position coordinate information sent by the external operation device on the external display screen, and convert the coordinate information into a position on a display screen of the mobile terminal Coordinate information

The control processing module is further configured to receive a control signal of the external operating device and position coordinate information on a display screen of the mobile terminal sent by the control conversion module, and according to the control signal and the position coordinate information, The display content of the mobile terminal and the external display screen is controlled.

An image processing system, comprising: a mobile terminal and an external display screen, the mobile terminal comprising: An application processor, configured to receive multiple image processing signals to be displayed, and splicing the received multiple image processing signals into one image display signal;

The system according to claim 21, wherein the application processor comprises: a decoding conversion module, configured to decode and convert the multi-path image processing signal into a bitmap file; and store a creation module, configured to a display area of the image display signal creates a temporary storage area; a bitmap creation module, configured to create a temporary bitmap file of the image display signal in the temporary storage area;

The system according to claim 21, wherein the application processor further comprises: a resolution comparison module, configured to compare a sum of resolution ranges of the multi-path image processing signals with the image display signal The size relationship of the resolution range;

24. The system of claim 21, further comprising:

The system according to claim 21, further comprising: an external operating device disposed in the external display screen for transmitting a signal for controlling the image display thereof to the mobile terminal and the external display screen;