WO2017107426A1 - Image processing method, apparatus and device, and non-volatile computer storage medium - Google Patents

Image processing method, apparatus and device, and non-volatile computer storage medium Download PDF

Info

Publication number
WO2017107426A1
WO2017107426A1 PCT/CN2016/088117 CN2016088117W WO2017107426A1 WO 2017107426 A1 WO2017107426 A1 WO 2017107426A1 CN 2016088117 W CN2016088117 W CN 2016088117W WO 2017107426 A1 WO2017107426 A1 WO 2017107426A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal device
data
image data
display device
projected
Prior art date
Application number
PCT/CN2016/088117
Other languages
French (fr)
Chinese (zh)
Inventor
宋晔
陈聪
赵科
Original Assignee
百度在线网络技术(北京)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 百度在线网络技术(北京)有限公司 filed Critical 百度在线网络技术(北京)有限公司
Publication of WO2017107426A1 publication Critical patent/WO2017107426A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA

Definitions

  • the present invention relates to communication technologies, and in particular, to an image processing method, apparatus, device, and non-volatile computer storage medium.
  • terminal devices integrate more and more functions, so that more and more corresponding applications (Applications, APPs) are included in the system function list of the terminal devices.
  • An application installed on some terminal devices which is referred to as an interconnection application in the present invention, needs to be installed by using a corresponding cooperation application on another terminal device connected thereto, otherwise there is no use value, especially for some vehicle interconnections. application.
  • the cooperation application can perform image interception processing on the interface displayed by the display device of the terminal device to obtain an original image.
  • the original image is subjected to a series of conversion processing to obtain a projection image that can be processed by the video encoding hardware of the terminal device where the application is located.
  • the matching application can perform video encoding processing on the obtained projected image to obtain a video data stream, which is sent to the interconnected application for output.
  • aspects of the present invention provide an image processing method, apparatus, device, and nonvolatile computer storage medium for improving the efficiency and reliability of image processing.
  • An aspect of the present invention provides an image processing method including:
  • the projectable area is obtained according to size data of the display device.
  • the obtaining the projectable area according to the size data of the display device including:
  • the projectable area is obtained according to size data of the display device and position data of the virtual button and/or status bar on the display device.
  • the image conversion parameter comprising at least one of the following parameters:
  • the method Before the storing the projected image data as a specified data format, the method further includes:
  • any possible implementation manner further provide an implementation manner of storing the projected image data as a specified data format, including:
  • the projected image data is stored as a preset data format
  • the projected image data of the preset data format is stored as the specified data format.
  • the first terminal device is an in-vehicle terminal device
  • the second terminal device is a user terminal device.
  • an image processing apparatus comprising:
  • An acquiring unit configured to acquire original image data displayed by a projectable area on a display device of the second terminal device connected to the first terminal device where the interconnection application is located;
  • a conversion unit configured to perform image conversion processing on the original image data according to preset image conversion parameters to obtain projected image data
  • a storage unit configured to store the projected image data into a specified data format for performing video encoding processing on the projected image data of the specified data format to obtain a projected video data stream for sending to the interconnected application.
  • the projectable area is obtained according to size data of the display device.
  • any possible implementation manner further provide an implementation manner, where the acquiring unit is specifically configured to
  • the projectable area is obtained according to size data of the display device and position data of the virtual button and/or status bar on the display device.
  • the image conversion parameter comprising at least one of the following parameters:
  • the projected image data of the preset data format is stored as the specified data format.
  • the first terminal device is an in-vehicle terminal device
  • the second terminal device is a user terminal device.
  • an apparatus comprising:
  • One or more processors are One or more processors;
  • One or more programs the one or more programs being stored in the memory, when executed by the one or more processors:
  • a nonvolatile computer storage medium storing one or more programs when the one or more programs are executed by a device causes The device:
  • the embodiment of the present invention obtains the original image data displayed by the projectable area on the display device of the second terminal device connected to the first terminal device where the first terminal device is connected, and further converts the parameter according to the preset image.
  • image conversion processing on the original image data to obtain projected image data so that the projected image data can be stored as a specified data format for performing video encoding processing on the projected image data of the specified data format to obtain
  • the projected video data stream is sent to the interconnected application without manual participation, the operation is simple, and the correct rate is high, thereby improving the efficiency and reliability of image processing.
  • the projected image data required for the video encoding process can be automatically obtained, which can effectively improve the efficiency of image processing, and can effectively improve the automation degree of image processing.
  • FIG. 1 is a schematic flowchart diagram of an image processing method according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of an image processing apparatus according to another embodiment of the present invention.
  • the user terminal device involved in the embodiments of the present invention may include, but is not limited to, a mobile phone, a personal digital assistant (PDA), a wireless handheld device, a tablet computer, and a personal computer (Personal Computer). , PC), MP3 player, MP4 player, wearable device (for example, smart glasses, smart watches, smart bracelets, etc.).
  • the vehicle-mounted terminal device involved in the embodiment of the present invention may also be referred to as a vehicle, and refers to an abbreviation of an in-vehicle infotainment product installed in a car.
  • the car machine must be capable of realizing people and vehicles, vehicles and the outside world ( Information communication between car and car).
  • FIG. 1 is a schematic flowchart of an image processing method according to an embodiment of the present invention, as shown in FIG. 1 .
  • the first terminal device and the second terminal device pass at least, but are not limited to, a Bluetooth connection, a Universal Serial Bus (USB) connection, and at least a Wireless Fidelity (WI-FI) connection.
  • a Bluetooth connection a Universal Serial Bus (USB) connection
  • a Wireless Fidelity (WI-FI) connection a connection that is This is not particularly limited.
  • the execution body of the application of the second terminal device that is, the application corresponding to the interconnection application, or the application of the second terminal device (ie, the cooperation corresponding to the interconnection application)
  • the functional unit such as a plug-in or a software development kit (SDK) in the application is not particularly limited in this embodiment.
  • the application may be a local application installed on the second terminal device (nativeApp), or may also be a web application (webApp) of the browser on the second terminal device. Special restrictions are made.
  • the original image data displayed on the display area of the second terminal device connected to the first terminal device connected to the first terminal device connected to the first terminal device is obtained, and then the image conversion processing is performed on the original image data according to the preset image conversion parameter.
  • Obtaining projected image data so that the projected image data can be stored as a specified data format for performing video encoding processing on the projected image data of the specified data format to obtain a projected video data stream to be sent to the interconnect
  • the application without manual participation, simple operation, and high correct rate, improves the efficiency and reliability of image processing.
  • the first terminal device is preferably an in-vehicle terminal device; and the second terminal device is preferably a user terminal device.
  • the first terminal device may also be a user terminal device; the second terminal device may also be an in-vehicle terminal device.
  • the applications installed on the user terminal device can be executed separately, without relying on another terminal device connected thereto for normal use, or relying on a corresponding cooperation application on another terminal device connected thereto. Normal use.
  • the device connection between the first terminal device and the second terminal device is established, based on the established device connection, it is further required to further establish cooperation between the interconnected application on the first terminal device and the second terminal device. Communication connection between applications. In this way, the user can work with the application or cooperate with the second terminal device where the application is located through the interconnection application.
  • the communication connection may include, but is not limited to, at least one of a Bluetooth connection, a USB connection, and a WI-FI connection, which is not specifically limited in this embodiment.
  • the size data of the display device of the second terminal device may be further acquired, and then, according to the size data of the display device, The projectable area is obtained.
  • the size data of the display device for example, 720 pixels (width) ⁇ 1280 pixels (height), the entire display area of the display device, as the projectable area, that is, the starting point is ( 0,0), a rectangular area with a width of 720 pixels and a height of 1280 pixels.
  • the location information of the virtual button and/or the status bar of the second terminal device on the display device may be acquired, for example, when the vertical screen is displayed, the virtual button is displayed on the display device.
  • the lower side of the display area, the status bar is on the upper side of the display area of the display device; when the horizontal screen is displayed, the virtual button is not displayed on the right side of the display area of the display device, and further, according to the Dimensional data of the display device and Position data of the virtual button and/or status bar on the display device as the displayable area of all display areas of the display device except the virtual button and/or the display area where the status bar is located region.
  • the image conversion parameter used may include, but is not limited to, at least one of the following parameters:
  • the projectable area is a display area other than the display area of the virtual button and/or the status bar in the entire display area of the display device, specifically according to the size of the projectable area
  • the data, and the preset size data that is consistent with or close to the size data of the display device of the first terminal device directly determines image scaling parameters, that is, horizontal scaling and vertical scaling.
  • image scaling parameter the size of the acquired original image data can be converted to a preset size.
  • a plurality of sets of preset size data may be preset, and a set of preset size data that meets the conversion requirement is selected according to the size data of the display device of the first terminal device, and the above operation is performed.
  • the projectable area is the entire display area of the display device, specifically according to the size data of the projectable area, and a pre-preparation of the size data of the display device that is slightly larger than the first terminal device.
  • Set the size data to determine the image scaling parameters, horizontal scaling and vertical scaling.
  • image clipping parameters are obtained according to the preset size data and the position data of the virtual button and/or status bar of the second terminal device on the display device. With this image trimming parameter, you can count the number of images after scaling Image data other than the image of the area where the virtual key and/or the status bar are located is extracted.
  • a plurality of sets of preset size data may be preset, and a set of preset size data that meets the conversion requirement is selected according to the size data of the display device of the first terminal device, and the above operation is performed.
  • the image flipping parameter is obtained according to the aspect ratio of the acquired original image data and the aspect ratio of the display device of the first terminal device. For example, determining that the acquired original image data is vertical screen image data according to the aspect ratio of the acquired original image data, and determining that the first terminal device is a horizontal screen display device according to the aspect ratio of the display device of the first terminal device Therefore, it is possible to obtain an image flip parameter that rotates 270° clockwise with the specified point as the center of rotation. With the image flipping parameter, the image data after the scaling process can be flipped so that the starting point of the image data after the scaling process coincides with the starting point of the image data after the flipping.
  • hardware information of the video encoding hardware of the second terminal device may be further acquired, and then, according to the hardware of the video encoding hardware, Information, determining the specified data format corresponding to the video encoding hardware.
  • the hardware information of the so-called video encoding hardware refers to the basic attributes of the hardware name, hardware type, and data format of the image data to be processed of the video encoding hardware. According to the hardware information of the video encoding hardware, the data format of the image data to be processed required by the video encoding hardware when performing the video encoding process may be determined, and the data format may be used as the specified data format.
  • the projected image data may be directly stored.
  • R represents the red component, the G green component, and the B blue component
  • the image data of any interface displayed by the display device of the second terminal device may be acquired in advance, according to the image data. Determine its storage format. If the storage format is the specified data format, the subsequently obtained projection image data may be directly stored; if the storage format is not the specified data format, then the subsequent obtained The projected image data of the storage format is first converted into projected image data of the specified data format, and then stored.
  • the conversion rule provided in the prior art may be used, or the conversion rule customized by the present invention may also be used, which is not specifically limited in this embodiment.
  • the projected image data may be specifically stored as a preset data format, for example, ARGB_8888, where A represents a transparency component, R represents a red component, a G green component, and a B blue component, respectively.
  • the image data of any interface displayed by the display device of the second terminal device may be acquired in advance, according to the image data. Determine its storage format. If the storage format is the preset data format, the subsequently obtained projected image data may be directly stored; if the storage format is not the preset data format, then the subsequent The obtained projected image data of the storage format is first converted into projected image data of the preset data format, and then stored.
  • the specific conversion rules The conversion rules provided in the prior art may be used, or the conversion rules customized by the present invention may also be used, which is not specifically limited in this embodiment.
  • the projected image data of the preset data format may be stored as the specified data format. Specifically, the projected image data of the preset data format may be first converted into the projected image data of the specified data format, and then stored.
  • the conversion rule provided in the prior art may be used, or the conversion rule customized by the present invention may also be used, which is not specifically limited in this embodiment.
  • the original image data displayed by the projectable area on the display device of the second terminal device connected to the first terminal device connected to the first terminal device is obtained, and then the original image data is performed according to the preset image conversion parameter.
  • Image conversion processing to obtain projected image data such that the projected image data can be stored as a specified data format for video encoding processing on the projected image data of the specified data format to obtain a projected video data stream to be sent to
  • the interconnection application does not require manual participation, has simple operation, and has high correct rate, thereby improving the efficiency and reliability of image processing.
  • the projected image data required for the video encoding process can be automatically obtained, which can effectively improve the efficiency of image processing, and can effectively improve the automation degree of image processing.
  • FIG. 2 is a schematic structural diagram of an image processing apparatus according to another embodiment of the present invention, as shown in FIG. 2 .
  • the image processing apparatus of the present embodiment may include an acquisition unit 21, a conversion unit 22, and a storage unit 23.
  • the obtaining unit 21 is configured to acquire original image data displayed by a projectable area on a display device of the second terminal device to which the first terminal device connected to the first terminal device is connected, and the converting unit 22 is configured to convert the parameter according to the preset image.
  • the image processing apparatus in this embodiment may be an application corresponding to the application of the second terminal device, that is, the corresponding application, or may be an application located in the second terminal device (ie, the corresponding application of the interconnection application).
  • the functional unit such as a plug-in or a software development kit (SDK) in the application is not particularly limited in this embodiment.
  • the application may be a local application installed on the second terminal device (nativeApp), or may also be a web application (webApp) of the browser on the second terminal device. Special restrictions are made.
  • the first terminal device is preferably an in-vehicle terminal device; and the second terminal device is preferably a user terminal device.
  • the first terminal device may also be a user terminal device; the second terminal device may also be an in-vehicle terminal device.
  • the applications installed on the user terminal device can be executed separately without relying on another terminal device connected to it. It can be used normally if it is used normally or if it depends on another terminal device connected to it.
  • the acquiring unit 21 may be further configured to acquire size data of the display device of the second terminal device; and according to the size data of the display device. Obtaining the projectable area.
  • the acquiring unit 21 may be specifically configured to acquire location data of a virtual button and/or a status bar of the second terminal device on the display device; and according to the size data of the display device and the The position data of the virtual button and/or status bar on the display device obtains the projectable area.
  • the image conversion parameter used by the converting unit 22 may include, but is not limited to, at least one of the following parameters:
  • the storage unit 23 may be further configured to acquire hardware information of a video encoding hardware of the second terminal device, and according to the video encoding hardware.
  • the hardware information determines the specified data format corresponding to the video encoding hardware.
  • the storage unit 23 may be specifically configured to store the projected image data as a preset data format; and display a projected image of the preset data format.
  • the data is stored in the specified data format.
  • the original image data displayed on the displayable area of the display device of the second terminal device to which the first terminal device connected to the first terminal device is connected is obtained by the acquiring unit, and then the conversion unit converts the parameter according to the preset image.
  • the storage unit can store the projected image data as a specified data format for performing video encoding processing on the projected image data of the specified data format,
  • the obtained projected video data stream is sent to the interconnected application without manual participation, the operation is simple, and the correct rate is high, thereby improving the efficiency and reliability of image processing.
  • the projected image data required for the video encoding process can be automatically obtained, which can effectively improve the efficiency of image processing, and can effectively improve the automation degree of image processing.
  • the disclosed system, apparatus, and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separate,
  • the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
  • the integrated unit implemented in the form of a software functional unit can be stored in a computer readable storage medium.
  • the software functional unit is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, an audio processing engine, or a network device, etc.) or a processor to perform various embodiments of the present invention. Part of the steps of the method.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

Provided are an image processing method, apparatus and device, and a non-volatile computer storage medium. According to the embodiments of the present invention, original image data displayed in a projectable area on a display apparatus of a second terminal device connected to a first terminal device where an interconnection application is located is acquired, and image conversion processing is performed on the original image data to obtain projection image data according to a pre-set image conversion parameter, so that the projection image data can be stored in an appointed data format to perform video coding processing on the projection image data in the appointed data format so as to obtain a projection video data stream and send same to the interconnection application. According to the method, artificial participation is not needed, the operation is easy and the accuracy is high, so that the efficiency and the reliability of image processing are improved.

Description

图像处理方法、装置、设备及非易失性计算机存储介质Image processing method, device, device and non-volatile computer storage medium
本申请要求了申请日为2015年12月25日,申请号为201510994400.3发明名称为“图像处理方法及装置”的中国专利申请的优先权。The present application claims priority to Chinese Patent Application No. 201510994400.3, entitled "Image Processing Method and Apparatus", filed on Dec. 25, 2015.
技术领域Technical field
本发明涉及通信技术,尤其涉及一种图像处理方法、装置、设备及非易失性计算机存储介质。The present invention relates to communication technologies, and in particular, to an image processing method, apparatus, device, and non-volatile computer storage medium.
背景技术Background technique
随着通信技术的发展,终端设备集成了越来越多的功能,从而使得终端设备的系统功能列表中包含了越来越多相应的应用(Application,APP)。有些终端设备上所安装的应用,本发明中称为互联应用,需要通过与其连接的另一个终端设备上安装一个相应的配合应用才能正常使用,否则没有任何使用价值,特别是对于一些车机互联应用。通常情况下,为了保证互联应用能够获取配合应用所在终端设备的屏幕上的实时内容,配合应用可以对所述终端设备的显示装置所显示的界面进行图像截取处理,以获得原始图像。进而,根据操作人员根据配合应用所在的终端设备的品牌和型号所设置的图像处理参数,对原始图像进行一系列转换处理,以获得配合应用所在终端设备的视频编码硬件所能够处理的投射图像。这样,配合应用则可以对所获得的投射图像进行视频编码处理,以获得视频数据流,发送给所述互联应用进行输出。 With the development of communication technologies, terminal devices integrate more and more functions, so that more and more corresponding applications (Applications, APPs) are included in the system function list of the terminal devices. An application installed on some terminal devices, which is referred to as an interconnection application in the present invention, needs to be installed by using a corresponding cooperation application on another terminal device connected thereto, otherwise there is no use value, especially for some vehicle interconnections. application. Generally, in order to ensure that the interconnected application can obtain real-time content on the screen of the terminal device where the application is located, the cooperation application can perform image interception processing on the interface displayed by the display device of the terminal device to obtain an original image. Further, according to the image processing parameters set by the operator according to the brand and model of the terminal device in which the application is located, the original image is subjected to a series of conversion processing to obtain a projection image that can be processed by the video encoding hardware of the terminal device where the application is located. In this way, the matching application can perform video encoding processing on the obtained projected image to obtain a video data stream, which is sent to the interconnected application for output.
然而,由于配合应用所在的终端设备的类型繁多,采用人工操作来逐一根据每种终端设备设置不同的图像处理参数,会使得操作复杂,且容易出错,从而导致了图像处理的效率和可靠性的降低。However, due to the wide variety of terminal devices in which the application is used, manual operation to set different image processing parameters according to each terminal device one by one makes the operation complicated and error-prone, resulting in image processing efficiency and reliability. reduce.
发明内容Summary of the invention
本发明的多个方面提供一种图像处理方法、装置、设备及非易失性计算机存储介质,用以提高图像处理的效率和可靠性。Aspects of the present invention provide an image processing method, apparatus, device, and nonvolatile computer storage medium for improving the efficiency and reliability of image processing.
本发明的一方面,提供一种图像处理方法,包括:An aspect of the present invention provides an image processing method including:
获取互联应用所在第一终端设备所连接的第二终端设备的显示装置上可投射区域所显示的原始图像数据;Obtaining original image data displayed by a projectable area on a display device of the second terminal device connected to the first terminal device where the interconnection application is located;
根据预设图像转换参数,对所述原始图像数据进行图像转换处理,以获得投射图像数据;Performing image conversion processing on the original image data according to preset image conversion parameters to obtain projected image data;
将所述投射图像数据存储为指定数据格式,以供对所述指定数据格式的投射图像数据,进行视频编码处理,以获得投射视频数据流发送给所述互联应用。And storing the projected image data into a specified data format for performing video encoding processing on the projected image data of the specified data format to obtain a projected video data stream and transmitting the data to the interconnected application.
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述获取互联应用所在第一终端设备所连接的第二终端设备的显示装置上可投射区域所显示的原始图像数据之前,还包括:The aspect as described above, and any possible implementation manner, further provide an implementation manner, where the acquiring the original image data displayed by the projectable area on the display device of the second terminal device connected to the first terminal device where the interconnection application is located Previously, it also included:
获取所述第二终端设备的显示装置的尺寸数据;Obtaining size data of the display device of the second terminal device;
根据所述显示装置的尺寸数据,获得所述可投射区域。 The projectable area is obtained according to size data of the display device.
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述根据所述显示装置的尺寸数据,获得所述可投射区域,包括:The aspect as described above and any of the possible implementations further provide an implementation manner, the obtaining the projectable area according to the size data of the display device, including:
获取所述第二终端设备的虚拟按键和/或状态栏在所述显示装置上的位置数据;Obtaining location data of the virtual button and/or status bar of the second terminal device on the display device;
根据所述显示装置的尺寸数据和所述虚拟按键和/或状态栏在所述显示装置上的位置数据,获得所述可投射区域。The projectable area is obtained according to size data of the display device and position data of the virtual button and/or status bar on the display device.
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述图像转换参数包括下列参数中的至少一项:In an aspect as described above and any possible implementation, an implementation is further provided, the image conversion parameter comprising at least one of the following parameters:
图像缩放参数;Image scaling parameter;
图像剪裁参数;以及Image cropping parameters;
图像翻转参数。Image flip parameters.
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述将所述投射图像数据存储为指定数据格式之前,还包括:The foregoing aspect and any possible implementation manner further provide an implementation manner. Before the storing the projected image data as a specified data format, the method further includes:
获取所述第二终端设备的视频编码硬件的硬件信息;Obtaining hardware information of the video encoding hardware of the second terminal device;
根据所述视频编码硬件的硬件信息,确定所述视频编码硬件所对应的所述指定数据格式。Determining, according to hardware information of the video encoding hardware, the specified data format corresponding to the video encoding hardware.
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述将所述投射图像数据存储为指定数据格式,包括:The aspect as described above and any possible implementation manner further provide an implementation manner of storing the projected image data as a specified data format, including:
将所述投射图像数据存储为预设数据格式;The projected image data is stored as a preset data format;
将所述预设数据格式的投射图像数据存储为所述指定数据格式。 The projected image data of the preset data format is stored as the specified data format.
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,An aspect of the above, and any possible implementation, further providing an implementation manner,
所述第一终端设备为车载终端设备;The first terminal device is an in-vehicle terminal device;
所述第二终端设备为用户终端设备。The second terminal device is a user terminal device.
本发明的另一方面,提供一种图像处理装置,包括:In another aspect of the invention, an image processing apparatus is provided, comprising:
获取单元,用于获取互联应用所在第一终端设备所连接的第二终端设备的显示装置上可投射区域所显示的原始图像数据;An acquiring unit, configured to acquire original image data displayed by a projectable area on a display device of the second terminal device connected to the first terminal device where the interconnection application is located;
转换单元,用于根据预设图像转换参数,对所述原始图像数据进行图像转换处理,以获得投射图像数据;a conversion unit, configured to perform image conversion processing on the original image data according to preset image conversion parameters to obtain projected image data;
存储单元,用于将所述投射图像数据存储为指定数据格式,以供对所述指定数据格式的投射图像数据,进行视频编码处理,以获得投射视频数据流发送给所述互联应用。And a storage unit configured to store the projected image data into a specified data format for performing video encoding processing on the projected image data of the specified data format to obtain a projected video data stream for sending to the interconnected application.
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述获取单元,还用于The aspect as described above and any possible implementation manner further provide an implementation manner, where the acquiring unit is further used for
获取所述第二终端设备的显示装置的尺寸数据;以及Obtaining size data of the display device of the second terminal device;
根据所述显示装置的尺寸数据,获得所述可投射区域。The projectable area is obtained according to size data of the display device.
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述获取单元,具体用于The aspect as described above and any possible implementation manner further provide an implementation manner, where the acquiring unit is specifically configured to
获取所述第二终端设备的虚拟按键和/或状态栏在所述显示装置上的位置数据;以及 Obtaining location data of the virtual button and/or status bar of the second terminal device on the display device;
根据所述显示装置的尺寸数据和所述虚拟按键和/或状态栏在所述显示装置上的位置数据,获得所述可投射区域。The projectable area is obtained according to size data of the display device and position data of the virtual button and/or status bar on the display device.
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述图像转换参数包括下列参数中的至少一项:In an aspect as described above and any possible implementation, an implementation is further provided, the image conversion parameter comprising at least one of the following parameters:
图像缩放参数;Image scaling parameter;
图像剪裁参数;以及Image cropping parameters;
图像翻转参数。Image flip parameters.
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述存储单元,还用于The aspect as described above and any possible implementation manner further provide an implementation manner, where the storage unit is further used for
获取所述第二终端设备的视频编码硬件的硬件信息;以及Obtaining hardware information of the video encoding hardware of the second terminal device;
根据所述视频编码硬件的硬件信息,确定所述视频编码硬件所对应的所述指定数据格式。Determining, according to hardware information of the video encoding hardware, the specified data format corresponding to the video encoding hardware.
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述存储单元,具体用于The foregoing aspect and any possible implementation manner further provide an implementation manner, where the storage unit is specifically configured to
将所述投射图像数据存储为预设数据格式;以及Storing the projected image data as a preset data format;
将所述预设数据格式的投射图像数据存储为所述指定数据格式。The projected image data of the preset data format is stored as the specified data format.
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,An aspect of the above, and any possible implementation, further providing an implementation manner,
所述第一终端设备为车载终端设备;The first terminal device is an in-vehicle terminal device;
所述第二终端设备为用户终端设备。 The second terminal device is a user terminal device.
本发明的另一方面,提供一种设备,包括:In another aspect of the invention, an apparatus is provided, comprising:
一个或者多个处理器;One or more processors;
存储器;Memory
一个或者多个程序,所述一个或者多个程序存储在所述存储器中,当被所述一个或者多个处理器执行时:One or more programs, the one or more programs being stored in the memory, when executed by the one or more processors:
获取互联应用所在第一终端设备所连接的第二终端设备的显示装置上可投射区域所显示的原始图像数据;Obtaining original image data displayed by a projectable area on a display device of the second terminal device connected to the first terminal device where the interconnection application is located;
根据预设图像转换参数,对所述原始图像数据进行图像转换处理,以获得投射图像数据;Performing image conversion processing on the original image data according to preset image conversion parameters to obtain projected image data;
将所述投射图像数据存储为指定数据格式,以供对所述指定数据格式的投射图像数据,进行视频编码处理,以获得投射视频数据流发送给所述互联应用。And storing the projected image data into a specified data format for performing video encoding processing on the projected image data of the specified data format to obtain a projected video data stream and transmitting the data to the interconnected application.
本发明的另一方面,提供一种非易失性计算机存储介质,所述非易失性计算机存储介质存储有一个或者多个程序,当所述一个或者多个程序被一个设备执行时,使得所述设备:In another aspect of the present invention, a nonvolatile computer storage medium storing one or more programs when the one or more programs are executed by a device causes The device:
获取互联应用所在第一终端设备所连接的第二终端设备的显示装置上可投射区域所显示的原始图像数据;Obtaining original image data displayed by a projectable area on a display device of the second terminal device connected to the first terminal device where the interconnection application is located;
根据预设图像转换参数,对所述原始图像数据进行图像转换处理,以获得投射图像数据;Performing image conversion processing on the original image data according to preset image conversion parameters to obtain projected image data;
将所述投射图像数据存储为指定数据格式,以供对所述指定数据格式的投射图像数据,进行视频编码处理,以获得投射视频数据流发送给 所述互联应用。Storing the projected image data into a specified data format for performing video encoding processing on the projected image data of the specified data format to obtain a projected video data stream to be sent to The interconnected application.
由所述技术方案可知,本发明实施例通过获取互联应用所在第一终端设备所连接的第二终端设备的显示装置上可投射区域所显示的原始图像数据,进而根据预设图像转换参数,对所述原始图像数据进行图像转换处理,以获得投射图像数据,使得能够将所述投射图像数据存储为指定数据格式,以供对所述指定数据格式的投射图像数据,进行视频编码处理,以获得投射视频数据流发送给所述互联应用,无需人工参与,操作简单,而且正确率高,从而提高了图像处理的效率和可靠性。According to the technical solution, the embodiment of the present invention obtains the original image data displayed by the projectable area on the display device of the second terminal device connected to the first terminal device where the first terminal device is connected, and further converts the parameter according to the preset image. Performing image conversion processing on the original image data to obtain projected image data, so that the projected image data can be stored as a specified data format for performing video encoding processing on the projected image data of the specified data format to obtain The projected video data stream is sent to the interconnected application without manual participation, the operation is simple, and the correct rate is high, thereby improving the efficiency and reliability of image processing.
另外,采用本发明所提供的技术方案,一旦获取原始图像数据,即能够自动获得视频编码处理所需要的投射图像数据,能够有效提高图像处理的效率,而且能够有效提高图像处理的自动化程度。In addition, with the technical solution provided by the present invention, once the original image data is acquired, the projected image data required for the video encoding process can be automatically obtained, which can effectively improve the efficiency of image processing, and can effectively improve the automation degree of image processing.
附图说明DRAWINGS
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are the present invention. For some embodiments, other drawings may be obtained from those of ordinary skill in the art in light of the inventive workability.
图1为本发明一实施例提供的图像处理方法的流程示意图;FIG. 1 is a schematic flowchart diagram of an image processing method according to an embodiment of the present invention;
图2为本发明另一实施例提供的图像处理装置的结构示意图。FIG. 2 is a schematic structural diagram of an image processing apparatus according to another embodiment of the present invention.
具体实施方式 detailed description
为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的全部其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
需要说明的是,本发明实施例中所涉及的用户终端设备可以包括但不限于手机、个人数字助理(Personal Digital Assistant,PDA)、无线手持设备、平板电脑(Tablet Computer)、个人电脑(Personal Computer,PC)、MP3播放器、MP4播放器、可穿戴设备(例如,智能眼镜、智能手表、智能手环等)等。本发明实施例中所涉及的车载终端设备,还可以称为车机,指的是安装在汽车里面的车载信息娱乐产品的简称,车机在功能上要能够实现人与车,车与外界(车与车)的信息通信。It should be noted that the user terminal device involved in the embodiments of the present invention may include, but is not limited to, a mobile phone, a personal digital assistant (PDA), a wireless handheld device, a tablet computer, and a personal computer (Personal Computer). , PC), MP3 player, MP4 player, wearable device (for example, smart glasses, smart watches, smart bracelets, etc.). The vehicle-mounted terminal device involved in the embodiment of the present invention may also be referred to as a vehicle, and refers to an abbreviation of an in-vehicle infotainment product installed in a car. The car machine must be capable of realizing people and vehicles, vehicles and the outside world ( Information communication between car and car).
另外,本文中术语“和/或”,仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。另外,本文中字符“/”,一般表示前后关联对象是一种“或”的关系。In addition, the term "and/or" herein is merely an association relationship describing an associated object, indicating that there may be three relationships, for example, A and/or B, which may indicate that A exists separately, and A and B exist at the same time. There are three cases of B alone. In addition, the character "/" in this article generally indicates that the contextual object is an "or" relationship.
图1为本发明一实施例提供的图像处理方法的流程示意图,如图1所示。FIG. 1 is a schematic flowchart of an image processing method according to an embodiment of the present invention, as shown in FIG. 1 .
101、获取互联应用所在第一终端设备所连接的第二终端设备的显示装置上可投射区域所显示的原始图像数据。101. Obtain original image data displayed by a projectable area on a display device of the second terminal device connected to the first terminal device where the interconnection application is located.
本发明中,第一终端设备与第二终端设备通过但不限于蓝牙连接、通用串行总线(Universal Serial Bus,USB)连接和无线相容性认证(Wireless Fidelity,WI-FI)连接中的至少一项进行连接,本实施例对 此不进行特别限定。In the present invention, the first terminal device and the second terminal device pass at least, but are not limited to, a Bluetooth connection, a Universal Serial Bus (USB) connection, and at least a Wireless Fidelity (WI-FI) connection. One connection, this embodiment is This is not particularly limited.
102、根据预设图像转换参数,对所述原始图像数据进行图像转换处理,以获得投射图像数据。102. Perform image conversion processing on the original image data according to preset image conversion parameters to obtain projected image data.
103、将所述投射图像数据存储为指定数据格式,以供对所述指定数据格式的投射图像数据,进行视频编码处理,以获得投射视频数据流发送给所述互联应用。103. Store the projected image data into a specified data format, for performing video encoding processing on the projected image data of the specified data format, to obtain a projected video data stream and sending the data to the interconnected application.
需要说明的是,101~103的执行主体可以为位于第二终端设备的应用即互联应用所对应的配合应用,或者还可以为设置在位于第二终端设备的应用(即互联应用所对应的配合应用)中的插件或软件开发工具包(Software Development Kit,SDK)等功能单元,本实施例对此不进行特别限定。It should be noted that the execution body of the application of the second terminal device, that is, the application corresponding to the interconnection application, or the application of the second terminal device (ie, the cooperation corresponding to the interconnection application) The functional unit such as a plug-in or a software development kit (SDK) in the application is not particularly limited in this embodiment.
可以理解的是,所述应用可以是安装在第二终端设备上的本地程序(nativeApp),或者还可以是第二终端设备上的浏览器的一个网页程序(webApp),本实施例对此不进行特别限定。It can be understood that the application may be a local application installed on the second terminal device (nativeApp), or may also be a web application (webApp) of the browser on the second terminal device. Special restrictions are made.
这样,通过获取互联应用所在第一终端设备所连接的第二终端设备的显示装置上可投射区域所显示的原始图像数据,进而根据预设图像转换参数,对所述原始图像数据进行图像转换处理,以获得投射图像数据,使得能够将所述投射图像数据存储为指定数据格式,以供对所述指定数据格式的投射图像数据,进行视频编码处理,以获得投射视频数据流发送给所述互联应用,无需人工参与,操作简单,而且正确率高,从而提高了图像处理的效率和可靠性。In this way, the original image data displayed on the display area of the second terminal device connected to the first terminal device connected to the first terminal device connected to the first terminal device is obtained, and then the image conversion processing is performed on the original image data according to the preset image conversion parameter. Obtaining projected image data, so that the projected image data can be stored as a specified data format for performing video encoding processing on the projected image data of the specified data format to obtain a projected video data stream to be sent to the interconnect The application, without manual participation, simple operation, and high correct rate, improves the efficiency and reliability of image processing.
可选地,在本实施例的一个可能的实现方式中,所述第一终端设备优选为车载终端设备;所述第二终端设备优选为用户终端设备。 Optionally, in a possible implementation manner of the embodiment, the first terminal device is preferably an in-vehicle terminal device; and the second terminal device is preferably a user terminal device.
反过来,所述第一终端设备也可以为用户终端设备;所述第二终端设备也可以为车载终端设备。但是,在实际应用中,用户终端设备上所安装的应用都可以单独执行,无需依赖与其连接的另一个终端设备才能正常使用,或者依赖与其连接的另一个终端设备上安装一个相应的配合应用才能正常使用。Conversely, the first terminal device may also be a user terminal device; the second terminal device may also be an in-vehicle terminal device. However, in practical applications, the applications installed on the user terminal device can be executed separately, without relying on another terminal device connected thereto for normal use, or relying on a corresponding cooperation application on another terminal device connected thereto. Normal use.
本发明中,在完成第一终端设备与第二终端设备之间的设备连接建立之后,基于所建立的设备连接,还需要进一步建立第一终端设备上的互联应用与第二终端设备上的配合应用之间的通信连接。这样,用户才可以通过互联应用,操作配合应用或者配合应用所在第二终端设备。In the present invention, after the device connection between the first terminal device and the second terminal device is established, based on the established device connection, it is further required to further establish cooperation between the interconnected application on the first terminal device and the second terminal device. Communication connection between applications. In this way, the user can work with the application or cooperate with the second terminal device where the application is located through the interconnection application.
可以理解的是,所述通信连接可以包括但不限于蓝牙连接、USB连接和WI-FI连接中的至少一项,本实施例对此不进行特别限定。It is to be understood that the communication connection may include, but is not limited to, at least one of a Bluetooth connection, a USB connection, and a WI-FI connection, which is not specifically limited in this embodiment.
可选地,在本实施例的一个可能的实现方式中,在101之前,还可以进一步获取所述第二终端设备的显示装置的尺寸数据,进而,则可以根据所述显示装置的尺寸数据,获得所述可投射区域。Optionally, in a possible implementation manner of the embodiment, before 101, the size data of the display device of the second terminal device may be further acquired, and then, according to the size data of the display device, The projectable area is obtained.
在一个具体的实现过程中,具体可以根据显示装置的尺寸数据,例如,720像素(宽)×1280像素(高),将显示装置的全部显示区域,作为所述可投射区域即起始点为(0,0),宽为720个像素,高为1280个像素的矩形区域。In a specific implementation process, according to the size data of the display device, for example, 720 pixels (width) × 1280 pixels (height), the entire display area of the display device, as the projectable area, that is, the starting point is ( 0,0), a rectangular area with a width of 720 pixels and a height of 1280 pixels.
在另一个具体的实现过程中,具体可以获取所述第二终端设备的虚拟按键和/或状态栏在所述显示装置上的位置数据,例如,进行竖屏显示时,虚拟按键在显示装置的显示区域的下侧,状态栏在显示装置的显示区域的上侧;进行横屏显示时,虚拟按键在显示装置的显示区域的右侧,状态栏一般不予显示等,进而,则可以根据所述显示装置的尺寸数据和 所述虚拟按键和/或状态栏在所述显示装置上的位置数据,将显示装置的全部显示区域中除了虚拟按键和/或状态栏所在显示区域之外的其他显示区域,作为所述可投射区域。In another specific implementation process, the location information of the virtual button and/or the status bar of the second terminal device on the display device may be acquired, for example, when the vertical screen is displayed, the virtual button is displayed on the display device. The lower side of the display area, the status bar is on the upper side of the display area of the display device; when the horizontal screen is displayed, the virtual button is not displayed on the right side of the display area of the display device, and further, according to the Dimensional data of the display device and Position data of the virtual button and/or status bar on the display device as the displayable area of all display areas of the display device except the virtual button and/or the display area where the status bar is located region.
可选地,在本实施例的一个可能的实现方式中,在102中,所采用的所述图像转换参数,可以包括但不限于下列参数中的至少一项:Optionally, in a possible implementation manner of this embodiment, in 102, the image conversion parameter used may include, but is not limited to, at least one of the following parameters:
图像缩放参数;Image scaling parameter;
图像剪裁参数;以及Image cropping parameters;
图像翻转参数。Image flip parameters.
在一个具体的实现过程中,若所述可投射区域为显示装置的全部显示区域中除了虚拟按键和/或状态栏所在显示区域之外的其他显示区域,具体可以根据所述可投射区域的尺寸数据,以及与第一终端设备的显示装置的尺寸数据一致或接近的预设尺寸数据,直接确定图像缩放参数即横向缩放比例和纵向缩放比例。利用该图像缩放参数,则可以将所获取的原始图像数据的尺寸转换为预设尺寸。In a specific implementation process, if the projectable area is a display area other than the display area of the virtual button and/or the status bar in the entire display area of the display device, specifically according to the size of the projectable area The data, and the preset size data that is consistent with or close to the size data of the display device of the first terminal device, directly determines image scaling parameters, that is, horizontal scaling and vertical scaling. With the image scaling parameter, the size of the acquired original image data can be converted to a preset size.
具体来说,可以预先设置若干组预设尺寸数据即宽高参数对,根据第一终端设备的显示装置的尺寸数据,选择满足转换需求的一组预设尺寸数据,执行上述操作。Specifically, a plurality of sets of preset size data, that is, a width and height parameter pair, may be preset, and a set of preset size data that meets the conversion requirement is selected according to the size data of the display device of the first terminal device, and the above operation is performed.
在另一个具体的实现过程中,若所述可投射区域为显示装置的全部显示区域,具体可以根据所述可投射区域的尺寸数据,以及稍微大于第一终端设备的显示装置的尺寸数据的预设尺寸数据,确定图像缩放参数即横向缩放比例和纵向缩放比例。然后,再根据预设尺寸数据和第二终端设备的虚拟按键和/或状态栏在所述显示装置上的位置数据,获得图像剪裁参数。利用该图像剪裁参数,则可以将经过缩放处理之后的图像数 据中除了虚拟按键和/或状态栏所在区域的图像之外的图像数据提取出来。In another specific implementation process, if the projectable area is the entire display area of the display device, specifically according to the size data of the projectable area, and a pre-preparation of the size data of the display device that is slightly larger than the first terminal device. Set the size data to determine the image scaling parameters, horizontal scaling and vertical scaling. Then, image clipping parameters are obtained according to the preset size data and the position data of the virtual button and/or status bar of the second terminal device on the display device. With this image trimming parameter, you can count the number of images after scaling Image data other than the image of the area where the virtual key and/or the status bar are located is extracted.
具体来说,可以预先设置若干组预设尺寸数据即宽高参数对,根据第一终端设备的显示装置的尺寸数据,选择满足转换需求的一组预设尺寸数据,执行上述操作。Specifically, a plurality of sets of preset size data, that is, a width and height parameter pair, may be preset, and a set of preset size data that meets the conversion requirement is selected according to the size data of the display device of the first terminal device, and the above operation is performed.
在另一个具体的实现过程中,根据所获取的原始图像数据的横纵比,以及第一终端设备的显示装置的横纵比,获得图像翻转参数。例如,根据所获取的原始图像数据的横纵比,确定所获取的原始图像数据为竖屏图像数据,根据第一终端设备的显示装置的横纵比,确定第一终端设备为横屏显示装置,因此,则可以获得以指定点作为旋转中心,顺时针旋转270°的图像翻转参数。利用该图像翻转参数,则可以将经过缩放处理之后的图像数据进行翻转,以使得经过缩放处理之后的图像数据的起始点与翻转之后的图像数据的起始点重合。In another specific implementation process, the image flipping parameter is obtained according to the aspect ratio of the acquired original image data and the aspect ratio of the display device of the first terminal device. For example, determining that the acquired original image data is vertical screen image data according to the aspect ratio of the acquired original image data, and determining that the first terminal device is a horizontal screen display device according to the aspect ratio of the display device of the first terminal device Therefore, it is possible to obtain an image flip parameter that rotates 270° clockwise with the specified point as the center of rotation. With the image flipping parameter, the image data after the scaling process can be flipped so that the starting point of the image data after the scaling process coincides with the starting point of the image data after the flipping.
可选地,在本实施例的一个可能的实现方式中,在103之前,还可以进一步获取所述第二终端设备的视频编码硬件的硬件信息,进而,则可以根据所述视频编码硬件的硬件信息,确定所述视频编码硬件所对应的所述指定数据格式。Optionally, in a possible implementation manner of the embodiment, before 103, hardware information of the video encoding hardware of the second terminal device may be further acquired, and then, according to the hardware of the video encoding hardware, Information, determining the specified data format corresponding to the video encoding hardware.
所谓的视频编码硬件的硬件信息,是指视频编码硬件的硬件名称、硬件类型、待处理图像数据的数据格式等基本属性。根据所述视频编码硬件的硬件信息,则可以确定所述视频编码硬件在执行视频编码处理时所要求的待处理图像数据的数据格式,并可以将该数据格式作为所述指定数据格式。The hardware information of the so-called video encoding hardware refers to the basic attributes of the hardware name, hardware type, and data format of the image data to be processed of the video encoding hardware. According to the hardware information of the video encoding hardware, the data format of the image data to be processed required by the video encoding hardware when performing the video encoding process may be determined, and the data format may be used as the specified data format.
在一个具体的实现过程中,具体可以直接将所述投射图像数据存储 为指定数据格式,例如,RGB_565,其中,R表示红色分量,G绿色分量,B蓝色分量,分别用5位、6位和5位记录RGB值,即R=5,G=6,B=5,那么,一个像素点占5+6+5=16位。In a specific implementation process, the projected image data may be directly stored. To specify the data format, for example, RGB_565, where R represents the red component, the G green component, and the B blue component, and the RGB values are recorded with 5 bits, 6 bits, and 5 bits, respectively, ie, R=5, G=6, B= 5, then, a pixel points account for 5 + 6 + 5 = 16 bits.
例如,由于不同终端设备获取其显示装置所显示的界面的图像数据的存储格式各不相同,因此,可以预先获取第二终端设备的显示装置所显示的任意界面的图像数据,根据该图像数据,确定其存储格式。若该存储格式为所述指定数据格式,那么,则可以将后续所获得的投射图像数据,直接进行存储处理;若该存储格式不为所述指定数据格式,那么,则可以将后续所获得的该存储格式的投射图像数据,先转换为所述指定数据格式的投射图像数据,再进行存储处理。其中,具体的转换规则,可以采用现有技术中所提供的转换规则,或者还可以采用本发明自定义的转换规则,本实施例对此不进行特别限定。For example, since the storage format of the image data of the interface displayed by the display device of the different terminal device is different, the image data of any interface displayed by the display device of the second terminal device may be acquired in advance, according to the image data. Determine its storage format. If the storage format is the specified data format, the subsequently obtained projection image data may be directly stored; if the storage format is not the specified data format, then the subsequent obtained The projected image data of the storage format is first converted into projected image data of the specified data format, and then stored. For the specific conversion rule, the conversion rule provided in the prior art may be used, or the conversion rule customized by the present invention may also be used, which is not specifically limited in this embodiment.
在另一个具体的实现过程中,具体可以将所述投射图像数据存储为预设数据格式,例如,ARGB_8888,其中,A表示透明度分量,R表示红色分量,G绿色分量,B蓝色分量,分别用8位记录ARGB值,即A=8,R=8,G=8,B=8,那么,一个像素点占8+8+8+8=32位。In another specific implementation process, the projected image data may be specifically stored as a preset data format, for example, ARGB_8888, where A represents a transparency component, R represents a red component, a G green component, and a B blue component, respectively. The ARGB value is recorded with 8 bits, that is, A=8, R=8, G=8, and B=8, then one pixel point occupies 8+8+8+8=32 bits.
例如,由于不同终端设备获取其显示装置所显示的界面的图像数据的存储格式各不相同,因此,可以预先获取第二终端设备的显示装置所显示的任意界面的图像数据,根据该图像数据,确定其存储格式。若该存储格式为所述预设数据格式,那么,则可以将后续所获得的投射图像数据,直接进行存储处理;若该存储格式不为所述预设数据格式,那么,则可以将后续所获得的该存储格式的投射图像数据,先转换为所述预设数据格式的投射图像数据,再进行存储处理。其中,具体的转换规则, 可以采用现有技术中所提供的转换规则,或者还可以采用本发明自定义的转换规则,本实施例对此不进行特别限定。For example, since the storage format of the image data of the interface displayed by the display device of the different terminal device is different, the image data of any interface displayed by the display device of the second terminal device may be acquired in advance, according to the image data. Determine its storage format. If the storage format is the preset data format, the subsequently obtained projected image data may be directly stored; if the storage format is not the preset data format, then the subsequent The obtained projected image data of the storage format is first converted into projected image data of the preset data format, and then stored. Among them, the specific conversion rules, The conversion rules provided in the prior art may be used, or the conversion rules customized by the present invention may also be used, which is not specifically limited in this embodiment.
进而,则可以将所述预设数据格式的投射图像数据存储为所述指定数据格式。具体来说,可以将所述预设数据格式的投射图像数据,先转换为所述指定数据格式的投射图像数据,再进行存储处理。其中,具体的转换规则,可以采用现有技术中所提供的转换规则,或者还可以采用本发明自定义的转换规则,本实施例对此不进行特别限定。Further, the projected image data of the preset data format may be stored as the specified data format. Specifically, the projected image data of the preset data format may be first converted into the projected image data of the specified data format, and then stored. For the specific conversion rule, the conversion rule provided in the prior art may be used, or the conversion rule customized by the present invention may also be used, which is not specifically limited in this embodiment.
本实施例中,通过获取互联应用所在第一终端设备所连接的第二终端设备的显示装置上可投射区域所显示的原始图像数据,进而根据预设图像转换参数,对所述原始图像数据进行图像转换处理,以获得投射图像数据,使得能够将所述投射图像数据存储为指定数据格式,以供对所述指定数据格式的投射图像数据,进行视频编码处理,以获得投射视频数据流发送给所述互联应用,无需人工参与,操作简单,而且正确率高,从而提高了图像处理的效率和可靠性。In this embodiment, the original image data displayed by the projectable area on the display device of the second terminal device connected to the first terminal device connected to the first terminal device is obtained, and then the original image data is performed according to the preset image conversion parameter. Image conversion processing to obtain projected image data, such that the projected image data can be stored as a specified data format for video encoding processing on the projected image data of the specified data format to obtain a projected video data stream to be sent to The interconnection application does not require manual participation, has simple operation, and has high correct rate, thereby improving the efficiency and reliability of image processing.
另外,采用本发明所提供的技术方案,一旦获取原始图像数据,即能够自动获得视频编码处理所需要的投射图像数据,能够有效提高图像处理的效率,而且能够有效提高图像处理的自动化程度。In addition, with the technical solution provided by the present invention, once the original image data is acquired, the projected image data required for the video encoding process can be automatically obtained, which can effectively improve the efficiency of image processing, and can effectively improve the automation degree of image processing.
需要说明的是,对于前述的各方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本发明并不受所描述的动作顺序的限制,因为依据本发明,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作和模块并不一定是本发明所必须的。 It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the present invention is not limited by the described action sequence. Because certain steps may be performed in other sequences or concurrently in accordance with the present invention. In addition, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.
在所述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。In the embodiment, the descriptions of the various embodiments are different, and the parts that are not detailed in a certain embodiment can be referred to the related descriptions of other embodiments.
图2为本发明另一实施例提供的图像处理装置的结构示意图,如图2所示。本实施例的图像处理装置可以包括获取单元21、转换单元22和存储单元23。其中,获取单元21,用于获取互联应用所在第一终端设备所连接的第二终端设备的显示装置上可投射区域所显示的原始图像数据;转换单元22,用于根据预设图像转换参数,对所述原始图像数据进行图像转换处理,以获得投射图像数据;存储单元23,用于将所述投射图像数据存储为指定数据格式,以供对所述指定数据格式的投射图像数据,进行视频编码处理,以获得投射视频数据流发送给所述互联应用。FIG. 2 is a schematic structural diagram of an image processing apparatus according to another embodiment of the present invention, as shown in FIG. 2 . The image processing apparatus of the present embodiment may include an acquisition unit 21, a conversion unit 22, and a storage unit 23. The obtaining unit 21 is configured to acquire original image data displayed by a projectable area on a display device of the second terminal device to which the first terminal device connected to the first terminal device is connected, and the converting unit 22 is configured to convert the parameter according to the preset image. Performing image conversion processing on the original image data to obtain projected image data; and storing unit 23, configured to store the projected image data as a specified data format for performing video on the projected image data of the specified data format Encoding processing to obtain a projected video data stream for transmission to the interconnected application.
需要说明的是,本实施例的图像处理装置可以为位于第二终端设备的应用即互联应用所对应的配合应用,或者还可以为设置在位于第二终端设备的应用(即互联应用所对应的配合应用)中的插件或软件开发工具包(Software Development Kit,SDK)等功能单元,本实施例对此不进行特别限定。It should be noted that the image processing apparatus in this embodiment may be an application corresponding to the application of the second terminal device, that is, the corresponding application, or may be an application located in the second terminal device (ie, the corresponding application of the interconnection application). The functional unit such as a plug-in or a software development kit (SDK) in the application is not particularly limited in this embodiment.
可以理解的是,所述应用可以是安装在第二终端设备上的本地程序(nativeApp),或者还可以是第二终端设备上的浏览器的一个网页程序(webApp),本实施例对此不进行特别限定。It can be understood that the application may be a local application installed on the second terminal device (nativeApp), or may also be a web application (webApp) of the browser on the second terminal device. Special restrictions are made.
可选地,在本实施例的一个可能的实现方式中,所述第一终端设备优选为车载终端设备;所述第二终端设备优选为用户终端设备。Optionally, in a possible implementation manner of the embodiment, the first terminal device is preferably an in-vehicle terminal device; and the second terminal device is preferably a user terminal device.
反过来,所述第一终端设备也可以为用户终端设备;所述第二终端设备也可以为车载终端设备。但是,在实际应用中,用户终端设备上所安装的应用都可以单独执行,无需依赖与其连接的另一个终端设备才能 正常使用,或者依赖与其连接的另一个终端设备上安装一个相应的配合应用才能正常使用。Conversely, the first terminal device may also be a user terminal device; the second terminal device may also be an in-vehicle terminal device. However, in practical applications, the applications installed on the user terminal device can be executed separately without relying on another terminal device connected to it. It can be used normally if it is used normally or if it depends on another terminal device connected to it.
可选地,在本实施例的一个可能的实现方式中,所述获取单元21,还可以进一步用于获取所述第二终端设备的显示装置的尺寸数据;以及根据所述显示装置的尺寸数据,获得所述可投射区域。Optionally, in a possible implementation manner of the embodiment, the acquiring unit 21 may be further configured to acquire size data of the display device of the second terminal device; and according to the size data of the display device. Obtaining the projectable area.
具体地,所述获取单元21,具体可以用于获取所述第二终端设备的虚拟按键和/或状态栏在所述显示装置上的位置数据;以及根据所述显示装置的尺寸数据和所述虚拟按键和/或状态栏在所述显示装置上的位置数据,获得所述可投射区域。Specifically, the acquiring unit 21 may be specifically configured to acquire location data of a virtual button and/or a status bar of the second terminal device on the display device; and according to the size data of the display device and the The position data of the virtual button and/or status bar on the display device obtains the projectable area.
可选地,在本实施例的一个可能的实现方式中,所述转换单元22所采用的所述图像转换参数,可以包括但不限于下列参数中的至少一项:Optionally, in a possible implementation manner of the embodiment, the image conversion parameter used by the converting unit 22 may include, but is not limited to, at least one of the following parameters:
图像缩放参数;Image scaling parameter;
图像剪裁参数;以及Image cropping parameters;
图像翻转参数。Image flip parameters.
可选地,在本实施例的一个可能的实现方式中,所述存储单元23,还可以进一步用于获取所述第二终端设备的视频编码硬件的硬件信息;以及根据所述视频编码硬件的硬件信息,确定所述视频编码硬件所对应的所述指定数据格式。Optionally, in a possible implementation manner of the embodiment, the storage unit 23 may be further configured to acquire hardware information of a video encoding hardware of the second terminal device, and according to the video encoding hardware. The hardware information determines the specified data format corresponding to the video encoding hardware.
可选地,在本实施例的一个可能的实现方式中,所述存储单元23,具体可以用于将所述投射图像数据存储为预设数据格式;以及将所述预设数据格式的投射图像数据存储为所述指定数据格式。Optionally, in a possible implementation manner of the embodiment, the storage unit 23 may be specifically configured to store the projected image data as a preset data format; and display a projected image of the preset data format. The data is stored in the specified data format.
需要说明的是,图1对应的实施例中方法,可以由本实施例提供的图像处理装置实现。详细描述可以参见图1对应的实施例中的相关内容, 此处不再赘述。It should be noted that the method in the embodiment corresponding to FIG. 1 can be implemented by the image processing apparatus provided in this embodiment. For a detailed description, reference may be made to related content in the embodiment corresponding to FIG. 1, I will not repeat them here.
本实施例中,通过获取单元获取互联应用所在第一终端设备所连接的第二终端设备的显示装置上可投射区域所显示的原始图像数据,进而由转换单元根据预设图像转换参数,对所述原始图像数据进行图像转换处理,以获得投射图像数据,使得存储单元能够将所述投射图像数据存储为指定数据格式,以供对所述指定数据格式的投射图像数据,进行视频编码处理,以获得投射视频数据流发送给所述互联应用,无需人工参与,操作简单,而且正确率高,从而提高了图像处理的效率和可靠性。In this embodiment, the original image data displayed on the displayable area of the display device of the second terminal device to which the first terminal device connected to the first terminal device is connected is obtained by the acquiring unit, and then the conversion unit converts the parameter according to the preset image. Performing image conversion processing on the original image data to obtain projected image data, so that the storage unit can store the projected image data as a specified data format for performing video encoding processing on the projected image data of the specified data format, The obtained projected video data stream is sent to the interconnected application without manual participation, the operation is simple, and the correct rate is high, thereby improving the efficiency and reliability of image processing.
另外,采用本发明所提供的技术方案,一旦获取原始图像数据,即能够自动获得视频编码处理所需要的投射图像数据,能够有效提高图像处理的效率,而且能够有效提高图像处理的自动化程度。In addition, with the technical solution provided by the present invention, once the original image data is acquired, the projected image data required for the video encoding process can be automatically obtained, which can effectively improve the efficiency of image processing, and can effectively improve the automation degree of image processing.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,所述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the described system, the device and the unit can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.
在本发明所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided by the present invention, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的, 作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separate, The components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。所述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
所述以软件功能单元的形式实现的集成的单元,可以存储在一个计算机可读取存储介质中。所述软件功能单元存储在一个存储介质中,包括若干指令用以使得一台计算机装置(可以是个人计算机,音频处理引擎,或者网络装置等)或处理器(processor)执行本发明各个实施例所述方法的部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。The integrated unit implemented in the form of a software functional unit can be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, an audio processing engine, or a network device, etc.) or a processor to perform various embodiments of the present invention. Part of the steps of the method. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .
最后应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。 It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and are not limited thereto; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that The technical solutions described in the foregoing embodiments are modified, or the equivalents of the technical features are replaced. The modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (16)

  1. 一种图像处理方法,其特征在于,包括:An image processing method, comprising:
    获取互联应用所在第一终端设备所连接的第二终端设备的显示装置上可投射区域所显示的原始图像数据;Obtaining original image data displayed by a projectable area on a display device of the second terminal device connected to the first terminal device where the interconnection application is located;
    根据预设图像转换参数,对所述原始图像数据进行图像转换处理,以获得投射图像数据;Performing image conversion processing on the original image data according to preset image conversion parameters to obtain projected image data;
    将所述投射图像数据存储为指定数据格式,以供对所述指定数据格式的投射图像数据,进行视频编码处理,以获得投射视频数据流发送给所述互联应用。And storing the projected image data into a specified data format for performing video encoding processing on the projected image data of the specified data format to obtain a projected video data stream and transmitting the data to the interconnected application.
  2. 根据权利要求1所述的方法,其特征在于,所述获取互联应用所在第一终端设备所连接的第二终端设备的显示装置上可投射区域所显示的原始图像数据之前,还包括:The method according to claim 1, wherein before the obtaining the original image data displayed by the projectable area on the display device of the second terminal device to which the first terminal device is connected, the method further includes:
    获取所述第二终端设备的显示装置的尺寸数据;Obtaining size data of the display device of the second terminal device;
    根据所述显示装置的尺寸数据,获得所述可投射区域。The projectable area is obtained according to size data of the display device.
  3. 根据权利要求2所述的方法,其特征在于,所述根据所述显示装置的尺寸数据,获得所述可投射区域,包括:The method according to claim 2, wherein the obtaining the projectable area according to the size data of the display device comprises:
    获取所述第二终端设备的虚拟按键和/或状态栏在所述显示装置上的位置数据;Obtaining location data of the virtual button and/or status bar of the second terminal device on the display device;
    根据所述显示装置的尺寸数据和所述虚拟按键和/或状态栏在所述显示装置上的位置数据,获得所述可投射区域。The projectable area is obtained according to size data of the display device and position data of the virtual button and/or status bar on the display device.
  4. 根据权利要求1~3任一权利要求所述的方法,其特征在于,所述图像转换参数包括下列参数中的至少一项:The method according to any one of claims 1 to 3, wherein the image conversion parameter comprises at least one of the following parameters:
    图像缩放参数; Image scaling parameter;
    图像剪裁参数;以及Image cropping parameters;
    图像翻转参数。Image flip parameters.
  5. 根据权利要求1~4任一权利要求所述的方法,其特征在于,所述将所述投射图像数据存储为指定数据格式之前,还包括:The method according to any one of claims 1 to 4, wherein before the storing the projected image data as a specified data format, the method further comprises:
    获取所述第二终端设备的视频编码硬件的硬件信息;Obtaining hardware information of the video encoding hardware of the second terminal device;
    根据所述视频编码硬件的硬件信息,确定所述视频编码硬件所对应的所述指定数据格式。Determining, according to hardware information of the video encoding hardware, the specified data format corresponding to the video encoding hardware.
  6. 根据权利要求1~5任一权利要求所述的方法,其特征在于,所述将所述投射图像数据存储为指定数据格式,包括:The method according to any one of claims 1 to 5, wherein the storing the projected image data as a specified data format comprises:
    将所述投射图像数据存储为预设数据格式;The projected image data is stored as a preset data format;
    将所述预设数据格式的投射图像数据存储为所述指定数据格式。The projected image data of the preset data format is stored as the specified data format.
  7. 根据权利要求1~6任一权利要求所述的方法,其特征在于,A method according to any of claims 1 to 6, wherein
    所述第一终端设备为车载终端设备;The first terminal device is an in-vehicle terminal device;
    所述第二终端设备为用户终端设备。The second terminal device is a user terminal device.
  8. 一种图像处理装置,其特征在于,包括:An image processing apparatus, comprising:
    获取单元,用于获取互联应用所在第一终端设备所连接的第二终端设备的显示装置上可投射区域所显示的原始图像数据;An acquiring unit, configured to acquire original image data displayed by a projectable area on a display device of the second terminal device connected to the first terminal device where the interconnection application is located;
    转换单元,用于根据预设图像转换参数,对所述原始图像数据进行图像转换处理,以获得投射图像数据;a conversion unit, configured to perform image conversion processing on the original image data according to preset image conversion parameters to obtain projected image data;
    存储单元,用于将所述投射图像数据存储为指定数据格式,以供对所述指定数据格式的投射图像数据,进行视频编码处理,以获得投射视频数据流发送给所述互联应用。And a storage unit configured to store the projected image data into a specified data format for performing video encoding processing on the projected image data of the specified data format to obtain a projected video data stream for sending to the interconnected application.
  9. 根据权利要求8所述的装置,其特征在于,所述获取单元,还用 于The apparatus according to claim 8, wherein said acquisition unit is further used to
    获取所述第二终端设备的显示装置的尺寸数据;以及Obtaining size data of the display device of the second terminal device;
    根据所述显示装置的尺寸数据,获得所述可投射区域。The projectable area is obtained according to size data of the display device.
  10. 根据权利要求9所述的装置,其特征在于,所述获取单元,具体用于The device according to claim 9, wherein the obtaining unit is specifically configured to
    获取所述第二终端设备的虚拟按键和/或状态栏在所述显示装置上的位置数据;以及Obtaining location data of the virtual button and/or status bar of the second terminal device on the display device;
    根据所述显示装置的尺寸数据和所述虚拟按键和/或状态栏在所述显示装置上的位置数据,获得所述可投射区域。The projectable area is obtained according to size data of the display device and position data of the virtual button and/or status bar on the display device.
  11. 根据权利要求8~10任一权利要求所述的装置,其特征在于,所述图像转换参数包括下列参数中的至少一项:The apparatus according to any one of claims 8 to 10, wherein the image conversion parameter comprises at least one of the following parameters:
    图像缩放参数;Image scaling parameter;
    图像剪裁参数;以及Image cropping parameters;
    图像翻转参数。Image flip parameters.
  12. 根据权利要求8~11任一权利要求所述的装置,其特征在于,所述存储单元,还用于The device according to any one of claims 8 to 11, wherein the storage unit is further used for
    获取所述第二终端设备的视频编码硬件的硬件信息;以及Obtaining hardware information of the video encoding hardware of the second terminal device;
    根据所述视频编码硬件的硬件信息,确定所述视频编码硬件所对应的所述指定数据格式。Determining, according to hardware information of the video encoding hardware, the specified data format corresponding to the video encoding hardware.
  13. 根据权利要求8~12任一权利要求所述的装置,其特征在于,所述存储单元,具体用于The device according to any one of claims 8 to 12, wherein the storage unit is specifically used for
    将所述投射图像数据存储为预设数据格式;以及Storing the projected image data as a preset data format;
    将所述预设数据格式的投射图像数据存储为所述指定数据格式。 The projected image data of the preset data format is stored as the specified data format.
  14. 根据权利要求8~13任一权利要求所述的装置,其特征在于,A device according to any one of claims 8 to 13, wherein
    所述第一终端设备为车载终端设备;The first terminal device is an in-vehicle terminal device;
    所述第二终端设备为用户终端设备。The second terminal device is a user terminal device.
  15. 一种设备,包括:A device that includes:
    一个或者多个处理器;One or more processors;
    存储器;Memory
    一个或者多个程序,所述一个或者多个程序存储在所述存储器中,当被所述一个或者多个处理器执行时:One or more programs, the one or more programs being stored in the memory, when executed by the one or more processors:
    获取互联应用所在第一终端设备所连接的第二终端设备的显示装置上可投射区域所显示的原始图像数据;Obtaining original image data displayed by a projectable area on a display device of the second terminal device connected to the first terminal device where the interconnection application is located;
    根据预设图像转换参数,对所述原始图像数据进行图像转换处理,以获得投射图像数据;Performing image conversion processing on the original image data according to preset image conversion parameters to obtain projected image data;
    将所述投射图像数据存储为指定数据格式,以供对所述指定数据格式的投射图像数据,进行视频编码处理,以获得投射视频数据流发送给所述互联应用。And storing the projected image data into a specified data format for performing video encoding processing on the projected image data of the specified data format to obtain a projected video data stream and transmitting the data to the interconnected application.
  16. 一种非易失性计算机存储介质,所述非易失性计算机存储介质存储有一个或者多个程序,当所述一个或者多个程序被一个设备执行时,使得所述设备:A non-volatile computer storage medium storing one or more programs, when the one or more programs are executed by a device, causing the device to:
    获取互联应用所在第一终端设备所连接的第二终端设备的显示装置上可投射区域所显示的原始图像数据;Obtaining original image data displayed by a projectable area on a display device of the second terminal device connected to the first terminal device where the interconnection application is located;
    根据预设图像转换参数,对所述原始图像数据进行图像转换处理,以获得投射图像数据;Performing image conversion processing on the original image data according to preset image conversion parameters to obtain projected image data;
    将所述投射图像数据存储为指定数据格式,以供对所述指定数据格 式的投射图像数据,进行视频编码处理,以获得投射视频数据流发送给所述互联应用。 Storing the projected image data as a specified data format for the specified data grid Projecting image data, performing video encoding processing to obtain a projected video data stream for transmission to the interconnected application.
PCT/CN2016/088117 2015-12-25 2016-07-01 Image processing method, apparatus and device, and non-volatile computer storage medium WO2017107426A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510994400.3A CN105611357A (en) 2015-12-25 2015-12-25 Image processing method and device
CN201510994400.3 2015-12-25

Publications (1)

Publication Number Publication Date
WO2017107426A1 true WO2017107426A1 (en) 2017-06-29

Family

ID=55990848

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/088117 WO2017107426A1 (en) 2015-12-25 2016-07-01 Image processing method, apparatus and device, and non-volatile computer storage medium

Country Status (2)

Country Link
CN (1) CN105611357A (en)
WO (1) WO2017107426A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109922291A (en) * 2019-01-18 2019-06-21 平安科技(深圳)有限公司 GIF generation method, device, computer equipment and storage medium
CN114445511A (en) * 2022-01-28 2022-05-06 广州华多网络科技有限公司 Image format conversion method and device, equipment, medium and product thereof

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105611357A (en) * 2015-12-25 2016-05-25 百度在线网络技术(北京)有限公司 Image processing method and device
CN105635774A (en) * 2015-12-25 2016-06-01 百度在线网络技术(北京)有限公司 Image processing method and device
CN107796370B (en) * 2016-08-30 2020-09-08 北京四维图新科技股份有限公司 Method and device for acquiring conversion parameters and mobile mapping system
CN108255447A (en) * 2016-12-29 2018-07-06 乐视汽车(北京)有限公司 For reducing the method for projection delay, data processing equipment and mobile equipment
EP3698540A1 (en) * 2017-12-05 2020-08-26 Google LLC Method for converting landscape video to portrait mobile layout using a selection interface
CN110557579B (en) * 2018-05-31 2021-11-02 杭州海康威视数字技术股份有限公司 Image processing method, device and equipment and readable medium
CN109032746B (en) * 2018-08-10 2021-08-24 广东小天才科技有限公司 Display interface self-defining method and system of wearable device and electronic device
CN111083450A (en) * 2019-12-31 2020-04-28 斑马网络技术有限公司 Vehicle-mounted-end image remote output method, device and system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030156097A1 (en) * 2002-02-21 2003-08-21 Toyota Jidosha Kabushiki Kaisha Display apparatus, portable terminal, data display system and control method of the data display system
CN103197910A (en) * 2013-04-17 2013-07-10 东软集团股份有限公司 Method and device for updating images
CN103444157A (en) * 2011-03-28 2013-12-11 株式会社电装 Information display system and device for vehicle
CN104129347A (en) * 2014-08-04 2014-11-05 京乐驰光电技术(北京)有限公司 Control method, device and system for vehicle-mounted system and terminal
CN104182167A (en) * 2013-05-27 2014-12-03 阿尔派株式会社 Display device, display device operation method and information display system
CN105611357A (en) * 2015-12-25 2016-05-25 百度在线网络技术(北京)有限公司 Image processing method and device

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102118498A (en) * 2010-12-31 2011-07-06 深圳市同洲软件有限公司 Method, device and system for mobile terminal to control display terminal to display image
KR20150004713A (en) * 2013-07-03 2015-01-13 삼성전자주식회사 Method and apparatus for managing application in a user device
CN103561284A (en) * 2013-10-12 2014-02-05 深圳市同洲电子股份有限公司 Transmission method and device for image processing
CN104735389B (en) * 2013-12-23 2018-08-31 联想(北京)有限公司 Information processing method and information processing equipment
CN104135712A (en) * 2014-07-30 2014-11-05 上海斐讯数据通信技术有限公司 Short-range control method and system for mobile terminal
CN104486665A (en) * 2014-12-31 2015-04-01 乐视致新电子科技(天津)有限公司 Remote assistance method and device of mobile terminal
CN105094732B (en) * 2015-06-29 2018-07-31 小米科技有限责任公司 Screen display method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030156097A1 (en) * 2002-02-21 2003-08-21 Toyota Jidosha Kabushiki Kaisha Display apparatus, portable terminal, data display system and control method of the data display system
CN103444157A (en) * 2011-03-28 2013-12-11 株式会社电装 Information display system and device for vehicle
CN103197910A (en) * 2013-04-17 2013-07-10 东软集团股份有限公司 Method and device for updating images
CN104182167A (en) * 2013-05-27 2014-12-03 阿尔派株式会社 Display device, display device operation method and information display system
CN104129347A (en) * 2014-08-04 2014-11-05 京乐驰光电技术(北京)有限公司 Control method, device and system for vehicle-mounted system and terminal
CN105611357A (en) * 2015-12-25 2016-05-25 百度在线网络技术(北京)有限公司 Image processing method and device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109922291A (en) * 2019-01-18 2019-06-21 平安科技(深圳)有限公司 GIF generation method, device, computer equipment and storage medium
CN109922291B (en) * 2019-01-18 2022-10-21 平安科技(深圳)有限公司 GIF generation method, device, computer equipment and storage medium
CN114445511A (en) * 2022-01-28 2022-05-06 广州华多网络科技有限公司 Image format conversion method and device, equipment, medium and product thereof

Also Published As

Publication number Publication date
CN105611357A (en) 2016-05-25

Similar Documents

Publication Publication Date Title
WO2017107426A1 (en) Image processing method, apparatus and device, and non-volatile computer storage medium
KR102221023B1 (en) Electronic device and method for processing image
US8087053B2 (en) System and method for transmitting an animated figure
CN108924538B (en) Screen expanding method of AR device
KR102327779B1 (en) Method for processing image data and apparatus for the same
WO2017107424A1 (en) Method, device, equipment and non-volatile computer storage medium for processing images
CN108628563A (en) Display device, display methods and storage medium
JP2016511876A (en) Inter-terminal image sharing method, terminal device, and communication system
TWI489419B (en) Method, apparatus and computer program product for image registration and display
US20170206050A1 (en) Content sharing methods and apparatuses
CN113421312A (en) Method and device for coloring black and white video, storage medium and terminal
EP4191513A1 (en) Image processing method and apparatus, device and storage medium
US20170206048A1 (en) Content sharing methods and apparatuses
WO2023227045A1 (en) Display object determination method and apparatus, electronic device, and storage medium
CN106605411A (en) Streaming video data in the graphics domain
CN106791346B (en) A kind of method and device of image prediction
CN106445440B (en) Screen sharing method and its terminal
WO2011003315A1 (en) Mobile terminal based image processing method and mobile terminal
WO2018133556A1 (en) Method, device and apparatus implementing communication in application
CN115953597B (en) Image processing method, device, equipment and medium
CN105824658B (en) The camera model of a kind of electronic equipment starts method and electronic equipment
WO2023239299A1 (en) Image processing method and apparatus, electronic device, and storage medium
WO2017107429A1 (en) Operation processing method, apparatus and device for interconnection application, and non-volatile computer storage medium
WO2023140785A2 (en) Method and apparatus for processing special effect image, and electronic device and storage medium
US11651529B2 (en) Image processing method, apparatus, electronic device and computer readable storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16877239

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16877239

Country of ref document: EP

Kind code of ref document: A1