WO2017101355A1 - 图像处理方法及装置 - Google Patents

图像处理方法及装置 Download PDF

Info

Publication number
WO2017101355A1
WO2017101355A1 PCT/CN2016/088732 CN2016088732W WO2017101355A1 WO 2017101355 A1 WO2017101355 A1 WO 2017101355A1 CN 2016088732 W CN2016088732 W CN 2016088732W WO 2017101355 A1 WO2017101355 A1 WO 2017101355A1
Authority
WO
WIPO (PCT)
Prior art keywords
real
time
projection
miracast
parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/088732
Other languages
English (en)
French (fr)
Inventor
张亮校
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Le Holdings Beijing Co Ltd
Lemobile Information Technology (Beijing) Co Ltd
Original Assignee
Le Holdings Beijing Co Ltd
Lemobile Information Technology (Beijing) Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Le Holdings Beijing Co Ltd, Lemobile Information Technology (Beijing) Co Ltd filed Critical Le Holdings Beijing Co Ltd
Priority to US15/241,835 priority Critical patent/US20170195617A1/en
Publication of WO2017101355A1 publication Critical patent/WO2017101355A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • H04N5/775Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television receiver
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth®, RF or wireless LAN [IEEE 802.11]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44004Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440218Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440281Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/633Control signals issued by server directed to the network components or client
    • H04N21/6332Control signals issued by server directed to the network components or client directed to client
    • H04N21/6336Control signals issued by server directed to the network components or client directed to client directed to decoder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/637Control signals issued by the client directed to the server or network components
    • H04N21/6373Control signals issued by the client directed to the server or network components for rate control, e.g. request to the server to modify its transmission rate
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • H04N21/6437Real-time Transport Protocol [RTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera

Definitions

  • the present invention relates to the field of communications technologies, and in particular, to an image processing method and apparatus.
  • wireless display function (Miracast) technology can be used to wirelessly share the audio and video content of the terminal between terminals.
  • the audio and video content displayed by one terminal can be projected to another terminal for playback.
  • the terminal that projects the audio and video content is called the source end, and the terminal that projects the video and audio content is called the sink end.
  • aspects of the present invention provide an image processing method and apparatus that meet different real-time requirements of shared image content.
  • An aspect of the present invention provides an image processing method including:
  • the working mode of the Miracast includes a real-time mode or a non-real-time mode
  • the projection parameter includes at least one of a projection resolution and a projection coding rate
  • the method further includes:
  • the setting a correspondence between the working mode of the Miracast and the projection parameter includes:
  • the non-real-time mode Setting a correspondence between the non-real-time mode and at least one of a non-real-time projection resolution and a non-real-time projection coding rate, the non-real-time projection resolution being greater than or equal to a first resolution threshold, the non-real-time projection coding rate being greater than or Equal to the first coding rate threshold;
  • the first resolution threshold is greater than or equal to the second resolution threshold
  • the first coding rate threshold is greater than or equal to the second coding rate threshold.
  • the method further includes:
  • decoding buffer parameters are obtained.
  • the method before the obtaining the decoding cache parameter according to the working mode of the Miracast, the method further includes:
  • the setting a correspondence between the working mode of the Miracast and the decoding cache parameter includes:
  • the first cache threshold is greater than or equal to the second cache threshold.
  • the method further includes:
  • an image processing apparatus comprising:
  • An obtaining unit configured to acquire a working mode of a wireless display function Miracast, where the working mode of the Miracast includes a real-time mode or a non-real-time mode;
  • a matching unit configured to obtain a projection parameter according to the working mode of the Miracast;
  • the projection parameter includes at least one of a projection resolution and a projection coding rate;
  • a processing unit configured to process, by using the projection parameter, an image to be encoded acquired by a transmitting end to obtain a projected video data stream
  • a sending unit configured to send the projected video data stream to the receiving end, where the receiving end outputs the projected video data stream.
  • the non-real-time mode Setting a correspondence between the non-real-time mode and at least one of a non-real-time projection resolution and a non-real-time projection coding rate, the non-real-time projection resolution being greater than or equal to a first resolution threshold, the non-real-time projection coding rate being greater than or Equal to the first coding rate threshold;
  • the first resolution threshold is greater than or equal to the second resolution threshold
  • the first coding rate threshold is greater than or equal to the second coding rate threshold.
  • decoding buffer parameters are obtained.
  • the setting the correspondence between the working mode of the Miracast and the decoding cache parameter includes:
  • the first cache threshold is greater than or equal to the second cache threshold.
  • the working mode of the Miracast includes a real-time mode or a non-real-time mode
  • the projection parameter is obtained according to the working mode of the Miracast
  • the projection parameter includes At least one of a projection resolution and a projection coding rate, and using the projection parameter, processing the image to be encoded acquired by the transmitting end to obtain a projected video data stream, so that the projected video data can be sent to the receiving end.
  • Flow for The receiving end outputs the projected video data stream, and according to the working mode of the Miracast, the image to be encoded acquired by the transmitting end is processed by using different projection parameters, so that different real-time properties of the shared image content can be satisfied.
  • the non-real-time projection resolution corresponding to the non-real-time mode is set to the largest possible resolution supported, and/or the non-real-time projection coding corresponding to the non-real-time mode is adopted.
  • the rate is set to the largest possible encoding rate supported, and/or the non-real-time decoding buffer parameter corresponding to the non-real-time mode is set to the largest possible buffer value supported, ensuring the smoothness and picture of the receiving end.
  • the clarity of the content enables the non-real-time requirements of the shared image content to be met.
  • the real-time projection resolution corresponding to the real-time mode is set to the minimum resolution supported, and/or the real-time projection coding rate corresponding to the real-time mode is set to Support the smallest possible coding rate, and / or set the real-time decoding cache parameter corresponding to the real-time mode to the smallest possible cache value supported, ensuring that the delay of playback at the receiving end is small, so that the shared Real-time requirements for image content.
  • the image to be encoded acquired by the transmitting end can be processed by using appropriate projection parameters, which can greatly improve the user experience.
  • FIG. 1 is a schematic flowchart diagram of an image processing method according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of an image processing apparatus according to another embodiment of the present invention.
  • FIG. 3 schematically shows a block diagram of a computing device for performing an image processing method according to an embodiment of the present invention
  • Fig. 4 schematically shows a storage unit for holding or carrying program code implementing an image processing method according to an embodiment of the present invention.
  • the terminal where the transmitting end is involved in the embodiment of the present invention may include, but is not limited to, a mobile phone, a personal digital assistant (PDA), a wireless handheld device, a tablet computer, and a personal computer (Personal). Computer, PC), MP3 player, MP4 player, wearable device (for example, smart glasses, smart watches, smart bracelets, etc.).
  • the terminal where the receiving end is located may be an output device, for example, a television set, a set top box (STB), a projector, an audio, an earphone, an in-vehicle terminal, and the like.
  • FIG. 1 is a schematic flowchart of an image processing method according to an embodiment of the present invention, as shown in FIG. 1 .
  • the projection parameter includes at least one of a projection resolution and a projection coding rate.
  • the image to be encoded acquired by the transmitting end is processed by using the projection parameter to obtain a projected video data stream.
  • the Miracast technology is used for communication between the transmitting end and the receiving end.
  • the terminal that projects the audio and video content is called the transmitting end, that is, the Source end
  • the terminal that projects the audio and video content is called the receiving end, that is, the Sink. .
  • the execution body of 101 to 104 may be an application located at the terminal where the transmitting end is located, or may be a plug-in or a software development kit (SDK) installed in an application located at the terminal where the transmitting end is located.
  • SDK software development kit
  • the functional unit is not particularly limited in this embodiment.
  • the application may be a local application (nativeApp) installed on the terminal, or may be a web application (webApp) of the browser on the terminal, which is not specifically limited in this embodiment.
  • the working mode of the Miracast includes a real-time mode or a non-real-time mode
  • the projection parameters are obtained, where the projection parameters include the projection resolution and the projection coding rate.
  • the projected video data stream can process the image to be encoded acquired by the transmitting end according to the working mode of the Miracast, and can satisfy different real-time requirements of the shared image content.
  • the working mode of the Miracast may be determined according to an application run by the terminal where the transmitting end is located.
  • the application may be determined to be real-time according to an application running on the terminal where the transmitting end is located. If the application has real-time performance, for example, a video player application, etc., it is determined that the working mode of the Miracast is the real-time mode; otherwise, if the application does not have real-time performance, for example, a video game application, etc., it is determined that the working mode of the Miracast is non- Real-time mode.
  • the working mode of the Miracast corresponding to the user operation instruction may be specifically selected according to a user operation instruction.
  • a selection interface may be outputted, and the selection interface includes a control for indicating a real-time mode and a control for indicating a non-real-time mode for the user to perform a selection operation. If the user operates the The control for indicating the real-time mode determines that the working mode of the Miracast is the real-time mode; otherwise, if the user operates the control for indicating the non-real-time mode, it determines that the working mode of the Miracast is the non-real time mode.
  • the corresponding relationship between the working mode of the Miracast and the projection parameter may be further set.
  • resolution refers to the number of pixels included in an image. The higher the resolution, the more pixels the image contains and the sharper the image. Conversely, the lower the resolution, the smaller the pixels contained in the image and the more blurred the image.
  • the coding rate is also called the bit rate, which refers to the coding rate of the video source, that is, the number of bits transmitted per second, generally in units of bps.
  • bit rate refers to the coding rate of the video source, that is, the number of bits transmitted per second, generally in units of bps.
  • the correspondence between the non-real-time mode and at least one of the non-real-time projection resolution and the non-real-time projection coding rate may be set, where the non-real-time projection resolution is greater than or equal to the first resolution threshold.
  • the non-real-time projection coding rate is greater than or equal to the first coding rate threshold.
  • the non-real-time projection resolution corresponding to the non-real-time mode can be set to the largest possible resolution supported, and/or the non-real-time projection coding rate corresponding to the non-real-time mode can be set to be supported as much as possible.
  • the large coding rate ensures the smoothness of the playback at the receiving end and the clarity of the content of the picture, so that the non-real-time requirements of the shared image content can be satisfied.
  • the correspondence between the real-time mode and at least one of real-time projection resolution and real-time projection coding rate may be set, where the real-time projection resolution is smaller than the second resolution threshold, and the real-time projection The coding rate is less than the second coding rate threshold.
  • the first resolution threshold may be greater than or equal to the second resolution threshold; the first encoding rate threshold may be greater than or equal to the second encoding rate threshold. It is to be understood that the setting of the thresholds may be an empirical value, or may be an experimental value obtained by repeated verification according to an experiment, which is not particularly limited in this embodiment.
  • the real-time projection resolution corresponding to the real-time mode can be set to the minimum resolution supported, and/or the real-time projection coding rate corresponding to the real-time mode can be set to be supported.
  • the coding rate as small as possible ensures that the delay of playback at the receiving end is small, so that the real-time requirements of the shared image content can be satisfied.
  • the obtained projection parameter is the projection resolution
  • the image to be encoded obtained by performing image interception processing on the interface displayed by the terminal where the transmitting end is located may be utilized by using the obtained projection resolution.
  • a series of conversion processes are performed to obtain a projected image of the projection resolution.
  • the obtained projection image is subjected to video coding processing to obtain a projected video data stream, which is sent to the receiving end for output.
  • the obtained projection parameter is the projection coding rate
  • the image to be encoded obtained by performing image interception processing on the interface displayed by the terminal at the transmitting end may be performed by using the default projection resolution.
  • a series of conversion processes to obtain a projected image of the projection resolution may be performed by using the obtained projection coding rate.
  • the obtained projection image is subjected to video coding processing to obtain a projected video data stream, which is sent to the receiving end for output.
  • the obtained projection parameters are the projection resolution and the projection coding rate
  • the obtained projection resolution can be used to perform image interception processing on the interface displayed by the terminal at the transmitting end.
  • the image to be encoded is subjected to a series of conversion processes to obtain a projected image of the projection resolution.
  • the obtained projection image is subjected to video coding processing to obtain a projected video data stream, which is sent to the receiving end for output.
  • the decoding cache parameter may be further obtained according to the working mode of the Miracast.
  • the correspondence between the working mode of the Miracast and the decoding cache parameter may be further set.
  • the correspondence between the non-real-time mode and the non-real-time decoding cache parameter may be specifically set, where the non-real-time decoding cache parameter is greater than or equal to the first cache threshold.
  • the non-real-time decoding cache parameter corresponding to the non-real-time mode can be set to the largest possible cache value supported, thereby ensuring the smoothness of the playback of the receiving end and the clarity of the content of the screen, so that the shared image can be satisfied.
  • Non-real time requirements for content can be set to the largest possible cache value supported, thereby ensuring the smoothness of the playback of the receiving end and the clarity of the content of the screen, so that the shared image can be satisfied.
  • the real-time mode and the real-time decoding cache parameter can be specifically set.
  • the correspondence between the numbers, the real-time decoding cache parameter is smaller than the second cache threshold.
  • the first cache threshold may be greater than or equal to the second cache threshold. It is to be understood that the setting of the thresholds may be an empirical value, or may be an experimental value obtained by repeated verification according to an experiment, which is not particularly limited in this embodiment.
  • the delay of playing at the receiving end is small, so that the real-time requirement of the shared image content can be satisfied.
  • the decoding buffer parameter may be further sent to the receiving end, where the receiving end uses the decoding buffer parameter to set and store the projection video.
  • a buffer of the data stream, the projected video data stream in the buffer area being output.
  • the data interaction between the transmitting end and the receiving end is performed based on the created session and using Real Time Streaming Protocol (RTSP).
  • RTSP Real Time Streaming Protocol
  • the working mode of the Miracast includes a real-time mode or a non-real-time mode, and then, according to the working mode of the Miracast, obtaining a projection parameter, where the projection parameter includes a projection resolution and a projection coding.
  • the projection parameter includes a projection resolution and a projection coding.
  • the non-real-time projection resolution corresponding to the non-real-time mode is set to the largest possible resolution supported, and/or the non-real-time projection coding corresponding to the non-real-time mode is adopted.
  • the rate is set to the largest possible encoding rate supported, and/or the non-real-time decoding buffer parameter corresponding to the non-real-time mode is set to the largest possible buffer value supported, ensuring the smoothness and picture of the receiving end.
  • the clarity of the content enables the non-real-time requirements of the shared image content to be met.
  • the real-time projection resolution corresponding to the real-time mode is set to the minimum resolution supported, and/or the real-time projection coding rate corresponding to the real-time mode is set to Support the smallest possible coding rate, and / or set the real-time decoding cache parameter corresponding to the real-time mode to the smallest possible cache value supported, ensuring that the delay of playback at the receiving end is small, so that the shared Real-time requirements for image content.
  • the image to be encoded acquired by the transmitting end can be processed by using appropriate projection parameters, which can greatly improve the user experience.
  • FIG. 2 is a schematic structural diagram of an image processing apparatus according to another embodiment of the present invention, as shown in FIG. 2 .
  • the image processing apparatus of the present embodiment may include an acquisition unit 21, a matching unit 22, a processing unit 23, and a transmission unit 24.
  • the obtaining unit 21 is configured to acquire a working mode of the wireless display function Miracast, and the working mode of the Miracast includes a real-time mode or a non-real-time mode.
  • the matching unit 22 is configured to obtain a projection parameter according to the working mode of the Miracast.
  • the projection parameter includes at least one of a projection resolution and a projection coding rate; the processing unit 23 is configured to process, by using the projection parameter, the image to be encoded acquired by the transmitting end to obtain a projected video data stream; 24, configured to send the projected video data stream to a receiving end, where the receiving end outputs the projected video data stream.
  • the image processing apparatus of this embodiment may be an application located at a terminal where the transmitting end is located, or may be a plug-in or a software development kit (SDK) installed in an application located at the terminal where the transmitting end is located.
  • SDK software development kit
  • the functional unit is not particularly limited in this embodiment.
  • the application can be a local program installed on the terminal (nativeApp). Alternatively, it may be a webpage program (webApp) of the browser on the terminal, which is not specifically limited in this embodiment.
  • the matching unit 22 may be further configured to set a correspondence between the working mode of the Miracast and the projection parameter.
  • the matching unit 22 may be specifically configured to set a correspondence between the non-real-time mode and at least one of a non-real-time projection resolution and a non-real-time projection coding rate, where the non-real-time projection resolution is greater than or equal to the first a resolution threshold, the non-real-time projection coding rate being greater than or equal to the first coding rate threshold; and/or setting a correspondence between the real-time mode and at least one of a real-time projection resolution and a real-time projection coding rate, the real-time projection resolution The rate is less than the second resolution threshold, the real-time projection coding rate is less than the second coding rate threshold; wherein the first resolution threshold is greater than or equal to the second resolution threshold; the first coding rate threshold is greater than or Equal to the second coding rate threshold.
  • the matching unit 22 may be further configured to obtain a decoding cache parameter according to the working mode of the Miracast.
  • the matching unit 22 may be further configured to set a correspondence between the working mode of the Miracast and the decoding cache parameter.
  • the matching unit 22 may be specifically configured to set a correspondence between a non-real-time mode and a non-real-time decoding cache parameter, where the non-real-time decoding cache parameter is greater than or equal to a first cache threshold; and/or set a real-time mode and real-time. Decoding a cached parameter, the real-time decoding cache parameter is smaller than a second cache threshold; wherein the first cache threshold is greater than or equal to the second cache threshold.
  • the sending unit 24 is further configured to send the decoding cache parameter to the receiving end, where the receiving end uses the decoding buffer parameter to set a buffer area for storing the projected video data stream. And outputting the projected video data stream in the buffer area.
  • the working mode of the Miracast is obtained by the acquiring unit, and the working mode of the Miracast includes a real-time mode or a non-real-time mode, and then the matching unit according to the Miracast a working mode of obtaining a projection parameter, the projection parameter comprising at least one of a projection resolution and a projection coding rate, and the processing unit uses the projection parameter to process the image to be encoded acquired by the transmitting end to obtain Projecting a video data stream, so that the sending unit can send the projected video data stream to the receiving end, so that the receiving end outputs the projected video data stream, because different projection parameters can be used according to the working mode of the Miracast
  • the acquired image to be encoded is processed, and therefore, different real-time requirements of the shared image content can be satisfied.
  • the non-real-time projection resolution corresponding to the non-real-time mode is set to the largest possible resolution supported, and/or the non-real-time projection coding corresponding to the non-real-time mode is adopted.
  • the rate is set to the largest possible encoding rate supported, and/or the non-real-time decoding buffer parameter corresponding to the non-real-time mode is set to the largest possible buffer value supported, ensuring the smoothness and picture of the receiving end.
  • the clarity of the content enables the non-real-time requirements of the shared image content to be met.
  • the real-time projection resolution corresponding to the real-time mode is set to the minimum resolution supported, and/or the real-time projection coding rate corresponding to the real-time mode is set to Support the smallest possible coding rate, and / or set the real-time decoding cache parameter corresponding to the real-time mode to the smallest possible cache value supported, ensuring that the delay of playback at the receiving end is small, so that the shared Real-time requirements for image content.
  • the image to be encoded acquired by the transmitting end can be processed by using appropriate projection parameters, which can greatly improve the user experience.
  • modules in the devices of the embodiments can be adaptively changed and placed in one or more devices different from the embodiment.
  • the modules or units or components of the embodiments may be combined into one module or unit or component, and further they may be divided into a plurality of sub-modules or sub-units or sub-components.
  • any combination of the features disclosed in the specification, including the accompanying claims, the abstract and the drawings, and any methods so disclosed, or All processes or units of the device are combined.
  • Each feature disclosed in this specification (including the accompanying claims, the abstract and the drawings) may be replaced by alternative features that provide the same, equivalent or similar purpose.
  • the various component embodiments of the present invention may be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof.
  • a microprocessor or digital signal processor may be used in practice to implement some or all of the functionality of some or all of the components in accordance with embodiments of the present invention.
  • the invention can also be implemented as a device or device program (e.g., a computer program and a computer program product) for performing some or all of the methods described herein.
  • a program implementing the invention may be stored on a computer readable medium or may be in the form of one or more signals.
  • Such signals may be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.
  • Figure 3 illustrates a computing device that can implement an image processing method in accordance with the present invention.
  • the computing device traditionally includes a processor 310 and a computer program product or computer readable medium in the form of a storage device 320.
  • the storage device 320 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, a hard disk, or a ROM.
  • Storage device 320 has a storage space 330 that stores program code 331 for performing any of the method steps described above.
  • storage space 330 storing program code may include various program code 331 for implementing various steps in the above methods, respectively.
  • the program code can be read from or written to one or more computer program products.
  • These computer program products include program code carriers such as a hard disk, a compact disk (CD), a memory card, or a floppy disk.
  • Such computer program products are typically portable or fixed storage units such as those shown in FIG.
  • the storage unit may have storage segments, storage spaces, and the like that are similarly arranged to storage device 320 in the computing device of FIG.
  • the program code can be compressed, for example, in an appropriate form.
  • the storage unit comprises computer readable code 331' for performing the steps of the method according to the invention, ie code that can be read by a processor such as 310, which when executed by the computing device causes the computing device Perform the various steps in the method described above.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

公开了一种图像处理方法及装置。通过获取Miracast的工作模式,所述Miracast的工作模式包括实时模式或非实时模式,进而根据所述Miracast的工作模式,获得投射参数,所述投射参数包括投射分辨率和投射编码率中的至少一项,并利用所述投射参数,对传送端所获取的待编码图像进行处理,以获得投射视频数据流,使得能够向接收端发送所述投射视频数据流,以供所述接收端输出所述投射视频数据流。

Description

图像处理方法及装置
相关申请的交叉参考
本申请要求于2015年12月18日提交中国专利局、申请号为2015109590545、发明名称为“图像处理方法及装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本发明涉及通信技术领域,具体涉及一种图像处理方法及装置。
背景技术
通常,可以采用无线显示功能(Miracast)技术,在终端之间无线分享终端的影音内容。在Miracast系统中,可以将一个终端所显示的影音内容投射到另一个终端进行播放,投射影音内容的终端称之为传送端即Source端,被投射影音内容的终端称之为接收端即Sink。
然而,由于用户对所分享的图像内容具有不同的实时性要求,例如,观看影视作品或参与视频游戏等,因此,亟需提供一种图像处理方法,以满足所分享的图像内容的不同实时性要求。
发明内容
本发明的多个方面提供一种图像处理方法及装置,以满足所分享的图像内容的不同实时性要求。
本发明的一方面,提供一种图像处理方法,包括:
获取无线显示功能Miracast的工作模式,所述Miracast的工作模式包括实时模式或非实时模式;
根据所述Miracast的工作模式,获得投射参数;所述投射参数包括投射分辨率和投射编码率中的至少一项;
利用所述投射参数,对传送端所获取的待编码图像进行处理,以获得投 射视频数据流;
向接收端发送所述投射视频数据流,以供所述接收端输出所述投射视频数据流。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述根据所述Miracast的工作模式,获得投射参数之前,还包括:
设置所述Miracast的工作模式与所述投射参数的对应关系。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述设置所述Miracast的工作模式与所述投射参数的对应关系,包括:
设置非实时模式与非实时投射分辨率和非实时投射编码率中的至少一项的对应关系,所述非实时投射分辨率大于或等于第一分辨率阈值,所述非实时投射编码率大于或等于第一编码率阈值;和/或
设置实时模式与实时投射分辨率和实时投射编码率中的至少一项的对应关系,所述实时投射分辨率小于第二分辨率阈值,所述实时投射编码率小于第二编码率阈值;其中,
所述第一分辨率阈值大于或等于所述第二分辨率阈值;
所述第一编码率阈值大于或等于所述第二编码率阈值。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述获取无线显示功能Miracast的工作模式之后,还包括:
根据所述Miracast的工作模式,获得解码缓存参数。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述根据所述Miracast的工作模式,获得解码缓存参数之前,还包括:
设置所述Miracast的工作模式与所述解码缓存参数的对应关系。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述设置所述Miracast的工作模式与所述解码缓存参数的对应关系,包括:
设置非实时模式与非实时解码缓存参数的对应关系,所述非实时解码缓存参数大于或等于第一缓存阈值;和/或
设置实时模式与实时解码缓存参数的对应关系,所述实时解码缓存参数 小于第二缓存阈值;其中,
所述第一缓存阈值大于或等于所述第二缓存阈值。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述根据所述Miracast的工作模式,获得解码缓存参数之后,还包括:
向所述接收端发送所述解码缓存参数,以供所述接收端利用所述解码缓存参数,设置存储所述投射视频数据流的缓存区,输出所述缓存区中的所述投射视频数据流。
本发明的另一方面,提供一种图像处理装置,包括:
获取单元,用于获取无线显示功能Miracast的工作模式,所述Miracast的工作模式包括实时模式或非实时模式;
匹配单元,用于根据所述Miracast的工作模式,获得投射参数;所述投射参数包括投射分辨率和投射编码率中的至少一项;
处理单元,用于利用所述投射参数,对传送端所获取的待编码图像进行处理,以获得投射视频数据流;
发送单元,用于向接收端发送所述投射视频数据流,以供所述接收端输出所述投射视频数据流。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述匹配单元,还用于
设置所述Miracast的工作模式与所述投射参数的对应关系。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述匹配单元,具体用于
设置非实时模式与非实时投射分辨率和非实时投射编码率中的至少一项的对应关系,所述非实时投射分辨率大于或等于第一分辨率阈值,所述非实时投射编码率大于或等于第一编码率阈值;和/或
设置实时模式与实时投射分辨率和实时投射编码率中的至少一项的对应关系,所述实时投射分辨率小于第二分辨率阈值,所述实时投射编码率小于第二编码率阈值;其中,
所述第一分辨率阈值大于或等于所述第二分辨率阈值;
所述第一编码率阈值大于或等于所述第二编码率阈值。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述匹配单元,还用于
根据所述Miracast的工作模式,获得解码缓存参数。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述匹配单元,还用于
设置所述Miracast的工作模式与所述解码缓存参数的对应关系。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述匹配单元,具体用于
所述设置所述Miracast的工作模式与所述解码缓存参数的对应关系,包括:
设置非实时模式与非实时解码缓存参数的对应关系,所述非实时解码缓存参数大于或等于第一缓存阈值;和/或
设置实时模式与实时解码缓存参数的对应关系,所述实时解码缓存参数小于第二缓存阈值;其中,
所述第一缓存阈值大于或等于所述第二缓存阈值。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述发送单元,还用于
向所述接收端发送所述解码缓存参数,以供所述接收端利用所述解码缓存参数,设置存储所述投射视频数据流的缓存区,输出所述缓存区中的所述投射视频数据流。
由所述技术方案可知,本发明实施例通过获取Miracast的工作模式,所述Miracast的工作模式包括实时模式或非实时模式,进而根据所述Miracast的工作模式,获得投射参数,所述投射参数包括投射分辨率和投射编码率中的至少一项,并利用所述投射参数,对传送端所获取的待编码图像进行处理,以获得投射视频数据流,使得能够向接收端发送所述投射视频数据流,以供 所述接收端输出所述投射视频数据流,由于能够根据Miracast的工作模式,采用不同的投射参数对传送端所获取的待编码图像进行处理,因此,能够满足所分享的图像内容的不同实时性要求。
另外,采用本发明所提供的技术方案,通过将非实时模式所对应的非实时投射分辨率设置为所支持的尽可能大的分辨率,和/或将非实时模式所对应的非实时投射编码率设置为所支持的尽可能大的编码率,和/或将非实时模式所对应的非实时解码缓存参数设置为所支持的尽可能大的缓存值,保证了接收端播放的流畅性和画面内容的清晰程度,使得能够满足所分享的图像内容的非实时性要求。
另外,采用本发明所提供的技术方案,通过将实时模式所对应的实时投射分辨率设置为所支持的尽可能小的分辨率,和/或将实时模式所对应的实时投射编码率设置为所支持的尽可能小的编码率,和/或将实时模式所对应的实时解码缓存参数设置为所支持的尽可能小的缓存值,保证了接收端播放的延时小,使得能够满足所分享的图像内容的实时性要求。
另外,采用本发明所提供的技术方案,能够根据Miracast的工作模式,采用恰当的投射参数对传送端所获取的待编码图像进行处理,能够极大提升用户体验。
上述说明仅是本发明技术方案的概述,为了能够更清楚了解本发明的技术手段,而可依照说明书的内容予以实施,并且为了让本发明的上述和其它目的、特征和优点能够更明显易懂,以下特举本发明的具体实施方式。
附图概述
通过阅读下文优选实施方式的详细描述,各种其他的优点和益处对于本领域普通技术人员将变得清楚明了。附图仅用于示出优选实施方式的目的,而并不认为是对本发明的限制。而且在整个附图中,用相同的参考符号表示相同的部件。在附图中:
图1为本发明一实施例提供的图像处理方法的流程示意图;
图2为本发明另一实施例提供的图像处理装置的结构示意图;
图3示意性地示出了用于执行根据本发明实施例的图像处理方法的计算设备的框图;
图4示意性地示出了用于保持或者携带实现根据本发明实施例的图像处理方法的程序代码的存储单元。
本发明的较佳实施方式
下面将参照附图更详细地描述本公开的示例性实施例。虽然附图中显示了本公开的示例性实施例,然而应当理解,可以以各种形式实现本公开而不应被这里阐述的实施例所限制。相反,提供这些实施例是为了能够更透彻地理解本公开,并且能够将本公开的范围完整的传达给本领域的技术人员。
需要说明的是,本发明实施例中所涉及的传送端所在终端可以包括但不限于手机、个人数字助理(Personal Digital Assistant,PDA)、无线手持设备、平板电脑(Tablet Computer)、个人电脑(Personal Computer,PC)、MP3播放器、MP4播放器、可穿戴设备(例如,智能眼镜、智能手表、智能手环等)等。接收端所在终端可以为输出设备,例如,电视机、机顶盒(Set Top Box,STB)、投影仪、音响、耳机、车载终端等。
另外,本文中术语“和/或”,仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。另外,本文中字符“/”,一般表示前后关联对象是一种“或”的关系。
图1为本发明一实施例提供的图像处理方法的流程示意图,如图1所示。
101、获取无线显示功能(Miracast)的工作模式,所述Miracast的工作模式包括实时模式或非实时模式。
102、根据所述Miracast的工作模式,获得投射参数;所述投射参数包括投射分辨率和投射编码率中的至少一项。
103、利用所述投射参数,对传送端所获取的待编码图像进行处理,以获得投射视频数据流。
104、向接收端发送所述投射视频数据流,以供所述接收端输出所述投 射视频数据流。
需要说明的是,传送端与接收端之间采用Miracast技术进行通信,在Miracast系统中,投射影音内容的终端称之为传送端即Source端,被投射影音内容的终端称之为接收端即Sink。
需要说明的是,101~104的执行主体可以为位于传送端所在终端的应用,或者还可以为设置在位于传送端所在终端的应用中的插件或软件开发工具包(Software Development Kit,SDK)等功能单元,本实施例对此不进行特别限定。
可以理解的是,所述应用可以是安装在终端上的本地程序(nativeApp),或者还可以是终端上的浏览器的一个网页程序(webApp),本实施例对此不进行特别限定。
这样,通过获取Miracast的工作模式,所述Miracast的工作模式包括实时模式或非实时模式,进而根据所述Miracast的工作模式,获得投射参数,所述投射参数包括投射分辨率和投射编码率中的至少一项,并利用所述投射参数,对传送端所获取的待编码图像进行处理,以获得投射视频数据流,使得能够向接收端发送所述投射视频数据流,以供所述接收端输出所述投射视频数据流,由于能够根据Miracast的工作模式,采用不同的投射参数对传送端所获取的待编码图像进行处理,因此,能够满足所分享的图像内容的不同实时性要求。
可选地,在本实施例的一个可能的实现方式中,在101中,具体可以根据传送端所在终端所运行的应用,确定Miracast的工作模式。具体来说,具体可以根据传送端所在终端所运行的应用,确定该应用是否具有实时性。若该应用具有实时性例如,影音播放器类应用等,则确定Miracast的工作模式为实时模式;否则,若该应用不具有实时性例如,视频游戏类应用等,则确定Miracast的工作模式为非实时模式。
可选地,在本实施例的一个可能的实现方式中,在101中,具体可以根据用户操作指令,选择该用户操作指令所对应的Miracast的工作模式。具体来说,具体可以输出一个选择界面,该选择界面中包含用于指示实时模式的控件和用于指示非实时模式的控件,供用户进行选择操作。若用户操作所述 用于指示实时模式的控件,则确定Miracast的工作模式为实时模式;否则,若用户操作所述用于指示非实时模式的控件,则确定Miracast的工作模式为非实时模式。
可选地,在本实施例的一个可能的实现方式中,在102之前,还可以进一步设置所述Miracast的工作模式与所述投射参数的对应关系。
所谓的分辨率,是指图像所包含的像素个数。分辨率越高,图像所包含的像素就越多,图像就越清晰,反之分辨率越低,图像所包含的像素就越小,图像就越模糊。
所谓的编码率,编码率也叫比特率,是指视频源的编码速率即每秒传送的比特(bit)数,一般以bps为单位。编码率越高,画面越清晰,反之编码率越低,画面越模糊。
在一个具体的实现过程中,具体可以设置非实时模式与非实时投射分辨率和非实时投射编码率中的至少一项的对应关系,所述非实时投射分辨率大于或等于第一分辨率阈值,所述非实时投射编码率大于或等于第一编码率阈值。
这样,可以通过将非实时模式所对应的非实时投射分辨率设置为所支持的尽可能大的分辨率,和/或将非实时模式所对应的非实时投射编码率设置为所支持的尽可能大的编码率,保证了接收端播放的流畅性和画面内容的清晰程度,使得能够满足所分享的图像内容的非实时性要求。
在另一个具体的实现过程中,具体可以设置实时模式与实时投射分辨率和实时投射编码率中的至少一项的对应关系,所述实时投射分辨率小于第二分辨率阈值,所述实时投射编码率小于第二编码率阈值。
其中,所述第一分辨率阈值可以大于或等于所述第二分辨率阈值;所述第一编码率阈值可以大于或等于所述第二编码率阈值。可以理解的是,这些阈值的设置,可以为一经验数值,或者还可以为根据实验反复验证所获得的实验数值,本实施例对此不进行特别限定。
这样,可以通过将实时模式所对应的实时投射分辨率设置为所支持的尽可能小的分辨率,和/或将实时模式所对应的实时投射编码率设置为所支持 的尽可能小的编码率,保证了接收端播放的延时小,使得能够满足所分享的图像内容的实时性要求。
本发明中,如果获得的投射参数为投射分辨率,在获得投射参数之后,则可以利用所获得的投射分辨率,对传送端所在终端所显示的界面进行图像截取处理所获得的待编码图像,进行一系列转换处理,以获得该投射分辨率的投射图像。然后,再利用默认的投射编码率,对所获得的投射图像进行视频编码处理,以获得投射视频数据流,发送给所述接收端进行输出。
本发明中,如果获得的投射参数为投射编码率,在获得投射参数之后,则可以利用默认的投射分辨率,对传送端所在终端所显示的界面进行图像截取处理所获得的待编码图像,进行一系列转换处理,以获得该投射分辨率的投射图像。然后,再利用所获得的投射编码率,对所获得的投射图像进行视频编码处理,以获得投射视频数据流,发送给所述接收端进行输出。
本发明中,如果获得的投射参数为投射分辨率和投射编码率,在获得投射参数之后,则可以利用所获得的投射分辨率,对传送端所在终端所显示的界面进行图像截取处理所获得的待编码图像,进行一系列转换处理,以获得该投射分辨率的投射图像。然后,再利用所获得的投射编码率,对所获得的投射图像进行视频编码处理,以获得投射视频数据流,发送给所述接收端进行输出。
可选地,在本实施例的一个可能的实现方式中,在101之后,还可以进一步根据所述Miracast的工作模式,获得解码缓存参数。
在该实现方式之前,还可以进一步设置所述Miracast的工作模式与所述解码缓存参数的对应关系。
在一个具体的实现过程中,具体可以设置非实时模式与非实时解码缓存参数的对应关系,所述非实时解码缓存参数大于或等于第一缓存阈值。
这样,可以通过将非实时模式所对应的非实时解码缓存参数设置为所支持的尽可能大的缓存值,保证了接收端播放的流畅性和画面内容的清晰程度,使得能够满足所分享的图像内容的非实时性要求。
在另一个具体的实现过程中,具体可以设置实时模式与实时解码缓存参 数的对应关系,所述实时解码缓存参数小于第二缓存阈值。
其中,所述第一缓存阈值可以大于或等于所述第二缓存阈值。可以理解的是,这些阈值的设置,可以为一经验数值,或者还可以为根据实验反复验证所获得的实验数值,本实施例对此不进行特别限定。
这样,可以通过将实时模式所对应的实时解码缓存参数设置为所支持的尽可能小的缓存值,保证了接收端播放的延时小,使得能够满足所分享的图像内容的实时性要求。
相应地,在该实现方式中,在获得解码缓存参数之后,还可以进一步向所述接收端发送所述解码缓存参数,以供所述接收端利用所述解码缓存参数,设置存储所述投射视频数据流的缓存区,输出所述缓存区中的所述投射视频数据流。
需要说明的是,本发明中,传送端与接收端之间的数据交互,都是基于所创建的会话(Session),并采用实时流传输协议(Real Time Streaming Protocol,RTSP)来进行的。
本实施例中,通过获取Miracast的工作模式,所述Miracast的工作模式包括实时模式或非实时模式,进而根据所述Miracast的工作模式,获得投射参数,所述投射参数包括投射分辨率和投射编码率中的至少一项,并利用所述投射参数,对传送端所获取的待编码图像进行处理,以获得投射视频数据流,使得能够向接收端发送所述投射视频数据流,以供所述接收端输出所述投射视频数据流,由于能够根据Miracast的工作模式,采用不同的投射参数对传送端所获取的待编码图像进行处理,因此,能够满足所分享的图像内容的不同实时性要求。
另外,采用本发明所提供的技术方案,通过将非实时模式所对应的非实时投射分辨率设置为所支持的尽可能大的分辨率,和/或将非实时模式所对应的非实时投射编码率设置为所支持的尽可能大的编码率,和/或将非实时模式所对应的非实时解码缓存参数设置为所支持的尽可能大的缓存值,保证了接收端播放的流畅性和画面内容的清晰程度,使得能够满足所分享的图像内容的非实时性要求。
另外,采用本发明所提供的技术方案,通过将实时模式所对应的实时投射分辨率设置为所支持的尽可能小的分辨率,和/或将实时模式所对应的实时投射编码率设置为所支持的尽可能小的编码率,和/或将实时模式所对应的实时解码缓存参数设置为所支持的尽可能小的缓存值,保证了接收端播放的延时小,使得能够满足所分享的图像内容的实时性要求。
另外,采用本发明所提供的技术方案,能够根据Miracast的工作模式,采用恰当的投射参数对传送端所获取的待编码图像进行处理,能够极大提升用户体验。
需要说明的是,对于前述的各方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本发明并不受所描述的动作顺序的限制,因为依据本发明,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作和模块并不一定是本发明所必须的。
在所述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。
图2为本发明另一实施例提供的图像处理装置的结构示意图,如图2所示。本实施例的图像处理装置可以包括获取单元21、匹配单元22、处理单元23和发送单元24。其中,获取单元21,用于获取无线显示功能Miracast的工作模式,所述Miracast的工作模式包括实时模式或非实时模式;匹配单元22,用于根据所述Miracast的工作模式,获得投射参数;所述投射参数包括投射分辨率和投射编码率中的至少一项;处理单元23,用于利用所述投射参数,对传送端所获取的待编码图像进行处理,以获得投射视频数据流;发送单元24,用于向接收端发送所述投射视频数据流,以供所述接收端输出所述投射视频数据流。
需要说明的是,本实施例的图像处理装置可以为位于传送端所在终端的应用,或者还可以为设置在位于传送端所在终端的应用中的插件或软件开发工具包(Software Development Kit,SDK)等功能单元,本实施例对此不进行特别限定。
可以理解的是,所述应用可以是安装在终端上的本地程序(nativeApp), 或者还可以是终端上的浏览器的一个网页程序(webApp),本实施例对此不进行特别限定。
可选地,在本实施例的一个可能的实现方式中,所述匹配单元22,还可以进一步用于设置所述Miracast的工作模式与所述投射参数的对应关系。
具体地,所述匹配单元22,具体可以用于设置非实时模式与非实时投射分辨率和非实时投射编码率中的至少一项的对应关系,所述非实时投射分辨率大于或等于第一分辨率阈值,所述非实时投射编码率大于或等于第一编码率阈值;和/或设置实时模式与实时投射分辨率和实时投射编码率中的至少一项的对应关系,所述实时投射分辨率小于第二分辨率阈值,所述实时投射编码率小于第二编码率阈值;其中,所述第一分辨率阈值大于或等于所述第二分辨率阈值;所述第一编码率阈值大于或等于所述第二编码率阈值。
可选地,在本实施例的一个可能的实现方式中,所述匹配单元22,还可以进一步用于根据所述Miracast的工作模式,获得解码缓存参数。
在该实现方式之前,所述匹配单元22,还可以进一步用于设置所述Miracast的工作模式与所述解码缓存参数的对应关系。
具体地,所述匹配单元22,具体可以用于设置非实时模式与非实时解码缓存参数的对应关系,所述非实时解码缓存参数大于或等于第一缓存阈值;和/或设置实时模式与实时解码缓存参数的对应关系,所述实时解码缓存参数小于第二缓存阈值;其中,所述第一缓存阈值大于或等于所述第二缓存阈值。
相应地,所述发送单元24,还可以进一步用于向所述接收端发送所述解码缓存参数,以供所述接收端利用所述解码缓存参数,设置存储所述投射视频数据流的缓存区,输出所述缓存区中的所述投射视频数据流。
需要说明的是,图1对应的实施例中方法,可以由本实施例提供的图像处理装置实现。详细描述可以参见图1对应的实施例中的相关内容,此处不再赘述。
本实施例中,通过获取单元获取Miracast的工作模式,所述Miracast的工作模式包括实时模式或非实时模式,进而由匹配单元根据所述Miracast 的工作模式,获得投射参数,所述投射参数包括投射分辨率和投射编码率中的至少一项,并由处理单元利用所述投射参数,对传送端所获取的待编码图像进行处理,以获得投射视频数据流,使得发送单元能够向接收端发送所述投射视频数据流,以供所述接收端输出所述投射视频数据流,由于能够根据Miracast的工作模式,采用不同的投射参数对传送端所获取的待编码图像进行处理,因此,能够满足所分享的图像内容的不同实时性要求。
另外,采用本发明所提供的技术方案,通过将非实时模式所对应的非实时投射分辨率设置为所支持的尽可能大的分辨率,和/或将非实时模式所对应的非实时投射编码率设置为所支持的尽可能大的编码率,和/或将非实时模式所对应的非实时解码缓存参数设置为所支持的尽可能大的缓存值,保证了接收端播放的流畅性和画面内容的清晰程度,使得能够满足所分享的图像内容的非实时性要求。
另外,采用本发明所提供的技术方案,通过将实时模式所对应的实时投射分辨率设置为所支持的尽可能小的分辨率,和/或将实时模式所对应的实时投射编码率设置为所支持的尽可能小的编码率,和/或将实时模式所对应的实时解码缓存参数设置为所支持的尽可能小的缓存值,保证了接收端播放的延时小,使得能够满足所分享的图像内容的实时性要求。
另外,采用本发明所提供的技术方案,能够根据Miracast的工作模式,采用恰当的投射参数对传送端所获取的待编码图像进行处理,能够极大提升用户体验。
在此提供的算法和显示不与任何特定计算机、虚拟系统或者其它设备固有相关。各种通用系统也可以与基于在此的示教一起使用。根据上面的描述,构造这类系统所要求的结构是显而易见的。此外,本发明也不针对任何特定编程语言。应当明白,可以利用各种编程语言实现在此描述的本发明的内容,并且上面对特定语言所做的描述是为了披露本发明的最佳实施方式。
在此处所提供的说明书中,说明了大量具体细节。然而,能够理解,本发明的实施例可以在没有这些具体细节的情况下实践。在一些实例中,并未详细示出公知的方法、结构和技术,以便不模糊对本说明书的理解。
类似地,应当理解,为了精简本公开并帮助理解各个发明方面中的一个 或多个,在上面对本发明的示例性实施例的描述中,本发明的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。然而,并不应将该公开的方法解释成反映如下意图:即所要求保护的本发明要求比在每个权利要求中所明确记载的特征更多的特征。更确切地说,如下面的权利要求书所反映的那样,发明方面在于少于前面公开的单个实施例的所有特征。因此,遵循具体实施方式的权利要求书由此明确地并入该具体实施方式,其中每个权利要求本身都作为本发明的单独实施例。
本领域那些技术人员可以理解,可以对实施例中的设备中的模块进行自适应性地改变并且把它们设置在与该实施例不同的一个或多个设备中。可以把实施例中的模块或单元或组件组合成一个模块或单元或组件,以及此外可以把它们分成多个子模块或子单元或子组件。除了这样的特征和/或过程或者单元中的至少一些是相互排斥之外,可以采用任何组合对本说明书(包括伴随的权利要求、摘要和附图)中公开的所有特征以及如此公开的任何方法或者设备的所有过程或单元进行组合。除非另外明确陈述,本说明书(包括伴随的权利要求、摘要和附图)中公开的每个特征可以由提供相同、等同或相似目的的替代特征来代替。
此外,本领域的技术人员能够理解,尽管在此所述的一些实施例包括其它实施例中所包括的某些特征而不是其它特征,但是不同实施例的特征的组合意味着处于本发明的范围之内并且形成不同的实施例。例如,在下面的权利要求书中,所要求保护的实施例的任意之一都可以以任意的组合方式来使用。
本发明的各个部件实施例可以以硬件实现,或者以在一个或者多个处理器上运行的软件模块实现,或者以它们的组合实现。本领域的技术人员应当理解,可以在实践中使用微处理器或者数字信号处理器(DSP)来实现根据本发明实施例中的一些或者全部部件的一些或者全部功能。本发明还可以实现为用于执行这里所描述的方法的一部分或者全部的设备或者装置程序(例如,计算机程序和计算机程序产品)。这样的实现本发明的程序可以存储在计算机可读介质上,或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到,或者在载体信号上提供,或者以任何其他形式提供。
例如,图3示出了可以实现根据本发明的图像处理方法的计算设备。该计算设备传统上包括处理器310和以存储设备320形式的计算机程序产品或者计算机可读介质。存储设备320可以是诸如闪存、EEPROM(电可擦除可编程只读存储器)、EPROM、硬盘或者ROM之类的电子存储器。存储设备320具有存储用于执行上述方法中的任何方法步骤的程序代码331的存储空间330。例如,存储程序代码的存储空间330可以包括分别用于实现上面的方法中的各种步骤的各个程序代码331。这些程序代码可以从一个或者多个计算机程序产品中读出或者写入到这一个或者多个计算机程序产品中。这些计算机程序产品包括诸如硬盘、紧致盘(CD)、存储卡或者软盘之类的程序代码载体。这样的计算机程序产品通常为例如图4所示的便携式或者固定存储单元。该存储单元可以具有与图3的计算设备中的存储设备320类似布置的存储段、存储空间等。程序代码可以例如以适当形式进行压缩。通常,存储单元包括用于执行根据本发明的方法步骤的计算机可读代码331',即可以由诸如310之类的处理器读取的代码,当这些代码由计算设备运行时,导致该计算设备执行上面所描述的方法中的各个步骤。
应该注意的是上述实施例对本发明进行说明而不是对本发明进行限制,并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中,不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”不排除存在未列在权利要求中的元件或步骤。位于元件之前的单词“一”或“一个”不排除存在多个这样的元件。本发明可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中,这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。

Claims (14)

  1. 一种图像处理方法,其特征在于,包括:
    获取无线显示功能Miracast的工作模式,所述Miracast的工作模式包括实时模式或非实时模式;
    根据所述Miracast的工作模式,获得投射参数;所述投射参数包括投射分辨率和投射编码率中的至少一项;
    利用所述投射参数,对传送端所获取的待编码图像进行处理,以获得投射视频数据流;
    向接收端发送所述投射视频数据流,以供所述接收端输出所述投射视频数据流。
  2. 根据权利要求1所述的方法,其特征在于,所述根据所述Miracast的工作模式,获得投射参数之前,还包括:
    设置所述Miracast的工作模式与所述投射参数的对应关系。
  3. 根据权利要求2所述的方法,其特征在于,所述设置所述Miracast的工作模式与所述投射参数的对应关系,包括:
    设置非实时模式与非实时投射分辨率和非实时投射编码率中的至少一项的对应关系,所述非实时投射分辨率大于或等于第一分辨率阈值,所述非实时投射编码率大于或等于第一编码率阈值;和/或
    设置实时模式与实时投射分辨率和实时投射编码率中的至少一项的对应关系,所述实时投射分辨率小于第二分辨率阈值,所述实时投射编码率小于第二编码率阈值;其中,
    所述第一分辨率阈值大于或等于所述第二分辨率阈值;
    所述第一编码率阈值大于或等于所述第二编码率阈值。
  4. 根据权利要求1~3任一权利要求所述的方法,其特征在于,所述获取无线显示功能Miracast的工作模式之后,还包括:
    根据所述Miracast的工作模式,获得解码缓存参数。
  5. 根据权利要求4所述的方法,其特征在于,所述根据所述Miracast 的工作模式,获得解码缓存参数之前,还包括:
    设置所述Miracast的工作模式与所述解码缓存参数的对应关系。
  6. 根据权利要求5所述的方法,其特征在于,所述设置所述Miracast的工作模式与所述解码缓存参数的对应关系,包括:
    设置非实时模式与非实时解码缓存参数的对应关系,所述非实时解码缓存参数大于或等于第一缓存阈值;和/或
    设置实时模式与实时解码缓存参数的对应关系,所述实时解码缓存参数小于第二缓存阈值;其中,
    所述第一缓存阈值大于或等于所述第二缓存阈值。
  7. 根据权利要求4所述的方法,其特征在于,所述根据所述Miracast的工作模式,获得解码缓存参数之后,还包括:
    向所述接收端发送所述解码缓存参数,以供所述接收端利用所述解码缓存参数,设置存储所述投射视频数据流的缓存区,输出所述缓存区中的所述投射视频数据流。
  8. 一种图像处理装置,其特征在于,包括:
    获取单元,用于获取无线显示功能Miracast的工作模式,所述Miracast的工作模式包括实时模式或非实时模式;
    匹配单元,用于根据所述Miracast的工作模式,获得投射参数;所述投射参数包括投射分辨率和投射编码率中的至少一项;
    处理单元,用于利用所述投射参数,对传送端所获取的待编码图像进行处理,以获得投射视频数据流;
    发送单元,用于向接收端发送所述投射视频数据流,以供所述接收端输出所述投射视频数据流。
  9. 根据权利要求8所述的装置,其特征在于,所述匹配单元,还用于设置所述Miracast的工作模式与所述投射参数的对应关系。
  10. 根据权利要求9所述的装置,其特征在于,所述匹配单元,具体用于
    设置非实时模式与非实时投射分辨率和非实时投射编码率中的至少一项的对应关系,所述非实时投射分辨率大于或等于第一分辨率阈值,所述非实时投射编码率大于或等于第一编码率阈值;和/或
    设置实时模式与实时投射分辨率和实时投射编码率中的至少一项的对应关系,所述实时投射分辨率小于第二分辨率阈值,所述实时投射编码率小于第二编码率阈值;其中,
    所述第一分辨率阈值大于或等于所述第二分辨率阈值;
    所述第一编码率阈值大于或等于所述第二编码率阈值。
  11. 根据权利要求8~10任一权利要求所述的装置,其特征在于,所述匹配单元,还用于
    根据所述Miracast的工作模式,获得解码缓存参数。
  12. 根据权利要求11所述的装置,其特征在于,所述匹配单元,还用于
    设置所述Miracast的工作模式与所述解码缓存参数的对应关系。
  13. 根据权利要求12所述的装置,其特征在于,所述匹配单元,具体用于
    所述设置所述Miracast的工作模式与所述解码缓存参数的对应关系,包括:
    设置非实时模式与非实时解码缓存参数的对应关系,所述非实时解码缓存参数大于或等于第一缓存阈值;和/或
    设置实时模式与实时解码缓存参数的对应关系,所述实时解码缓存参数小于第二缓存阈值;其中,
    所述第一缓存阈值大于或等于所述第二缓存阈值。
  14. 根据权利要求11所述的装置,其特征在于,所述发送单元,还用于
    向所述接收端发送所述解码缓存参数,以供所述接收端利用所述解码缓存参数,设置存储所述投射视频数据流的缓存区,输出所述缓存区中的所述 投射视频数据流。
PCT/CN2016/088732 2015-12-18 2016-07-05 图像处理方法及装置 Ceased WO2017101355A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/241,835 US20170195617A1 (en) 2015-12-18 2016-08-19 Image processing method and electronic device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510959054.5A CN105872651A (zh) 2015-12-18 2015-12-18 图像处理方法及装置
CN201510959054.5 2015-12-18

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/241,835 Continuation US20170195617A1 (en) 2015-12-18 2016-08-19 Image processing method and electronic device

Publications (1)

Publication Number Publication Date
WO2017101355A1 true WO2017101355A1 (zh) 2017-06-22

Family

ID=56623820

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/088732 Ceased WO2017101355A1 (zh) 2015-12-18 2016-07-05 图像处理方法及装置

Country Status (3)

Country Link
US (1) US20170195617A1 (zh)
CN (1) CN105872651A (zh)
WO (1) WO2017101355A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114286194A (zh) * 2021-12-08 2022-04-05 北京金山云网络技术有限公司 即时通信视频的处理方法、装置、电子设备及存储介质

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110291774B (zh) * 2018-03-16 2021-05-14 深圳市大疆创新科技有限公司 一种图像处理方法、设备、系统及存储介质
CN109391845A (zh) * 2018-11-23 2019-02-26 深圳市炬力北方微电子有限公司 跨设备显示的动态调整方法
CN112367542A (zh) * 2020-10-21 2021-02-12 四川长虹电器股份有限公司 一种镜像投屏的终端播放系统及方法
CN112346692B (zh) * 2020-11-09 2024-07-23 深圳康佳电子科技有限公司 一种投屏数据处理方法、设备及存储介质
CN113031895A (zh) * 2021-03-30 2021-06-25 联想(北京)有限公司 投屏控制方法、装置及电子设备
CN113411634A (zh) * 2021-05-08 2021-09-17 青岛海尔科技有限公司 视频流的操作方法和装置、存储介质、电子装置
US12125122B2 (en) * 2021-12-20 2024-10-22 Texas Instruments Incorporated Fault detection in a real-time image pipeline
CN114422734B (zh) * 2022-01-28 2023-12-01 杭州海康威视数字技术股份有限公司 一种录像机、视频数据处理方法、装置及电子设备
CN115766969B (zh) * 2022-11-29 2024-06-11 辉羲智能科技(上海)有限公司 一种车载图像处理方法、装置、介质及计算设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101370140A (zh) * 2008-09-25 2009-02-18 浙江大华技术股份有限公司 一种多码流生成的方法
CN103002288A (zh) * 2012-12-28 2013-03-27 北京视博云科技有限公司 一种视频图像的编解码方法及装置
US20140096164A1 (en) * 2012-09-28 2014-04-03 Marvell World Trade Ltd. Enhanced user experience for miracast devices
CN103986941A (zh) * 2014-05-28 2014-08-13 深圳市智英实业发展有限公司 一种无线音视频传输系统
CN104219551A (zh) * 2014-09-29 2014-12-17 武汉诚迈科技有限公司 一种智能设备屏幕共享与远程控制的方法
WO2015034698A1 (en) * 2013-09-04 2015-03-12 Qualcomm Incorporated Dynamic and automatic control of latency buffering for audio/video streaming

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5622404B2 (ja) * 2010-02-22 2014-11-12 シャープ株式会社 無線通信システム、および通信装置
US9690711B2 (en) * 2013-03-13 2017-06-27 International Business Machines Corporation Scheduler training for multi-module byte caching
JP2017512332A (ja) * 2014-02-06 2017-05-18 エルジー エレクトロニクス インコーポレイティド ワイファイディスプレイサービスの実行方法及びそのための装置
US9648073B2 (en) * 2014-04-10 2017-05-09 Qualcomm Incorporated Streaming control for real-time transport protocol

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101370140A (zh) * 2008-09-25 2009-02-18 浙江大华技术股份有限公司 一种多码流生成的方法
US20140096164A1 (en) * 2012-09-28 2014-04-03 Marvell World Trade Ltd. Enhanced user experience for miracast devices
CN103002288A (zh) * 2012-12-28 2013-03-27 北京视博云科技有限公司 一种视频图像的编解码方法及装置
WO2015034698A1 (en) * 2013-09-04 2015-03-12 Qualcomm Incorporated Dynamic and automatic control of latency buffering for audio/video streaming
CN103986941A (zh) * 2014-05-28 2014-08-13 深圳市智英实业发展有限公司 一种无线音视频传输系统
CN104219551A (zh) * 2014-09-29 2014-12-17 武汉诚迈科技有限公司 一种智能设备屏幕共享与远程控制的方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114286194A (zh) * 2021-12-08 2022-04-05 北京金山云网络技术有限公司 即时通信视频的处理方法、装置、电子设备及存储介质
CN114286194B (zh) * 2021-12-08 2024-05-03 北京金山云网络技术有限公司 即时通信视频的处理方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
CN105872651A (zh) 2016-08-17
US20170195617A1 (en) 2017-07-06

Similar Documents

Publication Publication Date Title
WO2017101355A1 (zh) 图像处理方法及装置
US10805570B2 (en) System and method for streaming multimedia data
US10516903B2 (en) Method and apparatus for transmitting video data
US11138715B2 (en) Method and apparatus for determining experience quality of VR multimedia
KR101646958B1 (ko) 변경된 영역들을 이용한 매체 인코딩
KR102646030B1 (ko) 영상제공장치, 그의 제어 방법 및 영상제공시스템
CN110784740A (zh) 视频处理方法、装置、服务器及可读存储介质
JP6672327B2 (ja) ユーザヘッドセットへの球状ビデオ帯域幅を減少させる方法および装置
CN112291590A (zh) 视频处理方法及设备
CN105791892A (zh) 一种基于桌面云的视频重定向方法、云服务器及系统
JP2016525317A5 (zh)
KR102566276B1 (ko) 원격 단말을 위한 몰입형 원격 회의 및 텔레프레즌스를 위한 오버레이 처리용 파라미터
US20250131630A1 (en) Prop display method, apparatus, device, and storage medium
CN107040808A (zh) 用于视频播放中弹幕图片的处理方法和装置
JP7701123B2 (ja) 遠隔端末用の没入型テレビ会議及びテレプレゼンスのためのビットストリーム構造
CN105979354A (zh) 一种频道切换方法及装置
CN105635613B (zh) 一种移动设备的录屏方法和装置
CN104010204B (zh) 图像信息处理方法及装置
CN113596583A (zh) 视频流子弹时间数据处理方法及装置
US11134114B2 (en) User input based adaptive streaming
US20140330957A1 (en) Widi cloud mode
CN121890092A (zh) 沉浸式现实中的用户表示
CN111314777A (zh) 视频生成方法及装置、计算机存储介质、电子设备
CN108464008A (zh) 电子设备和由电子设备控制的内容再现方法
TWI539795B (zh) 使用變化區域的媒體編碼

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16874417

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16874417

Country of ref document: EP

Kind code of ref document: A1