CN104703030A - Image coding method and image coding device - Google Patents

Image coding method and image coding device Download PDF

Info

Publication number
CN104703030A
CN104703030A CN201310671494.1A CN201310671494A CN104703030A CN 104703030 A CN104703030 A CN 104703030A CN 201310671494 A CN201310671494 A CN 201310671494A CN 104703030 A CN104703030 A CN 104703030A
Authority
CN
China
Prior art keywords
coding rate
user
video encoding
processing unit
image processing
Prior art date
Application number
CN201310671494.1A
Other languages
Chinese (zh)
Other versions
CN104703030B (en
Inventor
王鸿智
邱利昌
Original Assignee
扬智科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 扬智科技股份有限公司 filed Critical 扬智科技股份有限公司
Priority to CN201310671494.1A priority Critical patent/CN104703030B/en
Publication of CN104703030A publication Critical patent/CN104703030A/en
Application granted granted Critical
Publication of CN104703030B publication Critical patent/CN104703030B/en

Links

Abstract

Disclosed are an image coding method and an image coding device. The image coding method includes the following steps: collecting multiple frames enough for performing an H.264 coding mechanism in a buffer; dynamically switching coding rate of the H.264 coding mechanism according to at least one of using condition of the image coding device by a user and operating condition of an application program; adopting the H.264 coding mechanism corresponding to the coding rate to code the frames.

Description

影像编码方法及影像编码装置 Video encoding method and video encoding apparatus

技术领域 FIELD

[0001] 本发明是有关于一种编码方法及编码装置,且特别是有关于一种影像编码方法及影像编码装置。 [0001] The present invention relates to a coding method and coding apparatus, and more particularly to an image coding method and video encoding apparatus concerning.

背景技术 Background technique

[0002] 随着科技的发展以及时代的演进,人们对于电子产品所提供的娱乐功能已越来越注重。 [0002] With the evolution of technology and the development of the times, it has been increasingly focused for entertainment electronic products to offer. 因此,各家厂商无不争相推出各种新颖的数字娱乐产品,以吸引消费者们的注意。 Therefore, various manufacturers are all competing to launch a variety of innovative digital entertainment products to attract consumers' attention. 为了让使用者可将在移动装置上观看的画面投射至具有较大屏幕的显示器,现今已发展出一种具有屏幕镜射(Mirracast)功能的外部装置,其可在与移动装置连接之后,依据移动装置所发送的影像而对应地控制显示器(例如电视)显示与移动装置相同的画面。 In order for the user can be viewed on the mobile device to a display having a large screen of the projection screen, it has now developed a device external mirror screen (Mirracast) having a function, which can be connected after the mobile device, based on image transmitted by the mobile device and correspondingly controlling a display (e.g., television) display the same screen of the mobile device.

[0003] 一般来说,当移动装置是采用H.264的编码机制来编码欲传送至所述外部装置的影像时,其影像编码品质在决定之后便不再更动,因而使得移动装置传送至所述外部装置的影像品质为固定的。 [0003] Generally, when the mobile device is manufactured using the H.264 coding scheme to be encoded when transmitting the image to the external device, video encoding quality which is no longer determined after modifier, thus making the mobile device is transmitted to the the image quality of the external apparatus is constant. 更具体而言,移动装置所据以进行H.264编码机制的编码率在实质上进行编码之前即已决定,并无法任意地更动。 More specifically, according to the mobile device to perform a coding rate of H.264 encoding scheme substantially already decided before encoding, and can not be arbitrarily changed. 因此,在某些情况下,如此的运作机制将可能使得使用者经历到不佳的操作体验。 Therefore, in some cases, so the operating mechanism will likely enable the user to experience poor operating experience.

[0004] 举例而言,当使用者在编辑移动装置上的应用程序时,通常希望显示器能够较即时地反映使用者在移动装置上进行的各种编辑或操作行为,而较不会在意显示器所显示画面的影像品质。 [0004] For example, when editing the user application on the mobile device, typically more desirable display can instantly reflect various editing operations or acts performed by the user on the mobile device, the display they were not care image quality of the display screen. 在此情况下,若移动装置仍采用对应于较高编码率的H.264编码机制来编码欲发送(或分享)至外部装置的影像时,将可能使得移动装置与外部装置在提供屏幕镜射功能时出现延迟的情形,进而导致使用者经历到不佳的使用者体验。 In this case, when the mobile device is still using H.264 encoding scheme corresponds to a higher coding rate to be transmitted is encoded (or share) of the image to an external device, the mobile device may make an external apparatus provided with a screen mirroring a delay situation occurs when the function, thereby causing the user to experience poor user experience. 更具体而言,在移动装置采用高编码率的情况下,显示器所显示的画面将可能无法即时地反映使用者在移动装置上进行的操作。 More specifically, in a case where the mobile device adopts a high encoding rate, the display screen may not be displayed instantly reflecting the operation performed by the user on the mobile device.

[0005] 举另一例而言,当使用者欲在显示器上观赏移动装置所播放的影片时,通常希望能观赏到较高画质的影片,而较不会在意影片播放时出现的些许延迟情形。 [0005] For another example, when a user wants to watch the video played by the mobile device on the display, it is often desirable to be able to view high quality video, and the less likely a slight delay situation occurs when the video player care . 在此情况下,若移动装置仍采用对应于较低编码率的H.264编码机制来编码欲发送至外部装置的影像时,将可能使得使用者因无法观赏到高画质的影片而经历到不佳的使用者体验。 In this case, if the mobile unit still uses the H.264 coding scheme corresponding to the encoding rate is low when the encoded video to be transmitted to the external apparatus, so that the user will likely due to inability to view high quality video to be subjected to poor user experience.

发明内容 SUMMARY

[0006] 有鉴于此,本发明提供一种影像编码方法及影像编码装置,其可依据使用者对影像编码装置的使用情形或是运作中应用程序的运作情形而适应性地调整编码率,进而提供使用者较佳的使用者体验。 [0006] Accordingly, the present invention provides a video encoding method and video encoding apparatus, which can be based on the operating situation of the user of the video encoding device usage or application operations adaptively adjust the encoding rate, and further provide users with a better user experience.

[0007] 本发明提供一种影像编码方法,适于影像编码装置。 [0007] The present invention provides a video encoding method, video encoding apparatus adapted. 所述方法包括下列步骤:在缓冲器中收集足以进行H.264编码机制的多个帧;依据使用者对影像编码装置的使用情形及应用程序的运作情形的至少其中之一而动态地切换H.264编码机制的编码率;采用对应于编码率的H.264编码机制编码所述多个帧。 Said method comprising the steps of: collecting a plurality of frames sufficient to H.264 encoding scheme in a buffer; at least one user based on the operating situation of the usage and application of the video encoding apparatus wherein the dynamically switched H a coding rate of H.264 encoding scheme; coding using H.264 coding scheme corresponding to the coding rate of the plurality of frames.

[0008] 在本发明的一实施例中,在采用H.264编码机制编码所述多个帧的步骤之后,更包括:将编码后的所述多个帧与对应的音讯部分进行多工处理以产生传输串流;通过直接连线发送传输串流至影像解码装置,以分享影像编码装置的显示画面至影像解码装置。 [0008] In an embodiment of the present invention, after the step of using the H.264 coding scheme to encode the plurality of frames, further comprising: a portion of the plurality of audio frames corresponding to the encoded multi-tasking to generate a transmission stream; sending a transmission stream to the video decoding device by direct connection to share video encoding apparatus to the video decoding device display.

[0009] 在本发明的一实施例中,依据使用者对影像编码装置的使用情形及应用程序的运作情形的至少其中之一而动态地调整H.264编码机制的编码率的步骤包括:使用者通过影像编码装置的使用者接口单元调整用于调整编码率的物件时,依据物件呈现的调整结果切换编码率。 [0009] In an embodiment of the present invention, the step of at least one user based on the operating situation of the usage and application of the video encoding apparatus wherein dynamically adjusts the coding rate of H.264 encoding scheme comprises: using when the interface unit by the user's video adjustment device for adjusting the coding rate of the coding object, according to the adjustment results presented object coding rate switching.

[0010] 在本发明的一实施例中,所述应用程序为一最上层应用程序,且依据使用者对影像编码装置的使用情形及应用程序的运作情形的至少其中之一而动态地调整H.264编码机制的编码率的步骤包括:判断使用者是否正在编辑应用程序;若是,降低编码率。 [0010] In an embodiment of the present invention, the application program is one of the most upper application, and the at least one user based on the operating situation of the usage and application of the video encoding apparatus wherein dynamically adjusting the H the step of coding rate H.264 encoding scheme comprises: determining whether the user is editing application; if yes, reducing the coding rate.

[0011] 在本发明的一实施例中,所述应用程序为一最上层应用程序,且在判断使用者是否正在编辑应用程序的步骤之后,更包括:若使用者未正在编辑应用程序,判断影像编码装置是否已闲置或静止预设时间;若是,增加编码率。 [0011] In an embodiment of the present invention, the application program is one of the most upper application, and after the step of determining whether the user is editing application, further comprising: if the user does not editing application determines if the image encoding device has been idle for a preset time or static; if so, increasing the coding rate.

[0012] 在本发明的一实施例中,所述应用程序为一最上层应用程序,且依据使用者对影像编码装置的使用情形及应用程序的运作情形的至少其中之一而动态地调整H.264编码机制的编码率的步骤包括:判断应用程序所显示的当前帧与先前帧之间的差异度是否大于预设值;若是,降低编码率;若否,维持编码率。 [0012] In an embodiment of the present invention, the application program is one of the most upper application, and the at least one user based on the operating situation of the usage and application of the video encoding apparatus wherein dynamically adjusting the H .264 encoding step of encoding rate mechanism comprising: determining the application displays a current frame and a previous degree of difference between frames is greater than a predetermined value; if yes, reducing the coding rate; if not, to maintain the coding rate.

[0013] 本发明提供一种影像编码装置,其包括缓冲器及影像处理单元。 [0013] The present invention provides a video encoding apparatus, which includes a buffer and the image processing unit. 影像处理单元耦接缓冲器,经配置以执行下列步骤:在缓冲器中收集足以进行H.264编码机制的多个帧;依据使用者对影像编码装置的使用情形及应用程序的运作情形的至少其中之一而动态地切换H.264编码机制的编码率;采用对应于编码率的H.264编码机制编码所述多个帧。 The image processing unit is coupled to the buffer, configured to perform the following steps: collecting a plurality of frames sufficient to H.264 encoding scheme in a buffer; user based on the operating situation of the usage and application of the video encoding apparatus of at least one coding rate is dynamically switched H.264 encoding scheme; coding using H.264 coding scheme corresponding to the coding rate of the plurality of frames.

[0014] 在本发明的一实施例中,所述的影像编码装置更包括连接至影像处理单元的通讯单元,且影像处理单元更经配置以:将编码后的所述多个帧与对应的音讯部分进行多工处理以产生传输串流;控制通讯单元通过直接连线发送传输串流至影像解码装置,以分享影像编码装置的显示画面至影像解码装置。 [0014] In an embodiment of the present invention, the video encoding apparatus further comprises a communication unit connected to the image processing unit and image processing unit is further configured to: the plurality of frames encoded corresponding audio processing part to generate a multi-stream transmission; transmission stream to the video decoding apparatus controls the communication unit transmits via direct connection to a display screen sharing video encoding apparatus to the video decoding device.

[0015] 在本发明的一实施例中,所述的影像编码装置更包括连接至影像处理单元的使用者接口单元,其中当使用者通过影像编码装置的使用者接口单元调整用于调整编码率的物件时,影像处理单元依据物件呈现的调整结果切换编码率。 [0015] In an embodiment of the present invention, the video encoding apparatus further includes a user interface unit connected to the image processing unit, wherein when the coding rate used for adjusting the user interface unit by the user to adjust the video encoding apparatus when the object, the image processing unit switches the coding rate according to the adjustment result of the presentation object.

[0016] 在本发明的一实施例中,所述应用程序为一最上层应用程序,且影像处理单元判断使用者是否正在编辑应用程序;若是,影像处理单元降低编码率。 [0016] In an embodiment of the present invention, the application program is one of the most upper application, and the image processing unit determines whether the user is editing application; if, the image processing unit to decrease the coding rate.

[0017] 在本发明的一实施例中,所述应用程序为一最上层应用程序,且若使用者未正在编辑应用程序,影像处理单元更经配置以判断影像编码装置是否已闲置或静止预设时间;若是,影像处理单元增加编码率。 [0017] In an embodiment of the present invention, the application program is one of the most upper application, and if the user application is not being edited, the image processing unit further configured to judge whether the video encoding apparatus has been idle or stationary pre set time; if, the image processing unit increases the coding rate.

[0018] 在本发明的一实施例中,影像处理单元判断所显示的当前帧与先前帧之间的差异度是否大于预设值;若是,影像处理单元降低编码率;若否,影像处理单元维持编码率。 [0018] In an embodiment of the present invention, the image processing unit determines whether the display of the current frame and the previous frame is greater than the difference between the preset value; if yes, reducing the coding rate of the image processing unit; if not, the image processing unit maintaining the coding rate.

[0019] 基于上述,本发明实施例所提出的影像编码方法及影像编码装置可依据使用者对于影像编码装置的操作情形而适应性地调整编码率,进而提供使用者较佳的使用者体验。 [0019] Based on the above, the image coding method and image coding apparatus according to the embodiment of the present invention proposed may be based on a user operation for the case of the video encoding apparatus and a coding rate adaptively adjusted, thereby providing a better user experience the user.

[0020] 为让本发明的上述特征和优点能更明显易懂,下文特举实施例,并配合所附图式作详细说明如下。 [0020] In order to make the above features and advantages of the present invention can be more fully understood, the following non-limiting embodiment, and the accompanying figures are described in detail below.

附图说明 BRIEF DESCRIPTION

[0021] 图1是依据本发明的一实施例绘示的影像编码装置的功能方块图。 [0021] Figure 1 is a functional block diagram of an image encoding apparatus according to an embodiment shown of the present invention.

图2是依据本发明的一实施例绘示的影像编码方法流程图。 FIG 2 is a flowchart of a video encoding according to an embodiment of the present invention illustrates the method.

图3是依据本发明第一实施例绘示的影像编码方法流程图。 FIG 3 is a flowchart of a first embodiment according to the image encoding method of the invention shown.

图4是依据本发明第二实施例绘示的影像编码方法流程图。 FIG 4 is an image coding method according to a second embodiment of the present invention is shown in a flowchart.

【符号说明】 【Symbol Description】

100:影像编码装置 100: video encoding means

110:缓冲器 110: buffer

120:影像处理单元 120: image processing unit

130:通讯单元 130: communication unit

140:使用者接口单元 140: User interface unit

S210 〜S250、S310 〜S360、S410 〜S450:步骤 S210 ~S250, S310 ~S360, S410 ~S450: step

具体实施方式 Detailed ways

[0022] 图1是依据本发明的一实施例绘示的影像编码装置的功能方块图。 [0022] Figure 1 is a functional block diagram of an image encoding apparatus according to an embodiment shown of the present invention. 在本实施例中,影像编码装置100包括缓冲器110以及影像处理单元120。 In the present embodiment, the video encoding apparatus 100 includes a buffer 110 and an image processing unit 120. 影像编码装置100例如是智能手机(Smart Phone)、平板电脑(Tablet)、笔记本电脑、个人数字助理或是其他任何可通过无线传输技术将显示画面传输或分享至其他影像解码装置(例如是机顶盒(Set-TopBox, STB)),以达到屏幕镜射(Mirracast)功能的电子装置。 Video encoding apparatus 100 is a smart phone (Smart Phone), the tablet (the Tablet), notebook computers, personal digital assistants, or any other wireless transmission technology can transmit or share the display screen to another video decoding device (e.g. set-top boxes ( Set-topBox, STB)), to achieve the mirror-screen electronic device (Mirracast) function. 所述无线传输技术例如是无线保真度直接连线(Wireless Fidelity direct, W1-Fi direct),但本发明的可实施方式不限于此。 The radio transmission technology, for example, Wireless Fidelity direct connection (Wireless Fidelity direct, W1-Fi direct), but embodiments of the present invention is not limited thereto. 缓冲器110例如是存储器等存储媒体,其可存储关联于镜射影像编码装置100所显示画面的多个巾贞(frame)。 Buffer memory 110 is a storage medium, which may be stored in associated mirror image encoding device of the plurality of screens towel Chen (Frame) 100 display.

[0023] 影像处理单元120耦接于缓冲器110。 [0023] The image processing unit 120 is coupled to buffer 110. 影像处理单元120可以是绘图处理单元(Graphics Processing Unit, GPU)、一般用途处理器、特殊用途处理器、传统的处理器、数字信号处理器、多个微处理器(microprocessor)、一个或多个结合数字信号处理器核心的微处理器、控制器、微控制器、特殊应用集成电路(Applicat1n Specific IntegratedCircuit, ASIC)、现场可编程门阵列电路(Field Programmable Gate Array, FPGA)、任何其他种类的集成电路、状态机、基于进阶精简指令集机器(Advanced RISC Machine, ARM)的处理器以及类似品。 The image processing unit 120 may be a graphics processing unit (Graphics Processing Unit, GPU), a general purpose processor, a special purpose processor, a conventional processor, a digital signal processor, a plurality of microprocessors (Microprocessor), one or more a digital signal processor in conjunction with a microprocessor core, a controller, a microcontroller, application specific integrated circuits (Applicat1n specific integratedCircuit, ASIC), a field programmable gate array circuit (field programmable gate array, FPGA), any other type of integrated circuit, a state machine, a processor based on the Advanced RISC machine (Advanced RISC machine, ARM), and similar articles.

[0024] 为了让影像编码装置100与影像解码装置在进行屏幕镜射时能够提供使用者更佳的操作体验,本发明实施例提出一种影像编码方法,其可依据使用者对于影像编码装置100的操作情形而适应性地调整编码率,其细节详述如下。 [0024] In order for the video encoding apparatus and video decoding apparatus 100 can provide a better user experience during operation screen mirror, the embodiment provides an image coding method of the present invention, which can be based on the user 100 to the video encoding apparatus operating circumstances the coding rate adaptively adjusted, details of which are described below.

[0025] 图2是依据本发明的一实施例绘示的影像编码方法流程图。 [0025] FIG 2 is a flowchart of a video encoding embodiment illustrates a method of the present invention. 本实施例提出的方法可由图1的影像编码装置100执行,以下即搭配图1的各个元件来说明本方法的步骤细节。 The method of embodiment may be made according to the present embodiment performs the video encoding apparatus 100 of FIG. 1, i.e. with the various elements of FIG. 1 will be described details of the steps of the method.

[0026] 在步骤S210中,影像处理单元120可在缓冲器110中收集足以进行H.264编码机制的多个帧(即,影像)。 [0026] In step S210, the image processing unit 120 may collect a plurality of frames sufficient to H.264 encoding scheme (i.e., image) in the buffer 110. 接着,在步骤S220中,影像处理单元120可依据使用者对影像编码装置100的使用情形及应用程序的运作情形的至少其中之一而动态地调整H.264编码机制的编码率。 Next, in step S220, the image processing unit 120 may dynamically adjusts the coding rate of H.264 encoding scheme based on the at least one user to use the operating situation of the case of the video encoding apparatus 100 and the application program therein.

[0027] 在一实施例中,影像编码装置130可更包括连接至影像处理单元120的使用者接口单元140。 [0027] In one embodiment, the video encoding apparatus 130 may further include an image processing unit coupled to the user interface unit 120 to 140. 在此实施例中,影像编码装置100可在其使用者接口单元140(例如触控屏幕)上显示可让使用者调整编码率的物件。 Embodiment, may be 100 (e.g., touch screen) on the display allows the user to adjust the coding rate of the object which the user interface unit 140 in the video encoding apparatus in this embodiment. 所述物件例如是卷轴(Scroll Bar)或是屏幕按钮,但本发明的可实施方式不限于此。 The article, for example, a reel (Scroll Bar) or screen buttons, but embodiments of the present invention is not limited thereto. 当所述物件为卷轴时,使用者可通过拖动卷轴的方式来调整影像处理单元120进行H.264编码机制时的编码率。 When the article is a roll, the user may adjust the image processing unit when the coding rate is H.264 encoding scheme reel 120 by dragging manner. 当所述物件为屏幕按钮时,影像编码装置100可在其使用者接口单元上显示多个分别对应不同编码率或是影像品质的按钮,用以让使用者自行选取所想要影像品质。 When the article is a screen button, the video encoding apparatus 100 may be displayed on a user interface unit which respectively correspond to a plurality of different coding rates or image quality button to select users create their own desired image quality.

[0028] 接着,影像处理单元120可依据所述物件呈现的调整结果切换编码率。 [0028] Next, the image processing unit 120 may switch the coding rate according to the adjustment result of the presentation object. 举例而言,在所述物件是以屏幕按钮实现的情况下,当使用者选取例如高影像品质的屏幕按钮时,影像处理单元120可将编码率切换为对应至此屏幕按钮的编码率(例如是768kbps)。 For example, in the case where the screen button object is achieved, for example, when a user selects a high image quality screen button, the image processing unit 120 may switch the coding rate of the coding rate corresponding to this screen buttons (for example, 768kbps).

[0029] 接着,在步骤S230中,影像处理单元120可采用对应于所述编码率的H.264编码机制编码所述多个帧。 [0029] Next, in step S230, the image processing unit 120 may employ the H.264 coding scheme corresponding to the coding of the coding rate of the plurality of frames. 如此一来,使用者即可自行依据其对影像品质的需求而手动调整影像编码单元120用于编码帧的编码率,进而避免使用者经历到先前提及的各种不佳的使用者体验。 Therefore, the user can according to their own needs to manually adjust the image quality and the image encoding unit 120 for encoding the encoded frame rate, thereby avoiding the previously mentioned various users experiencing poor user experience.

[0030] 在其他实施例中,影像编码装置100可更包括耦接至影像处理单元120的通讯单元130。 [0030] In other embodiments, the video encoding apparatus 100 may further include an image processing unit coupled to the communication unit 120 is 130. 通讯单元130可与例如机顶盒等影像解码装置建立直接连线(例如是W1-Fi直接连线),并通过此直接连线将影像处理单元120编码的帧或是其他相关的影像资讯传输至所述影像解码装置。 The communication unit 130 may establish a direct connection (e.g. W1-Fi is a direct connection) to the video decoding device, for example, set-top boxes, and by this direct connection to the encoded image processing unit 120 or other frame of image information is transmitted to the said video decoding apparatus.

[0031] 在影像解码装置100具有通讯单元130的情况下,在步骤S230之后,影像处理单元120可更执行步骤S240以将编码后的所述多个帧与对应的音讯部分进行多工处理以产生传输串流(Transport Stream, TS)。 [0031] In the case where communication unit 130 has a video decoding apparatus 100, after the step S230, the image processing unit 120 may further performs step S240 to the audio portion of the encoded plurality of pictures and the corresponding treatment to be multiplexed generating transport stream (transport stream, TS).

[0032] 接着,在步骤S250中,影像处理单元120可控制通讯单元130通过直接连线发送传输串流至影像解码装置,以分享影像编码装置的显示画面至影像解码装置。 Sending a transmission stream 130 by a direct connection to the video decoding apparatus [0032] Next, in step S250, the image processing unit 120 may control the communication unit to share the video encoding apparatus to the video decoding device display. 之后,影像解码装置可通过自身包括的显示单元(例如液晶显示器)或是控制其他的显示装置(例如液晶显示器)显示影像编码装置100所分享的显示画面。 Thereafter, the video decoding device may display unit (e.g. liquid crystal display) or other display control means (e.g., a liquid crystal display) display screen 100 of sharing video encoding apparatus comprises a by itself.

[0033] 在其他实施例中,本发明的影像编码方法亦可采用其他的方式来实现,以下将列举其中的两种做法,但本发明的可实施方式不限于此。 [0033] In other embodiments, the video encoding method according to the present invention may also be implemented using other means, which will include the two approaches, but embodiment of the present invention is not limited to this embodiment.

[0034] 图3是依据本发明第一实施例绘示的影像编码方法流程图。 [0034] FIG. 3 is a flowchart illustrating a first embodiment of the video encoding method of the invention shown. 本实施例提出的方法可由图1的影像编码装置100执行,以下即搭配图1的各个元件来说明本方法的步骤细节。 The method of embodiment may be made according to the present embodiment performs the video encoding apparatus 100 of FIG. 1, i.e. with the various elements of FIG. 1 will be described details of the steps of the method.

[0035] 在步骤S310中,影像处理单元120可在缓冲器110中收集足以进行H.264编码机制的多个帧。 [0035] In step S310, the image processing unit 120 may collect a plurality of frames sufficient to H.264 encoding scheme in the buffer 110. 接着,在步骤S320中,影像处理单元120可判断使用者是否正在编辑应用程序。 Next, in step S320, the image processing unit 120 may determine whether the user is editing application. 所述应用程序例如是最上层(On-top)应用程序,亦即显示在最前/最上层的应用程序。 The application is, for example, the uppermost (On-top) application, i.e., before displaying the most / uppermost applications. 若是,影像处理单元120可接续进行步骤S330以降低编码率。 If yes, the image processing unit 120 may continue to step S330 to reduce the coding rate. 接着,影像处理单元120可进行步骤S340以采用对应于编码率的H.264编码机制编码所述多个帧。 Next, the image processing unit 120 may be performed in step S340 mechanism H.264 coding using a coding rate corresponding to said plurality of encoded frames.

[0036] 换言之,当影像编码装置100侦测到使用者正在编辑(或操作)应用程序时,影像处理单元120可对应地降低编码率,以避免影像编码装置100所分享在显示器上的显示画面出现无法即时回应使用者操作行为的情形发生。 [0036] In other words, when the image coding apparatus 100 detects a user being edited (or operator) applications, the image processing unit 120 may correspondingly reduce the coding rate, to avoid the video encoding apparatus 100 share a display screen on the display situation there can not respond immediately to user operation behavior occurs.

[0037] 另一方面,若影像处理单元120判断使用者并未正在编辑应用程序,则影像处理单元120可接续进行步骤S350以判断影像编码装置100是否已闲置或静止预设时间。 [0037] On the other hand, when the image processing unit 120 determines a user application is not being edited, the image processing unit 120 may be continued from step S350 to determine whether the video encoding apparatus 100 or the static preset idle time. 亦即,影像处理单元120可判断使用者是否已有一段时间(例如是所述预设时间)未操作影像编码装置100,或是影像编码装置100是否在所述预设时间内皆未被移动。 That is, the image processing unit 120 may determine whether the user for some time (for example, the predetermined time) is not in operation 100, the video encoding apparatus or the video encoding apparatus 100 is garnered is moved within the preset time . 在一实施例中,影像处理单元120可依据例如重力传感器(G-sensor)及陀螺仪(gyroscope)等传感器(未绘示)所提供的感测信号来进行步骤S350中的判断行为,但本发明的可实施方式不限于此。 In one embodiment, the image processing unit 120 may be determined behavior in step S350 according to the sensing signal a gravity sensor (G-sensor) and the gyroscope (Gyroscope) and other sensors (not shown) provided, for example, but the present embodiment of the invention may be embodiment is not limited thereto. 所述预设时间例如是20秒或是其他由影像编码装置100的设计者自行设定的值。 The predetermined time is 20 seconds, for example, by a designer or other values ​​of the video encoding apparatus 100 itself is set.

[0038] 若否,影像处理单元120可返回步骤S320 ;若是,则影像处理单元可进行步骤S360以增加编码率,并接着进行步骤S340以采用对应于编码率的H.264编码机制编码所述多个帧。 [0038] If not, the image processing unit 120 may return to step S320; if yes, the image processing unit may perform the step S360 to increase the coding rate, and then proceeds to step S340 to employ corresponding to the coding rate of the H.264 coding mechanism a plurality of frames. 其原因在于,当使用者在观看影像编码装置100所分享至显示器的影片或是影像(例如投影片)时,使用者可能会长时间地将影像编码装置100静置于某处。 The reason is that, while the user is viewing the video encoding apparatus to the video or image display shared (e.g. slide) 100, the user may be prolonged static video encoding apparatus 100 is placed somewhere. 此时,影像处理单元120即可适应性地增加编码率,以让使用者能够观赏到较高画质的显示画面。 In this case, the image processing unit 120 to increase the coding rate adaptively, to allow the user to watch the display screen higher image quality.

[0039] 图4是依据本发明第二实施例绘示的影像编码方法流程图。 [0039] FIG. 4 is a flow chart of the video encoding method of the second embodiment shown embodiment of the present invention. 本实施例提出的方法可由图1的影像编码装置100执行,以下即搭配图1的各个元件来说明本方法的步骤细节。 The method of embodiment may be made according to the present embodiment performs the video encoding apparatus 100 of FIG. 1, i.e. with the various elements of FIG. 1 will be described details of the steps of the method.

[0040] 在步骤S410中,影像处理单元120可在缓冲器110中收集足以进行H.264编码机制的多个帧。 [0040] In step S410, the image processing unit 120 may collect a plurality of frames sufficient to H.264 encoding scheme in the buffer 110. 接着,在步骤S420中,影像处理单元120可判断所显示的当前帧与先前帧之间的差异度是否大于预设值(例如是5%)。 Next, in step S420, the image processing unit 120 may determine the currently displayed frame of the previous frame is greater than the difference between the preset value (e.g., 5%). 所述当前帧例如是所述应用程序目前显示的画面,而所述先前帧例如是所述当前帧的前一个显示画面。 For example, the current frame is a screen display of the present application, and the previous frame before the current frame, for example, a display screen. 在其他实施例中,所述先前帧亦可以是其他先前存储于缓冲器110中的帧,但本发明的可实施方式不限于此。 In other embodiments, the previous frame can be other previous frames stored in the buffer 110, but embodiments of the present invention is not limited thereto.

[0041] 若所述差异度大于预设值,则影像处理单元120可进行步骤S430以降低编码率。 [0041] If the difference is greater than the predetermined value, the image processing unit 120 may perform step S430 in order to reduce the coding rate. 之后,影像处理单元120可进行步骤S440以采用对应于编码率的H.264编码机制编码所述多个帧。 Thereafter, the image processing unit 120 may be performed in step S440 mechanism H.264 coding using a coding rate corresponding to said plurality of encoded frames. 其原因在于,当所述差异度大于预设值时,代表当前帧与先前帧之间的相似度较低,此时若影像处理单元120仍采用较高编码率的话,将需要较长的处理时间,进而可能导致影像编码装置100所分享的显示画面出现延迟的情形。 This is because, when the difference is greater than a preset value, representative of a low degree of similarity between the current frame and a previous frame, if the image processing unit 120 at this time remains with a higher coding rate, it will take longer to process time, which may result in the case of the delayed video encoding apparatus 100 sharing display appears. 因此,影像处理单元120可在所述差异度高于预设值时适时地降低编码率,以减少影像处理单元120用于编码及传输的时间,进而避免出现前述的延迟情形。 Thus, the image processing unit 120 may be timely reduce the degree of difference in the coding rate is higher than a preset value, 120 in order to reduce time for encoding and transmitting an image processing unit, thereby avoiding the delay situation occurs.

[0042] 另一方面,若所述差异度不大于预设值,则影像处理单元120可进行步骤S450以维持编码率。 [0042] On the other hand, if the difference is not greater than the predetermined value, the image processing unit 120 may perform step S450 to maintain the coding rate. 之后,影像处理单元120可进行步骤S440以采用对应于编码率的H.264编码机制编码所述多个帧。 Thereafter, the image processing unit 120 may be performed in step S440 mechanism H.264 coding using a coding rate corresponding to said plurality of encoded frames. 其原因在于,在当前帧与先前帧之间相似度较高的情况下,影像处理单元120进行编码后的资料量相对地较少,因此即便维持编码率亦不会导致前述的延迟情形。 This is because, at the current frame between the previous frame and the high degree of similarity, the data amount after encoding the image processing unit 120 is relatively small, so even if the coding rate is maintained will not cause a delay in the case. 此外,在其他实施例中,若所述差异度不大于预设值,则影像处理单元120亦可增加编码率来进一步提高所分享的显示画面的影像品质。 Further, in other embodiments, if the difference is not greater than the predetermined value, the image processing unit 120 may increase the encoding rate to further improve the image quality of the display screen sharing.

[0043] 综上所述,本发明实施例提出的影像编码方法及影像编码装置,其可依据使用者对于影像编码装置100的操作情形而适应性地调整编码率。 [0043] As described above, the image coding method and image coding apparatus proposed in the present invention, which may be based on a user operation scenario for adaptively adjusting video encoding apparatus 100 coding rate. 如此一来,当使用者在操作影像编码装置时,影像编码装置即可适时地调低编码率,以让其所分享至显示器的显示画面能够即时地反映使用者在影像编码装置上的各种编辑或操作行为。 Thus, while the user is operating the video encoding device, video encoding apparatus to timely reduce the coding rate, to allow it to share the display screen of the display the user can immediately reflect on various video encoding apparatus edit or operating behavior. 此外,当使用者仅是在观赏影像编码装置分享至显示器的显示画面时,影像编码装置即可适时地增加编码率,以让使用者能够观赏到较高画质的显示画面,因而可提供使用者较佳的使用者体验。 Further, only when the user is sharing a display screen to display on the watch video encoding device, video encoding apparatus to increase the coding rate in a timely manner, to allow the user to watch the display screen of a high quality, which can be used to provide who better user experience.

[0044] 此外,虽然本发明提出的各个方法是绘示于多个分开的图中,但在其他实施例中,所述多个方法亦可任意地被结合来达到其他设计者想要的功效。 [0044] In addition, although the various methods proposed by the present invention is shown in the drawings a plurality of separate, but in other embodiments, the plurality of methods may also optionally be combined to achieve a desired effect other designers .

[0045] 虽然本发明已以实施例揭露如上,然其并非用以限定本发明,任何本领域技术人员,在不脱离本发明的精神和范围内,当可作些许的更动与润饰,故本发明的保护范围当视后附的权利要求所界定者为准。 [0045] Although the present invention has been disclosed in the above embodiments, they are not intended to limit the present invention, anyone skilled in the art, without departing from the spirit and scope of the present invention, may make various modifications and variations, so scope of the invention as defined by the appended claims and their equivalents.

Claims (12)

1.一种影像编码方法,适于影像编码装置,其特征在于,所述方法包括下列步骤: 在缓冲器中收集足以进行H.264编码机制的多个帧; 依据使用者对该影像编码装置的使用情形及应用程序的运作情形的至少其中之一而动态地切换该H.264编码机制的编码率;以及采用对应于该编码率的该H.264编码机制编码该些帧。 1. A video encoding method, video encoding apparatus adapted, characterized in that, said method comprising the steps of: collecting a plurality of frames sufficient to H.264 encoding scheme in a buffer; the video encoding apparatus according to user wherein at least one of the operating circumstances of the application and usage and dynamically switch the coding rate of H.264 encoding scheme; and using the coding rate corresponding to the H.264 coding scheme encoding the plurality of frames.
2.如权利要求1所述的方法,其特征在于,在采用该H.264编码机制编码该些帧的步骤之后,更包括: 将编码后的该些帧与对应的音讯部分进行多工处理以产生传输串流;以及通过无线直接连线发送该传输串流至影像解码装置,以分享该影像编码装置的显示画面至该影像解码装置。 2. The method according to claim 1, wherein, after the step of the plurality of frames encoded using the H.264 coding scheme, further comprising: the plurality of frames corresponding to the encoded audio portion of the rear multitasking to generate a transmission stream; and transmitting the transport stream to the video decoding device, to share the display screen of the video encoding apparatus to the video decoding apparatus through a wireless connection directly.
3.如权利要求1所述的方法,其特征在于,依据该使用者对该影像编码装置的该使用情形及该应用程序的该运作情形的至少其中之一而动态地调整该H.264编码机制的该编码率的步骤包括: 当该使用者通过该影像编码装置的使用者接口单元调整用于调整该编码率的物件时,依据该物件呈现的调整结果切换该编码率。 3. The method according to claim 1, wherein dynamically adjusting the H.264 encoder according to at least one of the user for the usage of the video encoding apparatus and the operation of the case where the application program the step of coding rate mechanism comprises: when the user through the user interface unit of the video encoding means for adjusting the encoding rate adjustment object, switches the coding rate according to the adjustment result of the presentation object.
4.如权利要求1所述的方法,其特征在于,依据该使用者对该影像编码装置的该使用情形及该应用程序的该运作情形的至少其中之一而动态地调整该H.264编码机制的该编码率的步骤包括: 判断该使用者是否正在编辑该应用程序; 若是,降低该编码率。 4. The method according to claim 1, wherein dynamically adjusting the H.264 encoder according to at least one of the user for the usage of the video encoding apparatus and the operation of the case where the application program the step of coding rate mechanism comprises: determining whether the user is editing the application; if yes, reducing the coding rate.
5.如权利要求4所述的方法,其特征在于,在判断该使用者是否正在编辑该应用程序的步骤之后,更包括: 若该使用者未正在编辑该应用程序,判断该影像编码装置是否已闲置或静止预设时间; 若是,增加该编码率。 5. The method according to claim 4, wherein, after the step of determining whether the user is editing the application program, further comprising: the image encoding device of the user if the application is not being edited, it is determined whether or not It has been idle for a preset time or rest; and if so, to increase the coding rate.
6.如权利要求1所述的方法,其特征在于,依据该使用者对该影像编码装置的该使用情形及该应用程序的该运作情形的至少其中之一而动态地调整该H.264编码机制的该编码率的步骤包括: 判断该应用程序所显示的当前帧与先前帧之间的差异度是否大于预设值; 若是,降低该编码率;以及若否,维持该编码率。 6. The method according to claim 1, wherein dynamically adjusting the H.264 encoder according to at least one of the user for the usage of the video encoding apparatus and the operation of the case where the application program the step of coding rate mechanism comprises: determining whether the application is displayed of the current frame and the previous frame is greater than the difference between the preset value; if yes, reducing the coding rate; and if not, to maintain the coding rate.
7.一种影像编码装置,其特征在于,包括: 缓冲器;以及影像处理单元,耦接该缓冲器,经配置以执行下列步骤: 在该缓冲器中收集足以进行H.264编码机制的多个帧; 依据使用者对该影像编码装置的使用情形及应用程序的运作情形的至少其中之一而动态地切换该H.264编码机制的编码率;以及采用对应于该编码率的该H.264编码机制编码该些帧。 A video encoding apparatus comprising: a buffer; and an image processing unit, coupled to the buffer, configured to perform the following steps of: collecting sufficient for multiple H.264 encoding scheme in the buffer a frame; at least one user based on the operating situation of the usage and application of the video encoding apparatus wherein the coding rate is dynamically switched to the H.264 encoding scheme; H. and using the coding rate corresponding to the 264 coding scheme encoding the plurality of frames.
8.如权利要求7所述的影像编码装置,其特征在于,更包括连接至该影像处理单元的通讯单元,且该影像处理单元更经配置以: 将编码后的该些帧与对应的音讯部分进行多工处理以产生传输串流;以及控制该通讯单元通过直接连线发送该传输串流至影像解码装置,以分享该影像编码装置的显示画面至该影像解码装置。 8. The video encoding apparatus according to claim 7, characterized in that, further comprising a communication unit connected to the image processing unit, and the image processing unit is further configured to: the frame and corresponding to the plurality of the encoded audio multi-part processing to generate a transmission stream; and controlling the communication unit to the transport stream transmitted by the video decoding apparatus direct connection to share the display screen of the video encoding apparatus to the video decoding apparatus.
9.如权利要求7所述的影像编码装置,其特征在于,更包括连接至该影像处理单元的使用者接口单元,其中当该使用者通过该影像编码装置的该使用者接口单元调整用于调整该编码率的物件时,该影像处理单元依据该物件呈现的调整结果切换该编码率。 9. The video encoding apparatus according to claim 7, characterized in that, further comprising a user interface unit connected to the image processing unit, wherein when the user via the user interface unit to adjust the video encoding means for when the object to adjust the coding rate, the image processing unit switches the coding rate according to the adjustment result of the presentation object.
10.如权利要求7所述的影像编码装置,其特征在于,该影像处理单元判断该使用者是否正在编辑该应用程序; 若是,该影像处理单元降低该编码率。 10. The video encoding apparatus according to claim 7, wherein the image processing unit determines whether or not the user is editing the application; if yes, the image processing unit to reduce the coding rate.
11.如权利要求10所述的影像编码装置,其特征在于,若该使用者未正在编辑该应用程序,该影像处理单元更经配置以判断该影像编码装置是否已闲置或静止预设时间; 若是,该影像处理单元增加该编码率。 11. The video encoding apparatus according to claim 10, wherein, if the user application is not being edited, the image processing unit further configured to judge whether the image encoding device has been idle for a preset time or stationary; if yes, the image processing unit increases the coding rate.
12.如权利要求7所述的影像编码装置,其特征在于,该影像处理单元判断所显示的当前帧与先前帧之间的差异度是否大于预设值; 若是,该影像处理单元降低该编码率;以及若否,该影像处理单元维持该编码率。 12. The video encoding apparatus according to claim 7, characterized in that the difference between the current frame of the image processing unit determines whether the previous frame is displayed is greater than a predetermined value; if yes, the image processing unit reduces the coding rate; and if not, the image processing unit to maintain the coding rate.
CN201310671494.1A 2013-12-10 2013-12-10 Video encoding method and video encoding apparatus CN104703030B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310671494.1A CN104703030B (en) 2013-12-10 2013-12-10 Video encoding method and video encoding apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310671494.1A CN104703030B (en) 2013-12-10 2013-12-10 Video encoding method and video encoding apparatus

Publications (2)

Publication Number Publication Date
CN104703030A true CN104703030A (en) 2015-06-10
CN104703030B CN104703030B (en) 2018-05-22

Family

ID=53349734

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310671494.1A CN104703030B (en) 2013-12-10 2013-12-10 Video encoding method and video encoding apparatus

Country Status (1)

Country Link
CN (1) CN104703030B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105704511A (en) * 2016-01-29 2016-06-22 明基电通有限公司 A method for dynamically adjusting wireless video coding

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102469562A (en) * 2010-11-18 2012-05-23 中国移动通信有限公司 Method and device for controlling power consumption of mobile terminal
CN102761739A (en) * 2011-04-26 2012-10-31 联发科技股份有限公司 Apparatus for dynamically adjusting video decoding complexity, and associated method
CN102802048A (en) * 2012-08-24 2012-11-28 乐视网信息技术(北京)股份有限公司 Multi-screen interaction system and method
CN102981793A (en) * 2012-11-22 2013-03-20 Tcl集团股份有限公司 Screen synchronization method and device
CN103092552A (en) * 2013-01-18 2013-05-08 中兴通讯股份有限公司 Method and system for achieving multi-screen display
US20130128948A1 (en) * 2011-11-23 2013-05-23 Qualcomm Incorporated Display mode-based video encoding in wireless display devices
CN103248947A (en) * 2012-02-08 2013-08-14 海尔集团公司 Video multiple screen sharing method and system for achieving same

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102469562A (en) * 2010-11-18 2012-05-23 中国移动通信有限公司 Method and device for controlling power consumption of mobile terminal
CN102761739A (en) * 2011-04-26 2012-10-31 联发科技股份有限公司 Apparatus for dynamically adjusting video decoding complexity, and associated method
US20120275502A1 (en) * 2011-04-26 2012-11-01 Fang-Yi Hsieh Apparatus for dynamically adjusting video decoding complexity, and associated method
US20130128948A1 (en) * 2011-11-23 2013-05-23 Qualcomm Incorporated Display mode-based video encoding in wireless display devices
CN103248947A (en) * 2012-02-08 2013-08-14 海尔集团公司 Video multiple screen sharing method and system for achieving same
CN102802048A (en) * 2012-08-24 2012-11-28 乐视网信息技术(北京)股份有限公司 Multi-screen interaction system and method
CN102981793A (en) * 2012-11-22 2013-03-20 Tcl集团股份有限公司 Screen synchronization method and device
CN103092552A (en) * 2013-01-18 2013-05-08 中兴通讯股份有限公司 Method and system for achieving multi-screen display

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105704511A (en) * 2016-01-29 2016-06-22 明基电通有限公司 A method for dynamically adjusting wireless video coding

Also Published As

Publication number Publication date
CN104703030B (en) 2018-05-22

Similar Documents

Publication Publication Date Title
JP5492232B2 (en) Mirroring to an external display of the graphic content
EP3324399A1 (en) Concurrent use of multiple user interface devices
CN102665139B (en) The information processing apparatus and information processing method
JP4372103B2 (en) Method of controlling an electronic device and an electronic device
US20130293689A1 (en) Wireless Communication Techniques
CN103297676A (en) Image continuous shooting method and relative image capture system
US9104238B2 (en) Systems and methods for providing enhanced motion detection
CN102968978B (en) A method for controlling the refresh rate of the display device and
CN102893599A (en) Reproduction device, display device, television receiver, system, recognition method, program, and recording medium
US8026982B2 (en) Method of controlling power supply of digital TV and digital TV therefor
JP4834472B2 (en) The information processing apparatus, video playback method and a program
US10212471B2 (en) Method for controlling multiple subscreens on display device and display device therefor
CN103338398B (en) The method of controlling a mobile terminal STB and the mobile terminal
US20130145267A1 (en) Video streaming in a web browser
JP6070544B2 (en) Way video display apparatus and a video display
JP5228796B2 (en) A portable information terminal, a hold state switching method and hold status switching program
WO2013096165A1 (en) A method, apparatus, and system for energy efficiency and energy conservation including dynamic user interface based on viewing conditions
CN102870427A (en) Output device, source apparatus, television set, system, output method, program, and recording medium
CN102099774B (en) Apparatus and method for providing user interface service in a multimedia system
CN103618956A (en) Method for obtaining video associated information and mobile terminal
CN105138228B (en) The display apparatus and a display method
US9131116B2 (en) Information processing apparatus, tuner, and information processing method
JP2011097401A (en) Information processing apparatus, tuner and information processing method
JP2015042006A (en) Audio/video adjustment based on content
CN104410916A (en) On-line living broadcast method and equipment

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
GR01