WO2016033877A1 - Procédé permettant un ajustement dynamique de l'affichage de caractères à l'écran d'un terminal, et terminal - Google Patents

Procédé permettant un ajustement dynamique de l'affichage de caractères à l'écran d'un terminal, et terminal Download PDF

Info

Publication number
WO2016033877A1
WO2016033877A1 PCT/CN2014/092173 CN2014092173W WO2016033877A1 WO 2016033877 A1 WO2016033877 A1 WO 2016033877A1 CN 2014092173 W CN2014092173 W CN 2014092173W WO 2016033877 A1 WO2016033877 A1 WO 2016033877A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
screen
resolution
ratio
face region
Prior art date
Application number
PCT/CN2014/092173
Other languages
English (en)
Chinese (zh)
Inventor
何道敬
张炯衍
曾慧鹏
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2016033877A1 publication Critical patent/WO2016033877A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range

Definitions

  • the present invention relates to a terminal screen management technology, and in particular, to a method and a terminal for dynamically adjusting a screen display of a terminal screen.
  • a mobile terminal refers to a computer device that can be used in mobile, and broadly includes a mobile phone, a notebook, a tablet, a wearable smart terminal, a vehicle-mounted computer, and the like. However, it usually refers to a mobile phone or a smart phone, a tablet computer, and a wearable smart terminal having multiple application functions. With the rapid development of integrated circuit technology, the functions of mobile terminals are becoming more and more abundant and powerful, and their use in work and life is becoming more and more extensive.
  • users can use mobile terminals such as smart phones, tablet computers, and wearable smart terminals during the exercise, but during the exercise, the user and the mobile terminal usually have different degrees of shaking, which causes the screen text of the mobile terminal to follow.
  • the human eye's line of sight produces a relative displacement.
  • the user can usually correct the position of the mobile terminal or the mobile terminal in time to see the terminal screen text, it will inevitably cause the user's discomfort, especially when the shaking frequency is high, the user's discomfort. The response is more pronounced, causing the user to stop using the mobile terminal.
  • the existing terminal screen text display adjustment scheme 1 is based on the assumption that the user remains motionless and only the mobile terminal is in motion, and the terminal screen text display adjustment is performed according to the mobile terminal's own sensor, on the premise of the above assumptions.
  • the existing program one has a more desirable effect.
  • the second terminal screen font adjustment scheme 2 is to combine the external measuring device and the mobile terminal's own sensor to perform screen text display adjustment, and install a measuring device on the user's body to measure the human body motion, and combine with the human body motion measured by the mobile terminal itself. And thus in a variety of situations The terminal screen text display can be adjusted correctly.
  • the existing scheme for adjusting the screen display of the terminal screen has at least the following defects:
  • Solution 1 When the user is exercising or moving together with the mobile terminal, the program will have a large error, that is, when the user needs to adjust the screen text display, there is a phenomenon that there is no timely response, but the user does not need An error occurred when adjusting the screen text display.
  • Solution 2 This solution is better than the solution that relies solely on the mobile terminal's own sensor, but additional measurement equipment is needed, so additional cost will be added; and the addition of measurement equipment will cause inconvenience to the user, easy to lose, and endurance is difficult to guarantee. And other issues.
  • embodiments of the present invention are expected to provide a method and a terminal for dynamically adjusting a screen display of a terminal screen.
  • the embodiment of the invention provides a method for dynamically adjusting the screen display of a terminal screen, the method comprising:
  • the terminal collects the first frame face image and the second frame face image of the current user through the camera of the terminal;
  • an embodiment of the present invention provides a terminal, where the terminal includes: an image collection unit, an area detection unit, and a display adjustment unit;
  • the image acquisition unit is configured to receive the screen font adjustment instruction
  • the camera of the end captures the first frame face image and the second frame face image of the current user
  • the area detecting unit is configured to detect a first face area in the first frame face image and a second face area in the second frame face image;
  • the display adjustment unit is configured to send a screen font adjustment instruction to the image collection unit; and according to a resolution of the first face region, a resolution of the second face region, and a screen resolution of the terminal Rate, adjust the screen text display of the terminal.
  • the method and terminal for dynamically adjusting the screen text display of the terminal provided by the embodiment of the present invention, when receiving the screen text display adjustment instruction, the terminal collects the first frame face image and the second frame face of the current user through the camera of the terminal An image; detecting a first face region in the first frame face image and a second face region in the second frame face image; according to a resolution of the first face region, the second person The resolution of the face area and the screen resolution of the terminal adjust the screen text display of the terminal.
  • the embodiment of the present invention can perform real-time without increasing cost and carrying complexity according to the resolution of the first face region, the resolution of the second face region, and the screen resolution of the terminal. And dynamically adjusting the screen text display of the terminal to enhance the user experience.
  • FIG. 1 is a schematic flowchart of a method for dynamically adjusting a screen display of a terminal screen according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of a terminal structure according to an embodiment of the present invention.
  • the terminal when receiving the screen text display adjustment instruction, collects the first frame face image and the second frame face image of the current user through the camera of the terminal; and detects the first frame face image. a first face region and a second face region in the second frame face image; a resolution according to the first face region, a resolution of the second face region, and the end
  • the screen resolution of the terminal adjusts the screen text display of the terminal.
  • the terminal may be a device with an intelligent display function, and may be, for example, a smart phone, a tablet ipad, a computer, or the like.
  • the embodiment of the invention provides a method for dynamically adjusting the screen display of the terminal screen. As shown in FIG. 1 , the method includes:
  • Step S100 When the terminal receives the screen text display adjustment instruction, the terminal captures the first frame face image and the second frame face image of the current user through the camera of the terminal.
  • the first frame face image represents a current frame face image
  • the second frame face image represents a next frame face image of a current frame face image
  • the control device of the terminal and the like can recognize the operation function of the user's on-screen text display adjustment function, and the control device such as the processor sends the screen text display adjustment instruction.
  • the terminal when receiving the screen text display adjustment instruction, the terminal first initializes the front camera of the terminal and runs the front camera in the background, and then passes the said time interval according to the set time interval manner.
  • the front camera of the terminal collects a frame of the face image of the current user, and the specific implementation manner is as follows:
  • the terminal When receiving the screen font adjustment instruction, the terminal collects the current frame face image of the current user through the front camera of the terminal; after the set time interval, starts collecting the next frame face image of the current frame face image; The next frame face image is used as the current frame face image, and after the next set time interval, the next user frame image of the current user is continuously collected.
  • the time interval is set according to actual needs.
  • the set time interval is 0.5S
  • a frame image of the current user is collected by the front camera of the terminal every 0.5S, thereby reducing the screen text per unit time.
  • Step S101 Detect a first face area in the first frame face image and a second face area in the second frame face image.
  • a rectangular area including only a face image is called a face area.
  • a minimum detectable face area is required. If the minimum face area is too small, a face area false detection phenomenon may occur if the minimum face area is too large. , the face area cannot be detected.
  • the resolution of the minimum face area can be set to 20% of the terminal screen resolution to ensure that the face area can be detected correctly.
  • Step 1 pre-processing the first frame face image and the second frame face image respectively; wherein the pre-processing includes image denoising, image brightness and contrast enhancement;
  • the pre-processing algorithm is not specifically limited, and the pre-processing algorithm may be selected to perform pre-processing on the face image according to actual conditions; specifically, according to the pre-processing algorithm, the first frame face image and the second frame person are The preprocessing of the face images separately belongs to the prior art, and is not described here;
  • Step 2 detecting a first face region in the pre-processed first frame face image and a second face region in the preprocessed second frame face image according to the face detection algorithm and the face tracking algorithm , the implementation is as follows:
  • the first frame face image is preprocessed, and then the machine-based face detection algorithm is used to detect the preprocessed first frame.
  • the first face area in the face image because the face detection algorithm consumes more system resources, therefore, it is not necessary to continuously use the face detection algorithm to detect the face area in the subsequently collected face image, but can adopt A face tracking algorithm that consumes less system resources tracks the face region in the subsequently acquired face image, for example, the Camshift algorithm, using Camshift Before the algorithm, the first face area needs to be pre-processed, for example, performing histogram equalization, normalization, binarization, color space conversion, and the like on the first face area, where The processing of histogram equalization, color space conversion and the like is performed to ensure the subsequent tracking effect; then the Camplay algorithm is used to generate a tracking object in the processed first face region, and the second frame is tracked according to the tracking object.
  • the second face area in the face image because the face detection algorithm consumes more system resources, therefore, it is not necessary to continuously use the face detection algorithm to
  • the face detection algorithm and the face tracking algorithm are not specifically limited; how to detect the first face region and the pre-processing in the pre-processed first frame face image according to the face detection algorithm and the face tracking algorithm
  • the second face area in the second frame of the face image belongs to the prior art, and details are not described herein again.
  • Step S102 Adjust the screen text display of the terminal according to the resolution of the first face region, the resolution of the second face region, and the screen resolution of the terminal.
  • the resolution of the first face region is preset to X 1 *Y 1
  • the resolution of the second face region is preset to X 2 *Y 2 , that is, the first face
  • the vertical resolution of the region is X 1 and the lateral resolution is Y 1
  • the vertical resolution of the second human face region is X 2 and the horizontal resolution is Y 2 .
  • the screen text display of the terminal may adopt the following two methods:
  • the ratio interval corresponding to the second ratio R 2 The screen displays the font size, and the screen text display of the terminal is adjusted according to the corresponding screen display font size.
  • the second mode adjusts the screen text display of the terminal according to the horizontal resolution of the second human face region Y 1 and the horizontal resolution of the second human face region is Y 2 :
  • the third ratio R 3 and the fourth ratio R 4 do not belong to the same ratio interval, determining, according to the correspondence between the preset ratio interval and the screen display font size, the ratio interval corresponding to the fourth ratio R 4
  • the screen displays the font size, and the screen text display of the terminal is adjusted according to the corresponding screen display font size.
  • a plurality of ratio intervals may be preset from the interval 0 to 1 according to actual needs, for example, preset five ratio intervals (0 to 0.2), (0.2 to 0.33), (0.33 to 0.5), (0.5 to 0.75), (0.75 ⁇ 1], and set the corresponding screen display font size for the ratio interval; because the smaller the value in the ratio interval is, the smaller the face area is, that is, the farther the face is from the front camera of the terminal, therefore, for convenience
  • the user needs to set a corresponding relatively large screen font according to the above-mentioned rule, and set a relatively small screen display font size for a larger value interval, for example, setting a ratio interval (0 to 0.2).
  • the screen displays the font size 16sp, where sp is Android
  • the default font size unit set the ratio range (0.2 to 0.33) corresponding screen display font size is 15sp; set the ratio interval (0.33 ⁇ 0.5) corresponding screen display font size is 14sp; set the ratio interval (0.5 ⁇ 0.75) corresponding screen display font size is 13sp; set the ratio range (0.75 ⁇ 1) corresponding to the screen display font size is 12sp; the preset ratio range and the screen display font size correspondence as shown in Table 1.
  • Ratio interval Screen font size (0 ⁇ 0.2] 16sp (0.2 ⁇ 0.33) 15sp (0.33 ⁇ 0.5) 14sp (0.5 ⁇ 0.75] 13sp (0.75 ⁇ 1] 12sp
  • the terminal when receiving the screen text display adjustment instruction, collects the first frame face image and the second frame face image of the current user through the camera of the terminal; and detects the first frame face image. a first face region and a second face region in the second frame face image; according to a resolution of the first face region, a resolution of the second face region, and a screen resolution of the terminal Rate, adjust the screen text display of the terminal.
  • the embodiment of the present invention can adjust the screen text display of the terminal in real time and dynamically according to the resolution of the first face region, the resolution of the second face region, and the screen resolution of the terminal. To enhance the user experience.
  • the correspondence between the ratio interval preset and the screen text display according to the actual demand is as shown in Table 1.
  • the detected vertical resolution of the face region in the current frame face image is 100 pixels, and is determined according to the vertical resolution of 100 pixels and the screen vertical resolution of the terminal is 300 pixels.
  • First ratio After the time interval of 0.5S, the detected vertical resolution of the face region in the next frame of the current frame is 140 pixels, which is determined according to the vertical resolution of 140 pixels and the screen vertical resolution of the terminal is 300 pixels.
  • Second ratio Since 0.333 and 0.47 belong to the same ratio interval (0.33 to 0.5), the screen text display of the terminal is not adjusted, and the screen text display of the terminal is still adjusted according to the screen display font number corresponding to 0.333;
  • the next frame face image is used as the current frame face image, then After the time interval of 0.5S, it is detected that the vertical resolution of the face region in the next frame of the face image is 160 pixels, and the second ratio is determined according to the vertical resolution of 160 pixels and the screen lateral resolution of the terminal of 300 pixels. Since 0.47 and 0.533 do not belong to the same ratio interval, they belong to two ratio intervals (0.33 to 0.5) and (0.5 to 0.75). Therefore, the screen text of the terminal is adjusted according to the screen display font number corresponding to the ratio interval of 0.533. Display, that is, adjust the screen display font size 14 to the number 13, so that the terminal screen text display is adjusted in real time and dynamically, thereby enhancing the user experience.
  • the embodiment of the present invention provides a terminal.
  • the principle and method for solving the problem are similar. Therefore, the implementation process and implementation principles of the terminal can be described in the implementation process and implementation principles of the foregoing method. I won't go into details here.
  • the terminal provided by the embodiment of the present invention includes: an image collecting unit 200, an area detecting unit 201, and a display adjusting unit 202;
  • the image capturing unit 200 is configured to collect, by the camera of the terminal, a first frame face image and a second frame face image of the current user when receiving the screen text display adjustment instruction;
  • the area detecting unit 201 is configured to detect a first face area in the first frame face image and a second face area in the second frame face image;
  • the font adjustment unit 202 is configured to send a screen text display adjustment instruction to the image collection unit 200; and according to the resolution of the first face region, the resolution of the second face region, and the terminal The screen resolution adjusts the screen text display of the terminal.
  • the image collection unit 200 is specifically configured to:
  • the first frame face image and the second frame face image of the current user are collected by the camera of the terminal.
  • the area detecting unit 201 is specifically configured to:
  • the first face region in the preprocessed first frame face image and the second face region in the preprocessed second frame face image are detected.
  • the display adjustment unit 202 is specifically configured to:
  • the resolution of the first face region is preset to be X 1 *Y 1
  • the resolution of the second face region is preset to be X 2 *Y 2 ;
  • the ratio interval corresponding to the second ratio R 2 The screen displays the font size, and the screen text display of the terminal is adjusted according to the corresponding screen display font size.
  • the display adjustment unit 202 is specifically configured to:
  • the resolution of the first face region is preset to be X 1 *Y 1
  • the resolution of the second face region is preset to be X 2 *Y 2 ;
  • the third ratio R 3 and the fourth ratio R 4 do not belong to the same ratio interval, determining, according to the correspondence between the preset ratio interval and the screen display font size, the ratio interval corresponding to the fourth ratio R 4
  • the screen displays the font size, and the screen text display of the terminal is adjusted according to the corresponding screen display font size.
  • the image acquisition unit 200, the area detecting unit 201, and the display adjustment unit 202 may be located by a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP), or Field Programmable Gate Array (FPGA) implementation.
  • CPU central processing unit
  • MPU microprocessor
  • DSP digital signal processor
  • FPGA Field Programmable Gate Array
  • the real-time and dynamic adjustment can be performed according to the resolution of the first face region, the resolution of the second face region, and the screen resolution of the terminal without increasing cost and carrying complexity.
  • the screen text display of the terminal enhances the user experience.

Abstract

L'invention concerne un procédé permettant un ajustement dynamique de l'affichage de caractères à l'écran d'un terminal. Le procédé comporte : quand un terminal reçoit une instruction d'ajustement d'affichage des caractères à l'écran, l'étape consistant à recueillir une première trame d'image faciale et une deuxième trame d'image faciale d'un utilisateur en cours au moyen d'une caméra du terminal ; l'étape consistant à détecter une première zone faciale dans la première trame d'image faciale et une deuxième zone faciale dans la deuxième trame d'image faciale ; et l'étape consistant à ajuster l'affichage des caractères à l'écran du terminal en fonction de la résolution de la première zone faciale, de la résolution de la deuxième zone faciale et de la résolution de l'écran du terminal. L'invention concerne également un terminal.
PCT/CN2014/092173 2014-09-05 2014-11-25 Procédé permettant un ajustement dynamique de l'affichage de caractères à l'écran d'un terminal, et terminal WO2016033877A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410453841.8 2014-09-05
CN201410453841.8A CN104298441A (zh) 2014-09-05 2014-09-05 一种动态调整终端屏幕文字显示的方法及终端

Publications (1)

Publication Number Publication Date
WO2016033877A1 true WO2016033877A1 (fr) 2016-03-10

Family

ID=52318191

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/092173 WO2016033877A1 (fr) 2014-09-05 2014-11-25 Procédé permettant un ajustement dynamique de l'affichage de caractères à l'écran d'un terminal, et terminal

Country Status (2)

Country Link
CN (1) CN104298441A (fr)
WO (1) WO2016033877A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106155279A (zh) * 2015-03-27 2016-11-23 中兴通讯股份有限公司 一种动态调整终端屏幕显示的方法及终端
CN111767098A (zh) * 2019-04-24 2020-10-13 北京京东尚科信息技术有限公司 用于调整字体大小的方法和装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090167900A1 (en) * 2007-12-26 2009-07-02 Altek Corporation Image processing method for adjusting a scale of a face
CN101751209A (zh) * 2008-11-28 2010-06-23 联想(北京)有限公司 一种调整屏幕呈现元素的方法及计算机
CN101788876A (zh) * 2009-01-23 2010-07-28 英华达(上海)电子有限公司 自动缩放调整的方法及其系统
CN102591550A (zh) * 2011-01-04 2012-07-18 中国移动通信集团公司 终端界面内容的缩放控制方法及装置
CN103377643A (zh) * 2012-04-26 2013-10-30 富泰华工业（深圳）有限公司 字体调整系统及方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6933979B2 (en) * 2000-12-13 2005-08-23 International Business Machines Corporation Method and system for range sensing of objects in proximity to a display
CN101539989A (zh) * 2008-03-20 2009-09-23 中国科学院研究生院 基于人脸检测的错误阅读姿势检测方法
CN102914286B (zh) * 2012-09-12 2014-09-10 福建网龙计算机网络信息技术有限公司 基于手持设备对使用者坐姿进行自动检测方法
CN103903595A (zh) * 2012-12-29 2014-07-02 深圳富泰宏精密工业有限公司 字体调整方法及系统
CN103491307B (zh) * 2013-10-07 2018-12-11 厦门美图网科技有限公司 一种后置摄像头的智能自拍方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090167900A1 (en) * 2007-12-26 2009-07-02 Altek Corporation Image processing method for adjusting a scale of a face
CN101751209A (zh) * 2008-11-28 2010-06-23 联想(北京)有限公司 一种调整屏幕呈现元素的方法及计算机
CN101788876A (zh) * 2009-01-23 2010-07-28 英华达(上海)电子有限公司 自动缩放调整的方法及其系统
CN102591550A (zh) * 2011-01-04 2012-07-18 中国移动通信集团公司 终端界面内容的缩放控制方法及装置
CN103377643A (zh) * 2012-04-26 2013-10-30 富泰华工业（深圳）有限公司 字体调整系统及方法

Also Published As

Publication number Publication date
CN104298441A (zh) 2015-01-21

Similar Documents

Publication Publication Date Title
WO2019137038A1 (fr) Procédé de détermination de point de regard, procédé et dispositif de réglage de contraste, appareil de réalité virtuelle et support d'informations
CN106652972B (zh) 显示屏的处理电路、显示方法及显示器件
WO2023071884A1 (fr) Procédé de détection de regard, procédé de commande pour dispositif électronique et dispositifs associés
US9424769B2 (en) Display and brightness adjusting method thereof
US9892336B2 (en) Detection devices and methods for detecting regions of interest
CN106781327B (zh) 坐姿矫正方法及移动终端
US11055829B2 (en) Picture processing method and apparatus
CN104850228B (zh) 基于移动终端的锁定眼球的注视区域的方法
CN103793719A (zh) 一种基于人眼定位的单目测距方法和系统
CN104182114A (zh) 用于调整移动设备的画面显示方向的方法和系统
CN111147749A (zh) 拍摄方法、拍摄装置、终端及存储介质
GB2553926A (en) Automatic detection of panoramic gestures
CN107133008B (zh) 移动终端自动调整输出的方法
TW201516967A (zh) 顏色取樣方法及觸控控制裝置
CN103165064A (zh) 基于人眼与屏幕距离自动调整显示屏分辨率的防窥视系统及方法
WO2018149322A1 (fr) Procédé, dispositif, et appareil d'identification d'image, et support de stockage de données
TWI671712B (zh) 自動調整顯示畫面比例的方法及其顯示裝置
WO2016011787A1 (fr) Procédé et appareil d'ajustement automatique d'une page d'un document électronique
WO2016033877A1 (fr) Procédé permettant un ajustement dynamique de l'affichage de caractères à l'écran d'un terminal, et terminal
WO2020108010A1 (fr) Procédé et appareil de traitement vidéo, dispositif électronique et support d'enregistrement
CN105718033A (zh) 疲劳检测系统及方法
CN104461002A (zh) 一种降低观看移动终端设备的视觉疲劳度的装置和方法
KR20130081439A (ko) 휴대 단말기에서 카메라 뷰 영역을 표시하는 장치 및 방법
WO2016155435A1 (fr) Procédé destiné à ajuster dynamiquement l'affichage d'un écran de terminal, terminal et support de stockage l'utilisant
JP2014121079A5 (fr)

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14901056

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14901056

Country of ref document: EP

Kind code of ref document: A1