WO2011032488A1

WO2011032488A1 - Method and equipment for adjusting display contents

Info

Publication number: WO2011032488A1
Application number: PCT/CN2010/076891
Authority: WO
Inventors: 严正飞; 陈茜
Original assignee: 华为终端有限公司
Priority date: 2009-09-18
Filing date: 2010-09-14
Publication date: 2011-03-24

Abstract

The embodiments of the present invention disclose a method and an equipment for adjusting display contents, and belong to the field of mobile communications. The method includes: obtaining the first image information in a user terminal for the facial character of a user (101); obtaining the second image information in the user terminal for the facial character of the user when a movement occurs between the user terminal and the user (102); adjusting the display contents of the user terminal based on the first image information and the second image information (103). The embodiments of the present invention also disclose a user terminal equipment. The solutions provided by the embodiments of the present invention realize to adjust automatically the sizes and pages of the display contents in a user terminal, according to changes of distance and position between the user and the user terminal.

Description

The present invention claims to be submitted to the Chinese Patent Office on October 13, 2009, and the application number is 200910178159. 1. The invention is entitled "A Method and Apparatus for Adjusting Display Content" and in 2009 9 The priority of the Chinese Patent Application No. 200910093661. 4, entitled "Display Method of a Mobile Terminal and Mobile Terminal", is incorporated herein by reference. TECHNICAL FIELD The present invention relates to the field of mobile communications, and in particular, to a method and apparatus for adjusting display content. BACKGROUND With the development of communication technologies, the scope of use of user terminals is becoming wider and wider, and the requirements of users for user terminals are also increasing, especially for mobile terminals.

Current user terminals are subject to various restrictions due to various factors such as screen size. When the user terminal is far away from the user, the user cannot clearly distinguish the display content in the user terminal, such as a font, a picture, a video, etc.; conversely, when the user terminal is closer to the user, the content is displayed in the user terminal. The size remains the same, although the user can see the display content, but can not get more display information.

The inventors found in the process of implementing the present invention:

When the distance between the user terminal and the user changes, the user needs to manually adjust the size of the display content of the user terminal, and when the user browses the display content of a certain page, the user needs to manually adjust the previous or next page of the user terminal. The display content, resulting in cumbersome user operations, the user's experience is poor. SUMMARY OF THE INVENTION In order to automatically adjust the size and page of the displayed content in the user terminal according to the change of the distance and the position of the user and the user terminal, the embodiment of the invention provides a method and a device for adjusting the display content, and the solution is as follows:

An embodiment of the present invention provides a method for adjusting display content, where the method includes:

Obtaining first imaging information of the facial features of the user in the user terminal;

Obtaining second imaging information of a facial feature of the user in the user terminal when a movement occurs between the user terminal and the user;

And displaying the display content in the user terminal according to the first imaging information and the second imaging information. The embodiment of the invention further provides a user terminal, where the user terminal includes: a first acquiring module, configured to acquire first imaging information of a facial feature of the user in the user terminal, and a second acquiring module, configured to acquire a facial feature of the user when the user terminal moves with the user Second information in the user terminal;

And an adjustment module, configured to adjust display content in the user terminal according to the first imaging information and the second imaging information.

The beneficial effects of the embodiment of the present invention are: the solution provided by the embodiment of the present invention, when the user terminal and the user move, adjust the display content of the user terminal by using different facial imaging information of the user's facial features in the mobile terminal, The user can obtain the display content more clearly and fully obtain the display content information, and can also realize the automatic page turning function of the user terminal, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below, and obviously, in the following description The drawings are only some of the embodiments of the present invention, and other drawings may be obtained from those skilled in the art without departing from the drawings.

1 is a schematic flow chart of a method provided by Embodiment 1 of the present invention;

2 is a schematic flow chart of a method provided by Embodiment 2 of the present invention;

3 is a schematic flowchart of a mobile terminal moving distance according to Embodiment 2 of the present invention;

4 is a schematic flow chart of a method provided by Embodiment 3 of the present invention;

FIG. 5 is a schematic structural diagram of a device according to Embodiment 4 of the present invention; FIG.

6-9 are schematic flowcharts of a method according to Embodiment 5 of the present invention;

10-11 are schematic diagrams showing the structure of a terminal provided in Embodiment 6 of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS In order to make the objects, technical solutions and advantages of the embodiments of the present invention more comprehensible, the embodiments of the present invention will be further described in detail.

At present, digital image recognition technology is widely used due to its high recognition rate and convenient processing, especially in face recognition. Face recognition technology is the fastest growing recognition technology in recent years. Generalized face recognition includes facial image acquisition, face localization, facial recognition preprocessing, identity confirmation and identity search. In the narrow sense, it only refers to identity verification through face-to-face or identity search. The basic hardware for face recognition is composed of a camera. After obtaining the appropriate digital image, the computer will extract the target surface from the background scene, and then perform certain processing to compare with the surface features in the database to realize the recognition of the face. With the development of 3G (3rd Generation, 3rd Generation Mobile Communication) technology, for a 3G mobile terminal with digital image recognition technology, its built-in camera can perform image recognition on the facial features of the user, wherein the facial features of the user can be eyes. The arbitrarily fixed two points of the face, the nose, the mouth, and the like are not limited in the embodiment of the present invention. The embodiment of the present invention implements the function of automatically adjusting the size of the displayed content in the user terminal and flipping the page by applying the digital identification technology to the user terminal. The specific content is as follows:

In order to automatically adjust the size and page of the displayed content in the user terminal according to the change of the distance and the position of the user and the user terminal, the embodiment of the present invention provides a method for adjusting the display content. Referring to FIG. 1, the method includes: - 101: Acquiring First imaging information of the user's facial features in the user terminal;

The facial features of the user may be two points, two eyebrows, and two points that are arbitrarily fixed on the face, which is not limited by the embodiment of the present invention.

102: Acquire second imaging information of a facial feature of the user in the user terminal when a movement occurs between the user terminal and the user;

The user terminal in the embodiment of the present invention may be any user equipment such as a mobile terminal, a PC, a PDA, and the like, which is not limited in this embodiment of the present invention.

103: Adjust display content in the user terminal according to the first imaging information and the second imaging information.

The display content in the embodiment of the present invention may be a font, a picture, a video, and the like, which are not limited in the embodiment of the present invention.

Wherein the first imaging information is a first imaging distance and/or a first imaging position, and the second imaging information is a second imaging distance and/or a second imaging position,

The first imaging information is a first imaging distance, and the second imaging information is a second imaging distance. The display content in the user terminal is adjusted according to the first imaging information and the second imaging information, specifically:

The size of the displayed content in the user terminal is adjusted according to the first imaging distance and the second imaging distance.

The first imaging information is a first imaging position, and the second imaging information is a second imaging position, and the display content in the user terminal is adjusted according to the first imaging information and the second imaging information, specifically:

A page displaying content in the user terminal is adjusted according to the first imaging position and the second imaging position.

Wherein, when the first imaging information is the first imaging distance and the first imaging position, the second imaging information is the second imaging Distance and second imaging position,

Adjusting the display content in the user terminal according to the first imaging information and the second imaging information, specifically, adjusting the size of the display content in the user terminal according to the first imaging distance and the second imaging distance; according to the first imaging position and the second The imaging position, which adjusts the page on which the content is displayed in the user terminal.

Further, adjusting the size of the displayed content in the user terminal according to the first imaging distance and the second imaging distance, specifically including:

Obtaining a size of the display content of the user terminal when the first imaging distance is;

And calculating a size of the adjusted display content according to a ratio of the ratio of the first imaging distance to the second imaging distance being equal to a ratio of the size of the adjusted display content to the size of the display content before the adjustment;

The size of the displayed content in the user terminal is adjusted according to the size of the adjusted display content.

Further, adjusting the size of the displayed content in the user terminal according to the adjusted display content, further comprising: determining whether the adjusted display content is within a threshold range set by the user terminal and exceeding a screen size of the user terminal ;

When the size of the adjusted display content is within the threshold range set by the user terminal and does not exceed the screen size of the user terminal, the size of the display content in the user terminal is adjusted according to the size of the adjusted display content.

Further, adjusting the page for displaying the content in the user terminal according to the first imaging position and the second imaging position, specifically comprising: deriving the second imaging position and the first imaging position to obtain a change value of the imaging position;

The page displaying the content in the user terminal is adjusted according to the change value of the imaging position.

Further, adjusting the page for displaying the content in the user terminal according to the change value of the imaging position, specifically: determining whether the size of the change value of the imaging position is greater than a preset position threshold, and if yes, according to the direction of the change value of the imaging position , Adjust the page that displays content in the user terminal.

The acquiring the first imaging information of the facial feature of the user in the user terminal, specifically includes: acquiring a facial image of the user by using a camera of the user terminal;

Identifying a facial image of the user to obtain first imaging information of the facial feature of the user in the user terminal; correspondingly, when the user terminal moves with the user, acquiring a second imaging of the facial feature of the user in the user terminal The information specifically includes: obtaining, by the camera of the user terminal, a facial image of the user when the user terminal moves with the user; identifying a facial image of the user when the user terminal moves with the user, and obtaining the facial feature of the user at the user terminal Second imaging information in . The method provided by the embodiment of the present invention, when the user terminal moves with the user, adjusts the size and page of the display content of the user terminal by using different imaging distances and imaging positions of the facial features of the user in the user terminal. The display content can be obtained more clearly and the display content information can be fully obtained, and the automatic page turning function of the user terminal can be realized, thereby improving the user experience. Example 2

The embodiment of the present invention provides a method for adjusting display content. The facial features of the user in the embodiment of the present invention are taken as an example of a user's two-eye distance, the user terminal uses a 3G mobile terminal as an example, and the display content is a font, for example. The digital image recognition technology recognizes the distance between the two eyes of the user and the position of the two eyes to automatically adjust the display content of the mobile terminal, thereby realizing the automatic adjustment of the size of the display content of the mobile terminal. Referring to FIG. 2, the method of the embodiment of the present invention is performed below. Description:

201: The mobile terminal acquires a facial image of the user through the internal camera from the user S, and analyzes the acquired image to obtain an imaging distance HI of the two eyes of the user in the mobile terminal.

The mobile terminal needs to determine the facial features of the facial image of the user when acquiring the facial image of the user. The facial features in the embodiment of the present invention are exemplified by the distance between the two eyes of the user, and may also be the distance between the two ears of the user and the two eyebrows. The distance between the two sides of the arbitrary surface is sufficient, and the embodiment of the present invention is not limited.

Referring to FIG. 3, the distance between the mobile terminal and the user is S, and the facial image of the user is obtained by the internal camera, wherein the value of S can be flexibly set according to needs as long as the obtained facial image is clear; the mobile terminal passes the number. The image recognition technology analyzes the acquired image. The specific analysis process can adopt the processing flow of the existing image recognition technology, image processing the collected image data, and identify the distance between the user's eyes in the mobile terminal in the facial image. Thereby, the imaging distance HI of the mobile terminal at the distance from the user's eyes at the user S is obtained, wherein the HI here refers to the imaging distance of the two eyes on the sensor sensor of the mobile terminal.

In the embodiment of the present invention, it is assumed that the actual distance between the two eyes of the user is H, and the vertical distance between the lens and the sensor is L. When the distance between the user and the mobile terminal is S, the font size displayed by the mobile terminal is T.

The mobile terminal in the embodiment of the present invention may be specifically a mobile phone, a notebook computer, a PDA, or the like. In the embodiment of the present invention, a 3G mobile terminal supporting digital image recognition technology is taken as an example, and other mobile terminals supporting digital image technology are in the embodiment of the present invention. The methods provided are also applicable.

Generally, the camera of the 3G mobile terminal is divided into an inner camera and an outer camera, wherein the external camera has the same function as an ordinary camera, and is used to acquire an image or video within the imaging range, and the internal camera is used to acquire the user's own image including the user's Face images, surrounding scenes, etc., to obtain video information for video conversations. The mobile terminal in the embodiment of the present invention takes an internal camera to obtain a facial image of the user as an example, and may of course also be acquired by an external camera. The facial image of the user is not limited in this embodiment of the present invention.

202: When the mobile terminal moves from the user S to the S+AS, the mobile terminal acquires the facial image of the user at this time through the internal camera, and analyzes the image to obtain the imaging distance H2 of the two eyes of the user in the mobile terminal.

The internal camera of the mobile terminal continuously acquires the facial image of the user according to a predetermined time interval, such as 1 second, and performs analysis processing to obtain an imaging distance of the two eyes, and the distance between the mobile terminal and the user is different from the imaging distance of the two eyes on the sensor sensor. It is also different accordingly.

Referring to FIG. 3, when the mobile terminal is away from the user by S+AS, the imaging distance of the user's eyes on the sensor Sensor is H2.

203: The mobile terminal calculates a change value ΔΤ of the font size according to HI and H2, and the specific content is as follows: Referring to FIG. 3, according to the actual distance between the eyes of the user, the vertical distance between the lens and the sensor Sensor is L, the mobile terminal The imaging distance of the two eyes from the user S is Hl, and the formula (1) is obtained:

H/S=H1/L Equation (1) The imaging distance of the two eyes from the user's S+AS by the mobile terminal is H2, and the formula (2) is available:

H/ ( S+AS) =H2/L Equation (2 ) Assume that the font size displayed by the mobile terminal at the distance from the user S+AS is Τ+ΔΤ, ΔΤ is the change value of the font size, and the formula (3) is obtained:

(Τ+ΔΤ) /Τ= ( S+AS) /S Equation (3 ) From the above formula (1) and formula (2), the formula (4) is available:

Hl/H2= (S+AS ) /S (4) From the above formula (3) and formula (4), the formula (5) is obtained:

ΔΤ/Τ= (H1-H2) /Η2 Equation (5) It can be known from equation (5) that when the mobile terminal moves from the distance S to the user S+AS, the font size displayed by the mobile terminal is At S and at S+AS, the user's two eyes are related to the imaging distance of the mobile terminal, so when the distance between the mobile terminal and the user changes, the font size displayed by the mobile terminal changes accordingly, and the size of the change See equation (5). Equation (5) can also be derived: Τ+ΔΤ/Τ= H1/H2, that is, the adjusted font is inversely proportional to the imaging distance of the user's eyes. The smaller the imaging distance of the user's eyes, the larger the adjusted font. Conversely, the larger the imaging distance of the user's eyes, the smaller the adjusted font.

204: Determine, according to the change value of the font size, whether the converted font is within the maximum font dot matrix and the minimum font dot matrix, and if yes, automatically adjust the font size of the mobile terminal according to the change value of the font size.

Among them, the mobile terminal is limited by the maximum font dot matrix supported by itself and the dot matrix supported by the smallest font, so the converted font size must be within the range of the largest font dot matrix and the smallest font dot matrix, that is, the changed word size. The body must be less than or equal to the maximum font dot matrix, and greater than or equal to the minimum font dot matrix, where the dot matrix refers to the pixel point, for example, the dot matrix is 6*6, that is, the length and width are each 6 pixel points. For example: The maximum font dot matrix supported by the mobile terminal is 8*8, and the minimum font dot matrix is 2*2. If the transformed font ΔΤ+Τ is 4*4, the transformed font ΔΤ+Τ is smaller than the maximum font dot matrix. 8*8 is greater than the minimum font dot matrix 2*2 at the same time, the font size is automatically adjusted from the original T to ΔΤ+Τ; if the font transformation is ΔΤ+Τ is 10*10, the transformed font ΔΤ+Τ is larger than the maximum font. Dot matrix 8*8, at this time, the font size displayed by the mobile terminal is not adjusted; if ΔΤ+Τ is 1*1 after the font conversion, the converted font is smaller than the minimum font dot matrix 2*2, which is not displayed on the mobile terminal at this time. The font size is adjusted.

For the different mobile terminals, the maximum font dot matrix and the minimum font dot matrix are different from each other, which is not limited by the embodiment of the present invention. In addition, the font of the mobile terminal is also limited by the screen size of the mobile terminal, and the displayed font size cannot be larger than the screen power of the mobile terminal; otherwise, the mobile terminal cannot display the font or cannot display the font completely.

The above steps 201-204 are when the mobile terminal moves from the user S to the user S+AS, the font size displayed by the mobile terminal is automatically calculated according to different distances, and the imaging distance of the eyes of the user in the mobile terminal is automatically Adjustment.

The method provided by the embodiment of the present invention is also applicable to the case where the display content of the mobile terminal is an image and a video. When the display content is an image, the imaging distance of the two eyes in the mobile terminal according to the image acquired by different distances is adjusted. The size of the picture, but the size of the adjusted picture cannot be larger than the size of the screen; when the display content is video, the image obtained by different distances is the imaging distance of the two eyes in the mobile terminal, and the size of the video is adjusted, but the adjusted video The size cannot be larger than the size of the screen.

The method provided by the embodiment of the present invention, when the distance between the user terminal and the user moves, the imaging distance of the user's facial features in the user terminal is different, and the size of the display content of the user terminal is adjusted, and the distance between the user terminal and the user is adjusted. When it becomes larger, the display content of the adjustment user terminal becomes larger, so that the user can obtain the display content more clearly; when the distance between the user terminal and the user becomes smaller, the display content of the adjustment user terminal becomes smaller, so that the user can obtain more display. Content information improves the user experience. Example 3

The embodiment of the present invention provides a method for adjusting display content. The facial features of the user in the embodiment of the present invention are taken as an example of a user's two-eye distance, the user terminal uses a 3G mobile terminal as an example, and the display content is a font, for example. The digital image recognition technology recognizes the distance between the two eyes of the user and the position of the two eyes to automatically adjust the display content of the mobile terminal, and realizes automatic page turning of the display content of the mobile terminal. Referring to FIG. 4, the method of the embodiment of the present invention is performed below. description: 301: The mobile terminal acquires a facial image of the user through the internal camera from the user S, and analyzes the acquired image to obtain an imaging position P1 of the two eyes of the user in the mobile terminal.

The mobile terminal needs to determine the facial features of the facial image of the user when acquiring the facial image of the user. The facial features in the embodiment of the present invention are exemplified by the distance between the two eyes of the user, or may be any fixed face of the user's ear or nose. The position of the present invention is not limited.

The distance between the mobile terminal and the user is s, and the facial image of the user is obtained by the internal camera, wherein the value of S can be flexibly set according to requirements as long as the obtained facial image is clear; the mobile terminal adopts digital image recognition technology. The acquired image is analyzed, and the specific analysis process can adopt the processing flow of the existing image recognition technology, perform image processing on the collected image data, and identify the position information of the user's eyes in the mobile terminal in the face image, thereby obtaining The mobile terminal is at an imaging position P1 of the user's eyes from the user S, where the PI is the imaging position information of the two eyes on the sensor sensor of the mobile terminal.

Generally, the camera of the 3G mobile terminal is divided into an inner camera and an outer camera, wherein the outer camera has the same function as the ordinary camera, and is used to acquire an image or video within the imaging range, and the inner camera is used to acquire the user's own image including the user. The facial image and the surrounding scenes, etc., to obtain video information for the video conversation. For example, the mobile terminal in the embodiment of the present invention obtains the facial image of the user by using the internal camera. For example, the facial image of the user may be acquired by the external camera.

302: When the mobile terminal moves from the user S to the S+AS, the mobile terminal acquires the facial image of the user at this time through the internal camera, and analyzes the image to obtain the imaging position P2 of the two eyes of the user in the mobile terminal.

Wherein, the internal camera of the mobile terminal continuously acquires the facial image of the user according to a predetermined time interval, such as 1 second, and performs analysis processing to obtain an imaging position of the two eyes, and the position of the mobile terminal and the user are different at the imaging position of the two eyes on the sensor sensor. It is also different accordingly. The movement referred to here refers to the movement of the user's position, and the distance between the two movements can be the same or the distance.

303: The mobile terminal judges P1 and according to the imaging position P1 of the user's two eyes and the imaging position P2 of the two eyes of the user.

Whether the change value of P2 is greater than a predetermined threshold, if yes, go to step 304; otherwise, end.

Wherein, the mobile terminal can set a predetermined time interval, such as 10 frames or 1 second, to analyze the position information P1 and P2 of the imaging distance of the two eyes of the user in the acquired image, first determine whether P1 and P2 are the same. , thereby determining whether the mobile terminal moves in position; if it is determined that the imaging position P1 of the two eyes of the user is the same as the imaging position P2 of the two eyes of the user, it is determined that the mobile terminal does not move in the position, and the font is not adjusted. Displaying a page; if it is determined that the imaging position PI of the two eyes of the user is different from the imaging position P2 of the two eyes of the user, determining that the mobile terminal moves in position, and calculating whether the change value of ΔΡ=Ρ2-Ρ1 of P2 and P1 is greater than a predetermined threshold, If ΔΡ is greater than the predetermined threshold, step 304 is performed _; otherwise, the display page of the font is not adjusted. The threshold value here can be flexibly set according to the situation, for example, it can be H1/2, where the calculation of ΔΡ can be horizontal or vertical or the actual distance between the two positions, and the embodiment of the present invention does not limit the calculation of the distance. .

304: Adjust the page displaying the font according to the moving direction of P1 and Ρ2.

Wherein, when ΔΡ is greater than a predetermined threshold, it is determined that the imaging position of the two eyes of the user is from the moving direction of P1 to Ρ2, for example, the moving direction of the mobile terminal may be determined according to whether ΔΡ is a positive value, and it is assumed that if ΔΡ is positive, the mobile terminal is determined. Moving to the right, setting the page displayed when the mobile terminal moves to the right automatically flips to the next page; conversely, if ΔΡ is negative, it is determined that the mobile terminal moves to the left, and the mobile terminal is displayed when moving to the left. The page automatically flips to the previous page. Of course, ΔΡ can also be set to be negative, and it is determined that the mobile terminal moves to the right, and the page displayed when the mobile terminal moves to the right is automatically turned to the next page; ΔΡ is positive, and it is determined that the mobile terminal moves to the left, and the movement is set. The page displayed when the terminal moves to the left automatically flips to the previous page; the embodiment of the present invention does not limit the setting of the moving direction and the setting of the page turning, and the moving direction of the mobile terminal can also be moved up and down and in the mobile terminal. The direction of P1 is also opposite, and the resulting positive and negative are also relative.

The above steps 301-304 are that when the mobile terminal moves from the user S to the user S+AS, the font page displayed by the mobile terminal is automatically adjusted according to the change of the imaging position of the eyes of the user in the mobile terminal. The method provided by the embodiment of the present invention is also applicable to the case where the display content of the mobile terminal is an image and a video. When the display content is an image, the image is adjusted according to the acquired image in the imaging position of the user's eyes in the mobile terminal. The size of the picture, but the size of the adjusted picture cannot be larger than the size of the screen; when the display content is video, the size of the video is adjusted according to the imaged position of the user's eyes in the mobile terminal, but the adjusted video size is also Cannot be larger than the size of the screen.

The method provided by the embodiment of the present invention, when a movement occurs between the user terminal and the user, adjusts the page of the display content of the user terminal by the difference in the imaging position of the facial feature of the user in the user terminal, when the user terminal is away from the user When the movement occurs, the page for displaying the content can be automatically adjusted according to the moving direction of the user terminal to implement the page turning function, thereby improving the user experience.

The method for automatically adjusting the page of the display content of the mobile terminal and the method for automatically adjusting the size of the display content of the mobile terminal provided in Embodiment 2 of the present invention may be performed independently of each other, or may be performed simultaneously with each other. For example, when the imaging distance of the distance between the eyes of the user in the mobile terminal is acquired in step 201 or step 301, the imaging position of the position of the two eyes of the user is acquired at the same time, and the mobile terminal moves from the user (the movement here may be The movement of the distance can also be the movement of the position or the same distance and position. When the time is moved, in step 202 or step 302, when the imaging distance of the distance between the eyes of the user is obtained in the mobile terminal, the imaging position of the position of the two eyes of the user is acquired at the same time, and in the subsequent steps, respectively according to the movement before and after the movement. The size and position of the displayed content in the user terminal are separately adjusted depending on the imaging distance and the imaging position. Example 4

In order to automatically adjust the size and page of the content displayed in the user terminal according to the change of the distance and the location of the user and the user terminal, the embodiment of the present invention provides a user terminal. Referring to FIG. 5, the user terminal includes:

The first obtaining module 401 is configured to acquire first imaging information of the facial features of the user in the user terminal, where the facial features of the user may be two eyes, two eyebrows, and two fixed points of the face. There is no limit to this.

The second obtaining module 402 is configured to acquire, when the user terminal moves with the user, acquiring second information of the facial feature of the user in the user terminal;

The adjustment module 403 is configured to adjust the display content in the user terminal according to the first imaging information and the second imaging information. The display content in the embodiment of the present invention may be a font, a picture, a video, and the like, which is not limited in the embodiment of the present invention.

The first imaging information is a first imaging distance and/or a first imaging position, and the second imaging information is a second imaging distance and/or a second imaging position.

The adjustment module 403 specifically includes: a resizing unit and an adjustment page unit,

And a size adjustment unit, configured to acquire a first imaging distance in the first imaging information and a second imaging distance in the second imaging information; and adjust a size of the display content in the user terminal according to the first imaging distance and the second imaging distance.

The adjustment page unit is configured to acquire a first imaging position in the first imaging information and a second imaging position in the second imaging information; and adjust a page displaying the content in the user terminal according to the first imaging position and the second imaging position.

Further, the sizing unit includes: a first acquiring subunit, configured to acquire a size of the display content of the user terminal at the first imaging distance; and a first calculating subunit configured to use the first imaging distance and the second imaging The ratio of the distance is equal to the ratio of the size of the adjusted display content to the size of the display content before the adjustment, and the size of the adjusted display content is calculated;

The first adjustment subunit is configured to adjust the size of the display content in the user terminal according to the adjusted display content.

Further, the resizing unit further includes: a first determining sub-unit, configured to determine whether the size of the adjusted display content is within a threshold range set by the user terminal and exceeds a screen size of the user terminal; and the size of the adjusted display content is a threshold set by the user terminal Within the range and not exceeding the screen size of the user terminal, the size of the display content in the user terminal is adjusted by the first adjustment subunit.

Wherein, adjusting the page unit specifically includes:

a second calculating subunit, configured to perform a difference between the second imaging position and the first imaging position to obtain a change value of the imaging position;

a second determining subunit, configured to determine whether the magnitude of the change value of the imaging position is greater than a preset position threshold, the second adjusting subunit, configured to determine, when the first determining subunit, that the magnitude of the change of the imaging position is greater than a preset position At the threshold value, the page displaying the content in the user terminal is adjusted according to the direction of the change value of the imaging position.

The first obtaining module 401 specifically includes:

a first acquiring unit, configured to acquire a facial image of the user by using a camera of the user terminal;

a first processing unit, configured to identify a facial image of the user, to obtain first imaging information of the facial feature of the user in the user terminal;

Correspondingly, the second obtaining module 402 specifically includes:

a second acquiring unit, configured to acquire, by using a camera of the user terminal, a facial image of the user when the user terminal and the user move;

The second processing unit is configured to identify a facial image of the user when the user terminal and the user move, and acquire second imaging information of the facial feature of the user in the user terminal.

The device provided by the embodiment of the present invention adjusts the size and page of the display content of the user terminal by using the difference between the imaging distance and the imaging position of the facial features of the user in the user terminal when the user terminal moves with the user. The display content can be obtained more clearly and the display content information can be fully obtained, and the automatic page turning function of the user terminal can be realized, thereby improving the user experience. Example 5

An embodiment of the present invention provides a technical solution for displaying a mobile terminal. As shown in FIG. 6, step 1: acquiring specific mode information and a distance between a user and a mobile terminal, where the specific mode information is used to distinguish a user's visual characteristics. ;

Step two. The manner of outputting the display information is determined according to the acquired specific mode information and the distance between the user and the mobile terminal, and the display information is outputted in accordance with the determined output display information.

In the above technical solution, the mode information is set by the user according to the visual characteristics of the user, and the specific mode is The information may specifically include: a myopia mode, a far vision mode, or a normal vision mode, and the corresponding myopia mode and the far vision mode may specifically include a corresponding level, the level is used to distinguish the degree of the user's myopia or hyperopia, specifically, if the user's myopia or If the degree of hyperopia is 50-150 degrees, it is set to one level. If the user's myopia or farsight is 150-300 degrees, it is set to level two. The obtaining the distance between the user and the mobile terminal may be specifically performed by transmitting an ultrasonic or infrared signal, and receiving a signal reflected by the user by the ultrasonic or infrared signal, and obtaining a formula according to the sending time and the receiving time as -D indicating that the mobile terminal is used with the mobile terminal. Distance, 1 means reception time, ^Q (m/s), specific

It indicates the ambient temperature (°C), and the default is room temperature. To obtain it accurately, you can add a thermometer to the mobile terminal to get it in real time.

Further, the specific manner of outputting the information may include:

In myopia mode and normal vision mode, the distance between the user and the mobile terminal is proportional to the font size of the output display information, but the proportional degree in the normal vision mode is smaller than the proportional degree in the myopia mode, such as the proportional ratio of the myopia level. The degree of proportionality can be 1. 1 or 1.2. The distance between the user and the mobile terminal is proportional to the font size of the output display information, that is, the closer the distance between the user and the mobile terminal is, the smaller the font size of the output display information is, and the farther the distance between the user and the mobile terminal is, the size of the displayed information is output. In the far vision mode, the distance between the user and the mobile terminal is inversely proportional to the font size of the output display information, that is, the closer the distance between the user and the mobile terminal is, the larger the font size of the output display information is, and the further the distance between the user and the mobile terminal is. The smaller the font size of the output display information.

In the above technical solution, the mobile terminal may determine a predetermined change value of the distance between the user and the mobile terminal according to different scene modes, and the user may also determine a predetermined change value of the distance between the user and the mobile terminal according to the environment in which the user is located, and determine the specific change value of the distance between the user and the mobile terminal. Whether the distance between the internal user and the mobile terminal is less than or equal to a predetermined change value, and if so, prompting the user to output the font size of the display information; if not, regaining the distance between the user and the mobile terminal. The corresponding specific time and the predetermined change value are set according to the environment in which the user is located. If the user uses the mobile terminal in a bumpy environment such as a car or a train, the predetermined time may be longer, and the predetermined change value may be larger, for example, The predetermined time can be set to 1 minute or 40 seconds, and the predetermined change value can be set to 3cm or 5cm; if the user uses the mobile terminal in a relatively stable home or office, the predetermined time can be shorter, and the predetermined change value can be smaller. For example, the predetermined time can be set to 30 seconds or 20 seconds, and the predetermined change value can be set to 2 cm or 1 cm.

For example, as shown in FIG. 7 , the process shown in the embodiment of the present invention is specifically described as follows: Step A1, obtaining a far-view mode set by a user and a corresponding far-view level, when the user and the mobile terminal are at a normal distance, Determine the font size of the output display information, the corresponding normal distance is generally the default, which can be 15-20cm range A value within, and select the appropriate display scale according to the user's own farsight level. For example, at normal distance, the selected output shows a font size of 12. If the user is far regarded as 200 degrees or two, the display ratio can be low. Some, such as 2 times, that is, when the distance between the user and the mobile terminal is 30_40cm, the output display font size is 6 _; if the user is far regarded as 400 degrees or three levels, then the display ratio can be higher, such as 4 times, that is, When the distance between the user and the mobile terminal is 7. 5-10cm, the font size displayed on the output is 48.

Step A2, sending an ultrasonic or infrared signal, the recording transmission time is ⁷ ^

Step A3: Detect whether there is an external interruption, that is, whether the user is detected, and once the user is detected, the ultrasonic or infrared signal reflected by the user is received, and the recording reception time is ^.

Step A4: Obtain a distance D between the user and the mobile terminal according to the transmission time being ⁷ ^ and the receiving time is ^, specifically, ^{D = C} *(" ^r0 ) ^/2 , where C represents the propagation speed of the ultrasonic or infrared signal (m/) s), specific c, where ^e represents the ambient temperature (°C), and generally defaults to room temperature. To obtain it accurately, a thermometer can be added to the mobile terminal to obtain it in real time.

Step A5: It is determined whether the distance between the obtained user and the mobile terminal is less than or equal to a predetermined change value within a certain time, and if yes, step A6 is performed; if not, step A2 is re-executed.

Step A6: prompting the user to output the font size of the display information according to the distance between the user and the mobile terminal and the selected display ratio. Specifically, if the user is satisfied with the font size of the current output display information, the display information is output according to the current font size; if the user is not satisfied If the font size of the display information is currently output, step A2 is re-executed.

In this embodiment, for a far-sighted user, the size of the output display information font can be adjusted at any time according to the change of the distance level of the user and the distance between the user and the mobile terminal, so that the far-sighted user can clearly see the information at different distances, and the far-sightedness can be clearly displayed. The user brings convenience and thus improves the user experience.

Taking the user as myopia as an example, as shown in FIG. 8, the process shown in the embodiment of the present invention is specifically described: Step B1, obtaining a myopia mode set by the user and a corresponding nearsight level, when the user and the mobile terminal are at a normal distance, Determine the font size of the output display information. The corresponding normal distance is generally the default. It can be a value within the range of 15-20cm, and select the appropriate display scale according to the user's own myopia level. For example, at normal distance, the output is selected. The displayed font size is 12. If the user is regarded as 200 degrees or two, the display ratio can be lower, such as 2 times, that is, when the distance between the user and the mobile terminal is 30-40cm, the output font size is 24; The user is regarded as 400 degrees or three levels, then the display ratio can be higher, such as 4 times, that is, when the distance between the user and the mobile terminal is 7. 5-10 cm, the output display font size is 3.

Step B2, sending an ultrasonic or infrared signal, the recording transmission time is ⁷ ^

In step B3, it is detected whether there is an external interruption, that is, whether the user is detected, and when the user is detected, the ultrasonic or infrared signal reflected by the user is received, and the recording and receiving time is ^ ¹ . Step B4: According to the sending time being ⁷ ^ and the receiving time, the distance between the user and the mobile terminal is obtained, specifically,

^{D = c} * (In ^T iO ^/2 _f , C represents the propagation speed ( _m / _{s) of the} ultrasonic or infrared signal, specifically c, where ^e represents the ambient temperature CO, and the default is room temperature. If it is accurately obtained, it can be moved. A thermometer is added to the terminal to obtain it in real time.

Step B5: Determine whether the obtained distance between the user and the mobile terminal is less than or equal to a predetermined change value within a specific time, and if yes, execute step B6; if not, perform step B2 again.

Step B6: prompting the user to output the font size of the display information according to the distance between the user and the mobile terminal and the selected display ratio. Specifically, if the user is satisfied with the font size of the current output display information, the display information is output according to the current font size; if the user is not satisfied If the font size of the display information is currently output, step B2 is re-executed.

In the embodiment, the myopia user can adjust the size of the output display information font according to the change of the myopia level and the distance between the user and the mobile terminal, so that the nearsighted user can clearly see the information at different distances for the nearsightedness. The user brings convenience and thus improves the user experience.

Taking the user as the normal vision as an example, as shown in FIG. 9, the process shown in the embodiment of the present invention is specifically described - step C1, the normal vision mode set by the user is obtained, and when the user and the mobile terminal are at a normal distance, the output display information is determined. The font size, the corresponding normal distance is generally the default, can be a value within the range of 15_20cm, and select the appropriate display scale according to the user's specific vision conditions, for example, at normal distance, the selected output shows the font size is 10 The ratio of the user selection is 1.1 times. When the distance between the user and the mobile terminal is 30_40cm, the font size of the output display can be 11. When the distance between the user and the mobile terminal is 7. 5-lcm, the output font size is 9. .

Step C2, sending an ultrasonic or infrared signal, the recording transmission time is ⁷ ^

In step C3, it is detected whether there is an external interruption, that is, whether the user is detected, and when the user is detected, the ultrasonic or infrared signal reflected by the user is received, and the recording and receiving time is ^ ¹ .

Step, C4, according to the transmission time is ⁷ ^ and the receiving time is to obtain the distance between the user and the mobile terminal, specifically, ^D = C * ( ^T i _ ^T o ) ^{/ 2} , where C represents the propagation speed of the ultrasonic or infrared signal ( _m / _{s )} , specific c = 331.45* l+ _c /273.16 τ

Where ^e is the ambient temperature rc), and the default is room temperature. To obtain it accurately, a thermometer can be added to the mobile terminal to obtain it in real time.

Step C5: It is determined whether the distance between the obtained user and the mobile terminal is less than or equal to a predetermined change value within a certain time, and if yes, step C6 is performed; if not, step C2 is re-executed.

Step C6: prompting the user to output the font size of the display information according to the distance between the user and the mobile terminal and the selected display ratio. For example, if the distance between the user and the mobile terminal is 15_20cm, the distance between the user and the mobile terminal is satisfied. If the font size of the message is displayed, the display information is output according to the current font size; if the user is not satisfied If the font size of the display information is currently output, step C2 is re-executed.

In this embodiment, the size of the output display information font is adjusted at any time by the change of the distance between the user and the mobile terminal, so that the user can clearly see the information at different distances, which brings convenience to the user, thereby improving the user's use. Experience. Example 6

The embodiment of the present invention further provides a mobile terminal, as shown in FIG. 10, including:

The obtaining unit 1 is configured to acquire specific mode information and a distance between the user and the mobile terminal, where the specific mode information is used to distinguish the visual features of the user.

The display unit 2 is configured to determine a manner of outputting the display information according to the specific mode information acquired by the acquisition unit 1 and the distance between the user and the mobile terminal, and output the display information according to the determined output display information.

As shown in FIG. 11, the mobile terminal may further include a storage unit 3, configured to store specific mode information currently used by the mobile terminal, where the specific mode information includes: a nearsight mode, a farsight mode, or a normal vision mode, where The nearsighted mode and the farsighted mode include corresponding levels, which are used to distinguish the degree of myopia or farsightedness of the user. Specifically, if the user's myopia or farsight degree is 50-150 degrees, the level is set to one level, if the user The myopia or the degree of farsightedness is 150-300 degrees, and is set to the second level or the like, and the acquiring unit 1 acquires the specific mode information through the storage unit 3.

The display unit 2 may specifically include a mode determining subunit 21 for determining that the distance between the user and the mobile terminal is proportional to the font size of the output display information in the near vision mode and the normal vision mode, but the degree of proportionality in the normal vision mode The degree of proportionality in the normal vision mode may be 1. 1 or 1.2. The distance between the user and the mobile terminal is proportional to the font size of the output display information, that is, the closer the distance between the user and the mobile terminal is, the smaller the font size of the output display information is, the farther the distance between the user and the mobile terminal is, the larger the font size of the output display information is. In the far-sight mode, the distance between the user and the mobile terminal is inversely proportional to the font size of the output display information, that is, the closer the distance between the user and the mobile terminal is, the larger the font size of the output display information is, the farther the distance between the user and the mobile terminal is, the output is displayed. The smaller the font size of the message.

The acquiring unit 1 may specifically include:

The distance obtaining sub-unit 11 is configured to obtain a distance between the user and the mobile terminal, specifically send an ultrasonic or infrared signal, receive a signal reflected by the user by the ultrasonic or infrared signal, and obtain a distance between the user and the mobile terminal according to the sending time and the receiving time. , the specific formula is -

D^ C ⁵ ^— ⁷ ^ ² , where D is the distance used for the mobile terminal, and ι is the reception time, ^Τ . Indicates that l L^ _ ^C indicates the propagation speed (m/ _S ) of the ultrasonic or infrared signal, specifically c, where ^e represents the ambient temperature rc), and the default is room temperature. To obtain it accurately, it can be added to the mobile terminal. Install a thermometer to get it in real time.

The above mobile terminal may further include:

The detecting and updating unit 4 is configured to: whether the distance between the user and the mobile terminal is less than or equal to a predetermined change value within a specific time, and if yes, prompting the user to output the font size of the display information; if not, regaining the distance between the user and the mobile terminal; The predetermined change value of the distance from the mobile terminal may be determined by the mobile terminal according to different scene modes, or may be set by the user according to the environment, specifically if the user uses the mobile terminal in a bumpy environment such as a car or a train. , the predetermined time can be longer, the predetermined change value can be larger, for example, the predetermined time can be set to 1 minute or 40 seconds, the predetermined change value can be set to 3cm or 5cm; if the user is used in a relatively stable home or office For the mobile terminal, the predetermined time may be shorter, and the predetermined change value may be smaller. For example, the predetermined time may be set to 30 seconds or 20 seconds, and the predetermined change value may be set to 2 cm or 1 cm.

The specific implementation of the processing function of each unit included in the foregoing mobile terminal has been described in Embodiment 5, and the description thereof will not be repeated here.

The above method embodiments 1-3 can be combined with the method embodiment 5 to adjust the display content in the user terminal through the first imaging information, the second imaging information, and the specific mode information. Similarly, the above device embodiment 4 can also be combined with the device embodiment 6.

Embodiments of the invention may be implemented in software, and the corresponding software program may be stored in a readable storage medium, such as a hard disk, cache or optical disk of a router.

The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., which are within the spirit and scope of the present invention, should be included in the protection of the present invention. Within the scope.

Claims

Rights request

A method for adjusting display content, the method comprising: acquiring first imaging information of a facial feature of a user in a user terminal;

And displaying the display content in the user terminal according to the first imaging information and the second imaging information.

The method according to claim 1, wherein the first imaging information is a first imaging distance and/or a first imaging position, and the second imaging information is a second imaging distance and/or a second Imaging position,

The adjusting the display content in the user terminal according to the first imaging information and the second imaging information, specifically:

Adjusting a size of the displayed content in the user terminal according to the first imaging distance and the second imaging distance;

A page of the content displayed in the user terminal is adjusted based on the first imaging position and the second imaging position.

The method according to claim 2, wherein the adjusting the size of the display content in the user terminal according to the first imaging distance and the second imaging distance comprises:

Calculating a size of the adjusted display content according to a ratio of the first imaging distance to the second imaging distance being equal to a ratio of a size of the adjusted display content to a size of the display content before the adjustment;

Adjusting the size of the displayed content in the user terminal according to the size of the adjusted display content.

The method according to claim 3, wherein the adjusting the size of the displayed content in the user terminal according to the size of the adjusted display content further includes:

Determining whether the size of the adjusted display content is within a threshold range set by the user terminal and whether the screen size of the user terminal is exceeded;

Adjusting the content displayed in the user terminal according to the size of the adjusted display content, when the size of the adjusted display content is within a threshold range set by the user terminal and does not exceed the screen size of the user terminal. the size of.

The method according to claim 2, wherein the adjusting a page for displaying content in the user terminal according to the first imaging position and the second imaging position comprises: Determining the difference between the second imaging position and the first imaging position to obtain a change value of the imaging position; determining, according to the change value of the imaging position, whether the magnitude of the change value of the imaging position is greater than a preset position The threshold is set, and if so, the page displaying the content in the user terminal is adjusted according to the direction of the change value of the imaging position.

The method of claim 1 , wherein the acquiring the first imaging information of the facial features of the user in the user terminal comprises: acquiring the facial image of the user by using a camera of the user terminal;

Identifying a facial image of the user to obtain first imaging information of a facial feature of the user in the user terminal;

Correspondingly, when the user terminal and the user move, acquiring the second imaging information of the facial feature of the user in the user terminal, specifically comprising: acquiring the user terminal and the user by using a camera of the user terminal The facial image of the user when the movement occurs between;

Identifying a facial image of the user when the user terminal and the user move, and obtaining second imaging information of the facial feature of the user in the user terminal.

The method according to any one of claims 1 to 6, wherein the method further comprises: acquiring specific mode information, wherein the specific mode information is used to distinguish a visual feature of the user, according to the first imaging The information and the second imaging information and the specific mode information adjust display content in the user terminal.

The method according to claim 7, wherein the specific mode information specifically includes: a near vision mode, a far vision mode, or a normal vision mode, wherein the near vision mode and the far vision mode specifically include corresponding levels, and the level is used by To distinguish the degree of myopia or hyperopia.

9. The method according to claim 8, wherein the manner of outputting the display information specifically comprises: in a near vision mode and a normal vision mode, the distance between the user and the mobile terminal is proportional to the font size of the output display information; the far vision mode Next, the distance between the user and the mobile terminal is inversely proportional to the font size of the output display information.

A user terminal, comprising: a first acquiring module, configured to acquire first imaging information of a facial feature of the user in the user terminal; and a second obtaining module, configured to be used as the user Obtaining second information of the facial features of the user in the user terminal when the movement occurs between the terminal and the user;

The apparatus according to claim 10, wherein the adjustment module specifically includes: a resizing unit and an adjustment page unit, where The sizing unit is configured to acquire a first imaging distance in the first imaging information and a second imaging distance in the second imaging information; according to the first imaging distance and the second imaging distance, Adjusting the size of the displayed content in the user terminal.

The adjustment page unit is configured to acquire a first imaging position in the first imaging information and a second imaging position in the second imaging information; according to the first imaging position and the second imaging position, Adjusting a page displaying content in the user terminal.

The device according to claim 11, wherein the resizing unit comprises: a first acquiring subunit, configured to acquire a size of display content of the user terminal when the first imaging distance is ;

a first calculating subunit, configured to calculate the adjusted display according to a ratio of the first imaging distance to the second imaging distance being equal to a ratio of a size of the adjusted display content to a size of the display content before the adjustment The size of the content;

And a first adjusting subunit, configured to adjust a size of the displayed content in the user terminal according to the size of the adjusted display content.

The apparatus according to claim 12, wherein the resizing unit further comprises: a first determining subunit, configured to determine whether the size of the adjusted display content calculated by the first calculating subunit is Within the threshold range set by the user terminal and whether the screen size of the user terminal is exceeded; when the size of the adjusted display content is within a threshold range set by the user terminal and does not exceed the screen size of the user terminal, And adjusting, by the first adjusting subunit, a size of the displayed content in the user terminal.

The device according to claim 13, wherein the adjusting the page unit comprises: a second calculating sub-unit, configured to obtain a difference between the second imaging position and the first imaging position, a change value of the imaging position;

a second determining subunit, configured to determine whether a size of the change value of the imaging position is greater than a preset position threshold;

a second adjusting subunit, configured to: when the second determining subunit determines that the magnitude of the change value of the imaging position is greater than a preset position threshold, adjust the user terminal according to a direction of a change value of the imaging position The page in which the content is displayed.

The device according to claim 10, wherein the first acquiring module comprises: a first acquiring unit, configured to acquire a facial image of the user by using a camera of the user terminal; And configured to identify a facial image of the user, to obtain first imaging information of a facial feature of the user in the user terminal; Correspondingly, the second acquiring module specifically includes: a second acquiring unit, configured to acquire, by using a camera of the user terminal, a facial image of the user when the user terminal and the user move;

And a second processing unit, configured to identify a facial image of the user when the user terminal moves with the user, and acquire second imaging information of the facial feature of the user in the user terminal.

The device according to any one of claims 10-15, further comprising:

a third acquiring unit, configured to acquire specific mode information, where the specific mode information is used to distinguish a user's visual characteristics;

The adjustment module further adjusts display content in the user terminal according to the specific mode information.

The device according to claim 16, further comprising a storage unit, wherein the storage unit is configured to store specific mode information currently used by the mobile terminal, where the specific mode information includes: a near vision mode, The hyperopia mode or the normal vision mode, wherein the nearsighted mode and the farsighted mode include respective levels, the levels are used to distinguish the degree of nearsightedness or farsightedness of the user, and the acquiring unit acquires specific mode information through the storage unit.

The device according to claim 17, wherein the adjustment module further comprises a mode determining subunit, configured to determine a distance between the user and the mobile terminal and a font size of the output display information in the near vision mode and the normal vision mode. It is proportional; in the far-sight mode, it is determined that the distance between the user and the mobile terminal is inversely proportional to the font size of the output display information.