WO2018059552A1 - Screen display control method, device and mobile terminal, and computer storage medium - Google Patents

Screen display control method, device and mobile terminal, and computer storage medium Download PDF

Info

Publication number
WO2018059552A1
WO2018059552A1 PCT/CN2017/104451 CN2017104451W WO2018059552A1 WO 2018059552 A1 WO2018059552 A1 WO 2018059552A1 CN 2017104451 W CN2017104451 W CN 2017104451W WO 2018059552 A1 WO2018059552 A1 WO 2018059552A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
terminal
display screen
face image
preset
Prior art date
Application number
PCT/CN2017/104451
Other languages
French (fr)
Chinese (zh)
Inventor
郑永进
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2018059552A1 publication Critical patent/WO2018059552A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the present disclosure relates to the field of communications, and in particular to a screen display control method and apparatus, and a mobile terminal and a computer storage medium.
  • the large-screen mobile phone brings a visual experience improvement to the user, and also brings a lot of inconvenience to the user with one-handed control.
  • the popularity of large-screen touch phones of 5 inches and above the convenience of one-handed operation of users has become more and more apparent.
  • the convenience of the one-hand operation of the user is mainly solved by the following methods: 1) for some application interfaces, the function button is placed at the bottom of the screen as much as possible for the user to touch; 2) the single touch is completed by completing a specific touch gesture. Touch state, pan or zoom out the screen for the user to touch.
  • the embodiment of the invention provides a screen display control method and device, and a mobile terminal, so as to solve at least the problem that the user has to operate the screen with one hand in the related art, and each interface needs to be separately customized and cannot cover all the interfaces.
  • a screen display control method including: acquiring a first position of the face image in the terminal screen; according to the first position and the face image at a terminal The relative position of the reference position in the screen controls the second position of the display screen in the terminal screen.
  • the method before the acquiring the face image in the first position in the terminal screen, the method further includes: a face image acquired by a front camera of the terminal where the terminal screen is located, or The reference position is determined according to a preset parameter.
  • acquiring the first location displayed by the face image in the terminal screen comprises: acquiring the face image by using a front camera of a terminal where the terminal screen is located The first location displayed in the terminal screen.
  • controlling the second movement of the display screen in the terminal screen according to the relative position of the first location and the reference position of the face image in a terminal screen The position includes: determining a horizontal first vector and a vertical second vector on the screen corresponding to the relative position; and controlling the first preset edge lateral movement of the display according to the determined first vector a first predetermined distance, wherein the direction of the lateral movement is opposite to a direction of the first vector; and/or, according to the determined second vector, controlling the The second preset edge of the display screen is longitudinally moved to a second predetermined distance, wherein the direction of the longitudinal movement is opposite to the direction of the second vector.
  • the display screen movement comprises one of: the display screen is totally translated, the display screen is compressed and moved according to a preset ratio, and a preset area in the display screen is translated, and the display screen is displayed.
  • the other areas except the preset area are compressed and moved according to a preset ratio.
  • a screen display control apparatus includes: an acquisition module, configured to acquire a first position of the face image in the terminal screen; and a control module, configured to The first position and the relative position of the reference image of the face image in the terminal screen control a second position of the display screen in the terminal screen.
  • the obtaining module is further configured to: acquire, by the front camera of the terminal where the terminal screen is located, before acquiring the first position of the face image in the terminal screen The face image, or, according to a preset parameter, determines the reference position.
  • the obtaining module is further configured to acquire, by the front camera of the terminal where the terminal screen is located, the first position displayed by the face image in the terminal screen.
  • the control module includes: a determining unit, configured to determine a first vector on a screen of the terminal corresponding to the relative position and a second vector in a vertical direction; a control unit, configured to determine The first vector of the display screen is controlled to laterally move to a first preset distance, wherein the direction of the lateral movement is opposite to the direction of the first vector; and/or And controlling, according to the determined second vector, the second preset edge of the display screen to move longitudinally to a second preset distance, wherein the direction of the longitudinal movement is opposite to the direction of the second vector.
  • the display screen movement comprises one of: the display screen is totally translated, the display screen is compressed and moved according to a preset ratio, and a preset area in the display screen is translated, and the display screen is displayed.
  • the other areas except the preset area are compressed and moved according to a preset ratio.
  • a mobile terminal comprising the apparatus of any of the foregoing.
  • a storage medium is also provided.
  • the storage medium is configured to store program code for performing a step of: acquiring a first position of the face image in the terminal screen; a reference in the terminal screen according to the first position and the face image The relative position of the position controls a second position in which the display screen moves in the terminal screen.
  • the storage medium is further configured to store program code for performing the step of: obtaining the face image before the first location in the terminal screen, further comprising: passing the terminal screen The face image acquired by the front camera of the terminal where the terminal is located, or the reference position is determined according to a preset parameter.
  • the storage medium is further arranged to store program code for performing control of: controlling the relative position of the first position and the reference position of the face image in the terminal screen according to the first position
  • the second location of the display screen movement in the terminal screen includes: determining a first horizontal vector and a vertical second vector on the screen of the terminal corresponding to the relative position; a vector, controlling a first preset edge of the display screen to laterally move to a first preset distance, wherein the direction of the lateral movement is opposite to a direction of the first vector; and/or, according to the determined And a second vector that controls the second preset edge of the display screen to move longitudinally to a second preset distance, wherein the direction of the longitudinal movement is opposite to the direction of the second vector.
  • the storage medium is further configured to store program code for performing the following steps: the display screen movement comprises one of: the display screen is panned as a whole, and the display screen is compressed and moved according to a preset ratio. The preset area in the display screen is translated, and other areas in the display screen except the preset area are compressed and moved according to a preset ratio.
  • the location of the user's face image in the terminal screen is related to the user's operation intention.
  • the movement position of the display screen in the terminal screen can be controlled, which can be applied to various interfaces of the screen. Therefore, the manner in which the user operates the screen with one hand can be solved in the related art.
  • Each interface needs to be separately customized, and the problem of all the interfaces cannot be covered, thereby achieving the effect of improving the convenience of the one-hand operation of the user.
  • FIG. 1 is a block diagram showing the hardware structure of a mobile terminal of a screen display control method according to an embodiment of the present invention
  • FIG. 2 is a flow chart of a screen display control method according to an embodiment of the present invention.
  • FIG. 3 is a structural block diagram of a mobile phone in accordance with a preferred embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a phone initial position facing a face according to a preferred embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a top edge of a mobile phone turning to a face according to a preferred embodiment of the present invention
  • FIG. 6 is a schematic diagram of a bottom edge of a mobile phone turning to a face according to a preferred embodiment of the present invention
  • FIG. 7 is a schematic diagram of a left side of a mobile phone turning to a face according to a preferred embodiment of the present invention.
  • FIG. 8 is a schematic diagram of a right side turning face of a mobile phone according to a preferred embodiment of the present invention.
  • FIG. 9 is a schematic diagram of a top left corner of a mobile phone turning to a face according to a preferred embodiment of the present invention.
  • FIG. 10 is a schematic diagram of a top right corner of a mobile phone turning to a face according to a preferred embodiment of the present invention
  • FIG. 11 is a schematic diagram of a left lower corner of a mobile phone turning to a face according to a preferred embodiment of the present invention.
  • FIG. 12 is a schematic diagram of a lower right corner of a mobile phone turning to a face according to a preferred embodiment of the present invention
  • FIG. 13 is a schematic diagram showing a relationship between a moving width of a display screen and a shift of a face image with respect to a central region according to a preferred embodiment of the present invention
  • FIG. 14 is a schematic diagram of linear shifting of a display screen according to a preferred embodiment of the present invention.
  • 15 is a schematic diagram of linear compression of a display screen according to a preferred embodiment of the present invention.
  • 16 is a schematic diagram of display screen translation plus compression according to a preferred embodiment of the present invention.
  • FIG. 17 is a flow chart of a screen display control method in accordance with a preferred embodiment of the present invention.
  • FIG. 18 is a schematic diagram of a screen display control method of a user's intention to touch an upper left area of a screen according to a preferred embodiment of the present invention
  • FIG. 19 is a block diagram showing the structure of a screen display control device according to an embodiment of the present invention.
  • 20 is a block diagram showing the structure of a control module 194 of a screen display control device according to an embodiment of the present invention.
  • 21 is a block diagram showing the structure of a mobile terminal according to an embodiment of the present invention.
  • FIG. 1 is a hardware structural block diagram of a mobile terminal of a screen display control method according to an embodiment of the present invention.
  • the mobile terminal 10 may include one or more (only one shown) processor 12 (the processor 12 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA).
  • a memory 14 for storing data, and a transmission device 16 for communication functions may be included in the structure shown in FIG. 1 merely illustrative and does not limit the structure of the above electronic device.
  • the mobile terminal 10 may also include more or fewer components than those shown in FIG. 1, or have a different configuration than that shown in FIG.
  • the memory 14 can be used to store software programs and modules of application software, such as program instructions/modules corresponding to the screen display control method in the embodiment of the present invention, and the processor 12 executes each by executing a software program and a module stored in the memory 14.
  • a functional application and data processing, that is, the above method is implemented.
  • Memory 14 may include high speed random access memory, and may also include non-volatile memory such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory.
  • memory 14 may further include memory remotely located relative to processor 12, which may be connected to mobile terminal 10 over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • Transmission device 16 is for receiving or transmitting data via a network.
  • the above-described network specific example may include a wireless network provided by a communication provider of the mobile terminal 10.
  • the transmission device 16 includes a Network Interface Controller (NIC) that can be connected to other network devices through a base station to communicate with the Internet.
  • the transmission device 16 can be a Radio Frequency (RF) module for communicating with the Internet wirelessly.
  • NIC Network Interface Controller
  • RF Radio Frequency
  • FIG. 2 is a flowchart of a screen display control method according to an embodiment of the present invention. As shown in FIG. 2, the flow includes the following steps:
  • Step S202 acquiring a first position of the face image in the terminal screen
  • Step S204 controlling the display screen in the terminal screen to move to the second position according to the relative position of the first position and the reference position of the face image in the terminal screen.
  • the moving position of the display screen in the terminal screen is controlled, which solves the problem that the user has one-hand operation screen in the related art.
  • Each interface needs to be customized separately, and it cannot cover all the interfaces, which improves the convenience of one-handed operation.
  • the reference position displayed by the face image in the terminal screen may be determined in multiple manners, for example, the face image acquired by the front camera of the terminal where the terminal screen is located, or according to preset parameters. , determine the reference location.
  • the preset parameter may be the center position of the terminal, or may be a certain position in the screen according to experience as a reference position.
  • the first location of the face image displayed in the terminal screen may be acquired in multiple manners.
  • the first camera displayed on the terminal screen may be obtained through the front camera of the terminal where the terminal screen is located.
  • the first location displayed by the face image in the terminal screen may also be acquired by other sensing devices (eg, infrared, etc.).
  • the display screen in the terminal screen is controlled to move to the second position according to the relative position of the first position and the reference position of the face image in the terminal screen in the following manner: determining the horizontal position on the screen of the terminal corresponding to the relative position a first vector and a second vector in the longitudinal direction; according to the determined first vector, controlling the first preset edge of the display screen to laterally move to a first preset distance, wherein the direction of the lateral movement is opposite to the direction of the first vector; And or, according to the determined second vector, controlling the second preset edge of the display screen to move longitudinally to the second preset distance, wherein the direction of the longitudinal movement is opposite to the direction of the second vector.
  • the moving of the display screen may include one of the following: displaying the overall translation of the screen; the display screen is compressed according to a preset ratio; the preset area in the display screen is translated, and other areas in the display screen except the preset area are pre-predicted. Set the scale to perform compression movement.
  • a screen display control method is provided.
  • the terminal uses a mobile phone as an example for description.
  • the mobile phone screen is touched with a thumb. Since the length of the thumb is limited, it is relatively easy to touch the middle area of the screen of the mobile phone, and the edge area of the screen of the mobile phone is often inaccessible or needs to be changed to be touched.
  • the phone when the user wants to click on the edge area farther from the tip of the thumb, the phone will be slightly tilted on the original plane, so that the area is slightly close to itself, which is equivalent to shortening the distance between the area and the tip of the thumb. For example, if you want to click on the top left corner of your phone, you will turn to the top left corner.
  • the change of the plane of the mobile phone relative to the face of the user can be The judgment is made by the face picture captured by the front camera. That is, the user wants to touch an edge area, and while the area is slightly turned to himself, the face image captured by the front camera also gradually moves toward the area.
  • the intuitive embodiment is to turn on the proactive preview. When you turn a certain edge area to yourself, the face in the preview image will move smoothly to the area. When the movement exceeds a certain threshold, it can be determined that the user wishes to touch the area.
  • the picture of the area and the corresponding touch point are gradually moved to the middle of the mobile phone. Easy for users to touch.
  • FIG. 3 is a structural block diagram of a mobile phone according to a preferred embodiment of the present invention. As shown in FIG. 3, the mobile phone includes a detecting module 32 and an executing module 34. The phone will be described below.
  • the detection module 32 performs face capture using the front camera to determine the edge area that the user wishes to touch.
  • the plane of the mobile phone is basically facing the user's face, as shown in FIG.
  • FIGS. 5 through 12 are schematic representations of different edge regions of the handset.
  • the execution module When the currently captured face image moves to the edge area of the mobile phone after the threshold range is exceeded, the execution module performs a process of displaying the display screen and corresponding touch points.
  • the execution module 34 smoothly moves the display screen of the edge area that the user desires to touch and the corresponding touch point to the middle area of the mobile phone. The user simply clicks on the middle area to complete the operation.
  • the magnitude of this movement can be related to the extent to which the proactively captured face image exceeds a threshold. That is, the more the position of the face image exceeds the threshold, the greater the amplitude of the movement of the display screen and the corresponding touch point; the smaller the position of the face image exceeds the threshold, the smaller the amplitude of the movement of the display screen and the corresponding touch point.
  • the display When the face image is restored to within the threshold range, the display also returns to the original no-movement state.
  • the relationship between the display screen movement amplitude and the face image offset from the center area is as shown in FIG.
  • FIG. 17 is a flow chart of a screen display control method according to a preferred embodiment of the present invention. As shown in FIG. 17, the flow includes the following steps:
  • step S1702 the front camera captures the face image position.
  • step S1704 it is determined whether the captured face image position exceeds a preset threshold. If yes, step S1706 is performed; otherwise, step S1702 is performed.
  • Step S1706 processing the display screen and corresponding touch points.
  • the screen display control method of the preferred embodiment will be described below by a specific algorithm.
  • the algorithm is used for calculating the moving range of the display screen and the positional relationship of the face image.
  • the screen control display method is a method for determining and processing when the user intends to touch the upper left area of the screen (other areas are similar) under the algorithm.
  • Step 1 The detection module uses the front camera for face capture.
  • the phone is facing the user's face.
  • Step 2 the user gradually turns the upper left corner of the mobile phone to himself, and the proactively captured human face image gradually moves to the upper left of the mobile phone and first exceeds the threshold in the x direction.
  • the x2 value is outside the threshold range and the display image needs to be shifted right.
  • Step 3 The execution module processes the display screen and the corresponding touch point to move to the right side of the mobile phone.
  • the left edge of the picture moves 360-x2, and the left edge of the picture moves to the horizontal axis 360-x2 (following x2 real-time change); the vertical position of the picture is unchanged. That is, the coordinates of the pixel in the upper left corner of the screen are (360-x2, 1920).
  • Step 4 If the user still cannot touch the touch point after moving in step 3, continue to turn the upper left corner of the mobile phone to himself, and the proactively captured face image also continues to move to the upper left of the mobile phone and further exceeds the threshold in the y direction.
  • the X3 and y3 values all exceed the threshold range, and the displayed image needs to be shifted right and down.
  • Step 5 The execution module processes the display screen and the corresponding touch point to move to the lower right of the mobile phone.
  • the left edge of the picture moves 360-x3, and the left edge of the picture moves to the horizontal axis 360-x3 (following x3 real-time change); the upper edge of the picture moves by y3-1200, and the upper edge of the picture moves to the vertical axis of the coordinate 3120.
  • -y3 followsing y3 real-time changes). That is, the coordinates of the pixel in the upper left corner of the screen are (360-x3, 3120-y3).
  • Step 6 After the user completes the touch, the screen of the mobile phone is gradually restored to the original state of the face of the user. Proactively capturing the face image also gradually moves to the center area until it returns to the threshold range, and the display gradually returns to the original There is no moving state at the beginning.
  • the configuration parameters such as the resolution of the proactive camera and the frame rate can be appropriately lowered, that is, the highest resolution and frame that can be supported by the camera are not required.
  • the rate is set, so that the power consumption of the whole machine during the bright screen operation can be reduced.
  • the user's normal operation habits are used to implement automatic control, and the user can automatically implement full-screen touch of the large-screen mobile phone without completing any additional actions, and avoid false triggering by setting a threshold.
  • the face capture technology is used to detect the position change of the user's face relative to the plane of the mobile phone, thereby determining the screen area that the user intends to touch, and then adjusting the display screen and the corresponding touch point to facilitate the user's touch.
  • the big screen mobile phone Since the front camera of the mobile phone is used for face capture to judge the user's intention, no hardware cost is added.
  • the technical solution of the preferred embodiment can cover all display interfaces, and both horizontal and vertical screen operations are applicable, and both left and right hand operations are applicable.
  • the content of the edge area that the user wants to touch is automatically moved to the middle area of the mobile phone, and the user only needs to click the middle area to complete the operation, which greatly improves the convenience of manipulation.
  • the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation.
  • the technical solution of the present invention which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk,
  • the optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present invention.
  • a screen display control device is also provided, which is used to implement the above-mentioned embodiments and preferred embodiments, and has not been described again.
  • the term "module” may implement a combination of software and/or hardware of a predetermined function.
  • the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
  • FIG. 19 is a structural block diagram of a screen display control apparatus according to an embodiment of the present invention. As shown in FIG. 19, the apparatus includes:
  • the obtaining module 192 is configured to acquire a first position of the face image in the terminal screen
  • the control module 194 is connected to the obtaining module 192, and is configured to control a second position of displaying a screen movement in the terminal screen according to the relative position of the first position and the reference position of the face image in the terminal screen.
  • the obtaining module 192 is further configured to: before acquiring the first location of the facial image in the terminal screen, the facial image acquired by the front camera of the terminal where the terminal screen is located, or according to preset parameters, Determine the reference location.
  • the obtaining module 192 is further configured to obtain, by using a front camera of the terminal where the terminal screen is located, a first position displayed by the face image in the terminal screen.
  • control module 194 includes:
  • a determining unit 202 configured to determine a first vector in the horizontal direction and a second vector in the vertical direction on the screen of the terminal corresponding to the relative position;
  • the control unit 204 is connected to the determining unit 202, configured to control the first preset edge of the display screen to move to a first preset distance according to the determined first vector, wherein the direction of the lateral movement and the direction of the first vector Conversely; and/or for controlling the second preset edge of the display screen to move to a second preset distance according to the determined second vector, wherein the direction of the longitudinal movement is opposite to the direction of the second vector.
  • the display screen movement may include one of the following: the overall movement of the display screen, the display screen is compressed and moved according to a preset ratio, and the preset area in the display screen is translated, and other areas in the display screen except the preset area are preset.
  • the scale is compressed.
  • each of the above modules may be implemented by software or hardware.
  • the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the above modules are in any combination.
  • the forms are located in different processors.
  • the mobile terminal includes a screen display control device 212 as shown in any of 19 or 20.
  • Embodiments of the present invention also provide a storage medium.
  • the foregoing storage medium may be configured to store program code for performing the following steps:
  • the storage medium is further configured to store program code for performing the following steps: before acquiring the first position of the face image in the terminal screen, further comprising: acquiring by the front camera of the terminal where the terminal screen is located The face image, or, based on the preset parameters, determines the reference position.
  • the storage medium is further configured to store program code for performing the following steps: acquiring the first location of the face image displayed in the terminal screen comprises: acquiring the face image by using a front camera of the terminal where the terminal screen is located The first position displayed in the terminal screen.
  • the storage medium is further arranged to store program code for performing the following steps:
  • controlling the movement of the display screen to the second position in the screen of the terminal comprises:
  • the storage medium is further configured to store program code for performing the following steps: the movement of the display screen comprises one of: displaying the overall translation of the screen, and compressing the display screen according to a preset ratio; displaying the preset area in the screen Pan; other areas in the display screen except the preset area are compressed and moved according to a preset ratio.
  • the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • a mobile hard disk e.g., a hard disk
  • magnetic memory e.g., a hard disk
  • the processor performs: acquiring, according to the stored program code in the storage medium, the first position of the face image in the terminal screen; the reference according to the first position and the face image in the terminal screen The relative position of the position controls the second position of the screen movement in the terminal screen.
  • the processor performs, according to the stored program code in the storage medium, before acquiring the first position of the face image in the terminal screen, further comprising: a front camera through the terminal where the terminal screen is located The obtained face image, or, according to a preset parameter, determines the reference position.
  • the processor is executed according to the stored program code in the storage medium: acquiring the first location displayed by the face image in the terminal screen comprises: acquiring, by using a front camera of the terminal where the terminal screen is located The first position of the face image displayed in the terminal screen.
  • the processor performs, according to the stored program code in the storage medium, controlling the display screen movement in the terminal screen according to the relative position of the first position and the reference position of the face image in the terminal screen.
  • the second location includes: determining a first vector in the horizontal direction on the screen of the terminal corresponding to the relative position and a second vector in the vertical direction; controlling the first preset edge of the display screen to move to the first preset distance according to the determined first vector Wherein the direction of the lateral movement is opposite to the direction of the first vector; and/or, according to the determined second vector, controlling the second predetermined edge of the display screen to move longitudinally to a second predetermined distance, wherein the direction of the longitudinal movement Contrary to the direction of the second vector.
  • the processor executes according to the stored program code in the storage medium: the display screen movement includes one of the following: displaying the overall translation of the screen, and compressing the display screen according to a preset ratio, and displaying the preview in the screen Set the area to pan, and the other areas except the preset area in the display screen are compressed and moved according to the preset ratio.
  • the processor is executed according to the stored program code in the storage medium: the specific example in this embodiment may refer to the examples described in the foregoing embodiment and the optional implementation manner, where the embodiment is This will not be repeated here.
  • modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein.
  • the steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module.
  • the invention is not limited to any specific combination of hardware and software.
  • the technical solution provided by the embodiment of the present invention can be applied to the field of communications.
  • controlling the moving position of the display screen in the terminal screen may be applied to the screen.
  • Each interface needs to be separately customized, and the problem of all the interfaces cannot be covered, thereby achieving the effect of improving the convenience of the one-hand operation of the user.

Abstract

A screen display control method, device and mobile terminal, and a computer storage medium. The method comprises: obtaining a first position of a human face graphic on a terminal screen (S202); and controlling, on the basis of the position of the first position relative to a reference position of the human face graphic on the terminal screen, a second position to which a display image moves on the terminal screen (S204). The method resolves the issues in the related art in which user one-handed operations need to be customized separately for each interface, and not all interfaces can be covered, thereby enhancing the ease of one-handed operations.

Description

屏幕显示控制方法、装置及移动终端和计算机存储介质Screen display control method, device, and mobile terminal and computer storage medium 技术领域Technical field
本公开涉及通信领域,具体而言,涉及一种屏幕显示控制方法、装置及移动终端和计算机存储介质。The present disclosure relates to the field of communications, and in particular to a screen display control method and apparatus, and a mobile terminal and a computer storage medium.
背景技术Background technique
大屏幕手机在给用户带来视觉体验提升的同时,也给用户单手操控带来了诸多不便。随着5寸及以上大屏幕触控手机的普及,用户单手操作的便捷性问题也越来越显现。The large-screen mobile phone brings a visual experience improvement to the user, and also brings a lot of inconvenience to the user with one-handed control. With the popularity of large-screen touch phones of 5 inches and above, the convenience of one-handed operation of users has become more and more apparent.
相关技术中,主要通过以下方式来解决用户单手操作的便捷性问题:1)针对某些应用界面将功能按钮尽量放在屏幕下方便于用户触控;2)通过完成特定的触摸手势进入单手触控状态,平移或缩小画面供用户触控。In the related art, the convenience of the one-hand operation of the user is mainly solved by the following methods: 1) for some application interfaces, the function button is placed at the bottom of the screen as much as possible for the user to touch; 2) the single touch is completed by completing a specific touch gesture. Touch state, pan or zoom out the screen for the user to touch.
然而,上述方式存在以下问题:1)对每个界面需要单独定制,无法涵盖所有界面;2)需要增加操作步骤,无法自动处理,也容易误触发。However, the above methods have the following problems: 1) Each interface needs to be customized separately, and cannot cover all interfaces; 2) It is necessary to add operating steps, cannot be automatically processed, and is easy to be triggered by mistake.
因此,相关技术中存在用户单手操作屏幕的方式每个界面需要单独定制,无法涵盖所有界面的问题。Therefore, in the related art, there is a way for the user to operate the screen with one hand. Each interface needs to be separately customized, and cannot cover all the interfaces.
发明内容Summary of the invention
本发明实施例提供了一种屏幕显示控制方法、装置及移动终端,以至少解决相关技术中存在用户单手操作屏幕的方式每个界面需要单独定制,无法涵盖所有界面的问题。The embodiment of the invention provides a screen display control method and device, and a mobile terminal, so as to solve at least the problem that the user has to operate the screen with one hand in the related art, and each interface needs to be separately customized and cannot cover all the interfaces.
根据本发明的一个实施例,提供了一种屏幕显示控制方法,包括:获取所述人脸图像在所述终端屏幕中的第一位置;根据所述第一位置与所述人脸图像在终端屏幕中的参考位置的相对位置,控制所述终端屏幕中显示画面移动的第二位置。According to an embodiment of the present invention, a screen display control method is provided, including: acquiring a first position of the face image in the terminal screen; according to the first position and the face image at a terminal The relative position of the reference position in the screen controls the second position of the display screen in the terminal screen.
根据一个示例性实施例,获取所述人脸图像在所述终端屏幕中的所述第一位置之前,还包括:通过所述终端屏幕所在的终端的前置摄像头获取的人脸图像,或者,根据预设参数,确定所述参考位置。According to an exemplary embodiment, before the acquiring the face image in the first position in the terminal screen, the method further includes: a face image acquired by a front camera of the terminal where the terminal screen is located, or The reference position is determined according to a preset parameter.
根据一个示例性实施例,获取所述人脸图像在所述终端屏幕中显示的所述第一位置包括:通过所述终端屏幕所在的终端的前置摄像头,获取所述人脸图像在所述终端屏幕中显示的所述第一位置。According to an exemplary embodiment, acquiring the first location displayed by the face image in the terminal screen comprises: acquiring the face image by using a front camera of a terminal where the terminal screen is located The first location displayed in the terminal screen.
根据一个示例性实施例,根据所述第一位置与所述人脸图像在终端屏幕中的所述参考位置的所述相对位置,控制所述终端屏幕中所述显示画面移动的所述第二位置包括:确定与所述相对位置对应的所述终端屏幕上横向的第一向量和纵向的第二向量;根据确定的所述第一向量,控制所述显示画面的第一预设边缘横向移动至第一预设距离,其中,所述横向移动的方向与所述第一向量的方向相反;和/或,根据确定的所述第二向量,控制所述 显示画面的第二预设边缘纵向移动至第二预设距离,其中,所述纵向移动的方向与所述第二向量的方向相反。According to an exemplary embodiment, controlling the second movement of the display screen in the terminal screen according to the relative position of the first location and the reference position of the face image in a terminal screen The position includes: determining a horizontal first vector and a vertical second vector on the screen corresponding to the relative position; and controlling the first preset edge lateral movement of the display according to the determined first vector a first predetermined distance, wherein the direction of the lateral movement is opposite to a direction of the first vector; and/or, according to the determined second vector, controlling the The second preset edge of the display screen is longitudinally moved to a second predetermined distance, wherein the direction of the longitudinal movement is opposite to the direction of the second vector.
根据一个示例性实施例,所述显示画面移动包括以下之一:所述显示画面整体平移,所述显示画面按照预设比例压缩移动,所述显示画面中的预设区域平移,所述显示画面中除所述预设区域外的其他区域按照预设比例进行压缩移动。According to an exemplary embodiment, the display screen movement comprises one of: the display screen is totally translated, the display screen is compressed and moved according to a preset ratio, and a preset area in the display screen is translated, and the display screen is displayed. The other areas except the preset area are compressed and moved according to a preset ratio.
根据本发明的另一个实施例,提供了一种屏幕显示控制装置,包括:获取模块,用于获取所述人脸图像在所述终端屏幕中的第一位置;控制模块,用于根据所述第一位置与所述人脸图像在终端屏幕中的参考位置的相对位置,控制所述终端屏幕中显示画面移动的第二位置。According to another embodiment of the present invention, a screen display control apparatus includes: an acquisition module, configured to acquire a first position of the face image in the terminal screen; and a control module, configured to The first position and the relative position of the reference image of the face image in the terminal screen control a second position of the display screen in the terminal screen.
根据一个示例性实施例,所述获取模块还用于在获取所述人脸图像在所述终端屏幕中的所述第一位置之前,通过所述终端屏幕所在的终端的前置摄像头获取的人脸图像,或者,根据预设参数,确定所述参考位置。According to an exemplary embodiment, the obtaining module is further configured to: acquire, by the front camera of the terminal where the terminal screen is located, before acquiring the first position of the face image in the terminal screen The face image, or, according to a preset parameter, determines the reference position.
根据一个示例性实施例,所述获取模块还用于通过所述终端屏幕所在的终端的前置摄像头,获取所述人脸图像在所述终端屏幕中显示的所述第一位置。According to an exemplary embodiment, the obtaining module is further configured to acquire, by the front camera of the terminal where the terminal screen is located, the first position displayed by the face image in the terminal screen.
根据一个示例性实施例,所述控制模块包括:确定单元,用于确定与所述相对位置对应的所述终端屏幕上横向的第一向量和纵向的第二向量;控制单元,用于根据确定的所述第一向量,控制所述显示画面的第一预设边缘横向移动至第一预设距离,其中,所述横向移动的方向与所述第一向量的方向相反;和/或,用于根据确定的所述第二向量,控制所述显示画面的第二预设边缘纵向移动至第二预设距离,其中,所述纵向移动的方向与所述第二向量的方向相反。According to an exemplary embodiment, the control module includes: a determining unit, configured to determine a first vector on a screen of the terminal corresponding to the relative position and a second vector in a vertical direction; a control unit, configured to determine The first vector of the display screen is controlled to laterally move to a first preset distance, wherein the direction of the lateral movement is opposite to the direction of the first vector; and/or And controlling, according to the determined second vector, the second preset edge of the display screen to move longitudinally to a second preset distance, wherein the direction of the longitudinal movement is opposite to the direction of the second vector.
根据一个示例性实施例,所述显示画面移动包括以下之一:所述显示画面整体平移,所述显示画面按照预设比例压缩移动,所述显示画面中的预设区域平移,所述显示画面中除所述预设区域外的其他区域按照预设比例进行压缩移动。According to an exemplary embodiment, the display screen movement comprises one of: the display screen is totally translated, the display screen is compressed and moved according to a preset ratio, and a preset area in the display screen is translated, and the display screen is displayed. The other areas except the preset area are compressed and moved according to a preset ratio.
根据本发明的又一个实施例,还提供了一种移动终端,该移动终端包括前述中任一项所述的装置。According to still another embodiment of the present invention, there is also provided a mobile terminal, the mobile terminal comprising the apparatus of any of the foregoing.
根据本发明的又一个实施例,还提供了一种存储介质。该存储介质设置为存储用于执行以下步骤的程序代码:获取所述人脸图像在所述终端屏幕中的第一位置;根据所述第一位置与所述人脸图像在终端屏幕中的参考位置的相对位置,控制所述终端屏幕中显示画面移动的第二位置。According to still another embodiment of the present invention, a storage medium is also provided. The storage medium is configured to store program code for performing a step of: acquiring a first position of the face image in the terminal screen; a reference in the terminal screen according to the first position and the face image The relative position of the position controls a second position in which the display screen moves in the terminal screen.
根据一个示例性实施例,存储介质还设置为存储用于执行以下步骤的程序代码:获取所述人脸图像在所述终端屏幕中的所述第一位置之前,还包括:通过所述终端屏幕所在的终端的前置摄像头获取的人脸图像,或者,根据预设参数,确定所述参考位置。According to an exemplary embodiment, the storage medium is further configured to store program code for performing the step of: obtaining the face image before the first location in the terminal screen, further comprising: passing the terminal screen The face image acquired by the front camera of the terminal where the terminal is located, or the reference position is determined according to a preset parameter.
根据一个示例性实施例,存储介质还设置为存储用于执行以下步骤的程序代码:获取所述人脸图像在所述终端屏幕中显示的所述第一位置包括:通过所述终端屏幕所在的终端的前置摄像头,获取所述人脸图像在所述终端屏幕中显示的所述第一位置。 According to an exemplary embodiment, the storage medium is further configured to store program code for performing the step of: obtaining the first location displayed by the face image in the terminal screen comprises: passing through a screen of the terminal a front camera of the terminal acquires the first position displayed by the face image in the terminal screen.
根据一个示例性实施例,存储介质还设置为存储用于执行以下步骤的程序代码:根据所述第一位置与所述人脸图像在终端屏幕中的所述参考位置的所述相对位置,控制所述终端屏幕中所述显示画面移动的所述第二位置包括:确定与所述相对位置对应的所述终端屏幕上横向的第一向量和纵向的第二向量;根据确定的所述第一向量,控制所述显示画面的第一预设边缘横向移动至第一预设距离,其中,所述横向移动的方向与所述第一向量的方向相反;和/或,根据确定的所述第二向量,控制所述显示画面的第二预设边缘纵向移动至第二预设距离,其中,所述纵向移动的方向与所述第二向量的方向相反。According to an exemplary embodiment, the storage medium is further arranged to store program code for performing control of: controlling the relative position of the first position and the reference position of the face image in the terminal screen according to the first position The second location of the display screen movement in the terminal screen includes: determining a first horizontal vector and a vertical second vector on the screen of the terminal corresponding to the relative position; a vector, controlling a first preset edge of the display screen to laterally move to a first preset distance, wherein the direction of the lateral movement is opposite to a direction of the first vector; and/or, according to the determined And a second vector that controls the second preset edge of the display screen to move longitudinally to a second preset distance, wherein the direction of the longitudinal movement is opposite to the direction of the second vector.
根据一个示例性实施例,存储介质还设置为存储用于执行以下步骤的程序代码:所述显示画面移动包括以下之一:所述显示画面整体平移,所述显示画面按照预设比例压缩移动,所述显示画面中的预设区域平移,所述显示画面中除所述预设区域外的其他区域按照预设比例进行压缩移动。According to an exemplary embodiment, the storage medium is further configured to store program code for performing the following steps: the display screen movement comprises one of: the display screen is panned as a whole, and the display screen is compressed and moved according to a preset ratio. The preset area in the display screen is translated, and other areas in the display screen except the preset area are compressed and moved according to a preset ratio.
用户操作终端时,用户的人脸图像在终端屏幕中的位置移动与用户的操作意向,具有关联性。通过本发明,根据获取到的人脸图像在终端屏幕中的第一位置与人脸图像的参考位置,控制终端屏幕中的显示画面的移动位置,可以适用于屏幕的多种界面。因此,可以解决相关技术中存在用户单手操作屏幕的方式每个界面需要单独定制,无法涵盖所有界面的问题,达到提高用户单手操作的便捷性的效果。When the user operates the terminal, the location of the user's face image in the terminal screen is related to the user's operation intention. According to the present invention, according to the obtained first position of the face image in the terminal screen and the reference position of the face image, the movement position of the display screen in the terminal screen can be controlled, which can be applied to various interfaces of the screen. Therefore, the manner in which the user operates the screen with one hand can be solved in the related art. Each interface needs to be separately customized, and the problem of all the interfaces cannot be covered, thereby achieving the effect of improving the convenience of the one-hand operation of the user.
附图说明DRAWINGS
此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:
图1是本发明实施例的一种屏幕显示控制方法的移动终端的硬件结构框图;1 is a block diagram showing the hardware structure of a mobile terminal of a screen display control method according to an embodiment of the present invention;
图2是根据本发明实施例的屏幕显示控制方法的流程图;2 is a flow chart of a screen display control method according to an embodiment of the present invention;
图3是根据本发明优选实施例的手机的结构框图;3 is a structural block diagram of a mobile phone in accordance with a preferred embodiment of the present invention;
图4是根据本发明实施例优选实施例的手机初始位置正对脸部的示意图;4 is a schematic diagram of a phone initial position facing a face according to a preferred embodiment of the present invention;
图5是根据本发明实施例优选实施例的手机顶边转向脸部的示意图;FIG. 5 is a schematic diagram of a top edge of a mobile phone turning to a face according to a preferred embodiment of the present invention; FIG.
图6是根据本发明实施例优选实施例的手机底边转向脸部的示意图;6 is a schematic diagram of a bottom edge of a mobile phone turning to a face according to a preferred embodiment of the present invention;
图7是根据本发明实施例优选实施例的手机左侧转向脸部的示意图;7 is a schematic diagram of a left side of a mobile phone turning to a face according to a preferred embodiment of the present invention;
图8是根据本发明实施例优选实施例的手机右侧转向脸部的示意图;FIG. 8 is a schematic diagram of a right side turning face of a mobile phone according to a preferred embodiment of the present invention; FIG.
图9是根据本发明实施例优选实施例的手机左上角转向脸部的示意图;9 is a schematic diagram of a top left corner of a mobile phone turning to a face according to a preferred embodiment of the present invention;
图10是根据本发明实施例优选实施例的手机右上角转向脸部的示意图;10 is a schematic diagram of a top right corner of a mobile phone turning to a face according to a preferred embodiment of the present invention;
图11是根据本发明实施例优选实施例的手机左下角转向脸部的示意图;11 is a schematic diagram of a left lower corner of a mobile phone turning to a face according to a preferred embodiment of the present invention;
图12是根据本发明实施例优选实施例的手机右下角转向脸部的示意图;12 is a schematic diagram of a lower right corner of a mobile phone turning to a face according to a preferred embodiment of the present invention;
图13是根据本发明实施例优选实施例的显示画面移动幅度和人脸图像相对中心区域偏移的关系的示意图;FIG. 13 is a schematic diagram showing a relationship between a moving width of a display screen and a shift of a face image with respect to a central region according to a preferred embodiment of the present invention; FIG.
图14是根据本发明实施例优选实施例的显示画面线性平移的示意图; 14 is a schematic diagram of linear shifting of a display screen according to a preferred embodiment of the present invention;
图15是根据本发明实施例优选实施例的显示画面线性压缩的示意图;15 is a schematic diagram of linear compression of a display screen according to a preferred embodiment of the present invention;
图16是根据本发明实施例优选实施例的显示画面平移加压缩的示意图;16 is a schematic diagram of display screen translation plus compression according to a preferred embodiment of the present invention;
图17是根据本发明优选实施例的屏幕显示控制方法的流程图;17 is a flow chart of a screen display control method in accordance with a preferred embodiment of the present invention;
图18是根据本发明实施例优选实施例的用户意图触摸屏幕左上区域屏幕显示控制方法的示意图;18 is a schematic diagram of a screen display control method of a user's intention to touch an upper left area of a screen according to a preferred embodiment of the present invention;
图19是根据本发明实施例的屏幕显示控制装置的结构框图;19 is a block diagram showing the structure of a screen display control device according to an embodiment of the present invention;
图20是根据本发明实施例的屏幕显示控制装置的控制模块194的结构框图;20 is a block diagram showing the structure of a control module 194 of a screen display control device according to an embodiment of the present invention;
图21是根据本发明实施例的移动终端的结构框图。21 is a block diagram showing the structure of a mobile terminal according to an embodiment of the present invention.
具体实施方式detailed description
下文中将参考附图并结合实施例来详细说明本发明。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.
需要说明的是,本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。It is to be understood that the terms "first", "second" and the like in the specification and claims of the present invention are used to distinguish similar objects, and are not necessarily used to describe a particular order or order.
实施例1Example 1
本申请实施例一所提供的方法实施例可以在移动终端、计算机终端或者类似的运算装置中执行。以运行在移动终端上为例,图1是本发明实施例的一种屏幕显示控制方法的移动终端的硬件结构框图。如图1所示,移动终端10可以包括一个或多个(图中仅示出一个)处理器12(处理器12可以包括但不限于微处理器MCU或可编程逻辑器件FPGA等的处理装置)、用于存储数据的存储器14、以及用于通信功能的传输装置16。本领域普通技术人员可以理解,图1所示的结构仅为示意,其并不对上述电子装置的结构造成限定。例如,移动终端10还可包括比图1中所示更多或者更少的组件,或者具有与图1所示不同的配置。The method embodiment provided in Embodiment 1 of the present application can be executed in a mobile terminal, a computer terminal or the like. Taking a mobile terminal as an example, FIG. 1 is a hardware structural block diagram of a mobile terminal of a screen display control method according to an embodiment of the present invention. As shown in FIG. 1, the mobile terminal 10 may include one or more (only one shown) processor 12 (the processor 12 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA). A memory 14 for storing data, and a transmission device 16 for communication functions. It will be understood by those skilled in the art that the structure shown in FIG. 1 is merely illustrative and does not limit the structure of the above electronic device. For example, the mobile terminal 10 may also include more or fewer components than those shown in FIG. 1, or have a different configuration than that shown in FIG.
存储器14可用于存储应用软件的软件程序以及模块,如本发明实施例中的屏幕显示控制方法对应的程序指令/模块,处理器12通过运行存储在存储器14内的软件程序以及模块,从而执行各种功能应用以及数据处理,即实现上述的方法。存储器14可包括高速随机存储器,还可包括非易失性存储器,如一个或者多个磁性存储装置、闪存、或者其他非易失性固态存储器。在一些实例中,存储器14可进一步包括相对于处理器12远程设置的存储器,这些远程存储器可以通过网络连接至移动终端10。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 14 can be used to store software programs and modules of application software, such as program instructions/modules corresponding to the screen display control method in the embodiment of the present invention, and the processor 12 executes each by executing a software program and a module stored in the memory 14. A functional application and data processing, that is, the above method is implemented. Memory 14 may include high speed random access memory, and may also include non-volatile memory such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory. In some examples, memory 14 may further include memory remotely located relative to processor 12, which may be connected to mobile terminal 10 over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
传输装置16用于经由一个网络接收或者发送数据。上述的网络具体实例可包括移动终端10的通信供应商提供的无线网络。在一个实例中,传输装置16包括一个网络适配器(Network Interface Controller,简称为NIC),其可通过基站与其他网络设备相连从而可与互联网进行通讯。在一个实例中,传输装置16可以为射频(Radio Frequency,简称为RF)模块,其用于通过无线方式与互联网进行通讯。 Transmission device 16 is for receiving or transmitting data via a network. The above-described network specific example may include a wireless network provided by a communication provider of the mobile terminal 10. In one example, the transmission device 16 includes a Network Interface Controller (NIC) that can be connected to other network devices through a base station to communicate with the Internet. In one example, the transmission device 16 can be a Radio Frequency (RF) module for communicating with the Internet wirelessly.
在本实施例中提供了一种运行于上述移动终端的屏幕显示控制方法,图2是根据本发明实施例的屏幕显示控制方法的流程图,如图2所示,该流程包括如下步骤:In this embodiment, a screen display control method running on the mobile terminal is provided. FIG. 2 is a flowchart of a screen display control method according to an embodiment of the present invention. As shown in FIG. 2, the flow includes the following steps:
步骤S202,获取人脸图像在终端屏幕中的第一位置;Step S202, acquiring a first position of the face image in the terminal screen;
步骤S204,根据第一位置与人脸图像在终端屏幕中的参考位置的相对位置,控制终端屏幕中显示画面移动至第二位置。Step S204, controlling the display screen in the terminal screen to move to the second position according to the relative position of the first position and the reference position of the face image in the terminal screen.
通过上述步骤,根据获取到的人脸图像在终端屏幕中的第一位置与人脸图像的参考位置,控制终端屏幕中的显示画面的移动位置,解决了相关技术中存在用户单手操作屏幕的方式每个界面需要单独定制,无法涵盖所有界面的问题,提高了用户单手操作的便捷性。Through the above steps, according to the obtained first position of the face image in the terminal screen and the reference position of the face image, the moving position of the display screen in the terminal screen is controlled, which solves the problem that the user has one-hand operation screen in the related art. Each interface needs to be customized separately, and it cannot cover all the interfaces, which improves the convenience of one-handed operation.
可选地,人脸图像在终端屏幕中显示的参考位置可以采用多种方式多种进行确定,例如,可以通过终端屏幕所在的终端的前置摄像头获取的人脸图像,或者,根据预设参数,确定参考位置。这里预设参数可以是终端的中心位置,也可以是根据经验设定屏幕中的某一位置作为参考位置。Optionally, the reference position displayed by the face image in the terminal screen may be determined in multiple manners, for example, the face image acquired by the front camera of the terminal where the terminal screen is located, or according to preset parameters. , determine the reference location. Here, the preset parameter may be the center position of the terminal, or may be a certain position in the screen according to experience as a reference position.
可选地,可以采用多种方式获取人脸图像在终端屏幕中显示的第一位置,例如,可以通过终端屏幕所在的终端的前置摄像头,获取人脸图像在终端屏幕中显示的第一位置。又例如,还可以通过其他的感知装置(例如,红外等)获取人脸图像在终端屏幕中显示的第一位置。Optionally, the first location of the face image displayed in the terminal screen may be acquired in multiple manners. For example, the first camera displayed on the terminal screen may be obtained through the front camera of the terminal where the terminal screen is located. . For another example, the first location displayed by the face image in the terminal screen may also be acquired by other sensing devices (eg, infrared, etc.).
可选地,可以采用如下方式根据第一位置与人脸图像在终端屏幕中的参考位置的相对位置,控制终端屏幕中显示画面移动至第二位置:确定与相对位置对应的终端屏幕上横向的第一向量和纵向的第二向量;根据确定的第一向量,控制显示画面的第一预设边缘横向移动至第一预设距离,其中,横向移动的方向与第一向量的方向相反;和/或,根据确定的第二向量,控制显示画面的第二预设边缘纵向移动至第二预设距离,其中,纵向移动的方向与第二向量的方向相反。Optionally, the display screen in the terminal screen is controlled to move to the second position according to the relative position of the first position and the reference position of the face image in the terminal screen in the following manner: determining the horizontal position on the screen of the terminal corresponding to the relative position a first vector and a second vector in the longitudinal direction; according to the determined first vector, controlling the first preset edge of the display screen to laterally move to a first preset distance, wherein the direction of the lateral movement is opposite to the direction of the first vector; And or, according to the determined second vector, controlling the second preset edge of the display screen to move longitudinally to the second preset distance, wherein the direction of the longitudinal movement is opposite to the direction of the second vector.
可选地,显示画面的移动可以包括以下之一:显示画面整体平移;显示画面按照预设比例压缩移动;显示画面中的预设区域平移,显示画面中除预设区域外的其他区域按照预设比例进行压缩移动。Optionally, the moving of the display screen may include one of the following: displaying the overall translation of the screen; the display screen is compressed according to a preset ratio; the preset area in the display screen is translated, and other areas in the display screen except the preset area are pre-predicted. Set the scale to perform compression movement.
基于上述实施例及优选实施方式,为说明方案的整个流程交互,在本优选实施例中,提供了一种屏幕显示控制方法,在该方法中,终端以手机为例进行说明。Based on the foregoing embodiments and preferred embodiments, in order to explain the entire process interaction of the solution, in the preferred embodiment, a screen display control method is provided. In the method, the terminal uses a mobile phone as an example for description.
用户在很多场合需要单手操控手机,按常规的握持习惯都是用大拇指触摸手机屏幕。由于大拇指长度有限,在触摸手机屏幕中间区域时会比较自如,而对于手机屏幕边缘区域往往无法触及,或者需要改变握持状态才能触及。Users need to control the mobile phone with one hand in many occasions. According to the conventional holding habit, the mobile phone screen is touched with a thumb. Since the length of the thumb is limited, it is relatively easy to touch the middle area of the screen of the mobile phone, and the edge area of the screen of the mobile phone is often inaccessible or needs to be changed to be touched.
如果能将用户希望触及的边缘区域的内容自动移动到手机中间区域,用户只需点击中间区域即可完成操作,便会大大提高操控便捷性。If the content of the edge area that the user wants to touch is automatically moved to the middle area of the mobile phone, the user only needs to click the middle area to complete the operation, which greatly improves the convenience of manipulation.
根据单手操控习惯,当用户希望点击距离拇指尖较远的边缘区域时,会将手机在原有平面基础上略微倾斜,使得该区域略靠近自己,相当于缩短了该区域与拇指尖的距离。如:希望点击手机左上角,会将左上角略转向自己。这种手机平面相对于用户脸部的变化,可 以通过前置摄像头捕捉的人脸画面进行判断。即,用户希望触及某一边缘区域,在将该区域略转向自己的同时,前置摄像头捕捉的人脸画面也会随着向该区域逐渐移动。直观的体现就是开启前摄预览,将某一边缘区域略转向自己时,预览画面中的人脸就会随之往该区域平滑移动。当该移动超过一定阈值时,即可判断为用户希望触及该区域。According to the one-hand control habit, when the user wants to click on the edge area farther from the tip of the thumb, the phone will be slightly tilted on the original plane, so that the area is slightly close to itself, which is equivalent to shortening the distance between the area and the tip of the thumb. For example, if you want to click on the top left corner of your phone, you will turn to the top left corner. The change of the plane of the mobile phone relative to the face of the user can be The judgment is made by the face picture captured by the front camera. That is, the user wants to touch an edge area, and while the area is slightly turned to himself, the face image captured by the front camera also gradually moves toward the area. The intuitive embodiment is to turn on the proactive preview. When you turn a certain edge area to yourself, the face in the preview image will move smoothly to the area. When the movement exceeds a certain threshold, it can be determined that the user wishes to touch the area.
在本发明优选实施例中,前摄(前置摄像头)捕捉到人脸画面向某区域移动超过一定阈值后,就随之将该区域的画面及对应的触控点也逐渐向手机中间移动,便于用户触摸。In a preferred embodiment of the present invention, after the front camera (front camera) captures that the face image moves to a certain area beyond a certain threshold, the picture of the area and the corresponding touch point are gradually moved to the middle of the mobile phone. Easy for users to touch.
图3是根据本发明优选实施例的手机的结构框图,如图3所示,该手机包括:检测模块32和执行模块34。下面对该手机进行说明。FIG. 3 is a structural block diagram of a mobile phone according to a preferred embodiment of the present invention. As shown in FIG. 3, the mobile phone includes a detecting module 32 and an executing module 34. The phone will be described below.
检测模块32利用前置摄像头进行人脸捕捉,判断用户希望触及的边缘区域。The detection module 32 performs face capture using the front camera to determine the edge area that the user wishes to touch.
当前摄捕捉到的人脸图像位于手机中间区域时,可以认为用户只需要正常点击手机中间区域,不需要点击边缘区域。即,此时手机平面基本正对用户脸部,如图4所示。When the currently captured face image is located in the middle area of the mobile phone, it can be considered that the user only needs to click the middle area of the mobile phone normally, and does not need to click on the edge area. That is, at this time, the plane of the mobile phone is basically facing the user's face, as shown in FIG.
当前摄捕捉到的人脸图像向手机边缘区域移动且达到一定阈值时,认为用户希望点击该边缘区域,即,此时用户已按常规操作习惯略微转动手机,将该区域略微转向自己以增加拇指尖触及的可能性。该阈值可预设缺省值且可在设置中调整,达到阈值则表明该转动已超出触控中间区域时的手机抖动带来的转动,即排除误判的可能。如图5至图12为针对手机不同的边缘区域所作的示意。When the currently captured face image moves to the edge area of the mobile phone and reaches a certain threshold, it is considered that the user wishes to click the edge area, that is, the user has slightly rotated the mobile phone according to the normal operation habit, and the area is slightly turned to himself to increase the thumb. The possibility of a sharp touch. The threshold value can be preset to a default value and can be adjusted in the setting. When the threshold value is reached, the rotation caused by the jitter of the mobile phone when the rotation has exceeded the middle area of the touch is eliminated, that is, the possibility of misjudgment is eliminated. Figures 5 through 12 are schematic representations of different edge regions of the handset.
当前摄捕捉到的人脸图像向手机边缘区域在超出阈值范围后移动时,执行模块执行显示画面及对应触控点的处理。When the currently captured face image moves to the edge area of the mobile phone after the threshold range is exceeded, the execution module performs a process of displaying the display screen and corresponding touch points.
执行模块34将用户希望触及的边缘区域的显示画面及对应的触控点向手机中间区域平滑移动。用户只需点击中间区域即可完成操作。The execution module 34 smoothly moves the display screen of the edge area that the user desires to touch and the corresponding touch point to the middle area of the mobile phone. The user simply clicks on the middle area to complete the operation.
该移动的幅度可以和前摄捕捉到的人脸图像超出阈值的程度相关。即人脸图像位置超出阈值越多,显示画面及对应的触控点移动的幅度越大;人脸图像位置超出阈值越少,显示画面及对应的触控点移动的幅度越小。人脸图像恢复到阈值范围内时,显示画面也恢复至原始无移动的状态。显示画面移动幅度和人脸图像相对中心区域偏移的关系如图13所示。The magnitude of this movement can be related to the extent to which the proactively captured face image exceeds a threshold. That is, the more the position of the face image exceeds the threshold, the greater the amplitude of the movement of the display screen and the corresponding touch point; the smaller the position of the face image exceeds the threshold, the smaller the amplitude of the movement of the display screen and the corresponding touch point. When the face image is restored to within the threshold range, the display also returns to the original no-movement state. The relationship between the display screen movement amplitude and the face image offset from the center area is as shown in FIG.
显示画面移动可以有多种方式,以下为典型的3种。There are many ways to display the screen movement. The following are typical three types.
1)线性平移。即画面整体向用户希望触及的区域的反方向平移,超出屏幕的部分舍弃。如图14所示。1) Linear translation. That is, the entire screen is translated in the opposite direction to the area that the user wishes to touch, and is discarded beyond the portion of the screen. As shown in Figure 14.
2)线性压缩。即画面整体向用户希望触及的区域的反方向压缩。如图15所示。2) Linear compression. That is, the entire screen is compressed in the opposite direction to the area that the user wishes to touch. As shown in Figure 15.
3)平移加压缩。即用户希望触及的区域的画面向反方向平移,其余区域压缩。如图16所示。3) Translation plus compression. That is, the picture of the area that the user wishes to touch is translated in the opposite direction, and the remaining areas are compressed. As shown in Figure 16.
结合图4所示的手机的结构框图,对屏幕移动的过程进行说明。The process of screen movement will be described in conjunction with the structural block diagram of the mobile phone shown in FIG.
图17是根据本发明优选实施例的屏幕显示控制方法的流程图,如图17所示,该流程包括如下步骤:17 is a flow chart of a screen display control method according to a preferred embodiment of the present invention. As shown in FIG. 17, the flow includes the following steps:
步骤S1702,前置摄像头捕捉人脸图像位置。 In step S1702, the front camera captures the face image position.
步骤S1704,判断捕捉的人脸图像位置是否超出预设阈值,如果是,执行步骤S1706,否则,执行步骤S1702。In step S1704, it is determined whether the captured face image position exceeds a preset threshold. If yes, step S1706 is performed; otherwise, step S1702 is performed.
步骤S1706,处理显示画面及对应的触控点。Step S1706, processing the display screen and corresponding touch points.
下面通过具体算法对本优选实施例的屏幕显示控制方法进行说明。该算法用于计算显示画面移动幅度和人脸图像位置关系,该屏幕控制显示方法是在此算法下用户意图触摸屏幕左上区域(其他区域类似)时的判断及处理方法。The screen display control method of the preferred embodiment will be described below by a specific algorithm. The algorithm is used for calculating the moving range of the display screen and the positional relationship of the face image. The screen control display method is a method for determining and processing when the user intends to touch the upper left area of the screen (other areas are similar) under the algorithm.
如图18所示,设前摄捕捉到的人脸图像中心坐标为(x,y),阈值为x∈[Xleft,Xright],y∈[Ydown,Yup],算法即为:As shown in FIG. 18, it is assumed that the center coordinates of the face image captured by the proactive image are (x, y), and the threshold values are x ∈ [X left , X right ], y ∈ [Y down , Y up ], and the algorithm is:
x<Xleft时,画面左边缘右移Xleft-x;When x<X left , the left edge of the screen is shifted to the right by X left -x;
x>Xright时,画面右边缘左移x-XrightWhen x>X right , the right edge of the screen shifts left xX right ;
y<Ydown时,画面下边缘上移Ydown-y;When y<Y down , the lower edge of the screen moves up Y down -y;
y>Yup时,画面上边缘下移y-YupWhen y>Y up , the upper edge of the screen moves down yY up ;
若手机分辨率为1080×1920,设定手机屏幕最左下角像素点坐标为(0,0),最右上角像素点坐标为(1080,1920)。则设定阈值Xleft=360,Xright=720,Ydown=600,Yup=1200。如图18所示。If the resolution of the mobile phone is 1080×1920, set the coordinates of the pixel in the lower left corner of the mobile phone screen to be (0, 0), and the coordinates of the pixel in the upper right corner are (1080, 1920). Then set the threshold Xleft=360, Xright=720, Ydown=600, Yup=1200. As shown in Figure 18.
用户意图触摸屏幕左上区域时的判断及处理步骤如下:The judgment and processing steps when the user intends to touch the upper left area of the screen are as follows:
步骤1:检测模块利用前置摄像头进行人脸捕捉,缺省状态时手机正对用户脸部。对应图18中人脸图像中心坐标(x1,y1),此时360<x1<720,600<y1<1200。(x1,y1)处于阈值范围内,显示图像不需要做移动处理。Step 1: The detection module uses the front camera for face capture. By default, the phone is facing the user's face. Corresponding to the face image center coordinates (x1, y1) in Fig. 18, 360 < x1 < 720, 600 < y1 < 1200. (x1, y1) is within the threshold range, and the display image does not need to be moved.
步骤2,用户逐渐将手机左上角转向自己,前摄捕捉到人脸图像也逐渐向手机左上移动并首先在x方向超出阈值。对应图18中人脸图像中心坐标(x2,y2),此时x2<360,600<y2<1200。x2值超出阈值范围,显示图像需要做右移处理。Step 2, the user gradually turns the upper left corner of the mobile phone to himself, and the proactively captured human face image gradually moves to the upper left of the mobile phone and first exceeds the threshold in the x direction. Corresponding to the center coordinate (x2, y2) of the face image in Fig. 18, x2 < 360, 600 < y2 < 1200. The x2 value is outside the threshold range and the display image needs to be shifted right.
步骤3,执行模块处理显示画面及对应的触控点向手机右侧移动。画面左边缘移动的幅度为360-x2,画面左边缘移至坐标横轴360-x2(跟随x2实时变化)处;画面纵向位置不变。即画面最左上角像素点坐标为(360-x2,1920)。Step 3: The execution module processes the display screen and the corresponding touch point to move to the right side of the mobile phone. The left edge of the picture moves 360-x2, and the left edge of the picture moves to the horizontal axis 360-x2 (following x2 real-time change); the vertical position of the picture is unchanged. That is, the coordinates of the pixel in the upper left corner of the screen are (360-x2, 1920).
步骤4,如果用户仍无法触及步骤3中移动后的触控点,则继续将手机左上角转向自己,前摄捕捉到人脸图像也继续向手机左上移动并进而在y方向超出阈值。对应图18中人脸图像中心坐标(x3,y3),此时x3<360,y3>1200。X3、y3值均超出阈值范围,显示图像需要做右移及下移处理。Step 4: If the user still cannot touch the touch point after moving in step 3, continue to turn the upper left corner of the mobile phone to himself, and the proactively captured face image also continues to move to the upper left of the mobile phone and further exceeds the threshold in the y direction. Corresponding to the face image center coordinates (x3, y3) in Fig. 18, at this time x3 < 360, y3 > 1200. The X3 and y3 values all exceed the threshold range, and the displayed image needs to be shifted right and down.
步骤5,执行模块处理显示画面及对应的触控点向手机右下移动。画面左边缘移动的幅度为360-x3,画面左边缘移至坐标横轴360-x3(跟随x3实时变化)处;画面上边缘移动的幅度为y3-1200,画面上边缘移至坐标纵轴3120-y3(跟随y3实时变化)处。即画面最左上角像素点坐标为(360-x3,3120-y3)。Step 5: The execution module processes the display screen and the corresponding touch point to move to the lower right of the mobile phone. The left edge of the picture moves 360-x3, and the left edge of the picture moves to the horizontal axis 360-x3 (following x3 real-time change); the upper edge of the picture moves by y3-1200, and the upper edge of the picture moves to the vertical axis of the coordinate 3120. -y3 (following y3 real-time changes). That is, the coordinates of the pixel in the upper left corner of the screen are (360-x3, 3120-y3).
步骤6,用户完成触控后,将手机屏幕逐渐恢复到原始的正对用户脸部的状态。前摄捕捉到人脸图像也逐渐向中心区域移动直至恢复到阈值范围内,显示画面也逐渐恢复至原 始无移动的状态。Step 6. After the user completes the touch, the screen of the mobile phone is gradually restored to the original state of the face of the user. Proactively capturing the face image also gradually moves to the center area until it returns to the threshold range, and the display gradually returns to the original There is no moving state at the beginning.
由于前置摄像头只需要捕捉人脸的位置,对拍摄的画面没有质量要求,即可以适当调低前摄的分辨率、帧率等配置参数,即不需要按摄像头可支持的最高分辨率和帧率等进行设置,从而可以降低亮屏操作时的整机功耗。Since the front camera only needs to capture the position of the face, there is no quality requirement for the captured picture, that is, the configuration parameters such as the resolution of the proactive camera and the frame rate can be appropriately lowered, that is, the highest resolution and frame that can be supported by the camera are not required. The rate is set, so that the power consumption of the whole machine during the bright screen operation can be reduced.
本优选实施例中利用用户常规操作习惯实现自动控制,不需要用户完成任何附加动作即可自动实现大屏手机的全界面触控,并通过设置阈值避免误触发。In the preferred embodiment, the user's normal operation habits are used to implement automatic control, and the user can automatically implement full-screen touch of the large-screen mobile phone without completing any additional actions, and avoid false triggering by setting a threshold.
本优选实施例中利用了人脸捕捉技术检测用户脸部相对于手机平面的位置变化,从而判断出用户意图触摸的屏幕区域,进而调节显示画面及对应的触控点以便于用户触控,适用于大屏手机。由于利用手机自带的前置摄像头进行人脸捕捉判断用户意图,不增加任何硬件成本。同时,本优选实施例的技术方案可以涵盖所有显示界面,横、竖屏操作都适用,左、右手操作都适用。通过本发明优选实施例的上述技术发难,将用户希望触及的边缘区域的内容自动移动到手机中间区域,用户只需点击中间区域即可完成操作,大大提高了操控便捷性。In the preferred embodiment, the face capture technology is used to detect the position change of the user's face relative to the plane of the mobile phone, thereby determining the screen area that the user intends to touch, and then adjusting the display screen and the corresponding touch point to facilitate the user's touch. On the big screen mobile phone. Since the front camera of the mobile phone is used for face capture to judge the user's intention, no hardware cost is added. Meanwhile, the technical solution of the preferred embodiment can cover all display interfaces, and both horizontal and vertical screen operations are applicable, and both left and right hand operations are applicable. Through the above-mentioned technology of the preferred embodiment of the present invention, the content of the edge area that the user wants to touch is automatically moved to the middle area of the mobile phone, and the user only needs to click the middle area to complete the operation, which greatly improves the convenience of manipulation.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到根据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,或者网络设备等)执行本发明各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, The optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present invention.
实施例2Example 2
在本实施例中还提供了一种屏幕显示控制装置,该装置用于实现上述实施例及优选实施方式,已经进行过说明的不再赘述。如以下所使用的,术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的。In the embodiment, a screen display control device is also provided, which is used to implement the above-mentioned embodiments and preferred embodiments, and has not been described again. As used below, the term "module" may implement a combination of software and/or hardware of a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
图19是根据本发明实施例的屏幕显示控制装置的结构框图,如图19所示,该装置包括:FIG. 19 is a structural block diagram of a screen display control apparatus according to an embodiment of the present invention. As shown in FIG. 19, the apparatus includes:
获取模块192,用于获取人脸图像在终端屏幕中的第一位置;The obtaining module 192 is configured to acquire a first position of the face image in the terminal screen;
控制模块194,连接至上述获取模块192,用于根据第一位置与人脸图像在终端屏幕中的参考位置的相对位置,控制终端屏幕中显示画面移动的第二位置。The control module 194 is connected to the obtaining module 192, and is configured to control a second position of displaying a screen movement in the terminal screen according to the relative position of the first position and the reference position of the face image in the terminal screen.
可选地,获取模块192,还可以用于在获取人脸图像在终端屏幕中的第一位置之前,通过终端屏幕所在的终端的前置摄像头获取的人脸图像,或者,根据预设参数,确定参考位置。Optionally, the obtaining module 192 is further configured to: before acquiring the first location of the facial image in the terminal screen, the facial image acquired by the front camera of the terminal where the terminal screen is located, or according to preset parameters, Determine the reference location.
可选地,获取模块192,还可以用于通过终端屏幕所在的终端的前置摄像头,获取人脸图像在终端屏幕中显示的第一位置。Optionally, the obtaining module 192 is further configured to obtain, by using a front camera of the terminal where the terminal screen is located, a first position displayed by the face image in the terminal screen.
图20是根据本发明实施例的屏幕显示控制装置的控制模块194的结构框图,如图19 所示,该控制模块194包括:20 is a block diagram showing the structure of a control module 194 of a screen display control device according to an embodiment of the present invention, as shown in FIG. As shown, the control module 194 includes:
确定单元202,用于确定与相对位置对应的终端屏幕上横向的第一向量和纵向的第二向量;a determining unit 202, configured to determine a first vector in the horizontal direction and a second vector in the vertical direction on the screen of the terminal corresponding to the relative position;
控制单元204,连接至上述确定单元202,用于根据确定的第一向量,控制显示画面的第一预设边缘横向移动至第一预设距离,其中,横向移动的方向与第一向量的方向相反;和/或,用于根据确定的第二向量,控制显示画面的第二预设边缘纵向移动至第二预设距离,其中,纵向移动的方向与第二向量的方向相反。The control unit 204 is connected to the determining unit 202, configured to control the first preset edge of the display screen to move to a first preset distance according to the determined first vector, wherein the direction of the lateral movement and the direction of the first vector Conversely; and/or for controlling the second preset edge of the display screen to move to a second preset distance according to the determined second vector, wherein the direction of the longitudinal movement is opposite to the direction of the second vector.
可选地,显示画面移动可以包括以下之一:显示画面整体平移,显示画面按照预设比例压缩移动,显示画面中的预设区域平移,显示画面中除预设区域外的其他区域按照预设比例进行压缩移动。Optionally, the display screen movement may include one of the following: the overall movement of the display screen, the display screen is compressed and moved according to a preset ratio, and the preset area in the display screen is translated, and other areas in the display screen except the preset area are preset. The scale is compressed.
需要说明的是,上述各个模块是可以通过软件或硬件来实现的,对于后者,可以通过以下方式实现,但不限于此:上述模块均位于同一处理器中;或者,上述各个模块以任意组合的形式分别位于不同的处理器中。It should be noted that each of the above modules may be implemented by software or hardware. For the latter, the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the above modules are in any combination. The forms are located in different processors.
实施例3Example 3
图21是根据本发明实施例的移动终端的结构框图,如图21所示,该移动终端包括如19或20中任一所示的屏幕显示控制装置212。21 is a block diagram showing the structure of a mobile terminal according to an embodiment of the present invention. As shown in FIG. 21, the mobile terminal includes a screen display control device 212 as shown in any of 19 or 20.
实施例4Example 4
本发明的实施例还提供了一种存储介质。可选地,在本实施例中,上述存储介质可以被设置为存储用于执行以下步骤的程序代码:Embodiments of the present invention also provide a storage medium. Optionally, in the embodiment, the foregoing storage medium may be configured to store program code for performing the following steps:
S1,获取人脸图像在终端屏幕中的第一位置;S1, acquiring a first position of the face image in the terminal screen;
S2,根据第一位置与人脸图像在终端屏幕中的参考位置的相对位置,控制终端屏幕中显示画面移动至第二位置。S2. Control the display screen in the terminal screen to move to the second position according to the relative position of the first position and the reference position of the face image in the terminal screen.
可选地,存储介质还被设置为存储用于执行以下步骤的程序代码:在获取人脸图像在终端屏幕中的第一位置之前,还包括:通过终端屏幕所在的终端的前置摄像头获取的人脸图像,或者,根据预设参数,确定参考位置。Optionally, the storage medium is further configured to store program code for performing the following steps: before acquiring the first position of the face image in the terminal screen, further comprising: acquiring by the front camera of the terminal where the terminal screen is located The face image, or, based on the preset parameters, determines the reference position.
可选地,存储介质还被设置为存储用于执行以下步骤的程序代码:获取人脸图像在终端屏幕中显示的第一位置包括:通过终端屏幕所在的终端的前置摄像头,获取人脸图像在终端屏幕中显示的第一位置。Optionally, the storage medium is further configured to store program code for performing the following steps: acquiring the first location of the face image displayed in the terminal screen comprises: acquiring the face image by using a front camera of the terminal where the terminal screen is located The first position displayed in the terminal screen.
可选地,存储介质还被设置为存储用于执行以下步骤的程序代码:Optionally, the storage medium is further arranged to store program code for performing the following steps:
根据第一位置与人脸图像在终端屏幕中的参考位置的相对位置,控制终端屏幕中显示画面移动至第二位置包括:According to the relative position of the first position and the reference position of the face image in the terminal screen, controlling the movement of the display screen to the second position in the screen of the terminal comprises:
S1,确定与相对位置对应的终端屏幕上横向的第一向量和纵向的第二向量;S1, determining a first horizontal vector and a second vertical vector on the screen of the terminal corresponding to the relative position;
S2,根据确定的第一向量,控制显示画面的第一预设边缘横向移动至第一预设距离,其中,横向移动的方向与第一向量的方向相反;和/或,根据确定的第二向量,控制显示画面的第二预设边缘纵向移动至第二预设距离,其中,纵向移动的方向与第二向量的方向 相反。S2, according to the determined first vector, controlling the first preset edge of the display screen to laterally move to a first preset distance, wherein the direction of the lateral movement is opposite to the direction of the first vector; and/or according to the determined second a vector that controls the second preset edge of the display screen to move longitudinally to a second preset distance, wherein the direction of the longitudinal movement and the direction of the second vector in contrast.
可选地,存储介质还被设置为存储用于执行以下步骤的程序代码:显示画面的移动包括以下之一:显示画面整体平移,显示画面按照预设比例压缩移动;显示画面中的预设区域平移;显示画面中除预设区域外的其他区域按照预设比例进行压缩移动。Optionally, the storage medium is further configured to store program code for performing the following steps: the movement of the display screen comprises one of: displaying the overall translation of the screen, and compressing the display screen according to a preset ratio; displaying the preset area in the screen Pan; other areas in the display screen except the preset area are compressed and moved according to a preset ratio.
可选地,在本实施例中,上述存储介质可以包括但不限于:U盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。Optionally, in this embodiment, the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory. A variety of media that can store program code, such as a disc or a disc.
可选地,在本实施例中,处理器根据存储介质中已存储的程序代码执行:获取人脸图像在终端屏幕中的第一位置;根据第一位置与人脸图像在终端屏幕中的参考位置的相对位置,控制终端屏幕中显示画面移动的第二位置。Optionally, in this embodiment, the processor performs: acquiring, according to the stored program code in the storage medium, the first position of the face image in the terminal screen; the reference according to the first position and the face image in the terminal screen The relative position of the position controls the second position of the screen movement in the terminal screen.
可选地,在本实施例中,处理器根据存储介质中已存储的程序代码执行:获取人脸图像在终端屏幕中的第一位置之前,还包括:通过终端屏幕所在的终端的前置摄像头获取的人脸图像,或者,根据预设参数,确定参考位置。Optionally, in this embodiment, the processor performs, according to the stored program code in the storage medium, before acquiring the first position of the face image in the terminal screen, further comprising: a front camera through the terminal where the terminal screen is located The obtained face image, or, according to a preset parameter, determines the reference position.
可选地,在本实施例中,处理器根据存储介质中已存储的程序代码执行:获取人脸图像在终端屏幕中显示的第一位置包括:通过终端屏幕所在的终端的前置摄像头,获取人脸图像在终端屏幕中显示的第一位置。Optionally, in this embodiment, the processor is executed according to the stored program code in the storage medium: acquiring the first location displayed by the face image in the terminal screen comprises: acquiring, by using a front camera of the terminal where the terminal screen is located The first position of the face image displayed in the terminal screen.
可选地,在本实施例中,处理器根据存储介质中已存储的程序代码执行:根据第一位置与人脸图像在终端屏幕中的参考位置的相对位置,控制终端屏幕中显示画面移动的第二位置包括:确定与相对位置对应的终端屏幕上横向的第一向量和纵向的第二向量;根据确定的第一向量,控制显示画面的第一预设边缘横向移动至第一预设距离,其中,横向移动的方向与第一向量的方向相反;和/或,根据确定的第二向量,控制显示画面的第二预设边缘纵向移动至第二预设距离,其中,纵向移动的方向与第二向量的方向相反。Optionally, in this embodiment, the processor performs, according to the stored program code in the storage medium, controlling the display screen movement in the terminal screen according to the relative position of the first position and the reference position of the face image in the terminal screen. The second location includes: determining a first vector in the horizontal direction on the screen of the terminal corresponding to the relative position and a second vector in the vertical direction; controlling the first preset edge of the display screen to move to the first preset distance according to the determined first vector Wherein the direction of the lateral movement is opposite to the direction of the first vector; and/or, according to the determined second vector, controlling the second predetermined edge of the display screen to move longitudinally to a second predetermined distance, wherein the direction of the longitudinal movement Contrary to the direction of the second vector.
可选地,在本实施例中,处理器根据存储介质中已存储的程序代码执行:显示画面移动包括以下之一:显示画面整体平移,显示画面按照预设比例压缩移动,显示画面中的预设区域平移,显示画面中除预设区域外的其他区域按照预设比例进行压缩移动。Optionally, in this embodiment, the processor executes according to the stored program code in the storage medium: the display screen movement includes one of the following: displaying the overall translation of the screen, and compressing the display screen according to a preset ratio, and displaying the preview in the screen Set the area to pan, and the other areas except the preset area in the display screen are compressed and moved according to the preset ratio.
可选地,在本实施例中,处理器根据存储介质中已存储的程序代码执行:本实施例中的具体示例可以参考上述实施例及可选实施方式中所描述的示例,本实施例在此不再赘述。Optionally, in this embodiment, the processor is executed according to the stored program code in the storage medium: the specific example in this embodiment may refer to the examples described in the foregoing embodiment and the optional implementation manner, where the embodiment is This will not be repeated here.
显然,本领域的技术人员应该明白,上述的本发明的各模块或各步骤可以用通用的计算装置来实现,它们可以集中在单个的计算装置上,或者分布在多个计算装置所组成的网络上,可选地,它们可以用计算装置可执行的程序代码来实现,从而,可以将它们存储在存储装置中由计算装置来执行,并且在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤,或者将它们分别制作成各个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样,本发明不限制于任何特定的硬件和软件结合。It will be apparent to those skilled in the art that the various modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein. The steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.
以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技 术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. The present invention is susceptible to various modifications and changes. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.
工业实用性Industrial applicability
本发明实施例提供的技术方案可以应用于通信领域。在本发明实施例提供的技术方案中,根据获取到的人脸图像在终端屏幕中的第一位置与人脸图像的参考位置,控制终端屏幕中的显示画面的移动位置,可以适用于屏幕的多种界面。因此,可以解决相关技术中存在用户单手操作屏幕的方式每个界面需要单独定制,无法涵盖所有界面的问题,达到提高用户单手操作的便捷性的效果。 The technical solution provided by the embodiment of the present invention can be applied to the field of communications. In the technical solution provided by the embodiment of the present invention, according to the obtained first position of the face image in the terminal screen and the reference position of the face image, controlling the moving position of the display screen in the terminal screen may be applied to the screen. A variety of interfaces. Therefore, the manner in which the user operates the screen with one hand can be solved in the related art. Each interface needs to be separately customized, and the problem of all the interfaces cannot be covered, thereby achieving the effect of improving the convenience of the one-hand operation of the user.

Claims (12)

  1. 一种屏幕显示控制方法,包括:A screen display control method includes:
    获取人脸图像在终端屏幕中的第一位置;Obtaining a first position of the face image in the terminal screen;
    根据所述第一位置与所述人脸图像在终端屏幕中的参考位置的相对位置,控制所述终端屏幕中显示画面移动至第二位置。And controlling the display screen in the terminal screen to move to the second position according to the relative position of the first position and the reference position of the face image in the terminal screen.
  2. 根据权利要求1所述的方法,其中,在获取所述人脸图像在所述终端屏幕中的所述第一位置之前,还包括:The method of claim 1, wherein before acquiring the first image of the face image in the terminal screen, the method further comprises:
    通过所述终端屏幕所在的终端的前置摄像头获取的人脸图像,或者,根据预设参数,确定所述参考位置。The reference position obtained by the front camera acquired by the front camera of the terminal where the terminal screen is located, or according to a preset parameter.
  3. 根据权利要求1所述的方法,其中,获取所述人脸图像在所述终端屏幕中显示的所述第一位置包括:The method of claim 1, wherein the obtaining the first location displayed by the face image in the terminal screen comprises:
    通过所述终端屏幕所在的终端的前置摄像头,获取所述人脸图像在所述终端屏幕中显示的所述第一位置。Obtaining, by the front camera of the terminal where the terminal screen is located, the first position displayed by the face image in the terminal screen.
  4. 根据权利要求1所述的方法,其中,根据所述第一位置与所述人脸图像在终端屏幕中的所述参考位置的所述相对位置,控制所述终端屏幕中所述显示画面移动至所述第二位置包括:The method of claim 1, wherein the display of the display screen in the terminal screen is controlled to be based on the relative position of the first position and the reference position of the face image in the terminal screen to The second location includes:
    确定与所述相对位置对应的所述终端屏幕上横向的第一向量和纵向的第二向量;Determining a first horizontal vector and a second vertical vector on the screen of the terminal corresponding to the relative position;
    根据确定的所述第一向量,控制所述显示画面的第一预设边缘横向移动至第一预设距离,其中,所述横向移动的方向与所述第一向量的方向相反;和/或,根据确定的所述第二向量,控制所述显示画面的第二预设边缘纵向移动至第二预设距离,其中,所述纵向移动的方向与所述第二向量的方向相反。Controlling, according to the determined first vector, a first preset edge of the display screen to move to a first preset distance, wherein the direction of the lateral movement is opposite to a direction of the first vector; and/or And controlling, according to the determined second vector, the second preset edge of the display screen to move longitudinally to a second preset distance, wherein the direction of the longitudinal movement is opposite to the direction of the second vector.
  5. 根据权利要求1至4中任一项所述的方法,其中,所述显示画面的移动包括以下之一:所述显示画面整体平移,所述显示画面按照预设比例压缩移动;所述显示画面中的预设区域平移;所述显示画面中除所述预设区域外的其他区域按照预设比例进行压缩移动。The method according to any one of claims 1 to 4, wherein the movement of the display screen comprises one of: the display screen is totally translated, and the display screen is compressed and moved according to a preset ratio; the display screen The preset area is shifted; the other areas of the display screen except the preset area are compressed and moved according to a preset ratio.
  6. 一种屏幕显示控制装置,包括:A screen display control device comprising:
    获取模块,设置为获取人脸图像在终端屏幕中的第一位置;Obtaining a module, configured to obtain a first position of the face image in the terminal screen;
    控制模块,设置为根据所述第一位置与所述人脸图像在终端屏幕中的参考位置的相对位置,控制所述终端屏幕中显示画面移动的第二位置。And a control module configured to control a second position of the display screen in the terminal screen according to the relative position of the first position and the reference position of the face image in the terminal screen.
  7. 根据权利要求6所述的装置,其中,所述获取模块还设置为在获取所述人脸图像在所述终端屏幕中的所述第一位置之前,通过所述终端屏幕所在的终端的前置摄像头获取的人脸图像,或者,根据预设参数,确定所述参考位置。The apparatus according to claim 6, wherein the acquisition module is further configured to pass through a front end of the terminal where the terminal screen is located before acquiring the face image in the first position in the terminal screen The face image acquired by the camera, or the reference position is determined according to a preset parameter.
  8. 根据权利要求6所述的装置,其中,所述获取模块还设置为通过所述终端屏幕所在的终端的前置摄像头,获取所述人脸图像在所述终端屏幕中显示的所述第一位 置。The apparatus according to claim 6, wherein the obtaining module is further configured to acquire, by the front camera of the terminal where the terminal screen is located, the first bit displayed by the face image in the terminal screen Set.
  9. 根据权利要求6所述的装置,其中,所述控制模块包括:The apparatus of claim 6 wherein said control module comprises:
    确定单元,设置为确定与所述相对位置对应的所述终端屏幕上横向的第一向量和纵向的第二向量;a determining unit, configured to determine a first vector in the horizontal direction and a second vector in the vertical direction on the screen of the terminal corresponding to the relative position;
    控制单元,设置为根据确定的所述第一向量,控制所述显示画面的第一预设边缘横向移动至第一预设距离,其中,所述横向移动的方向与所述第一向量的方向相反;和/或,设置为根据确定的所述第二向量,控制所述显示画面的第二预设边缘纵向移动至第二预设距离,其中,所述纵向移动的方向与所述第二向量的方向相反。a control unit, configured to control the first preset edge of the display screen to laterally move to a first preset distance according to the determined first vector, wherein the direction of the lateral movement and the direction of the first vector Conversely; and/or, configured to control the second preset edge of the display screen to move longitudinally to a second preset distance according to the determined second vector, wherein the direction of the longitudinal movement is opposite to the second The direction of the vector is reversed.
  10. 根据权利要求6至9中任一项所述的装置,其中,所述显示画面移动包括以下之一:所述显示画面整体平移,所述显示画面按照预设比例压缩移动,所述显示画面中的预设区域平移,所述显示画面中除所述预设区域外的其他区域按照预设比例进行压缩移动。The apparatus according to any one of claims 6 to 9, wherein the display screen movement comprises one of: the display screen is totally translated, and the display screen is compressed and moved according to a preset ratio, in the display screen The preset area is translated, and the other areas of the display screen except the preset area are compressed and moved according to a preset ratio.
  11. 一种移动终端,包括:权利要求6至10中任一项所述的装置。A mobile terminal comprising: the apparatus of any one of claims 6 to 10.
  12. 一种计算机存储介质,所述计算机存储介质中存储有计算机可执行的一个或多个程序,所述一个或多个程序被所述计算机执行时使所述计算机执行如根据权利要求1-5中任一项所述的屏幕显示控制方法。 A computer storage medium having stored therein one or more programs executable by a computer, the one or more programs being executed by the computer to cause the computer to perform as in claims 1-5 The screen display control method according to any one of the preceding claims.
PCT/CN2017/104451 2016-09-30 2017-09-29 Screen display control method, device and mobile terminal, and computer storage medium WO2018059552A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610877948.4A CN107885415A (en) 2016-09-30 2016-09-30 Control method for screen display, device and mobile terminal
CN201610877948.4 2016-09-30

Publications (1)

Publication Number Publication Date
WO2018059552A1 true WO2018059552A1 (en) 2018-04-05

Family

ID=61763140

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/104451 WO2018059552A1 (en) 2016-09-30 2017-09-29 Screen display control method, device and mobile terminal, and computer storage medium

Country Status (2)

Country Link
CN (1) CN107885415A (en)
WO (1) WO2018059552A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112860353A (en) * 2019-11-27 2021-05-28 佛山市云米电器科技有限公司 Household appliance control method, mobile terminal and computer readable storage medium
CN115933874A (en) * 2022-11-23 2023-04-07 深圳市江元智造科技有限公司 Intelligent sliding control method and system based on face control and storage medium

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111079625B (en) * 2019-12-11 2023-10-27 江苏国光信息产业股份有限公司 Control method for automatically following rotation of camera along with face
CN111914739A (en) * 2020-07-30 2020-11-10 深圳创维-Rgb电子有限公司 Intelligent following method and device, terminal equipment and readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101859176A (en) * 2009-04-08 2010-10-13 群康科技(深圳)有限公司 Screen control device and method thereof
CN102073436A (en) * 2009-11-23 2011-05-25 英业达股份有限公司 Picture operating method and electronic device using same
CN103543821A (en) * 2012-07-10 2014-01-29 中国移动通信集团公司 Method and system for controlling mobile terminal
US20140240363A1 (en) * 2013-02-22 2014-08-28 Samsung Electronics Co., Ltd. Context awareness-based screen scroll method, machine-readable storage medium and terminal therefor

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010226542A (en) * 2009-03-25 2010-10-07 Brother Ind Ltd Communication device, communication system, communication control method, and communication control program
CN102073435A (en) * 2009-11-23 2011-05-25 英业达股份有限公司 Picture operating method and electronic device using same
CN103135743A (en) * 2011-11-22 2013-06-05 联想(北京)有限公司 Adjustment method for display image of electronic equipment and electronic equipment
CN103777760A (en) * 2014-02-26 2014-05-07 北京百纳威尔科技有限公司 Method and device for switching screen display direction

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101859176A (en) * 2009-04-08 2010-10-13 群康科技(深圳)有限公司 Screen control device and method thereof
CN102073436A (en) * 2009-11-23 2011-05-25 英业达股份有限公司 Picture operating method and electronic device using same
CN103543821A (en) * 2012-07-10 2014-01-29 中国移动通信集团公司 Method and system for controlling mobile terminal
US20140240363A1 (en) * 2013-02-22 2014-08-28 Samsung Electronics Co., Ltd. Context awareness-based screen scroll method, machine-readable storage medium and terminal therefor

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112860353A (en) * 2019-11-27 2021-05-28 佛山市云米电器科技有限公司 Household appliance control method, mobile terminal and computer readable storage medium
CN115933874A (en) * 2022-11-23 2023-04-07 深圳市江元智造科技有限公司 Intelligent sliding control method and system based on face control and storage medium
CN115933874B (en) * 2022-11-23 2023-08-29 深圳市江元智造科技有限公司 Intelligent sliding control method, system and storage medium based on face control

Also Published As

Publication number Publication date
CN107885415A (en) 2018-04-06

Similar Documents

Publication Publication Date Title
AU2020201096B2 (en) Quick screen splitting method, apparatus, and electronic device, display UI, and storage medium
US11128802B2 (en) Photographing method and mobile terminal
US11054988B2 (en) Graphical user interface display method and electronic device
WO2018049812A1 (en) Split-screen display method and device, and terminal
US20170272659A1 (en) Apparatus and method for positioning image area using image sensor location
WO2016206201A1 (en) Mobile terminal, and display control method and apparatus
CN106937045B (en) Display method of preview image, terminal equipment and computer storage medium
CN111182205B (en) Photographing method, electronic device, and medium
WO2017097097A1 (en) Touch control method, user equipment, input processing method, mobile terminal and intelligent terminal
WO2018059552A1 (en) Screen display control method, device and mobile terminal, and computer storage medium
CN107124508B (en) Position adjusting method and device of suspension control, terminal and readable storage medium
WO2022048633A1 (en) Display method and apparatus and electronic device
WO2017161904A1 (en) Method and device for displaying wallpaper image
WO2017185459A1 (en) Method and apparatus for moving icons
CN107172347B (en) Photographing method and terminal
CN111479054A (en) Apparatus and method for processing image in device
US10095384B2 (en) Method of receiving user input by detecting movement of user and apparatus therefor
WO2022179331A1 (en) Photographing method and apparatus, mobile terminal, and storage medium
US20180152622A1 (en) Mobile terminal-based photographing method and mobile terminal
WO2023025060A1 (en) Interface display adaptation processing method and apparatus, and electronic device
WO2017054142A1 (en) Video data acquisition method, apparatus and system, and computer readable storage medium
CN105278947A (en) Interface element configuration method and apparatus
WO2023083089A1 (en) Photographing control display method and apparatus, and electronic device and medium
WO2017088694A1 (en) Gesture calibration method and apparatus, gesture input processing method and computer storage medium
CN112911147A (en) Display control method, display control device and electronic equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17855002

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17855002

Country of ref document: EP

Kind code of ref document: A1