CN107430441A - Method and apparatus for amplifying and/or protruding the object on screen - Google Patents

Method and apparatus for amplifying and/or protruding the object on screen Download PDF

Info

Publication number
CN107430441A
CN107430441A CN201680019576.XA CN201680019576A CN107430441A CN 107430441 A CN107430441 A CN 107430441A CN 201680019576 A CN201680019576 A CN 201680019576A CN 107430441 A CN107430441 A CN 107430441A
Authority
CN
China
Prior art keywords
focal zone
user
screen
sight
sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201680019576.XA
Other languages
Chinese (zh)
Inventor
安卢·佩斯拉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN107430441A publication Critical patent/CN107430441A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04806Zoom, i.e. interaction techniques or interactors for controlling the zooming operation

Abstract

The embodiment of the present invention discloses a kind of method and apparatus for amplifying and protruding the object on screen.The present invention provides a kind of device of the object shown with least one sensor, in amplification automatically and/or its prominent screen.Described device includes detecting the light intensity near the sight focal zone and described device at least one user for being absorbed in the screen based at least one Sensor Events from the sensor, and thus amplify automatically and/or protrude the sight focal zone, wherein described sight focal zone is the user to the present convergence region of the object shown on the screen, and the protrusion be based on described device near the light intensity.

Description

Method and apparatus for amplifying and/or protruding the object on screen
Technical field
Invention described herein theme relates in general to a kind of data handling system or computer including display screen System, and it more particularly relates to a kind of be used to object showing graphic user interface on a display screen, and For the display multiplication factor for showing the object of screen display to be automatically changed to system, the device of desired display multiplication factor And method.
Background technology
Nowadays almost everybody is generally using data handling system or computer system, such as mobile phone, comprising but it is unlimited In smart mobile phone, personal digital assistant (personal digital assistant, PDA) etc..These data handling systems or Computing system provides the figure screen of the object for showing the graphic user interface such as text-string and hyperlink, graphic button Curtain.These data handling systems or computing system are extremely advanced, and comprising various built-in sensors, for example, camera sensor plus Fast flowmeter sensor, touch sensor etc..
In addition to browsing the content using these data handling systems or computing system, also it is widely used in and is read Read, viewing video/animation/digital content.User can read its Email, document, e-book, view and image/picture, regard Figure presentation/figure, such as pie chart etc..
However, in reading/viewing, if the object/content shown on screen it is invisible for user's eyesight, compared with Small or if ambient light is improper (be not enough to be used for read/watch), user may need excessively to go reading/viewing with eye, So as to finally influence its eyesight.
In view of above limitation, prior art provides various schemes, wherein, when user is in any object of reading/viewing When, if it wants to be more clearly seen object, user must zoom in or out content manually.Therefore, to avoid user's eye Excessively, it is always necessary to manually intervene come magnified content so that its become apparent from/it is apparent.Equally, if ambient light is improper, this Asthenopia may be caused, to avoid this point, user must manually adjust the light of screen/display and/or further put Blob.
Therefore, subject matter existing for available/existing technologies for being provided is in the prior art:Readding for the convenience of the user Reading/viewing, it is necessary to intervene manually.
Accordingly, it is desirable to provide for the automation scheme of above-mentioned technical barrier, so that automatic amplification and prominent user are current The object of viewing/reading, and further reduce the eye tensity of user.
The content of the invention
It is to introduce and system, the method and apparatus for amplifying and protruding the object on screen to provide this content of the invention Related concept, is hereafter further described in a specific embodiment.This content of the invention is not intended to determine what is advocated The essential characteristic of theme, also it is not intended the scope for determining or limiting advocated theme.
One aspect of the present invention provides a kind of mechanism amplified and/or protrude the object on screen.
Another aspect of the present invention offer is a kind of to amplify and protrudes the mechanism of the object on screen based on sight focus.
Another aspect of the present invention offer is a kind of to be amplified based on sight focus and protrudes the automatic of the object on screen Change mechanism.
Another aspect of the present invention, which provides, a kind of amplified based on sight focus and protrudes object on screen, thus subtracts The automation mechanism of sense of fatigue during light reading/viewing object.
Another aspect of the present invention a kind of sight focus based on user is provided and/or amplified based on ambient light and The automation mechanism of object on prominent screen, sense of fatigue when thus mitigating reading/viewing object.
Therefore, in one embodiment, the present invention, which provides one kind, has at least one sensor, for amplifying automatically And/or the device of the object shown on its prominent screen.Described device is included based at least one biography from the sensor Sensor event and detect the light near the sight focal zone and described device at least one user for being absorbed in the screen Line strength, thus amplify automatically and/or protrude the sight focal zone, wherein the sight focal zone is the user couple The present convergence region of the object shown on the screen, and the protrusion be based on described device near the light Intensity.
In one embodiment, present invention offer is a kind of has at least one sensor, for amplifying automatically and/or dashing forward Go out on its screen the device of the object shown.Described device includes detection module, and it is being received from the sensor at least The sight focal zone that at least one user of the screen is absorbed in detection is immediately used for after one Sensor Events, and is examined The light intensity surveyed near described device.Described device also includes amplifying and prominent module, and it is used for based on detected mesh Light focal zone and amplify the sight focal zone;And/or the prominent sight is gathered based on detected light intensity Burnt region;Wherein described sight focal zone is the user to the present convergence area of the object shown on the screen Domain.
In one embodiment, the present invention provide it is a kind of as device perform be used to amplify automatically and/or it is prominent described in The method of the object shown on the screen of device.Methods described is included based at least one sensor thing from the sensor Part and detect the light intensity near the sight focal zone and described device at least one user for being absorbed in the screen, Thus amplification and/or the prominent sight focal zone automatically, wherein the sight focal zone is the user to the screen The present convergence region of the object shown on curtain, and the protrusion be based on described device near the light intensity.
In one embodiment, the present invention provide it is a kind of as device perform be used to amplify automatically and/or it is prominent described in The method of the object shown on the screen of device.Methods described includes:
● using detection module, detection is special at once after at least one Sensor Events from the sensor are received Note the light intensity near the sight focal zone of at least one user of the screen and described device;
● the sight focal zone is amplified based on detected sight focal zone using amplifying and protruding module; And
● protrude the sight focal zone using amplifying and protruding module based on detected light intensity;
● wherein, the sight focal zone is the user to the present convergence of the object shown on the screen Region.
The present invention provides the technical scheme for solving technical barrier to be busy with the specific crowd of document and e-book daily.Institute State scheme and also palliated the agonizing sufferings for many other people such as the elderlys of reading of daily early morning newspaper, or read and appoint in equipment for those Feel that the people to tire out palliate the agonizing sufferings during what document.
In one embodiment, the present invention can make user's life become letter by providing with feature in a device Peripheral region single, that the feature can catch the sight focus of user and protrusion and amplification user are currently absorbed in when reading.
In one embodiment, the present invention improves the Consumer's Experience of the reading documents on smart phone, and such a reading is The extremely common operation completed in daily life for many different activities, for example read news article, blog, e-book Etc..
In one embodiment, user needs to make equipment be closer to its eyes to obtain the definite of its object being absorbed in Focal zone, so as to reach following effect:
A) appearing in the definite focal zone of the object under the focal zone of user will be scaled to obtain more fine definition.
B) the same definite focal zone of object will depend on ambient light intensity and be protruded.
Brief description of the drawings
Embodiment is described with reference to the drawings.In the accompanying drawings, the leftmost numeral of Ref. No. represents the ginseng Numbering is examined in the figure first to occur.Through schema same characteristic features and component are referred to using same numbers.
Fig. 1 shows the device of embodiment according to the inventive subject matter, and it has at least one sensor, for putting automatically The object shown on big and/or prominent screen.
Fig. 2 shows being shielded by what device performed for amplifying automatically and/or protruding for embodiment according to the inventive subject matter The method of the object shown on curtain.
Fig. 3 and Fig. 4 shows the general overview of the invention of embodiment according to the inventive subject matter.
It should be understood that accompanying drawing is to illustrate idea of the invention, and may not be drawn to scale.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly retouched State.Obviously, described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.Based in the present invention Embodiment, all other embodiment that those of ordinary skill in the art are obtained under the premise of creative work is not made, Belong to the scope of protection of the invention.
The present invention can be implemented in many ways, including be embodied as process, device, system, composition of matter, computer-readable The computer-readable mediums such as storage medium, or the computer network that wherein programmed instruction is sent via optics or electronic communication link Network.In this manual, any other form that these embodiments or the present invention can take is referred to alternatively as technology.General In the case of, order the step of disclosed process can be adjusted within the scope of the invention.
Below along with the accompanying drawing of the principle of the explanation present invention come together that one or more embodiments of the invention is described in detail. The present invention combines such embodiment to be described, but the invention is not restricted to any embodiment.The scope of the present invention is only weighed The limitation of sharp claim, and the present invention covers many alternatives, modification and equivalent.In the following description, many spies are illustrated Details is determined to provide thorough understanding of the present invention.These details are in order at citing purpose and provided, and can not have these In the case of some or all of specific detail the present invention is put into practice according to claims.For clarity purposes, it is not right Known technologic material is described in detail in technical field related to the present invention, to prevent unnecessarily obscuring the present invention.
Open amplification and the method and apparatus of the object on prominent screen.
Although the described each side for being used to amplify and protrude the object on screen can be with any number of different calculating System, environment and/or configuration are implemented, but embodiment is described in the situation of following exemplary systems, devices and methods.
In one embodiment, the present invention a kind of sight focus based on user is provided and/or based on ambient light and The automation mechanism of amplification and object on prominent screen, sense of fatigue when thus mitigating reading/viewing object.
The needs to the present invention can be explained well by some active user situations, and this may pole for domestic consumer To be useful.Some use cases are recorded below for explanation.However, it should be noted that active user situation merely for understanding purpose and There is provided, and be not construed as limiting the scope of the present invention.
Use case 1:
Stella enjoys a lot to write blog, also like read blog, but she daily it is very busy, therefore only at dead of night when The thing of read-write blog can just be done.Therefore, she is absorbed in text and brings very big burden to eyes, and she must amplify manually With the text for the very little that decreases font size.
According to the present invention, if Stella shifts near mobile phone the eyes of oneself, then any text that she is seeing can be certainly It is dynamic to protrude, and screen scales around the text, and this will make her have more preferable reading experience.Even if outside is without electricity Power, text reading can still become extremely comfortable, because it will not make your eyes be involved.
Use case 2:
This scheme provided in the present invention is to carrying out some research work, daily read greatly being needed for these work The student or people for measuring article are extremely helpful.
For example, Smith carries out a certain research project, and he must read many articles daily, and article must allow more He must read night and day.Each screen reading causes enormous pressure, and also reduces his efficiency.At night, if Periphery also can become even more to act hurriedly in a messy situation without enough light, reading documents.And more preferably looked into when he must scale screen manually When seeing content, he must keep dragging screen manually to check full content.
Therefore, using the present invention, he can continue to be read in the normal fashion, and the present invention helps him with much better Effective means reading content without bringing many pressure to personal brains.
Use case 3:
The aging crowd or elder that this scheme can read newspaper to ordinary practice are helpful, because write in newspaper Word is typically too small for them.
The present invention will have any problem to reading small font, so that the people of these words of indigestion are helpful.
Case used above is a few examples with this scheme.Also many other situations can with adopting said method with User's life is allowed to become convenient.
In one embodiment, user needs to make equipment be closer to its eyes to obtain the definite of its object being absorbed in Focal zone, so as to reach following effect:
A) appearing in the definite focal zone of the object under the focal zone of user will be scaled to obtain more fine definition.
B) the same definite focal zone of object will depend on ambient light intensity and be protruded.
In one embodiment, the present invention detection user sight focus to know the present convergence region on screen, And ambient light intensity is also detected to be correspondingly that user amplifies and protruded text.
In one embodiment, the present invention enables a device to obtain Sensor Events to detect current gaze focus and week Enclose light intensity.In an example, if the equipment is to be based on Android operation system, Android can be received by the equipment Sensor Events.When user makes equipment be closer to its eyes, equipment needs to continue to obtain the Sensor Events in Android service.
In one embodiment, can using for amplify/scale and/or prominent option as in equipment setting page can Configuration item is supplied to user.
In one embodiment, closely used when the equipment such as Android system (operating system) receive equipment from user During the particular sensor event at family, action mentioned below can be provided a user:
A) if fair prominent features, equipment should protrude the focusing text compatible with ambient light to user.
B) its also scale it is described focusing text so that text become apparent from for user it is visible.
In one embodiment, as the very close user of device screen, camera sensor catches sight focus and will This event is sent to user by focal zone coordinate.Camera sensor (3D sensors) can be used for the light of identification peripheral region Intensity, this will tell how e-Pointer protrudes text so that user sees more clearly.Therefore, it is strong in acquisition focal zone and light After degree, present invention scaling and/or prominent (if any one option of these options is by fair use) are currently in the focal zone of user Text in domain.
In one embodiment, the present invention is to be based on and available eyeball tracking technology is formed pair in the prior art The amplification based on data of ratio and protrusion.
In one embodiment, when following the trail of eyeball movement, the present invention labeled as starting point and connects the first frame position The position for catching next frame.Each frame point is connected to create line spline structure, its direction that will be provided user and check.If counted The next pixel calculated exceedes threshold, then terminates the line in this place and since new pixel.If next pixel position Put and exceed the threshold value, it means the line terminates in this place, and should be since new line.
In one embodiment, the system that these line values are issued to equipment, to protrude and scale the part.This hair Bright feature can be added to configuration item, and use can be permitted when any need.
In one embodiment, surrounding environment may depend on to the projecting degree of text/image or any mime types Light intensity.Light intensity can capture from camera sensor.Depending on ambient light, certain limit can be provided a user, User can set prominent be worth in this scope.Depending on ambient light, prominent ratio is by difference.
In one embodiment, setting can be provided in equipment setting, user can set user by the setting The ratio of object amplification for focusing on it on said device is wanted according to usage comfort.
In one embodiment, the size based on equipment, the amplification may be different.For with larger screen size Equipment, the magnification ratio may be bigger, must be become apparent from so as to show.
In one embodiment, the present invention provides a kind of amplification based on mime types, and any application program can basis Its purposes and customize this amplification.
Referring now to Fig. 1, Fig. 1 show embodiment according to the inventive subject matter have at least one sensor, for from The device of the object shown in dynamic amplification and/or prominent screen.
Although embodiment is thought of as into device 100 to explain the present invention, it is to be understood that device 100 can also be in a variety of meters Implement in calculation system, such as laptop computer, desktop computer, notebook, work station, mainframe computer, server, network Server etc..It should be understood that device 100 can be set by multiple users by one or more user/electronics of hereinafter referred to as user Standby (not showing) or the application program resided on user equipment access.The example of device 100 and user equipment can include, but not It is limited to, portable computer, personal digital assistant, handheld device and work station.User equipment by network by correspondence It is coupled to device 100.
In one embodiment, network can be wireless network, cable network or its combination.Network can be embodied as inhomogeneity One kind in the network of type, such as intranet, LAN (local area network, LAN), wide area network (wide Area network, WAN), internet etc..Network can be dedicated network or shared network.Shared network representation uses a variety of Agreement associates with the different types of network that communicates with one another, the agreement such as HTTP (Hypertext Transfer Protocol, HTTP), transmission control protocol/Internet protocol (Transmission Control Protocol/Internet Protocol, TCP/IP), WAP (Wireless Application Protocol, WAP) etc..In addition, network can include multiple network equipment, set comprising router, bridge, server, calculating Standby, storage device etc..
In one embodiment, device 100 can include at least one processor 102, input/output (input/output, I/O) interface 104, at least one sensor 106, and memory 108.At least one processor 102 can be embodied as one Or multi-microprocessor, microcomputer, microcontroller, digital signal processor, central processing unit, state machine, logic circuit, And/or based on operational order come any equipment of control signal.Except other abilities, at least one processor 102 is especially For extracting and performing the computer-readable instruction that may be stored in modular form in memory 108.
I/O interfaces 104 can include various software and hardware interface, for example, web interface, graphic user interface etc..I/O Interface 104 can allow device 100 directly or through users/customers' end equipment and user mutual.In addition, I/O interfaces 104 can make Device 100 can be with other computing device communications such as Web server and Outside data services device (not showing).I/O interfaces 104 can Promote a variety of communications in extensive multiple network and protocol type, the network and protocol type include:Cable network, such as LAN, cable etc.;And wireless network, such as WLAN, cellular network or satellite.I/O interfaces 104 can include be used for will be multiple Equipment is connected to each other or is connected to one or more ports of another server.
Memory 108 can include known any computer-readable medium in art, comprising for example:Volatile storage Device, such as static RAM (static random access memory, SRAM) and dynamic random access memory Device (dynamic random access memory, DRAM);And/or nonvolatile memory, such as read-only storage (read Only memory, ROM), erasable programmable ROM, flash memory, hard disk, CD and tape.Memory 108 can include Module 110 and database (not showing).
Module 110 includes routine, program, object, component, data structure etc., and it performs particular task or implements specific take out Image data type.In one embodiment, module 110 can include detection module 112, amplification and prominent module 114.Other moulds Block (not showing) can include the application of supplementary device 100 and program or the coded command of function.
In one embodiment, present invention offer is a kind of has at least one sensor, for amplifying automatically and/or dashing forward Go out on its screen the device of the object shown.Described device is included based at least one Sensor Events from the sensor And the light intensity near the sight focal zone and described device at least one user for being absorbed in the screen is detected, by This automatic amplification and/or the prominent sight focal zone, wherein the sight focal zone is the user to the screen The present convergence region of the object of upper display, and the protrusion be based on described device near the light intensity.
In one embodiment, present invention offer is a kind of has at least one sensor, for amplifying automatically and/or dashing forward Go out on its screen the device of the object shown.Described device includes detection module, and the detection module comes from the biography receiving The sight that at least one user that the screen is absorbed in detection is immediately used for after at least one Sensor Events of sensor is gathered Burnt region, and detect the light intensity near described device.Described device also includes amplifying and prominent module, described to amplify and dash forward Go out module to be used to amplify the sight focal zone based on detected sight focal zone;And/or based on detected Light intensity and the prominent sight focal zone;Wherein described sight focal zone is the user to showing on the screen The present convergence region of the object shown.
In one embodiment, when the screen is away from user's preset distance, the present invention is automatic to be amplified and/or dashes forward Go out the user to the sight focal zone of the object shown on the screen, wherein the preset distance is by being attached At least one sensor to described device detects, and exactly, is detected by camera sensor.In one embodiment, institute The technical staff in category field can be used and can use in device it is understood that in order to determine the preset distance between screen and user Existing sensor in any sensor.
In one embodiment, it is preferred to ground is detected in focal zone coordinate form by means of at least one 3D sensors The sight focal zone.
In one embodiment, it is preferred to ground is by means of being attached at least one proximity transducer, definite of described device It is to detect the light intensity near described device by means of camera sensor that ground, which is said,.In one embodiment, it is affiliated Appointing in available existing sensor in device can be used it is understood that in order to determine light intensity in the technical staff in field What sensor.
In one embodiment, the present invention receives the focal zone coordinate at least one Sensor Events form With the light intensity data, thus amplify and/or protrude the sight focal zone, the sight focal zone is the use Family is to the present convergence region of the object shown on the screen.
In one embodiment, the sight focal zone is the user to the object that is shown on the screen Present convergence region, it is exaggerated and/or prominent.
In one embodiment, the present invention is used to receive Sensor Events when the screen is close to the user.
In one embodiment, the present invention provides at least one configurable item in setting options, wherein described match somebody with somebody Putting item is amplified in amplification (scaling) option of the sight focal zone or the protrusion option of the prominent sight focal zone At least one, or its any combinations.
In one embodiment, the prominent option includes the prominent value of the optionally a certain scope of the user.
In one embodiment, described amplification (scaling) option includes the amplification of the optionally a certain scope of the user (scaling) value.
In one embodiment, the sight focal zone is detected based at least two cable architectures, each structure has The starting point and end point obtained in the following manner:
● the eyeball based on the user for being absorbed in the screen is mobile and the first frame position is labeled as into starting point, and Next frame position that continues is caught, wherein first frame position and next frame position that continues include multiple frame point/pixels;
● the multiple frame point/pixel is connected to create the first cable architecture with the starting point, wherein described first Cable architecture provides the direction that the user is absorbed in the screen;
● check whether frame point/pixel exceedes threshold value, if it does, the frame point/pixel is labeled as into the First Line The end point of structure;
● described device is supplied to using first cable architecture as Sensor Events to amplify and/or protrude the mesh Light focal zone;And
● above step is repeated to obtain new cable architecture.
In one embodiment, the present invention provides mime type amplification and protruded.
Referring now to Fig. 2, Fig. 2 shows the side for being used to verify at least one user of embodiment according to the inventive subject matter Method.The methods described described in the overall context of computer executable instructions.Generally, computer executable instructions can include Routine, program, object, component, data structure, process, module, function etc., above-mentioned every execution specific function or implementation are specific Abstract data type.Methods described can also be put into practice in a distributed computing environment, wherein remote by being connected by communication network Journey processing equipment perform function.In a distributed computing environment, computer executable instructions can be located locally and remote computation In machine storage medium, memory storage device is included.
The order of description methods described does not have to be interpreted as limiting, and can combine any number of retouched in any order The square of method is stated to implement methods described or alternative method.In addition, the protection model of theme described herein can not departed from Single square is deleted in the case of enclosing from methods described.In addition, methods described can be in any suitable hardware, software, firmware Or implement in its combination.However, for ease of explaining, in the embodiment being described below, methods described can be considered as in above-mentioned dress Implement in putting 100.
In one embodiment, the present invention provide it is a kind of as device perform be used to amplify automatically and/or it is prominent described in The method of the object shown on the screen of device.Methods described is included based at least one sensor thing from the sensor Part and detect the light intensity near the sight focal zone and described device at least one user for being absorbed in the screen, Thus amplification and/or the prominent sight focal zone automatically, wherein the sight focal zone is the user to the screen The present convergence region of the object shown on curtain, and the protrusion be based on described device near the light intensity.
In one embodiment, the present invention provide it is a kind of as device perform be used to amplify automatically and/or it is prominent described in The method of the object shown on the screen of device.Methods described includes:
● using detection module, detection is special at once after at least one Sensor Events from the sensor are received Note the light intensity near the sight focal zone of at least one user of the screen and described device;
● the sight focal zone is amplified based on detected sight focal zone using amplifying and protruding module; And
● protrude the sight focal zone using amplifying and protruding module based on detected light intensity;
● wherein, the sight focal zone is the user to the present convergence of the object shown on the screen Region.
At square 202, received using detection module from the sensor being present in described device 100 extremely The sight focal zone of at least one user of the screen is absorbed in detection at once after few Sensor Events.
At square 204, received using detection module from the sensor being present in described device at least At once the light intensity near described device is detected after one Sensor Events.
At square 206, using described device amplification and prominent module based on detected sight focal zone come Amplify the sight focal zone.
At square 208, amplification and prominent module using described device are protruded based on detected light intensity The sight focal zone.
In one embodiment, the sight focal zone is the user to the object that is shown on the screen Present convergence region.
In one embodiment, methods described can further include detect between the screen and the user away from From if the distance detected is equal to or less than preset distance, automatic amplification and/or the prominent user are to the screen The sight focal zone of the object shown on curtain.
In one embodiment, methods described can further include preferably by means of at least one 3D sensors and/ Or camera sensor detects the sight focal zone in focal zone coordinate form.
In one embodiment, methods described can be received further in the described poly- of at least one Sensor Events form Burnt area coordinate and the light intensity data, thus amplify and/or protrude the sight focal zone, the sight focal zone Domain is the user to the present convergence region of the object shown on the screen.
In one embodiment, methods described can further receive sensor thing when the screen is close to the user Part.
In one embodiment, methods described further can be provided in the setting options of described device it is at least one can Configuration item, wherein the configurable item is the amplification option for amplifying the sight focal zone or the prominent sight focal zone At least one of protrusion option, or its any combinations.
In one embodiment, methods described can further include prominent option, and the prominent option includes the use The prominent value of the optionally a certain scope in family.
In one embodiment, methods described can further include amplification (scaling) option, amplification (scaling) choosing Item includes amplification (scaling) value of the optionally a certain scope of the user.
In one embodiment, methods described can further include:
● the sight focal zone is detected based at least two cable architectures, each cable architecture has to be obtained in the following manner The starting point and end point obtained:
● the eyeball based on the user for being absorbed in the screen is mobile and the first frame position is labeled as into starting point, and Next frame position that continues is detected, wherein first frame position and next frame position that continues include multiple frame point/pixels;
● the multiple frame point/pixel is connected to create the first cable architecture with the starting point, wherein described first Cable architecture provides the direction that the user is absorbed in the screen;
● check whether frame point/pixel exceedes threshold value, if it does, the frame point/pixel is labeled as into the First Line The end point of structure;
● described device is supplied to using first cable architecture as Sensor Events to amplify and/or protrude the mesh Light focal zone;And
● above step is repeated to obtain new cable architecture.
Fig. 3 and Fig. 4 shows the general overview of the invention of embodiment according to the inventive subject matter.
As shown in fig. 3, if user reads some on the display screen of equipment/device contains " ALICE ", " BOB " The content of the text of " MARK ", when user is reading certain content/be absorbed in " BOB ", user is but to read this specific Some are difficult during content, so according to the present invention, when user makes equipment/device closer to its eyes, this equipment is (wherein embedded Have the present invention) by this certain content of auto zoom.In addition, equipment/the device can also protrude this content.The protrusion and The scaling is can be by user optionally from the feature of setting option selection.
As demonstrated in Figure 4, there is provided the present invention being implemented in smart phone.Herein, user attempts to read mobile phone Screen on the content that shows, but some are difficult when it reads shown content.In order to avoid eyes are involved, user's examination Makes smart phone closer to its eyes.One detects this activity, and smart phone just tries to find user on screen really Cut sight focus, and the content that auto zoom/amplification is present in the definite focus that this is detected.Protruded if user is fair The features/options of content in the definite focus of its sight, the smart phone can detect light intensity nearby and correspondingly adjust The light intensity of smart phone.Amplification/scaling and/or the option of protrusion/is characterized in configurable and optional option/feature, its It can be provided in the setting page of smart phone.
In one embodiment, the present invention can be used for different situations and different objects.For understand purpose and under Text offer is wherein several, it should however be noted that not limit the scope of the invention with understanding, these example/situations.
If the application of the present invention is more text based application, then using this feature, user reads Text (the full line or a few rows) ratio that will be highlighted and be amplified to set by user.For example, if user is reading postal Part, row that user is read and is connected and is about to be protruded and amplified completely.
If any application program more uses image mime types, it may depend on user and scaling and prominent image be set. For example, if user checks any image from picture library, scalable described image is to provide more details.
If any application program is to be used to show figure, it may depend on user and the spy more clearly defined in figure be set Determine region or particular separation.For example, if user checks any pie chart, it only can protrude and scale the largest block in piecemeal And smallest blocks.
If using the application program based on excel, this feature can protrude specific collection/combination of cell and be put Greatly.
Exemplary embodiment discussed herein above can provide some advantages.Although the aspect for being not the practice present invention must Must, but these advantages can include:
1. the present invention provides good scheme to the people for feeling to tire out when keeping equipment very close to eyes.
2. the present invention is applied to myopia population and the elderly.
Although described with the language particularly for architectural feature and/or method for amplifying and protruding pair on screen The system of elephant, the embodiment of method and apparatus, it should be appreciated that appended claims are not necessarily limited to described special characteristic Or method.Exactly, special characteristic and method are as the system, method and dress for amplifying and protruding the object on screen The example for the embodiment put and disclose.

Claims (25)

1. a kind of device with least one sensor, for amplifying and/or protruding the object shown on its screen automatically, its It is characterised by, is used for:
At least one user for being absorbed in the screen is detected based at least one Sensor Events from the sensor Sight focal zone and described device near light intensity, thus amplification and/or the prominent sight focal zone automatically Domain, wherein the sight focal zone be the user to the present convergence region of the object shown on the screen, and The protrusion be based on described device near the light intensity.
2. a kind of device with least one sensor, for amplifying and/or protruding the object shown on its screen automatically, its It is characterised by, including:
Detection module, it is immediately used for after at least one Sensor Events from the sensor are received:
The sight focal zone of at least one user of the screen is absorbed in detection;
Detect the light intensity near described device;And
Amplification and prominent module, it is used for:
The sight focal zone is amplified based on detected sight focal zone;And/or
The prominent sight focal zone based on detected light intensity;Wherein described sight focal zone is the use Family is to the present convergence region of the object shown on the screen.
3. according to the device described in claim 1 and 2, it is characterised in that when the screen is away from user's preset distance, institute State device automatically amplification and/or the prominent user to the sight focal zone of the object shown on the screen, Wherein described preset distance is detected by least one sensor for being attached to described device, is preferably detected by camera sensor.
4. according to the device described in claim 1 and 2, it is characterised in that examined preferably by means of at least one 3D sensors Survey the sight focal zone in focal zone coordinate form.
5. according to the device described in claim 1 and 2, it is characterised in that the light intensity wherein near described device is excellent Selection of land detects by means of being attached at least one proximity transducer of described device, is exactly come by means of camera sensor Detection.
6. according to the device described in claim 4 and 5, it is characterised in that receive the institute at least one Sensor Events form Focal zone coordinate and the light intensity data are stated, thus amplifies and/or the prominent sight focal zone, the sight is gathered Burnt region is the user to the present convergence region of the object shown on the screen.
7. according to the device described in claim 1 and 2, it is characterised in that the sight focal zone is the user to described The present convergence region of the object shown on screen, it is exaggerated and/or protruded.
8. according to the device described in claim 1 and 2, it is characterised in that for being received when the screen is close to the user Sensor Events.
9. according to the device described in claim 1 and 2, it is characterised in that include at least one configurable item in setting options, Wherein described configurable item is amplification (scaling) option for amplifying the sight focal zone or the prominent sight focal zone At least one of protrusion option, or its any combinations.
10. device according to claim 9, it is characterised in that it is optionally a certain that the prominent option includes the user The prominent value of scope.
11. device according to claim 9, it is characterised in that it is optional that described amplification (scaling) option includes the user A certain scope amplification (scaling) value.
12. according to the device described in claim 1 and 2, it is characterised in that detect the sight based at least two cable architectures and gather Burnt region, each cable architecture have starting point and end point, and in order to detect the cable architecture, described device is used for:
Eyeball based on the user for being absorbed in the screen is mobile and the first frame position is labeled as into starting point, and under seizure One continues frame position, wherein first frame position and next frame position that continues include multiple frame point/pixels;
The multiple frame point/pixel is connected to create the first cable architecture with the starting point, wherein the First Line structure The direction that the user is absorbed in the screen is provided;
Check whether frame point/pixel exceedes threshold value, if it does, by the frame point/pixel labeled as first cable architecture End point;
Described device, which is supplied to, using first cable architecture as Sensor Events is focused on to amplify and/or protrude the sight Region;And
Above step is repeated to obtain new cable architecture.
13. according to the device described in claim 1 and 2, it is characterised in that provide mime type amplification and protrude.
14. a kind of method for being used to automatically amplify and/or protrude the object shown on the screen of described device performed by device, It is characterised in that it includes:
At least one user for being absorbed in the screen is detected based at least one Sensor Events from the sensor Sight focal zone and described device near light intensity, thus amplification and/or the prominent sight focal zone automatically Domain, wherein the sight focal zone be the user to the present convergence region of the object shown on the screen, and The protrusion be based on described device near the light intensity.
15. a kind of method for being used to automatically amplify and/or protrude the object shown on the screen of described device performed by device, It is characterised in that it includes:
Detected at once after at least one Sensor Events from the sensor are received using detection module:
It is absorbed in the sight focal zone of at least one user of the screen;With
Light intensity near described device;
The sight focal zone is amplified based on detected sight focal zone using amplifying and protruding module;And/or
The sight focal zone is protruded using amplifying and protruding module based on detected light intensity;
Wherein, the sight focal zone is the user to the present convergence region of the object shown on the screen.
16. according to the method described in claim 14 and 15, it is characterised in that including detecting between the screen and the user Distance, if the distance detected is equal to or less than preset distance, automatic amplification and/or the prominent user are to institute The sight focal zone of the object shown on screen is stated, wherein the preset distance is by being attached to described device extremely Few sensor detection, exactly, is detected by camera sensor.
17. according to the method described in claim 14 and 15, it is characterised in that including being sensed preferably by means of at least one 3D Device or camera sensor detect the sight focal zone in focal zone coordinate form.
18. according to the method described in claim 14 and 15, it is characterised in that including the light near detection described device Intensity, it is detected preferably by means of at least one proximity transducer for being attached to described device, and is exactly borrowed Help camera sensor to detect.
19. according to the method described in claim 14 and 15, it is characterised in that including receiving at least one Sensor Events The focal zone coordinate of form and the light intensity data, thus amplify and/or protrude the sight focal zone, institute It is the user to the present convergence region of the object shown on the screen to state sight focal zone.
20. according to the method described in claim 14 and 15, it is characterised in that connect when being included in the screen close to the user Receive Sensor Events.
21. according to the method described in claim 14 and 15, it is characterised in that be included in the setting options of described device and provide At least one configurable item, wherein the configurable item is amplification (scaling) option or protrusion for amplifying the sight focal zone At least one of protrusion option of the sight focal zone, or its any combinations.
22. according to the method for claim 21, it is characterised in that it is optionally a certain that the prominent option includes the user The prominent value of scope.
23. according to the method for claim 21, it is characterised in that it is optional that described amplification (scaling) option includes the user A certain scope amplification (scaling) value.
24. according to the method described in claim 14 and 15, it is characterised in that including based on described in the detection of at least two cable architectures Sight focal zone, each cable architecture have the starting point and end point obtained in the following manner:
Eyeball based on the user for being absorbed in the screen is mobile and the first frame position is labeled as into starting point, and under detection One continues frame position, wherein first frame position and next frame position that continues include multiple frame point/pixels;
The multiple frame point/pixel is connected to create the first cable architecture with the starting point, wherein the First Line structure The direction that the user is absorbed in the screen is provided;
Check whether frame point/pixel exceedes threshold value, if it does, by the frame point/pixel labeled as first cable architecture End point;
Described device, which is supplied to, using first cable architecture as Sensor Events is focused on to amplify and/or protrude the sight Region;And
Above step is repeated to obtain new cable architecture.
25. according to the method described in claim 14 and 15, it is characterised in that including providing mime type amplification and protruding.
CN201680019576.XA 2015-04-10 2016-03-25 Method and apparatus for amplifying and/or protruding the object on screen Pending CN107430441A (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
IN1890/CHE/2015 2015-04-10
IN1890CH2015 2015-04-10
PCT/CN2016/077401 WO2016161905A1 (en) 2015-04-10 2016-03-25 Method and apparatus for magnifying and/or highlighting objects on screens

Publications (1)

Publication Number Publication Date
CN107430441A true CN107430441A (en) 2017-12-01

Family

ID=57071717

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680019576.XA Pending CN107430441A (en) 2015-04-10 2016-03-25 Method and apparatus for amplifying and/or protruding the object on screen

Country Status (2)

Country Link
CN (1) CN107430441A (en)
WO (1) WO2016161905A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108491123A (en) * 2018-02-12 2018-09-04 维沃移动通信有限公司 A kind of adjusting application program image target method and mobile terminal
CN111506195A (en) * 2020-04-17 2020-08-07 南京巨鲨显示科技有限公司 Focal region highlighting system based on eyeball tracking equipment
CN112514373A (en) * 2018-08-14 2021-03-16 华为技术有限公司 Image processing apparatus and method for feature extraction

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109407831A (en) * 2018-09-28 2019-03-01 维沃移动通信有限公司 A kind of exchange method and terminal

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101893934A (en) * 2010-06-25 2010-11-24 宇龙计算机通信科技(深圳)有限公司 Method and device for intelligently adjusting screen display
CN102096757A (en) * 2010-09-08 2011-06-15 浙江大学 Regard point cluster data processing method based on time domain constraint
CN103019560A (en) * 2012-11-29 2013-04-03 中兴通讯股份有限公司 Method and device for controlling interface of mobile terminal and mobile terminal
CN103309451A (en) * 2013-06-20 2013-09-18 上海华勤通讯技术有限公司 Mobile terminal and display method thereof
CN103885589A (en) * 2014-03-06 2014-06-25 华为技术有限公司 Eye movement tracking method and device
CN103902179A (en) * 2012-12-28 2014-07-02 华为技术有限公司 Interaction method and device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI462648B (en) * 2012-08-06 2014-11-21 Wistron Corp Backlight driving circuit and backlight driving method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101893934A (en) * 2010-06-25 2010-11-24 宇龙计算机通信科技(深圳)有限公司 Method and device for intelligently adjusting screen display
CN102096757A (en) * 2010-09-08 2011-06-15 浙江大学 Regard point cluster data processing method based on time domain constraint
CN103019560A (en) * 2012-11-29 2013-04-03 中兴通讯股份有限公司 Method and device for controlling interface of mobile terminal and mobile terminal
CN103902179A (en) * 2012-12-28 2014-07-02 华为技术有限公司 Interaction method and device
CN103309451A (en) * 2013-06-20 2013-09-18 上海华勤通讯技术有限公司 Mobile terminal and display method thereof
CN103885589A (en) * 2014-03-06 2014-06-25 华为技术有限公司 Eye movement tracking method and device

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108491123A (en) * 2018-02-12 2018-09-04 维沃移动通信有限公司 A kind of adjusting application program image target method and mobile terminal
CN112514373A (en) * 2018-08-14 2021-03-16 华为技术有限公司 Image processing apparatus and method for feature extraction
CN112514373B (en) * 2018-08-14 2023-09-15 华为技术有限公司 Image processing apparatus and method for feature extraction
CN111506195A (en) * 2020-04-17 2020-08-07 南京巨鲨显示科技有限公司 Focal region highlighting system based on eyeball tracking equipment

Also Published As

Publication number Publication date
WO2016161905A1 (en) 2016-10-13

Similar Documents

Publication Publication Date Title
US11256919B2 (en) Method and device for terminal-based object recognition, electronic device
US20170142327A1 (en) Digital image capturing device system and method
EP3407216B1 (en) Method and device for displaying information resource, and computer readable storage medium
CN107430441A (en) Method and apparatus for amplifying and/or protruding the object on screen
US20120040717A1 (en) Mobile Data Gathering System and Method
JP5431552B1 (en) Information processing apparatus, information processing method, and computer program
US11425063B2 (en) Content selection
JP2019505911A (en) Method, system, user terminal and computer-readable storage medium for conducting PR activities for public opinion
CN111124564A (en) Method and device for displaying user interface
CN104408133A (en) Webpage link area thermodynamic diagram display method and device
CN104536566A (en) Page content processing method
WO2023083279A1 (en) Photographing method and apparatus
US10511813B1 (en) Systems, devices, and/or methods for logging writing activities
Xu et al. Touch saliency
US10484454B2 (en) Electronic device and method of providing digital photograph information
CN108170269A (en) A kind of image-scaling method and terminal
CN109948095A (en) Show method, apparatus, terminal and the storage medium of web page contents
US8712788B1 (en) Method of publicly displaying a person's relationship status
CN117666792A (en) Electronic form display method, electronic form display device, electronic equipment and readable storage medium
CN104571858A (en) Terminal
JP2015043118A (en) Information processing device, information processing system, information processing method, and program
Ward Language Socialization
Mccarthy Samsung is trolling Google over the notch on its new Pixel phone
KR101655172B1 (en) Device for counting visitors and visitor counting method using the device
Scates Exhibiting War: The Great War, Museums, and Memory in Britain, Canada and Australia

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20171201

RJ01 Rejection of invention patent application after publication