CN105590015B - Hum pattern hot spot acquisition method, treating method and apparatus and hot point system - Google Patents

Hum pattern hot spot acquisition method, treating method and apparatus and hot point system Download PDF

Info

Publication number
CN105590015B
CN105590015B CN201410575157.7A CN201410575157A CN105590015B CN 105590015 B CN105590015 B CN 105590015B CN 201410575157 A CN201410575157 A CN 201410575157A CN 105590015 B CN105590015 B CN 105590015B
Authority
CN
China
Prior art keywords
information
user
hot spot
hum pattern
according
Prior art date
Application number
CN201410575157.7A
Other languages
Chinese (zh)
Other versions
CN105590015A (en
Inventor
陆音
Original Assignee
中国电信股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中国电信股份有限公司 filed Critical 中国电信股份有限公司
Priority to CN201410575157.7A priority Critical patent/CN105590015B/en
Publication of CN105590015A publication Critical patent/CN105590015A/en
Application granted granted Critical
Publication of CN105590015B publication Critical patent/CN105590015B/en

Links

Abstract

The present invention proposes a kind of hum pattern hot spot acquisition method, treating method and apparatus and hot point system, is related to field of human-computer interaction.Wherein, a kind of hum pattern hot spot acquisition method includes: to obtain user's sight focus information;Probability distribution information of user's sight focus in hum pattern viewport is obtained according to user's sight focus information;The hum pattern for acquiring hum pattern viewport shows information, hum pattern translation position and zoom ratio information including viewport;Sending probability distributed intelligence and hum pattern show information.By such method, user can be known to the interested region of hum pattern and zoom ratio by the use of user.Send such information to the analysis foundation for the hot spot region that server is browsed as user, to more targetedly show each region of hum pattern in the screen of mobile terminal, the two dimensional navigation that user browses hum pattern is operated and is simplified, region and the zoom ratio for recommending display for user, promote hum pattern viewing experience.

Description

Hum pattern hot spot acquisition method, treating method and apparatus and hot point system

Technical field

The present invention relates to field of human-computer interaction, especially a kind of hum pattern hot spot acquisition method, treating method and apparatus and Hot point system.

Background technique

With the extreme enrichment of internet information and content, hum pattern (Infographics) is with abstract, succinct art Picture and text form, it is biggish to improve audient to the reading efficiency of internet content, gradually become the information of media and netizen's favor Ways of presentation.But when it is applied in mobile media, since hum pattern lacks unified format and frame, key content exists Distributing position is different in picture, it is difficult to quickly, orderly position key content, be not easy to Fast Reading, so user often feels It has no way of doing it;In addition, due to mobile device screen resolution limitations, and hum pattern size is generally large, user needs in browsing Picture is scaled/translated repeatedly, and operation is lengthy and tedious, and man-machine interaction experience is poor, thus limits it in the application of mobile terminal.Due to The quick consumptive characteristics of family mutual inconvenience and hum pattern content, user are often reluctant in the manual browsing side of hum pattern More interaction costs are paid in face, but direct closing information figure may be selected not to browse.

Summary of the invention

It is an object of the present invention to solve the problems, such as that it is lengthy and tedious that hum pattern operates in a mobile device.

According to an aspect of the present invention, a kind of hum pattern hot spot acquisition method is provided, comprising: obtain user's sight focus Information, wherein sight focus information is the screen area information that user's visual focus is located at;It is obtained according to user's sight focus information Take probability distribution information of the family sight focus in hum pattern viewport;The hum pattern for acquiring hum pattern viewport shows information, In, hum pattern shows that information includes hum pattern translation position and the zoom ratio information of viewport;Sending probability distributed intelligence and letter Breath figure shows information.

Further, sight focus information further includes the range information of user's eye and screen.

It further, further include that screen is divided into several regions, the quantity in region dynamic at a distance from eye with screen Adjustment, and it is negatively correlated at a distance from screen and eye.

Further, obtain user's sight focus information include: by front camera obtain user's face image, to Family face-image is identified, the facial fiducial position of the bridge of the nose and two restrictions is obtained;Terminal device posture is obtained, in conjunction with face Base position determines relative position and the rotation angle of eye and screen;It prompts user to click four angles of screen, obtains user's note When four angles of screen curtain, eyelid, eyeball, pupil and the white position of eyeball, as sight base position;It is continuously shot user's eye Portion, the change in size of analysis eyelid, eyeball, pupil and the pixel grey scale difference of the white part of eyeball and affiliated pixel coverage, obtains eye Portion's motion vector;According to eye motion vector sum sight base position, user's sight focus information is obtained.

Further, further includes: the hot spot region information and navigation information of hum pattern are obtained from server, wherein hot spot Area information be user's sight focus concentrate region location information, hot spot region at least one, navigation information is hot spot The zoom ratio information in region;Hum pattern is shown according to navigation information.

Further, the hot spot region fragment of hum pattern is shown according to navigation information, user can select the hot spot of display The fragment in region.

Further, navigation information further includes display order and the duration of hot spot region.

Further, hum pattern is according to hot spot region information and navigation information auto-translating and scaling.

By such method, it can know that user is emerging to which region more loading of hum pattern by user use Interest, and user can be obtained and browse the zoom ratio used when hum pattern.Server is sent such information to as information The analysis foundation of figure hot spot region, to more targetedly show each area of hum pattern in the screen of mobile terminal The two dimensional navigation operation (such as translate, scale) that user browses hum pattern is simplified, recommends region and the contracting of display for user by domain Ratio is put, to promote hum pattern viewing experience.

According to another aspect of the present invention, a kind of hum pattern hot spot processing method is also provided, comprising: obtain from client general Rate distributed intelligence and hum pattern show information, wherein probability distribution information is that user's sight focus is general in hum pattern viewport Rate distributed intelligence, hum pattern show that the hum pattern that information is viewport translates position and zoom ratio information;Count the general of multi-user Rate distributed intelligence and hum pattern show information, obtain hot spot region information according to probability distribution information, are shown and believed according to hum pattern Breath obtains navigation information, wherein hot spot region information is the location information for the hum pattern that user's sight focus is concentrated, hot spot region At least one, navigation information is the zoom ratio information of hot spot region;Send hot spot region information and navigation information.

Further, hum pattern is divided into several block of pixels, counts each block of pixels region according to probability distribution information Probability distribution;Hot spot region is as unit of block of pixels.

Further, if the cumulative probability distribution of block of pixels reaches predetermined value, for hot spot region;Or, cumulative probability by The block of pixels for arriving small preceding predetermined quantity greatly is hot spot region.

Further, navigation information further includes the display order of hot spot region, and display order is general according to different pixels block The acquisition order of rate distributed intelligence obtains.

Further, navigation information further includes the display duration of hot spot region, and the duration is according to the general of block of pixels Rate distribution size is distributed according to predetermined value, or according to the acquisition time interval of the probability distribution information of different pixels block according to predetermined Value distribution.

By such method, can according to multi-user for hum pattern emphasis browsing area and zoom ratio for letter The concerned degree in each region of breath figure is counted, so as to obtain hum pattern hot spot region and hot spot region display Ratio.Mobile terminal can more targetedly show the hot spot region of hum pattern in screen, and user is browsed hum pattern Navigation operate simplify, for user recommend display region and zoom ratio, to promote hum pattern viewing experience.

In accordance with a further aspect of the present invention, it is also proposed that a kind of hum pattern hot spot acquisition device, comprising: sight focus obtains mould Block, for obtaining user's sight focus information, wherein sight focus information is the screen area letter that user's visual focus is located at Breath;Probability analysis module, for obtaining probability of user's sight focus in hum pattern viewport according to user's sight focus information Distributed intelligence;Data obtaining module, the hum pattern for acquiring hum pattern viewport show information, wherein hum pattern shows information Hum pattern translation position and zoom ratio information including viewport;Sending module is used for sending probability distributed intelligence and hum pattern Show information.

Further, sight focus information further includes the range information of user's eye and screen.

It further, further include screen division module, for screen to be divided into several regions, the quantity in region is with screen It is adjusted with dynamic at a distance from eye, and negatively correlated at a distance from screen and eye.

Further, it includes: facial calibration unit that sight focus, which obtains module, for obtaining user's face image, opposite Portion's image carries out the facial fiducial position that identification obtains the bridge of the nose and two restrictions;Equipment posture calibration unit, for obtaining terminal Equipment posture determines relative position and the rotation angle of eye and screen in conjunction with facial base position;Eye calibration unit is used Four angles of screen are clicked in prompt user, obtain user when watching four angles of screen attentively, eyelid, eyeball, pupil and the white position of eyeball It sets, as sight base position;Eye motion detection unit analyzes eyelid, eyeball, pupil for being continuously shot user's eye With the pixel grey scale difference of the white part of eyeball and the change in size of affiliated pixel coverage, eye motion vector is obtained;Retina transplantation list Member, for obtaining user's sight focus information according to eye motion vector sum sight base position.

Further, further includes: hot spot obtains module, for obtaining the hot spot region information of hum pattern from server and leading Boat information, wherein hot spot region information is the location information in the region that user's sight focus is concentrated, hot spot region at least one A, navigation information is the zoom ratio information of hot spot region;Hot spot display module, for showing hum pattern according to navigation information.

Further, hot spot display module is for showing the hot spot region fragment of hum pattern according to navigation information, user It can select the hot spot region fragment of display.

Further, navigation information further includes display order and the duration of hot spot region.

Further, hot spot display module is used for according to hot spot region information and navigation information auto-translating and scalability information Figure.

Device in this way can know that user is emerging to which region more loading of hum pattern by the use of user Interest, and user can be obtained and browse the zoom ratio used when hum pattern.Server is sent such information to as user The analysis foundation of the hot spot region of browsing, to more targetedly show each of hum pattern in the screen of mobile terminal Region simplifies the two dimensional navigation operation (such as translate, scale) that user browses hum pattern, for user recommend the region of display with Zoom ratio, thus significant increase hum pattern viewing experience.

According to another aspect of the invention, it is also proposed that a kind of hum pattern hot spot processing unit, comprising: data obtaining module, For showing information from the distributed intelligence of client acquisition probability and hum pattern, wherein probability distribution information is user's sight focus Probability distribution information in hum pattern viewport, hum pattern show that information is that hum pattern translates position and zoom ratio information;Heat Point analysis module, probability distribution information and hum pattern for counting multi-user show information, are obtained according to probability distribution information Hot spot region information shows acquisition of information navigation information according to hum pattern, wherein hot spot region information is user's sight focus collection In region location information, hot spot region at least one, navigation information be hot spot region zoom ratio information;Hot spot hair Module is sent, for sending hot spot region information and navigation information.

Further, hum pattern is divided into several block of pixels, and analysis of central issue module counts every according to probability distribution information The probability distribution in a block of pixels region, hot spot region is as unit of block of pixels.

Further, if the cumulative probability distribution of block of pixels reaches predetermined value, for hot spot region;Or, cumulative probability by The block of pixels for arriving small preceding predetermined quantity greatly is hot spot region.

Further, navigation information further includes the display order of hot spot region, and display order is general according to different pixels block The acquisition order of rate distributed intelligence obtains.

Further, navigation information further includes the display duration of hot spot region, and the duration is according to the general of block of pixels Rate size is distributed according to predetermined value, or is distributed according to the acquisition interval of the probability distribution information of different pixels block according to predetermined value.

Device in this way, can according to multi-user for hum pattern emphasis browsing area and zoom ratio for letter The concerned degree in each region of breath figure is counted, so as to obtain hum pattern hot spot region and hot spot region display Ratio.Mobile terminal can more targetedly show the hot spot region of hum pattern in screen, and user is browsed hum pattern Navigation operate simplify, for user recommend display region and zoom ratio, to promote hum pattern viewing experience.

In addition, according to another aspect of the invention, proposing a kind of hum pattern hot point system, including previously mentioned any one Kind hum pattern hot spot acquisition device and any one hum pattern hot spot processing unit.

System in this way can know that user is emerging to which region more loading of hum pattern by the use of user Interest, and user can be obtained and browse the zoom ratio used when hum pattern;It can be according to multi-user for the emphasis of hum pattern Browsing area and zoom ratio count the concerned degree in each region of hum pattern, to obtain the hot spot of hum pattern The display ratio in region and hot spot region.Mobile terminal can targetedly show the hot spot region of hum pattern in screen, The navigation that user browses hum pattern is operated and is simplified, recommends region and the zoom ratio of display for user, so that significant increase is believed Cease figure viewing experience.

Detailed description of the invention

The drawings described herein are used to provide a further understanding of the present invention, constitutes part of this application, this hair Bright illustrative embodiments and their description are used to explain the present invention, and are not constituted improper limitations of the present invention.In the accompanying drawings:

Fig. 1 is the flow chart of one embodiment of hum pattern hot spot acquisition method of the invention.

Fig. 2 is the stream that user's sight focus information is obtained in one embodiment of hum pattern hot spot acquisition method of the invention Cheng Tu.

Fig. 3 is the schematic diagram of one embodiment of hum pattern hot spot processing method of the invention.

Fig. 4 is the schematic diagram of one embodiment of hum pattern hot spot acquisition device of the invention.

Fig. 5 is the schematic diagram of another embodiment of hum pattern hot spot acquisition device of the invention.

Fig. 6 is the schematic diagram of one embodiment of hum pattern processing unit of the invention.

Fig. 7 is the schematic diagram of one embodiment of hum pattern hot point system of the invention.

Fig. 8 is the information exchange figure of one embodiment of hum pattern hot point system of the invention.

Specific embodiment

Below by drawings and examples, technical scheme of the present invention will be described in further detail.

The flow chart of one embodiment of hum pattern hot spot acquisition method of the invention is as shown in Figure 1.

In a step 101, the facial information that user is shot by the front camera of mobile terminal, passes through the processing of information User's sight focus information is obtained, user's sight focus information includes user's sight focus position on the screen or coordinate letter Breath can also include the eye of user and the range information of screen.

In a step 102, probability of user's sight focus in hum pattern viewport is obtained according to user's sight focus information Distributed intelligence.

In step 103, translation position and the zoom ratio information of the hum pattern of hum pattern viewport are acquired.

At step 104, the hum pattern obtained in the probability distribution information and step 103 obtained in sending step 102 is aobvious Show information.

By such method, user can be known to hum pattern according to the visual focus of user by the use of user Which region it is interested, and the zoom ratio that uses when user browses hum pattern can be obtained.These information are sent out It is sent to analysis foundation of the server as hum pattern hot spot region, to targetedly show letter in the screen of mobile terminal The two dimensional navigation operation (such as translate, scale) that user browses hum pattern is simplified, is recommended for user aobvious by each region for ceasing figure The region shown and zoom ratio, thus significant increase hum pattern viewing experience.

In one embodiment, the screen of user can be divided into several regions, and the number in region can be with the eye of user Portion is inversely proportional at a distance from screen.Screen divide region quantity can with the eye of user and the distance change of screen dynamic Adjustment.When user's eye is close to screen, fine division is done;When user's eye apart from screen farther out when, do coarseness division.Point The sight focus probability in each region is not counted, to obtain the probability distribution information in hum pattern viewport.Side in this way Formula can carry out the information processing of adaptability according to user's eye at a distance from screen, meet apart from it is remote when be able to carry out heat While point acquisition, the precision of information collection can be improved when apart from close.

In one embodiment, the change in location according to eye apart from screen and its affiliated pixel coverage size of eye, sentence The relative distance in disconnected screen and human eye portion is far and near, and according to its distance, screen area is divided into 2 by transverse and longitudinalm x 2n A identification region, wherein m, n are integer, and 1≤m≤16,1≤n≤16, the value of m, n are dynamic with screen and facial relative position State adjustment, that is, the granularity of On-Screen Identification region division is adjusted with the accuracy of identification of eye motion vector;Eye each section is moved The long adduction of the mould of vector is got up, and is then averaged, the average value is bigger, then m, n value are bigger;For eye motion vector It is more clear to identify, then On-Screen Identification region division must be thinner.By such method, can judge screen and human eye portion away from From, and regular dynamic adjustment is carried out to screen granularity of division according to the Pixel Information in human eye portion, meet apart from it is remote when energy While enough carrying out hot spot acquisition, the precision of information collection can be improved when apart from close.

In one embodiment, the process for obtaining user's sight focus can be as shown in Figure 2.

In step 201, user's face image is obtained by front camera, user's face image is identified, is obtained Take the bridge of the nose and two facial fiducial positions limited.

In step 202, it obtains terminal device posture and determines the opposite position of eye and screen in conjunction with facial base position It sets and rotation angle.

In step 203, prompt user clicks four angles of screen, when acquisition user watches four angles of screen attentively, eyelid, eye Ball, pupil and the white position of eyeball, as sight base position.

In step 204, it is continuously shot user's eye, analysis eyelid, eyeball, pupil and the pixel grey scale of the white part of eyeball are poor The different change in size with affiliated pixel coverage, obtains eye motion vector;

In step 205, according to eye motion vector sum sight base position, user's sight focus information is obtained.

By such method, the front camera for being able to use mobile terminal obtains the opposite shape of user and mobile terminal State, so that analysis obtains the sight focus information of user, the basis as analysis user's sight focus and hum pattern hot spot region.

In one embodiment, on the basis of On-Screen Identification region division, in conjunction with eye motion vector and sight benchmark position Confidence breath assigns a probability value, the probability Estimation as active user's visual focus region for each On-Screen Identification region. For the probability assignment Gaussian distributed in each On-Screen Identification region.The visual focus probability distribution of each identification region is as primary The result of coarseness line-of-sight detection.By such method, probability distribution information can be made regular, reduces the fortune of terminal device Calculation amount.

In one embodiment, mobile terminal obtains the hot spot region information and navigation information of hum pattern from server, and It is targetedly shown according to hot spot region information of the navigation information to hum pattern.Hot spot region information is according to multi-user The location information in region that is counted of sight focus information, navigation information includes the zoom ratio of each hot spot region Information.By such method, mobile terminal is able to use the zoom ratio in navigation information and shows hot spot region, to save The amplification of user, reduction operation, it is user-friendly.

In one embodiment, hot spot region information is shown that user passes through a little in the form of hum pattern fragment respectively The mode hit or slided selects hot spot region to be shown, the sliding positioning operation of hum pattern is replaced with this, facilitates user Use.

In one embodiment, navigation information further includes that the sight of user concentrates on the order of each hot spot region and continues Temporal information.Hot spot region is shown with such navigation information, it can be according to order and duration to hum pattern Auto-translating and scaling are carried out, each hot spot region of hum pattern is shown in a manner of broadcasting, thus remove the operation of user from, into One step is convenient for the user to use.User can also carry out artificial intervention in use, skip or be maintained at hum pattern The display state of some hot spot region, browsing mode are more flexible.

The schematic diagram of one embodiment of hum pattern hot spot processing method of the invention is as shown in Figure 3.

In step 301, server obtains probability distribution letter of user's sight focus in hum pattern viewport from client Breath and hum pattern show information, and hum pattern shows that information includes translation position and the zoom ratio information of hum pattern.

In step 302, the probability distribution information of server statistics multi-user and hum pattern show information, statistical information figure The probability distribution of each region, the big region of probability are hot spot region, and counting user browses scaling when hot spot region Rate information is as navigation information.It in one embodiment, can be by way of setting predetermined value after obtaining probability distribution Select hot spot region, that is, the region that probability value is greater than predetermined value is hot spot region;It can also be by setting hot spot region number The mode of amount obtains hot spot region, the probability distribution of block of pixels is sorted from large to small, the block of pixels of preceding predetermined quantity is Hot spot region.

In step 303, the hot spot region information and navigation information that server will acquire are sent to mobile terminal.

By such method, can according to multiple users for hum pattern emphasis browsing area and zoom ratio for The concerned degree in each region of hum pattern is counted, so as to obtain the hot spot region of hum pattern and showing for hot spot region Show ratio.Mobile terminal can more targetedly show the hot spot region of hum pattern in screen, and user is browsed information The navigation of figure, which operates, to be simplified, and recommends region and the zoom ratio of display for user, to promote hum pattern viewing experience.

In one embodiment, hum pattern is divided into several block of pixels by server, and server is in counting user sight When focus information as unit of block of pixels, the probability value positioned at the same block of pixels region adds up, and obtains the block of pixels area The probability value in domain, and then obtain the probability distribution of whole hum pattern.The block of pixels or adjacent several that probability distribution is concentrated Block of pixels is as the same hot spot region.By such method, it can be controlled by way of dividing right quantity block of pixels Operand processed, so as to be adjusted according to the actual situation;It also can be in the certain continuous of hum pattern in addition, dividing block of pixels Region carries out artificial intervention, prevents same text section or message segment to be divided into multiple regions, influences user's awareness information It is comprehensive.

In one embodiment, hum pattern is divided into a 32x32 picture of S (transverse direction) x T (longitudinal direction) according to its Pixel Dimensions Plain block;Then according to client show viewport information, by all On-Screen Identification regions map to this hum pattern division it On;Then on the basis of identical division scale, probability distribution corresponding to each On-Screen Identification region is added.Finally, believing The biggish region of probability value is the hot spot region of user's browsing on breath figure.It by such method, can be by dividing pixel The mode of block controls operand, so as to shorten the operation time of server, can provide hot zone faster for client Domain information and navigation information.

In one embodiment, the sequence that the sight focus information of hum pattern different zones is obtained according to server, obtains Browsing sequence of the user for different hot spot regions, and a part as navigation information.It by such method, can be according to The generally browsing sequence of user is the browsing sequence that user recommends hot spot region, facilitates the browsing of user.

In one embodiment, the time interval of the sight focus information of hum pattern different zones is obtained according to server, User is obtained for the browsing duration of different hot spot regions, and a part as navigation information.Each hot spot in navigation information The browsing duration in region can also be allocated according to block of pixels probability distribution size according to predetermined value, be the big hot zone of probability Longer browsing duration is distributed in domain.By such method, hot spot can be automatically translated or switched at a certain time interval Region facilitates the browsing of user.

The schematic diagram of one embodiment of hum pattern hot spot acquisition device of the invention is as shown in Figure 4.401 be sight focus Module is obtained, for obtaining user's sight focus information.Sight focus obtains user's sight focus letter that module 401 will acquire Breath is sent to probability analysis module 402, and probability analysis module 402 obtains user's sight focus according to user's sight focus information and exists Probability distribution information in hum pattern viewport, and it is sent to sending module 404;It is burnt that data obtaining module 403 obtains user's sight The hum pattern of the corresponding viewport of point shows information, including hum pattern translation position and zoom ratio information, is sent to sending module 404;The probability distribution information and hum pattern that sending module 404 will acquire show that information is sent to server.

Such device can know that user is interested in which region of hum pattern by the use of user, and And user can be obtained and browse the zoom ratio used when hum pattern.Send such information to what server was browsed as user The analysis foundation of hot spot region, so that each region of hum pattern is more targetedly shown in the screen of mobile terminal, The two dimensional navigation operation (such as translate, scale) that user browses hum pattern is simplified, recommends region and the scaling of display for user Ratio, thus significant increase hum pattern viewing experience.

The schematic diagram of another embodiment of hum pattern hot spot acquisition device of the invention is as shown in Figure 5.501 is burnt for sight Point obtains module, include for obtaining user's sight focus information, in user's sight focus information user's eye and screen away from From information.The range information that sight focus obtains module 501 and will acquire is sent to screen division module 505, and screen divides mould Screen is divided into several regions at a distance from screen according to user's eye by block 505, and the number in region can be with the eye of user Portion is inversely proportional at a distance from screen.Screen divide region quantity can with the eye of user and the distance change of screen dynamic Adjustment.When user's eye is close to screen, fine division is done;When user's eye apart from screen farther out when, do coarseness division.Depending on Line focus obtains module and sends probability analysis module 502 for user's sight focus information, and probability analysis module 502 is according to user Sight focus information obtains probability distribution information of user's sight focus in hum pattern viewport, and is sent to sending module 504; Data obtaining module 503 obtain user's sight focus correspond to viewport hum pattern show information, including hum pattern translation position with Scaling information is sent to sending module 504;The probability distribution information and hum pattern that sending module 504 will acquire show letter Breath is sent to server.

Device in this way can carry out the information processing of adaptability according to user's eye at a distance from screen, full Foot apart from it is remote when be able to carry out hot spot acquisition while, can be improved the precision of information collection when apart from close.

In one embodiment, sight focus acquisition module may include:

Facial calibration unit, shoots user's face by equipment front camera, carries out image recognition for face, obtains The bridge of the nose and two composition facial fiducial positions, facial fiducial position can for bridge of the nose line segment and two between line composition ten Word location;Equipment posture calibration unit obtains terminal device posture in conjunction with facial base position and determines eye and device screen Relative position and rotation angle, terminal device posture can be used three axis compass acquisition;Eye calibration unit, passes through client It prompts user to click the mode at four angles of screen, shoots user's eye, when user watches four angles of screen attentively, eyelid, eyeball, pupil Hole and the white position of eyeball are as sight base position;Eye motion detection unit is continuously shot user by front camera Eye, using image processing motion detection technique, the pixel grey scale difference for the parts such as analysis eyelid, eyeball, pupil, eyeball are white and institute The change in size for belonging to pixel coverage, obtains the change in location of each section motion vector and eye apart from screen;Retina transplantation list Member is obtained according to the sight base position that the eye motion vector sum eye calibration unit that eye motion detection unit obtains obtains Take family sight focus information.

Device in this way, the front camera for being able to use mobile terminal obtain the opposite shape of user and mobile terminal State, so that analysis obtains the sight focus information of user, the basis as analysis user's sight focus and hum pattern hot spot region.

The schematic diagram of one embodiment of hum pattern hot spot processing unit of the invention is as shown in Figure 6.601 be acquisition of information Module shows that information, probability segment information are that user's sight focus is being believed from the distributed intelligence of client acquisition probability and hum pattern The probability distribution information in figure viewport is ceased, hum pattern shows that information is that hum pattern translates position and zoom ratio information, information obtain Probability distribution information and hum pattern are shown that information is sent to analysis of central issue module 602 by modulus block 601;Analysis of central issue module 602 The probability distribution information and hum pattern for counting multiple users show information, obtain hot spot region information according to probability distribution information, Acquisition of information navigation information is shown according to hum pattern, and hot spot region information and navigation information are sent to hot spot sending module 603; Hot spot sending module 603 sends hot spot region information and navigation information to client.

Analysis of central issue module 602 can select hot zone by way of setting predetermined value after obtaining probability distribution Domain, that is, the region that probability value is greater than predetermined value is hot spot region;Can also by way of setting hot spot region quantity come Hot spot region is obtained, the probability distribution of block of pixels is sorted from large to small, the block of pixels of preceding predetermined quantity is hot spot region.

Such device can know that user is interested in which region of hum pattern by the use of user, and User can be obtained and browse the zoom ratio used when hum pattern.Server is sent such information to as hum pattern hot zone The analysis foundation in domain, so that each region of hum pattern is more targetedly shown in the screen of mobile terminal, by user The two dimensional navigation operation (such as translate, scale) for browsing hum pattern simplifies, and recommends region and the zoom ratio of display for user, from And promote hum pattern viewing experience.

In one embodiment, hum pattern is divided into several block of pixels by server, and server is in counting user sight When focus information as unit of block of pixels, the probability value positioned at the same block of pixels region adds up, and obtains the pixel region Probability value, and then obtain the probability distribution of whole hum pattern.The block of pixels or adjacent several pictures that probability distribution is concentrated Plain block is as the same hot spot region.Such device can control operation by way of dividing right quantity block of pixels Amount, so as to be adjusted according to the actual situation;In addition, divide block of pixels also can certain continuums of hum pattern into The intervention that pedestrian is prevents same text section or message segment to be divided into multiple regions, influences the comprehensive of user's awareness information.

In one embodiment, the sequence that the sight focus information of hum pattern different zones is obtained according to server, obtains Browsing sequence of the user for different hot spot regions, and a part as navigation information.Device in this way, can be according to The generally browsing sequence of user is the browsing sequence that user recommends hot spot region, facilitates the browsing of user.

In one embodiment, the time interval of the sight focus information of hum pattern different zones is obtained according to server, User is obtained for the browsing duration of different hot spot regions, and a part as navigation information.Each hot spot in navigation information The browsing duration in region can also be allocated according to block of pixels probability distribution size according to predetermined value, be the big hot zone of probability Longer browsing duration is distributed in domain.Device in this way can automatically translate at a certain time interval or switch hot spot Region facilitates the browsing of user.

The schematic diagram of one embodiment of hum pattern hot point system of the invention is as shown in Figure 7.70 adopt for hum pattern hot spot Acquisition means, 71 be hum pattern hot spot processing unit.In hum pattern hot spot acquisition device 70,701 obtain module for sight focus, 702 be probability analysis module, and 703 be data obtaining module, and 704 be sending module, the working method of these modules and Fig. 4 institute The hum pattern hot spot acquisition device shown is identical.In hum pattern hot spot processing unit 71,711 be data obtaining module, and 712 be hot spot Analysis module, 713 be hot spot sending module, the working method of these modules and hum pattern hot spot processing unit shown in fig. 6 It is identical.Probability distribution information and hum pattern are shown that information is sent to letter by the sending module 704 of hum pattern hot spot acquisition device 70 Cease the data obtaining module 711 in figure hot spot processing unit 71;Hum pattern hot spot processing unit 71 is converged by the information of multi-user After summation processing, hot spot region information and navigation information are formed, the acquisition of hum pattern hot spot is sent to by hot spot sending module 713 Device 70.Hum pattern hot spot acquisition device 70 further includes that hot spot obtains module 705 and hot spot display module 706.Hot spot obtains mould Block 705 obtains the hot spot region information and navigation information that hot spot sending module 713 is sent;Hot spot display module 706 is according to navigation Information shows the hot spot region of hum pattern.

System in this way can know that user is emerging to which region more loading of hum pattern by the use of user Interest, and user can be obtained and browse the zoom ratio used when hum pattern;It can be according to multi-user for the emphasis of hum pattern Browsing area and zoom ratio count the concerned degree in each region of hum pattern, so as to obtain hum pattern The display ratio of hot spot region and hot spot region.Mobile terminal can targetedly show the hot zone of hum pattern in screen The navigation that user browses hum pattern is operated and is simplified by domain, recommends region and the zoom ratio of display for user, thus significant increase Hum pattern viewing experience.

In one embodiment, hum pattern hot spot processing unit 71 is believed according to the sight focus for obtaining hum pattern different zones The sequence of breath obtains user for the browsing sequence of different hot spot regions, and a part as navigation information;Hum pattern hot spot The hot spot display module 706 of acquisition device 70 shows the heat of hum pattern according to browsing sequence and zoom ratio according to navigation information Point region.System in this way can be the browsing sequence that user recommends hot spot region according to the generally browsing sequence of user, Facilitate the browsing of user;User selects hot spot region to be shown by way of clicking or sliding, and replaces whole picture with this The slide of hum pattern, is convenient for the user to use.

In one embodiment, hum pattern hot spot processing unit 71 is believed according to the sight focus for obtaining hum pattern different zones The time interval of breath obtains user for the browsing duration of different hot spot regions, and a part as navigation information.Hum pattern The hot spot display module 706 of hot spot acquisition device 70 shows information according to navigation information, according to corresponding duration and zoom ratio The hot spot region of figure.System in this way can carry out auto-translating and scaling to hum pattern according to order and duration, Each hot spot region of hum pattern is shown in a manner of broadcasting, to remove the operation of user from, further facilitates the use of user. User can also carry out artificial intervention in use, skip or be maintained at the display shape of some hot spot region of hum pattern State, browsing mode are more flexible.

The information exchange figure of one embodiment of hum pattern hot point system of the invention is as shown in Figure 8.Mobile terminal A passes through The sight information of human eye is analyzed and counted, sight statistical information is obtained and is sent to server end.Sight statistical information packet It includes probability distribution information and hum pattern of user's sight on hum pattern and shows information.Server summarizes the sight system of multiple users Information is counted, is handled, obtains hot spot region information and navigation information, storage is in the database.Mobile terminal B is obtained from server Hot spot region information and navigation information are taken, so as to simplify the browse operation mode of hum pattern, user is browsed into hum pattern The one-dimensional linear navigation that two dimensional navigation operation (such as translate, scale) is reduced to similar Web hyperlink operate (such as previous step, under One step etc.), by mobile device client automatically according to server end hot spot region information, for the hot spot region currently to be browsed Auto-translating, scaling are carried out, so that significant increase hum pattern viewing experience, is convenient for the user to use.

Finally it should be noted that: the above embodiments are merely illustrative of the technical scheme of the present invention and are not intended to be limiting thereof;To the greatest extent The present invention is described in detail with reference to preferred embodiments for pipe, it should be understood by those ordinary skilled in the art that: still It can modify to a specific embodiment of the invention or some technical features can be equivalently replaced;Without departing from this hair The spirit of bright technical solution should all cover within the scope of the technical scheme claimed by the invention.

Claims (15)

1. a kind of hum pattern hot spot acquisition method characterized by comprising
Obtain user's sight focus information, wherein the sight focus information is the screen area letter that user's visual focus is located at Breath, comprising:
User's face image is obtained by front camera, the user's face image is identified, obtains the bridge of the nose and two The facial fiducial position of restriction;
Terminal device posture is obtained, in conjunction with the facial fiducial position, determines relative position and the rotation angle of eye and screen;
It prompts user to click four angles of screen, obtains user when watching four angles of screen attentively, eyelid, eyeball, pupil and the white position of eyeball It sets, as sight base position;
It is continuously shot user's eye, analysis eyelid, eyeball, pupil and the pixel grey scale difference of the white part of eyeball and affiliated pixel coverage Change in size, obtain eye motion vector;
According to sight base position described in the eye motion vector sum, user's sight focus information is obtained;
Probability distribution information of user's sight focus in hum pattern viewport is obtained according to user's sight focus information;
The hum pattern for acquiring the hum pattern viewport shows information, wherein the hum pattern shows that information includes the hum pattern The hum pattern translation position of viewport and zoom ratio information;
It sends the probability distribution information and the hum pattern shows information.
2. the method according to claim 1, wherein the sight focus information further includes user's eye and screen Range information;
And/or
The method also includes being divided into several regions, the quantity in region dynamic at a distance from eye with screen for screen Adjustment, and it is negatively correlated at a distance from screen and eye.
3. the method according to claim 1, wherein further include:
The hot spot region information and navigation information of the hum pattern are obtained from server, wherein the hot spot region information is to use Family sight focus concentrate region location information, hot spot region at least one, the navigation information be the hot spot region Zoom ratio information;
The hum pattern is shown according to the navigation information.
4. according to the method described in claim 3, it is characterized in that, according to the navigation information by the hot zone of the hum pattern Domain fragment shows that user can select the fragment of the hot spot region of display;And/or
The navigation information further includes display order and the duration of hot spot region, and the hum pattern is according to the hot spot region Information and the navigation information auto-translating and scaling.
5. a kind of hum pattern hot spot processing method, which is characterized in that
Information is shown from the distributed intelligence of client acquisition probability and hum pattern, wherein the probability distribution information is user's sight Probability distribution information of the focus in hum pattern viewport, the hum pattern show that the hum pattern that information is viewport translates position and contracting Put rate information, wherein the client obtains user's sight focus information by following operation:
User's face image is obtained by front camera, the user's face image is identified, obtains the bridge of the nose and two The facial fiducial position of restriction;
Terminal device posture is obtained, in conjunction with the facial fiducial position, determines relative position and the rotation angle of eye and screen;
It prompts user to click four angles of screen, obtains user when watching four angles of screen attentively, eyelid, eyeball, pupil and the white position of eyeball It sets, as sight base position;
It is continuously shot user's eye, analysis eyelid, eyeball, pupil and the pixel grey scale difference of the white part of eyeball and affiliated pixel coverage Change in size, obtain eye motion vector;
According to sight base position described in the eye motion vector sum, user's sight focus information is obtained;
The probability distribution information and the hum pattern for counting multi-user show information, are obtained according to the probability distribution information Hot spot region information shows acquisition of information navigation information according to the hum pattern, wherein the hot spot region information is user's view Line focus concentrate the hum pattern location information, hot spot region at least one, the navigation information be the hot zone The zoom ratio information in domain;
Send the hot spot region information and the navigation information.
6. according to the method described in claim 5, it is characterized in that, the hum pattern is divided into several block of pixels, according to institute State the probability distribution that probability distribution information counts the block of pixels region;The hot spot region is as unit of the block of pixels;
Or
If the cumulative probability distribution of the block of pixels reaches predetermined value, for the hot spot region;Or, the cumulative probability is by big The block of pixels to small preceding predetermined quantity is the hot spot region.
7. according to the method described in claim 6, it is characterized in that, the navigation information further includes the display time of hot spot region Sequence, the display order are obtained according to the acquisition order of the probability distribution information of the different block of pixels;Or
The navigation information further includes the display duration of hot spot region, and the duration is according to the probability of the block of pixels Distribution size is distributed according to predetermined value, or according to the acquisition interval of the probability distribution informations of the different block of pixels according to pre- Definite value distribution.
8. a kind of hum pattern hot spot acquisition device characterized by comprising
Sight focus obtains module, for obtaining user's sight focus information, wherein the sight focus information is user's vision The screen area information that focus is located at, comprising:
Facial calibration unit identifies the face-image for obtaining user's face image, obtains the bridge of the nose and two limits Fixed facial fiducial position;
Equipment posture calibration unit, in conjunction with the facial fiducial position, determines eye and screen for obtaining terminal device posture Relative position and rotation angle;
Eye calibration unit, for prompting user to click four angles of screen, when acquisition user watches four angles of screen attentively, eyelid, eye Ball, pupil and the white position of eyeball, as sight base position;
Eye motion detection unit, for being continuously shot user's eye, the pixel of analysis eyelid, eyeball, pupil and the white part of eyeball The change in size of gray difference and affiliated pixel coverage obtains eye motion vector;
Retina transplantation unit is used for the sight base position according to the eye motion vector sum, obtains user's sight Focus information;
Probability analysis module, for obtaining user's sight focus in hum pattern viewport according to user's sight focus information Probability distribution information;
Data obtaining module, the hum pattern for acquiring the hum pattern viewport show information, wherein the hum pattern display letter Breath includes hum pattern translation position and the zoom ratio information of the hum pattern viewport;
Sending module shows information for sending the probability distribution information and the hum pattern.
9. device according to claim 8, which is characterized in that the sight focus information further includes user's eye and screen Range information;
Or
The hum pattern hot spot acquisition device further includes screen division module, for screen to be divided into several regions, the area With screen, the dynamic at a distance from eye adjusts the quantity in domain, and negatively correlated at a distance from screen and eye.
10. device according to claim 8, which is characterized in that further include:
Hot spot obtains module, for obtaining the hot spot region information and navigation information of the hum pattern from server, wherein described Hot spot region information is the location information in the region that user's sight focus is concentrated, hot spot region at least one, the navigation is believed Breath is the zoom ratio information of the hot spot region;
Hot spot display module, for showing the hum pattern according to the navigation information.
11. device according to claim 10, which is characterized in that the hot spot display module is used to be believed according to the navigation The hot spot region fragment of the hum pattern is shown that user can select the hot spot region fragment of display by breath;Or
The navigation information further includes display order and the duration of hot spot region, and the hot spot display module is used for according to institute It states hot spot region information and the navigation information auto-translating and scales the hum pattern.
12. a kind of hum pattern hot spot processing unit characterized by comprising
Data obtaining module, for showing information from the distributed intelligence of client acquisition probability and hum pattern, wherein the probability point Cloth information is probability distribution information of user's sight focus in hum pattern viewport, and the hum pattern shows that information is flat for hum pattern Pan position and zoom ratio information, wherein the client obtains user's sight focus information by following operation:
User's face image is obtained by front camera, the user's face image is identified, obtains the bridge of the nose and two The facial fiducial position of restriction;
Terminal device posture is obtained, in conjunction with the facial fiducial position, determines relative position and the rotation angle of eye and screen;
It prompts user to click four angles of screen, obtains user when watching four angles of screen attentively, eyelid, eyeball, pupil and the white position of eyeball It sets, as sight base position;
It is continuously shot user's eye, analysis eyelid, eyeball, pupil and the pixel grey scale difference of the white part of eyeball and affiliated pixel coverage Change in size, obtain eye motion vector;
According to sight base position described in the eye motion vector sum, user's sight focus information is obtained;
Analysis of central issue module, the probability distribution information and the hum pattern for counting multi-user show information, according to institute It states probability distribution information and obtains hot spot region information, acquisition of information navigation information is shown according to the hum pattern, wherein the heat Point area information be user's sight focus concentrate region location information, hot spot region at least one, the navigation information For the zoom ratio information of the hot spot region;
Hot spot sending module, for sending the hot spot region information and the navigation information.
13. device according to claim 12, which is characterized in that the hum pattern is divided into several block of pixels, described Analysis of central issue module counts the probability distribution in the block of pixels region according to the probability distribution information, and the hot spot region is with institute Stating block of pixels is unit;
Or
If the cumulative probability distribution of the block of pixels reaches predetermined value, for the hot spot region;Or, the cumulative probability is by big The block of pixels to small preceding predetermined quantity is the hot spot region.
14. device according to claim 13, which is characterized in that the navigation information further includes the display time of hot spot region Sequence, the display order are obtained according to the acquisition order of the probability distribution information of the different block of pixels;Or
The navigation information further includes the display duration of hot spot region, and the duration is according to the probability of the block of pixels Size is distributed according to predetermined value, or according to the acquisition interval of the probability distribution informations of the different block of pixels according to predetermined value Distribution.
15. a kind of hum pattern hot point system, which is characterized in that adopted including any information figure hot spot described in claim 8~11 Acquisition means and any hum pattern hot spot processing unit of claim 12~14.
CN201410575157.7A 2014-10-24 2014-10-24 Hum pattern hot spot acquisition method, treating method and apparatus and hot point system CN105590015B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410575157.7A CN105590015B (en) 2014-10-24 2014-10-24 Hum pattern hot spot acquisition method, treating method and apparatus and hot point system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410575157.7A CN105590015B (en) 2014-10-24 2014-10-24 Hum pattern hot spot acquisition method, treating method and apparatus and hot point system

Publications (2)

Publication Number Publication Date
CN105590015A CN105590015A (en) 2016-05-18
CN105590015B true CN105590015B (en) 2019-05-03

Family

ID=55929593

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410575157.7A CN105590015B (en) 2014-10-24 2014-10-24 Hum pattern hot spot acquisition method, treating method and apparatus and hot point system

Country Status (1)

Country Link
CN (1) CN105590015B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106325517A (en) * 2016-08-29 2017-01-11 袁超 Target object trigger method and system and wearable equipment based on virtual reality
CN107277474B (en) * 2017-06-26 2019-06-25 深圳看到科技有限公司 Panorama generation method and generating means

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101840265A (en) * 2009-03-21 2010-09-22 深圳富泰宏精密工业有限公司;奇美通讯股份有限公司 Visual perception device and control method thereof
CN101866215A (en) * 2010-04-20 2010-10-20 复旦大学 Human-computer interaction device and method adopting eye tracking in video monitoring
CN102221881A (en) * 2011-05-20 2011-10-19 北京航空航天大学 Man-machine interaction method based on analysis of interest regions by bionic agent and vision tracking
CN102830797A (en) * 2012-07-26 2012-12-19 深圳先进技术研究院 Man-machine interaction method and system based on sight judgment

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7872635B2 (en) * 2003-05-15 2011-01-18 Optimetrics, Inc. Foveated display eye-tracking system and method
WO2012107892A2 (en) * 2011-02-09 2012-08-16 Primesense Ltd. Gaze detection in a 3d mapping environment
US20140092006A1 (en) * 2012-09-28 2014-04-03 Joshua Boelter Device and method for modifying rendering based on viewer focus area from eye tracking

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101840265A (en) * 2009-03-21 2010-09-22 深圳富泰宏精密工业有限公司;奇美通讯股份有限公司 Visual perception device and control method thereof
CN101866215A (en) * 2010-04-20 2010-10-20 复旦大学 Human-computer interaction device and method adopting eye tracking in video monitoring
CN102221881A (en) * 2011-05-20 2011-10-19 北京航空航天大学 Man-machine interaction method based on analysis of interest regions by bionic agent and vision tracking
CN102830797A (en) * 2012-07-26 2012-12-19 深圳先进技术研究院 Man-machine interaction method and system based on sight judgment

Also Published As

Publication number Publication date
CN105590015A (en) 2016-05-18

Similar Documents

Publication Publication Date Title
US9939914B2 (en) System and method for combining three-dimensional tracking with a three-dimensional display for a user interface
US9916519B2 (en) Intuitive computing methods and systems
US8401248B1 (en) Method and system for measuring emotional and attentional response to dynamic digital media content
US20040119662A1 (en) Arbitrary object tracking in augmented reality applications
CN106797460B (en) The reconstruction of 3 D video
US9651782B2 (en) Wearable tracking device
US9234744B2 (en) Sensor-based mobile search, related methods and systems
US20110244919A1 (en) Methods and Systems for Determining Image Processing Operations Relevant to Particular Imagery
JP2008092557A (en) Digitally augmented reality video system
US20120133754A1 (en) Gaze tracking system and method for controlling internet protocol tv at a distance
Rosten et al. Real-time video annotations for augmented reality
EP3382510A1 (en) Visibility improvement method based on eye tracking, machine-readable storage medium and electronic device
JP5454570B2 (en) Tracking target determination device, tracking target determination method, and tracking target determination program
CN102081918B (en) Video image display control method and video image display device
EP2634727B1 (en) Method and portable terminal for correcting gaze direction of user in image
WO2011158511A1 (en) Instruction input device, instruction input method, program, recording medium and integrated circuit
EP3105921A1 (en) Photo composition and position guidance in an imaging device
JP5863423B2 (en) Information processing apparatus, information processing method, and program
US20150234457A1 (en) System and method for content provision using gaze analysis
CA2398431A1 (en) Method for navigating in a multi-scale three-dimensional scene
US20170177197A1 (en) Object tracking in zoomed video
US20100111441A1 (en) Methods, components, arrangements, and computer program products for handling images
US10248218B2 (en) Systems and methods of direct pointing detection for interaction with a digital device
WO2014012488A1 (en) Method and device for implementing augmented reality
KR20160068830A (en) Eye tracking

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
GR01 Patent grant