CN110456964A - A kind of adaptive chat bubble display methods, system, device and storage medium - Google Patents
A kind of adaptive chat bubble display methods, system, device and storage medium Download PDFInfo
- Publication number
- CN110456964A CN110456964A CN201910683018.9A CN201910683018A CN110456964A CN 110456964 A CN110456964 A CN 110456964A CN 201910683018 A CN201910683018 A CN 201910683018A CN 110456964 A CN110456964 A CN 110456964A
- Authority
- CN
- China
- Prior art keywords
- bubble
- picture
- target
- chat
- target area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 230000003044 adaptive effect Effects 0.000 title claims abstract description 29
- 210000005252 bulbus oculi Anatomy 0.000 claims abstract description 61
- 230000008569 process Effects 0.000 claims description 8
- 238000009877 rendering Methods 0.000 claims description 6
- 230000003321 amplification Effects 0.000 claims description 4
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 4
- 239000011800 void material Substances 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 abstract description 9
- 230000000007 visual effect Effects 0.000 abstract description 7
- 230000003993 interaction Effects 0.000 abstract description 6
- 235000013290 Sagittaria latifolia Nutrition 0.000 description 6
- 235000015246 common arrowhead Nutrition 0.000 description 6
- 238000004590 computer program Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000003466 anti-cipated effect Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 239000005338 frosted glass Substances 0.000 description 1
- 238000003709 image segmentation Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 239000000700 radioactive tracer Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
- G06V10/235—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition based on user input or interaction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G06V10/267—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion by performing operations on regions, e.g. growing, shrinking or watersheds
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/52—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail for supporting social networking services
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computing Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a kind of adaptive chat bubble display methods, system, device and storage mediums, the method includes obtaining the picture containing at least one chat bubble, execute eyeball tracking, and the chat bubble watched attentively is chosen to be target bubble, intercept out target area in the picture, and the display target area and etc..When there is multiple users speech simultaneously, multiple chat bubbles will occur on picture.The target bubble that user is watched attentively is obtained by using eyeball tracking technology, and the target bubble region is separated from entire picture, individually show the target bubble region, realize the visual effect to the target bubble " to feature ", target bubble is avoided to be overshadowed in chat bubble that is multiple while occurring, information needed for alloing user's timely learning, to improve the interactivity of the interaction tools such as chatroom or virtual auditorium.The present invention is widely used in Internet technical field.
Description
Technical field
The present invention relates to Internet technical field, especially a kind of adaptive chat bubble display methods, system, device
And storage medium.
Background technique
The interaction tools such as Internet chatroom and the virtual auditorium risen recently are used for by computer technology generation
Represent the virtual figure image of respective user.Referring to Fig.1, when in the text that user will be made a speech by terminal device input
Hold, then show a chat bubble near the corresponding virtual figure image of the user, so that the word content that will be made a speech is aobvious
It shows and, realize the interaction between different user.
Chat bubble is called chat balloon, dialog box and chat box etc., and the advantage is that can clearly indicate each visual human
The speech content of figure image, but disadvantage of the prior art is that, it, will be simultaneously on screen when multiple users make a speech simultaneously
It shows multiple chat bubbles, may overlap, cause between each bubble of chatting, between chat bubble and virtual figure image
The readable of bubble of chatting reduces, and the interactivity of content shown by entire screen also declines therewith.Especially special
When paying close attention to the speech of a certain user, the chat bubble of the user is easy to be overshadowed in chat bubble that is multiple while occurring, from
And it is unable to learn in time required information.
Summary of the invention
In order to solve the above-mentioned technical problem, the purpose of the present invention is to provide a kind of adaptive chat bubble display sides
Method, system, device and storage medium.
On the one hand, the embodiment of the present invention includes a kind of adaptive chat bubble display methods, comprising the following steps:
Obtain the picture containing at least one chat bubble；The picture also contains at least one virtual figure image, respectively
Chat bubble chat content for rendering；
Eyeball tracking is executed, and the chat bubble watched attentively is chosen to be target bubble；
Target area is intercepted out in the picture；Some or all of described target bubble is included in the target area
In domain；
Show the target area.
Further, the execution eyeball tracking, and the chat bubble watched attentively is chosen to be this step of target bubble
Suddenly, it specifically includes:
Eyeball tracking is carried out to user, so that it is determined that the sight focus of user；
It, will be with the sight focus weight when the sight focus is overlapped with any chat bubble in the picture
The chat bubble of conjunction is chosen to be target bubble；
It, will be burnt with the sight when the sight focus is overlapped with any virtual figure image in the picture
The virtual figure image that point is overlapped is chosen to be destination virtual figure image, and occurs being directed toward the destination virtual personage detecting
When the chat bubble of image, which is chosen to be the target bubble.
Further, the execution eyeball tracking, and the chat bubble watched attentively is chosen to be this step of target bubble
Suddenly, it specifically includes:
Eyeball tracking is carried out to user, so that it is determined that the sight focus of user；
When detecting there are multiple sight focuses on the picture, multiple sight focus positions are calculated
Geometric center；
It, will be with the geometric center weight when the geometric center is overlapped with any chat bubble in the picture
The chat bubble of conjunction is chosen to be target bubble.
Further, it described the step for intercepting out target area in the picture, specifically includes:
Determine destination virtual figure image pointed by the target bubble；
Generate interception frame；
Adjusted on the picture it is described interception frame size and location, until the target bubble a part or whole part with
And described figural a part or whole part of destination virtual is included in the interception frame；
The part being included in the interception frame in the picture is extracted as the target area.
Further, described the step for intercepting out target area in the picture, specifically further include:
The target area is divided into foreground part and background parts；The foreground part is by the target bubble
Part composed by a part or whole part and the figural a part or whole part of the destination virtual, the background parts are described
Other parts in target area in addition to the foreground part；
Fuzzy processing is carried out to the background parts.
Further, it the step for the display target area, specifically includes:
The target area is amplified to size identical with the picture；
The amplification process of target area described in Dynamically Announce；
It is continuously display to pass through the amplified target area.
Further, the adaptive chat bubble display methods is further comprising the steps of:
After the amplified target area is continuously displayed and reaches preset duration, terminate to the target area
The display in domain；
Restore to show the picture.
On the other hand, the embodiment of the invention also includes a kind of adaptive chat bubble display systems, comprising:
Picture obtains module, for obtaining the picture containing at least one chat bubble；The picture also contains at least one
A virtual figure image, each chat bubble chat content for rendering；
Eyeball tracking module is chosen to be target bubble for executing eyeball tracking, and by the chat bubble watched attentively；
Region interception module, for intercepting out target area in the picture；Some or all of described target bubble
It is included in the target area；
Region display module, for showing the target area.
On the other hand, the embodiment of the invention also includes a kind of adaptive chat bubble display devices, including memory, place
Device, eyeball tracking device and display are managed, for the memory for storing at least one program, the processor is described for loading
For at least one program to execute the method for the embodiment of the present invention, the eyeball tracking device is described aobvious for executing eyeball tracking
Show device for showing the picture and/or the target area.
On the other hand, the embodiment of the invention also includes a kind of storage mediums, wherein it is stored with the executable instruction of processor,
The executable instruction of the processor is used to execute the method for the present invention when executed by the processor.
The beneficial effects of the present invention are: multiple chat bubbles will occur on picture when there is multiple users speech simultaneously.It is logical
It crosses and obtains the target bubble watched attentively of user using eyeball tracking technology, and by the target bubble region from entire picture
On separate, individually show the target bubble region, realize the visual effect to the target bubble " to feature ", keep away
Exempt from target bubble to be overshadowed in chat bubble that is multiple while occurring, information needed for alloing user's timely learning, thus
Improve the interactivity of the interaction tools such as chatroom or virtual auditorium.
Detailed description of the invention
Fig. 1 is the display interface schematic diagram of network interdynamic tool；
Fig. 2 is the flow chart of chat bubble display methods adaptive described in the embodiment of the present invention；
Fig. 3 is the schematic illustration for carrying out eyeball tracking in the embodiment of the present invention to a user；
Fig. 4 is the schematic illustration that in the embodiment of the present invention two users are carried out with eyeball tracking；
Fig. 5 is the schematic diagram that frame is intercepted described in the embodiment of the present invention；
Fig. 6 is the effect picture for amplifying target area in the embodiment of the present invention；
Fig. 7 is the effect picture that the background parts of Fig. 6 are carried out with Fuzzy processing；
Fig. 8 is the structural block diagram of chat bubble display system adaptive described in the embodiment of the present invention.
Specific embodiment
The present embodiment includes a kind of adaptive chat bubble display methods, referring to Fig. 2, comprising the following steps:
S1. the picture containing at least one chat bubble is obtained；The picture also contains at least one virtual figure image,
Each chat bubble chat content for rendering；
S2. eyeball tracking is executed, and the chat bubble watched attentively is chosen to be target bubble；
S3. target area is intercepted out in the picture；Some or all of described target bubble is included in the mesh
It marks in region；
S4. the target area is shown.
In the present embodiment, the adaptive chat bubble display methods is in the mobile phone of any user or tablet computer etc.
It is realized in terminal.The media such as the terminal through internet are connect with server, on the server run chatroom or
The programs such as virtual auditorium, these Program Generatings contain at least one virtual figure image and containing at least one chat bubbles
Then these picture datas are transferred to terminal by picture, shown by terminal by display screen.
The virtual figure image refers to through computer program figure generated or animation, the virtual figure image
It can be used to represent a user, a terminal used by a user or one are used to simulate the robot journey of live user
Sequence.The virtual figure image can be humanoid cartoon character, is also possible to the cartoon character of toy shape, can also be and pass through
The computer graphical for being used to simulate true man that the modes such as artificial intelligence generate.
In step sl, the terminal through internet receives the picture that the server generates.The picture sheet
It is a frame in matter, when continuously receiving multiple pictures and continuously displaying these pictures, animation one can be showed in terminal
The result of broadcast of sample.
In step s 2, implement eyeball tracking technology, the eyeball of user is tracked, so as to know user
The position for being just look at or staring.When user is just being look at some chat bubble, the chat bubble that this is watched attentively is selected
It is set to target bubble.
When executing step S2, the eyeball action message that existing eyeball tracking device obtains user can be used, these
Eyeball action message is handled by eyeball tracking device, determines the sight of user focuses on where, exports the sight of user
The coordinate of focus.The program and algorithm that the processor of program and algorithm and terminal that eyeball tracking device is run is run can
Can be different, therefore when eyeball tracking device and the processor of terminal handle pixel or location point used seat
Mark system may also be different, therefore the processor of terminal needs the coordinate by sight focus to be converted into the pixel coordinate on picture.Such as
The pixel coordinate that fruit converts on resulting picture is fallen in some chat bubble, then this chat bubble is just chosen to be target
Bubble.
In step s3, the processor of terminal is split the picture, to intercept out target in the picture
Region.The target area is actually a part of the picture, and the target area should meet such property: it can
Some or all of described target bubble to be included, that is to say, that if show the target area on the screen,
User can see some or all of described target bubble.
In step s 4, the target area data transmission that the processor of terminal comes out interception, will be described to display module
Target area is shown.
Chat bubble in the present embodiment can be realized following technical effect: when and meanwhile have multiple users speech when, picture
On multiple chat bubbles will occur.The target bubble watched attentively of user is obtained by using eyeball tracking technology, and by the mesh
Standard gas bubble region is separated from entire picture, is individually shown the target bubble region, is realized to the target
The visual effect of bubble " giving feature " avoids target bubble from being overshadowed in chat bubble that is multiple while occurring, makes user can
With information needed for timely learning, to improve the interactivity of the interaction tools such as chatroom or virtual auditorium.
It is further used as preferred embodiment, the step S2, i.e. execution eyeball tracking, and the chat gas that will be watched attentively
The step for being chosen to be target bubble of bubble, specifically includes:
S201A. eyeball tracking is carried out to user, so that it is determined that the sight focus of user；
It S202A., will be with the sight when the sight focus is overlapped with any chat bubble in the picture
The chat bubble that focus is overlapped is chosen to be target bubble；
S203A. when the sight focus is overlapped with any virtual figure image in the picture, will with it is described
The virtual figure image that sight focus is overlapped is chosen to be destination virtual figure image, and occurs being directed toward the target void detecting
When intending figural chat bubble, which is chosen to be the target bubble.
In the present embodiment, the step S201A-S203A is one of implementation of step S2, i.e., the described step S2
It can be and be made of step S201A-S203A.
In step S201A, the eyeball movement of user is detected by eyeball tracking technology, can determine the mesh of user
Optical focus position.If coordinate system used in eyeball tracking device is identical as coordinate system used in terminal handler, that
Position of the sight focus of user on the picture can be directly determined using the coordinate that eyeball tracking device is exported.
If coordinate system used in eyeball tracking device is different from coordinate system used in terminal handler, an a pair can establish
It should be related to, the coordinate that eyeball tracking device is exported is mapped to position of the sight focus of user on the picture.
Step S202A is to be directed to a kind of executive condition of step S201A and execute.In step S202A, if detected
The sight focus is overlapped with any chat bubble in the picture, i.e., throwing of the described sight focus on the picture
Shadow point is in the range of a certain chat bubble, then this chat bubble for containing sight focus is just chosen to be target gas
Bubble.
For example, passing through eyeball for the speech " hello " of two virtual figure images shown in Fig. 3 and " welcoming you "
Tracer technique confirms that the sight focus of user is overlapped with the chat bubble that content is " hello ", then being just " big by content
Family it is good " chat bubble be confirmed as target bubble.
Step S203A is to be directed to another executive condition of step S201A and execute.In step S203A, if detection
It is overlapped to the sight focus with any virtual figure image in the picture, then just that this is burnt with the sight
The virtual figure image that point is overlapped is chosen to be destination virtual figure image.Then in the picture be located at destination virtual personage shape
As neighbouring part is analyzed, detects whether to exist and be directed toward the figural chat bubble of destination virtual.It is detecting
When there is being directed toward the figural chat bubble of the destination virtual, which is chosen to be the target bubble.
Part near the destination virtual figure image can be determined by presetted pixel range, for example, with described
Centered on destination virtual figure image center pixel, a certain number of pixel is as the range conduct on picture determined by " radius "
" the neighbouring part ".
In step S203A, when detecting that chat bubble occurs in the part near destination virtual figure image, analysis should be chatted
Whether its bubble is directed toward the destination virtual figure image.Specifically, it can be determined by the arrow head part of the chat bubble.
It is chat bubble in the position of maximum curvature by calculating the curvature of the lines since chat bubble is surrounded by lines
Arrow head part position.If the arrow head part position of the chat bubble and destination virtual figure image position
The distance between be no more than preset pixel number, then judge that the chat bubble is directed toward the destination virtual figure image, this chatted
Its bubble is chosen to be the target bubble.
It is further used as preferred embodiment, the step S2, i.e. execution eyeball tracking, and the chat gas that will be watched attentively
The step for being chosen to be target bubble of bubble, specifically includes:
S201B. eyeball tracking is carried out to user, so that it is determined that the sight focus of user；
S202B. when detecting there are multiple sight focuses on the picture, multiple sight focuses places are calculated
The geometric center of position；
It S203B., will be with the geometry when the geometric center is overlapped with any chat bubble in the picture
The chat bubble that center is overlapped is chosen to be target bubble.
In the present embodiment, the step S201B-S203B is another implementation of step S2, i.e., the described step S2 is also
It can be and be made of step S201B-S203B.
In step S201B, the eyeball movement of user is detected by eyeball tracking technology, can determine the mesh of user
Optical focus position.If coordinate system used in eyeball tracking device is identical as coordinate system used in terminal handler, that
Position of the sight focus of user on the picture can be directly determined using the coordinate that eyeball tracking device is exported.
If coordinate system used in eyeball tracking device is different from coordinate system used in terminal handler, an a pair can establish
It should be related to, the coordinate that eyeball tracking device is exported is mapped to position of the sight focus of user on the picture.
In actual use, multiple users be might have while watching the screen of the terminal, their sight focus
It may be different.In the case where there is eyeball tracking device relevant art to support, eyeball tracking device may be examined respectively simultaneously
Measure the respective sight focus of multiple users.
In step S202B, when detecting there are multiple sight focuses on the picture, each sight is determined respectively first
Focus position can be indicated by the pixel coordinate on the picture.Then it is burnt that multiple sight are calculated
The geometric center of point position.The specific steps are that: it is arbitrarily determined on picture first a little as origin, then with origin
The expression formula of each vector is calculated respectively using each sight focus position as terminal for starting point.If by the coordinate of origin
It is set as (0,0), then the expression formula of each vector is identical as the coordinate of its terminal respectively.The sum of each vector is calculated, it is then right
It carries out arithmetic mean of instantaneous value calculating, that is, by the abscissa of the expression formula of the sum of each vector and ordinate respectively divided by vector
Item number, the corresponding vector of resulting expression formula is the geometric center of multiple sight focus positions.
When the geometric center is overlapped with any chat bubble in the picture, step S203B is executed, it will be with
The chat bubble that the geometric center is overlapped is chosen to be target bubble.
For example, referring to Fig. 4, the screen of two users while viewing terminal is shared.By eyeball tracking technology, him is confirmed
Sight focus respectively fall in the chat bubble that content is " welcoming you " and the chat bubble that content is " hello ".Pass through
Geometric center calculates, and determines that the geometric center is located in the chat bubble that content is " hello ", therefore is " everybody by content
Chat bubble well " is confirmed as target bubble.
It executes step S201B-S203B to be adapted to multiple users while watching the use scene of picture, so that described
Target area is maintained at a more stable position in the picture, and the sight focus difference of multiple users is avoided to cause end
End, which is difficult to determine, selectes the sight focus of which user to control the display of the target area, thus improve chatroom or
The interactivity of the interaction tools such as virtual auditorium.
Be further used as preferred embodiment, the step S3, i.e., intercepted out in the picture target area this
Step specifically includes:
S301. destination virtual figure image pointed by the target bubble is determined；
S302. interception frame is generated；
S303. adjusted on the picture it is described interception frame size and location, until the target bubble part or
Whole and described figural a part or whole part of destination virtual is included in the interception frame；
S304. the part being included in the interception frame in the picture is extracted as the target area.
In the present embodiment, the step S301-S304 is one of implementation of step S3, i.e., the described step S3 can
With what is be made of step S301-S304.
In step S301, the void of target pointed by the target bubble can be determined by the arrow head part of target bubble
Anthropomorphic figure image.Since target bubble is surrounded by lines, by calculating the curvature of the lines, the position of maximum curvature just
It is the arrow head part position of target bubble.If the arrow head part position of the target bubble and some virtual portrait shape
As the distance between position be no more than preset pixel number, then the virtual figure image can be determined as to the mesh
Mark virtual figure image.
In step S302, interception frame is generated, and adjusts the size of the interception frame on the picture by step S303
And position, until a part or whole part and the figural a part or whole part of the destination virtual of the target bubble are wrapped
It includes in the interception frame.The interception frame is as shown in the dotted line frame of Fig. 5.The interception frame can be simply by record place
Location of pixels on picture is realized, does not show the interception frame simultaneously when showing the picture.
In step S304, the extracting section surrounded in the interception frame is come out, the target area is obtained.
It is further used as preferred embodiment, the step S4 is the step for showing the target area, specific to wrap
It includes:
S401. the target area is amplified to size identical with the picture；
S402. the amplification process of target area described in Dynamically Announce；
S403. continuously display to pass through the amplified target area.
Fig. 6 is the effect picture that the target area for being included is amplified to size identical as the picture in interception frame in Fig. 5.
In the present embodiment, the picture and the target area are the identical rectangles of Aspect Ratio, if they are Aspect Ratio differences
Rectangle the target area can be amplified to isometric or wait with the picture to keep the target area indeformable
It is wide.
During execution step S401 amplifies the target area, the target area of multiple and different sizes is generated
Domain, by the way that the target area of this multiple and different size is continuously displayed, can with the amplification process of target area described in Dynamically Announce,
Realize good visual effect.
It is continuously display by amplified described after the target area is amplified to size identical with the picture
Target area, display effect on the screen are as shown in Figure 6.
Be further used as preferred embodiment, the step S3, i.e., intercepted out in the picture target area this
Step, specifically further include:
S305. the target area is divided into foreground part and background parts；The foreground part is by the target
Part composed by a part or whole part of bubble and the figural a part or whole part of the destination virtual, the background parts
For the other parts in the target area in addition to the foreground part；
S306. Fuzzy processing is carried out to the background parts.
Fig. 7 is the result that step S305 and S306 are executed to Fig. 6.In step S305, image segmentation algorithm is executed, it will be described
Target area is divided into foreground part and background parts.Wherein, the foreground part is by the part of the target bubble or whole
Part composed by body and the figural a part or whole part of the destination virtual, the background parts are except the foreground portion
Other parts exceptionally.
In step S306, by demosaicing algorithm and frosted glass algorithm etc., the background parts are blurred, so that target
Region can more protrude foreground part, obtain better visual effect.
It is further used as preferred embodiment, the adaptive chat bubble display methods is further comprising the steps of:
S5. after the amplified target area is continuously displayed and reaches preset duration, terminate to the mesh
Mark the display in region；
S6. restore to show the picture.
Reach preset duration when the target area Fig. 6 or shown in Fig. 7 is continuously displayed, such as after 3s, end pair
Then Fig. 6 or screen switching shown in Fig. 7 are returned picture as shown in Figure 1 by the display of the target area, realize to target gas
Bubble highlights.
The present embodiment further includes a kind of adaptive chat bubble display system, referring to Fig. 8, comprising:
Picture obtains module, for obtaining the picture containing at least one chat bubble；The picture also contains at least one
A virtual figure image, each chat bubble chat content for rendering；
Eyeball tracking module is chosen to be target bubble for executing eyeball tracking, and by the chat bubble watched attentively；
Region interception module, for intercepting out target area in the picture；Some or all of described target bubble
It is included in the target area；
Region display module, for showing the target area.
The picture, which obtains module, eyeball tracking module, region interception module and region display module, can be computer
With the hardware module or software module of corresponding function in system.
The present embodiment further includes a kind of adaptive chat bubble display device, including memory, processor, eyeball tracking
Device and display, the memory is for storing at least one program, and the processor is for loading at least one described program
To execute the method for the embodiment of the present invention, the eyeball tracking device is for executing eyeball tracking, and the display is for showing
The picture and/or the target area.The adaptive chat bubble display device can be mobile phone and tablet computer etc.
Terminal.
The present embodiment further includes a kind of storage medium, wherein being stored with the executable instruction of processor, the processor can
The instruction of execution is when executed by the processor for executing the adaptive chat bubble display methods of the present invention.
Adaptive chat bubble display system, device and storage medium in the present embodiment, can execute of the invention
It is corresponding to have this method for adaptive chat bubble display methods, any combination implementation steps of executing method embodiment
Function and beneficial effect.
It should be noted that unless otherwise specified, when a certain feature referred to as " fixation ", " connection " are in another feature,
It can directly fix, be connected to another feature, and can also fix, be connected to another feature indirectly.In addition, this
The descriptions such as the upper and lower, left and right used in open are only the mutual alignment pass relative to each component part of the disclosure in attached drawing
For system.The "an" of used singular, " described " and "the" are also intended to including most forms in the disclosure, are removed
Non- context clearly expresses other meaning.In addition, unless otherwise defined, all technology and science used in the present embodiment
Term is identical as the normally understood meaning of those skilled in the art.This example demonstrates that term used in book is
In order to describe specific embodiment, it is not intended to be limiting of the invention.Term "and/or" used in the present embodiment includes one
Or the arbitrary combination of multiple relevant listed items.
It will be appreciated that though various elements, but this may be described using term first, second, third, etc. in the disclosure
A little elements should not necessarily be limited by these terms.These terms are only used to for same type of element being distinguished from each other out.For example, not departing from
In the case where disclosure range, first element can also be referred to as second element, and similarly, second element can also be referred to as
One element.The use of any and all example or exemplary language provided by the present embodiment (" such as ", " such as ") is only anticipated
The embodiment of the present invention is better described in figure, and unless the context requires otherwise, otherwise will not apply to the scope of the present invention and limit.
It should be appreciated that the embodiment of the present invention can be by computer hardware, the combination of hardware and software or by depositing
The computer instruction in non-transitory computer-readable memory is stored up to be effected or carried out.Standard volume can be used in the method
Journey technology-includes that the non-transitory computer-readable storage media configured with computer program is realized in computer program,
In configured in this way storage medium computer is operated in a manner of specific and is predefined --- according in a particular embodiment
The method and attached drawing of description.Each program can with the programming language of level process or object-oriented come realize with department of computer science
System communication.However, if desired, the program can be realized with compilation or machine language.Under any circumstance, which can be volume
The language translated or explained.In addition, the program can be run on the specific integrated circuit of programming for this purpose.
In addition, the operation of the process of the present embodiment description can be performed in any suitable order, unless the present embodiment is another
It is outer instruction or otherwise significantly with contradicted by context.The process (or modification and/or combination thereof) of the present embodiment description can
Configured with executable instruction one or more computer systems control under execute, and can be used as jointly at one or
The code (for example, executable instruction, one or more computer program or one or more application) that is executed on multiple processors,
It is realized by hardware or combinations thereof.The computer program includes the multiple instruction that can be performed by one or more processors.
Further, the method can be realized in being operably coupled to suitable any kind of computing platform, wrap
Include but be not limited to PC, mini-computer, main frame, work station, network or distributed computing environment, individual or integrated
Computer platform or communicated with charged particle tool or other imaging devices etc..Each aspect of the present invention can be to deposit
The machine readable code on non-transitory storage medium or equipment is stored up to realize no matter be moveable or be integrated to calculating
Platform, such as hard disk, optical reading and/or write-in storage medium, RAM, ROM, so that it can be read by programmable calculator, when
Storage medium or equipment can be used for configuration and operation computer to execute process described herein when being read by computer.This
Outside, machine readable code, or part thereof can be transmitted by wired or wireless network.When such media include combining microprocessor
Or other data processors are when realizing the instruction or program of steps described above, invention described in the present embodiment include these and its
His different types of non-transitory computer-readable storage media.When methods and techniques according to the present invention programming, this
Invention further includes computer itself.
Computer program can be applied to input data to execute function described in the present embodiment, to convert input data
It is stored with generating to the output data of nonvolatile memory.Output information can also be applied to one or more output equipments such as
Display.In the preferred embodiment of the invention, the data of conversion indicate physics and tangible object, including generate on display
Physics and physical objects particular visual describe.
The above, only presently preferred embodiments of the present invention, the invention is not limited to above embodiment, as long as
It reaches technical effect of the invention with identical means, all within the spirits and principles of the present invention, any modification for being made,
Equivalent replacement, improvement etc., should be included within the scope of the present invention.Its technical solution within the scope of the present invention
And/or embodiment can have a variety of different modifications and variations.
Claims (10)
1. a kind of adaptive chat bubble display methods, which comprises the following steps:
Obtain the picture containing at least one chat bubble；The picture also contains at least one virtual figure image, each described
It chats bubble chat content for rendering；
Eyeball tracking is executed, and the chat bubble watched attentively is chosen to be target bubble；
Target area is intercepted out in the picture；Some or all of described target bubble is included in the target area
It is interior；
Show the target area.
2. the adaptive chat bubble display methods of one kind according to claim 1, which is characterized in that the execution eyeball
Tracking, and the step for being chosen to be target bubble of chat bubble that will be watched attentively, specifically include:
Eyeball tracking is carried out to user, so that it is determined that the sight focus of user；
When the sight focus is overlapped with any chat bubble in the picture, by what is be overlapped with the sight focus
Chat bubble is chosen to be target bubble；
It, will be with the sight focus weight when the sight focus is overlapped with any virtual figure image in the picture
The virtual figure image of conjunction is chosen to be destination virtual figure image, and occurs being directed toward the destination virtual figure image detecting
Chat bubble when, which is chosen to be the target bubble.
3. the adaptive chat bubble display methods of one kind according to claim 1, which is characterized in that the execution eyeball
Tracking, and the step for being chosen to be target bubble of chat bubble that will be watched attentively, specifically include:
Eyeball tracking is carried out to user, so that it is determined that the sight focus of user；
When detecting there are multiple sight focuses on the picture, the geometry of multiple sight focus positions is calculated
Center；
When the geometric center is overlapped with any chat bubble in the picture, by what is be overlapped with the geometric center
Chat bubble is chosen to be target bubble.
4. the adaptive chat bubble display methods of one kind according to claim 1, which is characterized in that described in the picture
The step for target area is intercepted out in face specifically includes:
Determine destination virtual figure image pointed by the target bubble；
Generate interception frame；
The size and location that the interception frame is adjusted on the picture, until a part or whole part of the target bubble and institute
The figural a part or whole part of destination virtual is stated to be included in the interception frame；
The part being included in the interception frame in the picture is extracted as the target area.
5. the adaptive chat bubble display methods of one kind according to claim 1, which is characterized in that described in the picture
The step for target area is intercepted out in face, specifically further include:
The target area is divided into foreground part and background parts；The foreground part is the part by the target bubble
Or part composed by whole and described figural a part or whole part of destination virtual, the background parts are the target
Other parts in region in addition to the foreground part；
Fuzzy processing is carried out to the background parts.
6. the adaptive chat bubble display methods of one kind according to claim 1-5, which is characterized in that described
The step for showing the target area specifically includes:
The target area is amplified to size identical with the picture；
The amplification process of target area described in Dynamically Announce；
It is continuously display to pass through the amplified target area.
7. the adaptive chat bubble display methods of one kind according to claim 6, which is characterized in that further include following step
It is rapid:
After the amplified target area is continuously displayed and reaches preset duration, terminate to the target area
Display；
Restore to show the picture.
8. a kind of adaptive chat bubble display system characterized by comprising
Picture obtains module, for obtaining the picture containing at least one chat bubble；The picture also contains at least one void
Anthropomorphic figure image, each chat bubble chat content for rendering；
Eyeball tracking module is chosen to be target bubble for executing eyeball tracking, and by the chat bubble watched attentively；
Region interception module, for intercepting out target area in the picture；Some or all of described target bubble is wrapped
It includes in the target area；
Region display module, for showing the target area.
9. a kind of adaptive chat bubble display device, which is characterized in that including memory, processor, eyeball tracking device and
Display, the memory is for storing at least one program, and the processor is for loading at least one described program to hold
Any one of row claim 1-7 the method, the eyeball tracking device is for executing eyeball tracking, and the display is for showing
The picture and/or the target area.
10. a kind of storage medium, wherein being stored with the executable instruction of processor, which is characterized in that the processor is executable
Instruction be used to execute such as any one of claim 1-7 the method when executed by the processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910683018.9A CN110456964A (en) | 2019-07-26 | 2019-07-26 | A kind of adaptive chat bubble display methods, system, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910683018.9A CN110456964A (en) | 2019-07-26 | 2019-07-26 | A kind of adaptive chat bubble display methods, system, device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110456964A true CN110456964A (en) | 2019-11-15 |
Family
ID=68483610
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910683018.9A Pending CN110456964A (en) | 2019-07-26 | 2019-07-26 | A kind of adaptive chat bubble display methods, system, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110456964A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113010619A (en) * | 2019-12-20 | 2021-06-22 | 百度在线网络技术（北京）有限公司 | Bubble display method and device, electronic equipment and storage medium |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103049081A (en) * | 2012-12-05 | 2013-04-17 | 上海量明科技发展有限公司 | Method, client and system for visually triggering opening object |
| CN103309451A (en) * | 2013-06-20 | 2013-09-18 | 上海华勤通讯技术有限公司 | Mobile terminal and display method thereof |
| CN103885592A (en) * | 2014-03-13 | 2014-06-25 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for displaying information on screen |
| CN104077030A (en) * | 2014-06-10 | 2014-10-01 | 小米科技有限责任公司 | Control method and device for message bubble style |
| CN104133548A (en) * | 2013-05-03 | 2014-11-05 | 中国移动通信集团公司 | Method and device for determining viewpoint area and controlling screen luminance |
| CN105335061A (en) * | 2015-09-23 | 2016-02-17 | 小米科技有限责任公司 | Information display method and apparatus and terminal |
| CN106531123A (en) * | 2016-11-16 | 2017-03-22 | 武汉华星光电技术有限公司 | Screen brightness adjustment method and screen brightness adjustment device |
| CN107179824A (en) * | 2016-03-11 | 2017-09-19 | 中国电信股份有限公司 | A kind of method, device and the terminal of adjust automatically screen display |
| CN107491250A (en) * | 2017-07-31 | 2017-12-19 | 北京小米移动软件有限公司 | Display methods, device and the equipment of notification message |
| US20180165887A1 (en) * | 2016-12-08 | 2018-06-14 | Colopl, Inc. | Information processing method and program for executing the information processing method on a computer |
| CN108875526A (en) * | 2018-01-05 | 2018-11-23 | 北京旷视科技有限公司 | Method, apparatus, system and the computer storage medium of line-of-sight detection |
| CN109343919A (en) * | 2018-08-30 | 2019-02-15 | 深圳市口袋网络科技有限公司 | A kind of rendering method and terminal device, storage medium of bubble of chatting |
| CN109683705A (en) * | 2018-11-30 | 2019-04-26 | 北京七鑫易维信息技术有限公司 | The methods, devices and systems of eyeball fixes control interactive controls |
-
2019
- 2019-07-26 CN CN201910683018.9A patent/CN110456964A/en active Pending
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103049081A (en) * | 2012-12-05 | 2013-04-17 | 上海量明科技发展有限公司 | Method, client and system for visually triggering opening object |
| CN104133548A (en) * | 2013-05-03 | 2014-11-05 | 中国移动通信集团公司 | Method and device for determining viewpoint area and controlling screen luminance |
| CN103309451A (en) * | 2013-06-20 | 2013-09-18 | 上海华勤通讯技术有限公司 | Mobile terminal and display method thereof |
| CN103885592A (en) * | 2014-03-13 | 2014-06-25 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for displaying information on screen |
| CN104077030A (en) * | 2014-06-10 | 2014-10-01 | 小米科技有限责任公司 | Control method and device for message bubble style |
| CN105335061A (en) * | 2015-09-23 | 2016-02-17 | 小米科技有限责任公司 | Information display method and apparatus and terminal |
| CN107179824A (en) * | 2016-03-11 | 2017-09-19 | 中国电信股份有限公司 | A kind of method, device and the terminal of adjust automatically screen display |
| CN106531123A (en) * | 2016-11-16 | 2017-03-22 | 武汉华星光电技术有限公司 | Screen brightness adjustment method and screen brightness adjustment device |
| US20180165887A1 (en) * | 2016-12-08 | 2018-06-14 | Colopl, Inc. | Information processing method and program for executing the information processing method on a computer |
| CN107491250A (en) * | 2017-07-31 | 2017-12-19 | 北京小米移动软件有限公司 | Display methods, device and the equipment of notification message |
| CN108875526A (en) * | 2018-01-05 | 2018-11-23 | 北京旷视科技有限公司 | Method, apparatus, system and the computer storage medium of line-of-sight detection |
| CN109343919A (en) * | 2018-08-30 | 2019-02-15 | 深圳市口袋网络科技有限公司 | A kind of rendering method and terminal device, storage medium of bubble of chatting |
| CN109683705A (en) * | 2018-11-30 | 2019-04-26 | 北京七鑫易维信息技术有限公司 | The methods, devices and systems of eyeball fixes control interactive controls |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113010619A (en) * | 2019-12-20 | 2021-06-22 | 百度在线网络技术（北京）有限公司 | Bubble display method and device, electronic equipment and storage medium |
| CN113010619B (en) * | 2019-12-20 | 2024-03-22 | 百度在线网络技术（北京）有限公司 | Bubble display method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11676412B2 (en) | Object modeling and replacement in a video stream | |
| US20160358382A1 (en) | Augmented Reality Using 3D Depth Sensor and 3D Projection | |
| CN113168231A (en) | Enhanced techniques for tracking movement of real world objects to improve virtual object positioning | |
| CN110674719A (en) | Target object matching method and device, electronic equipment and storage medium | |
| KR101768532B1 (en) | System and method for video call using augmented reality | |
| US20210319540A1 (en) | Eye texture inpainting | |
| CN111985281B (en) | Image generation model generation method and device and image generation method and device | |
| CN110059623B (en) | Method and apparatus for generating information | |
| CN113254815B (en) | Document processing method and device and page processing method and device | |
| CN115546377B (en) | Video fusion method and device, electronic equipment and storage medium | |
| US20240037898A1 (en) | Method for predicting reconstructabilit, computer device and storage medium | |
| WO2023016107A1 (en) | Remote interaction method, apparatus and system, and electronic device and storage medium | |
| CN117274383A (en) | Viewpoint prediction method and device, electronic equipment and storage medium | |
| CN110456964A (en) | A kind of adaptive chat bubble display methods, system, device and storage medium | |
| CN107913519B (en) | Rendering method of 2D game and mobile terminal | |
| CN113269781A (en) | Data generation method and device and electronic equipment | |
| CN108151709B (en) | Positioning method and device applied to terminal | |
| CN112837372A (en) | Data generation method and device, electronic equipment and storage medium | |
| CN112087590A (en) | Image processing method, device, system and computer storage medium | |
| KR20170127354A (en) | Apparatus and method for providing video conversation using face conversion based on facial motion capture | |
| CN111260756B (en) | Method and device for transmitting information | |
| EP4290452A1 (en) | Data generation method and apparatus, and electronic device | |
| CN110471598A (en) | A kind of chat bubble display methods, system, device and storage medium | |
| CN114241046A (en) | Data annotation method and device, computer equipment and storage medium | |
| CN116074485A (en) | Conversation method and terminal based on augmented reality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20221012 Address after: Room 1602, 16th Floor, Building 18, Yard 6, Wenhuayuan West Road, Beijing Economic and Technological Development Zone, Daxing District, Beijing 100176 Applicant after: Beijing Lajin Zhongbo Technology Co.,Ltd. Address before: 310000 room 650, building 3, No. 16, Zhuantang science and technology economic block, Xihu District, Hangzhou City, Zhejiang Province Applicant before: Tianmai Juyuan (Hangzhou) Media Technology Co.,Ltd. |
|
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20191115 |