CN107454433A - Live annotation method and device, terminal and live broadcast system - Google Patents

Live annotation method and device, terminal and live broadcast system Download PDF

Info

Publication number
CN107454433A
CN107454433A CN201710677122.8A CN201710677122A CN107454433A CN 107454433 A CN107454433 A CN 107454433A CN 201710677122 A CN201710677122 A CN 201710677122A CN 107454433 A CN107454433 A CN 107454433A
Authority
CN
China
Prior art keywords
terminal
live
screen
track
annotation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710677122.8A
Other languages
Chinese (zh)
Other versions
CN107454433B (en
Inventor
郭庆伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Shiyuan Electronics Thecnology Co Ltd
Guangzhou Shirui Electronics Co Ltd
Original Assignee
Guangzhou Shiyuan Electronics Thecnology Co Ltd
Guangzhou Shirui Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Shiyuan Electronics Thecnology Co Ltd, Guangzhou Shirui Electronics Co Ltd filed Critical Guangzhou Shiyuan Electronics Thecnology Co Ltd
Priority to CN201710677122.8A priority Critical patent/CN107454433B/en
Publication of CN107454433A publication Critical patent/CN107454433A/en
Priority to PCT/CN2017/116790 priority patent/WO2019029087A1/en
Application granted granted Critical
Publication of CN107454433B publication Critical patent/CN107454433B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4882—Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders

Abstract

The invention discloses a kind of live annotation method and device, terminal and live broadcast system.The live annotation method includes obtaining the first touch routing information corresponding to the touch operation that this end subscriber is acted on local terminal touch-screen；The first comment track according to corresponding to described first touches the routing information drafting touch operation, and send described first to the displaying terminal that connection is established with local terminal and touch routing information so that the displaying terminal be plotted in that the displaying terminal show according to the described first touch routing information second annotate track；The first comment track is given to this end subscriber by screen shows.The embodiment of the present invention is by using above-mentioned technical proposal, it is possible to achieve live content is annotated during live, makes displaying terminal user more targeted when watching live, improves live bandwagon effect.

Description

Live annotation method and device, terminal and live broadcast system
Technical field
The present invention relates to direct seeding technique field, more particularly to a kind of live annotation method and device, terminal and live system System.
Background technology
In recent years, as the development of the information processing technology, live scene have also more and more been applied to education participant View field.
Under education or conference scenario, teacher or speaker can in front of classroom, in front of meeting room or in other places Tested by other staff of the live mode into classroom or meeting room or the demonstrations of equipment etc., now, typically The camera data of the electronic equipments such as mobile phone or the computer of live equipment can be used as by collection, and further to being gathered To camera data carry out coded treatment (as H.264 encode) after send it to the interaction intelligence in classroom or meeting room The presentation devices such as energy flat board, so as to realize the live of demonstrations content, to reach that the content of shooting of teacher or speaker is real When show the purpose of student or participant.
But inventor has found that prior art has following technological deficiency during the present invention is realized：Traditional is straight The camera data of live terminal are simply synchronized displaying when live by broadcasting method in displaying terminal, can not be realized live During live content is annotated.
The content of the invention
In view of this, the embodiment of the present invention provides a kind of live annotation method and device, terminal and live broadcast system, with solution The technical problem that live content can not be annotated during certainly live in the prior art.
In a first aspect, the embodiments of the invention provide a kind of live annotation method, including：
Obtain first corresponding to the touch operation that this end subscriber is acted on local terminal touch-screen and touch routing information；
According to described first touch routing information draw the touch operation corresponding to first comment track, and to local terminal The displaying terminal for establishing connection sends the first touch routing information, so that the displaying terminal touches road according to described first Footpath information is plotted in the second annotation track that the displaying terminal is shown；
The first comment track is given to this end subscriber by screen shows.
Second aspect, the embodiments of the invention provide a kind of live annotation method, including：
Obtain first sent with the live terminal that connection is established when front end and touch routing information and the live terminal With when the pixel corresponding relation of front end, wherein, the pixel corresponding relation be the live terminal screen in each first pixel With when the corresponding relation of each second pixel in front-end screen；
Routing information is touched according to described first and the pixel corresponding relation is determined when the second of front end touches path Information；
Second show when front end is plotted in based on the described second touch routing information and annotates track, and by the second batch Worked as front end user by screen shows in note track.
The third aspect, the embodiments of the invention provide a kind of live annotation device, including：
Routing information acquisition module, corresponding to the touch operation acted on for obtaining this end subscriber on local terminal touch-screen First touches routing information；
First comment drafting module, for according to described first touch routing information draw the touch operation corresponding to the One annotation track, and send described first to the displaying terminal that connection is established with local terminal and touch routing information, so that the displaying What terminal was plotted in that the displaying terminal show according to the described first touch routing information second annotates track；
First comment display module, for giving the first comment track to this end subscriber by screen shows.
Fourth aspect, the embodiments of the invention provide a kind of live annotation device, including：
Data obtaining module, routing information is touched for obtaining sent with the live terminal that connection is established when front end first And the live terminal and the pixel corresponding relation when front end, wherein, the pixel corresponding relation is the live end panel Each first pixel and the corresponding relation when each second pixel in front-end screen in curtain；
Routing information determining module, for touching routing information and pixel corresponding relation determination according to described first Second when front end touches routing information；
Second annotation display module, for being plotted in the second batch shown when front end based on the described second touch routing information Track is noted, and front end user is worked as into the described second annotation track by screen shows.
5th aspect, the embodiments of the invention provide a kind of live terminal, including：
One or more processors；
Memory, for storing one or more programs,
When one or more of programs are by one or more of computing devices so that one or more of processing Device realizes the live annotation method described in the embodiment of the present invention.
6th aspect, the embodiments of the invention provide a kind of displaying terminal, including：
One or more processors；
Memory, for storing one or more programs,
When one or more of programs are by one or more of computing devices so that one or more of processing Device realizes the live annotation method described in the embodiment of the present invention.
7th aspect, the embodiment of the present invention additionally provide a kind of live broadcast system, including live terminal and displaying terminal,
The live terminal, first corresponding to touch operation acted on for obtaining this end subscriber on local terminal touch-screen Touch routing information；The first comment track according to corresponding to described first touches the routing information drafting touch operation, and to The displaying terminal that connection is established with local terminal sends the first touch routing information, so that the displaying terminal is according to described first Touch routing information and be plotted in the second annotation track that the displaying terminal is shown；The first comment track is passed through into screen exhibition Show to this end subscriber；
The displaying terminal, routing information is touched for obtaining sent with the live terminal that connection is established when front end first And the live terminal and the pixel corresponding relation when front end, wherein, the pixel corresponding relation is the live end panel Each first pixel and the corresponding relation when each second pixel in front-end screen in curtain；Routing information is touched according to described first And the pixel corresponding relation is determined when the second of front end touches routing information；Routing information is touched based on described second to draw Worked as front end user by screen shows in the second annotation track shown when front end, and by the described second annotation track.
In the technical scheme annotated when above-mentioned live, the touch that this end subscriber is acted on local terminal touch-screen is obtained The first corresponding touch routing information of operation, first according to corresponding to the first touch routing information draws user's touch operation Annotation track simultaneously sends the first touch routing information to the displaying terminal that connection is established with local terminal, by the first comment rail of drafting Mark gives this end subscriber by local terminal screen shows, and accordingly, displaying terminal touches routing information according to first received and drawn In the second annotation track that displaying terminal is shown and present it to displaying terminal user.The technology annotated when above-mentioned live Scheme, it is possible to achieve to the annotation of live content during live, make displaying terminal user be more directed to when watching live Property, improve live bandwagon effect.
Brief description of the drawings
By reading the detailed description made to non-limiting example made with reference to the following drawings, of the invention is other Feature, objects and advantages will become more apparent upon：
Fig. 1 is a kind of schematic flow sheet for live annotation method that the embodiment of the present invention one provides；
Fig. 2 is a kind of schematic flow sheet for live annotation method that the embodiment of the present invention two provides；
Fig. 3 A are a kind of schematic flow sheet for live annotation method that the embodiment of the present invention three provides；
Fig. 3 B are a kind of viewing area schematic diagram for displaying terminal that the embodiment of the present invention three provides；
Fig. 4 is a kind of schematic flow sheet for live annotation method that the embodiment of the present invention four provides；
Fig. 5 is a kind of structured flowchart for live annotation device that the embodiment of the present invention five provides；
Fig. 6 is a kind of structured flowchart for live annotation device that the embodiment of the present invention six provides；
Fig. 7 is a kind of structural representation for live terminal that the embodiment of the present invention seven provides；
Fig. 8 is a kind of structural representation for displaying terminal that the embodiment of the present invention eight provides；
Fig. 9 is a kind of structured flowchart for live broadcast system that the embodiment of the present invention nine provides.
Embodiment
The present invention is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched The specific embodiment stated is used only for explaining the present invention, rather than limitation of the invention.It also should be noted that in order to just Part related to the present invention rather than full content are illustrate only in description, accompanying drawing.
Embodiment one
The embodiment of the present invention one provides a kind of live annotation method.This method can be performed by live annotation device, Wherein, the device can be realized by software and/or hardware, can typically be integrated in live terminal.Fig. 1 is that the embodiment of the present invention one carries The schematic flow sheet of the live annotation method supplied, as shown in figure 1, this method includes：
S101, the first touch path obtained corresponding to the touch operation that this end subscriber is acted on local terminal touch-screen are believed Breath.
In the present embodiment, obtaining the trigger condition of the first touch routing information can be configured as needed, for example, can To be obtained according to the setting cycle first path letter is touched corresponding to the touch operation that this end subscriber acted on local terminal touch-screen Cease, when the touch sources (finger or stylus of such as user) for detecting user's touch operation are lifted away from local terminal screen (touch-screen) Obtain first corresponding to the touch operation that this end subscriber is acted on local terminal touch-screen and touch routing information, or in user's point The first comment trace information for determining or clicking on and user's touch operation is obtained when obtaining button is hit, is not restricted herein.Wherein, together The quantity that the user's touch operation of one moment corresponds to touch sources can be one or more, now, the first acquired touch-control path The touch routing information of one or more touch sources can be included in information.In view of the simplicity of subsequent operation, it is preferred that institute First obtained touches the touch routing information that routing information is a touch sources, i.e. touch sources and first touch routing information Correspond, if the touch operation of user has multiple touch sources, can be generated respectively for different touch sources different First touches routing information, and carries out operations described below respectively for each first touch routing information, below with one first touch Routing information is only corresponded to exemplified by a touch sources.
S102, the first comment track according to corresponding to the described first touch routing information draws the touch operation, and to The displaying terminal that connection is established with local terminal sends the first touch routing information, so that the displaying terminal is according to described first Touch routing information and be plotted in the second annotation track that the displaying terminal is shown.
, can be (such as single straight line, double straight according to line color set in advance, line weight, the line style of type in the present embodiment Line or wave etc.) and/or draw mode (straight line is drawn, Drawing of Curve or broken line are drawn etc.) to draw user's touch operation corresponding First comment track.When drawing first comment track, if first touches routing information not in accordance with the progress of setting cycle Obtain, then can be with as the first touch routing information obtains after touch sources are lifted away from local terminal screen or click on determination key in user Touch track corresponding to first touch routing information of this acquisition is defined as a first comment track, i.e., first touches Routing information corresponds with first comment track；If first touches routing information according to the acquisition of setting cycle, can incite somebody to action Touch track corresponding to this first touch routing information obtained is defined as a son annotation track of first comment track, this When, first comment track can draw according to the multiple first touch routing informations and form, accordingly, described to touch road according to first The first touch path that first comment track corresponding to the information drafting touch operation of footpath is appreciated that to be obtained according to current period Information draws the current sub- annotation track of first comment track corresponding to touch operation, now, is drawing the current sub- annotation rail During mark, each sub- annotation track completed before this cycle in first comment track is not deleted, i.e. in first comment Continue to draw current son annotation track on the basis of each sub- annotation track that track has been completed.
Exemplary, local terminal can will establish the displaying connected by delivering paths such as LAN or wide area networks to local terminal Terminal sends first and touches routing information, accordingly, before the first touch routing information is sent, can pass through LAN first Or wide area network etc. is established with displaying terminal and connected, for example, the CLIENT PROGRAM that can be respectively started first in local terminal and displaying are eventually Service routine in end, then by transmission control protocol (Transmission Control Protocol, TCP) by local terminal CLIENT PROGRAM and displaying terminal service routine establish connect, so as to realize establishment of connection between local terminal and displaying terminal.
Here, it should be noted that after the first touch routing information is got, local terminal can carry out first first The drafting of track is noted, then sending first to displaying terminal again touches routing information, or, send first to displaying terminal first Routing information is touched, then carries out the drafting of first comment track again；First comment track can also be drawn simultaneously and to displaying Terminal sends first and touches routing information, is not restricted herein.In order to ensure that displaying terminal is painted according to the first touch routing information The real-time of the annotation of system second track simultaneously reduces the time difference that first comment track is shown with the second annotation track, it is preferred that After the first touch routing information is got, the first touch routing information can be sent to displaying terminal first and carry out first again Note the drafting of track.
S103, give the first comment track to this end subscriber by screen shows.
In the present embodiment, complete first comment track is showed this again after being completed in first comment track End subscriber, each sub- annotation track completed in first comment track can also be showed into this end subscriber in real time, this Place is not restricted.
In order to ensure that user can watch and correct in time the touch path of oneself, preferably according to setting in the present embodiment Cycle obtains each son batch completed in the first touch path of user's touch operation and real-time display first comment track Note track.Accordingly, the decision condition that first comment track completes to draw can be preset, and set in advance is sentenced meeting Judge that the first comment track is completed during fixed condition, now, if detecting the touch operation of user again, basis again The touch operation of user generates another first comment track.For example, it is assumed that if presetting first comment track pair The touch sources answered are lifted away from local terminal screen and judge that first comment track is completed, then, can be according to first when being annotated Set cycle acquisition touch sources first touches routing information, and each son completed in real-time display first comment track Track is annotated, also, it is in real time or corresponding according to the second setting cycle monitoring first comment track during obtaining with display Touch sources whether be lifted away from local terminal screen, if so, then judging that first comment track is completed.Now, after completing, also Each sub- annotation track included in first comment track can be synthesized to an entirety and determine the annotation track after synthesis For first comment track.
The live annotation method that the embodiment of the present invention one provides, obtain this end subscriber and act on touching on local terminal touch-screen Touch operation it is corresponding first touch routing information, according to this first touch routing information draw user's touch operation corresponding to the One annotation track simultaneously sends the first touch routing information to the displaying terminal that connection is established with local terminal, by the first comment of drafting This end subscriber is given in track by local terminal screen shows.The present embodiment is by using above-mentioned technical proposal, it is possible to achieve in live mistake Live content is annotated in journey, enable live terminal user clearly state its it is live during key content, drop The statement difficulty of low live terminal user, improve the usage experience of live terminal user.
The above-mentioned technical solutions of this embodiment, video or this end subscriber that can be for this end subscriber to being played in local terminal screen Live situation is carried out by the electronic game of local terminal screen operator, can also be directed to what this end subscriber was shot to local terminal camera Content carries out live situation.The present embodiment preferred pin carries out live situation, now, the present embodiment by camera to user The live annotation method provided can also include：Obtain the photographed data of local terminal camera；In local terminal screen described in display Photographed data, and the photographed data is sent to the displaying terminal that connection is established with local terminal, so that the displaying terminal is according to setting Fixed display rule shows the photographed data, wherein, the photographed data corresponding display layer in local terminal screen is located at described First comment track corresponds to the lower section of display layer.Here, local terminal shows photographed data in local terminal screen and sent out to displaying terminal Send photographed data can simultaneously or non-concurrent progress, preferably after camera data are got first to displaying terminal send shoot Data, to reduce the delay duration of displaying terminal displaying camera data.
On the basis of above-described embodiment, it is described by the first comment track by screen shows give this end subscriber it Afterwards, can also include：The event being moved in response to monitoring local terminal camera, based on annotation scenery in local terminal screen The change of first display location adjusts second display location of the first comment track in local terminal screen, the annotation scenery For scenery corresponding to the first comment track.When the content shot to camera carries out live, the movement of camera position Image space of the annotation scenery in live terminal screen can be caused to change, therefore, when camera position is moved, Display location of the first comment track in local terminal screen can be adjusted, so that the display location of first comment track is corresponding The display location for annotating scenery is corresponding.Exemplary, when detecting that local terminal camera is moved, it can first obtain and criticize The changing value of display location of the scenery in local terminal screen is noted, first comment track is then adjusted in local terminal screen according to the changing value Display location in curtain.Wherein, the quantity of the first comment track shown in local terminal screen can be one or more, if this The quantity of the first comment track shown in the screen of end is multiple, then the display location of each first comment track can be entered respectively Row adjustment, so that the display location of the corresponding annotation scenery in the display location of each first comment track is relative after adjustment Should, ensure the accuracy of each first comment track display location, when need not be shown in first comment track, user can be by deleting Division operation deletes the first comment track without being shown again.In view of the synchronism of local terminal and displaying terminal display picture, Preferably, can it is determined that send the changing value to displaying terminal after the changing value of annotation scenery display location, or, true The display location after the adjustment is sent to displaying terminal after determining the display location after the adjustment of first comment track, so that displaying is eventually End can improve displaying terminal user according to the timely changing value or the display location of the second annotation of display location adjustment track Viewing experience.
Here, it should be noted that because the display location of the adjustment annotation track in track drawing process is annotated can make The display location after the adjustment of track must be annotated and the phenomenon separated occur with the touch location of user's finger, cause first comment track Multiple discontinuous parts itself are separated into, it is therefore, continuous when being shown in order to ensure first comment track in the present embodiment Property, can be only to the first comment track completed in local terminal screen when detecting that camera position is moved Display location is adjusted.Now, local terminal can be by judging whether touch sources are lifted away from local terminal screen corresponding to first comment track Curtain or user whether click on " it is determined that " or the decision condition such as " complete draw " button judge whether a certain first comment track draws Complete, be not restricted herein.
Embodiment two
Fig. 2 is a kind of schematic flow sheet for live annotation method that the embodiment of the present invention two provides.The present embodiment is upper State and optimize on the basis of embodiment, in the present embodiment, will be " based on first display of the annotation scenery in local terminal screen The change of position adjusts second display location of the first comment track in local terminal screen " it is optimized for：Obtain local terminal shooting Head mobile message and the first comment track with being shown in local terminal screen it is corresponding annotation scenery depth of view information；According to institute State mobile message and the depth of view information determines the pixel offset value of first display location of the annotation scenery in local terminal screen； The second display location based on first comment track described in the pixel offset value and current time in local terminal screen determines The first comment track needs the first position to be shown adjusted；By the first comment track in local terminal screen Two display locations are adjusted to the described first position to be shown, and send described first to the displaying terminal that connection is established with local terminal and treat Display location, so that the displaying terminal determines the second annotation in the displaying terminal screen based on the described first position to be shown Track needs the second position to be shown adjusted.
Accordingly, as shown in Fig. 2 the live annotation method that the present embodiment provides includes：
S201, the first touch path obtained corresponding to the touch operation that this end subscriber is acted on local terminal touch-screen are believed Breath.
S202, the first comment track according to corresponding to the described first touch routing information draws the touch operation, and to The displaying terminal that connection is established with local terminal sends the first touch routing information, so that the displaying terminal is according to described first Touch routing information and be plotted in the second annotation track that the displaying terminal is shown.
S203, give the first comment track to this end subscriber by screen shows.
S204, the event being moved in response to monitoring local terminal camera, obtain local terminal camera mobile message with And the first comment track with being shown in local terminal screen it is corresponding annotation scenery depth of view information.
In the present embodiment, local terminal can be monitored by the accelerometer in local terminal or local terminal camera and gyroscope Whether camera is moved, and now, if accelerometer or gyroscope are non-zero values, can be determined that local terminal camera occurs It is mobile.
Exemplary, the mobile message of local terminal camera can be the moving distance information of local terminal camera, and it can be with base Obtained in the detection numerical computations of accelerometer, the numerical value (x, y, z) that can be such as detected to accelerometer is integrated twice The distance L1=(Lx1, Ly1, Lz1) of local terminal camera movement is obtained, so that it is determined that the mobile message of local terminal camera.Further Ground, in order to improve the accuracy of the displacement of resulting local terminal camera, it is worth to by the testing number of accelerometer , can also be using the anglec of rotation (α x, the α y, α of the local terminal camera that gyroscope detects after the distance of local terminal camera movement Z) distance of resulting movement is modified, and this is obtained according to revised displacement L2=(Lx2, Ly2, Lz2) The mobile message of camera is held, wherein, x directions are the pixel row direction of local terminal screen, and y directions are the pixel column side of local terminal screen To z directions are the direction of plane where vertical local terminal screen.
Exemplary, the depth of view information of local terminal camera can be annotation scenery corresponding to first comment and local terminal camera Range information, it can be detected by range units such as laser distance sensor or infrared distance sensors and obtained (as first Display location based on annotation scenery in local terminal screen determines the physical location of annotation scenery, is then sent to the physical location Laser, infrared ray or radar etc. are to obtain annotating the range information of scenery and local terminal camera)；Can also be it is determined that first comment After corresponding annotation scenery i.e. by local terminal camera focusing at the annotation scenery, and according to the image distance and focal length of now camera The object distance of camera is determined, so that it is determined that depth of view information of the annotation scenery to the range information, i.e. local terminal camera of camera, this Place is not restricted.Wherein, annotating scenery can be determined according to setting rule, such as can be automatically by first comment track Scenery corresponding to heart point or the image of central area opening position comprising central point is defined as annotating scenery, and annotation is determined to reduce Operating procedure needed for scenery, or, after being completed in first comment track, prompt user to click on determination in local terminal screen Scenery is annotated, to improve accuracy when determining annotation scenery, is not restricted herein.Exemplary, based on first comment rail When scenery corresponding to the central area of mark determines annotation scenery, the pixel that can obtain the first comment track centers region is sat Mark, and image space in local terminal screen is defined as annotation scenery with the photographed that the pixel coordinate is consistent.Wherein, center The size in region can be arranged as required to, for example, can will centered on first comment track centers point and with first comment rail The area that pixel corresponding to pixel corresponding to mark central point adjacent 8 pixels and first comment track centers point forms Domain is defined as central area.
S205, determine that according to the mobile message and the depth of view information annotation scenery is first aobvious in local terminal screen Show the pixel offset value of position.
Wherein, the pixel coordinate that pixel offset value offsets for annotation scenery first display location.Exemplary, it is determined that criticizing , can be first by the moving distance information of camera when noting the pixel offset value of first display location of the scenery in local terminal screen Component and the depth of field numerical value of annotation scenery depth of view information in parallel to local terminal screen are divided by and negate to obtain the annotation scape The relative deviant of thing, then obtained relative deviant correction parameter corresponding with local terminal screen resolution is multiplied, so as to Obtain annotating the pixel offset value of scenery first display location in local terminal screen.Wherein, the depth of field of scenery depth of view information is annotated Numerical value is numerical value when annotating scenery depth of view information using foot as unit；Correction parameter can lead to corresponding to local terminal screen resolution Cross corresponding in advance using multigroup mobile message, depth of view information, pixel offset value training or induction and conclusion acquisition.
For example, it is assumed that component Lx2=4cm, Ly2=of the acquired mobile message in parallel to local terminal screen 6cm, the depth of view information D=20 feet of scenery are annotated, correction parameter C=10 pixels/cm, then may be used corresponding to local terminal screen resolution With first by component of the mobile message on local terminal screen pixels row and pixel column direction respectively with annotating the depth of view information of scenery Depth of field numerical value be divided by and negate to obtain two components of the relative deviant of annotation scenery on pixel column and pixel column direction： Lx3=-Lx2/D=-4cm/20=-0.2cm, Ly3=-Ly2/D=-6cm/20=-0.3cm, i.e., with respect to deviant L3= (Lx3, Ly3)=(- 0.2, -0.3) (unit cm), then this is multiplied with respect to deviant with correction parameter, obtains annotating scenery Pixel offset value X=-0.2 × 10=-2 (pixel) of first display location on local terminal screen pixels line direction, and, annotation Pixel offset value Y=-0.3 × 10=-3 (pixel) of the display location of scenery first on local terminal screen pixels column direction.
S206, based on first comment track described in the pixel offset value and current time in local terminal screen second Display location determines that the first comment track needs the first position to be shown adjusted.
In the present embodiment, it can not consider to annotate the size of scenery position offset amplitude, as long as camera position moves It is dynamic that the second display location of first comment track is adjusted；Can also be only when annotation scenery position offset amplitude be smaller Second display location of first comment track is adjusted.In view of the practicality of position adjustments, optionally, can only criticize The generic pixel deviant of note scenery adjusts the second display location of first comment track when being less than given threshold.Wherein, relatively Pixel offset value can be the quadratic sum of two component of the pixel offset value on local terminal screen pixels row and pixel column direction, if Determining threshold value can be configured as needed by user or developer.Now, can after it is determined that annotating the pixel offset value of scenery With first according to determining component of the resulting pixel offset value on local terminal screen pixels line direction and pixel column direction Generic pixel deviant corresponding to pixel offset value；If the generic pixel deviant is less than or equal to setting offset threshold, The pixel coordinate of first comment track corresponding each pixel in local terminal screen is added with the pixel offset value respectively, with Obtain the first position to be shown of first comment track.
For example, it is assumed that the annotation display location of scenery first is on local terminal screen pixels line direction and pixel column direction Pixel offset value is respectively X=-2, Y=-3, given threshold 50, and the pixel of a certain pixel corresponding to first comment track is sat P1=(20,30) is designated as, then can calculate generic pixel deviant N=X × X+Y × Y=4+9=13 of the pixel first, Due to 13<50, therefore, can further calculate the pixel adjustment after corresponding pixel coordinate be P2=(20-2,30-3)= (18,27), the like, you can obtain the pixel coordinate after all pixels point adjustment corresponding to first comment track.
S207, that second display location of the first comment track in local terminal screen is adjusted into described first is to be shown Position, and first position to be shown is sent to the displaying terminal that connection is established with local terminal, so that the displaying terminal is based on First position to be shown determines that the second annotation track needs the second position to be shown adjusted in the displaying terminal screen Put.
Exemplary, when adjusting second display location of a certain first comment track in local terminal screen, can delete The first comment track of original display in local terminal screen, and repaint the first comment track in the first opening position to be shown； Or, it is contemplated that continuity during the second annotation track display location adjustment, can also be directly according to the first setting move mode First comment track at the second display location is moved to the first opening position to be shown, so as to realize the first comment Second display location of the track in local terminal screen is adjusted to the first display location.The present embodiment is not to adjustment first comment track The operation of the first display location limited with the execution sequence of operation to the first position to be shown of displaying terminal transmission, examine Consider the real-time of the second annotation track position regulation, preferably send the first position to be shown to displaying terminal first.Here, this It is understood that some position can not be sent, described herein " connects art personnel to being established with local terminal Displaying terminal send first position to be shown " in " the first display location " be the first display location pixel coordinate Etc. the abbreviation of relevant information.
The live annotation method that the embodiment of the present invention two provides, when being changed in the position of local terminal camera, is based on The range information of the change of camera position and annotation scenery and local terminal camera determines the pixel of annotation Scenery Imaging position Deviant, and based on the display location of pixel offset value regulation first comment track, can not only realize during live Live content is annotated, enable live terminal user clearly state its it is live during key content, reduce straight Broadcast the statement difficulty of terminal user；The accuracy of first comment track display location can also be improved, improves live terminal user Usage experience.
Embodiment three
The embodiment of the present invention three provides a kind of live annotation method.This method can be performed by live annotation device, Wherein the device can be realized by software and/or hardware, can typically be integrated in displaying terminal.Fig. 3 A are that the embodiment of the present invention three carries The schematic flow sheet of the live annotation method supplied, as shown in Figure 3A, this method includes：
S301, obtain the first touch routing information and described live sent with the live terminal that connection is established when front end Terminal and the pixel corresponding relation when front end, wherein, the pixel corresponding relation is each first picture in the live terminal screen Vegetarian refreshments and the corresponding relation when each second pixel in front-end screen.
In the present embodiment, connected when front end can be established by LAN or wide area network etc. with live terminal, accordingly, when The first touch routing information that front end can be sent by LAN or the live terminal of wide area network reception.Live terminal is with working as front end Pixel corresponding relation can be based on live terminal the first screen resolution information and the second screen resolution when front end Information determines, now, when obtaining live terminal with the pixel corresponding relation when front end, can first obtain and be established with working as front end The first screen resolution information and the second screen resolution information when front end of the live terminal of connection；Then according to First screen resolution information and second screen resolution information determine the live terminal and the pixel pair when front end It should be related to.
For example, such as Fig. 3 B so (including the annotation shown in first comment track 11, live terminal screen 1 in figure The first image 12, second annotation track 21 of scenery and the second image 22 when the annotation scenery shown in front-end screen 2), After the first screen resolution information and the second screen resolution information is obtained, according to live terminal and front end can be worked as first Screen resolution and default display rule determine live terminal screen 1 when the viewing area 23 in front-end screen 2, then The pixel that often row and each column include in the first screen resolution and the viewing area 23 based on live terminal determines live Terminal and the pixel corresponding relation when front end.Wherein, presetting display rule can be configured as needed, for example, default aobvious Show that rule could be arranged to ensure the picture in live terminal screen 1 when front-end screen 2 completely can be shown and had with equal proportion There is a viewing area of maximum, viewing area can be using default setting as positioned at center, left side or right side when front-end screen 2 etc., this Place is not restricted.
S302, the second touch of routing information and pixel corresponding relation determination when front end is touched according to described first Routing information.
Exemplary, routing information can be touched with first based on the pixel corresponding relation determination when front end and live terminal Corresponding each first pixel is in the second pixel corresponding in front-end screen, so that it is determined that second when front end touches path Information.For example, it is assumed that the first pixel coordinate for touching path corresponding a certain first pixel in live terminal is (X, Y), And in the pixel corresponding relation when front end and live terminal, live terminal pixel coordinate is working as front end for the pixel of (X, Y) Corresponding pixel points (X1, Y1), then it can determine that the second touch routing information is comprising pixel coordinate in the display location when front end The pixel of (X1, Y1), by that analogy, you can it is determined that second when front end touches routing information.
S303, the second annotation track shown when front end is plotted in based on the described second touch routing information, and by described in Worked as front end user by screen shows in the second annotation track.
Exemplary, the first touch routing information corresponding each first pixel in live terminal screen can be primarily based on The colouring information of point determines that the second touch routing information when the colouring information of each second pixel corresponding to front end, is then based on The colouring information is each second pixel Point Coloring corresponding to the second touch routing information, so as to realize painting for the second annotation track System.
The live annotation method that the embodiment of the present invention three provides, obtain and sent with the live terminal that connection is established when front end First touch routing information and the live terminal and the pixel corresponding relation when front end, touch road according to acquired first Footpath information and pixel corresponding relation determine the second touch routing information when front end, and routing information is touched according to identified second The the second annotation track shown when front end is plotted in, and by the second annotation track by being given when front end screen shows when front end is used Family.The present embodiment is by using above-mentioned technical proposal, it is possible to achieve live content is annotated during live, makes displaying Terminal user is more targeted when watching live, reduces the difficulty that displaying terminal user understands live key content, improves straight The bandwagon effect broadcast, improve the usage experience of displaying terminal user.
On the basis of above-described embodiment, the live annotation method that the present embodiment provides can also include：Receive and work as The photographed data that the live terminal of connection is sent is established in front end；It is true according to the live terminal and the pixel corresponding relation when front end The fixed photographed data is when the 3rd display location of front end；The photographed data is shown in the 3rd display location, wherein, Display layer corresponding to the photographed data corresponds to the lower section of display layer positioned at the described second annotation track.Exemplary, can be with base Closed in photographed data in the colouring information of each pixel corresponding to live terminal and live terminal with when the pixel of front end is corresponding System determines that photographed data when the colouring information of corresponding each pixel in the on-screen display (osd) area of front end, is then based on color letter Cease for when each pixel in the on-screen display (osd) area of front end is coloured, so as to realize photographed data when the display of front end.Its In, when front-end screen viewing area for live terminal screen when corresponding region in front-end screen.
Example IV
Fig. 4 is the schematic flow sheet for the live annotation method that the embodiment of the present invention four provides.The present embodiment is in above-mentioned reality Apply and optimize on the basis of example, further, touch routing information described based on described second and draw the second annotation track, And give the described second annotation track when the front end user after by screen shows, in addition to：Sent according to the live terminal The first position to be shown and the pixel corresponding relation determine that the second annotation track needs what is adjusted second to wait to show Show position；Described second annotation track is being adjusted to the described second position to be shown when the 4th display location in front-end screen Put.
Accordingly, as shown in figure 4, the live annotation method that the present embodiment provides includes：
S401, obtain the first touch routing information and described live sent with the live terminal that connection is established when front end Terminal and the pixel corresponding relation when front end, wherein, the pixel corresponding relation is each first picture in the live terminal screen Vegetarian refreshments and the corresponding relation when each second pixel in front-end screen.
S402, the second touch of routing information and pixel corresponding relation determination when front end is touched according to described first Routing information.
S403, the second annotation track shown when front end is plotted in based on the described second touch routing information, and by described in Worked as front end user by screen shows in the second annotation track.
Described in S404, the first position to be shown sent according to the live terminal and pixel corresponding relation determination Second annotation track needs the second position to be shown adjusted.
It is exemplary, can based on when the pixel corresponding relation of front end and live terminal determine in live terminal screen the One position to be shown is needing the display adjusted when corresponding second position to be shown in front-end screen, i.e., the second annotation track Position.For example, it is assumed that the pixel coordinate of the first position to be shown corresponding a certain first pixel in live terminal for (A, B), and in the pixel corresponding relation when front end and live terminal, live terminal pixel coordinate is the pixel of (A, B) current Corresponding pixel points (A1, B1) are held, then the first position to be shown in live terminal screen can be determined when right in front-end screen The second position to be shown answered includes the pixel that pixel coordinate is (A1, B1), by that analogy, you can determine the second annotation track Need the whole pixel coordinates of the second position to be shown adjusted.
Herein, it should be pointed out that the second position to be shown that second batch note track needs to adjust is not limited to according to straight The first position to be shown and live terminal for broadcasting terminal transmission determine with the pixel corresponding relation when front end, in the present embodiment, Scenery can also be annotated according to current time and determine that the second annotation track needs regulation to arrive when the display location in front-end screen The second position to be shown, be not restricted herein.
S405, by described second annotation track wait to show when the 4th display location in front-end screen is adjusted to described second Show position.
Exemplary, a certain second annotation track is being adjusted when when four display location in front-end screen, can deleted Except when shown in front-end screen second annotation track, and the second position to be shown again to this second annotation track paint System；Or, it is contemplated that continuity during the second annotation track display location adjustment, can also be directly according to the second setting movement side The second annotation track at the 4th display location is moved to the second opening position to be shown by formula, and the second batch is adjusted to reach Track is noted when the purpose of the 4th display location in front-end screen.
The live annotation method that the embodiment of the present invention four provides, it is right when being changed in live terminal camera position The display location that track is annotated when second shown in front-end screen is adjusted, and can not only be realized during live to straight Broadcast content to be annotated, make displaying terminal user more targeted when watching live, it is live to reduce displaying terminal user understanding The difficulty of key content, improve live bandwagon effect；The accuracy of the second annotation track display location can also be improved, is improved The usage experience of displaying terminal user.
Embodiment five
The embodiment of the present invention five provides a kind of live annotation device.The device can realize by software and/or hardware, one As can be integrated in live terminal, batch to the live picture during live can be realized by performing live annotation method Note.Fig. 5 is the structured flowchart for the live annotation device that the embodiment of the present invention five provides, as shown in figure 5, the device includes：
Routing information acquisition module 501, for obtain this end subscriber act on local terminal touch-screen touch operation institute it is right First answered touches routing information；
First comment drafting module 502, it is corresponding for touching the routing information drafting touch operation according to described first First comment track, and to local terminal establish connection displaying terminal send it is described first touch routing information so that described What displaying terminal was plotted in that the displaying terminal show according to the described first touch routing information second annotates track；
First comment display module 503, for giving the first comment track to this end subscriber by screen shows.
The live annotation device that the embodiment of the present invention five provides, passage path data obtaining module obtain this end subscriber work Routing information is touched with first corresponding to the touch operation on local terminal touch-screen, by first comment drafting module according to this First, which touches routing information, draws first comment track corresponding to user's touch operation and establishes the displaying connected end to local terminal End sends the first touch routing information, and the first comment track of drafting is passed through into local terminal screen by first comment display module Show this end subscriber.The present embodiment is by using above-mentioned technical proposal, it is possible to achieve live content is entered during live Row annotation, enable live terminal user clearly state its it is live during key content, reduce live terminal user's Difficulty is stated, improves the usage experience of live terminal user.
Further, the live annotation device that the present embodiment provides can also include：First shooting data disaply moudle, For obtaining the photographed data of local terminal camera；The photographed data is shown in local terminal screen, and is connected to being established with local terminal Displaying terminal send the photographed data so that the displaying terminal shows that rule shows the photographed data according to setting, Wherein, the photographed data corresponding display layer in local terminal screen is located at the first comment track and corresponded under display layer Side.
Further, the live annotation device that the present embodiment provides can also include：First display location adjusting module, For it is described by the first comment track by screen shows give this end subscriber after, in response to monitoring local terminal camera The event being moved, the change of the first display location based on annotation scenery in local terminal screen adjust the first comment rail Second display location of the mark in local terminal screen, the annotation scenery is scenery corresponding to the first comment track.
In such scheme, first display location adjusting module can include：Information acquisition unit, for monitoring When being moved to local terminal camera, the mobile message of local terminal camera and the first comment with being shown in local terminal screen are obtained The depth of view information of annotation scenery corresponding to track；Pixel offset value determining module, for according to the mobile message and described Depth of view information determines the pixel offset value of first display location of the annotation scenery in local terminal screen；First position determining module, For the second display location based on first comment track described in the pixel offset value and current time in local terminal screen Determine that the first comment track needs the first position to be shown adjusted；First position adjusting module, for by described Second display location of the one annotation track in local terminal screen is adjusted to the described first position to be shown, and connects to being established with local terminal The displaying terminal connect sends first position to be shown, so that the displaying terminal is based on the described first position to be shown and determined The second annotation track needs the second position to be shown adjusted in the displaying terminal screen.
In such scheme, the live annotation method that the present embodiment provides can also include：Scenery determining module is annotated, Sat for obtaining the pixel coordinate in the first comment track centers region, and by image space in local terminal screen and the pixel The photographed being consistent is marked to be defined as annotating scenery.
The live annotation device that the embodiment of the present invention five provides can perform the live of any embodiment offer of the present invention Annotation method, possess and perform the live corresponding functional module of annotation method and beneficial effect.It is not detailed in the present embodiment to retouch The ins and outs stated, reference can be made to the live annotation method that any embodiment of the present invention is provided.
Embodiment six
The embodiment of the present invention six provides a kind of live annotation device.The device can realize by software and/or hardware, one As can be integrated in displaying terminal, batch to the live picture during live can be realized by performing live annotation method Note.Fig. 6 is the structured flowchart for the live annotation device that the embodiment of the present invention six provides, as shown in fig. 6, the device includes：
Data obtaining module 601, path is touched for obtaining sent with the live terminal that connection is established when front end first Information and the live terminal and the pixel corresponding relation when front end, wherein, the pixel corresponding relation is the live end Hold each first pixel and the corresponding relation when each second pixel in front-end screen in screen；
Routing information determining module 602, for touching routing information and the pixel corresponding relation according to described first It is determined that second when front end touches routing information；
Second annotation display module 603, for based on the described second touch routing information be plotted in when front end show the Two annotation tracks, and front end user is worked as into the described second annotation track by screen shows.
The live annotation device that the embodiment of the present invention five provides, obtained by data obtaining module and connected with being established when front end The the first touch routing information and the live terminal and the pixel corresponding relation when front end that the live terminal connect is sent, pass through road Footpath information determination module touches routing information according to acquired first and pixel corresponding relation is determined when the second of front end touches Routing information, by the second annotation display module according to determined by second touch routing information be plotted in when front end show the Two annotation tracks, and by the second annotation track by being worked as front end user when front end screen shows.The present embodiment by using Above-mentioned technical proposal, it is possible to achieve annotated during live to live content, make displaying terminal user live in viewing When it is more targeted, reduce the difficulty that displaying terminal user understands live key content, improve live bandwagon effect, improve exhibition Show the usage experience of terminal user.
Further, the live annotation device that the present embodiment provides can also include：Photographed data receiving module, is used for Receive the photographed data sent with the live terminal that connection is established when front end；Display location determining module, for according to described straight Broadcast terminal determines the photographed data when the 3rd display location of front end with the pixel corresponding relation when front end；Photographed data shows Show module, for showing the photographed data in the 3rd display location, wherein, display layer position corresponding to the photographed data The lower section of display layer is corresponded in the described second annotation track.
In such scheme, the live annotation device that the present embodiment provides can also include：Second place determining module, For touching the second annotation of routing information drafting track based on described second described, and the described second annotation track is passed through into screen Curtain is showed after front end user, and the first position to be shown and the pixel sent according to the live terminal is corresponding to close System determines that the second annotation track needs the second position to be shown adjusted；Second place adjusting module, for by described in Second annotation track is being adjusted to the described second position to be shown when the 4th display location in front-end screen.
Further, the live annotation device that the present embodiment provides can also include：Resolution information acquisition module, use In the first screen resolution information for obtaining the live terminal with establishing connection when front end and when the second screen of front end is differentiated Rate information；Corresponding relation determining module, for according to first screen resolution information and second screen resolution Information determines the live terminal and the pixel corresponding relation when front end.
The live annotation device that the embodiment of the present invention six provides can perform the live of any embodiment offer of the present invention Annotation method, possess and perform the live corresponding functional module of annotation method and beneficial effect.It is not detailed in the present embodiment to retouch The ins and outs stated, reference can be made to the live annotation method that any embodiment of the present invention is provided.
Embodiment seven
Fig. 7 is a kind of structural representation for live terminal that the embodiment of the present invention seven provides, as shown in fig. 7, the live end End includes processor 70 and memory 71, can also include input unit 72 and output device 73；Processor 70 in live terminal Quantity can be one or more, in Fig. 7 by taking a processor 70 as an example；Processor 70, memory 71 in live terminal, Input unit 72 can be connected with output device 73 by bus or other modes, in Fig. 7 exemplified by being connected by bus.
Memory 71 is used as a kind of computer-readable recording medium, and journey is can perform available for storage software program, computer Sequence and module, programmed instruction/module is (for example, routing information obtains as corresponding to the theme update method in the embodiment of the present invention Modulus block 501, first comment drafting module 502 and first comment display module 503).Processor 70 is stored in by operation Software program, instruction and module in reservoir 71, so as to perform the various function application of live terminal and data processing, i.e., Realize above-mentioned theme update method.
Memory 71 can mainly include storing program area and storage data field, wherein, storing program area can store operation system Application program needed for system, at least one function；Storage data field can store uses created data etc. according to terminal.This Outside, memory 71 can include high-speed random access memory, can also include nonvolatile memory, for example, at least a magnetic Disk storage device, flush memory device or other non-volatile solid state memory parts.In some instances, memory 71 can be further Including network connection to live terminal can be passed through relative to the remotely located memory of processor 70, these remote memories. The example of above-mentioned network includes but is not limited to internet, intranet, LAN, mobile radio communication and combinations thereof.
Input unit 72 can be used for the numeral or character information for receiving input, and produces and set with the user of live terminal And the key signals input that function control is relevant.Output device 73 may include the display devices such as display screen.
Embodiment eight
Fig. 8 is a kind of structural representation for displaying terminal that the embodiment of the present invention eight provides, as shown in figure 8, the displaying is whole End includes processor 80 and memory 81, can also include input unit 82 and output device 83；Processor 80 in displaying terminal Quantity can be one or more, in Fig. 8 by taking a processor 80 as an example；Processor 80, memory 81 in displaying terminal, Input unit 82 can be connected with output device 83 by bus or other modes, in Fig. 8 exemplified by being connected by bus.
Memory 81 is used as a kind of computer-readable recording medium, and journey is can perform available for storage software program, computer Sequence and module, programmed instruction/module is (for example, acquisition of information mould as corresponding to the theme update method in the embodiment of the present invention Block 601, routing information determining module 602 and second annotate display module 603).Processor 80 is stored in memory by operation Software program, instruction and module in 81, so as to perform the various function application of displaying terminal and data processing, that is, are realized Above-mentioned theme update method.
Memory 81 can mainly include storing program area and storage data field, wherein, storing program area can store operation system Application program needed for system, at least one function；Storage data field can store uses created data etc. according to terminal.This Outside, memory 81 can include high-speed random access memory, can also include nonvolatile memory, for example, at least a magnetic Disk storage device, flush memory device or other non-volatile solid state memory parts.In some instances, memory 81 can be further Including network connection to displaying terminal can be passed through relative to the remotely located memory of processor 80, these remote memories. The example of above-mentioned network includes but is not limited to internet, intranet, LAN, mobile radio communication and combinations thereof.
Input unit 82 can be used for the numeral or character information for receiving input, and produces and set with the user of displaying terminal And the key signals input that function control is relevant.Output device 83 may include the display devices such as display screen.
Embodiment nine
The embodiment of the present invention nine provides a kind of live broadcast system, and the live broadcast system can perform provided in an embodiment of the present invention live Annotation method.Fig. 9 is the structured flowchart for the live broadcast system that the present embodiment provides, as shown in figure 9, the live broadcast system is including live Terminal 1 and displaying terminal 2,
The live terminal 1, corresponding to the touch operation acted on for obtaining this end subscriber on local terminal touch-screen One touches routing information；The first comment track according to corresponding to described first touches the routing information drafting touch operation, and Described first is sent to the displaying terminal that connection is established with local terminal and touches routing information 2, so that the displaying terminal 2 is according to described First touch routing information is plotted in the second annotation track that the displaying terminal 2 is shown；The first comment track is passed through Screen shows give this end subscriber；
The displaying terminal 2, path letter is touched for obtaining sent with the live terminal 1 that connection is established when front end first Breath and the live terminal 1 and the pixel corresponding relation when front end, wherein, the pixel corresponding relation is the live terminal Each first pixel and the corresponding relation when each second pixel in front-end screen in 1 screen；Path is touched according to described first Information and the pixel corresponding relation are determined when the second of front end touches routing information；Routing information is touched based on described second The the second annotation track shown when front end is plotted in, and front end user is worked as into the described second annotation track by screen shows.
The live broadcast system that the embodiment of the present invention nine provides, live terminal obtain this end subscriber and acted on local terminal touch-screen First corresponding to touch operation touches routing information, according to corresponding to the first touch routing information draws user's touch operation First comment track simultaneously sends the first touch routing information to the displaying terminal that connection is established with local terminal, by first of drafting This end subscriber is given in note track by local terminal screen shows；Accordingly, displaying terminal touches routing information according to first received It is plotted in the second annotation track that displaying terminal is shown and presents it to displaying terminal user.The present embodiment is by using above-mentioned Technical scheme, it is possible to achieve live content is annotated during live, make displaying terminal user watch it is live when more Targetedly, live bandwagon effect is improved.
Pay attention to, above are only presently preferred embodiments of the present invention and institute's application technology principle.It will be appreciated by those skilled in the art that The invention is not restricted to specific embodiment described here, can carry out for a person skilled in the art various obvious changes, Readjust and substitute without departing from protection scope of the present invention.Therefore, although being carried out by above example to the present invention It is described in further detail, but the present invention is not limited only to above example, without departing from the inventive concept, also Other more equivalent embodiments can be included, and the scope of the present invention is determined by scope of the appended claims.

Claims (14)

  1. A kind of 1. live annotation method, it is characterised in that including：
    Obtain first corresponding to the touch operation that this end subscriber is acted on local terminal touch-screen and touch routing information；
    The first comment track according to corresponding to described first touches the routing information drafting touch operation, and established to local terminal The displaying terminal of connection sends described first and touches routing information, believes so that the displaying terminal touches path according to described first Breath is plotted in the second annotation track that the displaying terminal is shown；
    The first comment track is given to this end subscriber by screen shows.
  2. 2. according to the method for claim 1, it is characterised in that also include：
    Obtain the photographed data of local terminal camera；
    The photographed data is shown in local terminal screen, and the shooting number is sent to the displaying terminal that connection is established with local terminal According to, so that the displaying terminal shows that rule shows the photographed data according to setting, wherein, the photographed data is in local terminal screen Corresponding display layer is located at the lower section that the first comment track corresponds to display layer in curtain.
  3. 3. according to the method for claim 2, it is characterised in that the first comment track is passed through into screen shows described To after this end subscriber, in addition to：
    The event being moved in response to monitoring local terminal camera, the first display position based on annotation scenery in local terminal screen The change put adjusts second display location of the first comment track in local terminal screen, and the annotation scenery is described first Annotate scenery corresponding to track.
  4. 4. according to the method for claim 3, it is characterised in that described first aobvious based on annotation scenery in local terminal screen Show that the change of position adjusts second display location of the first comment track in local terminal screen, including：
    Obtain the mobile message of local terminal camera and the first comment track with being shown in local terminal screen is corresponding annotates scenery Depth of view information；
    First display location of the annotation scenery in local terminal screen is determined according to the mobile message and the depth of view information Pixel offset value；
    The second display location based on first comment track described in the pixel offset value and current time in local terminal screen Determine that the first comment track needs the first position to be shown adjusted；
    Second display location of the first comment track in local terminal screen is adjusted to the described first position to be shown, and to The displaying terminal that connection is established with local terminal sends first position to be shown, so that the displaying terminal is treated based on described first Display location determines that the second annotation track needs the second position to be shown adjusted in the displaying terminal screen.
  5. 5. according to the method for claim 3, it is characterised in that also include：
    The pixel coordinate in the first comment track centers region is obtained, and image space in local terminal screen and the pixel are sat The photographed being consistent is marked to be defined as annotating scenery.
  6. A kind of 6. live annotation method, it is characterised in that including：
    Obtain first sent with the live terminal that connection is established when front end and touch routing information and the live terminal with working as The pixel corresponding relation of front end, wherein, the pixel corresponding relation is each first pixel in the live terminal screen with working as The corresponding relation of each second pixel in front-end screen；
    Routing information is touched according to described first and the pixel corresponding relation is determined when the second of front end touches routing information；
    The the second annotation track shown when front end is plotted in based on the described second touch routing information, and rail is annotated by described second Mark is worked as front end user by screen shows.
  7. 7. according to the method for claim 6, it is characterised in that also include：
    Receive the photographed data sent with the live terminal that connection is established when front end；
    Determine the photographed data when the 3rd display of front end with working as the pixel corresponding relation of front end according to the live terminal Position；
    The photographed data is shown in the 3rd display location, wherein, display layer corresponding to the photographed data is positioned at described Second annotation track corresponds to the lower section of display layer.
  8. 8. according to the method for claim 7, it is characterised in that touch routing information described based on described second and draw the Two annotation tracks, and will the described second annotation track by screen shows to when the front end user after, in addition to：
    The first position to be shown and the pixel corresponding relation sent according to the live terminal determines second annotation Track needs the second position to be shown adjusted；
    Described second annotation track is being adjusted to the described second position to be shown when the 4th display location in front-end screen.
  9. 9. according to the method for claim 6, it is characterised in that also include：
    Obtain the first screen resolution information of the live terminal with establishing connection when front end and the second screen point when front end Resolution information；
    Determine the live terminal with working as according to first screen resolution information and second screen resolution information The pixel corresponding relation of front end.
  10. A kind of 10. live annotation device, it is characterised in that including：
    Routing information acquisition module, first corresponding to touch operation acted on for obtaining this end subscriber on local terminal touch-screen Touch routing information；
    First comment drafting module, for according to described first touch routing information draw the touch operation corresponding to first Track is noted, and sends described first to the displaying terminal that connection is established with local terminal and touches routing information, so that the displaying terminal Be plotted in that the displaying terminal show according to the described first touch routing information second annotates track；
    First comment display module, for giving the first comment track to this end subscriber by screen shows.
  11. A kind of 11. live annotation device, it is characterised in that including：
    Data obtaining module, for obtain with when front end establish connection live terminal send first touch routing information and The live terminal and the pixel corresponding relation when front end, wherein, the pixel corresponding relation is in the live terminal screen Each first pixel and the corresponding relation when each second pixel in front-end screen；
    Routing information determining module, for touching routing information and pixel corresponding relation determination currently according to described first The second of end touches routing information；
    Second annotation display module, for being plotted in the second annotation rail shown when front end based on the described second touch routing information Mark, and front end user is worked as into the described second annotation track by screen shows.
  12. 12. a kind of live terminal, it is characterised in that the live terminal includes：
    One or more processors；
    Memory, for storing one or more programs,
    When one or more of programs are by one or more of computing devices so that one or more of processors are real The now live annotation method as described in any in claim 1-5.
  13. 13. a kind of displaying terminal, it is characterised in that the displaying terminal includes：
    One or more processors；
    Memory, for storing one or more programs,
    When one or more of programs are by one or more of computing devices so that one or more of processors are real The now live annotation method as described in any in claim 6-9.
  14. A kind of 14. live broadcast system, it is characterised in that including live terminal and displaying terminal,
    The live terminal, first corresponding to the touch operation acted on for obtaining this end subscriber on local terminal touch-screen touches Routing information；According to described first touch routing information draw the touch operation corresponding to first comment track, and to this The displaying terminal that connection is established at end sends the first touch routing information, so that the displaying terminal touches according to described first Routing information is plotted in the second annotation track that the displaying terminal is shown；The first comment track is given by screen shows This end subscriber；
    The displaying terminal, for obtain with when front end establish connection live terminal send first touch routing information and The live terminal and the pixel corresponding relation when front end, wherein, the pixel corresponding relation is in the live terminal screen Each first pixel and the corresponding relation when each second pixel in front-end screen；According to described first touch routing information and The pixel corresponding relation is determined when the second of front end touches routing information；It is plotted in and is worked as based on the described second touch routing information The second annotation track that front end is shown, and front end user is worked as into the described second annotation track by screen shows.
CN201710677122.8A 2017-08-09 2017-08-09 Live broadcasting annotation method and device, terminal and live broadcasting system Active CN107454433B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201710677122.8A CN107454433B (en) 2017-08-09 2017-08-09 Live broadcasting annotation method and device, terminal and live broadcasting system
PCT/CN2017/116790 WO2019029087A1 (en) 2017-08-09 2017-12-17 Live broadcast annotation method and apparatus, terminal, and live broadcast system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710677122.8A CN107454433B (en) 2017-08-09 2017-08-09 Live broadcasting annotation method and device, terminal and live broadcasting system

Publications (2)

Publication Number Publication Date
CN107454433A true CN107454433A (en) 2017-12-08
CN107454433B CN107454433B (en) 2020-08-04

Family

ID=60491888

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710677122.8A Active CN107454433B (en) 2017-08-09 2017-08-09 Live broadcasting annotation method and device, terminal and live broadcasting system

Country Status (2)

Country Link
CN (1) CN107454433B (en)
WO (1) WO2019029087A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108366238A (en) * 2018-02-08 2018-08-03 广州视源电子科技股份有限公司 Image processing method, system, readable storage medium storing program for executing and electronic equipment
CN108459836A (en) * 2018-01-19 2018-08-28 广州视源电子科技股份有限公司 Annotate display methods, device, equipment and storage medium
WO2019029087A1 (en) * 2017-08-09 2019-02-14 广州视源电子科技股份有限公司 Live broadcast annotation method and apparatus, terminal, and live broadcast system
CN111147880A (en) * 2019-12-30 2020-05-12 广州华多网络科技有限公司 Interaction method, device and system for live video, electronic equipment and storage medium
CN111176603A (en) * 2019-12-31 2020-05-19 海信视像科技股份有限公司 Image display method for display equipment and display equipment
CN112579025A (en) * 2019-09-30 2021-03-30 广州视源电子科技股份有限公司 Courseware annotating method, system, device and storage medium
CN113419693A (en) * 2021-05-17 2021-09-21 广州佰锐网络科技有限公司 Multi-user track synchronous display method and system
WO2022134058A1 (en) * 2020-12-25 2022-06-30 京东方科技集团股份有限公司 Writing method and system
CN115134318A (en) * 2022-06-16 2022-09-30 王蕾茜 Application program and chatting method capable of realizing synchronous same-screen real-time hand drawing by user
CN116248912A (en) * 2023-05-12 2023-06-09 南京维赛客网络科技有限公司 Method, system and storage medium for annotating live streaming picture in real time

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130290872A1 (en) * 2012-04-26 2013-10-31 Samsung Electronics Co., Ltd. Method and apparatus for sharing presentation data and annotation
CN105187930A (en) * 2015-09-18 2015-12-23 广州酷狗计算机科技有限公司 Video live broadcasting-based interaction method and device
CN105573702A (en) * 2015-12-16 2016-05-11 广州视睿电子科技有限公司 Remote headnote moving and scaling synchronization method and system
CN106203300A (en) * 2016-06-30 2016-12-07 北京小米移动软件有限公司 Content item display packing and device
CN106843797A (en) * 2017-03-13 2017-06-13 广州视源电子科技股份有限公司 The edit methods and device of a kind of image file

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105446689B (en) * 2015-12-16 2018-12-07 广州视睿电子科技有限公司 The synchronous method and system of long-range annotation
CN107454433B (en) * 2017-08-09 2020-08-04 广州视源电子科技股份有限公司 Live broadcasting annotation method and device, terminal and live broadcasting system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130290872A1 (en) * 2012-04-26 2013-10-31 Samsung Electronics Co., Ltd. Method and apparatus for sharing presentation data and annotation
CN105187930A (en) * 2015-09-18 2015-12-23 广州酷狗计算机科技有限公司 Video live broadcasting-based interaction method and device
CN105573702A (en) * 2015-12-16 2016-05-11 广州视睿电子科技有限公司 Remote headnote moving and scaling synchronization method and system
CN106203300A (en) * 2016-06-30 2016-12-07 北京小米移动软件有限公司 Content item display packing and device
CN106843797A (en) * 2017-03-13 2017-06-13 广州视源电子科技股份有限公司 The edit methods and device of a kind of image file

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019029087A1 (en) * 2017-08-09 2019-02-14 广州视源电子科技股份有限公司 Live broadcast annotation method and apparatus, terminal, and live broadcast system
CN108459836A (en) * 2018-01-19 2018-08-28 广州视源电子科技股份有限公司 Annotate display methods, device, equipment and storage medium
CN108459836B (en) * 2018-01-19 2019-05-31 广州视源电子科技股份有限公司 Annotate display methods, device, equipment and storage medium
US11301200B2 (en) 2018-01-19 2022-04-12 Guangzhou Shiyuan Electronics Co., Ltd. Method of providing annotation track on the content displayed on an interactive whiteboard, computing device and non-transitory readable storage medium
CN108366238A (en) * 2018-02-08 2018-08-03 广州视源电子科技股份有限公司 Image processing method, system, readable storage medium storing program for executing and electronic equipment
CN112579025A (en) * 2019-09-30 2021-03-30 广州视源电子科技股份有限公司 Courseware annotating method, system, device and storage medium
CN112579025B (en) * 2019-09-30 2023-12-12 广州视源电子科技股份有限公司 Annotating method, system, equipment and storage medium for courseware
CN111147880A (en) * 2019-12-30 2020-05-12 广州华多网络科技有限公司 Interaction method, device and system for live video, electronic equipment and storage medium
CN111176603A (en) * 2019-12-31 2020-05-19 海信视像科技股份有限公司 Image display method for display equipment and display equipment
WO2022134058A1 (en) * 2020-12-25 2022-06-30 京东方科技集团股份有限公司 Writing method and system
CN115349114A (en) * 2020-12-25 2022-11-15 京东方科技集团股份有限公司 Writing method and system
CN115349114B (en) * 2020-12-25 2024-04-16 京东方科技集团股份有限公司 Writing method and system
CN113419693A (en) * 2021-05-17 2021-09-21 广州佰锐网络科技有限公司 Multi-user track synchronous display method and system
CN115134318A (en) * 2022-06-16 2022-09-30 王蕾茜 Application program and chatting method capable of realizing synchronous same-screen real-time hand drawing by user
CN116248912A (en) * 2023-05-12 2023-06-09 南京维赛客网络科技有限公司 Method, system and storage medium for annotating live streaming picture in real time

Also Published As

Publication number Publication date
CN107454433B (en) 2020-08-04
WO2019029087A1 (en) 2019-02-14

Similar Documents

Publication Publication Date Title
CN107454433A (en) Live annotation method and device, terminal and live broadcast system
US20220319139A1 (en) Multi-endpoint mixed-reality meetings
US10600253B2 (en) Information processing apparatus, information processing method, and program
US20120192088A1 (en) Method and system for physical mapping in a virtual world
CN103871092A (en) Display control device, display control method and program
KR20140096109A (en) Spatial bookmarking
CN110286754A (en) Projective techniques and relevant device based on eyeball tracking
Jiang et al. A SLAM-based 6DoF controller with smooth auto-calibration for virtual reality
CN108710460A (en) element control method, device, equipment and storage medium
CN102880361B (en) The location calibration steps of electronic white board equipment
CN107291272A (en) Cursor position determination and method, device and the relevant device of image capture
Medien Implementation of a low cost marker based infrared optical tracking system
CN109255997A (en) A kind of electronic teaching material is prepared lessons teaching methods and device
CN107957824A (en) A kind of exchange method intelligently projected, device and system
CN114827686A (en) Recording data processing method and device and electronic equipment
CN113780051A (en) Method and device for evaluating concentration degree of student
CN110365959A (en) Projecting method, device, system and projection device
KR20150145303A (en) Multiview telepresence service providing method and apparaus thereof
Méndez et al. Natural interaction in virtual TV sets through the synergistic operation of low-cost sensors
US20230137560A1 (en) Assistance system and method for guiding exercise postures in live broadcast
CN104268379B (en) Digital panorama based three-dimensional indoor ranging system and device
KR102623534B1 (en) Remote lecture system that enables active class participation
TWI765398B (en) Indication icon sharing method, indication signal control method and indication signal processing device
Ciofi et al. Very Simple and Inexpensive System for Distance Learning with the Use of Chalkboard
KR101519590B1 (en) Interactive electronic board based motion capture and method for employing the board

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant