CN107333087A - A kind of information sharing method and device based on video session - Google Patents
A kind of information sharing method and device based on video session Download PDFInfo
- Publication number
- CN107333087A CN107333087A CN201710500964.6A CN201710500964A CN107333087A CN 107333087 A CN107333087 A CN 107333087A CN 201710500964 A CN201710500964 A CN 201710500964A CN 107333087 A CN107333087 A CN 107333087A
- Authority
- CN
- China
- Prior art keywords
- mark
- image
- information
- marked
- request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/7867—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/169—Annotation, e.g. comment data or footnotes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/835—Generation of protective data, e.g. certificates
- H04N21/8352—Generation of protective data, e.g. certificates involving content or source identification data, e.g. Unique Material Identifier [UMID]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8455—Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
Abstract
The embodiments of the invention provide a kind of information sharing method and device based on video session, methods described includes：During video session, the mark request that receiving terminal is sent；It is determined that a two field picture corresponding with the mark request, is used as image to be marked；Receive what the terminal was sent, with the mark corresponding markup information of request；Position corresponding with the markup information is labeled in the image to be marked, generation mark image；Send the mark image；Pass through the embodiment of the present invention so that when being labeled during video session, it is thus only necessary to send markup information, mark image is generated by server, so as to realize many people while being labeled, and the shared accuracy of markup information is ensure that, improve the efficiency being labeled.
Description
Technical field
The present invention relates to data processing field, more particularly to a kind of information sharing method and one kind based on video session
Information sharing apparatus based on video session.
Background technology
With the development of network technology, the demand that user carries out video session is also more and more, and video session is except application
In terms of amusement, also there are very big application, such as long-distance service, the applied field of tele-medicine remote guide in actual work
Scape.
During remote guide is carried out using video session, in addition to the immediate communication exchange of video, voice, user
By the operation being labeled on some picture of video session, remote guide can be enabled more accurate, more straight
Describe the problem with seeing.
And in current mask method, it is most of both for the one-to-one scene for being labeled guidance, usually use
Family is labeled in some terminal, after forming the picture containing mark after the completion of mark, then will contain mark by terminal
Picture is sent, and this method can not be applied to the scene that many people are labeled simultaneously, so as to can not meet user's
Demand.
The content of the invention
In view of the above problems, it is proposed that the embodiment of the present invention overcomes above mentioned problem or solved at least in part to provide
A kind of information sharing method and a kind of information sharing apparatus based on video session based on video session of above mentioned problem.
In order to solve the above problems, the embodiment of the invention discloses a kind of information sharing method based on video session, institute
The method of stating includes：
During video session, the mark request that receiving terminal is sent；
It is determined that a two field picture corresponding with the mark request, is used as image to be marked；
Receive what the terminal was sent, with the mark corresponding markup information of request；
Position corresponding with the markup information is labeled in the image to be marked, generation mark image；
Send the mark image.
Preferably, the markup information includes the screen resolution and first position information of the terminal, described to be marked
Image carries image resolution ratio, and the position corresponding with the markup information in the image to be marked is labeled, raw
The step of into mark image, includes：
Based on the screen resolution and described image resolution ratio, conversion proportion is calculated；
According to the conversion proportion, the first position information is converted into second place information；
Information corresponding position in the second place is labeled described in the image to be marked, generation mark image.
Preferably, described during video session, the step of mark that receiving terminal is sent is asked includes：
During video session, the frame of video of real-time reception is sent using default first template；
When receiving the mark request of terminal transmission, the mark request is added in default mark queue.
Preferably, it is characterised in that it is described send it is described mark image the step of include：
Using default second template, the frame of video of the mark image and real-time reception is organized into a frame target figure
Picture；
Send the target image.
Preferably, methods described also includes：
When reaching preset stopping opportunity, stop the generation mark image, and send real-time using first template
The frame of video of reception.
Preferably, the preset stopping opportunity includes but is not limited to following at least one：
Receive mark clearance order；
In the mark queue after the completion of all mark request processing, and it is not received by preset time period new
Mark request.
Preferably, first template includes real-time video region, and second template includes real-time video region and mark
Note image-region.
The embodiment of the invention also discloses another information sharing method based on video session, methods described includes：
During video session, when detect user for image to be marked first operation when, sent to server
Mark request；
Receive the characteristic information of user's input；
Based on the characteristic information, markup information is generated；
The markup information is sent to the server, the server be used in the image to be marked with it is described
The corresponding position of markup information is labeled, generation mark image, and sends the mark image.
Preferably, described to be based on the characteristic information, the step of generating markup information includes：
Determine the first position information of the characteristic information；
Obtain the screen resolution of terminal；
The screen resolution and the first position information are organized into markup information.
Preferably, methods described also includes：
When the video content for detecting real-time frame of video is changed, generation mark clearance order；
The mark clearance order is sent to the server, so that the server stops the generation mark image,
And the frame of video of real-time reception is sent using default first template.
The embodiment of the invention also discloses another information sharing method based on video session, methods described includes：
During video session, the mark image that the reception server is sent；Wherein, the mark image is the service
Device is receiving the mark request of terminal transmission, and will be used as image to be marked with the corresponding two field picture of the mark request
Afterwards, the image that position corresponding with the markup information received is labeled and generated in the image to be marked；
Show the mark image.
The embodiment of the invention also discloses a kind of information sharing apparatus based on video session, described device includes：
Request receiving module is marked, for the mark request that during video session, receiving terminal is sent；
Image to be marked, for determining a two field picture corresponding with the mark request, is used as figure to be marked as module
Picture；
Markup information receiving module, sends for receiving the terminal, with the mark corresponding markup information of request；
Mark image generation module, in the image to be marked position corresponding with the markup information enter rower
Note, generation mark image；
Image sending module is marked, for sending the mark image.
The embodiment of the invention also discloses another information sharing apparatus based on video session, described device includes：
Request sending module is marked, for during video session, when detecting user for the of image to be marked
During one operation, the mark sent to server is asked；
Characteristic information receiving module, the characteristic information for receiving user's input；
Markup information generation module, for based on the characteristic information, generating markup information；
Markup information sending module, for the markup information to be sent to the server, the server is used for
Position corresponding with the markup information is labeled in the image to be marked, generation mark image, and sends the mark
Image.
The embodiment of the invention also discloses another information sharing apparatus based on video session, described device includes：
Image receiver module is marked, for during video session, the mark image that the reception server is sent；Wherein,
The mark image is that the server is receiving the mark request of terminal transmission, and will be with the mark request corresponding one
Two field picture, after image to be marked, rower is entered in position corresponding with the markup information received in the image to be marked
The image noted and generated；
Picture showing module is marked, for showing the mark image.
The embodiment of the present invention includes advantages below：
In embodiments of the present invention, by during video session receiving terminal send mark ask, it is determined that with mark
The corresponding two field picture of note request, as image to be marked, is then received with marking the corresponding markup information of request, to be marked
Position corresponding with markup information is labeled in image, generates and sends mark image so that enter during video session
When rower is noted simultaneously, it is thus only necessary to send markup information, mark image is generated by server, so as to realize that many people are carried out
Mark, and the shared accuracy of markup information is ensure that, improve the efficiency being labeled.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below by institute in the description to the embodiment of the present invention
The accompanying drawing needed to use is briefly described, it should be apparent that, drawings in the following description are only some implementations of the present invention
Example, for those of ordinary skill in the art, without having to pay creative labor, can also be according to these accompanying drawings
Obtain other accompanying drawings.
Fig. 1 is a kind of step flow chart of information sharing method based on video session of the embodiment of the present invention；
Fig. 2 is a kind of network topological diagram of the embodiment of the present invention；
Fig. 3 is a kind of schematic diagram of second template of the embodiment of the present invention；
Fig. 4 is the step flow chart of another information sharing method based on video session of the embodiment of the present invention；
Fig. 5 is the step flow chart of another information sharing method based on video session of the embodiment of the present invention；
Fig. 6 is a kind of structured flowchart of information sharing apparatus based on video session of the embodiment of the present invention；
Fig. 7 is the structured flowchart of another information sharing apparatus based on video session of the embodiment of the present invention；
Fig. 8 is the structured flowchart of another information sharing apparatus based on video session of the embodiment of the present invention.
Embodiment
In order to facilitate the understanding of the purposes, features and advantages of the present invention, it is below in conjunction with the accompanying drawings and specific real
Applying mode, the present invention is further detailed explanation.Obviously, described embodiment is a part of embodiment of the invention, without
It is whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art are not before creative work is made
The every other embodiment obtained is put, the scope of protection of the invention is belonged to.
Reference picture 1, shows a kind of step flow of information sharing method based on video session of the embodiment of the present invention
Figure.
In embodiments of the present invention, carrying out multiple terminals of video session can be connected with server, as shown in Fig. 2
Terminal 201 can be the terminal for sending real-time video, and terminal 202, terminal 203 can be the terminals for receiving video, and terminal 201 can
To obtain plug-flow from server 204, draw stream address, corresponding network connection is then set up, to be carried out with terminal 202, terminal 203
Video session.
It is described, is specifically may include steps of from server side below：
Step 101, during video session, the mark request that receiving terminal is sent；
After video session is set up, send the terminal of video by frame of video can be pushed to server by plug-flow address,
The frame of video received can be transmitted to the other-end in video session by server, and other-end is received can after frame of video
To show the corresponding video of frame of video.
When needing to be labeled using the user of some terminal, mark request can be sent by terminal to server,
Server can receive mark request.
It should be noted that the terminal for sending mark request can be sent the terminal of frame of video or regarded
Other any one terminals of frequency session, terminal be sent to server frame of video can terminal gathered in real time by camera
Frame of video or the frame of video prestored, the video flowing pusher that terminal can constitute frame of video are flowed to server,
The video stream that server can also constitute frame of video is to other-end.
In one preferred embodiment of the invention, step 101 can include following sub-step：
Sub-step S11, during video session, the frame of video of real-time reception is sent using default first template；
In embodiments of the present invention, server can pre-set the first template, and the first template can include real-time video
Region, the corresponding image of frame of video for showing server real-time reception.
After server receives frame of video, the frame of video of real-time reception can be sent to by carry out video using the first template
The other-end of session, other-end can show the corresponding image of frame of video after receiving the frame of video of server transmission.
Sub-step S12, when receiving the mark request of terminal transmission, default mark team is added by the mark request
In row.
During terminal shows the corresponding image of frame of video, user can ask to be labeled, as by clicking on screen
Curtain, press peripheral hardware keyboard, click on mouse, the trigger action such as Oscilation sensor, terminal can detect user's trigger action, to clothes
Business device sends mark request.
In the server, mark queue is previously provided with, can be a kind of buffer queue, terminal hair is received in server
During the mark request sent, the mark received request can be added in mark queue, be handled in order, so as to
Multiple mark requests are handled simultaneously, realize many people online mark simultaneously.
Step 102, it is determined that a two field picture corresponding with the mark request, is used as image to be marked；
In embodiments of the present invention, server is after mark request is received, it may be determined that with mark request corresponding one
Two field picture, regard a two field picture as image to be marked.
As a kind of preferred exemplary, server can lock the frame of video of real-time reception when receiving mark request, will
One two field picture of locking is defined as a two field picture corresponding with mark request.
Certainly, those skilled in the art can also determine a two field picture corresponding with mark request using other modes, such as
Number of video frames is provided with mark request, the corresponding frame of video of number of video frames is regard as a frame corresponding with mark request
Image.
Step 103, receive what the terminal was sent, with the mark corresponding markup information of request；
As a kind of preferred exemplary, markup information can include the screen resolution and first position information of terminal, screen
Resolution ratio can be used to indicate that screen size, and first position information can be the positional information that user be labeled in the terminal,
Such as click on the coordinate of mouse, touch screen.
It should be noted that markup information can also include mark color and mark width, mark color can be used for referring to
The color of calibration note display, mark width can be used for the width for specifying mark.
After terminal determines image to be marked, user can be labeled to image to be marked, when terminal detects user
Labeling operation after the completion of, can generate with marking the corresponding markup information of request, markup information is then sent to server,
Server can receive markup information.
For example, user is labeled using mouse, contact action etc., terminal can detect that mouse, touch finger lift thing
Part, when user is not changed within a certain period of time by the mark point of the formation such as mouse, contact action, terminal judges mark
Operation is completed, and generates markup information.
Step 104, position corresponding with the markup information is labeled in the image to be marked, generation mark figure
Picture；
After markup information is received, server can determine position corresponding with markup information in image to be marked,
Then it is labeled on the position, generation mark image can cause the synchronous more accurate of markup information.
It should be noted that when there are multiple terminals simultaneously and be labeled, server can be by the multiple ends received
The markup information that end is sent is placed in mark queue, is handled sequentially in time using single thread, so as to
Realize many people online mark simultaneously.
In a kind of preferred embodiment of the invention, image to be marked can carry image resolution ratio, then step 104 can be wrapped
Include following sub-step：
Sub-step S21, based on the screen resolution and described image resolution ratio, calculates conversion proportion；
In embodiments of the present invention, server can obtain the screen resolution of terminal from markup information, can also be really
The image resolution ratio of fixed image to be marked, then calculates the conversion proportion changed screen resolution to image resolution ratio.
Sub-step S22, according to the conversion proportion, second place information is converted to by the first position information；
It is determined that after conversion proportion, server can be converted to first position information second place information.
Sub-step S23, information corresponding position in the second place is labeled described in the image to be marked, generation mark
Note image.
It is determined that after the information of the second place, server can determine the corresponding position of second place information in image to be marked
Put, be then labeled in the position, generation mark image.
In order that those skilled in the art are more clearly understood from step 104, the present invention is implemented below by way of an example
Example is subject to exemplary illustration, but it is to be understood that, the embodiment of the present invention is not limited to this.
The screen resolution of terminal 1 is 640X480, and user 1 draws a point in image to be marked, and first position information is
(x1, y1), the screen resolution of terminal 2 is 1280X960, and user 2 draws a point in image to be marked, and first position information is
(x2, y2)。
1st, after markup information is sent to server by terminal 1, terminal 2, server determines input video resolution ratio, such as
320X240, the conversion proportion for then calculating conversion proportion terminal 1 is 1/2, and the conversion proportion of terminal 2 is 1/4；
2nd, by first position information (x1, y1) be converted to second place information (x1/ 2, y1/ 2), by first position information (x2,
y2) be converted to second place information (x2/ 4, y2/4)；
3rd, (the x of server respectively in image to be marked1/ 2, y1/2)、(x2/ 4, y2/ 4) corresponding position be labeled.
Step 105, the mark image is sent.
After generation mark image, server sends mark image to the terminal for carrying out video session, and terminal can be received
Image is marked, and is showed.
In one preferred embodiment of the invention, step 105 can include following sub-step：
Sub-step S31, using default second template, one is organized into by the frame of video of the mark image and real-time reception
Frame target image；
In embodiments of the present invention, server can pre-set the second template, such as Fig. 3, and the second template can include real
When video area A and mark image-region B, real-time video region A can be used for the corresponding figure of frame of video for showing real-time reception
Picture, mark image-region B can be used for showing mark image.
As a kind of example, in the second template, it can mainly show mark image, real-time video region could be arranged to
One ad-hoc location and size, are such as set to a half or thirds for being located at the upper right corner, size is mark picture.
It should be noted that the first template, the second template can also all include mark menu area, it can be used for showing mark
Option is noted, such as " being labeled ", " removing mark ", user can be corresponding by marking mark option progress in menu area
Control operation, is such as labeled, removes mark, the color of control mark, style of writing width.
Server can be decoded to the video flowing for receiving real-time video frame composition, obtained after generation mark image
To the frame of video of real-time reception, then using the second template, the frame of video of the mark image and real-time reception is placed on pair
The position answered, carries out after hybrid coding, is organized into a frame target image.
In embodiments of the present invention, server is by by markup information and receiving real-time video frame and being mixed into a frame target
Image, then target image is sent to the terminal for carrying out video session, it is not necessary to markup information and real-time video frame will be received
Separately send, saves the network bandwidth, improves the efficiency of mark.
Sub-step S32, sends the target image.
The frame of video for marking image and real-time reception is being organized into a frame target image, server can be by target image
Preserve in the buffer, and target image is sent to terminal, terminal can receive target image, and be showed.
In one preferred embodiment of the invention, the embodiment of the present invention can also comprise the following steps：
When reaching preset stopping opportunity, stop the generation mark image, and send real-time using first template
The frame of video of reception.
In embodiments of the present invention, server can stop generation mark image when detection reaches preset stopping opportunity,
Mark image is disposed, mark image is changed into transparent, the frame of video of real-time reception is then sent using the first template, terminal will
Only show the corresponding image of real-time frame of video.
As a kind of example, preset stopping opportunity can include but is not limited to following at least one：
Receive mark clearance order；
In the mark queue after the completion of all mark request processing, and it is not received by preset time period new
Mark request.
Wherein, mark clearance order can be detected when the video content of real-time frame of video is changed for terminal and sent
Instruction, such as terminal can utilize gravity sensor, gyro sensor control device, regarded when control device detects collection
When the cam movement amplitude of frequency frame is more than predetermined amplitude threshold value, then judge that the video content for detecting real-time frame of video occurs
Change.Certainly, when " mark is removed " option in user actively triggering mark menu, it is clear that terminal can also send mark to server
Except instruction.
In embodiments of the present invention, by during video session receiving terminal send mark ask, it is determined that with mark
The corresponding two field picture of note request, as image to be marked, is then received with marking the corresponding markup information of request, to be marked
Position corresponding with markup information is labeled in image, generates and sends mark image so that enter during video session
When rower is noted simultaneously, it is thus only necessary to send markup information, mark image is generated by server, so as to realize that many people are carried out
Mark, and the shared accuracy of markup information is ensure that, improve the efficiency being labeled.
Reference picture 4, shows a kind of step flow of information sharing method based on video session of the embodiment of the present invention
Figure.
It is described, is specifically may include steps of from end side below：
Step 401, during video session, when detect user for image to be marked first operation when, to clothes
The mark request that business device is sent；
During multiple terminals carry out video session, when needing to be labeled using the user of some terminal,
User can carry out first for image to be marked and operate, and such as click on image to be marked, terminal can detect the first of user
Operation, generation mark request, and send mark request to server.
Step 402, the characteristic information of user's input is received；
After mark request is sent, user can continue to be labeled image to be marked, be drawn such as on image to be marked
One circle, forms characteristic information, and terminal can receive the characteristic information of user's input.
Step 403, based on the characteristic information, markup information is generated；
After characteristic information is received, characteristic information can be converted to markup information by terminal.
Specifically, step 403 can include following sub-step：
Sub-step S41, determines the first position information of the characteristic information；
In embodiments of the present invention, terminal can determine the position of characteristic information, generate first position information.
Sub-step S42, obtains the screen resolution of terminal；
In embodiments of the present invention, terminal can also obtain the screen resolution of terminal itself.
Sub-step S43, markup information is organized into by the screen resolution and the first position information.
After first position information and screen resolution is obtained, terminal can enter screen resolution and first position information
Row tissue, forms markup information.
Step 404, the markup information is sent to the server, the server is used in the image to be marked
In position corresponding with the markup information be labeled, generation mark image and sends the mark image.
After markup information is obtained, markup information can be sent to server by terminal, and server receives markup information
Afterwards, can be labeled position corresponding with markup information in image to be marked, generation mark image, and to carry out video council
The terminal of words sends mark image.
In one preferred embodiment of the invention, the embodiment of the present invention can also comprise the following steps：
When the video content for detecting real-time frame of video is changed, generation mark clearance order；To the service
Device sends the mark clearance order, so that the server stops the generation mark image, and uses default first mould
Plate sends the frame of video of real-time reception.
When the video content that terminal detects real-time frame of video is changed, mark clearance order can be generated, so
Mark clearance order is sent to server afterwards, server is received after mark clearance order, generation mark image can be stopped,
And the frame of video of real-time reception can be sent using default first template.
In embodiments of the present invention, by during video session receiving terminal send mark ask, it is determined that with mark
The corresponding two field picture of note request, as image to be marked, is then received with marking the corresponding markup information of request, to be marked
Position corresponding with markup information is labeled in image, generates and sends mark image so that enter during video session
When rower is noted simultaneously, it is thus only necessary to send markup information, mark image is generated by server, so as to realize that many people are carried out
Mark, and the shared accuracy of markup information is ensure that, improve the efficiency being labeled.
Reference picture 5, shows a kind of step flow of information sharing method based on video session of the embodiment of the present invention
Figure.
Survey and be described from terminal below, specifically may include steps of：
Step 501, during video session, the mark image that the reception server is sent；Wherein, the mark image is
The server is receiving the mark request of terminal transmission, and will with the corresponding two field picture of the mark request, as treating
Mark after image, the figure that position corresponding with the markup information received is labeled and generated in the image to be marked
Picture；
During multiple terminals carry out video session, server is receiving the mark request of some terminal transmission
Afterwards, it may be determined that a two field picture corresponding with mark request, as image to be marked, some terminal hair can then be received
The markup information sent, position corresponding with the markup information received is labeled in image to be marked, the image of generation, will
Mark image is sent to terminal, and terminal can receive the mark image of transmission.
Step 502, the mark image is showed.
After mark image is received, terminal can show mark image to user.
In embodiments of the present invention, by during video session receiving terminal send mark ask, it is determined that with mark
The corresponding two field picture of note request, as image to be marked, is then received with marking the corresponding markup information of request, to be marked
Position corresponding with markup information is labeled in image, generates and sends mark image so that enter during video session
When rower is noted simultaneously, it is thus only necessary to send markup information, mark image is generated by server, so as to realize that many people are carried out
Mark, and the shared accuracy of markup information is ensure that, improve the efficiency being labeled.
It should be noted that for embodiment of the method, in order to be briefly described, therefore it to be all expressed as to a series of action group
Close, but those skilled in the art should know, the embodiment of the present invention is not limited by described sequence of movement, because according to
According to the embodiment of the present invention, some steps can be carried out sequentially or simultaneously using other.Secondly, those skilled in the art also should
Know, embodiment described in this description belongs to preferred embodiment, the involved action not necessarily present invention is implemented
Necessary to example.
Reference picture 6, shows a kind of structured flowchart of information sharing apparatus based on video session of the embodiment of the present invention,
Following module can specifically be included：
Request receiving module 601 is marked, for the mark request that during video session, receiving terminal is sent；
Image to be marked is as module 602, for determining a two field picture corresponding with the mark request, as to be marked
Image；
Markup information receiving module 603, sends for receiving the terminal, and mark corresponding with the mark request is believed
Breath；
Mark image generation module 604, in the image to be marked position corresponding with the markup information enter
Rower is noted, generation mark image；
Image sending module 605 is marked, for sending the mark image.
In one preferred embodiment of the invention, the markup information includes the screen resolution and first of the terminal
Positional information, the image to be marked carries image resolution ratio, and mark image generation module 604 can include：
Conversion proportion calculating sub module, for based on the screen resolution and described image resolution ratio, calculating conversion ratio
Example；
Second place informoter module, for according to the conversion proportion, the first position information to be converted to
Second place information；
Image generation submodule is marked, is entered for the corresponding position of second place information described in the image to be marked
Rower is noted, generation mark image.
In one preferred embodiment of the invention, mark request receiving module 601 can include：
Frame of video sending submodule, for during video session, real-time reception to be sent using default first template
Frame of video；
Mark request addition submodule, for when receiving the mark request of terminal transmission, the mark request to be added
Enter in default mark queue.
In one preferred embodiment of the invention, mark image sending module 605 can include：
Target image tissue submodule, for using default second template, by the mark image and real-time reception
Frame of video is organized into a frame target image；
Target image sending submodule, for sending the target image.
In one preferred embodiment of the invention, described device can also include：
Mark image and stop generation module, for when reaching preset stopping opportunity, stopping the generation mark image, and
The frame of video of real-time reception is sent using first template.
In one preferred embodiment of the invention, the preset stopping opportunity includes but is not limited to following at least one
Kind：
Receive mark clearance order；
In the mark queue after the completion of all mark request processing, and it is not received by preset time period new
Mark request.
In one preferred embodiment of the invention, first template includes real-time video region, second template
Including real-time video region and mark image-region.
In embodiments of the present invention, by during video session receiving terminal send mark ask, it is determined that with mark
The corresponding two field picture of note request, as image to be marked, is then received with marking the corresponding markup information of request, to be marked
Position corresponding with markup information is labeled in image, generates and sends mark image so that enter during video session
When rower is noted simultaneously, it is thus only necessary to send markup information, mark image is generated by server, so as to realize that many people are carried out
Mark, and the shared accuracy of markup information is ensure that, improve the efficiency being labeled.
Reference picture 7, shows a kind of structured flowchart of information sharing apparatus based on video session of the embodiment of the present invention,
Following module can specifically be included：
Request sending module 701 is marked, for during video session, image to be marked to be directed to when detecting user
During the first operation, the mark sent to server is asked；
Characteristic information receiving module 702, the characteristic information for receiving user's input；
Markup information generation module 703, for based on the characteristic information, generating markup information；
Markup information sending module 704, for the markup information to be sent to the server, the server is used for
Position corresponding with the markup information is labeled in the image to be marked, generation mark image, and sends the mark
Note image.
In one preferred embodiment of the invention, markup information generation module 703 can include：
First position information determination sub-module, the first position information for determining the characteristic information；
Screen resolution submodule, the screen resolution for obtaining terminal；
Markup information tissue submodule, for the screen resolution and the first position information to be organized into mark letter
Breath.
In one preferred embodiment of the invention, described device can also include：
Clearance order generation module is marked, it is raw for when the video content for detecting real-time frame of video is changed
Into mark clearance order；
Clearance order sending module is marked, for sending the mark clearance order to the server, so that the clothes
Business device stops the generation mark image, and using the frame of video of default first template transmission real-time reception.
In embodiments of the present invention, by during video session receiving terminal send mark ask, it is determined that with mark
The corresponding two field picture of note request, as image to be marked, is then received with marking the corresponding markup information of request, to be marked
Position corresponding with markup information is labeled in image, generates and sends mark image so that enter during video session
When rower is noted simultaneously, it is thus only necessary to send markup information, mark image is generated by server, so as to realize that many people are carried out
Mark, and the shared accuracy of markup information is ensure that, improve the efficiency being labeled.
Reference picture 8, shows a kind of structured flowchart of information sharing apparatus based on video session of the embodiment of the present invention,
Following module can specifically be included：
Image receiver module 801 is marked, for during video session, the mark image that the reception server is sent；Its
In, the mark image is that the server is receiving the mark request of terminal transmission, and will be corresponding with the mark request
A two field picture, after image to be marked, position corresponding with the markup information received is entered in the image to be marked
The image that rower is noted and generated；
Picture showing module 802 is marked, for showing the mark image.
In embodiments of the present invention, by during video session receiving terminal send mark ask, it is determined that with mark
The corresponding two field picture of note request, as image to be marked, is then received with marking the corresponding markup information of request, to be marked
Position corresponding with markup information is labeled in image, generates and sends mark image so that enter during video session
When rower is noted simultaneously, it is thus only necessary to send markup information, mark image is generated by server, so as to realize that many people are carried out
Mark, and the shared accuracy of markup information is ensure that, improve the efficiency being labeled.
For device embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, it is related
Part illustrates referring to the part of embodiment of the method.
Each embodiment in this specification is described by the way of progressive, what each embodiment was stressed be with
Between the difference of other embodiment, each embodiment identical similar part mutually referring to.
It should be understood by those skilled in the art that, the embodiment of the embodiment of the present invention can be provided as method, device or calculate
Machine program product.Therefore, the embodiment of the present invention can using complete hardware embodiment, complete software embodiment or combine software and
The form of the embodiment of hardware aspect.Moreover, the embodiment of the present invention can use it is one or more wherein include computer can
With in the computer-usable storage medium (including but is not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code
The form of the computer program product of implementation.
The embodiment of the present invention is with reference to method according to embodiments of the present invention, terminal device (system) and computer program
The flow chart and/or block diagram of product is described.It should be understood that can be by computer program instructions implementation process figure and/or block diagram
In each flow and/or square frame and the flow in flow chart and/or block diagram and/or the combination of square frame.These can be provided
Computer program instructions are set to all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing terminals
Standby processor is to produce a machine so that held by the processor of computer or other programmable data processing terminal equipments
Capable instruction is produced for realizing in one flow of flow chart or multiple flows and/or one square frame of block diagram or multiple square frames
The device for the function of specifying.
These computer program instructions, which may be alternatively stored in, can guide computer or other programmable data processing terminal equipments
In the computer-readable memory worked in a specific way so that the instruction being stored in the computer-readable memory produces bag
The manufacture of command device is included, the command device is realized in one flow of flow chart or multiple flows and/or one side of block diagram
The function of being specified in frame or multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing terminal equipments so that
Series of operation steps is performed on computer or other programmable terminal equipments to produce computer implemented processing, so that
The instruction performed on computer or other programmable terminal equipments is provided for realizing in one flow of flow chart or multiple flows
And/or specified in one square frame of block diagram or multiple square frames function the step of.
Although having been described for the preferred embodiment of the embodiment of the present invention, those skilled in the art once know base
This creative concept, then can make other change and modification to these embodiments.So, appended claims are intended to be construed to
Including preferred embodiment and fall into having altered and changing for range of embodiment of the invention.
Finally, in addition it is also necessary to explanation, herein, such as first and second or the like relational terms be used merely to by
One entity or operation make a distinction with another entity or operation, and not necessarily require or imply these entities or operation
Between there is any this actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant meaning
Covering including for nonexcludability, so that process, method, article or terminal device including a series of key elements are not only wrapped
Those key elements, but also other key elements including being not expressly set out are included, or also include being this process, method, article
Or the intrinsic key element of terminal device.In the absence of more restrictions, by wanting that sentence "including a ..." is limited
Element, it is not excluded that also there is other identical element in the process including the key element, method, article or terminal device.
Video session is based on to a kind of information sharing method based on video session provided by the present invention and one kind above
Information sharing apparatus, be described in detail, specific case used herein is entered to the principle and embodiment of the present invention
Elaboration is gone, the explanation of above example is only intended to the method and its core concept for helping to understand the present invention；Simultaneously for this
The those skilled in the art in field, according to the thought of the present invention, will change in specific embodiments and applications,
In summary, this specification content should not be construed as limiting the invention.
Claims (14)
1. a kind of information sharing method based on video session, it is characterised in that methods described includes：
During video session, the mark request that receiving terminal is sent；
It is determined that a two field picture corresponding with the mark request, is used as image to be marked；
Receive what the terminal was sent, with the mark corresponding markup information of request；
Position corresponding with the markup information is labeled in the image to be marked, generation mark image；
Send the mark image.
2. according to the method described in claim 1, it is characterised in that the markup information includes the screen resolution of the terminal
With first position information, the image to be marked carries image resolution ratio, it is described in the image to be marked with the mark
The corresponding position of information is labeled, and the step of generation marks image includes：
Based on the screen resolution and described image resolution ratio, conversion proportion is calculated；
According to the conversion proportion, the first position information is converted into second place information；
Information corresponding position in the second place is labeled described in the image to be marked, generation mark image.
3. method according to claim 2, it is characterised in that described during video session, what receiving terminal was sent
The step of mark request, includes：
During video session, the frame of video of real-time reception is sent using default first template；
When receiving the mark request of terminal transmission, the mark request is added in default mark queue.
4. the method according to claim 1 or 2 or 3, it is characterised in that wrap the step of the transmission mark image
Include：
Using default second template, the frame of video of the mark image and real-time reception is organized into a frame target image；
Send the target image.
5. method according to claim 4, it is characterised in that methods described also includes：
When reaching preset stopping opportunity, stop the generation mark image, and real-time reception is sent using first template
Frame of video.
6. method according to claim 5, it is characterised in that the preset stopping opportunity include but is not limited to it is following extremely
Few one kind：
Receive mark clearance order；
In the mark queue after the completion of all mark request processing, and it is not received by preset time period new mark
Request.
7. method according to claim 4, it is characterised in that first template includes real-time video region, described the
Two templates include real-time video region and mark image-region.
8. a kind of information sharing method based on video session, it is characterised in that methods described includes：
During video session, when detect user for image to be marked first operation when, the mark sent to server
Note request；
Receive the characteristic information of user's input；
Based on the characteristic information, markup information is generated；
The markup information is sent to the server, the server is used in the image to be marked and the mark
The corresponding position of information is labeled, generation mark image, and sends the mark image.
9. method according to claim 8, it is characterised in that described to be based on the characteristic information, generation markup information
Step includes：
Determine the first position information of the characteristic information；
Obtain the screen resolution of terminal；
The screen resolution and the first position information are organized into markup information.
10. method according to claim 8 or claim 9, it is characterised in that methods described also includes：
When the video content for detecting real-time frame of video is changed, generation mark clearance order；
The mark clearance order is sent to the server, so that the server stops the generation mark image, and is adopted
The frame of video of real-time reception is sent with default first template.
11. a kind of information sharing method based on video session, it is characterised in that methods described includes：
During video session, the mark image that the reception server is sent；Wherein, the mark image is that the server exists
Receive the mark request of terminal transmission, and will with the corresponding two field picture of the mark request, after image to be marked,
The image that position corresponding with the markup information received is labeled and generated in the image to be marked；
Show the mark image.
12. a kind of information sharing apparatus based on video session, it is characterised in that described device includes：
Request receiving module is marked, for the mark request that during video session, receiving terminal is sent；
Image to be marked, for determining a two field picture corresponding with the mark request, is used as image to be marked as module；
Markup information receiving module, sends for receiving the terminal, with the mark corresponding markup information of request；
Mark image generation module, in the image to be marked position corresponding with the markup information be labeled,
Generation mark image；
Image sending module is marked, for sending the mark image.
13. a kind of information sharing apparatus based on video session, it is characterised in that described device includes：
Request sending module is marked, for during video session, being grasped when detecting user for the first of image to be marked
When making, the mark sent to server is asked；
Characteristic information receiving module, the characteristic information for receiving user's input；
Markup information generation module, for based on the characteristic information, generating markup information；
Markup information sending module, for the markup information to be sent to the server, the server is used for described
Position corresponding with the markup information is labeled in image to be marked, generation mark image, and sends the mark image.
14. a kind of information sharing apparatus based on video session, it is characterised in that described device includes：
Image receiver module is marked, for during video session, the mark image that the reception server is sent；Wherein, it is described
Mark image is that the server is receiving the mark request of terminal transmission, and will frame figure corresponding with the mark request
Picture, after image to be marked, in the image to be marked position corresponding with the markup information received be labeled and
The image of generation；
Picture showing module is marked, for showing the mark image.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710500964.6A CN107333087B (en) | 2017-06-27 | 2017-06-27 | Information sharing method and device based on video session |
| US15/958,093 US10382719B2 (en) | 2017-06-27 | 2018-04-20 | Method and apparatus for sharing information during video call |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710500964.6A CN107333087B (en) | 2017-06-27 | 2017-06-27 | Information sharing method and device based on video session |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107333087A true CN107333087A (en) | 2017-11-07 |
| CN107333087B CN107333087B (en) | 2020-05-08 |
Family
ID=60197261
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710500964.6A Active CN107333087B (en) | 2017-06-27 | 2017-06-27 | Information sharing method and device based on video session |
Country Status (2)
| Country | Link |
|---|---|
| US (1) | US10382719B2 (en) |
| CN (1) | CN107333087B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108401190A (en) * | 2018-01-05 | 2018-08-14 | 亮风台（上海）信息科技有限公司 | A kind of method and apparatus for being marked in real time to video frame |
| CN110035329A (en) * | 2018-01-11 | 2019-07-19 | 腾讯科技（北京）有限公司 | Image processing method, device and storage medium |
| CN110119383A (en) * | 2019-04-15 | 2019-08-13 | 维沃移动通信有限公司 | A kind of file management method and terminal device |
| CN111918016A (en) * | 2020-07-24 | 2020-11-10 | 武汉烽火众智数字技术有限责任公司 | Efficient real-time picture marking method in video call |
| CN112637541A (en) * | 2020-12-23 | 2021-04-09 | 平安银行股份有限公司 | Audio and video labeling method and device, computer equipment and storage medium |
| CN113271424A (en) * | 2020-02-17 | 2021-08-17 | 北京沃东天骏信息技术有限公司 | Audio and video communication method, device and system |
| CN113542332A (en) * | 2020-04-22 | 2021-10-22 | 中移智行网络科技有限公司 | Customer service video interaction method and equipment based on positioning labels |
| CN113891031A (en) * | 2021-11-11 | 2022-01-04 | 西安医疗指南者信息技术服务有限公司 | Video call method, device and storage medium for medical process |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112383734B (en) * | 2020-10-29 | 2023-06-23 | 岭东核电有限公司 | Video processing method, device, computer equipment and storage medium |
| US11265181B1 (en) * | 2021-01-30 | 2022-03-01 | Zoom Video Communications, Inc. | Multi-point video presentations with live annotation |
| US11704626B2 (en) * | 2021-07-09 | 2023-07-18 | Prezi, Inc. | Relocation of content item to motion picture sequences at multiple devices |
| US20230283497A1 (en) * | 2022-03-07 | 2023-09-07 | Brandon Fischer | System and method for annotating live sources |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105338479A (en) * | 2014-06-09 | 2016-02-17 | 阿里巴巴集团控股有限公司 | Place-based information processing method and apparatus |
| WO2016073185A1 (en) * | 2014-11-07 | 2016-05-12 | Pcms Holdings, Inc. | System and method for augmented reality annotations |
| US20170039867A1 (en) * | 2013-03-15 | 2017-02-09 | Study Social, Inc. | Mobile video presentation, digital compositing, and streaming techniques implemented via a computer network |
| CN106789130A (en) * | 2016-12-19 | 2017-05-31 | 北京恒华伟业科技股份有限公司 | A kind of conferencing information processing method, device and conference system |
| CN106791937A (en) * | 2016-12-15 | 2017-05-31 | 广东威创视讯科技股份有限公司 | The mask method and system of video image |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8886726B2 (en) * | 2010-12-28 | 2014-11-11 | General Electric Company | Systems and methods for interactive smart medical communication and collaboration |
| US9754292B1 (en) * | 2011-10-13 | 2017-09-05 | Google Inc. | Method and apparatus for serving relevant ads based on the recommendations of influential friends |
| CN105072460B (en) | 2015-07-15 | 2018-08-07 | 中国科学技术大学先进技术研究院 | A kind of information labeling and correlating method based on video content element, system and equipment |
-
2017
- 2017-06-27 CN CN201710500964.6A patent/CN107333087B/en active Active
-
2018
- 2018-04-20 US US15/958,093 patent/US10382719B2/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170039867A1 (en) * | 2013-03-15 | 2017-02-09 | Study Social, Inc. | Mobile video presentation, digital compositing, and streaming techniques implemented via a computer network |
| CN105338479A (en) * | 2014-06-09 | 2016-02-17 | 阿里巴巴集团控股有限公司 | Place-based information processing method and apparatus |
| WO2016073185A1 (en) * | 2014-11-07 | 2016-05-12 | Pcms Holdings, Inc. | System and method for augmented reality annotations |
| CN106791937A (en) * | 2016-12-15 | 2017-05-31 | 广东威创视讯科技股份有限公司 | The mask method and system of video image |
| CN106789130A (en) * | 2016-12-19 | 2017-05-31 | 北京恒华伟业科技股份有限公司 | A kind of conferencing information processing method, device and conference system |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108401190A (en) * | 2018-01-05 | 2018-08-14 | 亮风台（上海）信息科技有限公司 | A kind of method and apparatus for being marked in real time to video frame |
| WO2019134499A1 (en) * | 2018-01-05 | 2019-07-11 | 亮风台（上海）信息科技有限公司 | Method and device for labeling video frames in real time |
| CN110035329A (en) * | 2018-01-11 | 2019-07-19 | 腾讯科技（北京）有限公司 | Image processing method, device and storage medium |
| CN110035329B (en) * | 2018-01-11 | 2022-08-30 | 腾讯科技（北京）有限公司 | Image processing method, device and storage medium |
| CN110119383A (en) * | 2019-04-15 | 2019-08-13 | 维沃移动通信有限公司 | A kind of file management method and terminal device |
| CN113271424A (en) * | 2020-02-17 | 2021-08-17 | 北京沃东天骏信息技术有限公司 | Audio and video communication method, device and system |
| CN113542332A (en) * | 2020-04-22 | 2021-10-22 | 中移智行网络科技有限公司 | Customer service video interaction method and equipment based on positioning labels |
| CN113542332B (en) * | 2020-04-22 | 2023-04-07 | 中移智行网络科技有限公司 | Customer service video interaction method and equipment based on positioning labels |
| CN111918016A (en) * | 2020-07-24 | 2020-11-10 | 武汉烽火众智数字技术有限责任公司 | Efficient real-time picture marking method in video call |
| CN112637541A (en) * | 2020-12-23 | 2021-04-09 | 平安银行股份有限公司 | Audio and video labeling method and device, computer equipment and storage medium |
| CN113891031A (en) * | 2021-11-11 | 2022-01-04 | 西安医疗指南者信息技术服务有限公司 | Video call method, device and storage medium for medical process |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107333087B (en) | 2020-05-08 |
| US20180376104A1 (en) | 2018-12-27 |
| US10382719B2 (en) | 2019-08-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107333087A (en) | A kind of information sharing method and device based on video session | |
| CN105117190B (en) | LED display screen configuration method | |
| CN103997454B (en) | The application method and equipment of a kind of log information | |
| CN108010037B (en) | Image processing method, device and storage medium | |
| CN104504428B (en) | A kind of information transferring method based on Quick Response Code, system and mobile terminal | |
| CN105554430B (en) | A kind of video call method, system and device | |
| CN107113396A (en) | Change video call data | |
| CN107111427A (en) | Change video call data | |
| CN107765976B (en) | Message pushing method, terminal and system | |
| CN108521609B (en) | Determine the method, apparatus and terminal of pushing video type | |
| WO2017124906A1 (en) | Data synchronization method, apparatus and system | |
| CN110392306A (en) | A kind of data processing method and equipment | |
| CN109344748A (en) | A method of AR label is added in image frame based on monitoring point GPS | |
| CN109784304A (en) | Method and apparatus for marking dental imaging | |
| JPWO2013094065A1 (en) | Determination apparatus and determination program | |
| CN111107278B (en) | Image processing method and device, electronic equipment and readable storage medium | |
| CN105451090A (en) | Image processing method and image processing device | |
| CN113096225A (en) | Image special effect generation method and device, electronic equipment and storage medium | |
| KR101903639B1 (en) | Electronic device and method for providing information releated to broadcasting viewing | |
| KR101696102B1 (en) | System for providing virtual reality and method thereof | |
| CN105323141B (en) | A kind of information transferring method, system and mobile terminal based on image recognition | |
| CN107529075B (en) | Cross-screen continuous playing method, system, server, equipment and cross-screen continuous playing equipment | |
| CN109348253A (en) | A kind of video file processing method, terminal, server and system | |
| CN108434683A (en) | A kind of the startup method and sports equipment, mobile terminal device of sports equipment | |
| CN106445282A (en) | Interaction method based on augmented reality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |