CN108921093A - Meeting interactive service method and apparatus - Google Patents

Meeting interactive service method and apparatus Download PDF

Info

Publication number
CN108921093A
CN108921093A CN201810709463.3A CN201810709463A CN108921093A CN 108921093 A CN108921093 A CN 108921093A CN 201810709463 A CN201810709463 A CN 201810709463A CN 108921093 A CN108921093 A CN 108921093A
Authority
CN
China
Prior art keywords
information
participant
picture
server
sampling
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810709463.3A
Other languages
Chinese (zh)
Other versions
CN108921093B (en
Inventor
林湘粤
刘昆
乔爽爽
梁阳
韩超
朱名发
郭江亮
李旭
刘俊
李硕
尹世明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN201810709463.3A priority Critical patent/CN108921093B/en
Publication of CN108921093A publication Critical patent/CN108921093A/en
Application granted granted Critical
Publication of CN108921093B publication Critical patent/CN108921093B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G06V20/53Recognition of crowd images, e.g. recognition of crowd congestion
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/10Terrestrial scenes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The present invention provides a kind of meeting interactive service method and apparatus.Meeting interactive service method of the present invention, including:The picture that server receiving terminal is sent handles request, wherein includes in picture classification request:The pictorial information of at least one sampling picture;Server obtains the interactive information of participant in each sampling picture according to the pictorial information of default training pattern and each sampling picture;Server sends picture processing response to terminal, wherein includes in picture processing response:The interactive information of participant in each sampling picture, so that terminal executes corresponding operation according to the interactive information of participant in each sampling picture.The present invention solves the problems, such as to lead to the quality and inefficiency of meeting since interaction link is disorder in existing conference process, efficiently realizes the interaction link in meeting, improve the quality and efficiency of meeting.

Description

Meeting interactive service method and apparatus
Technical field
The present invention relates to field of artificial intelligence more particularly to a kind of meeting interactive service method and apparatus.
Background technique
Meeting has become important one of the action of people, therefore, how efficiently to have a meeting for personal, company and Enterprise becomes more and more crucial.During in session, the links such as the tissue that usually people in need interact makes a speech, votes. In order to guarantee that meeting process maintains the situation of a relatively quiet and excessively not noisy confusion, usually tissue speech can be used and be lifted Hand or directly stand etc. modes, vote can using raise one's hand, the modes such as device or paper slip of voting.
However, when conference hall space is larger or teleconference, meeting presider cannot be considered in terms of while make a speech Multiple people, and the task amount for counting ballot is also larger, easily causes the confusion of meeting interaction link, leads to the quality and efficiency of meeting It reduces.
Summary of the invention
The present invention provides a kind of meeting interactive service method and apparatus, to solve in existing conference process due to interacting link The problem of quality and inefficiency disorder and that lead to meeting.
In a first aspect, the present invention provides a kind of meeting interactive service method, including:
The picture that server receiving terminal is sent handles request, wherein including in picture classification request:At least one Sample the pictorial information of picture;
The server obtains each sample graph according to the pictorial information of default training pattern and each sampling picture The interactive information of participant in piece;
The server sends picture processing response to the terminal, wherein including in picture processing response:Each institute The interactive information of participant in sampling picture is stated, so that interactive information of the terminal according to participant in each sampling picture Execute corresponding operation.
Optionally, when the pictorial information includes:Speech pose information, pixel data and location information, and/or, speech When pose information, pixel data and all participant's information, the server is according to default training pattern and each sample graph The pictorial information of piece obtains the interactive information of participant in each sampling picture, including:
The server is predicted the pixel data of each sampling picture, is obtained according to the default training pattern The pose information and face information of participant into each sampling picture;
The server determines at least one sampling picture, wherein the sample graph piece is according to each pose information Pose information is the corresponding sampling picture of the speech pose information in preset time range;
The server determine in each sampling picture different face informations and different faces information it is corresponding with Meeting person's number;
The server according to the positional information with each face information, and/or, all participant's information and Each face information obtains each participant's information;
The server is using each participant's information and participant's number as participant in each sampling picture The interactive information of person.
Optionally, when the location information includes:When the camera site of the terminal and picture pixels ratio, the service Device with each face information, obtains each participant's information according to the positional information, including:
The server is according to the pixel data of the corresponding sampling picture of each face information, the camera site of the terminal With the picture pixels ratio, the location information of each participant corresponding to each face information is obtained;
The server determines that each participant's information is the location information of each participant.
Optionally, when all participant's information include:The personal information of all participants and the correspondence of face information When relationship, the server obtains each participant's information according to all participant's information and each face information, packet It includes:
The server obtains each people according to the personal information of each participant and the corresponding relationship of face information The personal information of the corresponding each participant of face information;
The server determines that each participant's information is the personal information of each participant.
Optionally, when the pictorial information includes:When pixel data and ballot pose information, the server is according to default The pictorial information of training pattern and each sampling picture obtains the interactive information of participant in each sampling picture, including:
The server is predicted the pixel data of each sampling picture, is obtained according to the default training pattern The pose information of participant into each sampling picture;
The server determines at least one sampling picture, wherein the sample graph piece is according to each pose information Pose information at preset time point is the corresponding sampling picture of the ballot pose information;
The server is using the number of the sampling picture as the interactive information of participant in each sampling picture.
Optionally, before sending picture processing response to the terminal in the server, the method also includes:
The server determines that the interactive information of participant in each sampling picture puts in order as each sampling The shooting time sequence of picture.
Optionally, it is obtained each in the server according to the pictorial information of default training pattern and each sampling picture In the sampling picture before the interactive information of participant, the method also includes:
The server obtains sampling picture of the shooting time of each sampling picture within preset time range.
Second aspect, the present invention provide a kind of meeting interactive service method, including:
Terminal obtains TV news;
The terminal carries out picture sampling to the TV news, obtains at least one sampling picture;
The terminal to server sends picture processing request, wherein including in picture classification processing:It is adopted described in each The pictorial information of master drawing piece;
The terminal receives the picture processing response that the server is sent, wherein including in picture classification processing: The interactive information of participant in each sampling picture;
The terminal executes corresponding operation according to each interactive information.
The third aspect, the present invention provide a kind of server, including:
Receiving module, for receiving the picture processing request of terminal transmission, wherein including in picture classification request:Extremely The pictorial information of few sampling picture;
Processing module, for according to the pictorial information for presetting training pattern and each sampling picture, obtaining each described adopt The interactive information of participant in master drawing piece;
Sending module, for sending picture processing response to the terminal, wherein including in picture processing response:Respectively The interactive information of participant in the sampling picture, so that the terminal is believed according to the interaction of participant in each sampling picture Breath executes corresponding operation.
Optionally, when the pictorial information includes:Speech pose information, pixel data and location information, and/or, speech When pose information, pixel data and all participant's information, the processing module is used for according to the default training pattern, right The pixel data of each sampling picture is predicted, the pose information and face letter of participant in each sampling picture is obtained Breath;According to each pose information, at least one sampling picture is determined, wherein the sample graph piece is in preset time range Pose information is the corresponding sampling picture of the speech pose information;Determine in each sampling picture different face information with And the corresponding participant's number of different faces information;According to the positional information with each face information, and/or, the institute There are participant's information and each face information, obtains each participant's information;By each participant's information and the participant Interactive information of the number as participant in each sampling picture.
Optionally, when the location information includes:When the camera site of the terminal and picture pixels ratio, the processing Module, specifically for according to the pixel data of the corresponding sampling picture of each face information, the camera site of the terminal and institute Picture pixels ratio is stated, the location information of each participant corresponding to each face information is obtained;Determine each participant Information is the location information of each participant.
Optionally, when all participant's information include:The personal information of all participants and the correspondence of face information When relationship, the processing module, specifically for obtaining according to the personal information of each participant and the corresponding relationship of face information To the personal information of the corresponding each participant of each face information;Determine that each participant's information is each participant's Personal information.
Optionally, when the pictorial information includes:When pixel data and ballot pose information, the processing module is used for According to the default training pattern, the pixel data of each sampling picture is predicted, is obtained in each sampling picture The pose information of participant;According to each pose information, determine at least one sampling picture, wherein the sample graph piece be Pose information at preset time point is the corresponding sampling picture of the ballot pose information;The number of the sampling picture is made For the interactive information of participant in each sampling picture.
Optionally, the server further includes:Determining module;
The determining module, for determining that the interactive information of participant in each sampling picture puts in order as each institute State the shooting time sequence of sampling picture.
Optionally, the server further includes:Obtain module;
The acquisition module is also used to obtain shooting time the adopting within preset time range of each sampling picture Master drawing piece.
Fourth aspect, the present invention provide a kind of terminal, including:
Module is obtained, for obtaining TV news;
Processing module obtains at least one sampling picture for carrying out picture sampling to the TV news;
Sending module, for sending picture processing request to server, wherein including in picture classification processing:Each institute State the pictorial information of sampling picture;
Receiving module, the picture processing response sent for receiving the server, wherein in picture classification processing Including:Target interacts list;
Execution module executes corresponding operation for the interactive information according to participant in each sampling picture.
5th aspect, the present invention provide a kind of computer readable storage medium, are stored thereon with computer program, the meter Meeting interactive service method described in first aspect is realized when calculation machine program is executed by processor, alternatively, the computer program Meeting interactive service method described in second aspect is realized when being executed by processor.
6th aspect, the present invention provide a kind of electronic equipment, including:
Processor;And
Memory, for storing the executable instruction of the processor;
Wherein, the processor is configured to mutual to execute meeting described in first aspect via the executable instruction is executed Dynamic method of servicing, alternatively, the processor is configured to execute meeting described in second aspect via the executable instruction is executed Discuss interactive service method.
Meeting interactive service method and apparatus provided by the invention, obtain TV news by terminal, to meeting in real time At least one sampling picture is carried after picture samples and is sent to server in picture processing request by video.Server According to the pictorial information of default training pattern and each sampling picture, the interactive information of participant in each sampling picture is obtained, then will The interactive information of participant, which is carried, in each sampling picture feeds back to terminal in picture processing response, so that terminal is according to each sampling The interactive information of participant in picture executes corresponding operation.Interactive information is accurately identified by server in the present invention, It enables the terminal to fast and accurately be responded according to interactive information, has taken into account all participants, effectively maintained meeting It discusses order and improves the quality and efficiency of meeting so that the interaction link of meeting is efficiently completed.
Detailed description of the invention
It, below will be to embodiment or existing in order to clearly demonstrate the embodiment of the present invention or technical solution in the prior art Attached drawing needed in technical description is briefly described, it should be apparent that, the accompanying drawings in the following description is the present invention Some embodiments of embodiment, for those of ordinary skill in the art, without any creative labor, also Other drawings may be obtained according to these drawings without any creative labor.
Fig. 1 is the schematic diagram of a scenario of meeting interactive service method provided by the invention;
Fig. 2 is the signaling process figure of meeting interactive service method provided by the invention;
Fig. 3 is the flow chart of meeting interactive service method provided by the invention;
Fig. 4 is the flow chart of meeting interactive service method provided by the invention;
Fig. 5 is the flow chart of meeting interactive service method provided by the invention;
Fig. 6 is the flow chart of meeting interactive service method provided by the invention;
Fig. 7 is the structural schematic diagram of server provided by the invention;
Fig. 8 is the structural schematic diagram of server provided by the invention;
Fig. 9 is the structural schematic diagram of terminal provided by the invention;
Figure 10 is the hardware structural diagram of electronic equipment provided by the invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is A part of the embodiment of the embodiment of the present invention, instead of all the embodiments.Based on the embodiment in the embodiment of the present invention, this field Those of ordinary skill's every other embodiment obtained without making creative work, belongs to implementation of the present invention The range of example protection.
Fig. 1 is the schematic diagram of a scenario of meeting interactive service method provided by the invention, as shown in Figure 1, the meeting of the present embodiment It discusses interactive service method and is applied to meeting interactive service system 10, which includes:Terminal 11 is (in Fig. 1 Terminal 11 is illustrated with robot) and at least one server 12 (server 12 is illustrated in Fig. 1 with one), terminal 11 Request of data can be sent at least one server 12, and terminal 11 can also receive the number of at least one server 12 transmission According to response.
Wherein, terminal 11 can be attached at least one server 12 by cable network and/or wireless network, this Embodiment does not limit this.And the terminal 11 that the present embodiment refers to:It can be wireless terminal and be also possible to catv terminal, wirelessly Terminal can refer to a kind of equipment with radio transmission-receiving function, can be deployed in land, including indoor or outdoors, it is hand-held or It is vehicle-mounted;(such as steamer) can also be deployed on the water surface;It can also dispose in the sky (such as on aircraft, balloon and satellite etc.). Terminal 11 can be mobile phone (mobile phone), tablet computer (Pad), the computer with radio transmission-receiving function, virtual reality (Virtual Reality, VR) terminal, augmented reality (Augmented Reality, AR) terminal, Industry Control Wireless terminal in (industrial control), the wireless terminal in unmanned (self driving), tele-medicine The wireless terminal in wireless terminal, smart grid (smart grid), transportation safety in (remote medical) The wireless terminal in wireless terminal, smart city (smart city) in (transportation safety), wisdom family Wireless terminal etc. in (smart home), is not limited thereto.
Currently, participant's participation interacts link (such as make a speech, vote, game link) or leads to merely in conference process Artificial guidance is crossed, test bigger to the live field control ability of host or sends ballot device, speech to each participant The equipment such as bell come control meeting ballot and speech situation, increase meeting cost.No matter which kind of above-mentioned mode, flexibility is all It is poor, the confusion of meeting is easily caused, being discontented with for participant is caused, so that the inefficiency of meeting.Especially in teleconference In, meeting interacts link often because the reasons such as network delay or image are not known, cause meeting interaction difficult, not can guarantee Meeting quality.
Further, to solve the above-mentioned problems, in conjunction with Fig. 1, terminal 11 will real-time collected scene in the present embodiment TV news are transferred to server 12, and server 12 often uses posture (e.g., gesture, stance using image recognition technology identification meeting Deng), to determine that participant participates in the interactive information of meeting.Then, which is fed back to terminal 11, terminal by server 12 11 can make in time corresponding operation according to the interactive information (e.g., is transferred to speech personnel for microphone or display ballot is total Number etc.), each participant can not only be more preferably taken into account, and the requirement of network broadband only is reduced to the propagation of interactive information, So that meeting time delay is reduced significantly, it ensure that the sequence of meeting interaction link is held, improve the quality and efficiency of meeting.Under Face is described in detail the specific implementation process of meeting interactive service method by specific embodiment in conjunction with Fig. 2.
Fig. 2 is the signaling process figure of meeting interactive service method provided by the invention, as shown in Fig. 2, the meeting of the present embodiment Discussing interactive service method may include:
S201, terminal obtain TV news.
Specifically, terminal 11 can obtain TV news by being mounted on the capture apparatus of itself, can also pass through installation Capture apparatus in conference hall obtains TV news, the present embodiment to the type and number of capture apparatus all without limitation.Its In, the mode that the present embodiment obtains TV news to terminal 11 includes but is not limited to aforesaid way.And the present embodiment regards meeting The size and format of frequency are all without limitation.
S202, terminal carry out picture sampling to TV news, obtain at least one sampling picture.
Specifically, it should be readily apparent to one skilled in the art that the transmission of TV news, shared Internet resources are more, is easy It results in waste of resources, and image recognition technology can identify the corresponding information of picture format.Therefore, terminal 11 can incite somebody to action TV news are converted at least one sampling picture, not only reduce the data volume of transmission, accelerate transmission rate, are also convenient for mutually The identification of dynamic information, accelerates treatment effeciency.
Wherein, terminal 11 can include but is not limited to:TV news are carried out according to default frame or according to preset time period The sampling processing of at least one sampling picture.
S203, terminal to server send picture processing request, wherein include in picture classification processing:Each sampling picture Pictorial information.
Specifically, pixel data of the terminal 11 in addition to that can get sampling picture can also get sampling picture The shooting pixel ratio etc. used when shooting time, the size for sampling picture and format, shooting sampling picture, the present embodiment is to this Without limitation.
Further, terminal 11 can integrate all relevant informations of each sampling picture, obtain each sample graph Pictorial information, then the pictorial information of each sample graph is carried and is sent to server 12 in picture processing request, so that server 12 accomplish fluently data basis for identification interactive information.
S204, server according to the pictorial information of default training pattern and each sampling picture, obtain in each sampling picture and The interactive information of meeting person.
Specifically, server 12 utilizes image recognition technology, can be to the pose information progress of participant when participating in interacting Training obtains default training pattern, can also be trained to the facial information of participant, obtains default training mode.This is pre- If training pattern uses depth convolutional neural networks (Deep Convolutional Neural Networks) structure, can wrap It includes but is not limited to:RCNN (Regions with CNN features), SSD (Single Shot MultiBox Detector), the object detections such as Mask RCNN and other Image Segmentation Models.
It should be noted that:The present embodiment presets server 12 based on the principle of depth convolutional neural networks structure The specific implementation process of training pattern can refer to the prior art, be not repeated herein.
Further, it can show that participant participates in the interactive information of meeting interaction link due to presetting training pattern, because This, server 12 can carry out prediction processing to the pictorial information of each sampling picture, obtain each according to default training pattern Sample the prediction result of picture.Server 12 participates in the concrete type of interaction link further according to participant, to each sampling picture Prediction result is analyzed and processed, and obtains the interactive information of participant in each sampling picture.Wherein, link is interacted in the present embodiment Concrete type can include but is not limited to:Statistics ballot type and conference speech type.
S205, server send picture processing response to terminal, wherein include in picture processing response:In each sampling picture The interactive information of participant.
S206, terminal execute corresponding operation according to the interactive information of participant in each sampling picture.
Specifically, the interactive information of participant in each sampling picture is carried in picture processing response and sends by server 12 To terminal 11.The interactive information of participant from each sampling picture determines the interactive information for meeting preset condition to terminal 11 again, and Corresponding operation is executed according to each interactive information, such as determines participant or the output ballot sum of speech.Wherein, preset condition can To be set according to the concrete type of interaction link, can make a speech number for participant, or ballot time limit, this implementation Example does not limit this.
Further, in the prior art, either conference hall is larger or teleconference in, interaction link often all without Method takes into account each meeting language person, and certain participants are often ignored.And the interaction link in conference process, it is easy by network The influence of bandwidth and network delay.Compared to existing technologies, known in the present embodiment by server combination image recognition technology The pose information and/or face information of other participant can efficiently feed back the interactive information of participant to terminal in time, so that Terminal can take into account all participants, and due to the transmission quantity of interactive information network bandwidth and network smaller, thus be subject to The influence of time delay is smaller, ensure that meeting quality and mutual efficiency of movement.
It should be noted that:Terminal 11 can send picture processing request to one or more servers 12.Wherein, work as end When end 11 sends picture processing request to a server 12, using the specific implementation of the meeting interactive service method of the present embodiment Process can refer to the above process, be not repeated herein.When terminal 11 sends picture processing request to multiple servers 12, terminal Each sampling picture can be divided into M parts, the number of every part of sampling picture can be according to each clothes according to the number M of server 12 by 11 The load balancing of device 12 of being engaged in and scheduling of resource are set.Terminal 11 is asked further according to M parts of sampling picture components at M picture processing It asks, is sent to each server 12, so that each server 12 all can quickly timely be handled each sampling picture, obtain each Sample the interactive information of participant in picture.Wherein, each server 12 can send respective picture processing to terminal 11 respectively Response can also be sent out by the interactive information of participant in the comprehensive all sampling pictures of one of server 12, then to terminal 11 Send picture processing response, can also according to the interactive information of participant in obtained each sampling picture come more new database so that Each interactive information is stored in database, terminal 11 can directly obtain each interactive information from database, alternatively, terminal 11 connects Each interactive information that server 12 is extracted from database is received, the present embodiment is not limited to above-mentioned two ways.
In a specific embodiment, with the artificial terminal 11 of machine, for server 12 is Cloud Server, in meeting Cheng Zhong, multiple participants by this given pose of raising one's hand make a speech or vote etc. interaction link when, robot uses this reality The meeting interactive service method of example is applied, the detailed process for obtaining the interactive information of participant is:
1, robot acquires the TV news that each participant participates in interaction link;
2, robot carries out picture sampling to TV news, obtains at least one sampling picture;
3, the picture for carrying each image information using picture processing request is sent to terminal 11 by robot;
4, Cloud Server utilizes image recognition technology, and the concrete type in conjunction with meeting interaction link and the posture raised one's hand obtain To default training pattern;And according to the pictorial information disengaging prediction and analysis of default training pattern and each sampling picture, obtain each Sample the interactive information of participant in picture;
5, the picture processing response for carrying the interactive information of participant in each sampling picture is sent to machine by Cloud Server Device people;
6, robot executes according to the interactive information of participant in each sampling picture of acquisition and announces speech list or ballot The corresponding operation such as sum.
Meeting interactive service method provided in this embodiment, obtains TV news by terminal, to TV news in real time After picture samples, at least one sampling picture is carried and is sent to server in picture processing request.Server according to The pictorial information of default training pattern and each sampling picture obtains the interactive information of participant in each sampling picture, then will respectively adopt The interactive information of participant, which is carried, in master drawing piece feeds back to terminal in picture processing response, so that terminal is according to each sampling picture The interactive information of middle participant executes corresponding operation.Interactive information is accurately identified by server in the present embodiment, is made Obtaining terminal can fast and accurately respond according to interactive information, taken into account all participants, effectively maintained meeting Order improves the quality and efficiency of meeting so that the interaction link of meeting is efficiently completed.
Firstly, the meeting interactive service method of the present embodiment is suitble to each in meeting on the basis of above-mentioned Fig. 2 embodiment Kind interaction link.In turn, terminal 11 can interact the concrete type of link according to meeting, select the part of each sampling picture related The pictorial information of each sampling picture is transferred to server 12, reduced by pictorial information of the information as each sampling picture, terminal 11 Volume of transmitted data, improves message transmission rate.For ease of description, the present embodiment is with interactive scene one and interactive scene The specific implementation process for executing S204 is described in detail in example.
Interactive scene one
When interactive scene one is selection speech participant, the pictorial information for each sampling picture that server 12 receives can To include:Speech pose information, pixel data and location information, and/or, speech pose information, pixel data and all participants Person's information.Below with reference to server 12 in Fig. 3-5 couples of Fig. 2 embodiment S204 according to default training pattern and each sampling picture Pictorial information, the specific implementation process for obtaining the interactive information of participant in each sampling picture are described in detail.
Fig. 3 is the flow chart of meeting interactive service method provided by the invention, as shown in figure 3, the meeting of the present embodiment is mutual Dynamic method of servicing may include:
S301, server predict the pixel data of each sampling picture, obtain each sampling according to default training pattern The pose information and face information of participant in picture.
It specifically, is selection speech participant due to currently interacting link, terminal 11 not only needs to select to want hair The participant of speech, it is also necessary to which the participant of speech is wanted in positioning.In turn, server 12 can use image recognition technology, respectively Pose information and face information are trained, obtain respective default training pattern, server 12 is further according to each default training Model, to it is each sampling picture pixel data predict, it is available it is each sampling picture in participant pose information and people Face information.
S302, server determine at least one sampling picture according to each pose information, wherein sampling picture is when default Between in range pose information be the corresponding sampling picture of speech pose information.
Specifically, since the period of the desired speech of participant in conference process is limited, and need to comprehensively consider each participant The enthusiasm of person, therefore, server 12 can set the preset time range of selection sampling picture, select from each pose information It makes a speech out pose information, obtains the corresponding sampling picture of speech pose information.Wherein, server 12 can be from meeting initial time Into speech initial time this period, arbitrarily select a period as preset time range, the present embodiment is to preset time The specific duration of range is without limitation.
S303, server determine face information and the corresponding participant of different faces information different in each sampling picture Number.
S304, server according to location information and each face information, and/or, all participant's information and each face information, Obtain each participant's information.
S305, server are believed using each participant's information and participant's number as the interaction of participant in each sampling picture Breath.
Specifically, since the pose information in each sampling picture is all speech pose information, and the people in each sampling picture There may be repetitions for face information, and therefore, server 12 can determine different faces information from the face information of each sampling picture Number, that is, the participant's number made a speech.
Further, server 12 can also determine different face informations from the face information of each sampling picture.For It can accurately determine each participant, server 12 can obtain each participant's information according to location information and each face information, Each participant's information can also be obtained according to all participant's information and each face information, above two mode can also be combined, Obtain each participant's information.The present embodiment does not limit this.In this way, server 12 can by participant's information of speech and with Interactive information of meeting person's number as participant in each sampling picture.
Wherein, location information can be the seat information prearranged to each participant, can also be arrived according to each participant The seat information acquired after settling down, the present embodiment to the acquisition modes and particular content of location information without limitation.And institute There is participant's information can include but is not limited to:Name, title, face picture of each participant etc..
Further, server 12 can determine positioning speech participant by various modes.In the following, using two kinds of sides Formula, in conjunction with Fig. 4 and Fig. 5, to the server 12 in S304 embodiment according to location information and each face information, and/or, Suo Youyu Meeting person's information and each face information, the specific implementation process for obtaining each participant's information are described in detail.
The first feasible implementation, optionally, when location information includes:The camera site of terminal 11 and picture pixels When ratio, each participant is obtained to the server 12 in S304 embodiment according to location information and each face information in conjunction with Fig. 4 The specific implementation process of information is described in detail.
Fig. 4 is the flow chart of meeting interactive service method provided by the invention, as shown in figure 4, the meeting of the present embodiment is mutual Dynamic method of servicing may include:
S401, server predict the pixel data of each sampling picture, obtain each sampling according to default training pattern The pose information and face information of participant in picture.
S402, server determine at least one sampling picture according to each pose information, wherein sampling picture is when default Between in range pose information be the corresponding sampling picture of speech pose information.
S403, server determine face information and the corresponding participant of different faces information different in each sampling picture Number.
Wherein, S401, S402 and S403 are similar with S301, S302 and S303 implementation in Fig. 3 embodiment respectively, this Details are not described herein again for embodiment.
S4041, server are according to the pixel data of the corresponding sampling picture of each face information, the camera site of terminal and picture Pixel ratio obtains the location information of each participant corresponding to each face information.
S4042, server determine that each participant's information is the location information of each participant.
Specifically, server 12 can be according to the pixel data and picture pixels ratio of the corresponding sampling picture of each face information Example, determines the location information of face information in each sampling picture, fixes position, the i.e. camera site of terminal 11 in conjunction with practical, The location information of the corresponding each participant of each face information, the i.e. physical location of participant can be prepared to orient.In this way, service Device 12 can be using the location information of each participant as each participant's information.
S405, server are believed using each participant's information and participant's number as the interaction of participant in each sampling picture Breath.
Wherein, S405 is similar with the S105 implementation in Fig. 3 embodiment, and details are not described herein again for the present embodiment.
Second of feasible implementation, optionally, when all participant's information include:The personal information of all participants When with the corresponding relationship of face information, in conjunction with Fig. 5, to the server 12 in S304 embodiment according to all participant's information and each Face information, the specific implementation process for obtaining each participant's information are described in detail.
Fig. 5 is the flow chart of meeting interactive service method provided by the invention, as shown in figure 5, the meeting of the present embodiment is mutual Dynamic method of servicing may include:
S501, server predict the pixel data of each sampling picture, obtain each sampling according to default training pattern The pose information and face information of participant in picture.
S502, server determine at least one sampling picture according to each pose information, wherein sampling picture is when default Between in range pose information be the corresponding sampling picture of speech pose information.
S503, server determine face information and the corresponding participant of different faces information different in each sampling picture Number.
Wherein, S401, S402 and S403 are similar with S301, S302 and S303 implementation in Fig. 3 embodiment respectively, this Details are not described herein again for embodiment.
S5041, server obtain each face information according to the personal information of each participant and the corresponding relationship of face information The personal information of corresponding each participant.
S5042, server determine that each participant's information is the personal information of each participant.
Specifically, server 12 can be according to the pixel data and picture pixels ratio of the corresponding sampling picture of each face information Example, determines the location information of face information in each sampling picture, fixes position, the i.e. camera site of terminal 11 in conjunction with practical, The location information of the corresponding each participant of each face information, the i.e. physical location of participant are oriented in preparation.In this way, server 12 It can be using the location information of each participant as each participant's information.
S505, server are believed using each participant's information and participant's number as the interaction of participant in each sampling picture Breath.
Wherein, S405 is similar with the S105 implementation in Fig. 3 embodiment, and details are not described herein again for the present embodiment.
Interactive scene two
When interactive scene two is statistics ballot, the pictorial information for each sampling picture that server 12 receives be can wrap It includes:Pixel data and ballot pose information.Below with reference to Fig. 6 to 12 device of service in Fig. 2 embodiment S204 according to default training The pictorial information of model and each sampling picture, the specific implementation process for obtaining the interactive information of participant in each sampling picture carry out It is described in detail.
Fig. 6 is the flow chart of meeting interactive service method provided by the invention, as shown in fig. 6, the meeting of the present embodiment is mutual Dynamic method of servicing may include:
S601, server predict the pixel data of each sampling picture, obtain each sampling according to default training pattern The pose information of participant in picture.
It specifically, is statistics ballot due to currently interacting link, terminal 11 is corresponding it is only necessary to determine ballot posture Participant's number.In turn, server 12 can use image recognition technology, be trained to pose information, obtain default instruction Practice model.Server 12 predicts the pixel data of each sampling picture further according to each default training pattern, available each Sample the pose information of participant in picture.
S602, server determine at least one sampling picture according to each pose information, wherein sampling picture is when default Between pose information at point be the corresponding sampling picture of ballot pose information.
Specifically, due to section time limit polling hours in conference process, and participant can hesitate about what move to make during ballot, Therefore, server 12 can select ballot pose information at preset time point from each pose information, obtain ballot posture The corresponding sampling picture of information.Wherein, the present embodiment can will apart from the poll closing immediate moment as preset time point, To guarantee that the pose information of sample graph on piece that server 12 obtains most can really reflect the ballot situation of participant.
S603, server will sample the number of picture as the interactive information of participant in each sampling picture.
Specifically, since each sampling picture is not only according to ballot pose information determination, and also at preset time point Determining, so that the case where respectively face information in sampling picture is not in identical face information, therefore, 12 basis of server The number of picture is sampled, i.e. ballot number, determines the interactive information of participant in each sampling picture.
Further, in order to guarantee ballot authenticity, server 12 can also obtain sample picture number while, Can also obtain it is each sampling picture face information, with determine participate in ballot participant's information, wherein server 12 obtain with The specific implementation process of meeting person's information can refer to the implementation of Fig. 3-5 embodiment, be not repeated herein.
On the basis of above-mentioned Fig. 2 embodiment, the server 12 in S205 embodiment sends picture processing to terminal 11 Before response, the interactive information of quick obtaining participant is capable of for the ease of terminal 11, optionally, server 12 determines each sampling The interactive information of participant puts in order as the shooting time sequence of each sampling picture in picture.
Specifically, server 12 can be according to the shooting time sequence of each sampling picture, to participant in each sampling picture Interactive information be ranked up, each interactive information after terminal 11 is sorted can be intuitively clearly understood that Each participant participates in the enthusiasm of interaction link.
On the basis of above-mentioned Fig. 2 embodiment, server 12 in S204 embodiment is according to default training pattern and each The pictorial information for sampling picture obtains in each sampling picture before the interactive information of participant, in order to reduce the processing of server 12 Data volume, optionally, server obtains sampling picture of the shooting time within preset time range of each sampling picture.
Specifically, since the sampling picture that server 12 receives may be the sampling picture of entire conference process duration, And server 12 is not necessarily to carry out the sampling picture at all time points respective handling, therefore, server 12 can be mutual in conjunction with meeting The concrete type of rotating ring section obtains the shooting time of each sampling picture corresponding sampling picture within a preset period of time, to delete Except the sampling picture not in interaction link time, reduces the time and quantity of the processing of server 12, accelerate server 12 Processing speed, enable terminal 11 to obtain the meeting interactive information of participant in time.
Fig. 7 is the structural schematic diagram of server provided by the invention, as shown in fig. 7, the server 70 of the present embodiment includes:
Receiving module 71, for receiving the picture processing request of terminal transmission, wherein including in picture classification request: The pictorial information of at least one sampling picture;
Processing module 72, for obtaining each described according to the pictorial information for presetting training pattern and each sampling picture Sample the interactive information of participant in picture;
Sending module 73, for sending picture processing response to the terminal, wherein including in picture processing response: The interactive information of participant in each sampling picture, so that interaction of the terminal according to participant in each sampling picture Information executes corresponding operation.
Optionally, when the pictorial information includes:Speech pose information, pixel data and location information, and/or, speech When pose information, pixel data and all participant's information, the processing module 72 is used for according to the default training pattern, The pixel data of each sampling picture is predicted, the pose information and face of participant in each sampling picture is obtained Information;According to each pose information, at least one sampling picture is determined, wherein the sample graph piece is in preset time range Interior pose information is the corresponding sampling picture of the speech pose information;Determine face information different in each sampling picture And the corresponding participant's number of different faces information;According to the positional information with each face information, and/or, it is described All participant's information and each face information, obtain each participant's information;By each participant's information and the participant Interactive information of person's number as participant in each sampling picture.
Optionally, when the location information includes:When the camera site of the terminal and picture pixels ratio, the processing Module 72, specifically for according to the pixel data of the corresponding sampling picture of each face information, the camera site of the terminal and The picture pixels ratio obtains the location information of each participant corresponding to each face information;Determine each participant Person's information is the location information of each participant.
Optionally, when all participant's information include:The personal information of all participants and the correspondence of face information When relationship, the processing module 72, specifically for according to the personal information of each participant and the corresponding relationship of face information, Obtain the personal information of the corresponding each participant of each face information;Determine that each participant's information is each participant Personal information.
Optionally, when the pictorial information includes:When pixel data and ballot pose information, the processing module 72 is used According to the default training pattern, the pixel data of each sampling picture is predicted, each sampling picture is obtained The pose information of middle participant;According to each pose information, at least one sampling picture is determined, wherein the sample graph piece is Pose information at preset time point is the corresponding sampling picture of the ballot pose information;By the number of the sampling picture Interactive information as participant in each sampling picture.
Fig. 8 is the structural schematic diagram of server provided by the invention, as shown in figure 8, the server 70 of the present embodiment is such as On the basis of structure shown in Fig. 7, further include:Determining module 74
The determining module 74, before being used to send picture processing response to the terminal in the sending module 73, really The interactive information of participant puts in order as the shooting time sequence of each sampling picture in fixed each sampling picture.
Continuing with Fig. 8, optionally, the server 70 of the present embodiment further includes:Obtain module 75;
The acquisition module 75 is also used in the processing module 72 according to default training pattern and each sampling picture Pictorial information, obtain it is each it is described sampling picture in participant interactive information before, obtain it is each it is described sampling picture shooting Sampling picture of the time within preset time range.
Server provided in this embodiment can be used for executing above-mentioned meeting interactive service method, implementation and technology Effect is similar, and details are not described herein again for the present embodiment.
The division that can carry out functional module in the present invention to server according to above method example, for example, can correspond to Two or more functions can also be integrated in a processing module by each each functional module of function division.On It states integrated module both and can take the form of hardware realization, can also be realized in the form of software function module.It needs It is bright, it is schematical, only a kind of logical function partition to the division of module in various embodiments of the present invention, it is practical to realize When there may be another division manner.
Fig. 9 is the structural schematic diagram of terminal provided by the invention, as shown in figure 9, the terminal 90 of the present embodiment includes:
Module 91 is obtained, for obtaining TV news;
Processing module 92 obtains at least one sampling picture for carrying out picture sampling to the TV news;
Sending module 93, for sending picture processing request to server, wherein including in picture classification processing:Respectively The pictorial information of the sampling picture;
Receiving module 94, the picture processing response sent for receiving the server, wherein the picture classification is handled In include:Target interacts list;
Execution module 95 executes corresponding operation for the interactive information according to participant in each sampling picture.
Terminal provided in this embodiment can be used for executing above-mentioned meeting interactive service method, implementation and technology effect Seemingly, details are not described herein again for the present embodiment for fruit.
The division of functional module can be carried out to terminal according to above method example in the present invention, for example, can correspond to each Two or more functions can also be integrated in a processing module by a each functional module of function division.It is above-mentioned Integrated module both can take the form of hardware realization, can also be realized in the form of software function module.It needs to illustrate , it is schematical, only a kind of logical function partition to the division of module in various embodiments of the present invention, in actual implementation There may be another division manner.
Figure 10 is the hardware structural diagram of electronic equipment provided by the invention.As shown in Figure 10, which wraps It includes:Memory 101 and processor 102;
Memory 101, for storing computer program;
Processor 102, for executing the computer program of memory storage, to realize that the meeting in above-described embodiment interacts Method of servicing.It specifically may refer to the associated description in preceding method embodiment.
Optionally, memory 101 can also be integrated with processor 102 either independent.
When the memory 101 is independently of the device except processor 102, the electronic equipment 100 can also be wrapped It includes:
Bus 103, for connecting the memory 101 and processor 102.
Electronic equipment provided in this embodiment can be used for executing above-mentioned meeting interactive service method, implementation and skill Art effect is similar, and details are not described herein again for the present embodiment.
The present invention also provides a kind of computer readable storage medium, the computer readable storage medium includes computer journey Sequence, the computer program is for realizing the meeting interactive service method in embodiment as above.
In several embodiments provided by the present invention, it should be understood that disclosed device and method can pass through it Its mode is realized.For example, apparatus embodiments described above are merely indicative, for example, the division of the module, only Only a kind of logical function partition, there may be another division manner in actual implementation, for example, multiple modules can combine or It is desirably integrated into another system, or some features can be ignored or not executed.Another point, it is shown or discussed it is mutual it Between coupling, direct-coupling or communication connection can be through some interfaces, the INDIRECT COUPLING or communication link of device or module It connects, can be electrical property, mechanical or other forms.
The module as illustrated by the separation member may or may not be physically separated, aobvious as module The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.Some or all of the modules therein can be selected to realize the mesh of this embodiment scheme according to the actual needs 's.
It, can also be in addition, each functional module in each embodiment of the present invention can integrate in one processing unit It is that modules physically exist alone, can also be integrated in one unit with two or more modules.Above-mentioned module at Unit both can take the form of hardware realization, can also realize in the form of hardware adds SFU software functional unit.
The above-mentioned integrated module realized in the form of software function module, can store and computer-readable deposit at one In storage media.Above-mentioned software function module is stored in a storage medium, including some instructions are used so that a computer Equipment (can be personal computer, server or the network equipment etc.) or processor (English:Processor this Shen) is executed Please each embodiment the method part steps.
It should be understood that above-mentioned processor can be central processing unit (English:Central Processing Unit, letter Claim:CPU), it can also be other general processors, digital signal processor (English:Digital Signal Processor, Referred to as:DSP), specific integrated circuit (English:Application Specific Integrated Circuit, referred to as: ASIC) etc..General processor can be microprocessor or the processor is also possible to any conventional processor etc..In conjunction with hair The step of bright disclosed method, can be embodied directly in hardware processor and execute completion, or with hardware in processor and soft Part block combiner executes completion.
Memory may include high speed RAM memory, it is also possible to and it further include non-volatile memories NVM, for example, at least one Magnetic disk storage can also be USB flash disk, mobile hard disk, read-only memory, disk or CD etc..
Bus can be industry standard architecture (Industry Standard Architecture, ISA) bus, outer Portion's apparatus interconnection (Peripheral Component, PCI) bus or extended industry-standard architecture (Extended Industry Standard Architecture, EISA) bus etc..Bus can be divided into address bus, data/address bus, control Bus etc..For convenient for indicating, the bus in illustrations does not limit only a bus or a type of bus.
Above-mentioned computer readable storage medium can be by any kind of volatibility or non-volatile memory device or Their combination realizes that, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM) can Erasable programmable read-only memory (EPROM) (EPROM), programmable read only memory (PROM), read-only memory (ROM), magnetic memory, Flash memory, disk or CD.Storage medium can be any usable medium that general or specialized computer can access.
Those of ordinary skill in the art will appreciate that:Realize that all or part of the steps of above-mentioned each method embodiment can lead to The relevant hardware of program instruction is crossed to complete.Program above-mentioned can be stored in a computer readable storage medium.The journey When being executed, execution includes the steps that above-mentioned each method embodiment to sequence;And storage medium above-mentioned includes:ROM, RAM, magnetic disk or The various media that can store program code such as person's CD.
Finally it should be noted that:The above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations;To the greatest extent Present invention has been described in detail with reference to the aforementioned embodiments for pipe, those skilled in the art should understand that:Its according to So be possible to modify the technical solutions described in the foregoing embodiments, or to some or all of the technical features into Row equivalent replacement;And these are modified or replaceed, various embodiments of the present invention technology that it does not separate the essence of the corresponding technical solution The range of scheme.

Claims (18)

1. a kind of meeting interactive service method, which is characterized in that including:
The picture that server receiving terminal is sent handles request, wherein including in picture classification request:At least one sampling The pictorial information of picture;
The server obtains in each sampling picture according to the pictorial information of default training pattern and each sampling picture The interactive information of participant;
The server sends picture processing response to the terminal, wherein including in picture processing response:It is adopted described in each The interactive information of participant in master drawing piece, so that the terminal is executed according to the interactive information of participant in each sampling picture Corresponding operation.
2. the method according to claim 1, wherein when the pictorial information includes:Speech pose information, pixel Data and location information, and/or, speech pose information, pixel data and when all participant's information, the server is according in advance If the pictorial information of training pattern and each sampling picture obtains the interactive information of participant in each sampling picture, packet It includes:
The server is predicted the pixel data of each sampling picture, is obtained each according to the default training pattern The pose information and face information of participant in the sampling picture;
The server determines at least one sampling picture, wherein the sample graph piece is pre- according to each pose information If pose information is the corresponding sampling picture of the speech pose information in time range;
The server determines face information and the corresponding participant of different faces information different in each sampling picture Number;
The server according to the positional information with each face information, and/or, all participant's information and each institute Face information is stated, each participant's information is obtained;
The server is using each participant's information and participant's number as participant in each sampling picture Interactive information.
3. according to the method described in claim 2, it is characterized in that, when the location information includes:The shooting position of the terminal When setting with picture pixels ratio, the server with each face information, obtains each participant's letter according to the positional information Breath, including:
The server is according to the pixel data of the corresponding sampling picture of each face information, the camera site of the terminal and institute Picture pixels ratio is stated, the location information of each participant corresponding to each face information is obtained;
The server determines that each participant's information is the location information of each participant.
4. according to the method described in claim 2, it is characterized in that, when all participant's information include:All participants Personal information and face information corresponding relationship when, the server is according to all participant's information and each face Information obtains each participant's information, including:
The server obtains each face letter according to the personal information of each participant and the corresponding relationship of face information Cease the personal information of corresponding each participant;
The server determines that each participant's information is the personal information of each participant.
5. the method according to claim 1, wherein when the pictorial information includes:Pixel data and ballot appearance When gesture information, the server obtains each sampling according to the pictorial information of default training pattern and each sampling picture The interactive information of participant in picture, including:
The server is predicted the pixel data of each sampling picture, is obtained each according to the default training pattern The pose information of participant in the sampling picture;
The server determines at least one sampling picture, wherein the sample graph piece is pre- according to each pose information If the pose information at time point is the corresponding sampling picture of the ballot pose information;
The server is using the number of the sampling picture as the interactive information of participant in each sampling picture.
6. method according to claim 1-5, which is characterized in that send and scheme to the terminal in the server Before piece processing response, the method also includes:
The server determines that the interactive information of participant in each sampling picture puts in order as each sampling picture Shooting time sequence.
7. method according to claim 1-5, which is characterized in that in the server according to default training pattern With the pictorial information of each sampling picture, obtain in each sampling picture before the interactive information of participant, the method Further include:
The server obtains sampling picture of the shooting time of each sampling picture within preset time range.
8. a kind of meeting interactive service method, which is characterized in that including:
Terminal obtains TV news;
The terminal carries out picture sampling to the TV news, obtains at least one sampling picture;
The terminal to server sends picture processing request, wherein including in picture classification processing:Each sample graph The pictorial information of piece;
The terminal receives the picture processing response that the server is sent, wherein including in picture classification processing:Each institute State the interactive information of participant in sampling picture;
The terminal executes corresponding operation according to each interactive information.
9. a kind of server, which is characterized in that including:
Receiving module, for receiving the picture processing request of terminal transmission, wherein including in picture classification request:At least one The pictorial information of a sampling picture;
Processing module, for obtaining each sample graph according to the pictorial information for presetting training pattern and each sampling picture The interactive information of participant in piece;
Sending module, for sending picture processing response to the terminal, wherein including in picture processing response:It is each described The interactive information of participant in picture is sampled, so that the terminal is held according to the interactive information of participant in each sampling picture Row corresponding operation.
10. server according to claim 9, which is characterized in that when the pictorial information includes:Speech pose information, Pixel data and location information, and/or, speech pose information, pixel data and when all participant's information, the processing mould Block, for predicting the pixel data of each sampling picture, obtaining each sampling according to the default training pattern The pose information and face information of participant in picture;According to each pose information, at least one sampling picture is determined, wherein The sampling picture is that pose information is the corresponding sampling picture of the speech pose information in preset time range;It determines each Different face informations and the corresponding participant's number of different faces information in the sampling picture;According to the positional information With each face information, and/or, all participant's information and each face information obtain each participant's information;It will The interactive information of each participant's information and participant's number as participant in each sampling picture.
11. server according to claim 10, which is characterized in that when the location information includes:The bat of the terminal It acts as regent when setting with picture pixels ratio, the processing module, specifically for according to the corresponding sampling picture of each face information Pixel data, the camera site of the terminal and the picture pixels ratio, obtain corresponding to each face information it is each with The location information of meeting person;Determine that each participant's information is the location information of each participant.
12. server according to claim 10, which is characterized in that when all participant's information include:It is all with When the corresponding relationship of the personal information of meeting person and face information, the processing module, specifically for according to each participant's The corresponding relationship of personal information and face information obtains the personal information of the corresponding each participant of each face information;It determines Each participant's information is the personal information of each participant.
13. server according to claim 9, which is characterized in that when the pictorial information includes:Pixel data and ballot When pose information, the processing module, for according to the default training pattern, to the pixel data of each sampling picture into Row prediction obtains the pose information of participant in each sampling picture;According to each pose information, determine that at least one is adopted Master drawing piece, wherein the sample graph piece is the corresponding sampling of the ballot pose information for the pose information at preset time point Picture;Using the number of the sampling picture as the interactive information of participant in each sampling picture.
14. according to the described in any item servers of claim 9-13, which is characterized in that the server further includes:Determine mould Block;
The determining module, for determining that the putting in order for interactive information of participant in each sampling picture described is adopted to be each The shooting time sequence of master drawing piece.
15. according to the described in any item servers of claim 9-13, which is characterized in that the server further includes:Obtain mould Block;
The acquisition module is also used to obtain sample graph of the shooting time of each sampling picture within preset time range Piece.
16. a kind of terminal, which is characterized in that including:
Module is obtained, for obtaining TV news;
Processing module obtains at least one sampling picture for carrying out picture sampling to the TV news;
Sending module, for sending picture processing request to server, wherein including in picture classification processing:It is adopted described in each The pictorial information of master drawing piece;
Receiving module, the picture processing response sent for receiving the server, wherein including in picture classification processing: Target interacts list;
Execution module executes corresponding operation for the interactive information according to participant in each sampling picture.
17. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program Claim 1-7 described in any item meeting interactive service methods are realized when being executed by processor, alternatively, the computer program Meeting interactive service method according to any one of claims 8 is realized when being executed by processor.
18. a kind of electronic equipment, which is characterized in that including:
Processor;And
Memory, for storing the executable instruction of the processor;
Wherein, the processor is configured to require 1-7 described in any item via executing the executable instruction and carry out perform claim Meeting interactive service method, alternatively, the processor is configured to come 8 institutes of perform claim requirement via the execution executable instruction The meeting interactive service method stated.
CN201810709463.3A 2018-07-02 2018-07-02 Conference interaction service method and device Active CN108921093B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810709463.3A CN108921093B (en) 2018-07-02 2018-07-02 Conference interaction service method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810709463.3A CN108921093B (en) 2018-07-02 2018-07-02 Conference interaction service method and device

Publications (2)

Publication Number Publication Date
CN108921093A true CN108921093A (en) 2018-11-30
CN108921093B CN108921093B (en) 2020-01-07

Family

ID=64424808

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810709463.3A Active CN108921093B (en) 2018-07-02 2018-07-02 Conference interaction service method and device

Country Status (1)

Country Link
CN (1) CN108921093B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105893948A (en) * 2016-03-29 2016-08-24 乐视控股(北京)有限公司 Method and apparatus for face identification in video conference
CN106709438A (en) * 2016-12-14 2017-05-24 贵州电网有限责任公司电力调度控制中心 Method for collecting statistics of number of people based on video conference
CN106791579A (en) * 2016-12-30 2017-05-31 唐常芳 The processing method and system of a kind of Video Frequency Conference Quality
CN108063909A (en) * 2016-11-08 2018-05-22 阿里巴巴集团控股有限公司 Video conferencing system, image trace acquisition method and device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105893948A (en) * 2016-03-29 2016-08-24 乐视控股(北京)有限公司 Method and apparatus for face identification in video conference
CN108063909A (en) * 2016-11-08 2018-05-22 阿里巴巴集团控股有限公司 Video conferencing system, image trace acquisition method and device
CN106709438A (en) * 2016-12-14 2017-05-24 贵州电网有限责任公司电力调度控制中心 Method for collecting statistics of number of people based on video conference
CN106791579A (en) * 2016-12-30 2017-05-31 唐常芳 The processing method and system of a kind of Video Frequency Conference Quality

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
TIAGO S. NAZARÉ等: "Hand-Raising Gesture Detection with Lienhart-Maydt Method in Videoconference and Distance Learning", 《CIARP 2013: PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS》 *

Also Published As

Publication number Publication date
CN108921093B (en) 2020-01-07

Similar Documents

Publication Publication Date Title
CN110213601A (en) A kind of live broadcast system and live broadcasting method based on cloud game, living broadcast interactive method
CN105554372B (en) Shooting method and device
US20090257730A1 (en) Video server, video client device and video processing method thereof
EP2824913A1 (en) A method for generating an immersive video of a plurality of persons
CN109525802A (en) A kind of video stream transmission method and device
CN112799891B (en) iOS device testing method, device, system, storage medium and computer device
CN104506946B (en) A kind of TV programme recognition methods and system based on image recognition
CN111985281B (en) Image generation model generation method and device and image generation method and device
CN107078917A (en) Trustship videoconference
CN104170317A (en) Communication control system and control device
CN110536095A (en) Call method, device, terminal and storage medium
CN109922352A (en) A kind of data processing method, device, electronic equipment and readable storage medium storing program for executing
CN112702557A (en) Screen sharing method, device, equipment and storage medium based on call
CN113438442A (en) Conference data sharing method and device
CN112601022A (en) On-site monitoring system and method based on network camera
CN110084530A (en) Analytical equipment and its method, the movement inspection device and storage medium of mobile inspection
CN114531564A (en) Processing method and electronic equipment
CN112507798B (en) Living body detection method, electronic device and storage medium
CN108961424A (en) Virtual information processing method, equipment and storage medium
WO2021187646A1 (en) Method and system for conducting conference by using avatar
CN108921093A (en) Meeting interactive service method and apparatus
CN108958690B (en) Multi-screen interaction method and device, terminal equipment, server and storage medium
CN106686089A (en) Method and system for control of motion capture data cloud sharing based on voice
CN113709401A (en) Video call method, device, storage medium, and program product
CN209002109U (en) Situation Awareness System based on power distribution network construction site

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant