CN106454451B - Control method for playing multimedia and device - Google Patents
Control method for playing multimedia and device Download PDFInfo
- Publication number
- CN106454451B CN106454451B CN201610943207.1A CN201610943207A CN106454451B CN 106454451 B CN106454451 B CN 106454451B CN 201610943207 A CN201610943207 A CN 201610943207A CN 106454451 B CN106454451 B CN 106454451B
- Authority
- CN
- China
- Prior art keywords
- multimedia
- role
- image
- predetermined role
- predetermined
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
Abstract
The disclosure is directed to control method for playing multimedia and devices.This method comprises: obtaining the present image of predetermined role in multimedia；The auxiliary display device that the present image of the predetermined role is sent in multimedia scene is shown, the auxiliary display device is different equipment from the multimedia equipment is played.The technical solution, to increase multimedia viewing atmosphere, can improve user and watch multimedia experience in the different image pictures for playing the dominant role in multimedia while other positions simultaneous display multimedia in multimedia environment.
Description
Technical field
This disclosure relates to intelligent terminal technical field more particularly to a kind of control method for playing multimedia and device.
Background technique
Currently, VR (Virtual Reality, i.e. virtual reality, abbreviation VR) display technology comprehensively utilizes computer graphical
System and the interface equipments such as various reality and control, provide feeling of immersion in three-dimensional environment generating on computers, can interacting
The technology of feel.Virtual reality technology can create the computer simulation system in the experiencing virtual world, generate one kind using computer
The simulated environment of the interactive Three-Dimensional Dynamic what comes into a driver's and entity behavior of Multi-source Information Fusion, is immersed to user in the environment.
In VR, most common application first is that viewing multimedia messages.And multimedia scene is all in existing VR
It is fixed and invariable, how to increase the sense of reality of multimedia scene is an optimization user experience and asking for needing to solve
Topic.
Summary of the invention
The embodiment of the present disclosure provides control method for playing multimedia and device.The technical solution is as follows:
According to the first aspect of the embodiments of the present disclosure, a kind of control method for playing multimedia is provided, comprising:
Obtain the present image of predetermined role in multimedia；
The auxiliary display device that the present image of the predetermined role is sent in multimedia scene is shown,
The auxiliary display device is different equipment from the multimedia equipment is played.
Wherein, the head portrait for obtaining predetermined role in multimedia, comprising:
Obtain the benchmark image of predetermined role；
The present image of predetermined role described in the multimedia is identified using the benchmark image of the predetermined role.
Wherein, the benchmark image for obtaining predetermined role, comprising:
Obtain the face image of user's assigned role；
Set the face image of user's assigned role to the benchmark image of the predetermined role.
Wherein, the benchmark image for obtaining predetermined role, comprising:
Obtain the multimedia advance notice segment；
At least one face image is obtained from the multimedia advance notice segment；
Set at least one described face image to the benchmark image of the predetermined role.
Wherein, the benchmark image for obtaining predetermined role, comprising:
The video clip of predetermined time length is obtained from the multimedia；
At least one face image is obtained from the video clip of the predetermined time length；
Set at least one described face image to the benchmark image of the predetermined role.
Wherein, at least one face image is obtained from the video clip of the predetermined time length, comprising:
All face images are obtained from the video clip of the predetermined time length；
Statistics belongs to the quantity of the face image of the same role；
Obtain at least one face image of the forward role of quantity.
According to the second aspect of an embodiment of the present disclosure, a kind of multimedia playback control apparatus is provided, comprising:
Module is obtained, is configured as obtaining the present image of predetermined role in multimedia；
Sending module is configured as the auxiliary being sent to the present image of the predetermined role in multimedia scene
Display equipment is shown that the auxiliary display device is different equipment from the multimedia equipment is played.
Wherein, the acquisition module, comprising:
First acquisition submodule is configured as obtaining the benchmark image of predetermined role；
It identifies submodule, is configured as identifying using the benchmark image of the predetermined role predetermined described in the multimedia
The present image of role.
Wherein, first acquisition submodule, comprising:
Second acquisition submodule is configured as obtaining the face image of user's assigned role；
First setting submodule, is configured as setting the predetermined role for the face image of user's assigned role
Benchmark image.
Wherein, first acquisition submodule, comprising:
Third acquisition submodule is configured as obtaining the multimedia advance notice segment；
4th acquisition submodule is configured as obtaining at least one face image from the multimedia advance notice segment；
Second setting submodule, is configured as setting at least one described face image to the benchmark of the predetermined role
Image.
Wherein, first acquisition submodule, comprising:
5th acquisition submodule is configured as obtaining the video clip of predetermined time length from the multimedia；
6th acquisition submodule is configured as obtaining at least one face from the video clip of the predetermined time length
Image；
Submodule is arranged in third, is configured as setting at least one described face image to the benchmark of the predetermined role
Image.
Wherein, the 6th acquisition submodule, comprising:
7th acquisition submodule is configured as obtaining all face's figures from the video clip of the predetermined time length
Picture；
Statistic submodule is configured as the quantity that statistics belongs to the face image of the same role；
8th acquisition submodule is configured as obtaining at least one face image of the forward role of quantity.
According to the third aspect of an embodiment of the present disclosure, a kind of multimedia playback control apparatus is provided, comprising:
Processor；
Memory for storage processor executable instruction；
Wherein, the processor is configured to:
Obtain the present image of predetermined role in multimedia；
The auxiliary display device that the present image of the predetermined role is sent in multimedia scene is shown,
The auxiliary display device is different equipment from the multimedia equipment is played.
The technical scheme provided by this disclosed embodiment can include the following benefits:
Above-mentioned technical proposal obtains the image of predetermined role from multimedia, and during multimedia, will make a reservation for
The auxiliary display device that the image of role is sent in multimedia environment is shown, that is, is sent to non-multimedia broadcasting and is set
In standby other display equipment, to play figure that is multimedia while showing in multimedia environment predetermined role
Picture, for example, in movie theatre watch 3D film while, by 3D film leading role and the various image pictures of supporting role it is synchronous in shadow
It is shown in auxiliary display device provided around institute, to increase viewing atmosphere.By the disclosure, multimedia can played
While dominant role in the other positions simultaneous display multimedia of multimedia environment different image pictures, to increase
Add multimedia viewing atmosphere, improves user and watch multimedia experience.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not
The disclosure can be limited.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the disclosure
Example, and together with specification for explaining the principles of this disclosure.
Fig. 1 is the flow chart of control method for playing multimedia shown according to an exemplary embodiment.
Fig. 2 is the flow chart of step 101 in control method for playing multimedia shown according to an exemplary embodiment.
Fig. 3 is the flow chart of step 201 in control method for playing multimedia shown according to an exemplary embodiment.
Fig. 4 is the flow chart of step 201 in the control method for playing multimedia shown according to a further exemplary embodiment.
Fig. 5 is the flow chart of step 201 in the control method for playing multimedia shown according to a further exemplary embodiment.
Fig. 6 is the flow chart of step 502 in control method for playing multimedia shown according to an exemplary embodiment.
Fig. 7 is the block diagram of multimedia playback control apparatus shown according to an exemplary embodiment.
Fig. 8 is the block diagram that module 701 is obtained in multimedia playback control apparatus shown according to an exemplary embodiment.
Fig. 9 is the first acquisition submodule 801 in multimedia playback control apparatus shown according to an exemplary embodiment
Block diagram.
Figure 10 is the first acquisition submodule 801 in the multimedia playback control apparatus shown according to a further exemplary embodiment
Block diagram.
Figure 11 is the first acquisition submodule 801 in the multimedia playback control apparatus shown according to a further exemplary embodiment
Block diagram.
Figure 12 is the 6th acquisition submodule 1102 in multimedia playback control apparatus shown according to an exemplary embodiment
Block diagram.
Figure 13 is the block diagram shown according to an exemplary embodiment suitable for multimedia playback control apparatus.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to
When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment
Described in embodiment do not represent all implementations consistent with this disclosure.On the contrary, they be only with it is such as appended
The example of the consistent device and method of some aspects be described in detail in claims, the disclosure.
Fig. 1 is a kind of flow chart of control method for playing multimedia shown according to an exemplary embodiment, such as Fig. 1 institute
Show, include the following steps 101-102:
In a step 101, the present image of predetermined role in multimedia is obtained；
In a step 102, the auxiliary that the present image of the predetermined role is sent in multimedia scene is shown
Equipment is shown that the auxiliary display device is different equipment from the multimedia equipment is played.
In the present embodiment, the image of predetermined role is obtained from multimedia, and during multimedia, by predetermined angle
The auxiliary display device that the image of color is sent in multimedia environment is shown, that is, is sent to non-multimedia playback equipment
Other display equipment in, to play image that is multimedia while showing in multimedia environment predetermined role,
It is such as while watching 3D film in movie theatre, the leading role in 3D film is synchronous with the various image pictures of supporting role in movie theatre week
It encloses in the auxiliary display device of setting and is shown, to increase viewing atmosphere.It through this embodiment, can be multimedia in broadcasting
The different image pictures of dominant role in the other positions simultaneous display multimedia of multimedia environment simultaneously, to increase
Multimedia viewing atmosphere improves user and watches multimedia experience.For example, when movie theatre watches horrow movie, by current picture
In the image of terrified role or the image of role in most terrified scene in multimedia be shown in the auxiliary around movie theatre
It shows in equipment, can add to one's terrors atmosphere, improve user experience.
In a kind of possible embodiment, as shown in Fig. 2, the step 101 can also by following step 201 and
202 complete.
In step 201, the benchmark image of predetermined role is obtained；
In step 202, predetermined role described in the multimedia is identified using the benchmark image of the predetermined role
Present image.
In the present embodiment, during multimedia, in order to obtain predetermined role in currently playing video content
Present image needs to obtain the benchmark image of predetermined role in advance.The benchmark image of the predetermined role includes can be from more matchmakers
In volumetric video segment determine the predetermined role image, as the face image of the predetermined role or other can obviously determine
For the feature of the predetermined role, such as the Buddhist monk's cap worn on one of the chief characters in "Pilgrimage To The West" who was supposedly incarnated through the spirit of pig, a symbol of man's cupidity's head in Journey to the West.During multimedia, pass through institute
The benchmark image of the predetermined role obtained is matched with multimedia content, obtains the present image of predetermined role in multimedia.
The present image of predetermined role can be identified from the multimedia by the matching of feature by image-recognizing method.For example,
When playing multimedia, the characteristics of image in multimedia video frame is extracted, and utilize extracted characteristics of image and the benchmark
The graphic feature of image carries out the mode such as matching determine in multimedia video frame whether include the predetermined role, if multimedia
Include the predetermined role in video frame, which can be sent to auxiliary after the image zooming-out in the video frame comes out
Show equipment.It, can be in advance by the figure of role predetermined in multimedia video frame in order to improve the multimedia sense of reality of viewing
As extracting, and the image of predetermined role is sent to auxiliary display device when being played to the video frame, with it is corresponding
Video frame synchronizes display.Certainly, the extraction of the present image of predetermined role and multimedia play can also be in video frame
It is synchronous to carry out, several seconds present images for extracting predetermined role in multimedia video frame can be shifted to an earlier date based on actual video processing capabilities
?.Multimedia many times is repeated playing for needs, such as plays the situation of film in cinema, it can in advance or the
When primary broadcasting, the image for corresponding to the predetermined role of video frame is all extracted and stored, is playing multimedia every time
When, the image of corresponding predetermined role is sent to auxiliary display device and shown by synchronization.
In a kind of possible embodiment, as shown in figure 3, the step 201 can also by following step 301 and
302 complete.
In step 301, the face image of user's assigned role is obtained；
In step 302, the face image of user's assigned role is set to the benchmark image of the predetermined role.
In the present embodiment, the benchmark image of predetermined role is specified by user.User is referred to by software or other modes
Determine and extract the face image of the predetermined role in multimedia, and using the face image of predetermined role as the base of predetermined role
Quasi- image.For example, for the horrow movie that will be shown, related personnel specifies most terrified in horrow movie and/or most
Have at least one distinctive predetermined role, and obtain the face image of at least one predetermined role, as predetermined angle
The benchmark image of color.Certainly, in other embodiments, other images of predetermined role, such as accessories, clothes energy can also be extracted
Enough unique identifications go out the image of the predetermined role.
In a kind of possible embodiment, as shown in figure 4, the step 201 can also pass through following step 401-403
To complete.
In step 401, the multimedia advance notice segment is obtained；
In step 402, at least one face image is obtained from the multimedia advance notice segment；
In step 403, at least one described face image is set to the benchmark image of the predetermined role.
In the present embodiment, by obtaining multimedia advance notice segment from the dynamic benchmark image for obtaining predetermined role.For example,
For multimedias such as films, usually can all there be corresponding advance notice segment, to show the multimedia related content.It is past to predict segment
Toward being the set for being best able to represent the video frame of multimedia content, wherein being substantially all the master that can occur in the multimedia content
Want role and main picture scene.Therefore the face image occurred in video frame can be extracted from advance notice segment, determined pre-
Determine the benchmark image of role.The face image extracted from advance notice segment usually can all have many, can scheme from multiple faces
Benchmark image of the different role face image as different role is selected as in.This mode through this embodiment, compared to
The benchmark image that dominant role is extracted by traversing entire multimedia video, can save the time, improve efficiency.
In a kind of possible embodiment, as shown in figure 5, the step 201 can also pass through following step 501-503
To complete.
In step 501, the video clip of predetermined time length is obtained from the multimedia；
In step 502, at least one face image is obtained from the video clip of the predetermined time length；
In step 503, at least one described face image is set to the benchmark image of the predetermined role.
In the present embodiment, the video clip of predetermined time length can be obtained from multimedia, then from acquired view
The benchmark image of predetermined role is extracted in frequency segment.The predetermined time length can be configured according to the actual situation.More matchmakers
Dominant role generally can all occur in multimedia beginning or latter end in body, therefore can be since multimedia or knot
Beam part obtains the video clip of predetermined time length, and extracts face image from the video frame of video clip.For being mentioned
The multiple face images taken therefrom choose a kind of benchmark image of the face image of different role as predetermined role.Certainly, in advance
The video clip for length of fixing time can also be specified by user, can also be obtained from the video clip of multiple predetermined time length
Take the face image of different role.The face's figure for extracting predetermined role not only can be improved in technical solution through this embodiment
The efficiency of picture, additionally it is possible to more comprehensively obtain each role in multimedia, and improve accuracy.
In a kind of possible embodiment, as shown in fig. 6, the step 502 can also pass through following step 601-603
To complete.
In step 601, all face images are obtained from the video clip of the predetermined time length；
In step 602, statistics belongs to the quantity of the face image of the same role；
In step 603, at least one face image of the forward role of quantity is obtained.
In the present embodiment, the video clip of predetermined time length is made of multiple video frames, and some video frames may go out
Existing one or more face image, and the face image occurred in different video frame may belong to the same role.And belong to same
The face image of one role is more, illustrates that role of the role in multimedia is more important, therefore can be by counting pre-
The quantity of the face image of the same role in the video clip for length of fixing time, and one or more roles that quantity is most
As predetermined role, and using the wherein width face image of predetermined role as the benchmark image of predetermined role.By this implementation
Example, can quickly and accurately determine the benchmark image of predetermined role and predetermined role.
Following is embodiment of the present disclosure, can be used for executing embodiments of the present disclosure.
Fig. 7 is a kind of block diagram of multimedia playback control apparatus shown according to an exemplary embodiment, which can be with
Pass through being implemented in combination with as some or all of of electronic equipment for software, hardware or both.As shown in fig. 7, the multimedia
Broadcast control device includes obtaining module 701 and sending module 702.Wherein:
Module 701 is obtained to be configured as obtaining the present image of predetermined role in multimedia；
Sending module 702 is configured as the present image of the predetermined role being sent to auxiliary in multimedia scene
Display equipment is helped to be shown, the auxiliary display device is different equipment from the multimedia equipment is played.
In the present embodiment, the image of predetermined role is obtained from multimedia, and during multimedia, by predetermined angle
The auxiliary display device that the image of color is sent in multimedia environment is shown, that is, is sent to non-multimedia playback equipment
Other display equipment in, to play image that is multimedia while showing in multimedia environment predetermined role,
It is such as while watching 3D film in movie theatre, the leading role in 3D film is synchronous with the various image pictures of supporting role in movie theatre week
It encloses in the auxiliary display device of setting and is shown, to increase viewing atmosphere.It through this embodiment, can be multimedia in broadcasting
The different image pictures of dominant role in the other positions simultaneous display multimedia of multimedia environment simultaneously, to increase
Multimedia viewing atmosphere improves user and watches multimedia experience.For example, when movie theatre watches horrow movie, by current picture
In the image of terrified role or the image of role in most terrified scene in multimedia be shown in the auxiliary around movie theatre
It shows in equipment, can add to one's terrors atmosphere, improve user experience.
In a kind of possible embodiment, as shown in figure 8, control method for playing multimedia disclosed above can also wrap
It includes and the acquisition module 701 is configured to include the first acquisition submodule 801 and identification submodule 802.Wherein:
First acquisition submodule 801 is configured as obtaining the benchmark image of predetermined role；
Identification submodule 802 is configured as identifying using the benchmark image of the predetermined role pre- described in the multimedia
Determine the present image of role.
In the present embodiment, during multimedia, in order to obtain predetermined role in currently playing video content
Present image needs to obtain the benchmark image of predetermined role in advance.The benchmark image of the predetermined role includes can be from more matchmakers
In volumetric video segment determine the predetermined role image, as the face image of the predetermined role or other can obviously determine
For the feature of the predetermined role, such as the Buddhist monk's cap worn on one of the chief characters in "Pilgrimage To The West" who was supposedly incarnated through the spirit of pig, a symbol of man's cupidity's head in Journey to the West.During multimedia, pass through institute
The benchmark image of the predetermined role obtained is matched with multimedia content, obtains the present image of predetermined role in multimedia.
The present image of predetermined role can be identified from the multimedia by the matching of feature by image-recognizing method.For example,
When playing multimedia, the characteristics of image in multimedia video frame is extracted, and utilize extracted characteristics of image and the benchmark
The graphic feature of image carries out the mode such as matching determine in multimedia video frame whether include the predetermined role, if multimedia
Include the predetermined role in video frame, which can be sent to auxiliary after the image zooming-out in the video frame comes out
Show equipment.It, can be in advance by the figure of role predetermined in multimedia video frame in order to improve the multimedia sense of reality of viewing
As extracting, and the image of predetermined role is sent to auxiliary display device when being played to the video frame, with it is corresponding
Video frame synchronizes display.Certainly, the extraction of the present image of predetermined role and multimedia play can also be in video frame
It is synchronous to carry out, several seconds present images for extracting predetermined role in multimedia video frame can be shifted to an earlier date based on actual video processing capabilities
?.Multimedia many times is repeated playing for needs, such as plays the situation of film in cinema, it can in advance or the
When primary broadcasting, the image for corresponding to the predetermined role of video frame is all extracted and stored, is playing multimedia every time
When, the image of corresponding predetermined role is sent to auxiliary display device and shown by synchronization.
In a kind of possible embodiment, as shown in figure 9, multimedia playback control apparatus disclosed above can also wrap
It includes and first acquisition submodule 801 is configured to include the second acquisition submodule 901 and the first setting submodule 902.Wherein:
Second acquisition submodule 901 is configured as obtaining the face image of user's assigned role；
First setting submodule 902 is configured as setting the predetermined angle for the face image of user's assigned role
The benchmark image of color.
In the present embodiment, the benchmark image of predetermined role is specified by user.User is referred to by software or other modes
Determine and extract the face image of the predetermined role in multimedia, and using the face image of predetermined role as the base of predetermined role
Quasi- image.For example, for the horrow movie that will be shown, related personnel specifies most terrified in horrow movie and/or most
Have at least one distinctive predetermined role, and obtain the face image of at least one predetermined role, as predetermined angle
The benchmark image of color.Certainly, in other embodiments, other images of predetermined role, such as accessories, clothes energy can also be extracted
Enough unique identifications go out the image of the predetermined role.
In a kind of possible embodiment, as shown in Figure 10, multimedia playback control apparatus disclosed above can be with
Including first acquisition submodule 801 be configured to include third acquisition submodule 1001, the 4th acquisition submodule 1002 and
Second setting submodule 1003.Wherein:
Third acquisition submodule 1001 is configured as obtaining the multimedia advance notice segment；
4th acquisition submodule 1002 is configured as obtaining at least one face figure from the multimedia advance notice segment
Picture；
Second setting submodule 1003 is configured as setting the predetermined role's at least one described face image
Benchmark image.
In the present embodiment, by obtaining multimedia advance notice segment from the dynamic benchmark image for obtaining predetermined role.For example,
For multimedias such as films, usually can all there be corresponding advance notice segment, to show the multimedia related content.It is past to predict segment
Toward being the set for being best able to represent the video frame of multimedia content, wherein being substantially all the master that can occur in the multimedia content
Want role and main picture scene.Therefore the face image occurred in video frame can be extracted from advance notice segment, determined pre-
Determine the benchmark image of role.The face image extracted from advance notice segment usually can all have many, can scheme from multiple faces
Benchmark image of the different role face image as different role is selected as in.This mode through this embodiment, compared to
The benchmark image that dominant role is extracted by traversing entire multimedia video, can save the time, improve efficiency.
In a kind of possible embodiment, as shown in figure 11, multimedia playback control apparatus disclosed above can be with
Including first acquisition submodule 801 be configured to include the 5th acquisition submodule 1101, the 6th acquisition submodule 1102 and
Submodule 1103 is arranged in third.Wherein:
5th acquisition submodule 1101 is configured as obtaining the video clip of predetermined time length from the multimedia；
6th acquisition submodule 1102 is configured as obtaining at least one from the video clip of the predetermined time length
Face image；
Third setting submodule 1103 is configured as setting the predetermined role's at least one described face image
Benchmark image.
In the present embodiment, the video clip of predetermined time length can be obtained from multimedia, then from acquired view
The benchmark image of predetermined role is extracted in frequency segment.The predetermined time length can be configured according to the actual situation.More matchmakers
Dominant role generally can all occur in multimedia beginning or latter end in body, therefore can be since multimedia or knot
Beam part obtains the video clip of predetermined time length, and extracts face image from the video frame of video clip.For being mentioned
The multiple face images taken therefrom choose a kind of benchmark image of the face image of different role as predetermined role.Certainly, in advance
The video clip for length of fixing time can also be specified by user, can also be obtained from the video clip of multiple predetermined time length
Take the face image of different role.The face's figure for extracting predetermined role not only can be improved in technical solution through this embodiment
The efficiency of picture, additionally it is possible to more comprehensively obtain each role in multimedia, and improve accuracy.
In a kind of possible embodiment, as shown in figure 12, multimedia playback control apparatus disclosed above can be with
Including the 6th acquisition submodule 1102 is configured to include the 7th acquisition submodule 1201, statistic submodule 1202 and the 8th
Acquisition submodule 1203.Wherein:
7th acquisition submodule 1201 is configured as obtaining all faces from the video clip of the predetermined time length
Image；
Statistic submodule 1202 is configured as the quantity that statistics belongs to the face image of the same role；
8th acquisition submodule 1203 is configured as obtaining at least one face image of the forward role of quantity.
In the present embodiment, the video clip of predetermined time length is made of multiple video frames, and some video frames may go out
Existing one or more face image, and the face image occurred in different video frame may belong to the same role.And belong to same
The face image of one role is more, illustrates that role of the role in multimedia is more important, therefore can be by counting pre-
The quantity of the face image of the same role in the video clip for length of fixing time, and one or more roles that quantity is most
As predetermined role, and using the wherein width face image of predetermined role as the benchmark image of predetermined role.By this implementation
Example, can quickly and accurately determine the benchmark image of predetermined role and predetermined role.
According to the third aspect of an embodiment of the present disclosure, a kind of multimedia playback control apparatus is provided, comprising:
Processor；
Memory for storage processor executable instruction；
Wherein, processor is configured as:
Obtain the present image of predetermined role in multimedia；
The auxiliary display device that the present image of the predetermined role is sent in multimedia scene is shown,
The auxiliary display device is different equipment from the multimedia equipment is played.
Above-mentioned processor is also configured to:
Wherein, the head portrait for obtaining predetermined role in multimedia, comprising:
Obtain the benchmark image of predetermined role；
The present image of predetermined role described in the multimedia is identified using the benchmark image of the predetermined role.
Wherein, the benchmark image for obtaining predetermined role, comprising:
Obtain the face image of user's assigned role；
Set the face image of user's assigned role to the benchmark image of the predetermined role.
Wherein, the benchmark image for obtaining predetermined role, comprising:
Obtain the multimedia advance notice segment；
At least one face image is obtained from the multimedia advance notice segment；
Set at least one described face image to the benchmark image of the predetermined role.
Wherein, the benchmark image for obtaining predetermined role, comprising:
The video clip of predetermined time length is obtained from the multimedia；
At least one face image is obtained from the video clip of the predetermined time length；
Set at least one described face image to the benchmark image of the predetermined role.
Wherein, at least one face image is obtained from the video clip of the predetermined time length, comprising:
All face images are obtained from the video clip of the predetermined time length；
Statistics belongs to the quantity of the face image of the same role；
Obtain at least one face image of the forward role of quantity.
Figure 13 is a kind of block diagram for multimedia playback control apparatus shown according to an exemplary embodiment, the device
Suitable for terminal device.For example, device 1300 can be mobile phone, and computer, digital broadcasting terminal, messaging device,
Game console, tablet device, Medical Devices, body-building equipment, personal digital assistant etc..
Device 1300 may include following one or more components: processing component 1302, memory 1304, power supply module
1306, multimedia component 1308, audio component 1310, the interface 1312 of input/output (I/O), sensor module 1314, and
Communication component 1316.
The integrated operation of the usual control device 1300 of processing component 1302, such as with display, telephone call, data communication,
Camera operation and record operate associated operation.Processing component 1302 may include one or more processors 1320 to execute
Instruction, to perform all or part of the steps of the methods described above.In addition, processing component 1302 may include one or more moulds
Block, convenient for the interaction between processing component 1302 and other assemblies.For example, processing component 1302 may include multi-media module,
To facilitate the interaction between multimedia component 1308 and processing component 1302.
Memory 1304 is configured as storing various types of data to support the operation in device 1300.These data
Example includes the instruction of any application or method for operating on device 1300, contact data, telephone book data,
Message, picture, video etc..Memory 1304 can by any kind of volatibility or non-volatile memory device or they
Combination is realized, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), it is erasable can
Program read-only memory (EPROM), programmable read only memory (PROM), read-only memory (ROM), magnetic memory, flash memory
Reservoir, disk or CD.
Power supply module 1306 provides electric power for the various assemblies of device 1300.Power supply module 1306 may include power management
System, one or more power supplys and other with for device 1300 generate, manage, and distribute the associated component of electric power.
Multimedia component 1308 includes the screen of one output interface of offer between described device 1300 and user.?
In some embodiments, screen may include liquid crystal display (LCD) and touch panel (TP).If screen includes touch panel,
Screen may be implemented as touch screen, to receive input signal from the user.Touch panel includes that one or more touch passes
Sensor is to sense the gesture on touch, slide, and touch panel.The touch sensor can not only sense touch or sliding is dynamic
The boundary of work, but also detect duration and pressure associated with the touch or slide operation.In some embodiments, more
Media component 1308 includes a front camera and/or rear camera.When device 1300 is in operation mode, as shot mould
When formula or video mode, front camera and/or rear camera can receive external multi-medium data.Each preposition camera shooting
Head and rear camera can be a fixed optical lens system or have focusing and optical zoom capabilities.
Audio component 1310 is configured as output and/or input audio signal.For example, audio component 1310 includes a wheat
Gram wind (MIC), when device 1300 is in operation mode, when such as call mode, recording mode, and voice recognition mode, microphone quilt
It is configured to receive external audio signal.The received audio signal can be further stored in memory 1304 or via communication
Component 1316 is sent.In some embodiments, audio component 1310 further includes a loudspeaker, is used for output audio signal.
I/O interface 1312 provides interface, above-mentioned peripheral interface module between processing component 1302 and peripheral interface module
It can be keyboard, click wheel, button etc..These buttons may include, but are not limited to: home button, volume button, start button and
Locking press button.
Sensor module 1314 includes one or more sensors, and the state for providing various aspects for device 1300 is commented
Estimate.For example, sensor module 1314 can detecte the state that opens/closes of device 1300, the relative positioning of component, such as institute
The display and keypad that component is device 1300 are stated, sensor module 1314 can be with detection device 1300 or device 1,300 1
The position change of a component, the existence or non-existence that user contacts with device 1300,1300 orientation of device or acceleration/deceleration and dress
Set 1300 temperature change.Sensor module 1314 may include proximity sensor, be configured in not any physics
It is detected the presence of nearby objects when contact.Sensor module 1314 can also include optical sensor, as CMOS or ccd image are sensed
Device, for being used in imaging applications.In some embodiments, which can also include acceleration sensing
Device, gyro sensor, Magnetic Sensor, pressure sensor or temperature sensor.
Communication component 1316 is configured to facilitate the communication of wired or wireless way between device 1300 and other equipment.Dress
The wireless network based on communication standard, such as WiFi can be accessed by setting 1300,2G or 3G or their combination.It is exemplary at one
In embodiment, communication component 1316 receives broadcast singal or broadcast correlation from external broadcasting management system via broadcast channel
Information.In one exemplary embodiment, the communication component 1316 further includes near-field communication (NFC) module, to promote short distance
Communication.For example, radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra wide band can be based in NFC module
(UWB) technology, bluetooth (BT) technology and other technologies are realized.
In the exemplary embodiment, device 1300 can be by one or more application specific integrated circuit (ASIC), number
Signal processor (DSP), digital signal processing appts (DSPD), programmable logic device (PLD), field programmable gate array
(FPGA), controller, microcontroller, microprocessor or other electronic components are realized, for executing the above method.
In the exemplary embodiment, a kind of non-transitorycomputer readable storage medium including instruction, example are additionally provided
It such as include the memory 1304 of instruction, above-metioned instruction can be executed by the processor 1320 of device 1300 to complete the above method.Example
Such as, the non-transitorycomputer readable storage medium can be ROM, random access memory (RAM), CD-ROM, tape, soft
Disk and optical data storage devices etc..
A kind of non-transitorycomputer readable storage medium, when the instruction in the storage medium is by the processing of device 1300
When device executes, so that the method that device 1300 is able to carry out above-mentioned multimedia control, which comprises
Obtain the present image of predetermined role in multimedia；
The auxiliary display device that the present image of the predetermined role is sent in multimedia scene is shown,
The auxiliary display device is different equipment from the multimedia equipment is played.
Wherein, the head portrait for obtaining predetermined role in multimedia, comprising:
Obtain the benchmark image of predetermined role；
The present image of predetermined role described in the multimedia is identified using the benchmark image of the predetermined role.
Wherein, the benchmark image for obtaining predetermined role, comprising:
Obtain the face image of user's assigned role；
Set the face image of user's assigned role to the benchmark image of the predetermined role.
Wherein, the benchmark image for obtaining predetermined role, comprising:
Obtain the multimedia advance notice segment；
At least one face image is obtained from the multimedia advance notice segment；
Set at least one described face image to the benchmark image of the predetermined role.
Wherein, the benchmark image for obtaining predetermined role, comprising:
The video clip of predetermined time length is obtained from the multimedia；
At least one face image is obtained from the video clip of the predetermined time length；
Set at least one described face image to the benchmark image of the predetermined role.
Wherein, at least one face image is obtained from the video clip of the predetermined time length, comprising:
All face images are obtained from the video clip of the predetermined time length；
Statistics belongs to the quantity of the face image of the same role；
Obtain at least one face image of the forward role of quantity.
Those skilled in the art will readily occur to its of the disclosure after considering specification and practicing disclosure disclosed herein
Its embodiment.This application is intended to cover any variations, uses, or adaptations of the disclosure, these modifications, purposes or
Person's adaptive change follows the general principles of this disclosure and including the undocumented common knowledge in the art of the disclosure
Or conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the disclosure are by following
Claim is pointed out.
It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and
And various modifications and changes may be made without departing from the scope thereof.The scope of the present disclosure is only limited by the accompanying claims.
Claims (14)
1. a kind of control method for playing multimedia characterized by comprising
When playing multimedia, acquisition includes the current figure of the predetermined role in the multimedia video frame of predetermined role
Picture；
When being played to the video frame, the present image of the predetermined role in the video frame is sent to multimedia and is broadcast
The auxiliary display device put in scene is shown that the auxiliary display device is different from the multimedia equipment is played
Equipment.
2. the method as described in claim 1, which is characterized in that the acquisition includes in the multimedia video frame of predetermined role
The predetermined role present image, comprising:
Obtain the benchmark image of predetermined role；
The present image of predetermined role described in the multimedia video frame is identified using the benchmark image of the predetermined role.
3. method according to claim 2, which is characterized in that the benchmark image for obtaining predetermined role, comprising:
Obtain the face image of user's assigned role；
Set the face image of user's assigned role to the benchmark image of the predetermined role.
4. method according to claim 2, which is characterized in that the benchmark image for obtaining predetermined role, comprising:
Obtain the multimedia advance notice segment；
At least one face image is obtained from the multimedia advance notice segment；
Set at least one described face image to the benchmark image of the predetermined role.
5. method according to claim 2, which is characterized in that the benchmark image for obtaining predetermined role, comprising:
The video clip of predetermined time length is obtained from the multimedia；
At least one face image is obtained from the video clip of the predetermined time length；
Set at least one described face image to the benchmark image of the predetermined role.
6. method as claimed in claim 5, which is characterized in that obtained at least from the video clip of the predetermined time length
One face image, comprising:
All face images are obtained from the video clip of the predetermined time length；
Statistics belongs to the quantity of the face image of the same role；
Obtain at least one face image of the forward role of quantity.
7. a kind of multimedia playback control apparatus characterized by comprising
Module is obtained, is configured as when playing multimedia, acquisition includes described in the multimedia video frame of predetermined role
The present image of predetermined role；
Sending module is configured as when being played to the video frame, by the current of the predetermined role in the video frame
The auxiliary display device that image is sent in multimedia scene is shown that the auxiliary display device and broadcasting are described more
The equipment of media is different equipment.
8. device as claimed in claim 7, which is characterized in that the acquisition module, comprising:
First acquisition submodule is configured as obtaining the benchmark image of predetermined role；
It identifies submodule, is configured as identifying using the benchmark image of the predetermined role pre- described in the multimedia video frame
Determine the present image of role.
9. device as claimed in claim 8, which is characterized in that first acquisition submodule, comprising:
Second acquisition submodule is configured as obtaining the face image of user's assigned role；
First setting submodule, is configured as setting the face image of user's assigned role in the base of the predetermined role
Quasi- image.
10. device as claimed in claim 8, which is characterized in that first acquisition submodule, comprising:
Third acquisition submodule is configured as obtaining the multimedia advance notice segment；
4th acquisition submodule is configured as obtaining at least one face image from the multimedia advance notice segment；
Second setting submodule, is configured as setting at least one described face image to the reference map of the predetermined role
Picture.
11. device as claimed in claim 8, which is characterized in that first acquisition submodule, comprising:
5th acquisition submodule is configured as obtaining the video clip of predetermined time length from the multimedia；
6th acquisition submodule is configured as obtaining at least one face figure from the video clip of the predetermined time length
Picture；
Submodule is arranged in third, is configured as setting at least one described face image to the reference map of the predetermined role
Picture.
12. device as claimed in claim 11, which is characterized in that the 6th acquisition submodule, comprising:
7th acquisition submodule is configured as obtaining all face images from the video clip of the predetermined time length；
Statistic submodule is configured as the quantity that statistics belongs to the face image of the same role；
8th acquisition submodule is configured as obtaining at least one face image of the forward role of quantity.
13. a kind of multimedia playback control apparatus characterized by comprising
Processor；
Memory for storage processor executable instruction；
Wherein, the processor is configured to:
When playing multimedia, acquisition includes the current figure of the predetermined role in the multimedia video frame of predetermined role
Picture；
When being played to the video frame, the present image of the predetermined role in the video frame is sent to multimedia and is broadcast
The auxiliary display device put in scene is shown that the auxiliary display device is different from the multimedia equipment is played
Equipment.
14. a kind of computer readable storage medium, is stored thereon with computer instruction, which is characterized in that the instruction is by processor
The step of any one of the claims 1-6 the method is realized when execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610943207.1A CN106454451B (en) | 2016-10-31 | 2016-10-31 | Control method for playing multimedia and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610943207.1A CN106454451B (en) | 2016-10-31 | 2016-10-31 | Control method for playing multimedia and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106454451A CN106454451A (en) | 2017-02-22 |
| CN106454451B true CN106454451B (en) | 2019-08-06 |
Family
ID=58177433
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610943207.1A Active CN106454451B (en) | 2016-10-31 | 2016-10-31 | Control method for playing multimedia and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106454451B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107318029A (en) * | 2017-06-14 | 2017-11-03 | 北京易威科技有限公司 | Switch the method for correspondence virtual reality scenario according to video content under VR environment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101232612A (en) * | 2007-12-06 | 2008-07-30 | 北京广视通达网络技术有限公司 | Assistant medium playing method triggered based on video contents |
| CN103368932A (en) * | 2012-04-06 | 2013-10-23 | 瑞昱半导体股份有限公司 | Multi-screen video playback system and related multi-screen control device |
| CN105744292A (en) * | 2016-02-02 | 2016-07-06 | 广东欧珀移动通信有限公司 | Video data processing method and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9218122B2 (en) * | 2011-12-29 | 2015-12-22 | Rovi Guides, Inc. | Systems and methods for transferring settings across devices based on user gestures |
-
2016
- 2016-10-31 CN CN201610943207.1A patent/CN106454451B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101232612A (en) * | 2007-12-06 | 2008-07-30 | 北京广视通达网络技术有限公司 | Assistant medium playing method triggered based on video contents |
| CN103368932A (en) * | 2012-04-06 | 2013-10-23 | 瑞昱半导体股份有限公司 | Multi-screen video playback system and related multi-screen control device |
| CN103368933A (en) * | 2012-04-06 | 2013-10-23 | 瑞昱半导体股份有限公司 | Video playback system for enhancing drama effect and related drama effect control device |
| CN105744292A (en) * | 2016-02-02 | 2016-07-06 | 广东欧珀移动通信有限公司 | Video data processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106454451A (en) | 2017-02-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20170304735A1 (en) | Method and Apparatus for Performing Live Broadcast on Game | |
| CN106559712B (en) | Video playing processing method and device and terminal equipment | |
| CN104918107B (en) | The identification processing method and device of video file | |
| CN106791893A (en) | Net cast method and device | |
| EP3136391A1 (en) | Method, device and terminal device for video effect processing | |
| CN104243819A (en) | Photo acquiring method and device | |
| CN104391711B (en) | A kind of method and device that screen protection is set | |
| CN104090709B (en) | Picture switching method and device | |
| CN111031393A (en) | Video playing method, device, terminal and storage medium | |
| CN112738544B (en) | Live broadcast room interaction method and device, electronic equipment and storage medium | |
| CN105117111B (en) | The rendering method and device of virtual reality interactive picture | |
| CN104035674B (en) | Picture displaying method and device | |
| CN107132769B (en) | Intelligent equipment control method and device | |
| EP3133806A1 (en) | Method and device for generating panorama | |
| CN106254939B (en) | Information prompting method and device | |
| CN104881342B (en) | terminal test method and device | |
| CN107124658B (en) | Net cast method and device | |
| CN104156151A (en) | Image display method and image display device | |
| CN104837020B (en) | The method and apparatus for playing video | |
| CN106228077B (en) | It handles image and shows the method, apparatus and terminal of image | |
| CN106454451B (en) | Control method for playing multimedia and device | |
| CN108600625A (en) | Image acquiring method and device | |
| CN105957011B (en) | Image processing method and device | |
| CN111698532B (en) | Bullet screen information processing method and device | |
| CN106954093A (en) | Panoramic video processing method, apparatus and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |