CN114302235A - Multimedia playing method, device, storage medium and electronic equipment - Google Patents
Multimedia playing method, device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN114302235A CN114302235A CN202111617587.7A CN202111617587A CN114302235A CN 114302235 A CN114302235 A CN 114302235A CN 202111617587 A CN202111617587 A CN 202111617587A CN 114302235 A CN114302235 A CN 114302235A
- Authority
- CN
- China
- Prior art keywords
- playing
- target
- time point
- browsing
- record
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 230000004044 response Effects 0.000 claims abstract description 25
- 230000006399 behavior Effects 0.000 claims description 97
- 230000001815 facial effect Effects 0.000 claims description 46
- 230000008560 physiological behavior Effects 0.000 claims description 26
- 238000004590 computer program Methods 0.000 claims description 13
- 238000001514 detection method Methods 0.000 claims description 13
- 238000012545 processing Methods 0.000 claims description 12
- 230000000694 effects Effects 0.000 abstract description 4
- 230000006870 function Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 206010011469 Crying Diseases 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Landscapes
- Television Signal Processing For Recording (AREA)
Abstract
The application discloses a multimedia playing method, a multimedia playing device, a storage medium and electronic equipment, which relate to the technical field of Internet, and the method comprises the following steps: in response to detecting a specific object behavior of a media browsing object, collecting characteristic information of the media browsing object, and generating a target object identifier based on the characteristic information; acquiring a play record of a target multimedia, wherein the play record comprises a play record time point and at least one preset object identifier; comparing the target object identification with the preset object identification to obtain a comparison result; and determining a playing time point matched with the specific object behavior according to the comparison result and the playing recording time point, and playing the target multimedia according to the playing time point. The multimedia playing effect can be effectively improved.
Description
Technical Field
The present application relates to the field of internet technologies, and in particular, to a multimedia playing method and apparatus, a storage medium, and an electronic device.
Background
With the development of the technology, the playing experience requirements of multimedia such as video and the like are higher and higher, taking playing a video program in a smart television as an example, different objects often generate different playing records when operating the television to play the video program, and generally the objects have the requirement of playing back the video program according to the playing records.
However, there are cases where multiple objects browse multimedia simultaneously, and at present, when playing multimedia according to a play record, the multimedia is often played simply based on a time point at which the multimedia recorded by the device ends playing historically, and it is generally difficult to play the multimedia at a suitable position for the case where multiple objects browse multimedia, which results in poor playing effect of the multimedia and poor user playing experience.
Disclosure of Invention
The embodiment of the application provides a scheme, which can effectively improve the playing effect of multimedia.
The embodiment of the application provides the following technical scheme:
according to an embodiment of the present application, a multimedia playing method includes: in response to detecting a specific object behavior of a media browsing object, collecting characteristic information of the media browsing object, and generating a target object identifier based on the characteristic information; acquiring a play record of a target multimedia, wherein the play record comprises a play record time point and at least one preset object identifier; comparing the target object identification with the preset object identification to obtain a comparison result; and determining a playing time point matched with the specific object behavior according to the comparison result and the playing recording time point, and playing the target multimedia according to the playing time point.
In some embodiments of the present application, the specific object behavior includes a browsing participation behavior within a predetermined time period at which a trigger time point of a specific play request is located; the collecting characteristic information of the media browsing object in response to detecting the specific object behavior of the media browsing object and generating the target object identifier based on the characteristic information comprises: if the specific playing request corresponding to the target multimedia is received, detecting a facial image of a media browsing object in a target area within a preset time period of a trigger time point of the specific playing request; in response to detecting the facial image, extracting facial feature information based on the facial image as feature information of the media browsing object; generating the target object identification based on the characteristic information.
In some embodiments of the present application, the target object identification comprises at least one; the determining the playing time point matched with the specific object behavior according to the comparison result and the playing record time point includes: if the comparison result indicates that the at least one target object identifier is consistent with the at least one preset object identifier, determining the playing recording time point as a playing time point matched with the browsing participation behavior; the method further comprises the following steps: and continuing to update and record browsing record information of the media browsing object aiming at the target multimedia in the playing record.
In some embodiments of the present application, the target object identification comprises at least one; the determining the playing time point matched with the specific object behavior according to the comparison result and the playing record time point includes: if the comparison result indicates that the at least one target object identifier is a subset of the at least one preset object identifier, determining the playing recording time point as a playing time point matched with the browsing participation behavior; the method further comprises the following steps: and generating a target browsing record, and recording browsing record information of the media browsing object aiming at the target multimedia in the target browsing record.
In some embodiments of the present application, the target object identifier includes a plurality, and the play record includes a plurality; the determining the playing time point matched with the specific object behavior according to the comparison result and the playing record time point includes: if the comparison result indicates that at least two target object identifications exist in different playing records and at least two playing record time points exist in different playing records, determining the minimum playing record time point as the playing time point matched with the browsing participation behavior; the method further comprises the following steps: and generating a current browsing record, and recording browsing record information of the media browsing object aiming at the target multimedia in the current browsing record.
In some embodiments of the present application, the particular subject behavior comprises a particular physiological behavior; the collecting characteristic information of the media browsing object in response to detecting the specific object behavior of the media browsing object and generating the target object identifier based on the characteristic information comprises: in response to detecting the particular physiological behavior of a media browsing object, capturing a facial image of the media browsing object; extracting facial feature information based on the facial image as feature information of the media browsing object, and generating an object identifier based on the feature information; predicting a browsing expectation tag of the media browsing object based on behavior information corresponding to the specific physiological behavior; and combining the object identification and the browsing expected label to obtain the target object identification.
In some embodiments of the present application, each of the preset object identifiers is generated by combining a related object identifier and a target browsing expected tag, the playing recording time point includes a plurality of recording time points, and each of the preset object identifiers corresponds to one recording time point; the determining the playing time point matched with the specific object behavior according to the comparison result and the playing record time point includes: determining a preset object identifier of a target browsing expected tag matched with the browsing expected tag according to the comparison result to obtain a target preset object identifier; acquiring an object relation network corresponding to the object identification and a related object identification in the target preset object identification; grading based on the object relationship network to obtain a browsing grade of each related object identifier in the target preset object identifier; determining the preset object identification corresponding to the related object identification with the highest browsing score to obtain a target playing identification; and determining the recording time point corresponding to the target playing identifier as the playing time point matched with the specific physiological behavior.
According to another embodiment of the present application, a multimedia playback apparatus includes: the detection module is used for responding to the detection of the specific object behavior of the media browsing object, collecting the characteristic information of the media browsing object and generating a target object identifier based on the characteristic information; the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring a play record of a target multimedia, and the play record comprises a play record time point and at least one preset object identifier; the comparison module is used for comparing the target object identification with the preset object identification to obtain a comparison result; and the playing module is used for determining the playing time point matched with the specific object behavior according to the comparison result and the playing record time point and playing the target multimedia according to the playing time point.
According to another embodiment of the present application, a storage medium has stored thereon a computer program which, when executed by a processor of a computer, causes the computer to perform the method of an embodiment of the present application.
According to another embodiment of the present application, an electronic device may include: a memory storing a computer program; and the processor reads the computer program stored in the memory to execute the method in the embodiment of the application.
In the embodiment of the application, in response to the detection of the specific object behavior of the media browsing object, collecting the characteristic information of the media browsing object, and generating a target object identifier based on the characteristic information; acquiring a play record of a target multimedia, wherein the play record comprises a play record time point and at least one preset object identifier; comparing the target object identification with the preset object identification to obtain a comparison result; and determining a playing time point matched with the specific object behavior according to the comparison result and the playing recording time point, and playing the target multimedia according to the playing time point.
In this way, the target object identifier is obtained according to the specific object behavior of the media browsing object, the play record corresponding to the target multimedia and including at least one preset object identifier is obtained, the play time point matched with the specific user behavior is determined according to the comparison result of the target object identifier and the preset object identifier and the play record time point, when the situation that a plurality of objects watch the multimedia simultaneously is faced, the target multimedia can be played very suitably based on one play time point matched with the specific user behavior, the play effect of the multimedia can be effectively improved, and the play experience of the user is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 shows a schematic diagram of a system to which embodiments of the present application may be applied.
Fig. 2 shows a flow chart of a multimedia playback method according to an embodiment of the application.
Fig. 3 shows a block diagram of a multimedia playback device according to an embodiment of the present application.
FIG. 4 shows a block diagram of an electronic device according to an embodiment of the application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In the description that follows, specific embodiments of the present application will be described with reference to steps and symbols executed by one or more computers, unless otherwise indicated. Accordingly, these steps and operations will be referred to, several times, as being performed by a computer, the computer performing operations involving a processing unit of the computer in electronic signals representing data in a structured form. This operation transforms the data or maintains it at locations in the computer's memory system, which may be reconfigured or otherwise altered in a manner well known to those skilled in the art. The data maintains a data structure that is a physical location of the memory that has particular characteristics defined by the data format. However, the principles of the present application are described in the foregoing text and are not meant to be limiting, as those of ordinary skill in the art will appreciate that various steps and operations described below may be implemented in hardware.
In addition, the embodiment of the present application may legally perform collection, processing, and the like of data such as feature information of an object on the basis of user approval or authorization.
FIG. 1 shows a schematic diagram of a system 100 to which embodiments of the present application may be applied. As shown in fig. 1, system 100 may include a terminal 101. The terminal 101 may be any computer device, such as a computer, a mobile phone, a smart watch, a home appliance (e.g., a smart television), and the like, and the terminal 101 may be equipped with a facial image capturing device such as a camera.
In one embodiment of this example, the terminal 101 may: in response to detecting a specific object behavior of a media browsing object, collecting characteristic information of the media browsing object, and generating a target object identifier based on the characteristic information; acquiring a play record of a target multimedia, wherein the play record comprises a play record time point and at least one preset object identifier; comparing the target object identification with the preset object identification to obtain a comparison result; and determining a playing time point matched with the specific object behavior according to the comparison result and the playing recording time point, and playing the target multimedia according to the playing time point.
Fig. 2 schematically shows a flow chart of a multimedia playback method according to an embodiment of the present application. The execution subject of the multimedia playing method may be any device, such as the terminal 101 shown in fig. 1.
As shown in fig. 2, the multimedia playing method may include steps S210 to S240.
Step S210, in response to the detection of the specific object behavior of the media browsing object, collecting the characteristic information of the media browsing object, and generating a target object identifier based on the characteristic information; step S220, obtaining a play record of the target multimedia, wherein the play record comprises a play record time point and at least one preset object identifier; step S230, comparing the target object identifier with the preset object identifier to obtain a comparison result; step S240, determining a playing time point matched with the behavior of the specific object according to the comparison result and the playing record time point, and playing the target multimedia according to the playing time point.
The media browsing object may be an object that browses multimedia, such as a user browsing television programs. Through equipment such as a camera or a recording device, browsing participation behaviors of a media browsing object (such as behaviors participating in browsing a target multimedia in a preset time period after the target multimedia is triggered to be played) or specific object behaviors such as specific physiological behaviors (such as behaviors of laughing, crying or smiling face) can be detected in an agreed legal protocol mode.
The feature information is, for example, feature information of an object such as sound information or face image information. The characteristic information of the media browsing object can be collected through equipment such as a camera or recording equipment. The target object identification can be the identification which can uniquely identify the media browsing object, and the characteristic information is the information which can uniquely represent the media browsing object, so that the target object identification of the media browsing object can be generated based on the characteristic information.
The play record can be obtained from the cloud or from a local memory, and the like. Target multimedia such as television programs or article content, etc. The target multimedia may be the multimedia desired to be viewed as indicated by the media browsing object.
The play record includes a play record time point and at least one preset object identifier, the play record time point is a specific play time point of the target multimedia (for example, a play time point of a television when a certain time is finished watching or a play time point with specific picture content when a certain time is watched) recorded when objects (for example, 1 or 3 objects and the like) corresponding to the at least one preset object identifier (for example, 1 or 3 objects and the like) watch the target multimedia together, and the preset object identifier is an identifier corresponding to an object in history when the certain time watches the target multimedia together.
The target object identifier is compared with at least one preset object identifier in the play record to obtain a comparison result, and the comparison result may indicate a relationship between the media browsing object and a historical object historically participating in browsing the target multimedia, for example, the media browsing object is identical to the historical object or the media browsing object belongs to a subset of the historical object.
And then, according to the comparison result and the playing record time points, determining the playing time points matched with the behaviors of the specific objects, and under the condition that the number of the media browsing objects is any number, determining a proper playing time point and playing the target multimedia according to the playing time point.
In this way, based on steps S210 to S240, a target object identifier is obtained according to a specific object behavior of the media browsing object, a play record corresponding to the target multimedia and including at least one preset object identifier is obtained, and a play time point matching the specific user behavior is determined according to a comparison result between the target object identifier and the preset object identifier and the play record time point.
The following describes specific procedures of each step performed when multimedia playback is performed.
In step S210, in response to detecting a specific object behavior of the media browsing object, feature information of the media browsing object is collected, and a target object identifier is generated based on the feature information.
In one embodiment, the specific object behavior includes a browsing participation behavior within a predetermined time period at which a trigger time point of a specific play request is located; step S210, in response to detecting a specific object behavior of a media browsing object, acquiring feature information of the media browsing object, and generating a target object identifier based on the feature information, including:
if the specific playing request corresponding to the target multimedia is received, detecting a facial image of a media browsing object in a target area within a preset time period of a trigger time point of the specific playing request; in response to detecting the facial image, extracting facial feature information based on the facial image as feature information of the media browsing object; generating the target object identification based on the characteristic information.
The specific play request may include a playback request or a play start request, and the like, where the trigger time point is a user trigger time point of the specific play request, the predetermined time period is a time period of a predetermined length starting from the trigger time point, and the target area may be a preset media browsing area, and an object in the media browsing area is regarded as an object whose probability of browsing multimedia is higher than a predetermined threshold.
Facial images of media browsing objects participating in viewing of the target multimedia can be continuously captured by the image capturing device for a predetermined period of time, and facial feature information of each captured facial image is extracted. Based on the facial feature information as the feature information, an object identifier matched with the facial feature information may be acquired from the face recognition library as a target object identifier, or a unique target object identifier may be generated based on the facial feature information. And further, generating a target object identifier of each media browsing object aiming at each media browsing object corresponding to the browsing participation behavior.
In one embodiment, the particular subject behavior comprises a particular physiological behavior; step S210, in response to detecting a specific object behavior of a media browsing object, acquiring feature information of the media browsing object, and generating a target object identifier based on the feature information, including:
in response to detecting the particular physiological behavior of a media browsing object, capturing a facial image of the media browsing object; extracting facial feature information based on the facial image as feature information of the media browsing object, and generating an object identifier based on the feature information; predicting a browsing expectation tag of the media browsing object based on behavior information corresponding to the specific physiological behavior; and combining the object identification and the browsing expected label to obtain the target object identification.
The specific physiological behaviors such as laughing, crying or smiling face and the like can be one or more objects generating the specific physiological behaviors, and can be set according to actual conditions. After the specific physiological behavior is detected, facial images of the media browsing object are collected to extract facial feature information as feature information of the media browsing object, and an object identifier matched with the specific information is obtained from a facial recognition library based on the feature information or a unique object identifier corresponding to the feature information is generated in a self-defining mode based on the specific information.
The method is characterized in that corresponding behavior information can be acquired while specific physiological behaviors are detected, the behavior information such as audio characteristic information or image characteristic information of a plurality of facial images is input into a prediction module for prediction processing by adopting a pre-trained prediction model based on machine learning, and a browsing expected label of a media browsing object is predicted. Browsing intent tags may refer to tags such as a particular browsing score or a particular browsing level of a media browsing object at a current time. The type of the browsing expectation tag can be at least one type of browsing expectation tag according to requirements in advance when the prediction model is trained, and the prediction model can predict one type of browsing expectation tag matched with the behavior information according to the behavior information.
And combining the generated browsing expected tags with each object identifier respectively to obtain at least one target object identifier.
In step S220, a play record of the target multimedia is obtained, where the play record includes a play record time point and at least one preset object identifier.
The play record includes a play record time point and at least one preset object identifier, the play record time point is a specific play time point of the target multimedia (for example, a play time point of a television when a certain time is finished watching or a play time point with specific picture content when a certain time is watched) recorded when objects (for example, 1 or 3 objects and the like) corresponding to the at least one preset object identifier (for example, 1 or 3 objects and the like) watch the target multimedia together, and the preset object identifier is an identifier corresponding to an object in history when the certain time watches the target multimedia together.
In step S230, the target object identifier is compared with the preset object identifier to obtain a comparison result.
The target object identifier is compared with at least one preset object identifier in the play record to obtain a comparison result, and the comparison result may indicate a relationship between the media browsing object and a historical object historically participating in browsing the target multimedia, for example, the media browsing object is identical to the historical object or the media browsing object belongs to a subset of the historical object.
In one example, the comparison result is that the target object identifier is consistent with the preset object identifier, that is, at least one target object identifier is consistent with at least one preset object identifier, for example, the target object identifier includes 2 a and B, and the preset object identifier includes 2 a and B, if the media browsing object corresponding to the target object identifier is the same as the object corresponding to the preset object identifier. In one example, the target object identifier is completely different from the preset object identifier, so that the media browsing object has no corresponding play record historically. In one example, the at least one target object identifier is a subset of at least one preset object identifier, for example, the target object identifier includes 1 a, and the preset object identifier includes 2 a and B. In one example, at least two target object identifiers exist in different play records, for example, a play record corresponding to a target multimedia includes record 1 and record 2, 1 target object identifier a exists in record 1, and 1 target object identifier B exists in record 2.
Step S240, determining a playing time point matched with the behavior of the specific object according to the comparison result and the playing record time point, and playing the target multimedia according to the playing time point.
In one embodiment, the target object identification comprises at least one; step S240, determining the play time point matched with the specific object behavior according to the comparison result and the play record time point, including:
if the comparison result indicates that the at least one target object identifier is consistent with the at least one preset object identifier, determining the playing recording time point as a playing time point matched with the browsing participation behavior; the method further comprises the following steps: and continuing to update and record browsing record information of the media browsing object aiming at the target multimedia in the playing record.
If at least one target object identifier is consistent with the at least one preset object identifier, the current media browsing object corresponds to the object corresponding to the preset object identifier recorded in the play record one by one, that is, the current media browsing object is the same as the object recorded in the play record. At this time, the play recording time point in the play record can be used as the play time point matched with the browsing participation behavior detected this time, and the target multimedia can be effectively played back. And updating and recording browsing record information in the playing record, wherein the browsing record information at least comprises a specific playing time point of the target multimedia (such as a playing time point of a television when the watching is finished this time or a playing time point with specific picture content when the watching is finished this time).
In one embodiment, the target object identification comprises at least one; step S240, determining the play time point matched with the specific object behavior according to the comparison result and the play record time point, including:
if the comparison result indicates that the at least one target object identifier is a subset of the at least one preset object identifier, determining the playing recording time point as a playing time point matched with the browsing participation behavior; the method further comprises the following steps: and generating a target browsing record, and recording browsing record information of the media browsing object aiming at the target multimedia in the target browsing record.
At least one target object identifier is a subset of the at least one preset object identifier, that is, the media browsing object of this time is a part of the objects recorded in the play record, at this time, the play recording time point in the play record may also be used as the play time point matched with the browsing participation behavior detected this time, and the target multimedia may be effectively played back.
Meanwhile, a new target browsing record for the detected media browsing object is generated this time, browsing record information is recorded in the target browsing record, and the browsing record information at least may include a specific playing time point of the target multimedia (e.g., a playing time point of a television when the watching is finished this time or a playing time point with specific picture content when the watching is finished this time, etc.) and a target object identifier corresponding to the detected media browsing object this time.
In addition, in some embodiments, the preset object identifier corresponding to the target object identifier corresponding to the media browsing object detected this time may be deleted from the obtained play record.
In one embodiment, the target object identifier includes a plurality, and the play record includes a plurality; step S240, determining the play time point matched with the specific object behavior according to the comparison result and the play record time point, including:
if the comparison result indicates that at least two target object identifications exist in different playing records and at least two playing record time points exist in different playing records, determining the minimum playing record time point as the playing time point matched with the browsing participation behavior; the method further comprises the following steps: and generating a current browsing record, and recording browsing record information of the media browsing object aiming at the target multimedia in the current browsing record.
The play record corresponding to the target multimedia includes a play record 1 and a play record 2, where 1 target object identifier a exists in the play record 1 (i.e. a certain preset object identifier in the play record 1 matches a), and 1 target object identifier B exists in the play record 2 (i.e. a certain preset object identifier in the play record 2 matches B). Meanwhile, the play record 1 comprises a play record time 1, the play record 2 comprises a play record time 2, at this time, the minimum value of the play record time 1 and the play record time 2 is determined as a play time point matched with the browsing participation behavior, and the target multimedia can be reliably played back.
Meanwhile, a new current browsing record for the detected media browsing object is generated this time, browsing record information is recorded in the current browsing record, and the browsing record information at least includes a specific playing time point of the target multimedia (e.g., a playing time point of a television when the watching is finished this time or a playing time point with specific picture content when the watching is finished this time, etc.) and a target object identifier corresponding to the detected media browsing object this time.
In addition, in some embodiments, the preset object identifier corresponding to the target object identifier corresponding to the media browsing object detected this time may be deleted from the obtained play record.
In one embodiment, each preset object identifier is generated by combining a related object identifier and a target browsing expected tag, the playing and recording time point includes a plurality of recording time points, and each preset object identifier corresponds to one recording time point; step S240, determining the play time point matched with the specific object behavior according to the comparison result and the play record time point, including:
determining a preset object identifier of a target browsing expected tag matched with the browsing expected tag according to the comparison result to obtain a target preset object identifier; acquiring an object relation network corresponding to the object identification and a related object identification in the target preset object identification; grading based on the object relationship network to obtain a browsing grade of each related object identifier in the target preset object identifier; determining the preset object identification corresponding to the related object identification with the highest browsing score to obtain a target playing identification; and determining the recording time point corresponding to the target playing identifier as the playing time point matched with the specific physiological behavior.
In the case of combining the object identifier and the browsing expectation tag to obtain the target object identifier, the browsing expectation tag may refer to a tag such as a specific browsing score or a specific browsing level of the media browsing object at the current time.
The playing record time point in the playing record includes a plurality of recording time points, each preset object identifier corresponds to one recording time point, and the target browsing expected tag may also refer to a tag such as a specific browsing score or a specific browsing level of a related object (an object corresponding to the related object identifier in the preset object identifier) at the current time.
The target object identification and each preset object identification have corresponding comparison results, and the preset object identification (which may include at least one) having the target browsing expected tag matched with the browsing expected tag (belonging to the target object identification) can be determined according to the comparison results, so as to obtain the target preset object identification.
And then, acquiring an object relation network corresponding to the object identification in the target object identification and the related object identification in the target preset object identification. The object relationship network is a relationship network established by taking the object identifier and the related object identifier as nodes and taking the social relationship data between the object identifier and the object corresponding to the related object identifier as connecting edges. The object relationship network can be built in real time or can be acquired from a preset relationship network.
When the object relationship network is scored, the object relationship network can be converted into an adjacency matrix, the adjacency matrix is input into a pre-trained machine learning-based scoring model, and the scoring model outputs the browsing score of each related object identifier in the target preset object identifier.
Then, determining a preset object identifier corresponding to the related object identifier with the highest browsing score to obtain a target playing identifier; and determining the recording time point corresponding to the target playing identifier as a playing time point matched with the specific physiological behavior for playing, so that the target can effectively and reliably play back the media in any scene.
In order to better implement the multimedia playing method provided by the embodiment of the present application, the embodiment of the present application further provides a multimedia playing device based on the multimedia playing method. The meaning of the noun is the same as that in the above multimedia playing method, and the specific implementation details can refer to the description in the method embodiment. Fig. 3 shows a block diagram of a multimedia playback device according to an embodiment of the present application.
As shown in fig. 3, the multimedia playing apparatus 300 may include a detection module 310, an acquisition module 320, a comparison module 330, and a playing module 340.
The detection module 310 may be configured to, in response to detecting a specific object behavior of a media browsing object, collect feature information of the media browsing object, and generate a target object identifier based on the feature information; the obtaining module 320 may be configured to obtain a play record of a target multimedia, where the play record includes a play record time point and at least one preset object identifier; the comparing module 330 may be configured to compare the target object identifier with the preset object identifier to obtain a comparison result; the playing module 340 may be configured to determine a playing time point that matches the behavior of the specific object according to the comparison result and the playing record time point, and play the target multimedia according to the playing time point.
In some embodiments of the present application, the specific object behavior includes a browsing participation behavior within a predetermined time period at which a trigger time point of a specific play request is located; the detection module 310 includes a first detection unit, configured to: if the specific playing request corresponding to the target multimedia is received, detecting a facial image of a media browsing object in a target area within a preset time period of a trigger time point of the specific playing request; in response to detecting the facial image, extracting facial feature information based on the facial image as feature information of the media browsing object; generating the target object identification based on the characteristic information.
In some embodiments of the present application, the target object identification comprises at least one; the playing module 340 includes a first playing processing unit, configured to: if the comparison result indicates that the at least one target object identifier is consistent with the at least one preset object identifier, determining the playing recording time point as a playing time point matched with the browsing participation behavior; the apparatus further comprises a first updating unit configured to: and continuing to update and record browsing record information of the media browsing object aiming at the target multimedia in the playing record.
In some embodiments of the present application, the target object identification comprises at least one; the playing module 340 includes a second playing processing unit, configured to: if the comparison result indicates that the at least one target object identifier is a subset of the at least one preset object identifier, determining the playing recording time point as a playing time point matched with the browsing participation behavior; the apparatus further comprises a second updating unit configured to: and generating a target browsing record, and recording browsing record information of the media browsing object aiming at the target multimedia in the target browsing record.
In some embodiments of the present application, the target object identifier includes a plurality, and the play record includes a plurality; the playing module 340 includes a second playing processing unit, configured to: if the comparison result indicates that at least two target object identifications exist in different playing records and at least two playing record time points exist in different playing records, determining the minimum playing record time point as the playing time point matched with the browsing participation behavior; the apparatus further comprises a third updating unit configured to: and generating a current browsing record, and recording browsing record information of the media browsing object aiming at the target multimedia in the current browsing record.
In some embodiments of the present application, the particular subject behavior comprises a particular physiological behavior; the detection module 310 includes a second detection unit, configured to: in response to detecting the particular physiological behavior of a media browsing object, capturing a facial image of the media browsing object; extracting facial feature information based on the facial image as feature information of the media browsing object, and generating an object identifier based on the feature information; predicting a browsing expectation tag of the media browsing object based on behavior information corresponding to the specific physiological behavior; and combining the object identification and the browsing expected label to obtain the target object identification.
In some embodiments of the present application, each of the preset object identifiers is generated by combining a related object identifier and a target browsing expected tag, the playing recording time point includes a plurality of recording time points, and each of the preset object identifiers corresponds to one recording time point; the playing module 340 includes a fourth playing processing unit, configured to: determining a preset object identifier of a target browsing expected tag matched with the browsing expected tag according to the comparison result to obtain a target preset object identifier; acquiring an object relation network corresponding to the object identification and a related object identification in the target preset object identification; grading based on the object relationship network to obtain a browsing grade of each related object identifier in the target preset object identifier; determining the preset object identification corresponding to the related object identification with the highest browsing score to obtain a target playing identification; and determining the recording time point corresponding to the target playing identifier as the playing time point matched with the specific physiological behavior.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the application. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
In addition, an embodiment of the present application further provides an electronic device, where the electronic device may be a terminal or a server, as shown in fig. 4, which shows a schematic structural diagram of the electronic device according to the embodiment of the present application, and specifically:
the electronic device may include components such as a processor 401 of one or more processing cores, memory 402 of one or more computer-readable storage media, a power supply 403, and an input unit 404. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 4 does not constitute a limitation of the electronic device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:
the processor 401 is a control center of the electronic device, connects various parts of the entire computer device using various interfaces and lines, and performs various functions of the computer device and processes data by operating or executing software programs and/or modules stored in the memory 402 and calling data stored in the memory 402, thereby integrally monitoring the electronic device. Optionally, processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly handles operating systems, user pages, application programs, and the like, and the modem processor mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 401.
The memory 402 may be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by operating the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data created according to use of the computer device, and the like. Further, the memory 402 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 access to the memory 402.
The electronic device further comprises a power supply 403 for supplying power to the various components, and preferably, the power supply 403 is logically connected to the processor 401 through a power management system, so that functions of managing charging, discharging, and power consumption are realized through the power management system. The power supply 403 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.
The electronic device may further include an input unit 404, and the input unit 404 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.
Although not shown, the electronic device may further include a display unit and the like, which are not described in detail herein. Specifically, in this embodiment, the processor 401 in the electronic device loads the executable file corresponding to the process of one or more computer programs into the memory 402 according to the following instructions, and the processor 401 runs the computer program stored in the memory 402, so as to implement various functions, for example, the processor 401 may execute the following steps:
in response to detecting a specific object behavior of a media browsing object, collecting characteristic information of the media browsing object, and generating a target object identifier based on the characteristic information; acquiring a play record of a target multimedia, wherein the play record comprises a play record time point and at least one preset object identifier; comparing the target object identification with the preset object identification to obtain a comparison result; and determining a playing time point matched with the specific object behavior according to the comparison result and the playing recording time point, and playing the target multimedia according to the playing time point.
In some embodiments of the present application, the specific object behavior includes a browsing participation behavior within a predetermined time period at which a trigger time point of a specific play request is located; when the detecting of the specific object behavior of the media browsing object, acquiring feature information of the media browsing object, and generating the target object identifier based on the feature information, the processor 401 may perform: if the specific playing request corresponding to the target multimedia is received, detecting a facial image of a media browsing object in a target area within a preset time period of a trigger time point of the specific playing request; in response to detecting the facial image, extracting facial feature information based on the facial image as feature information of the media browsing object; generating the target object identification based on the characteristic information.
In some embodiments of the present application, the target object identification comprises at least one; when determining the play time point that matches the specific object behavior according to the comparison result and the play recording time point, the processor 401 may execute: if the comparison result indicates that the at least one target object identifier is consistent with the at least one preset object identifier, determining the playing recording time point as a playing time point matched with the browsing participation behavior; the processor 401 may further perform: and continuing to update and record browsing record information of the media browsing object aiming at the target multimedia in the playing record.
In some embodiments of the present application, the target object identification comprises at least one; when determining the play time point that matches the specific object behavior according to the comparison result and the play recording time point, the processor 401 may execute: if the comparison result indicates that the at least one target object identifier is a subset of the at least one preset object identifier, determining the playing recording time point as a playing time point matched with the browsing participation behavior; the processor 401 may further perform: and generating a target browsing record, and recording browsing record information of the media browsing object aiming at the target multimedia in the target browsing record.
In some embodiments of the present application, the target object identifier includes a plurality, and the play record includes a plurality; when determining the play time point that matches the specific object behavior according to the comparison result and the play recording time point, the processor 401 may execute: if the comparison result indicates that at least two target object identifications exist in different playing records and at least two playing record time points exist in different playing records, determining the minimum playing record time point as the playing time point matched with the browsing participation behavior; the processor 401 may further perform: and generating a current browsing record, and recording browsing record information of the media browsing object aiming at the target multimedia in the current browsing record.
In some embodiments of the present application, the particular subject behavior comprises a particular physiological behavior; when the detecting of the specific object behavior of the media browsing object, acquiring feature information of the media browsing object, and generating the target object identifier based on the feature information, the processor 401 may perform: in response to detecting the particular physiological behavior of a media browsing object, capturing a facial image of the media browsing object; extracting facial feature information based on the facial image as feature information of the media browsing object, and generating an object identifier based on the feature information; predicting a browsing expectation tag of the media browsing object based on behavior information corresponding to the specific physiological behavior; and combining the object identification and the browsing expected label to obtain the target object identification.
In some embodiments of the present application, each of the preset object identifiers is generated by combining a related object identifier and a target browsing expected tag, the playing recording time point includes a plurality of recording time points, and each of the preset object identifiers corresponds to one recording time point; when determining the play time point that matches the specific object behavior according to the comparison result and the play recording time point, the processor 401 may execute: determining a preset object identifier of a target browsing expected tag matched with the browsing expected tag according to the comparison result to obtain a target preset object identifier; acquiring an object relation network corresponding to the object identification and a related object identification in the target preset object identification; grading based on the object relationship network to obtain a browsing grade of each related object identifier in the target preset object identifier; determining the preset object identification corresponding to the related object identification with the highest browsing score to obtain a target playing identification; and determining the recording time point corresponding to the target playing identifier as the playing time point matched with the specific physiological behavior.
It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by a computer program, which may be stored in a computer-readable storage medium and loaded and executed by a processor, or by related hardware controlled by the computer program.
To this end, the present application further provides a storage medium, in which a computer program is stored, where the computer program can be loaded by a processor to execute the steps in any one of the methods provided in the present application.
Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
Since the computer program stored in the storage medium can execute the steps in any method provided in the embodiments of the present application, the beneficial effects that can be achieved by the methods provided in the embodiments of the present application can be achieved, for details, see the foregoing embodiments, and are not described herein again.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the embodiments disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains.
It will be understood that the present application is not limited to the embodiments that have been described above and shown in the drawings, but that various modifications and changes can be made without departing from the scope thereof.
Claims (10)
1. A multimedia playing method, comprising:
in response to detecting a specific object behavior of a media browsing object, collecting characteristic information of the media browsing object, and generating a target object identifier based on the characteristic information;
acquiring a play record of a target multimedia, wherein the play record comprises a play record time point and at least one preset object identifier;
comparing the target object identification with the preset object identification to obtain a comparison result;
and determining a playing time point matched with the specific object behavior according to the comparison result and the playing recording time point, and playing the target multimedia according to the playing time point.
2. The method according to claim 1, wherein the specific object behavior comprises a browsing participation behavior within a predetermined time period at which a trigger time point of a specific play request is located;
the collecting characteristic information of the media browsing object in response to detecting the specific object behavior of the media browsing object and generating the target object identifier based on the characteristic information comprises:
if the specific playing request corresponding to the target multimedia is received, detecting a facial image of a media browsing object in a target area within a preset time period of a trigger time point of the specific playing request;
in response to detecting the facial image, extracting facial feature information based on the facial image as feature information of the media browsing object;
generating the target object identification based on the characteristic information.
3. The method of claim 2, wherein the target object identifications include at least one; the determining the playing time point matched with the specific object behavior according to the comparison result and the playing record time point includes:
if the comparison result indicates that the at least one target object identifier is consistent with the at least one preset object identifier, determining the playing recording time point as a playing time point matched with the browsing participation behavior;
the method further comprises the following steps: and continuing to update and record browsing record information of the media browsing object aiming at the target multimedia in the playing record.
4. The method of claim 2, wherein the target object identifications include at least one; the determining the playing time point matched with the specific object behavior according to the comparison result and the playing record time point includes:
if the comparison result indicates that the at least one target object identifier is a subset of the at least one preset object identifier, determining the playing recording time point as a playing time point matched with the browsing participation behavior;
the method further comprises the following steps: and generating a target browsing record, and recording browsing record information of the media browsing object aiming at the target multimedia in the target browsing record.
5. The method according to claim 1, wherein the target object identifier comprises a plurality, and the play record comprises a plurality; the determining the playing time point matched with the specific object behavior according to the comparison result and the playing record time point includes:
if the comparison result indicates that at least two target object identifications exist in different playing records and at least two playing record time points exist in different playing records, determining the minimum playing record time point as the playing time point matched with the browsing participation behavior;
the method further comprises the following steps: and generating a current browsing record, and recording browsing record information of the media browsing object aiming at the target multimedia in the current browsing record.
6. The method of claim 1, wherein the particular subject behavior comprises a particular physiological behavior; the collecting characteristic information of the media browsing object in response to detecting the specific object behavior of the media browsing object and generating the target object identifier based on the characteristic information comprises:
in response to detecting the particular physiological behavior of a media browsing object, capturing a facial image of the media browsing object;
extracting facial feature information based on the facial image as feature information of the media browsing object, and generating an object identifier based on the feature information;
predicting a browsing expectation tag of the media browsing object based on behavior information corresponding to the specific physiological behavior;
and combining the object identification and the browsing expected label to obtain the target object identification.
7. The method according to claim 6, wherein each of the preset object identifiers is generated by combining a related object identifier and a target browsing expected tag, the playing recording time point includes a plurality of recording time points, and each of the preset object identifiers corresponds to one recording time point;
the determining the playing time point matched with the specific object behavior according to the comparison result and the playing record time point includes:
determining a preset object identifier of a target browsing expected tag matched with the browsing expected tag according to the comparison result to obtain a target preset object identifier;
acquiring an object relation network corresponding to the object identification and a related object identification in the target preset object identification;
grading based on the object relationship network to obtain a browsing grade of each related object identifier in the target preset object identifier;
determining the preset object identification corresponding to the related object identification with the highest browsing score to obtain a target playing identification;
and determining the recording time point corresponding to the target playing identifier as the playing time point matched with the specific physiological behavior.
8. A multimedia playback apparatus, comprising:
the detection module is used for responding to the detection of the specific object behavior of the media browsing object, collecting the characteristic information of the media browsing object and generating a target object identifier based on the characteristic information;
the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring a play record of a target multimedia, and the play record comprises a play record time point and at least one preset object identifier;
the comparison module is used for comparing the target object identification with the preset object identification to obtain a comparison result;
and the playing module is used for determining the playing time point matched with the specific object behavior according to the comparison result and the playing record time point and playing the target multimedia according to the playing time point.
9. A storage medium having stored thereon a computer program which, when executed by a processor of a computer, causes the computer to carry out the method of any one of claims 1 to 7.
10. An electronic device, comprising: a memory storing a computer program; a processor reading a computer program stored in the memory to perform the method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111617587.7A CN114302235A (en) | 2021-12-27 | 2021-12-27 | Multimedia playing method, device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111617587.7A CN114302235A (en) | 2021-12-27 | 2021-12-27 | Multimedia playing method, device, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114302235A true CN114302235A (en) | 2022-04-08 |
Family
ID=80970547
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111617587.7A Pending CN114302235A (en) | 2021-12-27 | 2021-12-27 | Multimedia playing method, device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114302235A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090113301A1 (en) * | 2007-10-26 | 2009-04-30 | Yahoo! Inc. | Multimedia Enhanced Browser Interface |
| US9805766B1 (en) * | 2016-07-19 | 2017-10-31 | Compal Electronics, Inc. | Video processing and playing method and video processing apparatus thereof |
| CN107995505A (en) * | 2017-12-14 | 2018-05-04 | 深圳Tcl新技术有限公司 | A kind of program continuous playing method, television equipment and computer-readable recording medium |
| CN110933468A (en) * | 2019-10-17 | 2020-03-27 | 宇龙计算机通信科技(深圳)有限公司 | Playing method, playing device, electronic equipment and medium |
| CN112004149A (en) * | 2020-07-24 | 2020-11-27 | 青岛海尔科技有限公司 | Play control method, device and system and storage medium |
| CN113157174A (en) * | 2020-01-23 | 2021-07-23 | 阿里巴巴集团控股有限公司 | Data processing method and device, electronic equipment and computer storage medium |
-
2021
- 2021-12-27 CN CN202111617587.7A patent/CN114302235A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090113301A1 (en) * | 2007-10-26 | 2009-04-30 | Yahoo! Inc. | Multimedia Enhanced Browser Interface |
| US9805766B1 (en) * | 2016-07-19 | 2017-10-31 | Compal Electronics, Inc. | Video processing and playing method and video processing apparatus thereof |
| CN107995505A (en) * | 2017-12-14 | 2018-05-04 | 深圳Tcl新技术有限公司 | A kind of program continuous playing method, television equipment and computer-readable recording medium |
| CN110933468A (en) * | 2019-10-17 | 2020-03-27 | 宇龙计算机通信科技(深圳)有限公司 | Playing method, playing device, electronic equipment and medium |
| CN113157174A (en) * | 2020-01-23 | 2021-07-23 | 阿里巴巴集团控股有限公司 | Data processing method and device, electronic equipment and computer storage medium |
| CN112004149A (en) * | 2020-07-24 | 2020-11-27 | 青岛海尔科技有限公司 | Play control method, device and system and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR20120088650A (en) | Estimating and displaying social interest in time-based media | |
| CN107547922B (en) | Information processing method, device, system and computer readable storage medium | |
| CN110475139B (en) | Video subtitle shielding method and device, storage medium and electronic equipment | |
| CN113573097A (en) | Video recommendation method and device, server and storage medium | |
| CN113965806B (en) | Video recommendation method and device and computer-readable storage medium | |
| CN114302235A (en) | Multimedia playing method, device, storage medium and electronic equipment | |
| CN110597566B (en) | Application processing method and device, storage medium and electronic equipment | |
| CN114071127A (en) | Live video delay testing method and device, storage medium and electronic equipment | |
| CN113741814A (en) | Data processing method, data processing device, computer readable storage medium and computer equipment | |
| CN113515670A (en) | Method, device and storage medium for identifying state of movie and television resource | |
| CN115689642A (en) | Media content recommendation method and device, electronic equipment and storage medium | |
| CN114157914A (en) | Multimedia playing method, device, storage medium and electronic equipment | |
| CN114513686A (en) | Method and device for determining video information and storage medium | |
| CN113873317A (en) | Content playing method and device, electronic equipment and computer readable storage medium | |
| TWI688269B (en) | Video extracting method and electronic device using the same | |
| CN111857467B (en) | File processing method and electronic equipment | |
| CN114302168B (en) | Learning video generation method, device, equipment and storage medium based on big data | |
| CN113840177B (en) | Live interaction method and device, storage medium and electronic equipment | |
| CN112434711B (en) | Data management method and device and electronic equipment | |
| CN114640888A (en) | Video playing method and device, computer equipment and computer readable storage medium | |
| CN117150110A (en) | Media asset content recall method and device, storage medium and electronic equipment | |
| CN113743282A (en) | Content search method, content search device, electronic equipment and computer-readable storage medium | |
| CN113612959A (en) | Video call method and device, storage medium and electronic equipment | |
| CN114007122A (en) | Video playing method and device, electronic equipment and storage medium | |
| CN116204666A (en) | Recommendation information display method, recommendation information providing method, recommendation information generation device and recommendation information generation equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |