CN108260012B

CN108260012B - Electronic device, video playing control method and related product

Info

Publication number: CN108260012B
Application number: CN201810209374.2A
Authority: CN
Inventors: 张海平
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2018-03-14
Filing date: 2018-03-14
Publication date: 2020-12-04
Anticipated expiration: 2038-03-14
Also published as: CN108260012A

Abstract

The embodiment of the application provides an electronic device, a video playing control method and a related product, wherein the electronic device comprises a brain wave sensor and a processor, the brain wave sensor is coupled with the processor, and the method comprises the following steps: acquiring a first brain wave signal of a target user through a brain wave sensor; analyzing the first brain wave signal to obtain target attribute information of the target video; generating a video positioning instruction according to the target attribute information; and positioning to the playing position of the target video. Therefore, the video can be positioned according to the brain wave signals of the user, and convenience and accuracy of video positioning are improved to a certain extent.

Description

Electronic device, video playing control method and related product

Technical Field

The present application relates to the field of signal processing technologies, and in particular, to an electronic device, a video playback control method, and a related product.

Background

With the improvement of living standard of people, electronic devices such as mobile phones become necessities, and when the electronic devices such as the mobile phones are used, a plurality of users can use the video playing function. At present, when people play videos, the video playing is interrupted sometimes due to various reasons (for example, a mobile phone is out of power, leaves in the middle of the process, etc.), but a user cannot accurately remember the position of the video interruption, so that it is difficult for the user to quickly locate the part of the video which is not played last time when the user watches the video again, and thus the convenience and the intelligence of video location are affected.

Disclosure of Invention

The embodiment of the application provides an electronic device, a video playing control method and a related product, which can position a video according to a brain wave signal of a user, and improve the convenience and accuracy of video positioning to a certain extent.

A first aspect of embodiments of the present application provides an electronic device including a brain wave sensor and a processor, the brain wave sensor being coupled with the processor, wherein,

the brain wave sensor is used for acquiring a first brain wave signal of a target user;

the processor is used for analyzing the first brain wave signal to obtain target attribute information of a target video; generating a video positioning instruction according to the target attribute information; and positioning to the playing position of the target video.

A second aspect of the embodiments of the present application provides a video playback control method, which is applied to an electronic device including a brain wave sensor, and includes:

acquiring a first brain wave signal of a target user through the brain wave sensor;

analyzing the first brain wave signal to obtain target attribute information of a target video;

generating a video positioning instruction according to the target attribute information;

and positioning to the playing position of the target video.

A third aspect of the embodiments of the present application provides a video playback control apparatus applied to an electronic apparatus including a brain wave sensor, the video playback control apparatus including an acquisition unit, a parsing unit, an instruction generation unit, and a positioning unit, wherein,

the acquisition unit is used for acquiring a first brain wave signal of a target user through the brain wave sensor;

the analysis unit is used for analyzing the first brain wave signal to obtain target attribute information of a target video;

the instruction generating unit is used for generating a video positioning instruction according to the target attribute information;

and the positioning unit is used for positioning the playing position of the target video.

A fourth aspect of embodiments of the present application provides an electronic device, comprising a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for performing the steps of the second aspect of embodiments of the present application.

A fifth aspect of embodiments of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, wherein the computer program causes a computer to perform some or all of the steps as described in the second aspect of embodiments of the present application.

A sixth aspect of embodiments of the present application provides a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps as described in the second aspect of embodiments of the present application. The computer program product may be a software installation package.

The embodiment of the application has the following beneficial effects:

according to the embodiment of the application, the first brain wave signal of the target user is firstly acquired through the brain wave sensor, then the first brain wave signal is analyzed to obtain the target attribute information of the target video, then the first video positioning instruction is generated according to the target attribute information, and finally the playing position of the target video is positioned, so that the user can analyze the brain wave of the user, then the positioning instruction is generated, and finally the playing position of the video is positioned.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1A is a schematic diagram of an electronic device according to an embodiment of the present application;

FIG. 1B is a schematic diagram of a possible structure of the sensor of FIG. 1A according to an embodiment of the present invention;

FIG. 1C is a schematic structural diagram of the electroencephalogram sensor in the embodiment of the present application in FIG. 1A;

fig. 1D is a schematic structural diagram of an electrode array according to an embodiment of the present disclosure;

fig. 1E is a schematic diagram of a signal processing circuit of a brain wave sensor according to an embodiment of the present application;

fig. 2 is a schematic flowchart of a video playing control method according to an embodiment of the present application;

fig. 3 is a schematic flowchart of another video playing control method according to an embodiment of the present application;

fig. 4 is a schematic flowchart of another video playing control method according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;

fig. 6 is a schematic structural diagram of a video playback control apparatus according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.

Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the specification. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

The electronic device according to the embodiments of the present application may include various handheld devices, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to a wireless modem, and various forms of User Equipment (UE), Mobile Stations (MS), terminal equipment (terminal device), and so on. For convenience of description, the above-mentioned apparatuses are collectively referred to as electronic devices.

In order to better understand the technical solution of the present application, an electronic device applying a screen locking control method provided in an embodiment of the present application is described below. Referring to fig. 1A, fig. 1A is a schematic view of an electronic device according to an embodiment of the disclosure. As shown in fig. 1A, the electronic device 100 includes: a casing 110, a circuit board 120 arranged in the casing 110, a brain wave sensor 140 and a display screen 130 arranged on the casing 110, wherein a processor 1201 and a memory 1202 are arranged on the circuit board 120, the processor 1201 is connected with the brain wave sensor 140, the memory 1202 and the display screen 130, wherein,

the brain wave sensor 140 is configured to acquire a first brain wave signal of a target user;

the memory 1202 may be configured to store attribute parameters, target videos, and the like;

the processor 1201 is configured to analyze the first brain wave signal to obtain target attribute information of a target video; generating a video positioning instruction according to the target attribute information; and positioning to the playing position of the target video.

The brain wave sensor 140 may also be referred to as a brain wave chip, a brain wave receiver, or the like, and the brain wave sensor 140 is integrated in an electronic device, has a dedicated signal processing circuit, is connected to a processor of the electronic device, and may be divided into a current type brain wave sensor and an electromagnetic type brain wave sensor according to the type of a signal collected, wherein the current type brain wave sensor collects a bioelectric current generated by a cerebral cortex, and the electromagnetic type brain wave sensor collects an electromagnetic wave radiated from a brain of a human during an activity. It is understood that the specific form of the brain wave sensor 140 may be various and is not limited thereto.

Referring to fig. 1B, fig. 1B is a schematic diagram of a possible structure of the electroencephalogram sensor 140 in the embodiment of the present application in fig. 1A. As shown in fig. 1B, the brain wave sensor includes a signal collector 210, a signal transmitter 220, a signal receiver 230 and a signal processing circuit 240, wherein the signal collector 210 is connected to the signal transmitter 220, the signal receiver 230 is connected to the signal processing circuit 240, wherein the signal collector 210 is used for collecting brain wave signals of a user, the signal processing circuit 240 can perform analog filtering, a/D conversion and digital filtering on the brain wave signals collected by the signal collector 210, that is, after the brain wave signals are collected by the signal collector 210, the signals are transmitted to the signal receiver 230 through the signal transmitter 220, the signal receiver 230 transmits the received signals to the signal processing circuit 240, the signal processing circuit 240 first performs analog filtering on the brain wave signals, filters noise signals in the brain wave signals, and then converts the filtered signals into digital signals through a/D, the digital signal is digitally filtered by a digital filter, and a brain wave signal having a high signal-to-noise ratio is output to a processor of an electronic device.

Optionally, the signal collector 210 may be a wearable signal collector, which may be, for example, a signal collection helmet, the signal collector 210 may also be a patch signal collector, which may be attached to the head of the user to collect brain wave signals of the user, and the signal collector 210 may also be a non-contact signal collector, which does not need to contact with the body of the user, and may improve user experience to a certain extent.

Referring to fig. 1C to 1E, as shown in fig. 1C to 1E, the brain wave sensor 140 may include an electrode array embedded in the scalp to capture electrical signals of neurons, and a signal processing module having a needle-shaped electrode portion, wherein the signal processing circuit portion may include an instrumentation amplifier, a low-pass filter circuit, a high-pass filter circuit, an a/D conversion circuit, an interface circuit, and the like.

The processor 1201 includes an application processor and a baseband processor, and is a control center of the electronic device, and is connected to various parts of the electronic device through various interfaces and lines, and executes various functions and processes data of the electronic device by operating or executing software programs and/or modules stored in the memory and calling data stored in the memory, thereby integrally monitoring the electronic device. The application processor mainly processes an operating system, a user interface, application programs and the like, and the baseband processor mainly processes wireless communication. It will be appreciated that the baseband processor described above may not be integrated into the processor. The memory 1202 may be used to store software programs and modules, and the processor executes various functional applications and data processing of the electronic device by operating the software programs and modules stored in the memory. The memory 1202 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function, and the like; the storage data area may store data created according to use of the electronic device, and the like. Further, the memory 1202 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

It can be seen that, according to the electronic device described in the embodiment of the present application, the first brain wave signal of the target user is obtained through the brain wave sensor, then the first brain wave signal is analyzed to obtain the target attribute information of the target video, then the first video positioning instruction is generated according to the target attribute information, and finally the playing position of the target video is positioned, so that the video positioning time is reduced to a certain extent by analyzing the brain wave of the user, and then the positioning instruction is generated, and finally the playing position of the video is positioned.

Optionally, in the aspect of analyzing the first brain wave signal to obtain target attribute information of the target video, the processor 1201 is specifically configured to: performing signal separation on the first brain wave signals to obtain a plurality of independent brain wave signals; matching the plurality of independent brain wave signals pairwise to obtain a plurality of matching values; selecting a target matching value with the matching value larger than a preset threshold value from the plurality of matching values, and acquiring a target independent brain wave signal corresponding to the target matching value; performing feature extraction on the target independent brain wave signal to obtain a target electroencephalogram of the target independent brain wave signal; and obtaining target attribute information corresponding to the target electroencephalogram according to a mapping relation between a preset electroencephalogram and the attribute information.

Therefore, a plurality of independent brain wave signals can be obtained by separating the brain wave signals, then the independent brain wave signals are matched pairwise, and a target independent brain wave signal larger than a preset threshold value is selected from the independent brain wave signals, so that target attribute information is obtained, the brain wave signals are separated, multi-dimensional analysis can be performed on the brain wave signals, and finally the target attribute information is extracted, so that the accuracy of attribute information extraction can be improved.

Optionally, the target attribute information includes a plurality of attribute parameters; in the aspect of generating the video positioning instruction according to the target attribute information, the processor 1201 is further specifically configured to: determining an execution priority among the plurality of attribute parameters; selecting a target attribute parameter with an execution priority higher than a preset priority; and generating a video positioning instruction according to the target attribute parameters.

It can be seen that, in this example, if the same execution priority is adopted for the plurality of attribute parameters, the time for video positioning is likely to increase, and by setting the execution priority of the attribute parameters and generating the video positioning instruction according to the priority, the time for video positioning after the instruction is executed can be reduced, and the efficiency of video positioning is improved.

Optionally, in terms of the positioning to the play position of the target video, the processor 1201 is further specifically configured to: extracting a plurality of scene images associated with target attribute parameters in the target attribute information from the target video according to the video positioning instruction; performing image quality evaluation on each scene image in the plurality of scene images to obtain a plurality of image quality evaluation values; and selecting a target image quality evaluation value larger than a preset image quality threshold value from the plurality of image quality evaluation values, and acquiring the playing position of the scene image corresponding to the target image quality evaluation value in the target video.

Therefore, in this example, the positioning accuracy can be improved to a certain extent by extracting the scene associated with the target attribute parameter in the target attribute information and screening out the image with higher quality.

Optionally, when there are multiple playing positions, after the target video is located at the playing position, the processor 1201 is further specifically configured to: displaying a video image corresponding to each playing position in the plurality of playing positions, wherein each video image corresponds to a serial number identifier; acquiring a second brain wave signal of the target user through the brain wave sensor; analyzing the second brain wave signal to obtain a target characteristic value; determining a target serial number identifier corresponding to the target characteristic value according to a mapping relation between a preset characteristic value and the serial number identifier; and playing the target video from the playing position corresponding to the target sequence number identification.

It can be seen that, in this example, when a plurality of play positions exist, the video image corresponding to each play position is displayed, the play position that the user needs to watch is obtained through electroencephalogram analysis, and the video is played at the play position, so that the play position is displayed and finally determined according to the electroencephalogram of the user, and the accuracy and the intelligence of the video play control can be further improved.

Referring to fig. 2, fig. 2 is a schematic flowchart illustrating a video playing control method according to an embodiment of the present application. As shown in fig. 2, the method comprises the following steps:

201. the electronic device acquires a first brain wave signal of a target user through the brain wave sensor;

optionally, the electronic device may collect brain wave signals of the target user through the brain wave sensor.

Specifically, a coordinate system with the position of the brain wave sensor as an origin is established, the horizontal axis of the coordinate system is a distance, the vertical axis of the coordinate system is a direction, the distance is a distance between the geometric center of the area where the head of the user is located and the brain wave sensor in the electronic device, and the direction is a direction of the area where the head of the user is located relative to the brain wave sensor. The method comprises the steps that a brain wave sensor determines a space area where the head of a user is located, the space area where the head of the user is located is a brain wave generation area including the head of the user, coordinates where the area where the head of the user is located are determined, then according to the coordinates, the brain wave sensor is adjusted from an initial detection area to the space area where the head of the user is located, detection power of the brain wave sensor is adjusted to detection power adaptive to the space area where the head of the user is located, wherein the brain wave sensor has an initial detection area and initial detection power, namely when the brain wave sensor is turned on, the area detected by the brain wave sensor is the initial detection area, and the detection power of brain wave signals in the area is detected to be the initial detection power.

Furthermore, the detection power of the brain wave sensor is related to the distance between the spatial region where the head region of the user is located and the brain wave sensor, and the detection power of the brain wave sensor is increased when the distance is longer, and the detection power of the brain wave sensor is decreased when the distance is shorter, so that the detection power of the brain wave sensor can be dynamically adjusted.

The detection area and the detection power of the brain wave sensor are adjusted through the method, the accuracy of detecting the brain wave signals can be improved to a certain degree, and meanwhile, the energy consumption of the brain wave sensor can be reduced to a certain degree.

202. The electronic device analyzes the first brain wave signal to obtain target attribute information of a target video;

optionally, the attribute information includes a plurality of attribute parameters, and the attribute parameters may include at least one of the following: a point in time, a video frame, a target character, an action of the target character, a speech of the target character, a bullet screen about the target character, a skill of the target character, a weapon of the target character, etc.

Alternatively, one possible method for the electronic device to analyze the first brain wave signal to obtain the target attribute information of the target video includes the following steps a 1-A3:

a1, preprocessing the first brain wave signal by the electronic device to obtain a reference brain wave signal;

optionally, the method for preprocessing the first brain wave signal may be as follows: the first brain wave signal is subjected to primary analog filtering, then the filtered brain wave signal is amplified through a low noise amplifier, and finally the amplified brain wave signal is subjected to frequency mixing to obtain a reference brain wave signal.

Optionally, the filter device for primarily filtering the first brain wave signal may be, for example, a surface acoustic wave filter, and the surface acoustic wave filter has characteristics of low loss and high out-of-band rejection, and can well filter noise signals in the first brain wave signal, and the noise signals are, for example, electric waves generated by muscle contraction, and the analysis of the electric waves by the electric waves has strong noise interference, so that the accuracy of the subsequent brain wave analysis can be improved to a certain extent by the above method.

The low-noise amplifier is used for amplifying the brain wave signals, has the characteristics of low self-generated interference and the like, and also has the function of amplifying the brain wave signals, so that the brain wave signals are amplified, the interference of self devices to the brain wave signals is small, and the accuracy of follow-up brain wave analysis can be improved to a certain degree.

A2, the electronic device extracts a target electroencephalogram of the reference electroencephalogram signal;

optionally, the reference brain wave signal is displayed, the waveform of the reference brain wave is recorded as a target electroencephalogram of the reference brain wave signal, and the target electroencephalogram is cached.

A3, the electronic device obtains a first target keyword corresponding to the target electroencephalogram according to the mapping relation between the electroencephalogram and the target keyword.

Optionally, an attribute information library is pre-established, where the attribute information library includes a mapping relationship between an electroencephalogram set of a user electroencephalogram signal and the attribute information. Here, the action of the target person is taken as an example, and when the target person is in the action, a plurality of electroencephalograms of the electroencephalograms when the user imagines that the target person is in the action are detected, the electroencephalograms of the respective electroencephalograms are determined, the plurality of electroencephalograms are set as one electroencephalogram set, and the electroencephalogram set is associated with the action of the target person, thereby creating the attribute information base.

Optionally, the target electroencephalogram is input into the attribute information base, and the target electroencephalogram is subjected to matching query to obtain target attribute information of the target video corresponding to the target electroencephalogram.

Alternatively, another possible method for the electronic device to analyze the first brain wave signal to obtain the target attribute information of the target video includes the following steps B1-B5:

b1, the electronic device performs signal separation on the first brain wave signal to obtain a plurality of independent brain wave signals;

optionally, a signal separation technology is adopted to separate the first brain wave signal, after the first brain wave signal is separated, a plurality of sub brain wave signals are obtained, and the plurality of sub brain wave signals can be restored to the first brain wave signal after being superimposed.

The first brain wave is composed of sub brain waves carrying different information, and the first brain wave signal can be separated according to the different information carried in the brain waves, for example, the first brain wave signal carries information related to a target video, information related to weather, information related to other things to be processed by a user, and the like, so that the brain wave signal can be separated into an independent brain wave signal related to the target video, an independent brain wave signal related to weather, and an independent brain wave signal related to other things to be processed by the user. Meanwhile, the independent brain wave signal related to the target video can be separated into a plurality of brain wave signals related to the target attribute information, such as the target person, the action of the target person, the lines of the target person, the barrage related to the target person, the skill of the target person, the weapon related to the target person, and the like.

B2, matching the independent brain wave signals pairwise by the electronic device to obtain a plurality of matching values;

alternatively, the plurality of independent brain wave signals separated in step B1 may be subjected to feature extraction, and the feature extraction may be to extract the frequencies and amplitudes of the brain wave signals to obtain the frequencies and amplitudes of the plurality of independent brain wave signals. The frequencies and amplitudes of the independent brain wave signals are matched pairwise to obtain a plurality of matching values.

Optionally, a method for pairwise matching the frequencies and amplitudes of a plurality of independent brain wave signals is as follows: firstly, generating a spectrogram of each independent brain wave signal; then, the spectrogram of one of the independent brain wave signals is matched with the spectrogram of another independent brain wave in the remaining independent brain wave signals, wherein the matching method is to compare the spectrograms of the independent brain wave signals to obtain a similarity between the two spectrograms, a horizontal axis of the spectrograms is a frequency (frequency axis), a vertical axis of the spectrograms is an amplitude (amplitude axis), and a determination method of the similarity may be: selecting a plurality of specific frequency points on the spectrogram, wherein the frequency points can be obtained by dividing a frequency axis into a plurality of sections, taking the end point of each section as a specific frequency point, then correspondingly comparing the amplitudes of each specific frequency point on the two spectrograms to obtain a ratio, finally solving the mean value of all the ratios as a matching value, and obtaining a plurality of matching values for pairwise matching of a plurality of brain wave signals through the method.

Optionally, another method for pairwise matching multiple independent brain waves to obtain multiple matching values is as follows:

extracting the electroencephalogram of each independent electroencephalogram signal, and matching each electroencephalogram in the following way: the electroencephalograms of two independent electroencephalogram signals are subjected to waveform comparison, namely, a plurality of specific time points are selected, the time points can be obtained by dividing a time axis into a plurality of sections, the end point of each section is used as a specific time point, the amplitude of each specific time point is correspondingly compared to obtain a ratio, finally, the mean value of all the ratios is obtained to be used as a matching value, and a plurality of matching values for pairwise matching of the plurality of electroencephalogram signals are obtained through the method.

B3, selecting a target matching value with the matching value larger than a preset threshold value from the multiple matching values by the electronic device, and acquiring a target independent brain wave signal corresponding to the target matching value;

optionally, the preset threshold may be set by the user, or the system defaults, for example, the preset threshold may be a value between 0.8 and 1.0, and the interval value is set, so that the target attribute information of the target video may be determined in a larger range.

B4, performing feature extraction on the target independent brain wave signal to obtain a target electroencephalogram of the target independent brain wave signal;

and B5, obtaining target attribute information corresponding to the target electroencephalogram according to the mapping relation between the preset electroencephalogram and the attribute information.

The steps B4 and B5 are implemented by referring to the corresponding methods in the steps a1 to A3, and are not described herein again.

203. The electronic device generates a first video positioning instruction according to the target attribute information;

optionally, the attribute information includes a plurality of attribute parameters, and the attribute parameters may include: a point in time, a video frame, a target character, an action of the target character, a speech of the target character, a bullet screen about the target character, a skill of the target character, a weapon of the target character, etc.

Optionally, one possible way to generate video positioning instructions according to the target attribute information includes the following steps C1-C3:

c1, the electronic device determines the execution priority in the plurality of attribute parameters;

optionally, one possible setting manner of the execution priority of the attribute parameter is as follows: the setting can be carried out according to the degree of association with the target person, and the specific case that the execution priority is from high to low is as follows: time point, video frame, target character, speech of the target character, bullet screen about the target character, action of the target character, skill of the target character, weapon of the target character. Of course, other execution priorities may also be set, and this is merely an example and is not limited specifically.

C2, the electronic device selects a target attribute parameter with execution priority higher than the preset priority;

optionally, the preset priority may be set by the user, or the system defaults. The execution priority may be in order from high to low, and a specific priority area may be determined, and the priority area may include a high priority area, a medium priority area, and a low priority area, wherein the high priority area may include a time point, a video frame, a target person, a line of the target person, and a bullet screen about the target person; the medium priority area may include actions of the target person, skills of the target person; the low priority zone may include a weapon of the target character. Of course, other execution priorities may also be set, and this is merely an example and is not limited specifically.

Optionally, the priorities of the high priority area, the medium priority area, and the low priority area are respectively a first priority, a second priority, and a third priority, and the preset priority may be the second priority corresponding to the medium priority area, so that the value of the target attribute parameter is the attribute parameter in the high priority area.

And C3, the electronic device generates a video positioning instruction according to the target attribute parameters.

Optionally, the electronic device selects the target attribute parameter in the high priority region to generate the video positioning instruction.

204. The electronic device is positioned to the playing position of the target video.

Alternatively, one possible method for the electronic device to locate the playing position of the target video includes the following steps D1-D3:

d1, the electronic device extracts a plurality of scene images associated with the target attribute parameters in the target attribute information from the target video according to the video positioning instruction;

optionally, extracting a plurality of scenes associated with the target attribute parameter in the target attribute information from the target video may be understood as: the target person may include a front image of the target person, a side image of the target person, a back image of the target person, etc., and as illustrated herein, all scenes associated with the target person are extracted from the target video, including a scene of the front image of the target person, a scene of the side image of the target person, a scene of the back image of the target person, etc.

D2, evaluating the image quality of each scene image in the plurality of scene images to obtain a plurality of image quality evaluation values;

and D3, selecting a target image quality evaluation value larger than a preset image quality threshold value from the plurality of image quality evaluation values, and acquiring the playing position of the scene image corresponding to the target image quality evaluation value in the target video.

The preset image quality threshold value can be set by the user or defaulted by the system. Since there may be face blurring or poor image quality in the multiple scene images, image quality evaluation may be performed on each scene image in the multiple scene images, for example, the sharpness of the face of the target person may be evaluated, or the overall quality of the image may be evaluated to obtain multiple image quality evaluation values, and in the image quality evaluation process, at least one image quality evaluation index may be used to perform image quality evaluation on the image, and the image quality evaluation index may be at least one of: mean square deviation, average gray scale, information entropy, edge retention and the like, and further, a target image quality evaluation value larger than a preset image quality threshold value is selected from the multiple image quality evaluation values, and the playing position of a scene image corresponding to the target image quality evaluation value in a target video is obtained, so that rapid and clear positioning is realized, and user experience is improved.

In another possible scenario, when there are multiple play positions, the following methods E1-E5 are further included after the target video is located at the play position:

e1, the electronic device displays a video image corresponding to each playing position in the plurality of playing positions, and each video image corresponds to a serial number identifier;

optionally, the serial number identifier corresponding to the video image may be set by the system, and one possible setting manner is: the labeling can be performed according to the sequence of the video positions in the playing time, the labeling can be performed according to the sequence from small to large, the labeling can be performed according to the sequence from large to small, the labeling can be performed according to any other numbers capable of distinguishing the video playing positions without limitation, and other different serial number identification setting modes can be provided without limitation.

E2, the electronic device acquires a second brain wave signal of the target user through the brain wave sensor;

e3, analyzing the second brain wave signal by the electronic device to obtain a target characteristic value;

e4, the electronic device determines a target serial number identifier corresponding to the target characteristic value according to a preset mapping relation between the characteristic value and the serial number identifier;

optionally, the preset mapping relationship between the feature value and the serial number identifier may be established by establishing a serial number identifier library, which is established as the method in step a 3.

E5, the electronic device plays the target video from the playing position corresponding to the target serial number identification.

The implementation of the steps E2, E3, and E5 may refer to the related methods from step 201 to step 204, which are not described herein again.

It can be seen that, according to the video playing control method described in the embodiment of the present application, first a first brain wave signal of a target user is obtained through the brain wave sensor, then the first brain wave signal is analyzed to obtain target attribute information of a target video, then a first video positioning instruction is generated according to the target attribute information, and finally a playing position of the target video is positioned, so that a positioning instruction is generated by analyzing the brain wave of the user, and finally the playing position of the video is positioned.

Referring to fig. 3, fig. 3 is a schematic flowchart illustrating another video playback control method according to an embodiment of the present application. As shown in fig. 3, applied to the electronic device shown in fig. 1A, the electronic device includes a brain wave sensor, and the video playback control method includes the steps of:

301. acquiring a first brain wave signal of a target user through the brain wave sensor;

302. performing signal separation on the first brain wave signals to obtain a plurality of independent brain wave signals;

303. matching the plurality of independent brain wave signals pairwise to obtain a plurality of matching values;

304. selecting a target matching value with the matching value larger than a preset threshold value from the plurality of matching values, and acquiring a target independent brain wave signal corresponding to the target matching value;

305. performing feature extraction on the target independent brain wave signal to obtain a target electroencephalogram of the target independent brain wave signal;

306. obtaining target attribute information corresponding to the target electroencephalogram according to a mapping relation between a preset electroencephalogram and the attribute information;

307. the target attribute information comprises a plurality of attribute parameters, and the execution priority in the attribute parameters is determined;

308. selecting a target attribute parameter with an execution priority higher than a preset priority;

309. generating a video positioning instruction according to the target attribute parameters;

310. extracting a plurality of scene images associated with target attribute parameters in the target attribute information from the target video according to the video positioning instruction;

311. performing image quality evaluation on each scene image in the plurality of scene images to obtain a plurality of image quality evaluation values;

312. and selecting a target image quality evaluation value larger than a preset image quality threshold value from the plurality of image quality evaluation values, and acquiring the playing position of the scene image corresponding to the target image quality evaluation value in the target video.

It can be seen that, with the video control playing method described in the embodiment of the present application, first the first brain wave signal of the target user is obtained through the brain wave sensor, and then the first brain wave signal is parsed, in the analysis, the brain wave signal is separated into a plurality of independent brain wave signals, and the brain wave signal related to the target attribute information is obtained from the plurality of independent brain wave signals, then extracting the target attribute information, then generating a first video positioning instruction according to the target attribute information, and finally positioning to the playing position of the target video, the positioning instruction can be generated by analyzing the brain wave of the user, and finally the video playing position is positioned, compared with the existing method that the user needs to manually position the video playing position, the time of video positioning is reduced to a certain extent, and the convenience and the intelligence of the video positioning are improved to a certain extent.

Referring to fig. 4, fig. 4 is a schematic flowchart illustrating another video playback control method according to an embodiment of the present disclosure. As shown in fig. 4, applied to the electronic device shown in fig. 1A, the electronic device includes a brain wave sensor, and the video playback control method includes the steps of:

401. acquiring a first brain wave signal of a target user through the brain wave sensor;

402. performing signal separation on the first brain wave signals to obtain a plurality of independent brain wave signals;

403. matching the plurality of independent brain wave signals pairwise to obtain a plurality of matching values;

404. selecting a target matching value with the matching value larger than a preset threshold value from the plurality of matching values, and acquiring a target independent brain wave signal corresponding to the target matching value;

405. performing feature extraction on the target independent brain wave signal to obtain a target electroencephalogram of the target independent brain wave signal;

406. obtaining target attribute information corresponding to the target electroencephalogram according to a mapping relation between a preset electroencephalogram and the attribute information;

407. the target attribute information comprises a plurality of attribute parameters, and the execution priority in the attribute parameters is determined;

408. selecting a target attribute parameter with an execution priority higher than a preset priority;

409. generating a video positioning instruction according to the target attribute parameters;

410. extracting a plurality of scene images associated with target attribute parameters in the target attribute information from the target video according to the video positioning instruction;

411. performing image quality evaluation on each scene image in the plurality of scene images to obtain a plurality of image quality evaluation values;

412. selecting a target image quality evaluation value larger than a preset image quality threshold value from the plurality of image quality evaluation values, and acquiring a playing position of a scene image corresponding to the target image quality evaluation value in the target video;

413. when a plurality of playing positions exist, displaying a video image corresponding to each playing position in the plurality of playing positions, wherein each video image corresponds to one serial number identifier;

414. acquiring a second brain wave signal of the target user through the brain wave sensor;

415. analyzing the second brain wave signal to obtain a target characteristic value;

416. determining a target serial number identifier corresponding to the target characteristic value according to a mapping relation between a preset characteristic value and the serial number identifier;

417. and playing the target video from the playing position corresponding to the target sequence number identification.

It can be seen that, with the video playing control method described in the embodiment of the present application, first a first brain wave signal of a target user is obtained through the brain wave sensor, then the first brain wave signal is analyzed to obtain target attribute information of the target video, then a first video positioning instruction is generated according to the target attribute information, and finally the target video is positioned to a playing position, and if there are multiple playing positions after the target video is positioned to the playing position, the target video is displayed and a final playing position is determined according to the brain waves of the user, so that the positioning instruction can be regenerated by analyzing the brain waves of the user, and finally the video playing position is positioned, compared with the existing video playing position where the user needs to manually position, the video positioning time is reduced to a certain extent, and meanwhile, the final playing position is obtained through the brain waves of the user, the convenience and the intelligence of video positioning are improved to a certain extent.

In accordance with the foregoing embodiments, please refer to fig. 5, fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application, and as shown in the drawing, the electronic device includes a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for performing the following steps:

and positioning to the playing position of the target video.

In one possible example, in terms of the analyzing the first brain wave signal to obtain the target attribute information of the target video, the instructions in the program are specifically configured to perform the following operations: performing signal separation on the first brain wave signals to obtain a plurality of independent brain wave signals; matching the plurality of independent brain wave signals pairwise to obtain a plurality of matching values; selecting a target matching value with the matching value larger than a preset threshold value from the plurality of matching values, and acquiring a target independent brain wave signal corresponding to the target matching value; and performing feature extraction on the target independent brain wave signal to obtain the target attribute information of the target video.

In one possible example, the target attribute information contains a plurality of attribute parameters; in the aspect of generating the video positioning instruction according to the target attribute information, the instruction in the program is further specifically configured to perform the following operations: determining an execution priority among the plurality of attribute parameters; selecting a target attribute parameter with an execution priority higher than a preset priority; and generating a video positioning instruction according to the target attribute parameters.

In one possible example, in terms of the locating the play position of the target video, the instructions in the program are further specifically configured to: extracting a plurality of scene images associated with target attribute parameters in the target attribute information from the target video according to the video positioning instruction; performing image quality evaluation on each scene image in the plurality of scene images to obtain a plurality of image quality evaluation values; and selecting a target image quality evaluation value larger than a preset image quality threshold value from the plurality of image quality evaluation values, and acquiring the playing position of the scene image corresponding to the target image quality evaluation value in the target video.

In one possible example, when there are a plurality of the play positions, after the positioning to the play position of the target video, the instructions in the program are further specifically configured to: displaying a video image corresponding to each playing position in the plurality of playing positions, wherein each video image corresponds to a serial number identifier; acquiring a second brain wave signal of the target user through the brain wave sensor; analyzing the second brain wave signal to obtain a target characteristic value; determining a target serial number identifier corresponding to the target characteristic value according to a mapping relation between a preset characteristic value and the serial number identifier; and playing the target video from the playing position corresponding to the target sequence number identification.

The above description has introduced the solution of the embodiment of the present application mainly from the perspective of the method-side implementation process. It is understood that the electronic device comprises corresponding hardware structures and/or software modules for performing the respective functions in order to realize the above functions. Those of skill in the art will readily appreciate that the present application is capable of hardware or a combination of hardware and computer software implementing the various illustrative elements and algorithm steps described in connection with the embodiments provided herein. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiment of the present application, the electronic device may be divided into the functional units according to the method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.

In accordance with the above, please refer to fig. 6, fig. 6 is a schematic structural diagram of a video playback control apparatus according to an embodiment of the present disclosure. Applied to an electronic device comprising a brain wave sensor, the video playback control device comprises an acquisition unit 601, a parsing unit 602, an instruction generation unit 603, and a positioning unit 604, wherein,

the acquisition unit 601 is used for acquiring a first brain wave signal of a target user through the brain wave sensor;

the analyzing unit 602 is configured to analyze the first brain wave signal to obtain target attribute information of a target video;

the instruction generating unit 603 is configured to generate a video positioning instruction according to the target attribute information;

the positioning unit 604 is configured to position a playing position of the target video.

It can be seen that, according to the video playing control device described in the embodiment of the present application, the first brain wave signal of the target user is obtained through the brain wave sensor, then the first brain wave signal is analyzed to obtain the target attribute information of the target video, then the first video positioning instruction is generated according to the target attribute information, and finally the playing position of the target video is positioned, so that the positioning instruction is generated by analyzing the brain wave of the user, and finally the playing position of the video is positioned.

Optionally, in terms of analyzing the first brain wave signal to obtain target attribute information of the target video, the analyzing unit 602 is specifically configured to: performing signal separation on the first brain wave signals to obtain a plurality of independent brain wave signals; matching the plurality of independent brain wave signals pairwise to obtain a plurality of matching values; selecting a target matching value with the matching value larger than a preset threshold value from the plurality of matching values, and acquiring a target independent brain wave signal corresponding to the target matching value; and performing feature extraction on the target independent brain wave signal to obtain the target attribute information of the target video.

Optionally, the target attribute information includes a plurality of attribute parameters; in the aspect of generating the video positioning instruction according to the target attribute information, the instruction generating unit 603 is specifically configured to: determining an execution priority among the plurality of attribute parameters; selecting a target attribute parameter with an execution priority higher than a preset priority; and generating a video positioning instruction according to the target attribute parameters.

Optionally, in terms of positioning to the playing position of the target video, the positioning unit 604 is specifically configured to: extracting a plurality of scene images associated with target attribute parameters in the target attribute information from the target video according to the video positioning instruction; performing image quality evaluation on each scene image in the plurality of scene images to obtain a plurality of image quality evaluation values; and selecting a target image quality evaluation value larger than a preset image quality threshold value from the plurality of image quality evaluation values, and acquiring the playing position of the scene image corresponding to the target image quality evaluation value in the target video.

Optionally, when there are a plurality of the playing positions, after the target video is located at the playing position, the video playing control device is further specifically configured to: displaying a video image corresponding to each playing position in the plurality of playing positions, wherein each video image corresponds to a serial number identifier; acquiring a second brain wave signal of the target user through the brain wave sensor; analyzing the second brain wave signal to obtain a target characteristic value; determining a target serial number identifier corresponding to the target characteristic value according to a mapping relation between a preset characteristic value and the serial number identifier; and playing the target video from the playing position corresponding to the target sequence number identification.

Embodiments of the present application also provide a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute part or all of the steps of any one of the video playback control methods described in the above method embodiments.

Embodiments of the present application also provide a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program causes a computer to execute some or all of the steps of any one of the video playback control methods described in the above method embodiments.

It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implementing, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may be implemented in the form of a software program module.

The integrated units, if implemented in the form of software program modules and sold or used as stand-alone products, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method described in the embodiments of the present application. And the aforementioned memory comprises: various media capable of storing program codes, such as a usb disk, a read-only memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and the like.

Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash memory disks, read-only memory, random access memory, magnetic or optical disks, and the like.

The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. An electronic device comprising a brain wave sensor and a processor, the brain wave sensor being coupled with the processor, wherein,

the brain wave sensor is used for acquiring a first brain wave signal of a target user after the playing of the target video is interrupted;

the processor is used for analyzing the first brain wave signal to obtain target attribute information of the target video; generating a video positioning instruction according to the target attribute information; and positioning to the playing position of the target video.

2. The electronic device according to claim 1, wherein in the analyzing the first brain wave signal to obtain the target attribute information of the target video, the processor is specifically configured to:

performing signal separation on the first brain wave signals to obtain a plurality of independent brain wave signals;

matching the plurality of independent brain wave signals pairwise to obtain a plurality of matching values;

selecting a target matching value with the matching value larger than a preset threshold value from the plurality of matching values, and acquiring a target independent brain wave signal corresponding to the target matching value;

performing feature extraction on the target independent brain wave signal to obtain a target electroencephalogram of the target independent brain wave signal;

and obtaining target attribute information corresponding to the target electroencephalogram according to a mapping relation between a preset electroencephalogram and the attribute information.

3. The electronic device according to claim 1 or 2, wherein the target attribute information contains a plurality of attribute parameters; in the aspect of generating the video positioning instruction according to the target attribute information, the processor is further specifically configured to:

determining an execution priority among the plurality of attribute parameters;

selecting a target attribute parameter with an execution priority higher than a preset priority;

and generating a video positioning instruction according to the target attribute parameters.

4. The electronic device of claim 3, wherein in terms of the locating to the play position of the target video, the processor is further specifically configured to:

extracting a plurality of scene images associated with target attribute parameters in the target attribute information from the target video according to the video positioning instruction;

performing image quality evaluation on each scene image in the plurality of scene images to obtain a plurality of image quality evaluation values;

and selecting a target image quality evaluation value larger than a preset image quality threshold value from the plurality of image quality evaluation values, and acquiring the playing position of the scene image corresponding to the target image quality evaluation value in the target video.

5. The electronic device according to any one of claims 1 to 4, wherein when there are a plurality of the playing positions, after the positioning to the playing position of the target video, the processor is further specifically configured to:

displaying a video image corresponding to each playing position in the plurality of playing positions, wherein each video image corresponds to a serial number identifier;

acquiring a second brain wave signal of the target user through the brain wave sensor;

analyzing the second brain wave signal to obtain a target characteristic value;

determining a target serial number identifier corresponding to the target characteristic value according to a mapping relation between a preset characteristic value and the serial number identifier;

and playing the target video from the playing position corresponding to the target sequence number identification.

6. A video playing control method is applied to an electronic device, wherein the electronic device comprises a brain wave sensor, and the method comprises the following steps:

after the playing of the target video is interrupted, acquiring a first brain wave signal of a target user through the brain wave sensor;

analyzing the first brain wave signal to obtain target attribute information of the target video;

and positioning to the playing position of the target video.

7. The method according to claim 6, wherein the analyzing the first brain wave signal to obtain target attribute information of a target video comprises:

8. The method according to claim 6 or 7, wherein the target attribute information contains a plurality of attribute parameters; the generating of the video positioning instruction according to the target attribute information includes:

determining an execution priority among the plurality of attribute parameters;

9. The method of claim 8, wherein the locating the playing position of the target video comprises:

10. The method according to any one of claims 6 to 9, wherein when there are a plurality of the playing positions, the positioning is performed after the playing position of the target video, and further comprising:

analyzing the second brain wave signal to obtain a target characteristic value;

11. A video playing control device is characterized in that the video playing control device is applied to an electronic device, the electronic device comprises a brain wave sensor, the video playing control device comprises an acquisition unit, an analysis unit, an instruction generation unit and a positioning unit, wherein,

the acquisition unit is used for acquiring a first brain wave signal of a target user through the brain wave sensor after the playing of the target video is interrupted;

the analysis unit is used for analyzing the first brain wave signal to obtain target attribute information of the target video;

12. An electronic device comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of claims 6 to 10.

13. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the method according to any one of claims 6 to 10.