CN107801087A - Video broadcasting method, device and terminal device - Google Patents
Video broadcasting method, device and terminal device Download PDFInfo
- Publication number
- CN107801087A CN107801087A CN201711021391.5A CN201711021391A CN107801087A CN 107801087 A CN107801087 A CN 107801087A CN 201711021391 A CN201711021391 A CN 201711021391A CN 107801087 A CN107801087 A CN 107801087A
- Authority
- CN
- China
- Prior art keywords
- image
- terminal device
- video
- displacement
- active user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4333—Processing operations in response to a pause request
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/441—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
- H04N21/4415—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Health & Medical Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Health & Medical Sciences (AREA)
- Social Psychology (AREA)
- Biomedical Technology (AREA)
- Human Computer Interaction (AREA)
- Theoretical Computer Science (AREA)
- Image Analysis (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention discloses a kind of video broadcasting method, device and terminal device, wherein, method includes：To active user's emitting structural light, obtain the first image of target area in the face of active user, and according to the first image of acquisition, count the relative change frequency in position between preset duration region of interest within and terminal device, if position exceeds default first threshold with respect to change frequency, suspend the broadcasting of current video in terminal device.In the present embodiment; by counting the relative change frequency in position in preset duration in face between target area and terminal device; the motion state of detection terminal equipment; when position exceeds default first threshold with respect to change frequency; illustrate that terminal device is in dither state; suspend the broadcasting of current video, so as to avoid user from watching video in the case where terminal device is shaken, improve the protection to eyes.
Description
Technical field
The present invention relates to terminal device technical field, more particularly to a kind of video broadcasting method, device and terminal device.
Background technology
As the development of terminal device technology, terminal device technology are more and more ripe.For example, can by terminal user
To watch video online, or video is locally downloading, video is watched whenever and wherever possible.
The process of video is watched in user, the situation of terminal device shake occurs unavoidably.For example, user sees in public transport
Video is seen, because rocking for bus causes terminal device to rock, or user walks about and causes terminal device to rock etc..This feelings
Video is watched under condition, can not only influence viewing effect, and human eye can be damaged.
The content of the invention
It is contemplated that at least solves one of technical problem in correlation technique to a certain extent.
Therefore, the present invention proposes a kind of video broadcasting method, to realize target area and the terminal device in face
Position with respect to change frequency, control video playback, when in position, relative change time exceed default first threshold, pause video
Broadcasting, so as to avoid user terminal device shake in the case of watch video, improve the protection to eyes.
The present invention proposes a kind of video play device.
The present invention proposes a kind of terminal device.
The present invention proposes a kind of computer-readable recording medium.
The embodiment of the present invention proposes a kind of video broadcasting method, including：
To active user's emitting structural light, the first image of target area in the face of the active user is obtained；
According to the described first image of acquisition, the position between the target area and terminal device in preset duration is counted
With respect to change frequency；
If the position exceeds default first threshold with respect to change frequency, suspend in the terminal device and work as forward sight
The broadcasting of frequency.
The video broadcasting method of the embodiment of the present invention, by the people for active user's emitting structural light, obtaining active user
First image of target area in face, and according to the first image of acquisition, count preset duration region of interest within and terminal device
Between position with respect to change frequency, if position exceeds default first threshold with respect to change frequency, suspend terminal device
The broadcasting of middle current video.In the present embodiment, by counting in preset duration in face between target area and terminal device
Position is with respect to change frequency, the motion state of detection terminal equipment, when position exceeds default first threshold with respect to change frequency,
Illustrate that terminal device is in dither state, suspend the broadcasting of current video, so as to avoid the situation that user shakes in terminal device
Lower viewing video, improves the protection to eyes.
The embodiment of the present invention proposes a kind of video play device, including：
Structured light projector, for active user's emitting structural light；
Image collection assembly, the first image of target area in the face for obtaining the active user；
Processor, for the described first image according to acquisition, count the target area in preset duration and set with terminal
Position between standby is with respect to change frequency, and if the position exceeds default first threshold with respect to change frequency, then temporarily
Stop the broadcasting of current video in the terminal device.
The video play device of the embodiment of the present invention, by the people for active user's emitting structural light, obtaining active user
First image of target area in face, and according to the first image of acquisition, count preset duration region of interest within and terminal device
Between position with respect to change frequency, if position exceeds default first threshold with respect to change frequency, suspend terminal device
The broadcasting of middle current video.In the present embodiment, by counting in preset duration in face between target area and terminal device
Position is with respect to change frequency, the motion state of detection terminal equipment, when position exceeds default first threshold with respect to change frequency,
Illustrate that terminal device is in dither state, suspend the broadcasting of current video, so as to avoid the situation that user shakes in terminal device
Lower viewing video, improves the protection to eyes.
The embodiment of the present invention proposes a kind of terminal device, including：
One or more processors；
Memory；With
One or more programs, wherein one or more of programs are stored in the memory, and it is configured
Into by one or more of computing devices, described program includes being used to perform the video broadcasting method described in previous embodiment
Instruction.
The present invention proposes a kind of computer-readable recording medium, including the terminal device with that can image is used in combination
Computer program, the computer program can be executed by processor to complete the video broadcasting method described in previous embodiment.
The additional aspect of the present invention and advantage will be set forth in part in the description, and will partly become from the following description
Obtain substantially, or recognized by the practice of the present invention.
Brief description of the drawings
Of the invention above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments
Substantially and it is readily appreciated that, wherein：
Fig. 1 is a kind of schematic flow sheet of video broadcasting method provided in an embodiment of the present invention；
Fig. 2 is the schematic flow sheet of another video broadcasting method provided in an embodiment of the present invention；
Fig. 3 is the schematic flow sheet of another video broadcasting method provided in an embodiment of the present invention；
Fig. 4 is a kind of structural representation of video play device provided in an embodiment of the present invention；
Fig. 5 is a kind of structural representation of terminal device provided in an embodiment of the present invention；
Fig. 6 is a kind of schematic diagram of image processing circuit provided in an embodiment of the present invention.
Embodiment
Embodiments of the invention are described below in detail, the example of the embodiment is shown in the drawings, wherein from beginning to end
Same or similar label represents same or similar element or the element with same or like function.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to for explaining the present invention, and is not considered as limiting the invention.
Below with reference to the accompanying drawings the video broadcasting method, device and terminal device of the embodiment of the present invention are described.
Fig. 1 is a kind of schematic flow sheet of video broadcasting method provided in an embodiment of the present invention.
Step 101, to active user's emitting structural light, the first image of target area in the face of active user is obtained.
Structure light (Structured Light) arrives body surface to project specific light, due to body surface be bumps not
Flat, the change of body surface and possible gap can be modulated to irradiating the light come, then be launched.Structure light images
Head gathers the structure light that is reflected of the body surface, and the catoptric arrangement light of collection is imaged in camera, and institute is into can take on image
Distortion information with light.Generally the depth of each characteristic point is proportional on the distortion degree and object of light.Further, may be used
To calculate each characteristic point depth information on object according to the distortion information carried in image.
The video broadcasting method that the embodiment of the present invention proposes, available on terminal device, the terminal device can be intelligence
Mobile phone, tablet personal computer, ipad etc..Structured light projector is installed on terminal device, can be to user's emitting structural light.Work as structure light
When being irradiated to human body, because the body surface of user is not smooth, so body when reflecting structure light, can be made
Into the distortion of structure light.The structure light that structure light video camera head collection human body is reflected, the catoptric arrangement light of collection is in camera
Imaging, into the distortion information that light can be carried on image.It is possible to further be calculated according to the distortion information carried in image
The each characteristic point depth information of human body.Then, the human face region that user is identified in image is collected from visible image capturing head,
Target area, such as human eye, nose are extracted from human face region further according to depth information, obtains the first figure of target area
Picture.
Step 102, according to the first image of acquisition, the position between preset duration region of interest within and terminal device is counted
With respect to change frequency.
In the present embodiment, by the relative change frequency in position between preset duration region of interest within and terminal device, come
Determine the state of terminal device.
, can be by counting in preset duration, in 30s as a kind of possible implementation, a certain picture in the first image
The change frequency of vegetarian refreshments and the distance between correspondence position in target area, as position with respect to change frequency.Specifically, calculate
The distance between correspondence position in a certain pixel and target area in first image, and adjacent with first image first
The distance between correspondence position in same pixel and target area in image.Then, the difference between two distances is calculated, if
Difference exceedes predetermined threshold value, and position adds 1 with respect to change frequency.So as to which position can be counted in preset duration with respect to change frequency.
Step 103, if position exceeds default first threshold with respect to change frequency, suspend in terminal device and work as forward sight
The broadcasting of frequency.
When position exceedes default first threshold with respect to change frequency, it is believed that terminal device is in dither state, this
Video-see effect can be influenceed in the case of kind, and eyes can be damaged, then pause plays video.
If it is understood that position with respect to change frequency without departing from default first threshold, illustrate at terminal device
In relatively steady state, then continue to play video.
In order to more accurately obtain the first image of target area in face, the embodiment of the present invention proposes another video
Player method.Fig. 2 is the schematic flow sheet of another video broadcasting method provided by the invention.
As shown in Fig. 2 on the basis of embodiment illustrated in fig. 1, step 101 may comprise steps of：
Step 201, the scene image of active user is obtained.
Visible image capturing head is installed, for gathering the scene image of active user in the present embodiment, on terminal device.Its
In, it can be gray level image or coloured image that scene image, which is,.
Step 202, the structure light image modulated through active user is shot.
Structured light projector and structure light video camera head are also equipped with the present embodiment, on terminal device.
Wherein, structured light projector can be used for active user's projective structure light；Structure light video camera head can be used for shooting to pass through
The structure light image of active user's modulation.
Specifically, structured light projector by the project structured light of certain pattern to active user face and body on after,
The structure light image after being modulated by active user can be formed in the face of active user and the surface of body.Structure light video camera head is clapped
Take the photograph it is modulated after structure light image.Wherein, the pattern of structure light can be laser stripe, it is Gray code, sine streak, non-homogeneous
Speckle etc..
Step 203, phase information corresponding to each pixel of demodulation structure light image is to obtain the depth map of active user
Picture.
Structure light video camera head can further phase information corresponding to each pixel in demodulation structure light image, by phase information
Depth information is converted into, and depth image is generated according to depth information.
Specifically, compared with non-modulated structure light, the phase information of the structure light after modulation is changed, and is being tied
The structure light showed in structure light image is to generate the structure light after distortion, wherein, the phase information of change can characterize
The depth information of object.Therefore, structure light video camera head demodulates phase information corresponding to each pixel in structure light image first,
Depth information is calculated further according to phase information, so as to obtain final depth image.
Step 204, scene image and depth image are handled to extract target area of the active user in scene image and
Obtain the first image.
, can be by obtaining the depth image of active user with by the face of the active user in scene image in the present embodiment
Middle target area extracts.Wherein, target area can be the eyes of face.
Specifically, the human face region in scene image can be identified first, obtained from depth image corresponding with human face region
Depth information, the depth bounds of target area, and the depth according to target area are determined according to the depth information of human face region
Scope determines the target area that is connected and is fallen into depth bounds with human face region to obtain the first image.
More specifically, the human face region that the deep learning Model Identification trained goes out in scene image can be used first,
The depth information of human face region is then can determine that according to the corresponding relation of scene image and depth image.
Because human face region includes target area, in other words, target area is in some depth together with human face region
In the range of, therefore, can be according to the depth information sets target area of human face region after the depth information of human face region is determined
The depth bounds in domain, further according to the depth bounds target area that falls into the depth bounds of extraction of target area to obtain first
Image.
In this way, the target area of active user can be extracted from scene image according to depth information and obtain the first figure
Picture.Because the image for obtaining the not factor such as illumination, colour temperature in by environment of depth information rings, therefore, the target area extracted
The first image it is more accurate.
The video broadcasting method of the embodiment of the present invention, by structure light can from the scene image of active user it is more accurate
The first image for extracting target area, so as to improve calculating accuracy rate of the position with respect to change frequency, and then improve
The control accuracy played to video pause.
For clearer explanation above-described embodiment, the embodiment of the present invention proposes another video broadcasting method.
As shown in figure 3, the video broadcasting method comprises the following steps：
Step 301, when detecting that terminal device is in video broadcasting condition, triggering terminal equipment is launched to active user
Structure light.
In the present embodiment, whether terminal device can be in video playback shape every prefixed time interval detection terminal equipment
State.When detecting that terminal device is in video broadcasting condition, the structured light projector in triggering terminal equipment is launched to user
Structure light.
Step 302, the first image of target area in the face of active user is obtained.
In the present embodiment, the detailed process for obtaining the first image can be found in the record of related content in above-described embodiment,
This is repeated no more.
Step 303, in preset duration, two adjacent the first images is compared, judge adjacent two first
It whether there is displacement between image.
In preset duration, in 30s, the image of adjacent two first of acquisition is compared and judges adjacent two
It whether there is displacement between first image.In the present embodiment, it can be carried out by same pixel in two adjacent the first images
Judge.If same pixel position differs in two adjacent the first images, it may be determined that two adjacent the first images it
Between displacement be present.
Step 304, there is the number of displacement between adjacent the first image in statistics two-by-two.
According to the above method, count in preset duration, the number of displacement between the first adjacent image two-by-two be present.
Step 305, determine position with respect to change frequency according to the number that displacement be present.
Because terminal device can not possibly remain static, in order to avoid frequently suspending video, made troubles to user,
Therefore can not be simply using the number that displacement between the first adjacent two-by-two image be present as the relative change frequency in position.
In the present embodiment, by displacement and the comparative result of default displacement threshold value, the relative change time in statistics position
Number.Specifically, the displacement existed between the image of adjacent two first of displacement is obtained, and by displacement and default displacement
Amount threshold value is compared, and statistics exceeds the number of the displacement of displacement threshold value, as position with respect to change frequency.
As a kind of possible implementation, the position between two adjacent the first images can be obtained by the following method
Shifting amount.During two adjacent the first images are compared, the same pixel of two adjacent the first images is recorded
Displacement between point, can be by the displacement between same pixel, as the displacement between two adjacent the first images.
It is thus possible to the displacement between obtaining the image of adjacent two first that displacement be present.
In the present embodiment, by the displacement of same pixel in two adjacent the first images, to determine adjacent two
Displacement between individual first image, computational methods are simply, conveniently.
Step 306, if position exceeds default first threshold with respect to change frequency, suspend in terminal device and work as forward sight
The broadcasting of frequency.
In the present embodiment, by the relative change frequency in position in preset duration compared with default first threshold.If
Position exceeds default first threshold with respect to change frequency, illustrates that video should not be watched under present case, then terminal device controls
Suspend currently playing video, to protect the eyes of people.
Step 307, continue to obtain the first image, and count position again with respect to change frequency.
In order to improve the flexibility of video playback, after pause plays video, can continue to obtain the first image, and according to upper
State method and count in preset duration position again with respect to change frequency.
Step 308, when the position counted with respect to change frequency without departing from first threshold, then recover broadcasting for current video
Put.
When the relative change frequency in the position counted is without departing from first threshold, illustrate that terminal device is in metastable
State, current video can control to recover to play.
The video broadcasting method of the embodiment of the present invention, by counting existing displacement time between adjacent the first image two-by-two
Number, to determine position with respect to change frequency, and then according to position with respect to change frequency and the comparative result of first threshold, it is determined that being
The broadcasting of no pause video.Also, after temporarily video is played, judge whether to continue to play video, so as to which neatly control regards
Frequency broadcast state, improve the protection to eyes.
The video broadcasting method of the embodiment of the present invention, by the people for active user's emitting structural light, obtaining active user
First image of target area in face, and according to the first image of acquisition, count preset duration region of interest within and terminal device
Between position with respect to change frequency, if position exceeds default first threshold with respect to change frequency, suspend terminal device
The broadcasting of middle current video.In the present embodiment, by counting in preset duration in face between target area and terminal device
Position is with respect to change frequency, the motion state of detection terminal equipment, when position exceeds default first threshold with respect to change frequency,
Illustrate that terminal device is in dither state, suspend the broadcasting of current video, so as to avoid the situation that user shakes in terminal device
Lower viewing video, improves the protection to eyes.
The present invention also proposes a kind of video play device.
As shown in figure 4, the video play device includes：Structured light projector 410, image collection assembly 420, processor
430。
Structured light projector 410 is used for active user's emitting structural light.
First image of target area in face of the image collection assembly 420 for obtaining active user.
Processor 430 is used for the first image according to acquisition, counts between preset duration region of interest within and terminal device
Position with respect to change frequency, and if position exceeds default first threshold with respect to change frequency, then suspend terminal device
The broadcasting of middle current video.
As a kind of possible implementation of the present embodiment, image collection assembly 420 may include visible image capturing head and knot
Structure light video camera head.Visible image capturing head can be used for the scene image for obtaining active user, and structure light video camera head can be used for shooting to pass through
The structure light image of active user's modulation, and phase information corresponding to each pixel of demodulation structure light image, further according to phase
Position information calculates depth information.So as to which image collection assembly 420 can extract according to depth information from the scene image of user
Go out target area in the face of user and obtain the first image.
It should be noted that the foregoing explanation to video broadcasting method embodiment, is also applied for regarding for the present embodiment
Frequency playing device, therefore will not be repeated here.
The video play device of the embodiment of the present invention, by the people for active user's emitting structural light, obtaining active user
First image of target area in face, and according to the first image of acquisition, count preset duration region of interest within and terminal device
Between position with respect to change frequency, if position exceeds default first threshold with respect to change frequency, suspend terminal device
The broadcasting of middle current video.In the present embodiment, by counting in preset duration in face between target area and terminal device
Position is with respect to change frequency, the motion state of detection terminal equipment, when position exceeds default first threshold with respect to change frequency,
Illustrate that terminal device is in dither state, suspend the broadcasting of current video, so as to avoid the situation that user shakes in terminal device
Lower viewing video, improves the protection to eyes.
The embodiment of the present invention also proposes a kind of terminal device.
As shown in figure 5, the terminal device includes：One or more processors 510, memory 520 and one or more journeys
Sequence 521.
Wherein, one or more programs 521 are stored in memory 520, and are configured to by one or more
Reason device 510 performs, and program 521 includes being used for the instruction for performing the video broadcasting method described in any of the above-described embodiment.
For example, program 521 includes being used to perform the instruction of the video broadcasting method of following steps：
To active user's emitting structural light, the first image of target area in the face of active user is obtained；
According to the first image of acquisition, count that the position between preset duration region of interest within and terminal device is relative to be changed
Number；
If position exceeds default first threshold with respect to change frequency, suspend broadcasting for current video in terminal device
Put.
For another example program 521 also includes the instruction for being used to perform the video broadcasting method of following steps：
Obtain the scene image of active user；
The structure light image that shooting is modulated through active user；With
Phase information corresponding to each pixel of demodulation structure light image is to obtain the depth image of active user；
Processing scene image and depth image obtain first to extract target area of the active user in scene image
Image.
The computer-readable recording medium of embodiment of the present invention includes what is be used in combination with the terminal device that can be imaged
Computer program.Computer program can be performed by processor 510 to complete the video playback side of above-mentioned any one embodiment
Method.
For example, computer program can be performed by processor 510 to complete the video broadcasting method of following steps：
To active user's emitting structural light, the first image of target area in the face of active user is obtained；
According to the first image of acquisition, count that the position between preset duration region of interest within and terminal device is relative to be changed
Number；
If position exceeds default first threshold with respect to change frequency, suspend broadcasting for current video in terminal device
Put.
For another example computer program can be also performed by processor 510 to complete the video broadcasting method described in following steps：
Obtain the scene image of active user；
The structure light image that shooting is modulated through active user；With
Phase information corresponding to each pixel of demodulation structure light image is to obtain the depth image of active user；
Processing scene image and depth image obtain first to extract target area of the active user in scene image
Image.
The embodiment of the present invention also provides a kind of terminal device.Terminal device includes image processing circuit, image procossing electricity
Road can utilize hardware and/or component software to realize, it may include define ISP (Image Signal Processing, image letter
Number processing) pipeline various processing units.Fig. 6 is the schematic diagram of image processing circuit in one embodiment.As shown in fig. 6, it is
It is easy to illustrate, the various aspects of the image processing techniques related to the embodiment of the present invention is only shown.
As shown in fig. 6, image processing circuit 900 includes imaging device 910, ISP processors 930 and control logic device 940.
Imaging device 910 may include the camera and structured light projector with one or more lens 912, imaging sensor 914
916.Structured light projector 916 is by structured light projection to measured object.Wherein, the structured light patterns can be laser stripe, Gray code,
Sine streak or, speckle pattern of random alignment etc..Imaging sensor 914 catches the structure light that projection is formed to measured object
Image, and structure light image is sent to ISP processors 930, acquisition is demodulated to structure light image by ISP processors 930
The depth information of measured object.Meanwhile imaging sensor 914 can also catch the color information of measured object.It is of course also possible to by two
Individual imaging sensor 914 catches the structure light image and color information of measured object respectively.
Wherein, by taking pattern light as an example, ISP processors 930 are demodulated to structure light image, are specifically included, from this
The speckle image of measured object is gathered in structure light image, by the speckle image of measured object with reference speckle image according to pre-defined algorithm
View data calculating is carried out, each speckle point for obtaining speckle image on measured object dissipates relative to reference to the reference in speckle image
The displacement of spot.The depth value of each speckle point of speckle image is calculated using trigonometry conversion, and according to the depth
Angle value obtains the depth information of measured object.
It is, of course, also possible to obtain the depth image by the method for binocular vision or based on jet lag TOF method
Information etc., is not limited herein, as long as can obtain or belong to this by the method for the depth information that measured object is calculated
The scope that embodiment includes.
After the color information that ISP processors 930 receive the measured object that imaging sensor 914 captures, it can be tested
View data corresponding to the color information of thing is handled.ISP processors 930 are analyzed view data can be used for obtaining
It is determined that and/or imaging device 910 one or more control parameters image statistics.Imaging sensor 914 may include color
Color filter array (such as Bayer filters), imaging sensor 914 can obtain to be caught with each imaging pixel of imaging sensor 914
Luminous intensity and wavelength information, and provide one group of raw image data being handled by ISP processors 930.
ISP processors 930 handle raw image data pixel by pixel in various formats.For example, each image pixel can
Bit depth with 8,10,12 or 14 bits, ISP processors 930 can be carried out at one or more images to raw image data
Reason operation, image statistics of the collection on view data.Wherein, image processing operations can be by identical or different bit depth
Precision is carried out.
ISP processors 930 can also receive pixel data from video memory 920.Video memory 920 can be memory device
The independent private memory in a part, storage device or electronic equipment put, and may include DMA (Direct Memory
Access, direct direct memory access (DMA)) feature.
When receiving raw image data, ISP processors 930 can carry out one or more image processing operations.
After ISP processors 930 get color information and the depth information of measured object, it can be merged, obtained
3-D view.Wherein, can be extracted by least one of appearance profile extracting method or contour feature extracting method corresponding
The feature of measured object.Such as pass through active shape model method ASM, active appearance models method AAM, PCA PCA, discrete
The methods of cosine transform method DCT, the feature of measured object is extracted, is not limited herein.It will be extracted respectively from depth information again
The feature of measured object and feature progress registration and the Fusion Features processing that measured object is extracted from color information.Herein refer to
Fusion treatment can be the feature that will be extracted in depth information and color information directly combination or by different images
Middle identical feature combines after carrying out weight setting, it is possibility to have other amalgamation modes, finally according to the feature after fusion, generation
3-D view.
The view data of 3-D view can be transmitted to video memory 920, to carry out other place before shown
Reason.ISP processors 930 from the reception processing data of video memory 920, and to the processing data carry out original domain in and
Image real time transfer in RGB and YCbCr color spaces.The view data of 3-D view may be output to display 960, for
Family is watched and/or further handled by graphics engine or GPU (Graphics Processing Unit, graphics processor).This
Outside, the output of ISP processors 930 also be can be transmitted to video memory 920, and display 960 can be read from video memory 920
View data.In one embodiment, video memory 920 can be configured as realizing one or more frame buffers.In addition,
The output of ISP processors 930 can be transmitted to encoder/decoder 950, so as to encoding/decoding image data.The picture number of coding
According to can be saved, and decompressed before being shown in the equipment of display 960.Encoder/decoder 950 can by CPU or GPU or
Coprocessor is realized.
The image statistics that ISP processors 930 determine, which can be transmitted, gives the unit of control logic device 940.Control logic device 940
It may include the processor and/or microcontroller for performing one or more routines (such as firmware), one or more routines can be according to connecing
The image statistics of receipts, determine the control parameter of imaging device 910.
It it is below the step of realizing video broadcasting method with image processing techniques in Fig. 6：
To active user's emitting structural light, the first image of target area in the face of the active user is obtained；
According to the described first image of acquisition, the position between the target area and terminal device in preset duration is counted
With respect to change frequency；
If the position exceeds default first threshold with respect to change frequency, suspend in the terminal device and work as forward sight
The broadcasting of frequency.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or the spy for combining the embodiment or example description
Point is contained at least one embodiment or example of the present invention.In this manual, to the schematic representation of above-mentioned term not
Identical embodiment or example must be directed to.Moreover, specific features, structure, material or the feature of description can be with office
Combined in an appropriate manner in one or more embodiments or example.In addition, in the case of not conflicting, the skill of this area
Art personnel can be tied the different embodiments or example and the feature of different embodiments or example described in this specification
Close and combine.
In addition, term " first " is only used for describing purpose, and it is not intended that instruction or hint relative importance or hidden
Containing the quantity for indicating indicated technical characteristic.Thus, define the feature of " first " can express or implicitly include to
Few this feature.In the description of the invention, " multiple " are meant that at least two, such as two, three etc., unless otherwise
It is clearly specific to limit.
Any process or method described otherwise above description in flow chart or herein is construed as, and represents to include
Module, fragment or the portion of the code of the executable instruction of one or more the step of being used to realize custom logic function or process
Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discuss suitable
Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system including the system of processor or other can be held from instruction
The system of row system, device or equipment instruction fetch and execute instruction) use, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass
Defeated program is for instruction execution system, device or equipment or the dress used with reference to these instruction execution systems, device or equipment
Put.The more specifically example (non-exhaustive list) of computer-readable medium includes following：Electricity with one or more wiring
Connecting portion (electronic installation), portable computer diskette box (magnetic device), random access memory (RAM), read-only storage
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device, and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium, which can even is that, to print the paper of described program thereon or other are suitable
Medium, because can then enter edlin, interpretation or if necessary with it for example by carrying out optical scanner to paper or other media
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each several part of the present invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned
In embodiment, software that multiple steps or method can be performed in memory and by suitable instruction execution system with storage
Or firmware is realized.Such as, if realized with hardware with another embodiment, following skill well known in the art can be used
Any one of art or their combination are realized：With the logic gates for realizing logic function to data-signal from
Logic circuit is dissipated, the application specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene can compile
Journey gate array (FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method carries
Suddenly it is that by program the hardware of correlation can be instructed to complete, described program can be stored in a kind of computer-readable storage medium
In matter, the program upon execution, including one or a combination set of the step of embodiment of the method.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, can also
That unit is individually physically present, can also two or more units be integrated in a module.Above-mentioned integrated mould
Block can both be realized in the form of hardware, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized in the form of software function module and as independent production marketing or in use, can also be stored in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only storage, disk or CD etc..Although have been shown and retouch above
Embodiments of the invention are stated, it is to be understood that above-described embodiment is exemplary, it is impossible to be interpreted as the limit to the present invention
System, one of ordinary skill in the art can be changed to above-described embodiment, change, replace and become within the scope of the invention
Type.
Claims (10)
- A kind of 1. video broadcasting method, it is characterised in that including：To active user's emitting structural light, the first image of target area in the face of the active user is obtained；According to the described first image of acquisition, the position counted in preset duration between the target area and terminal device is relative Change frequency；If the position exceeds default first threshold with respect to change frequency, suspend current video in the terminal device Play.
- 2. video broadcasting method according to claim 1, it is characterised in that work as forward sight in the pause terminal device After the broadcasting of frequency, in addition to：Continue to obtain described first image, and count the position again with respect to change frequency；Then recover broadcasting for the current video without departing from the first threshold with respect to change frequency when the position counted Put.
- 3. video broadcasting method according to claim 1, it is characterised in that the described first image according to acquisition, The relative change frequency in position between the target area and terminal device in preset duration is counted, including：In the preset duration, two adjacent described first images are compared, judged described in described adjacent two It whether there is displacement between first image；The number of displacement between adjacent described first image two-by-two be present in statistics；Determine the position with respect to change frequency according to the number that displacement be present.
- 4. video broadcasting method according to claim 3, it is characterised in that described true according to the number that displacement be present The position is determined with respect to change frequency, including：Obtain the displacement between the two adjacent described first images that displacement be present；By the displacement compared with default displacement threshold value；Number of the statistics beyond the displacement of the displacement threshold value；The number is defined as the position with respect to change frequency.
- 5. video broadcasting method according to claim 4, it is characterised in that the acquisition has the described adjacent of displacement Displacement between two described first images, including：During two adjacent described first images are compared, described adjacent two described first are recorded Displacement between the same pixel of image；Using the displacement between the same pixel, the displacement between two adjacent described first images is obtained Amount.
- 6. according to the video broadcasting method described in claim any one of 1-5, it is characterised in that described to active user's emitter junction Structure light, including：Detect whether the terminal device is currently in video broadcasting condition；If being in the video broadcasting condition, the terminal device is triggered to active user's emitting structural light.
- 7. according to the video broadcasting method described in claim any one of 1-5, it is characterised in that described to active user's emitter junction Structure light, the first image of target area in the face of the active user is obtained, including：Obtain the scene image of active user；The structure light image that shooting is modulated through the active user；WithPhase information corresponding to each pixel of the structure light image is demodulated to obtain the depth image of the active user；The scene image and the depth image are handled to extract the mesh of the active user in the scene image Mark region and obtain described first image.
- A kind of 8. video play device, it is characterised in that including：Structured light projector, for active user's emitting structural light；Image collection assembly, the first image of target area in the face for obtaining the active user；Processor, for the described first image according to acquisition, count in preset duration the target area and terminal device it Between position with respect to change frequency, and if the position exceeds default first threshold with respect to change frequency, then suspend institute State the broadcasting of current video in terminal device.
- A kind of 9. terminal device, it is characterised in that including：One or more processors；Memory；WithOne or more programs, wherein one or more of programs are stored in the memory, and be configured to by One or more of computing devices, the video that described program includes being used for described in perform claim 1 to 7 any one of requirement are broadcast Put the instruction of method.
- A kind of 10. computer-readable recording medium, it is characterised in that the meter being used in combination including the terminal device with that can image Calculation machine program, the computer program can be executed by processor to complete the video playback described in claim 1 to 7 any one Method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711021391.5A CN107801087B (en) | 2017-10-27 | 2017-10-27 | Video playing method and device and terminal equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711021391.5A CN107801087B (en) | 2017-10-27 | 2017-10-27 | Video playing method and device and terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107801087A true CN107801087A (en) | 2018-03-13 |
| CN107801087B CN107801087B (en) | 2021-05-11 |
Family
ID=61548122
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711021391.5A Active CN107801087B (en) | 2017-10-27 | 2017-10-27 | Video playing method and device and terminal equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107801087B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109858291A (en) * | 2019-01-25 | 2019-06-07 | 努比亚技术有限公司 | 3D display method of controlling security, terminal and computer readable storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101673173A (en) * | 2009-08-17 | 2010-03-17 | 宇龙计算机通信科技(深圳)有限公司 | Adjusting device, method and mobile terminal of display interface |
| CN102053866A (en) * | 2009-11-03 | 2011-05-11 | 英华达(上海)电子有限公司 | Method for processing portable electronic equipment and portable electronic equipment |
| CN105847914A (en) * | 2016-03-29 | 2016-08-10 | 乐视控股（北京）有限公司 | Vehicle-mounted display-based video playing method and device |
| CN105867610A (en) * | 2015-12-29 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Play control method based on face identification and terminal |
| CN106126147A (en) * | 2016-06-28 | 2016-11-16 | 广东欧珀移动通信有限公司 | Screen control method, screen control device and electronic installation |
| CN106371552A (en) * | 2015-07-22 | 2017-02-01 | 腾讯科技（深圳）有限公司 | Control method and device for carrying out media representation at mobile terminals |
-
2017
- 2017-10-27 CN CN201711021391.5A patent/CN107801087B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101673173A (en) * | 2009-08-17 | 2010-03-17 | 宇龙计算机通信科技(深圳)有限公司 | Adjusting device, method and mobile terminal of display interface |
| CN102053866A (en) * | 2009-11-03 | 2011-05-11 | 英华达(上海)电子有限公司 | Method for processing portable electronic equipment and portable electronic equipment |
| CN106371552A (en) * | 2015-07-22 | 2017-02-01 | 腾讯科技（深圳）有限公司 | Control method and device for carrying out media representation at mobile terminals |
| CN105867610A (en) * | 2015-12-29 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Play control method based on face identification and terminal |
| CN105847914A (en) * | 2016-03-29 | 2016-08-10 | 乐视控股（北京）有限公司 | Vehicle-mounted display-based video playing method and device |
| CN106126147A (en) * | 2016-06-28 | 2016-11-16 | 广东欧珀移动通信有限公司 | Screen control method, screen control device and electronic installation |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109858291A (en) * | 2019-01-25 | 2019-06-07 | 努比亚技术有限公司 | 3D display method of controlling security, terminal and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107801087B (en) | 2021-05-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107480613A (en) | Face identification method, device, mobile terminal and computer-readable recording medium | |
| CN107465906B (en) | Panorama shooting method, device and the terminal device of scene | |
| CN107481304A (en) | The method and its device of virtual image are built in scene of game | |
| CN107682607A (en) | Image acquiring method, device, mobile terminal and storage medium | |
| CN107481317A (en) | The facial method of adjustment and its device of face 3D models | |
| CN107657652A (en) | Image processing method and device | |
| CN107452034B (en) | Image processing method and device | |
| CN107483845B (en) | Photographic method and its device | |
| CN107423716A (en) | Face method for monitoring state and device | |
| CN107509043B (en) | Image processing method, image processing apparatus, electronic apparatus, and computer-readable storage medium | |
| CN107509045A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| CN107590828B (en) | Blurring processing method and device for shot image | |
| CN107493427A (en) | Focusing method, device and the mobile terminal of mobile terminal | |
| CN107610171A (en) | Image processing method and its device | |
| CN107707835A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| CN107610080A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| CN107707838A (en) | Image processing method and device | |
| CN107621867A (en) | Put out screen control method, device and terminal device | |
| CN107517346A (en) | Photographic method, device and mobile device based on structure light | |
| CN107656611A (en) | Somatic sensation television game implementation method and device, terminal device | |
| CN107644440A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| CN107610078A (en) | Image processing method and device | |
| CN107682656B (en) | Background image processing method, electronic device, and computer-readable storage medium | |
| CN107610076A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| CN107454336A (en) | Image processing method and device, electronic installation and computer-readable recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 523860 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong Applicant after: OPPO Guangdong Mobile Communications Co., Ltd. Address before: 523860 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong Applicant before: Guangdong OPPO Mobile Communications Co., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |