CN107770592A - Motion state of mobile terminal detection method in mobile video playing process - Google Patents

Motion state of mobile terminal detection method in mobile video playing process Download PDF

Info

Publication number
CN107770592A
CN107770592A CN201711263485.3A CN201711263485A CN107770592A CN 107770592 A CN107770592 A CN 107770592A CN 201711263485 A CN201711263485 A CN 201711263485A CN 107770592 A CN107770592 A CN 107770592A
Authority
CN
China
Prior art keywords
user
speed
terminal
module
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201711263485.3A
Other languages
Chinese (zh)
Other versions
CN107770592B (en
Inventor
陶晓明
刘烽
刘一烽
肖霭玲
段平
段一平
葛宁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
Original Assignee
Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University filed Critical Tsinghua University
Priority to CN201711263485.3A priority Critical patent/CN107770592B/en
Publication of CN107770592A publication Critical patent/CN107770592A/en
Application granted granted Critical
Publication of CN107770592B publication Critical patent/CN107770592B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234381Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808Management of client data
    • H04N21/25841Management of client data involving the geographical location of the client
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866Management of end-user data
    • H04N21/25875Management of end-user data involving end-user authentication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42202Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508Management of client data or end-user data
    • H04N21/4524Management of client data or end-user data involving the geographical location of the client

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Graphics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Ecology (AREA)
  • Emergency Management (AREA)
  • Environmental & Geological Engineering (AREA)
  • Environmental Sciences (AREA)
  • Remote Sensing (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The motion state detection method of customer mobile terminal belongs to user movement state inspection field in mobile video playing process, is realized in the user movement collectively constituted by terminal, base station and server a state obtaining system.It is characterized in that, in the terminal except the acquisition process memory module of setting acceleration and gps data, also set up video playout speed class adjusting module, adjust frame phenomenon of breaking caused by terminal shake, also set up mobile video and play fault alarm module, writing to each other for base station and user is established, obtains service experience and solution of the user to failure.Mobile video fault-signal processing module is set in a base station, solves Caton phenomenon.User authentication, the identification of application request legitimacy are set in the server, specify user movement state tracking module, to movement locus of the monitoring designated terminal user in video display process in real time.The present invention meets the needs of terminal user and relevant department tracking special user track simultaneously.

Description

Motion state of mobile terminal detection method in mobile video playing process
Technical field
The present invention relates to motion state detection field, in particular in a kind of playing process towards mobile video The detection method of motion state of mobile terminal.The present invention, according to mobile terminal, during video is played, the acceleration that is gathered Degree count with GPS (global positioning system, Global Positioning System) data, detected using statistical method Motion state (including dither state and speed state) with estimating mobile terminal, and then be the user of identification hand-held mobile terminal Motion state provides scientific basis.
Background technology
According to the newest industry analysis report display of China's Industry Information Network in 2017, by December, 2016:(1) China netizen 95.1% is risen to using the ratio of mobile terminal Internet access;(2) netizen passes through non-Residential environments (such as unit, school, public place of entertainment Institute) online ratio it is in rising trend compared with former years;(3) 2016 years, the online duration per capita of Chinese netizen was 26.4 hours/week;(4) Mobile netizen commonly using five class APP (instant messaging, network direct broadcasting, microblogging social, comprehensive electric business and Comprehensive Data) in, There are four small peaks of use at 13 points, 19 points, 22 points and 0 point respectively in network direct broadcasting class APP.Further analysis report can be seen Go out, mobile video has become one of most commonly used business of mobile subscriber.Cisco VNI is also predicted, to the year two thousand twenty, video The 82% of total IP flows will be accounted for, the flow of wireless and mobile device generation will account for 2/3rds of total internet traffic.
At the same time, when user enjoys Video service using mobile terminal device in a mobile environment, inevitably Due to the characteristic of mobile context so as to influence the Video service of user experience.Specifically, when mobile device is static user to regarding The perception of frequency be it is most strong, and mobile device in space exist shake etc. state when, details of the user to video playback Capturing ability is decreased obviously.So if it can be detected in real time by mobile terminal device and the motion state of assessment equipment (bag Include dither state and speed state), if solution can be found to improve perception of the user to mobile video, then Lift Video service Quality of experience.
From the above mentioned, accurately motion state of the detection mobile device in video playback has more great meaning with answering With, therefore the motion state of mobile terminal detection method in mobile video playing process is highlighted herein.
At present, several representational mobile terminal state appraisal procedures and problem to be present as follows:
(1) patent [application publication number:The A of CN 106510720, the reminding method and device of a kind of User Status]:According to The GPS module of mobile terminal detects the location of terminal information.Only GPS parameters can only detect the displacement of mobile terminal Information, it is not enough to represent the motion state of mobile terminal, is more not enough to represent User Status.
(2) patent [application publication number:The A of CN 106131792, user movement state monitoring method and device]:According to end The current angular velocity data and current acceleration data at end, the current motion state parameter value of terminal is determined, obtain working as terminal Preceding motion state parameterses desired value meets pre- in current motion state parameter desired value and the difference of current motion state parameter value If during condition, it is determined that the user for holding terminal is currently at target state.Difficult point in the patented method practical application exists It is excessively subjective or inaccurate in setting up for preparatory condition, and the accuracy of this motion state for directly affecting detection terminal, enter And influence the detection accuracy of User Status.
(3) patent [application publication number:The A of CN 105224104, pedestrian movement's state based on smart mobile phone grip mode Recognition methods]:The acceleration transducer data gathered according to mobile terminal, using the SVMs based on Radial basis kernel function Method detects the motion state with estimation mobile terminal, and then estimates pedestrian's User Status of hand-held intelligent mobile phone mode.Should Method, the mapping relations between data input and data output can not be captured well, it is relatively adapted to find optimum segmentation Face problem, be not suitable for nonlinear mobile terminal state detection during mobile video play service.
And the content of the discussions of this patent includes, introduce and how from the state of customer mobile terminal to obtain the motion of terminal user State, discuss how from the motion state of user come obtain user video display process in experience and fault resolution, And the tracking of the detection and User Status user movement state links together.
The content of the invention
Goal of the invention:Obtain motion state of the user in mobile video playing process
It is a feature of the present invention that it is that a kind of motion state parameterses by means of detecting customer mobile terminal obtain movement The method of terminal user's motion state, it is by customer mobile terminal abbreviation terminal, base station and mobile communication backbone network clothes at one Business device abbreviation server, mobile terminal user's motion state that three collectively constitutes obtain system, hereinafter referred to as in system successively Realize according to the following steps:
Step (1):System initialization
Step (1.1):Terminal initialization:
Terminal acceleration analysis part, controlled by acceleration transducer, acceleration information acquisition process memory module and output Molding block is in series, and the input data of described acceleration information acquisition process memory module is acceleration information, exports number According to for chattering frequency and jitter mode, and output control module sets up wireless output control signal input, output control manually The output end of signal input part processed, chattering frequency and jitter mode,
Gps data processing component, it is in series by a gps data processing, memory module and output control module, it is described Output control module be provided with wireless output control signal input and manual output control signal input,
Define the Three models of terminal dither state:Inactive state, slight jitter and acutely shake, wherein:
Inactive state:Shake number C1 per minute<=1,
Slight jitter:1<Shake number C2 per minute<=C2.max, C2.max=47,
Acutely shake:C2.max<Shake number C3 per minute<C3.max, C3.max=120,
Define terminal velocity state, thousand ms/h of unit:Bicycle (10~15), electric car (15~30), motorcycle (20~80), subway (40~80), automobile (30~150), train (150~200), high ferro (more than 200),
Thus the motion state of terminal user is obtained, is divided into following five kinds of motor patterns:
Inactive state:0km/h,
Ambulatory position:1~10km/h,
Riding condition:10~30km/h,
Low speed trip state:30~150km/h,
Trip state at a high speed:>150km/h,
Video playout speed class adjusting module, the specified broadcasting speed for setting mobile video are numerically equal to mid ranger Secondary intermediate value speed, video playout speed adjustment by built-in there is comprising at least for regulation broadcasting speed function to have Player including KMplayer, BSplayer is simultaneously realized with manual fine-tuning again, realizes video playback speed according to the following steps successively The adjustment of degree:
1) acceleration value during disconnected frame is integrated to obtain terminal movement velocity during disconnected frame,
2) judge terminal movement velocity during disconnected frame be in middling speed class, or at a high speed or in low speed class,
If 3) fall in high speed class, specified broadcasting speed is improved to the minimum speed of high speed class, if falling low In fast class, then specified broadcasting speed is reduced to the maximal rate of low speed class, if falling in middling speed class, if more than specified Speed, then fine setting improves normal speed, if being less than normal speed, fine setting reduces normal speed, and then manually fine setting is straight Untill mobile terminal user is satisfied with,
Mobile video plays fault alarm module, provided with following array:[authenticating user identification code, user mobile phone number, user Name, user address, carve at the beginning of corresponding failure, the end time of corresponding failure, the number that failure occurs], and this Array is output to base station,
Step (1.2):Base station initialization:Setting network communication module is realized to be interconnected with server, sets mobile video event Hinder signal processing module, its output end is connected with the input of described network communication module, in input and the terminal The output end that mobile video plays fault alarm module is connected,
Step (1.3):Server initiation:Provided with authenticating user identification module, user applies for that request legitimacy assert mould Block and the motion state trace signals output module of specified mobile terminal user, three are sequentially connected in series,
Step (2):System realizes the acquisition of user movement state according to the following steps successively:
Step (2.1):Base station differentiates the type of input signal,
Step (2.1.1):The motion state trace signals of the designated terminal user sent if server, successively by following Step is carried out,
Step (2.1.1.1):Differentiate that server designated terminal user is current whether in the range of this base station communication:If no In, then return to step (2.1.1), if, open respectively server specify it is defeated in the acceleration analysis part of user terminal The output control module gone out in control module and gps data processing component,
Step (2.1.1.2):From the mobile terminal acceleration acquisition process memory module and gps data processing module Obtained in the result of output each motion state residing for the user represented in mobile video playing process with time order and function when Section, its corresponding GPS location coordinate section and the vehicles that may be taken,
Step (2.1.1.3):The above results are uploaded onto the server by the network communication module of base station,
Step (2.1.1.4):Server carries out authenticating user identification, and differentiation is that criminal investigation department user or civil department are used Family, if criminal investigation department user, then law enforcement agency of public security organs is sent to, if civil department user, is then sent to civil law enforcement Part or civil service department,
Step (2.1.2):If user video fault-signal, perform according to the following steps successively,
Step (2.1.2.1):According to the array uploaded in video playback fault alarm module in terminal, body is carried out to user Part certification:If not by program determination;If by, respectively open customer mobile terminal acceleration analysis part In output control module and gps data processing component in output control module,
Step (2.1.2.2):In the result exported from acceleration acquisition process memory module and gps data processing module, Obtain different events under the terminal chattering frequency of the time-varying of terminal, jitter mode and each malfunction in mobile video playing process Hinder beginning and the end time of period,
Step (2.1.2.3):Discriminating fault types,
Step (2.1.2.3.1):Disconnected frame failure, integrates to obtain each motion of terminal from the acceleration information at each disconnected frame moment Speed,
Step (2.1.2.3.1.1):Judge that the movement velocity of terminal falls in low speed, middling speed or high speed class,
Step (2.1.2.3.1.1.1):Broadcasting speed is improved to high speed class in high speed class, regulation player if falling Minimum speed,
Step (2.1.2.3.1.1.2):If fall in middling speed class, motion of the fine setting player speed close to present terminal Speed,
Step (2.1.2.3.1.1.3):If fall reduces broadcasting speed to low speed class in low speed class, regulation player Maximal rate,
Step (2.1.2.3.1.2):Broadcasting speed is adjusted repeatedly manually, until broadcasting speed is adjusted to mobile terminal user Untill satisfaction,
Step (2.1.2.3.2):Interim card failure, the duration of each interim card period in mobile video playing process is found out,
Step (2.1.2.3.2.1):The interim card duration of maximum, max (Δ t are found out from each interim card periodk), Δ t is represented The duration of interim card,
K represents the sequence number that interim card occurs, and k=1,2 ..., K, K is interim card total degree,
Step (2.1.2.3.2.2):Judge max (Δ tk) whether it is more than interim card limiting value tmax, make tK max=375ms, its In above 75ms represent that retina signal is delivered to the corticocerebral time, middle 200ms is used at corticocerebral deep processing Reason, the transmission and expression of rear 100ms user's brain decision-making,
Step (2.1.2.3.2.2.1):If it is not, then terminate,
Step (2.1.2.3.2.2.2):If so, then base station eliminates the hardware fault for producing interim card, and go to step (2.1.2.3.2.2), until max (Δ tk)<tK maxUntill.
The advantage of the invention is that obtain the motion state of terminal user from the state of customer mobile terminal, discuss how from The motion state of user obtains the experience in the video display process of user and fault resolution, and user movement state Detection and the trajectory track of user movement state link together.
Brief description of the drawings
Fig. 1:The main program flow block diagram of the present invention.
Fig. 2:Dither state testing process block diagram.
Fig. 3:The schematic block diagram of user movement state period.
Fig. 4:Speed state testing process block diagram.
Embodiment
Shown in Fig. 2, the implementing procedure of dither state detection is as follows:
The definition of step (1) dither state patterns:Inactive state, acutely slight jitter, shake.
Step (1.1) finds a series of testers for meeting test request, including juvenile (7 years old~17 years old), young (18 years old~40 years old), middle aged (41 years old~65 years old), the elderly is each 3 (after 66 years old).
Step (1.2) requires its handhold mobile terminal equipment, carries out the jitter test of lasting one minute, most start according to It is per minute 10 times shake, then every time test lifting 10 times/it is per minute, until be promoted to 100 times/it is per minute untill, test it Between 5 minute time of having a rest was set.
Step (1.3) feeds back according to the tester of different age group, and statistical test personnel feel tired in test process The shake number of labor, the threshold value for taking its average value to be shaken as slight jitter and acutely.
Step (1.4) completes the definition of jitter mode:Still-mode (shake number per minute is less than 1 time), slight jitter Pattern (shake number per minute is more than 1 time, less than 47 times), acutely shakes (shake number per minute is more than 47 times).
Step (2) acceleration informations gather:User clicks on and commences play out video button, video jukebox software front-end interface Can be to the video that user's displaying is playing.Meanwhile software backstage starts to gather acceleration information, comprises the following steps that:
Step (2.1) softwares backstage detects whether to have already turned on collection sub-line journey program, if it is not, creating newly Collection sub-line journey program starts background acquisition acceleration information.
Step (2.2) is during software plays video, and backstage is respectively with specified sampling time interval TaAdopt within=0.1 second Collect mobile terminal in sampling instant t=nTa, n ∈ { 0,1,2 ... } acceleration information, and by its by " timestamp, x-axis, y-axis, Z-axis " form, which is written to, is stored in mobile terminal, and until video playback terminates, including video normal termination and user artificially terminate Video.Specifically, in the matrix form in the range of output data acquisition time mobile terminal accelerometer data time series, Wherein N is the number of sampled point, T is taken under default situationsa=0.1 second, N value was determined by the data acquisition time T of reality,And under default situations There should be T >=60 second.
For step (2.3) if video playbacks terminate, software backstage should terminate corresponding collection sub-line journey program immediately.
Step (3) validity checks:Data in the text of current record are carried out with validity check, main inspection Whether whether measuring acceleration data are in effective range, and have and the problem of equipment produces such as can not record, can if occurring The reason for directly giving up and producing log recording error.
The processing of step (4) data predictions:Packet by the accelerometer data A collected by every five seconds for example, altogether N/50 Group data, every group of data are used for the dither state S for analyzing every five seconds for exampled.I.e. data are divided into And it is each acceleration information matrix anInitially Change the three-dimensional initial velocity vector that a numerical value is 0With the three-dimensional position skew that a numerical value is 0 Vector
Step (5) is for each group of data anLagrange's interpolation operation is carried out, this operation is to anIn matrix it is each arrange to Measure all, below with x-axis acceleration information (first row) for example.It is specific as follows:
To (an)x=[ax50×(n-1) ax50×(n-1)+1 … ax50×n] data vector carries out simplifying description:X=[x0 x1 … x50].This 51 data are carried out with piecewise interpolation successively, 50 interpolation are amounted to, wherein [x0 x1] between interpolation inserted using linear Value method, i.e.,
xp=x0+t·x1,0<t<1
Then to [x1 x50] between data enter row interpolation, amount to 49 Lagrange's interpolations.For every section of interpolation [xn xn+1] (n=1,2,3 ... 49), construct following Interpolation-Radix-Function, Lagrangian fundamental polynomials:
Then interpolating function can be obtained:
xt=xn-1l1(t)+xnl2(t)+xn+1l3(t) (n<t<n+1)
Obtain continuous acceleration information
an=[fx(t),fy(t),fz(t)],(0<t<50, unit:0.1s).
Wherein
Similarly fyAnd f (t)z(t) can be tried to achieve according to same step.
Step (6) is to a after interpolationnIntegrated, try to achieve the speed v at each moment in 5 secondsn.Concrete operations are such as Under:
vn=[gx(t),gy(t),gz(t)]
Wherein (t unit:Second, g (t) unit:Meter per second)
Then the speed of this group of last moment is entered as to the initial velocity of next group of data, i.e.,:
Step (7) integrates to speed, tries to achieve the displacement bias amount d at each moment in 5 secondsn.Concrete operations are as follows:
dn=[hx(t),hy(t),hz(t)]
Wherein (t unit:Second, h (t) unit:Rice)
Then the position offset of this group of last moment is entered as to the initial position offset of next group of data, i.e.,:
Step (8) is to position offset dnThe number of its zero crossing is sought, takes x, the offset zero crossing in tri- directions of y, z The most vibrations number as mobile terminal in this 5 seconds of number.Concrete operations are as follows:
Ask
The number of three solution of equations, it is not anti-to be set to mx,my,mz, then this group of acceleration information finally try to achieve in this 5 seconds Shake number mnFor:
mn=max { mx,my,mz}
Then chattering frequency fdFor:
fd=12mn, unit:Beat/min
Then according to fdTo judge dither state Sd.That is input acceleration matrix an, export as dither state:
[fd,Sd]
Wherein fdRepresent vibration frequency, i.e., the number of shake per minute;SdRepresent that (0 represents inactive state, 1 table to dither state Show slight jitter, 2 represent acutely shake).
Step (9) is to each acceleration submatrix a for being grouped to obtain from acceleration matrix An, carry out step 5,6,7, 8, you can to obtain chronological dither state sequence:
[fd,Sd]1, [fd,Sd]2..., [fd,Sd]N/50
If necessary to count dither state overall in whole video display process, the ratio of each dither state can be taken, It is or average.
The implementing procedure of speed state detection is as follows:
Shown in Fig. 4, it is speed state overhaul flow chart, comprises the following steps that:
The definition of step (1) speed state patterns:Inactive state, ambulatory position, riding condition, at a high speed slow traffic, friendship It is logical.
Speed is divided into five scopes, each scope corresponding one by step (1.1) according to the speed of all kinds of vehicles Kind or a variety of most possible vehicles.
(unit is unified for the typical rate of step (1.2) act vehicles of common:Thousand ms/h):Bicycle (10~ 15), electric car (15~30), motorcycle (20~80), subway (40~80), automobile (30~150), train (>150).
Step (1.3) is overlapping because the velocity band of the part vehicles has, and can not directly be divided according to speed, we Suitable point on the basis of watching video is considered whether, speed state is divided into following four state:Inactive state (0km/h), is walked Dynamic state (1~10km/h), riding condition (10~30km/h), slow traffic (30~150km/h), high-speed transit (>150km/ h)。
Step (2) .GPS data acquisitions:Click commences play out video button, and software front-end interface can be shown to user The video of broadcasting.Meanwhile software backstage starts to gather acceleration and gps data, comprises the following steps that:
Step (2.1) softwares backstage detects whether to have already turned on collection sub-line journey program, if it is not, creating newly Collection sub-line journey program starts background acquisition acceleration and gps data.
Step (2.2) is during software plays video, and software backstage is respectively with specified sampling time interval Tp=5 seconds Mobile terminal is gathered in sampling instant t=nTp, n ∈ { 0,1,2 ... } gps data, and by its respectively by " timestamp, longitude, Latitude " form is written to storage in the terminal, and until video playback terminates, (including video normal termination and user artificially tie Beam video).
For step (2.3) if video playbacks terminate, software backstage should terminate corresponding collection sub-line journey program immediately.
Step (3) validity checks:Data in the text of current record are carried out with validity check, main inspection Gps data is surveyed whether in effective range, and whether has and the problem of equipment produces such as can not record, can be straight if occurring Connect the reason for giving up and produce log recording error.
Step (4) data predictions:In the matrix form in the range of output data acquisition time mobile terminal gps data Time series, P= Wherein M be sampled point number, default situations Under take Tp=10 seconds, M value was determined by the data acquisition time T of reality,And should have under default situations T >= 60 seconds.
Step (5) is calculated per TpThe average speed of mobile terminal in=5 seconds, specific calculating operation are as follows:
Gathered because the GPS collected counts by 5 seconds, therefore matrix P need not be grouped again, and in view of in 5 seconds The GPS location change of user will not be excessively complicated, can be approximately considered in linear uniform motion, so can be in the hope of in 5 seconds Point-to-point speed of the average speed as terminal device, directly by
The speed of mobile device is calculated, wherein R is earth radius.I.e. by GPS matrix P, what is directly calculated is flat Equal speed V, then according to fdTo judge speed state Sv.Gps data p is inputted, is exported as dither state:
[V,Sv]
Wherein V represents the average speed in 5 seconds;SvExpression speed state (0 expression inactive state, 1 expression ambulatory position, 2 Riding condition is represented, 3 represent slow traffic, and 4 represent high-speed transit).
Step (6) is to the data [px in each P from GPS matrixesn-1 pyn-1 pxn pyn], carry out step 5, you can with Obtain chronological dither state sequence:
[V,Sv]1, [V, Sv]2..., [V, Sv]M
If necessary to count speed state overall in whole video display process, the ratio of each speed state can be taken, Or it is average, while the vehicles that user is taken, schematic diagram such as Fig. 3 can also be estimated according to speed state.

Claims (2)

1. the motion state detection method of customer mobile terminal in mobile video playing process, it is characterised in that be it is a kind of by Obtain the method for mobile terminal user's motion state in the motion state parameterses of detection customer mobile terminal, be one by with Family mobile terminal abbreviation terminal, base station and mobile communication backbone's network server abbreviation server, the mobile end that three collectively constitutes End subscriber motion state obtains system, is hereinafter referred to as realized according to the following steps successively in system:
Step (1):System initialization
Step (1.1):Terminal initialization:
Terminal acceleration analysis part, by acceleration transducer, acceleration information acquisition process memory module and output control mould Block is in series, and the input data of described acceleration information acquisition process memory module is acceleration information, and output data is Chattering frequency and jitter mode, and output control module sets up wireless output control signal input, manual output control letter The output end of number input, chattering frequency and jitter mode,
Gps data processing component, in series by a gps data processing, memory module and output control module, described is defeated Go out control module and be provided with wireless output control signal input and manual output control signal input,
Define the Three models of terminal dither state:Inactive state, slight jitter and acutely shake, wherein:
Inactive state:Shake number C1 per minute<=1,
Slight jitter:1<Shake number C2 per minute<=C2.max, C2.max=47,
Acutely shake:C2.max<Shake number C3 per minute<C3.max, C3.max=120,
Define terminal velocity state, thousand ms/h of unit:Bicycle (10~15), electric car (15~30), motorcycle (20~ 80), subway (40~80), automobile (30~150), train (150~200), high ferro (more than 200),
Thus the motion state of terminal user is obtained, is divided into following five kinds of motor patterns:
Video playout speed class adjusting module, the specified broadcasting speed for setting mobile video are numerically equal to middling speed class Intermediate value speed, video playout speed adjustment by built-in there is comprising at least for regulation broadcasting speed function to have KMplayer, Player including BSplayer is simultaneously realized with manual fine-tuning again, realizes the adjustment of video playout speed according to the following steps successively:
1) acceleration value during disconnected frame is integrated to obtain terminal movement velocity during disconnected frame,
2) judge terminal movement velocity during disconnected frame be in middling speed class, or at a high speed or in low speed class,
If 3) fall in high speed class, specified broadcasting speed is improved to the minimum speed of high speed class, if falling in low or first gear In secondary, then specified broadcasting speed is reduced to the maximal rate of low speed class, if falling in middling speed class, if being more than specified speed Degree, then fine setting improve normal speed, if being less than normal speed, fine setting reduction normal speed, then manually finely tune until Untill mobile terminal user is satisfied with,
Mobile video plays fault alarm module, provided with following array:[authenticating user identification code, user mobile phone number, user's surname Name, user address, carve at the beginning of corresponding failure, the end time of corresponding failure, the number that failure occurs], and this number Group is output to base station,
Step (1.2):Base station initialization:Set network communication module to realize to interconnect with server, mobile video failure letter is set Number processing module, its output end are connected with the input of described network communication module, input and the movement in the terminal The output end of video playback fault alarm module is connected,
Step (1.3):Server initiation:Provided with authenticating user identification module, user apply request legitimacy assert module and The motion state trace signals output module of mobile terminal user is specified, three is sequentially connected in series,
Step (2):System realizes the acquisition of user movement state according to the following steps successively:
Step (2.1):Base station differentiates the type of input signal,
Step (2.1.1):The motion state trace signals of the designated terminal user sent if server, successively according to the following steps Carry out,
Step (2.1.1.1):Differentiate that server designated terminal user is current whether in the range of this base station communication:If not existing, Return to step (2.1.1), if opening the output control in the acceleration analysis part of the specified user terminal of server respectively Output control module in module and gps data processing component,
Step (2.1.1.2):Exported from the mobile terminal acceleration acquisition process memory module with gps data processing module Result in obtain each motion state residing for the user represented in mobile video playing process with time order and function period, its Corresponding GPS location coordinate section and the vehicles that may be taken,
Step (2.1.1.3):The above results are uploaded onto the server by the network communication module of base station,
Step (2.1.1.4):Server carries out authenticating user identification, and differentiation is criminal investigation department user or civil department user, If criminal investigation department user, being then sent to law enforcement agency of public security organs, if civil department user, then civil law enforcement part is sent to Or civil service department,
Step (2.1.2):If user video fault-signal, perform according to the following steps successively,
Step (2.1.2.1):According to the array uploaded in video playback fault alarm module in terminal, identity is carried out to user and recognized Card:If not by program determination;If by the acceleration analysis part for opening customer mobile terminal respectively Output control module in output control module and gps data processing component,
Step (2.1.2.2):In the result exported from acceleration acquisition process memory module and gps data processing module, obtain In mobile video playing process under the terminal chattering frequency of the time-varying of terminal, jitter mode and each malfunction during different faults The beginning of section and end time,
Step (2.1.2.3):Discriminating fault types,
Step (2.1.2.3.1):Disconnected frame failure, integrate to obtain each motion speed of terminal from the acceleration information at each disconnected frame moment Degree,
Step (2.1.2.3.1.1):Judge that the movement velocity of terminal falls in low speed, middling speed or high speed class,
Step (2.1.2.3.1.1.1):If falling in high speed class, regulation player improves broadcasting speed to high speed class most Small speed,
Step (2.1.2.3.1.1.2):If fall in middling speed class, motion speed of the fine setting player speed close to present terminal Degree,
Step (2.1.2.3.1.1.3):If falling in low speed class, regulation player reduces broadcasting speed to low speed class most Big speed,
Step (2.1.2.3.1.2):Broadcasting speed is adjusted repeatedly manually, is satisfied with until broadcasting speed is adjusted to mobile terminal user Untill,
Step (2.1.2.3.2):Interim card failure, the duration of each interim card period in mobile video playing process is found out,
Step (2.1.2.3.2.1):The interim card duration of maximum, max (Δ t are found out from each interim card periodk), Δ t represents a secondary card The duration to pause, k represent the sequence number that interim card occurs, and k=1,2 ..., K, K is interim card total degree,
Step (2.1.2.3.2.2):Judge max (Δ tk) whether it is more than interim card limiting value tmax, make tK max=375ms, wherein before Face 75ms represents that retina signal is delivered to the corticocerebral time, and middle 200ms is handled for corticocerebral deep processing, after The transmission and expression of 100ms user's brain decision-making,
Step (2.1.2.3.2.2.1):If it is not, then terminate,
Step (2.1.2.3.2.2.2):If so, then base station eliminates the hardware fault for producing interim card, and go to step (2.1.2.3.2.2), until max (Δ tk)<tK maxUntill.
2. the motion state detection method of customer mobile terminal in mobile video playing process according to claim 1, its It is characterised by, the calculating of customer mobile terminal dither state is realized according to the following steps successively:
Step (1):The definition of dither state pattern:Inactive state, acutely slight jitter, shake,
Step (1.1) finds a series of testers for meeting test request, includes the teenager of 7 years old~17 years old, 18 years old~40 years old Youth, the middle age of 41 years old~65 years old, 66 years old later old each 3,
Step (1.2) requires its handhold mobile terminal equipment, carries out the jitter test of lasting one minute, most starts according to every point The shake of clock 10 times, then test lifting 10 times/per minute every time, until be promoted to 100 times/it is per minute untill, set between test 5 minute time of having a rest is put,
Step (1.3) feeds back according to the tester of different age group, and statistical test personnel feel fatigue in test process Shake number, the threshold value for taking its average value to be shaken as slight jitter and acutely,
Step (1.4) completes the definition of jitter mode, still-mode:Shake number per minute is less than 1 time, slight jitter pattern: Shake number per minute is more than 1 time, less than 47 times, violent jitter mode:Shake number per minute is at least 47 times,
Step (2) acceleration informations gather:User clicks on and commences play out video button, and video jukebox software front-end interface can be to The video that user's displaying is playing, meanwhile, software backstage starts to gather acceleration information:
Step (2.1) softwares backstage detects whether to have already turned on collection sub-line journey program, if it is not, creating new collection Sub-line journey program starts background acquisition acceleration information,
The data that step (2.2) is collected are recorded as data matrix A according to two dimensions of time and acceleration direction of principal axis,
For step (2.3) if video playbacks terminate, software backstage should terminate corresponding collection sub-line journey program immediately,
Step (3) validity checks:Validity check is carried out to the data in the text of current record, predominantly detects and adds Whether whether speed data is in effective range, and have and the problem of equipment produces such as can not record, can be direct if occurring The reason for giving up and producing log recording error,
Step (4) data predictions, acceleration information matrix A is divided into a series of submatrix a according to the data volume of every five seconds for example, And initial velocity vector and position offset vector are initialized,
Step (5) carries out Lagrange's interpolation operation to each submatrix data a in matrix A, obtains adding for zonal cooling Speed data,
The acceleration information of zonal coolings of step (6) to being obtained in step (5) integrates, and tries to achieve each moment in 5 seconds Speed,
The speed at each moment integrates in step (7) obtained to step (6) continuous 5 seconds, tries to achieve each moment in 5 seconds Position offset,
The position offset at each moment seeks the number of its zero crossing in step (8) obtained to step (7) 5 seconds, take three plus Vibrations number of the most value of speed direction of principal axis offset zero crossing number as mobile terminal in this 5 seconds, and it is calculated Chattering frequency, it is determined that corresponding jitter mode,
Step (9) carries out step (5), (6), (7), (8) to each acceleration matrix A submatrix a for being grouped to obtain, and obtains According to the dither state sequence of Time alignment.
CN201711263485.3A 2017-12-05 2017-12-05 Motion state of mobile terminal detection method in mobile video playing process Active CN107770592B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711263485.3A CN107770592B (en) 2017-12-05 2017-12-05 Motion state of mobile terminal detection method in mobile video playing process

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711263485.3A CN107770592B (en) 2017-12-05 2017-12-05 Motion state of mobile terminal detection method in mobile video playing process

Publications (2)

Publication Number Publication Date
CN107770592A true CN107770592A (en) 2018-03-06
CN107770592B CN107770592B (en) 2018-07-27

Family

ID=61276876

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711263485.3A Active CN107770592B (en) 2017-12-05 2017-12-05 Motion state of mobile terminal detection method in mobile video playing process

Country Status (1)

Country Link
CN (1) CN107770592B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110177212A (en) * 2019-06-26 2019-08-27 Oppo广东移动通信有限公司 Image processing method and device, electronic equipment, computer readable storage medium
CN110234023A (en) * 2019-02-22 2019-09-13 华为技术有限公司 A kind of method and apparatus handling video traffic
CN110505501A (en) * 2019-08-28 2019-11-26 咪咕视讯科技有限公司 Information processing method, electronic equipment and computer readable storage medium
CN110719535A (en) * 2019-09-02 2020-01-21 北方工业大学 Adaptive equalization adjustment method for downlink video stream code rate at video source end
CN111614659A (en) * 2020-05-19 2020-09-01 杭州英视信息科技有限公司 Distributed detection method for unknown network flow

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110211132A1 (en) * 2008-10-28 2011-09-01 Silicon Communications Technology Co., Ltd. Grid signal receiver and wireless pointing system having the same
CN102577312A (en) * 2009-10-16 2012-07-11 高通股份有限公司 Adaptively streaming multimedia
CN103731557A (en) * 2014-01-08 2014-04-16 南方医科大学 Smartphone-based real-time falling detection system and method
CN103729281A (en) * 2014-01-17 2014-04-16 中国联合网络通信集团有限公司 Application program usage information acquisition method and mobile terminal
CN104735485A (en) * 2015-03-05 2015-06-24 上海小蚁科技有限公司 Method and device for playing video
CN105224104A (en) * 2015-09-01 2016-01-06 电子科技大学 Pedestrian movement's state identification method of mode is held based on smart mobile phone
CN105659639A (en) * 2013-07-26 2016-06-08 艾纳高格有限公司 Associating external devices to vehicles and usage of said association
CN106131792A (en) * 2016-08-26 2016-11-16 北京小米移动软件有限公司 User movement state monitoring method and device
CN106502756A (en) * 2016-12-06 2017-03-15 武汉斗鱼网络科技有限公司 Application control method and device
CN106501834A (en) * 2016-10-11 2017-03-15 上海保橙网络科技有限公司 A kind of method of use mobile phone automatic decision user movement behavior
CN106510720A (en) * 2016-10-19 2017-03-22 广东欧珀移动通信有限公司 Method and device for prompting user state
US9628958B1 (en) * 2013-03-15 2017-04-18 Paul McBurney User-controlled, smart device-based location and transit data gathering and sharing
CN107015646A (en) * 2017-03-28 2017-08-04 北京犀牛数字互动科技有限公司 The recognition methods of motion state and device
CN107317934A (en) * 2017-06-30 2017-11-03 北京奇虎科技有限公司 User Activity state based on mobile terminal determines method, device and mobile terminal

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110211132A1 (en) * 2008-10-28 2011-09-01 Silicon Communications Technology Co., Ltd. Grid signal receiver and wireless pointing system having the same
CN102577312A (en) * 2009-10-16 2012-07-11 高通股份有限公司 Adaptively streaming multimedia
US9628958B1 (en) * 2013-03-15 2017-04-18 Paul McBurney User-controlled, smart device-based location and transit data gathering and sharing
CN105659639A (en) * 2013-07-26 2016-06-08 艾纳高格有限公司 Associating external devices to vehicles and usage of said association
CN103731557A (en) * 2014-01-08 2014-04-16 南方医科大学 Smartphone-based real-time falling detection system and method
CN103729281A (en) * 2014-01-17 2014-04-16 中国联合网络通信集团有限公司 Application program usage information acquisition method and mobile terminal
CN104735485A (en) * 2015-03-05 2015-06-24 上海小蚁科技有限公司 Method and device for playing video
CN105224104A (en) * 2015-09-01 2016-01-06 电子科技大学 Pedestrian movement's state identification method of mode is held based on smart mobile phone
CN106131792A (en) * 2016-08-26 2016-11-16 北京小米移动软件有限公司 User movement state monitoring method and device
CN106501834A (en) * 2016-10-11 2017-03-15 上海保橙网络科技有限公司 A kind of method of use mobile phone automatic decision user movement behavior
CN106510720A (en) * 2016-10-19 2017-03-22 广东欧珀移动通信有限公司 Method and device for prompting user state
CN106502756A (en) * 2016-12-06 2017-03-15 武汉斗鱼网络科技有限公司 Application control method and device
CN107015646A (en) * 2017-03-28 2017-08-04 北京犀牛数字互动科技有限公司 The recognition methods of motion state and device
CN107317934A (en) * 2017-06-30 2017-11-03 北京奇虎科技有限公司 User Activity state based on mobile terminal determines method, device and mobile terminal

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110234023A (en) * 2019-02-22 2019-09-13 华为技术有限公司 A kind of method and apparatus handling video traffic
CN110177212A (en) * 2019-06-26 2019-08-27 Oppo广东移动通信有限公司 Image processing method and device, electronic equipment, computer readable storage medium
CN110505501A (en) * 2019-08-28 2019-11-26 咪咕视讯科技有限公司 Information processing method, electronic equipment and computer readable storage medium
CN110505501B (en) * 2019-08-28 2021-12-07 咪咕视讯科技有限公司 Information processing method, electronic device, and computer-readable storage medium
CN110719535A (en) * 2019-09-02 2020-01-21 北方工业大学 Adaptive equalization adjustment method for downlink video stream code rate at video source end
CN111614659A (en) * 2020-05-19 2020-09-01 杭州英视信息科技有限公司 Distributed detection method for unknown network flow
CN111614659B (en) * 2020-05-19 2022-09-23 杭州英视信息科技有限公司 Distributed detection method for unknown network flow

Also Published As

Publication number Publication date
CN107770592B (en) 2018-07-27

Similar Documents

Publication Publication Date Title
CN107770592B (en) Motion state of mobile terminal detection method in mobile video playing process
CN102685717B (en) network service quality parameter identification method and device
US10672249B1 (en) Determining, scoring, and reporting mobile phone distraction of a driver
US11932257B2 (en) Determining, scoring, and reporting mobile phone distraction of a driver
CN109873726B (en) Robust service quality prediction and guarantee method based on deep learning in SDN
CN104065928B (en) A kind of behavior pattern statistic device and method
CN101309400B (en) Stream media service pause information acquisition method and device
CN104185136B (en) A kind of intelligence based on WiFi technology, which is registered, system and registers method
CN110139231A (en) A kind of car networking social contact method based on travelling data
US20160132618A1 (en) Characterization of sensor data for vehicle telematics
CN107103647A (en) System and method for for car tracing
US20200228923A1 (en) Estimating orientation of a mobile device with respect to a vehicle using global displacement information and local motion information
CN107133892A (en) The real-time estimating method and system of a kind of network Piano lesson
CN106209540B (en) A kind of test method and device of CAN bus sampling point position
CN109409172A (en) Pilot&#39;s line of vision detection method, system, medium and equipment
CN112597965A (en) Driving behavior recognition method and device and computer readable storage medium
CN106982391A (en) A kind of information-pushing method, terminal, server and system
CN109974726A (en) A kind of road state determines method and device
RU2308385C2 (en) Device for estimating quality of automobile driving
CN110342363B (en) Method and device for testing safety performance of elevator, terminal equipment and storage medium
CN102316363B (en) Method and devices for measuring video end-to-end delay by non-intrusive double-ended collection
CN108540424A (en) Monitoring system, monitoring device and monitoring method
WO2015049539A1 (en) Improvements relating to remote monitoring of user environments using mobile devices
CN107241624B (en) The method and device of information processing
CN105096197A (en) Vehicle risk sharing method and apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB03 Change of inventor or designer information

Inventor after: Tao Xiaoming

Inventor after: Liu Yifeng

Inventor after: Xiao Ailing

Inventor after: Duan Yiping

Inventor after: Ge Ning

Inventor before: Tao Xiaoming

Inventor before: Liu Yifeng

Inventor before: Xiao Ailing

Inventor before: Duan Yiping

Inventor before: Ge Ning

CB03 Change of inventor or designer information
GR01 Patent grant
GR01 Patent grant
CB03 Change of inventor or designer information

Inventor after: Tao Xiaoming

Inventor after: Liu Yifeng

Inventor after: Xiao Ailing

Inventor after: Duan Yiping

Inventor after: Ge Ning

Inventor after: Liu Shuai

Inventor before: Tao Xiaoming

Inventor before: Liu Yifeng

Inventor before: Xiao Ailing

Inventor before: Duan Yiping

Inventor before: Ge Ning

CB03 Change of inventor or designer information
CI03 Correction of invention patent

Correction item: Inventor

Correct: Tao Xiaoming|Liu Yifeng|Xiao Ailing|Duan Yiping|Ge Ning

False: Tao Xiaoming|Liu Yifeng|Xiao Ailing|Duan Yiping|Ge Ning|Liu Shuai

Number: 36-01

Volume: 35

CI03 Correction of invention patent
CB03 Change of inventor or designer information

Inventor after: Tao Xiaoming

Inventor after: Liu Yifeng

Inventor after: Xiao Ailing

Inventor after: Duan Yiping

Inventor after: Ge Ning

Inventor after: Liu Shuai

Inventor before: Tao Xiaoming

Inventor before: Liu Yifeng

Inventor before: Xiao Ailing

Inventor before: Duan Yiping

Inventor before: Ge Ning

CB03 Change of inventor or designer information