CN104185050A - OTT television based intelligent remote control system and control method thereof - Google Patents

OTT television based intelligent remote control system and control method thereof Download PDF

Info

Publication number
CN104185050A
CN104185050A CN201410371357.0A CN201410371357A CN104185050A CN 104185050 A CN104185050 A CN 104185050A CN 201410371357 A CN201410371357 A CN 201410371357A CN 104185050 A CN104185050 A CN 104185050A
Authority
CN
China
Prior art keywords
remote control
prime
ott
main controller
control sheet
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410371357.0A
Other languages
Chinese (zh)
Inventor
张钦宇
林威
汪翠
田彬
刘昆
张绍君
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Graduate School Harbin Institute of Technology
Original Assignee
Shenzhen Graduate School Harbin Institute of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Graduate School Harbin Institute of Technology filed Critical Shenzhen Graduate School Harbin Institute of Technology
Priority to CN201410371357.0A priority Critical patent/CN104185050A/en
Publication of CN104185050A publication Critical patent/CN104185050A/en
Pending legal-status Critical Current

Links

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The invention provides an OTT television based intelligent remote control system and a control method thereof. The control system comprises a remote control sheet and an OTT box thereof, wherein the remote control sheet comprises an MCU, a triaxial accelerometer sensor, a triaxial gyroscope sensor, a triaxial magnetometer sensor and a Bluetooth sending module, and the MCU is connected with the triaxial accelerometer sensor, the triaxial gyroscope sensor, the triaxial magnetometer sensor and the Bluetooth sending module; and the OTT box comprises a control chip and a Bluetooth receiving module that is connected with the control chip. According to the OTT television based intelligent remote control system and the control method thereof, traditional mechanical buttons are not required; voice identification is integrated with gesture identification, so that voice input is realized, and movement of a screen cursor as well as a series of gestures in different complexity are controlled by the sensors; and thus, the contents are more abundant.

Description

Intelligent remote control system based on OTT TV and control method thereof
Technical field
The present invention relates to communication technical field, relate in particular to a kind of intelligent remote control system and control method thereof based on OTT TV.
Background technology
OTT box is a small-sized computing terminal equipment, it is connected with traditional tv by technology such as HDMI or color difference lines as long as simple, just can on traditional tv, realize web page browsing, Internet video broadcasting, application program installation, even the photo in mobile phone, flat board and video can be projected in the middle of the large screen television in getting home.OTT box must use by matched remote controller, and at present traditional remote control mode mainly contains two kinds: a kind of is button infrared remote controller based on traditional, and one is based on handset remote controller app.Handset remote controller app realizes by the mode of analogue-key, and it is upper is the same with traditional remote controller, and this mechanical key mode is relatively poor in user's experience.Given this, people start the thinking mode of body sense and replace traditional remote controller, at present emerging flying squirrel remote controller has substantially been realized and is utilized the motion of remote controller to realize the control that it moves as cursor on internet television screen on the market, and in somatic sensation television game, serve as game paddle, but this flying squirrel remote controller only can be realized its movement on screen as cursor, and Operational Figure Of Merit is not high, and the remote controller of prior art cannot be realized the identification of gesture, cannot make OTT box carry out corresponding operational order according to the motion state of remote controller.
In sum, traditional remote controller is based on button principle, the too mechanization of its mode of operation; Although existing body sense remote controller can be realized the control of cursor, because the Mobile data of controlling cursor exists larger error, therefore, operate sensitively not, experience poor; And existing body sense remote controller cannot realize the identification of gesture, user embodies not good.
Summary of the invention
The object of the invention is to solve the defect that above-mentioned prior art exists, provide one not only can precisely control cursor movement, can also realize the OTT intelligence box remote control sheet of gesture identification.
Based on an intelligent remote control system for OTT TV, comprise remote control sheet and OTT box thereof;
3 axle acceleration flowmeter sensors, 3 axle gyro sensors, 3 axle magnetometer sensor, bluetooth sending module, capacitor type touch switch, LED light, battery voltage detection circuit, MIC voice input module that described remote control sheet comprises MCU main controller, is connected respectively with MCU main controller;
The bluetooth receiver module that described OTT box comprises control chip, is connected with control chip.
Further, the intelligent remote control system based on OTT TV as above, described remote control sheet comprises MIC voice input module, described MIC voice input module is connected with MCU main controller.
Further, the intelligent remote control system based on OTT TV as above, described remote control sheet comprises battery voltage detection circuit, described MCU main controller is connected with battery voltage detection circuit.
Further, the intelligent remote control system based on OTT TV as above, described OTT box comprises camera, described camera is connected with control chip.
An intelligent remote control system control method based on OTT TV, adopts complementary filter method to revise the data of 3 axle gyro sensors, specifically comprises the following steps:
(1), MCU main controller is according to the motion state of remote control sheet, obtains respectively the original measurement value of 3 axis accelerometers, 3 axle gyroscopes, 3 axle magnetometers, wherein a 0 (x, y, z)represent 3-axis acceleration original measurement value, g 0 (x, y, z)represent three axis angular rate original measurement values, m 0 (x, y, z)represent three-axle magnetic field original measurement value;
(2), MCU main controller is according to the original measurement value a obtaining 0 (x, y, z), g 0 (x, y, z), m 0 (x, y, z)calculate the value after normalization, be expressed as a x, y, z, g x, y, z, m x, y, z;
(3), MCU main controller is according to a x, y, z, g x, y, z, m x, y, zerror of calculation vector e x, y, z,
e x = ( a y * v z - a z * v y ) + ( m y * w z - m z * w y ) e y = ( a z * v x - a x * v z ) + ( m z * w x - m x * w z ) e z = ( a x * v y - a y * v x ) + ( m x * w y - m y * w x ) - - - ( 1 ) ;
In formula, v x, y, zfor acceleration reference vector, the gravitational unit's vector under geographic coordinate system is transformed into the value after body axis system, and establishing the vector representation of current time hypercomplex number is Q=q 0+ q 1i+q 2j+q 3k, wherein hypercomplex number q 0, q 1, q 2, q 3be initialized as respectively 1,0,0,0, v x, y, zcomputing formula is as follows:
v x = 2 * ( q 1 q 3 - q 0 q 2 ) v y = 2 * ( q 0 q 1 + q 3 q 2 ) v z = q 0 q 0 - q 1 q 1 - q 2 q 2 + q 3 q 3 - - - ( 2 ) ;
W x, y, zfor magnetic field reference vector, be that the magnetic field unit vector under geographic coordinate system is transformed into the value after body axis system, the magnetic field unit vector under geographic coordinate system is made as b x, y, z, computing formula is as follows:
b x = ( 2 m z ( q 1 q 3 + q 0 q 2 ) + 2 m y ( q 2 q 1 - q 0 q 3 ) + 2 m x ( 0.5 - q 3 q 3 - q 2 q 2 ) ) 2 + ( 2 m z ( q 2 q 3 - q 0 q 1 ) + 2 m x ( q 2 q 1 + q 0 q 3 ) + 2 m y ( 0.5 - q 1 q 1 - q 3 q 3 ) ) 2 b y = 0 b z = 2 m x ( q 1 q 3 - q 0 q 2 ) + 2 m y ( q 2 q 3 + q 0 q 1 ) + 2 m z ( 0.5 - q 1 q 1 - q 2 q 2 ) - - - ( 3 ) ;
w x = 2 b x ( 0.5 - q 3 q 3 - q 2 q 2 ) + 2 b z ( q 1 q 3 - q 0 q 2 ) w y = 2 b x ( q 1 q 2 - q 0 q 3 ) + 2 b z ( q 1 q 0 + q 3 q 2 ) w z = 2 b x ( q 1 q 3 + q 0 q 2 ) + 2 b z ( 0.5 - q 1 q 1 - q 2 q 2 ) - - - ( 4 ) ;
(4), MCU main controller utilizes error vector e x, y, zgyro data is carried out to filtering, obtain revised three axis angular rate measured values, be expressed as g ' 0 (x, y, z),
g 0 x ′ = g 0 x + K p * e x + e x Int + e x * K i * T / 2 g 0 y ′ = g 0 y + K p * e y + e y Int + e y * K i * T / 2 g 0 z ′ = g 0 z + K p * e z + e z Int + e z * K i * T / 2 - - - ( 5 ) ;
In formula, e x, y, zint is three-axis gyroscope error intergal, and T is the sampling interval, constant coefficient K irepresent to control the storage gain of gyroscope zero inclined to one side rate of convergence, K prepresent to control the proportional gain of accelerometer and magnetometer rate of convergence.
Further, the intelligent remote control system control method based on OTT TV as above, it comprises the following steps:
(1) the magnitude of angular velocity g ' that, MCU main controller obtains according to complementary filter method 0 (x, y, z)the displacement Δ x of screen cursor on x axle and the mobile Δ y in Y-axis in calculating sampling interval T on display screen
Δx = g 0 z ′ * speed _ mode Segmentations * control _ sensitivity Δy = g 0 y ′ * speed + mode Segmentations * control _ sensitivity - - - ( 6 ) ;
Wherein speed_mode and Segmentations are the predefine constants of sensor fusion algorithm, and control_sensitivity represents gyroscope sensitivity;
(2), by screen cursor, the displacement Δ x on x axle, the screen cursor mobile Δ y in Y-axis sends to the bluetooth receiver module of OTT box to MCU main controller by bluetooth sending module, the control chip of OTT box is carried out the relative displacement distance of remote control sheet on screen according to the Δ x, the Δ y that receive.
Further, the intelligent remote control system control method based on OTT TV as above, comprises the following steps:
(1), user's hand-held remote control sheet marks a gesture aloft, the three-axis gyroscope transducer of remote control sheet is exported original three axis angular rate measured value g according to the motion state of this remote control sheet 0 (x, y, z);
(2), MCU main controller utilizes complementary filter method to g 0 (x, y, z)carry out filtering processing, obtain g ' 0 (x, y, z);
(3), MCU main controller is according to g ' 0 (x, y, z)utilize quaternion differential equation to upgrade and obtain hypercomplex number differential
q · 0 q · 1 q · 2 q · 3 = 1 2 0 - g 0 x ′ - g 0 y ′ - g 0 z ′ g 0 x ′ 0 g 0 z ′ - g 0 y ′ g 0 y ′ - g 0 z ′ 0 g 0 x ′ g 0 z ′ g 0 y ′ - g 0 x ′ 0 q 0 q 1 q 2 q 3 - - - ( 7 ) ;
(4), MCU main controller will obtain the hypercomplex number q under current time after the above results integration 0,1,2,3thereby, carry out attitude algorithm, obtain 3 attitude angle, i.e. course angles roll angle λ, pitching angle theta,
(5), MCU main controller is sent to OTT box by roll angle λ through bluetooth, control chip calculates roll angle variation delta λ in gesture time of origin, judge in the time of-180 ° of < Δ λ <-90 ° left-handed, in the time of 180 ° of 90 ° of < Δ λ <, be dextrorotation, and carry out the corresponding command according to result of determination.
Further, the intelligent remote control system control method based on OTT TV as above, comprises the following steps:
(1), user's hand-held remote control sheet marks a gesture aloft, each transducer of remote control sheet is exported original 3-axis acceleration measured value a according to the movement locus of this remote control sheet 0 (x, y, z), three axis angular rate measured value g 0 (x, y, z), three-axle magnetic field measured value m 0 (x, y, z);
(2), MCU main controller is according to a 0 (x, y, z), g 0 (x, y, z), m 0 (x, y, z)calculate the magnitude of angular velocity g ' after complementary filter 0 (x, y, z), bluetooth sending module is by g ' 0 (x, y, z)and 3-axis acceleration measured value a 0 (x, y, z)radio to OTT box;
(3), the acceleration a of the control chip of OTT box based on receiving 0 (x, y, z)with angular speed g ' 0 (x, y, z), realize the identification of complicated gesture or realize the function of remote control sheet as somatic sensation television game handle.
An intelligent remote control system control method based on OTT TV, comprises the following steps:
(1), user's hand-held remote control sheet marks a gesture aloft, the 3-axis acceleration sensor of remote control sheet is exported original 3-axis acceleration measured value a according to the motion state of this remote control sheet 0 (x, y, z);
(2), MCU main controller utilizes hypercomplex number by a 0 (x, y, z)be transformed into geographic coordinate system a ' from body axis system 0 (x, y, z), conversion formula is:
a 0 x &prime; a 0 y &prime; a 0 z &prime; = Q * a 0 x a 0 y a 0 z * Q * - - - ( 9 ) ;
(3), MCU main controller is by a ' 0 (x, y, z)send to OTT box by blue teeth wireless, control chip is according to a ' 0 (x, y, z)compare with a predefined threshold value, judge the direction of motion of remote control sheet according to comparative result, then carry out corresponding order according to the direction of motion; Described threshold value comprises upper and lower 6 directions corresponding interval respectively all around.
An intelligent remote control system control method based on OTT TV, comprises () following steps:
(1) the MIC voice input module, on remote control sheet gathers the voice messaging of user's input, and it is carried out to analog-to-digital conversion, and the voice messaging after conversion is sent to OTT box by bluetooth sending module;
(2), the voice messaging receiving and the sound bank being pre-stored in memory in advance carry out template matches by OTT box control chip, find out corresponding voice, thereby carry out corresponding instruction.
Intelligent remote control system and control method thereof based on OTT TV provided by the invention, due to integrated 3 axle acceleration flowmeter sensors, 3 axle gyro sensors and 3 axle magnetometer sensor on remote control sheet, first on MCU main controller, utilize complementary filter technology to eliminate gyrostatic error, based on sensing data after treatment, realize more accurate remote control again.Intelligent remote control system based on OTT TV provided by the invention can be controlled the movement of screen cursor, identify a series of simple to complicated gesture, also support voice input, can serve as game paddle, on the basis of external camera, can also realize reality and strengthen, thereby make remote controller further realize abundanter content.In addition, the small and exquisite exquisiteness of remote control sheet outward appearance of the present invention, can be hand-held, also can be buckled on supporting bracelet or finger ring and use, and further improved user's experience.
Brief description of the drawings
Fig. 1 is the intelligent remote control system structural representation that the present invention is based on OTT TV;
Fig. 2 is OTT box intelligent distant control sheet vertical view of the present invention;
Fig. 3 is OTT box intelligent distant control sheet stereogram of the present invention;
Fig. 4 is speech recognition schematic diagram;
Fig. 5 is that low-voltage detects schematic diagram.
Embodiment
For making the object, technical solutions and advantages of the present invention clearer, below technical scheme in the present invention be clearly and completely described, obviously, described embodiment is the present invention's part embodiment, instead of whole embodiment.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtaining under creative work prerequisite, belong to the scope of protection of the invention.
Fig. 1 is the intelligent remote control system structural representation that the present invention is based on OTT TV, and as shown in Figure 1, the intelligent remote control system based on OTT TV provided by the invention, comprises remote control sheet and OTT box thereof;
3 axle acceleration flowmeter sensors, 3 axle gyro sensors, 3 axle magnetometer sensor, bluetooth sending module, capacitor type touch switch, LED light that described remote control sheet comprises MCU main controller, is connected respectively with MCU main controller;
The bluetooth receiver module that described OTT box comprises control chip, is connected with control chip, described bluetooth receiver module is corresponding with the bluetooth sending module of remote control Embedded.
Intelligent distant control based on OTT TV provided by the invention, due to simultaneously integrated 3 axle acceleration flowmeter sensors, 3 axle gyro sensors and 3 axle magnetometer sensor on described remote control sheet, the MCU main controller of remote control sheet is measured respectively former starting acceleration a according to 3 axle acceleration flowmeter sensors, 3 axle gyro sensors and 3 axle magnetometer sensor 0 (x, y, z), angular speed g 0 (x, y, z), and magnetic-field measurement value m 0 (x, y, z), and adopt the initial data g of the measurement of complementary filter technology to 3 axle gyro sensors 0 (x, y, z)revise, then by revised angular speed g ' (0x, y, z)send to OTT box by bluetooth sending module, the control chip of OTT box is according to g ' 0 (x, y, z)and other sensor measurements data out realize following energy:
1, realize based on filtered magnitude of angular velocity the control that screen cursor moves;
Particularly, the utilization of MCU main controller adopts the angular speed g ' after filter correction 0 (x, y, z)calculate in a sampling interval T, the displacement Δ x of screen cursor on x axle and the mobile Δ y in Y-axis, then, MCU main controller is the displacement Δ x on x axle by screen cursor, the mobile Δ y of screen cursor in Y-axis sends to the bluetooth receiver module of OTT box by bluetooth sending module, the control chip of OTT box is according to the Δ x receiving, Δ y carries out the relative displacement distance of remote control sheet on screen, thereby, user just can see the movement of cursor on screen, because the present invention has adopted complementary filter technology, therefore, the movement of cursor is more accurately sensitive.
2, before and after realizing up and down based on accekeration, the identification of 6 direction simple gesture, realizes the identification of 2 direction simple gesture of left-handed dextrorotation based on filtered magnitude of angular velocity, then carries out corresponding order according to the motion of these 8 directions.
Particularly, user's hand-held remote control sheet marks a gesture aloft, and the 3-axis acceleration sensor of remote control sheet is exported original 3-axis acceleration measured value a according to the motion state of this remote control sheet 0 (x, y, z); , MCU main controller utilizes hypercomplex number by a 0 (x, y, z)be transformed into geographic coordinate system a ' from body axis system 0 (x, y, z), MCU main controller is by a ' 0 (x, y, z)send to OTT box by blue teeth wireless, (this threshold value comprises the threshold values of upper and lower 6 directions all around to a threshold value that OTT box is pre-stored, each threshold values is respectively equipped with a corresponding interval at x, y, z axle), OTT box is received to a ' 0 (x, y, z)compare with the interval threshold value of respective coordinates axle, then judge the direction of motion of remote control sheet according to comparative result, then the control chip of OTT box is carried out corresponding order according to the direction of motion of judging.
3, based on accekeration and filtered magnitude of angular velocity, utilize existing complicated Gesture Recognition to carry out complicated gesture identification, user can be the different self-defined corresponding fill order of gesture.
4, be used as the input value of somatic sensation television game based on accekeration, magnetic field value and filtered magnitude of angular velocity, make remote control sheet serve as the role of game paddle.
Particularly, the realization of this function comprises the following steps:
(1) user's hand-held remote control sheet marks a gesture aloft, and each transducer of remote control sheet is exported original 3-axis acceleration measured value a according to the movement locus of this remote control sheet 0 (x, y, z), three axis angular rate measured value g 0 (x, y, z), three-axle magnetic field measured value m 0 (x, y, z);
(2) MCU main controller is according to a 0 (x, y, z), g 0 (x, y, z), m 0 (x, y, z)calculate the magnitude of angular velocity g ' after complementary filter 0 (x, y, z), bluetooth sending module is by g ' 0 (x, y, z)and 3-axis acceleration measured value a 0 (x, y, z)radio to OTT box;
(3) the acceleration a of the control chip of OTT box based on receiving 0 (x, y, z)with angular speed g ' 0 (x, y, z), realize the identification of complicated gesture or realize the function of remote control sheet as somatic sensation television game handle.
Further, in order to improve for embodying, the present invention is on the basis of the intelligent remote control system of described OTT TV, and described remote control sheet comprises battery voltage detection circuit, and described MCU main controller is connected with battery voltage detection circuit.Described OTT box comprises camera, and described camera is connected with control chip.
Fig. 5 is that low-voltage detects schematic diagram, and as shown in Figure 5, remote control sheet main controller has the A/D convertor circuit that battery electric quantity detects, by its battery alarm voltage value of programming and low-voltage sleep value.The voltage value obtaining when detection is during lower than low-voltage alarming value, and remote control sheet is by allowing the indicator light reminding user battery electric quantity deficiency of glimmering.The voltage value obtaining when detection is during lower than low pressure sleep value, remote control sector-meeting sleep mode automatically, and before sleep, bright a period of time of indicator light president, charges with reminding user.
The present invention utilizes MIC voice input module to gather user speech input message, and is sent in OTT box, utilizes existing speech recognition technology to identify user speech.When in the situation of the external camera of OTT box, can carry out picture catching and location to remote control sheet, the display mode on screen changes and controls to remote control sheet to utilize existing real enhancing technology.In order to realize the wireless transmission of remote control sheet and OTT box, the present invention adopts Bluetooth technology to carry out transfer of data.In order to improve the flying power of remote control sheet, the present invention adds managing electric quantity mechanism in remote control sheet.
OTT box intelligent distant control sheet outward appearance exquisiteness, only has dial plate size, and not additional any mechanical key, can be hand-held, also can be buckled on supporting bracelet or finger ring, carries out remote control as intelligent wearable device.Integrated 9 axle sensor modules, microprocessor, bluetooth module, microphone, LED light, battery voltage detection circuit and a capacitor type touch switch on it, under remote control sheet resting state, touch this switch and can wake remote control sheet up, in working order, touch this switch and can enter main menu by a key, be equivalent to " home " key.
As shown in Figure 1, as shown in Figure 2,3, wherein in the middle of remote control sheet top layer, recessed portion is soft-touch control to appearance design 3D effect figure for OTT box intelligent distant control sheet and OTT box hardware block diagram, and surrounding is indicator light floodlight district.
The present invention also provides a kind of intelligent remote control system control method based on OTT TV.
Particularly, 9 axle sensors comprise the 3 axle acceleration flowmeter sensors for acceleration measurement, for 3 axle gyro sensors of measured angular speed, with the 3 axle magnetometer sensor for measuring magnetic field, what 3 axle acceleration flowmeter sensors and 3 axle gyro sensors were measured is acceleration and the angular speed of transducer (namely remote control sheet), what 3 axle gyro sensors were measured is the residing earth magnetic field of remote control sheet, due to gyroscope survey to rudimentary horn speed contain drift error, if directly application is to cause larger error, therefore, first need MCU main controller to carry out filtering to rudimentary horn speed, the present invention adopts complementary filter technology to revise angular speed, concrete implementation step is as follows:
(1), MCU main controller is according to the motion state of remote control sheet, obtains respectively the original measurement value of 3 axis accelerometers, 3 axle gyroscopes, 3 axle magnetometers, wherein a 0 (x, y, z)represent 3-axis acceleration original measurement value, g 0 (x, y, z)represent three axis angular rate original measurement values, m 0 (x, y, z)represent three-axle magnetic field original measurement value;
(2), MCU main controller is according to the original measurement value a obtaining 0 (x, y, z), g 0 (x, y, z), m 0 (x, y, z)calculate the value after normalization, be expressed as a x, y, z, g x, y, z, m x, y, z;
(3), MCU main controller is according to a x, y, z, g x, y, z, m x, y, zerror of calculation vector e x, y, z,
e x = ( a y * v z - a z * v y ) + ( m y * w z - m z * w y ) e y = ( a z * v x - a x * v z ) + ( m z * w x - m x * w z ) e z = ( a x * v y - a y * v x ) + ( m x * w y - m y * w x ) - - - ( 1 ) ;
In formula, v x, y, zfor acceleration reference vector, the gravitational unit's vector under geographic coordinate system is transformed into the value after body axis system, and establishing the vector representation of current time hypercomplex number is Q=q 0+ q 1i+q 2j+q 3k (wherein hypercomplex number q 0, q 1, q 2, q 3be initialized as respectively 1,0,0,0), v x, y, zcomputing formula is as follows:
v x = 2 * ( q 1 q 3 - q 0 q 2 ) v y = 2 * ( q 0 q 1 + q 3 q 2 ) v z = q 0 q 0 - q 1 q 1 - q 2 q 2 + q 3 q 3 - - - ( 2 ) ;
W x, y, zfor magnetic field reference vector, be that the magnetic field unit vector under geographic coordinate system is transformed into the value after body axis system, the magnetic field unit vector under geographic coordinate system is made as b x, y, z, computing formula is as follows:
b x = ( 2 m z ( q 1 q 3 + q 0 q 2 ) + 2 m y ( q 2 q 1 - q 0 q 3 ) + 2 m x ( 0.5 - q 3 q 3 - q 2 q 2 ) ) 2 + ( 2 m z ( q 2 q 3 - q 0 q 1 ) + 2 m x ( q 2 q 1 + q 0 q 3 ) + 2 m y ( 0.5 - q 1 q 1 - q 3 q 3 ) ) 2 b y = 0 b z = 2 m x ( q 1 q 3 - q 0 q 2 ) + 2 m y ( q 2 q 3 + q 0 q 1 ) + 2 m z ( 0.5 - q 1 q 1 - q 2 q 2 ) - - - ( 3 ) ;
w x = 2 b x ( 0.5 - q 3 q 3 - q 2 q 2 ) + 2 b z ( q 1 q 3 - q 0 q 2 ) w y = 2 b x ( q 1 q 2 - q 0 q 3 ) + 2 b z ( q 1 q 0 + q 3 q 2 ) w z = 2 b x ( q 1 q 3 + q 0 q 2 ) + 2 b z ( 0.5 - q 1 q 1 - q 2 q 2 ) - - - ( 4 ) ;
(4), MCU main controller utilizes error vector e x, y, zgyro data is carried out to filtering, obtain revised three axis angular rate measured values, be expressed as g ' 0 (x, y, z),
g 0 x &prime; = g 0 x + K p * e x + e x Int + e x * K i * T / 2 g 0 y &prime; = g 0 y + K p * e y + e y Int + e y * K i * T / 2 g 0 z &prime; = g 0 z + K p * e z + e z Int + e z * K i * T / 2 - - - ( 5 )
In formula, e x, y, zint is three-axis gyroscope error intergal, and T is the sampling interval, constant coefficient K irepresent to control the storage gain of gyroscope zero inclined to one side rate of convergence, K prepresent to control the proportional gain of accelerometer and magnetometer rate of convergence.
Based on the above-mentioned correction-compensation to angular speed, the present invention also provides the method for controlling screen cursor movement.
Particularly, the movement of cursor only need to be used the gyro sensor data of both direction, wherein, and filtered angular speed g ' 0zrepresent course angle rate of change, determine screen cursor displacement Δ x on x axle within the T time interval, filtered angular speed g ' with this 0yrepresent angle of pitch rate of change, determine screen cursor mobile Δ y in Y-axis within the T time interval with this, can determine Δ x according to the proportionate relationship between displacement and angular speed, y thus:
&Delta;x = g 0 z &prime; * speed _ mode Segmentations * control _ sensitivity &Delta;y = g 0 y &prime; * speed + mode Segmentations * control _ sensitivity - - - ( 6 )
This formula is that the quantitative ratio of angular speed and cursor movement is related to computing formula, and wherein speed_mode and Segmentations are the predefine constants of sensor fusion algorithm, and control_sensitivity represents gyroscope sensitivity.
The present invention also provides a kind of and has known method for distinguishing about predefined simple gesture, comprises the identification of 8 simple gesture directions of motion containing predefined simple gesture identification, up and down before, and left-handed dextrorotation.
The judgement of the direction that 1. seesaws up and down
The acceleration of three axles is set to respective threshold and can judge the direction (up and down) that user's gesture moves, accekeration is carried out to integration and can also calculate gesture mobile displacement in space, if by gesture motion track be presented in real time on screen, can realize on screen make marks, picture etc.
The function of 6 moving directions of predefine is as follows:
Upper: after channel selection menu ejects, for increasing television channel number, the increase of channel number becomes certain ratio with displacement, be increased to till upwards gesture stops;
Under: after channel selection menu ejects, for reducing television channel number, the reducing of channel number becomes certain ratio with displacement, till being reduced to downward gesture and stopping;
Left: in screen, content is moved to the left (rolling);
When video display, music, reduce volume till gesture stops, the reducing of volume becomes certain ratio with displacement;
When electronic bits of data reading or PPT demo mode, page turning left;
Right: content move right (rolling) in screen;
When video display, music, increase volume till gesture stops, the increase of volume becomes certain ratio with displacement;
When electronic bits of data reading or PPT demo mode, page turning to the right;
Before: the amplifications such as picture, word are until gesture stops, and magnification ratio becomes certain ratio with displacement;
Rear: picture, word etc. dwindles until gesture stops, reduce in scale becomes certain ratio with displacement;
While realization, first utilize hypercomplex number that 3-axis acceleration vector is transformed into geographic coordinate system from body axis system, then according to a ' 0 (x, y, z)judge remote control sheet moving direction (as shown in table 1).
MCU main controller utilizes hypercomplex number by a 0 (x, y, z)be transformed into geographic coordinate system a ' from body axis system 0 (x, y, z), conversion formula is:
a 0 x &prime; a 0 y &prime; a 0 z &prime; = Q * a 0 x a 0 y a 0 z * Q * - - - ( 9 ) ;
Table 1 is the basis for estimation of front and back up and down
By a ' calculating 0xyzxthe table of comparisons 1, can judge is the motion of that direction of front and back up and down, and then carries out corresponding order according to the direction of motion.
2. direction of rotation judgement
Remote control sheet MCU main controller carries out attitude algorithm according to filtered angular speed and obtains three attitude angle (course angles roll angle λ, pitching angle theta), can carry out the judgement of 2 direction of rotation (left-handed, dextrorotation) to OTT box through Bluetooth transmission, basis for estimation is as shown in table 2, and the function of 2 rotations of predefine is as follows:
Dextrorotation: TV is closed down, dextrorotation represents start once;
Under open state, dextrorotation represents " determining " once;
Left-handed: the in the situation that of main menu, confirmation frame is closed in left-handed ejection once, and shutdown, the left-handed main menu that returns are confirmed in now dextrorotation;
In non-main menu situation, left-handed expression " returning " once;
While realization, first upgrade hypercomplex number derivative according to quaternion differential equation
q &CenterDot; 0 q &CenterDot; 1 q &CenterDot; 2 q &CenterDot; 3 = 1 2 0 - g 0 x &prime; - g 0 y &prime; - g 0 z &prime; g 0 x &prime; 0 g 0 z &prime; - g 0 y &prime; g 0 y &prime; - g 0 z &prime; 0 g 0 x &prime; g 0 z &prime; g 0 y &prime; - g 0 x &prime; 0 q 0 q 1 q 2 q 3 - - - ( 7 )
After integration, obtain the hypercomplex number q under current time 0,1,2,3, the relation between recycling hypercomplex number and coordinate conversion matrix, between coordinate conversion matrix and attitude angle is carried out attitude algorithm, shown in following formula:
Because left-handed dextrorotation is only relevant with roll angle, regulation roll angle threshold value is as follows:
The basis for estimation of the left-handed dextrorotation of table 2
Direction of rotation Threshold value
Left-handed -180°<Δλ<-90°
Dextrorotation 90°<Δλ<180°
In table 2, Δ λ represents the variable quantity of roll angle in gesture motion time of origin.
The present invention also provides the method for the complicated gesture identification can customize, and particularly, is similar to coding principle, and user can be set as shortcut a series of more complicated gesture according to the hobby of oneself and open fast some application.Because complicated gesture identification needs real-time calculating and the storage of large amount of complex, on remote control sheet, cannot complete merely, therefore need the sensing data of eliminating after error to arrive OTT box by Bluetooth transmission, in box, carry out.The recognition technology of existing complicated gesture can realize by the wherein one in 3 kinds of modes that provide below.Method one: based on HMM; Method two: based on input method; Method three: in conjunction with voice.While realization, first degree of will speed up and filtered angular speed send to OTT box to remote control sheet MCU, OTT box is again based on these data, utilize existing complicated Gesture Recognition to realize the identification of complicated gesture, the detailed principle of existing complicated Gesture Recognition will repeat no more.
One, the complicated gesture identification based on recessive Markov model (HMM)
The application of recessive Markov model (Hidden Markov Model-HMM) in speech recognition is quite ripe, because gesture sequence is very similar with voice sequence, therefore HMM is also used in gesture identification gradually, and has obtained higher accuracy of identification.
The complicated gesture identification method of HMM:
Step 1: what a gesture storehouse of precondition is stored in OTT box, these gestures have comprised numeral 012 ... 9 and English lower case abc ..., and some special figures (for example: love, make hook, question mark ...), the corresponding a kind of HMM model λ of each gesture;
Step 2: user can be the self-defined shortcut function of each gesture (for example love represents to play at once favorite television channel), and user inputs corresponding gesture, remote control sheet sends to OTT box acceleration and filtered angular speed;
Step 3: OTT box control chip is based on these data, utilizes HMM algorithm to calculate the probability that in gesture storehouse, each model occurs, maximum probability be the gesture that user makes;
The method of the complicated gesture identification based on input method
Certain current OTT box all carries or input method can be installed, most of input method (as search dog input method etc.) be all based on image processing techniques, carry out fuzzy diagnosis according to final image, in literal pool, finding out all close words provides user to select.After user has inputted gesture, remote control sheet sends to OTT box sensing data, and control chip is inputted data again as input method, identifies corresponding gesture.
In conjunction with the method for the complicated gesture identification of voice
Speech data is sent to OTT box by remote control sheet, and speech recognition software finds corresponding word to show from sound bank.
The present invention utilizes remote controller to realize the method for somatic sensation television game
Angular velocity data after remote control sheet degree of will speed up, magnetic field and filtering sends to OTT box by bluetooth, and somatic sensation television game program calculates the corresponding actions of these data representatives, for it sets corresponding game order.
The present invention utilizes remote controller to realize the method for speech recognition
Bluetooth sends the speech input information of remote control sheet to OTT box, and control chip carries out sound template and mates the voice that can identify user.Fig. 4 is speech recognition schematic diagram, intelligent distant control sheet has voice input module, can gather user's speech data, through AD analog-to-digital conversion, send to the processing unit in OTT box by bluetooth module, thereby parse user's usual instructions and carry out associative operation, such as zapping, volume increase and decrease, switching on and shutting down, entering PPT demo mode, enter somatic sensation television game etc.Coordinate gesture identification function by voice recognition processing, user can realize the beginning of gesture and confirm operation, has saved the traditional operations such as button.Speech data can also do other and process, and as by loud speaker sounding, sends to server by network, carries out other function treatment.
Voice collecting
Before sampling and quantizing, must carry out the pre-filtering of speech signal.The object of pre-filtering is that particularly filtering is higher than the composition of 1/2 sample frequency in order to prevent high-frequency noise.The band pass filter of design, upper limiting frequency is 3400Hz, lower frequency limit is 60Hz.Be converted to again binary audio digital signals of 16 by A/D.After coding, sending to OTT box processing center by bluetooth module identifies or other processing.
Speech recognition process
Voice input signal in OTT box intelligent distant control sheet is sent to and in OTT box, carries out speech recognition through bluetooth.What when processing, adopt is unspecified person isolated word recognition mode, and an independent entry be can be regarded as in each word or phrase in vocabulary, add the usual instructions model library having trained on OTT box.Therefore, user only need to face toward remote control sheet, says conventional instruction as start, shutdown, and sound subtracts, and sound adds, and confirms, returns etc., and the processing center of OTT box is by the feature extraction of voice, and the estimation of the coupling of ATL, draws court verdict.So just can realize various phonetic orders has operated.
The present invention utilizes remote control sheet to realize the method that reality strengthens
In the time of the external camera of OTT box, can carry out picture catching and location to remote control sheet, utilize existing real enhancing technology to realize the remote control sheet in picture is become to another article.For example become a handful flower, a teapot, one sword etc., reaches magical AR effect.
Bluetooth communication
Integrated with Bluetooth module on remote control sheet and OTT box, sets up the function that just can realize data wireless on remote control sheet after network successful matching and be transferred to OTT box.If remote control sheet a period of time does not have operational motion automatically to enter resting state, drive bluetooth also to enter dormancy, until user touches capacitance switch, wake MCU up, MCU drives bluetooth to wake up, thereby carries out other functions.
Data on remote control sheet will be sent to after box, could generate command adapted thereto, complete corresponding operating.Because Bluetooth technology is data information and voice messaging simultaneously, there is the advantages such as easy to use, antijamming capability is strong, low in energy consumption, radiation is low, this technology employing integrated with Bluetooth module in remote control sheet and OTT box realizes the transmission of wireless data.
By the Basic Topological piconet (Piconet) of bluetooth, OTT box is as main equipment (Master), can accept the control of 7 remote control sheets in state of activation at the most simultaneously, realize both hands or many people and control video screen simultaneously or realize many people athletic game etc.For different transferring contents, bluetooth is used different agreement:
Pass voice messaging by A2DP agreement, headset profile (Headset Profile), handsfree protocol (Hands-Free Profile) etc., can realize very easily the voice transfer between remote control sheet and OTT box, also ensure the confidentiality of voice messaging simultaneously.
By SPP protocol transmission data message, to the different COS of main frame application, distinguish these different COS by the Report ID (being Property ID) of self-defining by SDP agreement.
The bluetooth module groundwork state of OTT box intelligent distant control sheet comprises following 4 kinds:
Sleep state: in sleep state, Bluetooth chip power consumption is extremely low, while being waken up, if there has been the information of reconnecting (the last host information of pairing with it, comprise BD_Address and Pin Code) and electric weight enough enter the state of reconnecting, otherwise stay at sleep state.
Reconnect state: enter after the state of reconnecting, read the information of reconnecting and attempt reconnecting with the main frame of the last pairing.If reconnected successfully, enter operating state, if repeatedly reconnect failure, reenter sleep state.
Can Discovery Status: under free position, if user presses pairing key, remove that reconnect information and enter can Discovery Status.At this moment main frame OTT box can be found remote controller, and carries out matching operation.
Operating state: carry out normal data transmit-receive in operating state, whether remote control sheet is selected required transducer and module and control and power and select different sniff intervals to reduce power consumption to them according to different message formats.If user does not use remote control sheet for a long time, system can increase the interval of sniff, reduces power consumption, finally can make system enter sleep state.If OTT box main frame initiatively disconnects, system can enter sleep state.If connect unexpected disconnection, system can enter the state of reconnecting.
Power management
In order to improve the flying power of remote control sheet, we are improved the design of remote control sheet.Improved method has two.First method is to improve the capacity of remote control sheet battery, uses rechargeable battery, charges by USB or wireless charging mode, although increased so a little the weight of remote control sheet, has reduced the inconvenience that frequent replacing battery brings, more environmental protection, economy.Second method is to make remote control sheet energy-conservation, reduces the use electric current of remote controller as far as possible, under different operating states and different message format, selects different transducers or module, adjusts the power of give out a contract for a project interval and the radio frequency of bluetooth.
Sleep pattern
In remote control sheet pairing, reconnect failure, or close most functions when long-time unmanned use, enter an extremely low state of power consumption to save battery electric quantity.Meeting following any one condition: match unsuccessfully, reconnect failure, battery electric quantity is low, long-time attonity etc., system will enter sleep state.
Should set waken system GPIO entering before sleep state, system can closure sensor module, and notifies bluetooth controller to enter sleep pattern, and the oikocryst of finally closing chip operation shakes and makes chip enter sleep pattern.In the time of sleep pattern, only there is a low-frequency LPO crystal oscillator for system provides clock, only have capacitive touch switch wake-up interrupts can make system wake-up.
After system is waken up, first can initialization GPIO, timer, voltage detecting ADC etc., after completing initialization, battery is carried out to voltage detecting, if cell voltage is lower than alarm voltage, the LED of remote controller meeting cut-in voltage alarm carrys out reminding user and charges in time, if voltage is lower than shutdown voltage, remote controller can reenter sleep state.After detecting by low pressure, remote controller is attempted reconnecting with server, reconnect failure or Discovery overtime after, remote control sector-meeting enters sleep state again.
Low pressure detects
Fig. 5 is that low-voltage detects schematic diagram, and remote control sheet main controller has the A/D convertor circuit that battery electric quantity detects, by its battery alarm voltage value of programming and low-voltage sleep value.The voltage value obtaining when detection is during lower than low-voltage alarming value, and remote control sheet is by allowing the indicator light reminding user battery electric quantity deficiency of glimmering.The voltage value obtaining when detection is during lower than low pressure sleep value, remote control sector-meeting sleep mode automatically, and before sleep, bright a period of time of indicator light president, charges with reminding user.
Intelligent distant control sheet provided by the invention, except controlling OTT box, also can be in the similar like products such as internet television.
Intelligent distant control sheet provided by the invention is an OTT box intelligent distant control sheet that outward appearance is small and exquisite, and not additional any mechanical key has also added other content of more enriching on the function basis of realizing traditional remote controller in a kind of brand-new mode.On remote control sheet, integrated accelerometer, gyroscope, magnetometer, utilize accelerometer and magnetometer data to compensate gyro data, and the zero drift error can effectively filtering low level bringing to gyroscope, has improved precision to a great extent.Utilize magnitude of angular velocity to be converted to the displacement of cursor on screen two-dimensional space on the one hand, carry out on the other hand a series of simple to complicated gesture identification in conjunction with accekeration, for example up and down, rotation, numeral, special pattern etc., thereby can replace button in traditional remote controller can serve as again the mini game paddle of somatic sensation television game.In addition, remote control sheet is also integrated microphone, thus realize voice control, make operation more simple and direct.
Finally it should be noted that: above embodiment only, in order to technical scheme of the present invention to be described, is not intended to limit; Although the present invention is had been described in detail with reference to previous embodiment, those of ordinary skill in the art is to be understood that: its technical scheme that still can record aforementioned each embodiment is modified, or part technical characterictic is wherein equal to replacement; And these amendments or replacement do not make the essence of appropriate technical solution depart from the spirit and scope of various embodiments of the present invention technical scheme.

Claims (10)

1. the intelligent remote control system based on OTT TV, is characterized in that, comprises remote control sheet and OTT box thereof;
3 axle acceleration flowmeter sensors, 3 axle gyro sensors, 3 axle magnetometer sensor, bluetooth sending module, capacitor type touch switch, LED light, battery voltage detection circuit, MIC voice input module that described remote control sheet comprises MCU main controller, is connected respectively with MCU main controller;
The bluetooth receiver module that described OTT box comprises control chip, is connected with control chip.
2. the intelligent remote control system based on OTT TV according to claim 1, is characterized in that, described remote control sheet comprises MIC voice input module, and described MIC voice input module is connected with MCU main controller.
3. the intelligent remote control system based on OTT TV according to claim 1, is characterized in that, described remote control sheet comprises battery voltage detection circuit, and described MCU main controller is connected with battery voltage detection circuit.
4. the intelligent remote control system based on OTT TV according to claim 1, is characterized in that, described OTT box comprises camera, and described camera is connected with control chip.
5. the intelligent remote control system control method based on OTT TV, is characterized in that, adopts complementary filter method to revise the data of 3 axle gyro sensors, specifically comprises the following steps:
(1), MCU main controller is according to the motion state of remote control sheet, obtains respectively the original measurement value of 3 axis accelerometers, 3 axle gyroscopes, 3 axle magnetometers, wherein a 0 (x, y, z)represent 3-axis acceleration original measurement value, g 0 (x, y, z)represent three axis angular rate original measurement values, m 0 (x, y, z)represent three-axle magnetic field original measurement value;
(2), MCU main controller is according to the original measurement value a obtaining 0 (x, y, z), g 0 (x, y, z), m 0 (x, y, z)calculate the value after normalization, be expressed as a x, y, z, g x, y, z, m x, y, z;
(3), MCU main controller is according to a x, y, z, g x, y, z, m x, y, zerror of calculation vector e x, y, z,
e x = ( a y * v z - a z * v y ) + ( m y * w z - m z * w y ) e y = ( a z * v x - a x * v z ) + ( m z * w x - m x * w z ) e z = ( a x * v y - a y * v x ) + ( m x * w y - m y * w x ) - - - ( 1 ) ;
In formula, v x, y, zfor acceleration reference vector, the gravitational unit's vector under geographic coordinate system is transformed into the value after body axis system, and establishing the vector representation of current time hypercomplex number is Q=q 0+ q 1i+q 2j+q 3k, wherein hypercomplex number q 0, q 1, q 2, q 3be initialized as respectively 1,0,0,0, v x, y, zcomputing formula is as follows:
v x = 2 * ( q 1 q 3 - q 0 q 2 ) v y = 2 * ( q 0 q 1 + q 3 q 2 ) v z = q 0 q 0 - q 1 q 1 - q 2 q 2 + q 3 q 3 - - - ( 2 ) ;
W x, y, zfor magnetic field reference vector, be that the magnetic field unit vector under geographic coordinate system is transformed into the value after body axis system, the magnetic field unit vector under geographic coordinate system is made as b x, y, z, computing formula is as follows:
b x = ( 2 m z ( q 1 q 3 + q 0 q 2 ) + 2 m y ( q 2 q 1 - q 0 q 3 ) + 2 m x ( 0.5 - q 3 q 3 - q 2 q 2 ) ) 2 + ( 2 m z ( q 2 q 3 - q 0 q 1 ) + 2 m x ( q 2 q 1 + q 0 q 3 ) + 2 m y ( 0.5 - q 1 q 1 - q 3 q 3 ) ) 2 b y = 0 b z = 2 m x ( q 1 q 3 - q 0 q 2 ) + 2 m y ( q 2 q 3 + q 0 q 1 ) + 2 m z ( 0.5 - q 1 q 1 - q 2 q 2 ) - - - ( 3 ) ;
w x = 2 b x ( 0.5 - q 3 q 3 - q 2 q 2 ) + 2 b z ( q 1 q 3 - q 0 q 2 ) w y = 2 b x ( q 1 q 2 - q 0 q 3 ) + 2 b z ( q 1 q 0 + q 3 q 2 ) w z = 2 b x ( q 1 q 3 + q 0 q 2 ) + 2 b z ( 0.5 - q 1 q 1 - q 2 q 2 ) - - - ( 4 ) ;
(4), MCU main controller utilizes error vector e x, y, zgyro data is carried out to filtering, obtain revised three axis angular rate measured values, be expressed as g ' 0 (x, y, z),
g 0 x &prime; = g 0 x + K p * e x + e x Int + e x * K i * T / 2 g 0 y &prime; = g 0 y + K p * e y + e y Int + e y * K i * T / 2 g 0 z &prime; = g 0 z + K p * e z + e z Int + e z * K i * T / 2 - - - ( 5 ) ;
In formula, e x, y, zint is three-axis gyroscope error intergal, and T is the sampling interval, constant coefficient K irepresent to control the storage gain of gyroscope zero inclined to one side rate of convergence, K prepresent to control the proportional gain of accelerometer and magnetometer rate of convergence.
6. the intelligent remote control system control method based on OTT TV according to claim 5, is characterized in that, comprises the following steps:
(1) the magnitude of angular velocity g ' that, MCU main controller obtains according to complementary filter method 0 (x, y, z)the displacement Δ x of screen cursor on x axle and the mobile Δ y in Y-axis in calculating sampling interval T on display screen
&Delta;x = g 0 z &prime; * speed _ mode Segmentations * control _ sensitivity &Delta;y = g 0 y &prime; * speed + mode Segmentations * control _ sensitivity - - - ( 6 ) ;
Wherein speed_mode and Segmentations are the predefine constants of sensor fusion algorithm, and control_sensitivity represents gyroscope sensitivity;
(2), by screen cursor, the displacement Δ x on x axle, the screen cursor mobile Δ y in Y-axis sends to the bluetooth receiver module of OTT box to MCU main controller by bluetooth sending module, the control chip of OTT box is carried out the relative displacement distance of remote control sheet on screen according to the Δ x, the Δ y that receive.
7. the intelligent remote control system control method based on OTT TV according to claim 5, is characterized in that, comprises the following steps:
(1), user's hand-held remote control sheet marks a gesture aloft, the three-axis gyroscope transducer of remote control sheet is exported original three axis angular rate measured value g according to the motion state of this remote control sheet 0 (x, y, z);
(2), MCU main controller utilizes complementary filter method to g 0 (x, y, z)carry out filtering processing, obtain g ' 0 (x, y, z);
(3), MCU main controller is according to g ' 0 (x, y, z)utilize quaternion differential equation to upgrade and obtain hypercomplex number differential
q &CenterDot; 0 q &CenterDot; 1 q &CenterDot; 2 q &CenterDot; 3 = 1 2 0 - g 0 x &prime; - g 0 y &prime; - g 0 z &prime; g 0 x &prime; 0 g 0 z &prime; - g 0 y &prime; g 0 y &prime; - g 0 z &prime; 0 g 0 x &prime; g 0 z &prime; g 0 y &prime; - g 0 x &prime; 0 q 0 q 1 q 2 q 3 - - - ( 7 ) ;
(4), MCU main controller will obtain the hypercomplex number q under current time after the above results integration 0,1,2,3thereby, carry out attitude algorithm, obtain 3 attitude angle, i.e. course angles roll angle λ, pitching angle theta,
(5), MCU main controller is sent to OTT box by roll angle λ through bluetooth, control chip calculates roll angle variation delta λ in gesture time of origin, judge in the time of-180 ° of < Δ λ <-90 ° left-handed, in the time of 180 ° of 90 ° of < Δ λ <, be dextrorotation, and carry out the corresponding command according to result of determination.
8. the intelligent remote control system control method based on OTT TV according to claim 5, is characterized in that, comprises the following steps:
(1), user's hand-held remote control sheet marks a gesture aloft, each transducer of remote control sheet is exported original 3-axis acceleration measured value a according to the movement locus of this remote control sheet 0 (x, y, z), three axis angular rate measured value g 0 (x, y, z), three-axle magnetic field measured value m 0 (x, y, z);
(2), MCU main controller is according to a 0 (x, y, z), g 0 (x, y, z), m 0 (x, y, z)calculate the magnitude of angular velocity g ' after complementary filter 0 (x, y, z), bluetooth sending module is by g ' 0 (x, y, z)and 3-axis acceleration measured value a 0 (x, y, z)radio to OTT box;
(3), the acceleration a of the control chip of OTT box based on receiving 0 (x, y, z)with angular speed g ' 0 (x, y, z), realize the identification of complicated gesture or realize the function of remote control sheet as somatic sensation television game handle.
9. the intelligent remote control system control method based on OTT TV, is characterized in that, comprises the following steps:
(1), user's hand-held remote control sheet marks a gesture aloft, the 3-axis acceleration sensor of remote control sheet is exported original 3-axis acceleration measured value a according to the motion state of this remote control sheet 0 (x, y, z);
(2), MCU main controller utilizes hypercomplex number by a 0 (x, y, z)be transformed into geographic coordinate system a ' from body axis system 0 (x, y, z), conversion formula is:
a 0 x &prime; a 0 y &prime; a 0 z &prime; = Q * a 0 x a 0 y a 0 z * Q * - - - ( 9 ) ;
(3), MCU main controller is by a ' 0 (x, y, z)send to OTT box by blue teeth wireless, control chip is according to a ' 0 (x, y, z) compare with a predefined threshold value, judge the direction of motion of remote control sheet according to comparative result, then carry out corresponding order according to the direction of motion; Described threshold value comprises upper and lower 6 directions corresponding interval respectively all around.
10. the intelligent remote control system control method based on OTT TV, (its) is characterised in that, comprises the following steps:
(1) the MIC voice input module, on remote control sheet gathers the voice messaging of user's input, and it is carried out to analog-to-digital conversion, and the voice messaging after conversion is sent to OTT box by bluetooth sending module;
(2), the voice messaging receiving and the sound bank being pre-stored in memory in advance carry out template matches by OTT box control chip, find out corresponding voice, thereby carry out corresponding instruction.
CN201410371357.0A 2014-07-30 2014-07-30 OTT television based intelligent remote control system and control method thereof Pending CN104185050A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410371357.0A CN104185050A (en) 2014-07-30 2014-07-30 OTT television based intelligent remote control system and control method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410371357.0A CN104185050A (en) 2014-07-30 2014-07-30 OTT television based intelligent remote control system and control method thereof

Publications (1)

Publication Number Publication Date
CN104185050A true CN104185050A (en) 2014-12-03

Family

ID=51965739

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410371357.0A Pending CN104185050A (en) 2014-07-30 2014-07-30 OTT television based intelligent remote control system and control method thereof

Country Status (1)

Country Link
CN (1) CN104185050A (en)

Cited By (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104503321A (en) * 2014-12-18 2015-04-08 赵爽 Ultralow-power wireless intelligent control system for body sensing or voice control
CN104699800A (en) * 2015-03-19 2015-06-10 深圳市米家互动网络有限公司 Picture information searching method and system, remote controller and display terminal
CN104773289A (en) * 2015-04-16 2015-07-15 四川理工学院 Internet-of-things-based micro four-rotor aircraft
CN105068650A (en) * 2015-08-11 2015-11-18 王燕军 Real-time motion capturing and interaction game band
CN105224082A (en) * 2015-09-27 2016-01-06 邱少勐 The system failure is sought help warning device in real time
CN105739381A (en) * 2016-02-01 2016-07-06 四川长虹电器股份有限公司 Ring type computing equipment and household electric appliance interaction method and system
CN105824420A (en) * 2016-03-21 2016-08-03 李骁 Gesture recognition method based on acceleration transducer
CN106028107A (en) * 2016-06-20 2016-10-12 昆明理工大学 Wireless English text input system based on accelerometer and gyroscope sensor
CN106127878A (en) * 2016-07-01 2016-11-16 陕西师范大学 A kind of portable check class attendance system and method for RFID based on all-in-one campus card
CN106340171A (en) * 2016-09-13 2017-01-18 上海理工大学 Wireless remote control electrical switch
CN106454465A (en) * 2016-12-01 2017-02-22 北京小米移动软件有限公司 Remote control method and device of remote controller
CN106791518A (en) * 2016-12-22 2017-05-31 深圳Tcl数字技术有限公司 The method and apparatus that intelligent watch controls TV
CN107029422A (en) * 2017-06-06 2017-08-11 西安蝴蝶网络科技有限公司 A kind of arm motion tracks of device and its motion capture method
CN107209587A (en) * 2014-09-30 2017-09-26 Dav公司 Control device and method for motor vehicles
CN107318035A (en) * 2017-05-04 2017-11-03 华南理工大学 Utilize the control system and its control method of smart mobile phone remote-controlled smart television mouse
CN107391005A (en) * 2017-06-22 2017-11-24 歌尔科技有限公司 The method of control main frame onscreen cursor movement, game paddle
CN107376341A (en) * 2017-06-22 2017-11-24 歌尔科技有限公司 It is a kind of for the data processing method of game paddle, device and game paddle
CN107493494A (en) * 2017-07-13 2017-12-19 安徽声讯信息技术有限公司 Intelligent OTT boxes speech control system
CN107560613A (en) * 2017-08-15 2018-01-09 江苏科技大学 Trajectory Tracking System and method in robot chamber based on nine axle inertial sensors
CN107635214A (en) * 2017-08-21 2018-01-26 深圳创维-Rgb电子有限公司 Response method, device, system and readable storage medium storing program for executing based on blue Tooth remote controller
CN107885109A (en) * 2017-12-25 2018-04-06 桂林电子科技大学 A kind of wireless controller
CN108762528A (en) * 2018-08-15 2018-11-06 苏州大学 Attitude algorithm method suitable for aerial flying squirrel
CN109739371A (en) * 2018-11-28 2019-05-10 北京永洪商智科技有限公司 A kind of smart handle, operating method and system operating large-size screen monitors
CN111221420A (en) * 2020-01-13 2020-06-02 深圳大学 2D movement track identification method and system based on smart watch
CN111580666A (en) * 2020-05-11 2020-08-25 清华大学 Equipment control method, electronic equipment, equipment control system and storage medium
CN111596883A (en) * 2020-05-14 2020-08-28 深圳航天智慧城市系统技术研究院有限公司 Data visualization system supporting voice recognition and somatosensory operation remote control
CN111643092A (en) * 2020-06-02 2020-09-11 四川大学华西医院 Epilepsia alarm device and epilepsia detection method
CN113766288A (en) * 2021-08-04 2021-12-07 深圳Tcl新技术有限公司 Electric quantity prompting method and device and computer readable storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102843597A (en) * 2012-08-21 2012-12-26 青岛海信宽带多媒体技术有限公司 Set top box remote controller
CN102932686A (en) * 2012-10-15 2013-02-13 青岛海信信芯科技有限公司 Method for processing sensor data in remote controller
CN103210608A (en) * 2010-09-17 2013-07-17 帝吉恩斯株式会社 Digital device control system using smart phone
CN103428552A (en) * 2013-08-26 2013-12-04 四川长虹器件科技有限公司 Remote control air mouse control system and method for achieving same
CN103424115A (en) * 2013-07-19 2013-12-04 上海理工大学 Micro miniature aircraft ground test attitude recorder
CN203537531U (en) * 2013-09-29 2014-04-09 上海云视科技有限公司 Full-function remote controller
CN103943106A (en) * 2014-04-01 2014-07-23 北京豪络科技有限公司 Intelligent wristband for gesture and voice recognition
CN204013938U (en) * 2014-07-30 2014-12-10 哈尔滨工业大学深圳研究生院 Based on the intelligent remote control system of OTT TV

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103210608A (en) * 2010-09-17 2013-07-17 帝吉恩斯株式会社 Digital device control system using smart phone
CN102843597A (en) * 2012-08-21 2012-12-26 青岛海信宽带多媒体技术有限公司 Set top box remote controller
CN102932686A (en) * 2012-10-15 2013-02-13 青岛海信信芯科技有限公司 Method for processing sensor data in remote controller
CN103424115A (en) * 2013-07-19 2013-12-04 上海理工大学 Micro miniature aircraft ground test attitude recorder
CN103428552A (en) * 2013-08-26 2013-12-04 四川长虹器件科技有限公司 Remote control air mouse control system and method for achieving same
CN203537531U (en) * 2013-09-29 2014-04-09 上海云视科技有限公司 Full-function remote controller
CN103943106A (en) * 2014-04-01 2014-07-23 北京豪络科技有限公司 Intelligent wristband for gesture and voice recognition
CN204013938U (en) * 2014-07-30 2014-12-10 哈尔滨工业大学深圳研究生院 Based on the intelligent remote control system of OTT TV

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
MARK EUSTON ET.AL: "A complementary filter for attitude estimation of a fixed-wing UAV", 《2008 IEEE/RSJ INTERNATIONL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS》 *

Cited By (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107209587B (en) * 2014-09-30 2020-05-19 Dav公司 Command device and method for a motor vehicle
CN107209587A (en) * 2014-09-30 2017-09-26 Dav公司 Control device and method for motor vehicles
CN104503321A (en) * 2014-12-18 2015-04-08 赵爽 Ultralow-power wireless intelligent control system for body sensing or voice control
CN104699800A (en) * 2015-03-19 2015-06-10 深圳市米家互动网络有限公司 Picture information searching method and system, remote controller and display terminal
CN104773289A (en) * 2015-04-16 2015-07-15 四川理工学院 Internet-of-things-based micro four-rotor aircraft
CN105068650B (en) * 2015-08-11 2018-05-25 王燕军 A kind of real time motion capture, the game bracelet of interaction
CN105068650A (en) * 2015-08-11 2015-11-18 王燕军 Real-time motion capturing and interaction game band
CN105224082A (en) * 2015-09-27 2016-01-06 邱少勐 The system failure is sought help warning device in real time
CN105739381A (en) * 2016-02-01 2016-07-06 四川长虹电器股份有限公司 Ring type computing equipment and household electric appliance interaction method and system
CN105824420A (en) * 2016-03-21 2016-08-03 李骁 Gesture recognition method based on acceleration transducer
CN105824420B (en) * 2016-03-21 2018-09-14 李骁 A kind of gesture identification method based on acceleration transducer
CN106028107B (en) * 2016-06-20 2018-12-14 昆明理工大学 A kind of wireless English text input system based on accelerometer and gyro sensor
CN106028107A (en) * 2016-06-20 2016-10-12 昆明理工大学 Wireless English text input system based on accelerometer and gyroscope sensor
CN106127878A (en) * 2016-07-01 2016-11-16 陕西师范大学 A kind of portable check class attendance system and method for RFID based on all-in-one campus card
CN106340171A (en) * 2016-09-13 2017-01-18 上海理工大学 Wireless remote control electrical switch
CN106454465A (en) * 2016-12-01 2017-02-22 北京小米移动软件有限公司 Remote control method and device of remote controller
CN106791518A (en) * 2016-12-22 2017-05-31 深圳Tcl数字技术有限公司 The method and apparatus that intelligent watch controls TV
CN107318035A (en) * 2017-05-04 2017-11-03 华南理工大学 Utilize the control system and its control method of smart mobile phone remote-controlled smart television mouse
CN107029422A (en) * 2017-06-06 2017-08-11 西安蝴蝶网络科技有限公司 A kind of arm motion tracks of device and its motion capture method
CN107376341A (en) * 2017-06-22 2017-11-24 歌尔科技有限公司 It is a kind of for the data processing method of game paddle, device and game paddle
CN107391005A (en) * 2017-06-22 2017-11-24 歌尔科技有限公司 The method of control main frame onscreen cursor movement, game paddle
CN107376341B (en) * 2017-06-22 2020-05-12 歌尔科技有限公司 Data processing method and device for gamepad and gamepad
CN107493494A (en) * 2017-07-13 2017-12-19 安徽声讯信息技术有限公司 Intelligent OTT boxes speech control system
CN107560613A (en) * 2017-08-15 2018-01-09 江苏科技大学 Trajectory Tracking System and method in robot chamber based on nine axle inertial sensors
CN107560613B (en) * 2017-08-15 2020-03-31 江苏科技大学 Robot indoor track tracking system and method based on nine-axis inertial sensor
CN107635214B (en) * 2017-08-21 2019-10-01 深圳创维-Rgb电子有限公司 Response method, device, system and readable storage medium storing program for executing based on blue Tooth remote controller
CN107635214A (en) * 2017-08-21 2018-01-26 深圳创维-Rgb电子有限公司 Response method, device, system and readable storage medium storing program for executing based on blue Tooth remote controller
CN107885109A (en) * 2017-12-25 2018-04-06 桂林电子科技大学 A kind of wireless controller
CN108762528B (en) * 2018-08-15 2021-03-23 苏州大学 Attitude calculation method suitable for airborne flying mouse
CN108762528A (en) * 2018-08-15 2018-11-06 苏州大学 Attitude algorithm method suitable for aerial flying squirrel
CN109739371A (en) * 2018-11-28 2019-05-10 北京永洪商智科技有限公司 A kind of smart handle, operating method and system operating large-size screen monitors
CN111221420A (en) * 2020-01-13 2020-06-02 深圳大学 2D movement track identification method and system based on smart watch
CN111580666A (en) * 2020-05-11 2020-08-25 清华大学 Equipment control method, electronic equipment, equipment control system and storage medium
CN111580666B (en) * 2020-05-11 2022-04-29 清华大学 Equipment control method, electronic equipment, equipment control system and storage medium
CN111596883A (en) * 2020-05-14 2020-08-28 深圳航天智慧城市系统技术研究院有限公司 Data visualization system supporting voice recognition and somatosensory operation remote control
CN111596883B (en) * 2020-05-14 2023-06-06 深圳航天智慧城市系统技术研究院有限公司 Data visualization system supporting voice recognition and somatosensory operation remote control
CN111643092A (en) * 2020-06-02 2020-09-11 四川大学华西医院 Epilepsia alarm device and epilepsia detection method
CN113766288A (en) * 2021-08-04 2021-12-07 深圳Tcl新技术有限公司 Electric quantity prompting method and device and computer readable storage medium

Similar Documents

Publication Publication Date Title
CN104185050A (en) OTT television based intelligent remote control system and control method thereof
US10362438B2 (en) Portable apparatus and method of controlling location information of portable apparatus
CN108596976B (en) Method, device and equipment for relocating camera attitude tracking process and storage medium
US8344998B2 (en) Gesture-based power management of a wearable portable electronic device with display
CN108711430B (en) Speech recognition method, intelligent device and storage medium
CN107193455B (en) Information processing method and mobile terminal
CN107786732A (en) Terminal applies method for pushing, mobile terminal and computer-readable recording medium
CN106664656A (en) Electronic device with static electric field sensor and related method
CN103943106A (en) Intelligent wristband for gesture and voice recognition
CN104170360A (en) Intelligent response method of user equipment, and user equipment
US11656658B2 (en) Electronic device and method for controlling electronic device
US11222729B2 (en) Electronic device and method for providing stress index corresponding to activity of user
CN107102733A (en) A kind of electronic equipment touch-screen control method and device
CN204013938U (en) Based on the intelligent remote control system of OTT TV
CN101763165A (en) Information processing apparatus
CN113365085B (en) Live video generation method and device
CN107301862A (en) A kind of audio recognition method, identification model method for building up, device and electronic equipment
CN107832067B (en) Application updating method, mobile terminal and computer readable storage medium
CN115686264A (en) False touch prevention method and device
CN107239184A (en) A kind of touch screen contactor control device, method and mobile terminal
CN111552166B (en) Electronic equipment, interaction method and device
CN114578984A (en) Electronic device including flexible display and method of operating the same
US10551195B2 (en) Portable device with improved sensor position change detection
US20230024254A1 (en) Gesture Controls Using Ultra Wide Band
WO2022048623A1 (en) Electronic device, and control method and control apparatus therefor

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C53 Correction of patent of invention or patent application
CB03 Change of inventor or designer information

Inventor after: Zhang Qinyu

Inventor after: Lin Wei

Inventor after: Wang Youqin

Inventor after: Xue Ruifan

Inventor after: Chen Huaguan

Inventor after: Han Xiao

Inventor before: Zhang Qinyu

Inventor before: Lin Wei

Inventor before: Wang Cui

Inventor before: Tian Bin

Inventor before: Liu Kun

Inventor before: Zhang Shaojun

COR Change of bibliographic data

Free format text: CORRECT: INVENTOR; FROM: ZHANG QINYU LIN WEI WANG CUI TIAN BIN LIU KUN ZHANG SHAOJUN TO: ZHANG QINYU LIN WEI WANG YOUQIN XUE RUIFAN CHEN HUAGUAN HAN XIAO

C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20141203