CN103501445B - Gesture-based interaction two-way interactive digital TV box system and implementation method - Google Patents
Gesture-based interaction two-way interactive digital TV box system and implementation method Download PDFInfo
- Publication number
- CN103501445B CN103501445B CN201310477038.3A CN201310477038A CN103501445B CN 103501445 B CN103501445 B CN 103501445B CN 201310477038 A CN201310477038 A CN 201310477038A CN 103501445 B CN103501445 B CN 103501445B
- Authority
- CN
- China
- Prior art keywords
- gesture
- user
- digital
- information
- chunk
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a gesture-based interaction two-way interactive digital TV box system and an implementation method. The system comprises a video server system, a VOD (Video-On-Demand) management system, a digital TV network, an EPG (Electronic Program Guide) system and a digital TV terminal. The EPG system provides users with a mode which is convenient to operate, is program-friendly and is quick in accessing to the program. The program information played recently by one or more channels are browsed and queried by the system. Meanwhile, the EPG provides a classification function, and helps the users browse and select various types of programs. The EPG system comprises a receiving module, a control conversion module, a storage module and a gesture human-machine interaction operation module. The two-way interactive digital TV box has stronger product usability, and standardized layout and content. The operation process in the user selection process is simplified, so that the two-way interactive digital TV box has the advantages of good user experience.
Description
Technical field
The present invention relates to areas of information technology, the Bidirectional interdynamic digital television box system of more particularly, to a kind of gesture interaction and
Implementation method.
Background technology
DTV STB is a kind of conversion equipment that digital television signal is converted into analog signal, and it is to through number
The image of wordization compression and voice signal are decoded reducing, and produce video and the voice signal of simulation, by television indicator
There is provided high-quality TV programme with stereo set to spectators.Current DTV STB has become a kind of embedding assembly
Equipment, has perfect real time operating system, provides powerful CPU computing capability, for coordinating to control Set Top Box each several part hard
Part facility, and colourful graphic user interface is provided, the such as electronic program guides of enhanced-quality television, provide the user with picture and text
And the program description of cyclopentadienyl and background information.Meanwhile, Set Top Box has " fool's computer " ability, by house software function to net
Network carries out bidirectional rebuilding, facilitates implementation as internet browsing, video request program, household electric business, the multiple service of telephone communication.
Bidirectional interdynamic digital television Set Top Box still rests in the manipulation of traditional remote controller formula mostly, lacks unified group
The mode of operation of the interface layout of part formula and flexibly intelligence.Existing related interfaces assume the patent with intelligent interaction mode at present
Although the interface of chunk and the manipulation of gesture can also be realized, all interface controls and operational order one cannot be realized
One corresponding interaction, thus intellectualized operation is applied to each organize block instruction, the TV for bi-directional digital television box is straight
Broadcast, video-on-demand applications function is it is difficult to realize the intelligence experience of the interaction of What You See Is What You Get and hommization.
Sum it up, needing the urgent technical problem solving of those skilled in the art to be at present：
First, how the display end in DTV realize a kind of interface layout of novel component, make interface assume energy
Enough standardization and unification, and the otherness of the various display terminal of automatic shield.
Second, how a kind of interaction characteristic of Bidirectional interdynamic digital television box system and method are provided, support new chunk
The intelligent interaction operation changed, realizes seeing the interaction effect obtaining final product, improves Consumer's Experience.
Content of the invention
The interface that the present invention is directed to traditional Bidirectional interdynamic digital television box presents and man-machine interaction is related to the problem that exists,
Propose Bidirectional interdynamic digital television box system and the implementation method of a kind of gesture interaction, this system emphasis is to two-way interaction numeral
EPG (Electronic Program Guide, the electric program menu) system of TV box improves, and definition is a kind of to be based on group
The UI of block assumes interface, and application resource content is packaged in the form of assembly, terminal EPG of Bidirectional interdynamic digital television box
System realizes gesture interaction operational order and the one-to-one event binding of interface assembly, and the application completing What You See Is What You Get selects
Function, interaction can reduce unnecessary repeated interaction, realizes flexibly controlled interaction effect, and it is two-way that the method is realized
Digital television interaction box system achieves a kind of new application and assumes layout and support the intelligent man-machine interaction mode of gesture,
Facilitate user to browse and inquire about programme information, the service of personalization is provided.
To achieve these goals, the present invention adopts the following technical scheme that：
A kind of Bidirectional interdynamic digital television box system of gesture interaction, including video server system, VOD management system,
Digital TV network, EPG system and digital TV terminal, described video server system transfers data to VOD management system,
Data is transferred to EPG system by digital TV network by described VOD management system, described EPG system and digital TV terminal
Between be two-way communication, the digital television case of described digital TV terminal obtains the information of EPG system by interface, and in numeral
The display device of television terminal is presented；
EPG system includes receiver module, controls modular converter, memory module and gesture man-machine interactive operation module.
Described gesture man-machine interactive operation module is used for realizing the man-machine interactive operation of chunk, detection identifying user
Enter the operating instructions, respond and execute this operational order, and operating result is fed back to digital TV terminal；Described gesture is man-machine
Interactive operation can carry out free definition by the information gathering of the gesture of user, that is, allow user to define different gestures and carry out table
Show the operating function in system.
Described video server system includes:VOD broadcasting server, VOD page directory server, VOD Broadcast Control server；
Described VOD Broadcast Control server is the core of VOD business, is mainly used to execute the video on-demand request processing user,
And response data, and the data query of Coordination Treatment VOD program request are provided, broadcast file and prepare, broadcast issuing of control command；
Described VOD broadcasting server is mainly used to execute the program request order of Broadcast Control server, including the distribution of IP Information On Demand,
The scheduling of program request file, broadcasts the control of file；
Described VOD page directory server is used for processing the page directory browse request of user, and page data is passed to
The user of request.
Described VOD management system is responsible for the detailed inquiry of the mandate of a broadcasting user, the charging of user's program request and expense；Main work(
Subscriber information management, customer data base index, video frequency program source control, user authentication, monitoring server can be included；
Described digital TV network is used for realizing transmission distribution, network transmission, is loaded into network function.
Described receiver module comes from the various data message of digital TV network for reception, and by demodulating, demultiplexing,
Decoding and audio/video coding obtain electric program menu information, and transfer data to control modular converter；
Described control modular converter, for being converted to group by the programme content index of generation and associated extension information
Blocking structure form, and the data after conversion is transferred to memory module；
Described memory module, for the program menu information of the group blocking structure after storage conversion, and defines group block instruction
Collection, storage user input raw information and characterize command function operation information between mapping relations storehouse, mapping relations with
Presented in the corresponding key value of keyword, it is two-way communication between described memory module and gesture man-machine interactive operation module；
In described mapping relations storehouse, input instruction collection exists as keyword, for mating the instruction letter of triggering after user interactive
Breath, the operation information characterizing command function exists as key value, and keyword is mapped as one-to-one or many-one with key value
Relation；
Described gesture man-machine interactive operation module is used for realizing the man-machine interactive operation of chunk, detection identifying user
Enter the operating instructions, respond and execute this operational order, and operating result is fed back to digital TV terminal；Gesture man-machine interaction
Operation module also includes self-adapting estimation module, carries out self study to the gesture of user, that is, allow user to define different gestures
Instruction is used as the operational order of function in system, thus the gesture model that early stage sampling is obtained carries out necessary correction, with
Improve the accuracy rate of identification further.
Described digital TV terminal, as the hardware carrier of Bidirectional interdynamic digital television box system, inputs, shows for providing
Show that equipment is interacted with user, digital TV terminal includes display device and digital television case,
Described display device is used for the EPG information receiving being parsed and showing with the interface of chunk form
Show；
Described digital television case is used for the acquisition of film data and the original input information of identifying user, in digital television case
The gesture induction device realizing gesture operation is installed.
The exchange method that described digital television case system is adopted, mainly comprises the steps：
Step (1)：Start, video server system provides the program source of video request program, and is managed by VOD management system
The mandate billing function of point broadcasting user, programme information source, through the transmission of digital TV network, is transmitted to EPG system；
Step (2)：Received by EPG system receiver module and come from the various data message of digital TV network, and pass through
Demodulation, demultiplexing, decoding and audio/video coding obtain electric program menu information；
Step (3)：Modular converter is controlled to be general lattice by the electric program menu receiving content information and index translation
Version, and store the program menu information of the general lattice structure after conversion in a storage module；Then by program menu information
It is transferred to the display device of digital TV terminal, carry out presenting of interface；
Step (4)：The interaction of user is carried out by the gesture induction device of the digital television case of digital TV terminal
The typing of primitive operation instruction；
Step (5)：By gesture man-machine interactive operation module, by user input instruction and memory module mapping relations storehouse
Whether keyword is mated, and judges whether user input instruction meets default instruction set, meet in mapping relations storehouse
Keyword, if be put into step (6)；It is put into step (7) if not；
Step (6)：System executes the function event of the corresponding operational order of corresponding keyword, and passes through terminal display device
Assume the corresponding result interface of operation；Terminate；
Step (7)：Display miscue information, terminates.
The corresponding result interface of operation of described step (6) is by setting up logistic model and applying algorithm automatically to give birth to
Become, described logistic model refers to represent the structure that presents at chunk interface with tree construction, chunk interface is as dendrogram
Root node, has the other node of two species, respectively primary area node and auxiliary area node, wherein primary area node is the knot that there must be
Point, auxiliary area node allows to be existed as desired as the area of object container, and each layer of tree construction of depth represents represented by it
Node type.
The specific works method of the gesture man-machine interactive operation module of described step (5) is as follows：
Gesture man-machine interaction method it is important that the identification process of gesture, gather the gesture of user by gesture induction device
Action, and the chunk function of being mated with this gesture motion by the detection of gesture processing module, and gathered according to gesture induction device
To characteristic point be located position, characteristic point quantity and characteristic point moving direction update display module in interface；
According to the feature of operation and control interface, manipulation instruction collection is divided, and configure manipulation instruction and respond thing with chunk
The mapping relations of part, realize manipulation instruction and the one-to-one operating result of interface group block, that is, when triggering a manipulation instruction
The event of a chunk must be had matching, produce corresponding operating result；
Gesture motion is divided into static gesture and dynamic gesture.
The identification process of static gesture is：
Step (5a-1):Gesture gatherer process：First carry out gesture positioning, obtain images of gestures, and carry out static gesture portion
The extraction of position, by gesture harvester collection contour area in one's hands；
Step (5a-2):Characteristic extraction procedure：Using the mathematics method of geometry of convex closure, obtain summit and the top of convex closure collection
The coordinate information of point, obtains representing the feature contour of hand shape, the central point O taking feature contour is basic point, with (x0, y0) table
Show, x0 is averaged and obtained by the maximum of x coordinate on feature contour and minimum of a value, is expressed as x0=1/2 (xmin+xmax), y0
=1/2 (ymin+ymax)；Try to achieve the distance value of arbitrfary point Q (x1, y1) on basic point and convex closureFrom
And obtain one with distance value r for forming the characteristic vector of unit；Store gesture feature to after the collection of various types of gestures
Storehouse, and carry out feature extraction and obtain characteristic vector set F；
Step (5a-3):Search key dictionary set D is generated to the method for characteristic set F application K-means cluster, holds
Measure as d, each class corresponding keyword g is averaged by characteristic vectors f all in such and obtains, each keyword g corresponds to
The execute instruction of one chunk, its mapping relations with chunk operational order key value, store in memory module；
Step (5a-4):Interaction for user, hand is positioned over before induction installation, shows the operation posture of hand and keeps
Static, gesture induction device carries out feature extraction by the gesture attitude gathering user, for the static state to be identified of input
Gesture instruction, the method according to step (5a-1) and step (5a-2) obtains characteristic vector m of a n dimension；
Step (5a-5):In keyword dictionary set D, find Manhattan distance minimum and characteristic vector m between
Keyword g, if this distance is less than the threshold value specified, f is the vector of coupling, and it is corresponding to instruct as instruction to be executed,
And belong to m in the corresponding class of this keyword, such feature interpretation is updated to g=(D*g+m)/(d+1).
The identification process of dynamic gesture is：The moving process of gesture is regarded as dynamic track, and define one specific
Time span t to represent the time interval between dynamic gesture, create the sequence that a queue Q stores gesture motion, by hand
Gesture state is added in Q, and detects that the new action adding is the final state of gesture every time, if last shape
State, then the change of detection gesture and movement locus, to determine testing result；
Concrete operation step is as follows：
Step (5b-1):Create a queue Q with the time as standard, define time interval t, every the time of t, system
The position of automatic detection gesture and action, current action is added in queue Q, and detects previous in current gesture and queue
The matching degree of individual gesture, if matching degree is more than preset value, and accumulated time T<Dynamic gesture time threshold T ', then be judged as
Static gesture, otherwise for dynamic gesture；
Step (5b-2):If dynamic gesture, then detect that the data being newly joined is gesture final state, i.e. t
After time, whether gesture changes；If final state, go to step (5b-4)；
Step (5b-3):If not final state, record gesture motion and the displacement information of current state, continue inspection
Survey the new gesture adding, repeat step (5b-2)；
Step (5b-4):Beginning detection, the change according to gesture and movement locus are first opened for tail of the queue from queue with current gesture,
Judge whether gesture is default gesture instruction, if it is return operating result, otherwise point out error message.
Beneficial effects of the present invention：
1 provides a kind of intelligent, open, support EPG system that is multiple services, having canonical layout's form broadband many
Media business platform, is solved the problems, such as that business index and navigation lack consolidation form, and is transmitted by Ethernet static or dynamic
The resource of state simultaneously provides digital television bidirectional interactive entertainment service.
2 definition are a kind of to assume interface based on the UI of chunk, application resource content is packaged in the form of assembly, passes through
Set up logistic model it is achieved that a kind of new application assumes layout and interactive mode.Terminal interface in DTV
Realize interactive operation instruction and the one-to-one event binding of interface assembly, complete the application selection function of What You See Is What You Get, hand over
Mutually process can reduce unnecessary repeated interaction, improve the efficiency of response, reach flexibly controlled interaction effect, realize one
Plant new digital TV program menu and assume layout and two-way interaction pattern.
A kind of 3 gesture Bidirectional interdynamic digital television boxes based on chunk interaction technique of offer, and interact skill with chunk
The Bidirectional interdynamic digital television cartridge device of the gesture interaction that art principle is realized, can support the gesture operation of single-point and multiple spot, go forward side by side
The high-precision action recognition of row, all kinds of gesture operation of quick response, make Bidirectional interdynamic digital television box have stronger product easy
With property, simplify operating process when user selects, make Bidirectional interdynamic digital television box have good Consumer's Experience.
4, by new chunk UI interface alternation method, are different from traditional only having upper and lower, left and right, confirm and move back
The distance type interactive mode of operation of selection such as go out.The method need not define complexity alternative events, have be apparent from, easy to learn, easy-to-use
Interaction characteristic.Two-way interaction mode meets the demand to different business level for the user, there is provided the choosing of more free multicomponent
Select channel, and chunk exchange method support multiple modes of operation, can expand to multiple Intelligent control modes with autonomous configuration,
Method of operating is flexible and changeable, the interaction of suitable miscellaneous service information and application resource.
A kind of 5 recognition methods that fast and effectively static gesture and dynamic gesture are provided, and combine algorithm of convex hull to static state
Gesture carries out feature extraction, improves the efficiency of feature extraction, and the feature obtaining can preferably reflect the image of current gesture
Feature, identification process introduces keyword and feature is described, and decreases the coupling amount being more than in matching process, accelerates quiet
State gesture identification speed.The queue of Dynamic Recognition dish is stored to gesture motion and is detected it is only necessary to judge in the unit interval
Action change and track just can quickly identify the dynamic gesture meeting preset instructions, matching process is simply convenient, greatly
Improve greatly speed and the efficiency of identification.
In a word, this exchange method makes Bidirectional interdynamic digital television box have stronger Product's Ease of Use, normalized layout
And content, simplify the operating process in user's selection course, by this UI layout and interaction design, two-way interaction can be made
The more hommization of the mode of operation of digital television case, thus the Consumer's Experience of significantly improving product.
The present invention construct a kind of interface layout form of Bidirectional interdynamic digital television box system of new general form and
Interactive mode, by one-to-one interface assembly and response events, realizes the interaction effect of What You See Is What You Get.It is different from tradition
Only there are upper and lower, left and right, confirm and exit the single remote control interactive operator scheme of selection, it is double that adopting said method is realized
High-quality Consumer's Experience service can be provided a user with to digital television interaction box system, method of operating is flexible and changeable, and
The intelligent operation holding gesture formula interacts field, the interaction of suitable miscellaneous service information and application resource, realizes quick response each
Generic operation, system is apparent from, easy to learn, easy-to-use convenient interactive mode can be suitable for wider crowd and operate with, and allows user to feel
It is subject to intellectuality, the amusement of hommization to enjoy.
Brief description
Fig. 1 is the Mathematical Modeling schematic diagram that Bidirectional interdynamic digital television box system assumes interface；
Fig. 2 is Bidirectional interdynamic digital television box system construction drawing；
Fig. 3 is static gesture profile and the operational order corresponding diagram of Bidirectional interdynamic digital television box system；
Fig. 4 is dynamic gesture track and the operational order corresponding diagram of Bidirectional interdynamic digital television box system；
Fig. 5 is the static gesture interactive identification method flow diagram of system；
Fig. 6 is the dynamic gesture interactive identification method flow diagram of system；
Fig. 7 is the gesture interaction process flow diagram flow chart of Bidirectional interdynamic digital television box system.
Specific embodiment
As shown in figure 1, the digital television case system that the present invention realizes is directed to presenting and handing over of conventional digital interactive TV box
Mutually it is related to the problem existing it is proposed that a kind of television services implementation method based on general lattice interaction technique, this implementation method is first
The interface that presents of digital television case terminal is improved, definition is a kind of to assume interface based on the UI of general lattice, by application resource
Hold and be packaged in the form of assembly it is achieved that a kind of new application assumes layout.
The interface layout content of described general case form includes：Main display block, in order to show the first carrying chunk；Auxiliary aobvious
Show block, in order to show the second carrying chunk；Described auxiliary display block be located at the upside of described main display block, downside, left side,
Right side or be suspended in top.Have multiple suspended states block when, shown using the form that level goes forward one by one, i.e. up-to-date ejection
Suspended state block is always located in highlighting foremost of interface, and the interface block of other levels passes through to arrange level transparency
Display.
Described system includes initial interface and multiple process interface, the appearance form phase of initial interface and process interface
With main display block has nine first carrying chunks, and arrangement is in palace trellis；There are nine second carrying chunks auxiliary viewing area, laterally
Or be longitudinally arranged in order, nine carrying chunks of display in each block, if chunk is more than nine in block, need to by the tenth and
Above carrying chunk Pagination Display.
Compared with the general lattice interface being related in existing publication, it is interface definition Mathematical Modeling in the present invention, and
Initial interface and process interface can be automatically generated by algorithm, method for expressing is as follows：
Represent that with tree construction the interface of general lattice assumes structure, as the root node of dendrogram, there are two species at general lattice interface
Other five child nodes, respectively primary area node (E area node) and auxiliary area node (auxiliary area 1, auxiliary area of auxiliary area 2 ... M), wherein primary area
Node is the node that there must be, and auxiliary area node can exist as desired as the area of object container, each layer of tree construction
Depth represent the type of its represented node.As shown in figure 1, each interface (including initial interface and process interface) is made
For root node, its level depth is 1, and the level depth of area's node is 2, and in area, the level depth of chunk node is 3.
General lattice model, with set Q=q | q=(primary area (chunk E1, chunk E2... chunk En), auxiliary area 1 (chunk A1, chunk
A2... chunk An), auxiliary area 2 (chunk B1, chunk B2... chunk Bn) ... auxiliary area M (chunk M1, chunk M2... chunk Mn)), wherein main
Area ≠ ∮, n≤9 } represent, that is, the primary area at general lattice interface can not be sky, and the group block number that each area is contained within can not exceed 9.Separately
Outward, the tree construction that initial interface and process interface obtain, can automatically generate according to presenting content, obtain distributing the son of tree construction
Node.
As shown in Fig. 2 a kind of Bidirectional interdynamic digital television box system of gesture interaction, including video server system, VOD
(Video On Demand, multimedia video program request) management system, digital TV network, EPG system and digital TV terminal,
Described video server system transfers data to VOD management system, and data is passed through digital tv network by described VOD management system
Network is transferred to EPG system, is two-way communication between described EPG system and digital TV terminal, the number of described digital TV terminal
Word TV box by interface obtain EPG system all above issue film list, the information such as program category and film title, and
Presented in the display device of digital TV terminal.
Described video server system includes:VOD broadcasting server, VOD page directory server, VOD Broadcast Control server.
Described VOD Broadcast Control server is the core of VOD business, is mainly used to execute the video on-demand request processing user,
And response data, and the data query of Coordination Treatment VOD program request are provided, broadcast file and prepare, broadcast issuing of control command.
Described VOD broadcasting server is mainly used to execute the program request order of Broadcast Control server, including the distribution of IP Information On Demand
(VPID (video PID coding), APID (Audio PID coding)), the scheduling of program request file, broadcast the control of file.
Described VOD page directory server is used for processing the page directory browse request of user, and page data is passed to
The user of request.
Described VOD management system is responsible for the detailed inquiry of the mandate of a broadcasting user, the charging of user's program request and expense.Main work(
Subscriber information management, customer data base index, video frequency program source control, user authentication, monitoring server etc. can be included.
Described digital TV network is used for realizing transmission distribution, network transmission, is loaded into the functions such as network.
Described EPG system is provided the user simple operation, program close friend, can be led in a kind of mode of quick interview show
Cross this system to realize browsing and inquire about the programme information that one or more channels are play in the recent period, meanwhile, EPG can provide classification work(
Can, user can be helped to browse and select various types of programs.EPG system includes receiver module, controls modular converter, storage
Module and gesture man-machine interactive operation module.
Described receiver module comes from the various data message of digital TV network for reception, and by demodulating, demultiplexing,
The technical limit spacing electric program menu information such as decoding and audio/video coding, and transfer data to control modular converter；
Described control modular converter, for being converted to group by the programme content index of generation and associated extension information
Blocking structure form, and the data after conversion is transferred to memory module；
Described memory module, for the program menu information of the group blocking structure after storage conversion, and defines group block instruction
Collection, storage user input raw information and characterize command function operation information between mapping relations storehouse, mapping relations with
Presented in the corresponding key value of keyword, it is two-way communication between described memory module and gesture man-machine interactive operation module.
In described mapping relations storehouse, input instruction collection exists as keyword, for mating the instruction letter of triggering after user interactive
Breath, the operation information characterizing command function exists as key value, and keyword is mapped as one-to-one or many-one with key value
Relation.
Described gesture man-machine interactive operation module is used for realizing the man-machine interactive operation of chunk, detection identifying user
Enter the operating instructions, respond and execute this operational order, and operating result is fed back to digital TV terminal.Gesture man-machine interaction
Operation module also includes self-adapting estimation module, can carry out self study to the gesture of user, that is, allow user to define different
Gesture instruction is used as the operational order of function in system, thus the gesture model that early stage sampling is obtained carries out necessary school
Just, to improve the accuracy rate of identification further.
Described digital TV terminal, as the hardware carrier of Bidirectional interdynamic digital television box system, inputs, shows for providing
Show etc. that equipment is interacted with user, digital TV terminal includes display device and digital television case,
Described display device is used for the EPG information receiving being parsed and showing with the interface of chunk form
Show；
Described digital television case is used for the acquisition of film data and the original input information of identifying user, in digital television case
Equipped with the gesture induction device realizing gesture operation
As shown in fig. 7, the exchange method that the Bidirectional interdynamic digital television box system of above-mentioned gesture interaction is adopted, main bag
Include following steps：
Step (1)：Start, video server system provides the program source of video request program, and is managed by VOD management system
The mandate billing function of point broadcasting user, programme information source, through the transmission of digital TV network, is transmitted to EPG system；
Step (2)：Received by EPG system receiver module and come from the various data message of digital TV network, and pass through
The technical limit spacing electric program menu information such as demodulation, demultiplexing, decoding and audio/video coding；
Step (3)：Modular converter is controlled to be general lattice by the electric program menu receiving content information and index translation
Version, and store the program menu information of the general lattice structure after conversion in a storage module；Then by program menu information
It is transferred to the display device of digital TV terminal, carry out presenting of interface；
Step (4)：The interaction of user is carried out by the gesture induction device of the digital television case of digital TV terminal
The typing of primitive operation instruction；
Step (5)：By gesture man-machine interactive operation module, by user input instruction and memory module mapping relations storehouse
Whether keyword is mated, and judges whether user input instruction meets default instruction set, meet in mapping relations storehouse
Keyword, if be put into step (6)；It is put into step (7) if not；
Step (6)：System executes the function event of the corresponding operational order of corresponding keyword, and passes through terminal display device
Assume the corresponding result interface of operation；Terminate；
Step (7)：Display miscue information, terminates.
The corresponding result interface of operation of described step (6) is by setting up logistic model and applying algorithm automatically to give birth to
Become, described logistic model refers to represent the structure that presents at chunk interface with tree construction, chunk interface is as dendrogram
Root node, has the other node of two species, respectively primary area node and auxiliary area node, wherein primary area node is the knot that there must be
Point, auxiliary area node allows to be existed as desired as the area of object container, and each layer of tree construction of depth represents represented by it
Node type.
The specific works method of the gesture man-machine interactive operation module of described step (5) is as follows：
Gesture man-machine interaction method it is important that the identification process of gesture, gather the gesture of user by gesture induction device
Action, and the chunk function of being mated with this gesture motion by the detection of gesture processing module, and gathered according to gesture induction device
To the moving direction of position, characteristic point quantity and characteristic point etc. that is located of characteristic point update the interface in display module.
According to the feature of operation and control interface, manipulation instruction collection is divided, and configure manipulation instruction and respond thing with chunk
The mapping relations of part, realize manipulation instruction and the one-to-one operating result of interface group block, that is, when triggering a manipulation instruction
The event of a chunk must be had matching, produce corresponding operating result.The division of chunk instruction set and configuration-direct with
The definition of the mapping relations of chunk operational order and basic gesture action refers to patent《Man-machine interaction using gesture sets
Standby》(application number 201310120461.8).
As shown in figure 5, gesture motion can be divided into static gesture and dynamic gesture.Wherein, the identification process of static gesture
For：
Step (5a-1):Gesture gatherer process：First carry out gesture positioning, obtain images of gestures, and carry out static gesture portion
The extraction of position, by gesture harvester collection contour area in one's hands；
Step (5a-2):Characteristic extraction procedure：Using the mathematics method of geometry of convex closure, obtain summit and the top of convex closure collection
The coordinate information of point, obtains representing the feature contour of hand shape, the central point O taking feature contour is basic point, with (x0, y0) table
Show, x0 is averaged and obtained by the maximum of x coordinate on feature contour and minimum of a value, is expressed as x0=1/2 (xmin+xmax), y0
=1/2 (ymin+ymax)；Try to achieve the distance value of arbitrfary point Q (x1, y1) on basic point and convex closureFrom
And obtain one with distance value r for forming the characteristic vector of unit；Store gesture feature to after the collection of various types of gestures
Storehouse, and carry out feature extraction and obtain characteristic vector set F；
Step (5a-3):Search key dictionary set D is generated to the method for characteristic set F application K-means cluster, holds
Measure as d, each class corresponding keyword g is averaged by characteristic vectors f all in such and obtains, each keyword g corresponds to
The execute instruction of one chunk, its mapping relations with chunk operational order key value, store in memory module；
Step (5a-4):Interaction for user, hand is positioned over before induction installation, shows the operation posture of hand and keeps
Static, gesture induction device carries out feature extraction by the gesture attitude gathering user, for the static state to be identified of input
Gesture instruction, the method according to step (5a-1) and step (5a-2) obtains characteristic vector m of a n dimension；
Step (5a-5):In keyword dictionary set D, find Manhattan distance minimum and characteristic vector m between
Keyword g, if this distance is less than the threshold value specified, f is the vector of coupling, and it is corresponding to instruct as instruction to be executed,
And belong to m in the corresponding class of this keyword, such feature interpretation is updated to g=(D*g+m)/(d+1).
As shown in figure 3, the convex closure point of gesture contours extract and the corresponding relation with feature contour, and feature contour work
For keyword and chunk operational order key value mapping relations as shown in the figure.
As shown in figure 4, the relation between gesture dynamic trajectory and gesture operation instruction.
As shown in fig. 6, the identification process of dynamic gesture is：The moving process of gesture is regarded as dynamic track, and fixed
One specific time span t of justice, to represent the time interval between dynamic gesture, creates a queue Q and stores gesture motion
Sequence, gesture state is added in Q, and detects that the new action adding is the final state of gesture every time, if
It is final state, then the change of detection gesture and movement locus, to determine testing result.Concrete operation step is as follows：
Step (5b-1):Create a queue Q with the time as standard, define time interval t, every the time of t, system
The position of automatic detection gesture and action, current action is added in queue Q, and detects previous in current gesture and queue
The matching degree of individual gesture, if matching degree is more than preset value, and accumulated time T<Dynamic gesture time threshold T ', then be judged as
Static gesture, otherwise for dynamic gesture；
Step (5b-2):If dynamic gesture, then detect that the data being newly joined is gesture final state, i.e. t
After time, whether gesture changes；If final state, go to step (5b-4)；
Step (5b-3):If not final state, record gesture motion and the displacement information of current state, continue inspection
Survey the new gesture adding, repeat step (5b-2)；
Step (5b-4):Beginning detection, the change according to gesture and movement locus are first opened for tail of the queue from queue with current gesture,
Judge whether gesture is default gesture instruction, if it is return operating result, otherwise point out error message.
Although the above-mentioned accompanying drawing that combines is described to the specific embodiment of the present invention, not model is protected to the present invention
The restriction enclosed, one of ordinary skill in the art should be understood that on the basis of technical scheme, and those skilled in the art are not
Need to pay the various modifications that creative work can make or deformation still within protection scope of the present invention.
Claims (9)
1. a kind of Bidirectional interdynamic digital television box system of gesture interaction, is characterized in that, including video server system, VOD pipe
Reason system, digital TV network, EPG system and digital TV terminal, described video server system transfers data to VOD pipe
Reason system, data is transferred to EPG system by digital TV network by described VOD management system, and described EPG system is electric with numeral
Depending on being two-way communication between terminal, the digital television case of described digital TV terminal obtains the information of EPG system by interface, and
Presented in the display device of digital TV terminal；
EPG system includes receiver module, controls modular converter, memory module and gesture man-machine interactive operation module；
Described gesture man-machine interactive operation module is used for realizing the man-machine interactive operation of chunk, the input of detection identifying user
Operational order, responds and executes this operational order, and operating result is fed back to digital TV terminal；Described gesture man-machine interaction
Operation can carry out free definition by the information gathering of the gesture of user, that is, allow user to define different gestures to represent system
Operating function in system；
Described receiver module comes from the various data message of digital TV network for reception, and by demodulation, demultiplexing, decoding
Obtain electric program menu information with audio/video coding, and transfer data to control modular converter；
Described control modular converter, for being converted to chunk by the programme content index of generation and associated extension information
Version, and the data after conversion is transferred to memory module；
Described memory module, for the program menu information of the group blocking structure after storage conversion, and defines chunk instruction set, deposits
Mapping relations storehouse between the raw information of storage user input and the operation information characterizing command function, mapping relations are with keyword
Presented in corresponding key value, it is two-way communication between described memory module and gesture man-machine interactive operation module；Described reflect
Penetrate input instruction collection in relation storehouse to exist as keyword, for mating the command information of triggering after user interactive, characterize
The operation information of command function exists as key value, and keyword is mapped as one-to-one or many-to-one relation with key value；
Described gesture man-machine interactive operation module is used for realizing the man-machine interactive operation of chunk, the input of detection identifying user
Operational order, responds and executes this operational order, and operating result is fed back to digital TV terminal；Gesture man-machine interactive operation
Module also includes self-adapting estimation module, carries out self study to the gesture of user, that is, allow user to define different gesture instruction
It is used as the operational order of function in system, thus the gesture model that early stage sampling is obtained carries out necessary correction, to enter one
Step improves the accuracy rate of identification；
Wherein, the specific works method of gesture man-machine interactive operation module is as follows：
Gesture man-machine interaction method it is important that the identification process of gesture, moved by the gesture that gesture induction device gathers user
Make, and the chunk function of being mated with this gesture motion by the detection of gesture processing module, and collected according to gesture induction device
Characteristic point be located position, characteristic point quantity and characteristic point moving direction update display module in interface；
According to the feature of operation and control interface, manipulation instruction collection is divided, and configure manipulation instruction and chunk response events
Mapping relations, realize manipulation instruction and the one-to-one operating result of interface group block, must have when triggering a manipulation instruction
The event of one chunk is matching, produces corresponding operating result；
Gesture motion is divided into static gesture and dynamic gesture；
The identification process of dynamic gesture is：The moving process of gesture is regarded as dynamic track, and define one specific when
Between length t to represent the time interval between dynamic gesture, create the sequence that a queue Q stores gesture motion, by gesture shape
State is added in Q, and detects that the new action adding is the final state of gesture, if final state, then every time
The change of detection gesture and movement locus, to determine testing result；
Concrete operation step is as follows：
Step (5b-1)：Create a queue Q with the time as standard, define time interval t, every the time of t, system is automatic
The position of detection gesture and action, current action is added in queue Q, and detects the previous hand in current gesture and queue
The matching degree of gesture, if matching degree is more than preset value, and accumulated time T<Dynamic gesture time threshold T ', then be judged as static state
Gesture, otherwise for dynamic gesture；
Step (5b-2)：If dynamic gesture, then detect that the data being newly joined is gesture final state, i.e. the t time
Whether gesture changes afterwards；If final state, go to step (5b-4)；
Step (5b-3)：If not final state, record gesture motion and the displacement information of current state, continue detection new
The gesture adding, repeat step (5b-2)；
Step (5b-4)：Beginning detection, the change according to gesture and movement locus are first opened for tail of the queue from queue with current gesture, judges
Whether gesture is default gesture instruction, if it is returns operating result, otherwise points out error message.
2. a kind of Bidirectional interdynamic digital television box system of gesture interaction as claimed in claim 1, is characterized in that, described video
Server system includes:VOD broadcasting server, VOD page directory server, VOD Broadcast Control server；
Described VOD Broadcast Control server is the core of VOD business, is mainly used to execute the video on-demand request processing user, and carries
For response data, and the data query of Coordination Treatment VOD program request, broadcast file and prepare, broadcast issuing of control command；
Described VOD broadcasting server is mainly used to execute the program request order of Broadcast Control server, including the distribution of IP Information On Demand, program request
The scheduling of file, broadcasts the control of file；
Described VOD page directory server is used for processing the page directory browse request of user, and page data is passed to request
User.
3. a kind of Bidirectional interdynamic digital television box system of gesture interaction as claimed in claim 1, is characterized in that,
Described VOD management system is responsible for the detailed inquiry of the mandate of a broadcasting user, the charging of user's program request and expense；Major function bag
Include subscriber information management, customer data base index, video frequency program source control, user authentication, monitoring server；
Described digital TV network is used for realizing transmission distribution, network transmission, is loaded into network function.
4. a kind of Bidirectional interdynamic digital television box system of gesture interaction as claimed in claim 1, is characterized in that,
Described digital TV terminal, as the hardware carrier of Bidirectional interdynamic digital television box system, sets for offer input, display
For interacting with user, digital TV terminal includes display device and digital television case,
Described display device is used for the EPG information receiving being parsed and showing with the interface of chunk form；
Described digital television case is used for installing in the acquisition of film data and the original input information of identifying user, digital television case
There is the gesture induction device realizing gesture operation.
5. the exchange method that the digital television case system as described in above-mentioned any claim is adopted, is characterized in that, main bag
Include following steps：
Step (1)：Start, video server system provides the program source of video request program, and program request is managed by VOD management system
The mandate billing function of user, programme information source, through the transmission of digital TV network, is transmitted to EPG system；
Step (2)：Received by EPG system receiver module and come from the various data message of digital TV network, and by demodulating,
Demultiplexing, decoding and audio/video coding obtain electric program menu information；
Step (3)：Modular converter is controlled to be general lattice structure by the electric program menu receiving content information and index translation
Form, and store the program menu information of the general lattice structure after conversion in a storage module；Then program menu information is transmitted
To the display device of digital TV terminal, carry out presenting of interface；
The interaction of step (4) user carries out original behaviour by the gesture induction device of the digital television case of digital TV terminal
Make the typing instructing；
Step (5)：By gesture man-machine interactive operation module, by the key of user input instruction and memory module mapping relations storehouse
Word is mated, and judges whether user input instruction meets default instruction set, whether meets the key in mapping relations storehouse
Word, if be put into step (6)；It is put into step (7) if not；
Step (6)：System executes the function event of the corresponding operational order of corresponding keyword, and is presented by terminal display device
Operate corresponding result interface；Terminate；
Step (7)：Display miscue information, terminates.
6. method as claimed in claim 5, is characterized in that, the corresponding result interface of operation of described step (6) is passed through to set up
Logistic model simultaneously applies algorithm to automatically generate, and what described logistic model referred to represent chunk interface with tree construction is in
Existing structure, as the root node of dendrogram, there are the other node of two species, respectively primary area node and auxiliary area node in chunk interface,
Wherein primary area node is the node that there must be, and auxiliary area node allows to be existed as desired as the area of object container, tree construction
Each layer of depth represent the type of its represented node.
7. method as claimed in claim 5, is characterized in that, the gesture man-machine interactive operation module of described step (5) concrete
Method of work is as follows：
Gesture man-machine interaction method it is important that the identification process of gesture, moved by the gesture that gesture induction device gathers user
Make, and the chunk function of being mated with this gesture motion by the detection of gesture processing module, and collected according to gesture induction device
Characteristic point be located position, characteristic point quantity and characteristic point moving direction update display module in interface；
According to the feature of operation and control interface, manipulation instruction collection is divided, and configure manipulation instruction and chunk response events
Mapping relations, realize manipulation instruction and the one-to-one operating result of interface group block, must have when triggering a manipulation instruction
The event of one chunk is matching, produces corresponding operating result；
Gesture motion is divided into static gesture and dynamic gesture.
8. method as claimed in claim 7, is characterized in that, the identification process of static gesture is：
Step (5a-1):Gesture gatherer process：First carry out gesture positioning, obtain images of gestures, and carry out static gesture position
Extract, by gesture harvester collection contour area in one's hands；
Step (5a-2):Characteristic extraction procedure：Using the mathematics method of geometry of convex closure, obtain the summit of convex closure collection and summit
Coordinate information, obtains representing the feature contour of hand shape, the central point O taking feature contour is basic point, with (x0, y0) represent, x0By
On feature contour, the maximum of x coordinate and minimum of a value are averaged and are obtained, and are expressed as x0=1/2 (xmin+xmax), y0=1/2 (ymin
+ymax)；Try to achieve Q (x in arbitrfary point on basic point and convex closure1, y1) distance valueThus obtaining one
The individual characteristic vector with distance value r for composition unit；Store gesture feature database to after the collection of various types of gestures, and carry out
Feature extraction obtains characteristic vector set F；
Step (5a-3):Search key dictionary set D is generated to the method for characteristic set F application K-means cluster, capacity is
D, each class corresponding keyword g is averaged by characteristic vectors f all in such and obtains, corresponding one of each keyword g
The execute instruction of chunk, its mapping relations with chunk operational order key value, store in memory module；
Step (5a-4):Interaction for user, hand is positioned over before induction installation, shows operation posture the remains stationary of hand,
Gesture induction device carries out feature extraction by the gesture attitude gathering user, and the static gesture to be identified for input refers to
Order, the method according to step (5a-1) and step (5a-2) obtains characteristic vector m of a n dimension；
Step (5a-5):In keyword dictionary set D, find the minimum key of Manhattan distance and characteristic vector m between
Word g, if this distance is less than the threshold value specified, f is the vector of coupling, and it is corresponding to instruct as instruction to be executed, and by m
Belong in the corresponding class of this keyword, such feature interpretation is updated to g=(D*g+m)/(d+1).
9. method as claimed in claim 7, is characterized in that, the identification process of dynamic gesture is：The moving process of gesture is seen
Doing is dynamic track, and defines specific time span t to represent the time interval between dynamic gesture, creates one
Queue Q stores the sequence of gesture motion, and gesture state is added in Q, and detects that the new action adding is every time
The final state of gesture, if final state, then the change of detection gesture and movement locus, to determine testing result；
Concrete operation step is as follows：
Step (5b-1)：Create a queue Q with the time as standard, define time interval t, every the time of t, system is automatic
The position of detection gesture and action, current action is added in queue Q, and detects the previous hand in current gesture and queue
The matching degree of gesture, if matching degree is more than preset value, and accumulated time T<Dynamic gesture time threshold T ', then be judged as static state
Gesture, otherwise for dynamic gesture；
Step (5b-2)：If dynamic gesture, then detect that the data being newly joined is gesture final state, i.e. the t time
Whether gesture changes afterwards；If final state, go to step (5b-4)；
Step (5b-3)：If not final state, record gesture motion and the displacement information of current state, continue detection new
The gesture adding, repeat step (5b-2)；
Step (5b-4)：Beginning detection, the change according to gesture and movement locus are first opened for tail of the queue from queue with current gesture, judges
Whether gesture is default gesture instruction, if it is returns operating result, otherwise points out error message.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310477038.3A CN103501445B (en) | 2013-10-12 | 2013-10-12 | Gesture-based interaction two-way interactive digital TV box system and implementation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310477038.3A CN103501445B (en) | 2013-10-12 | 2013-10-12 | Gesture-based interaction two-way interactive digital TV box system and implementation method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103501445A CN103501445A (en) | 2014-01-08 |
| CN103501445B true CN103501445B (en) | 2017-02-22 |
Family
ID=49866606
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310477038.3A Expired - Fee Related CN103501445B (en) | 2013-10-12 | 2013-10-12 | Gesture-based interaction two-way interactive digital TV box system and implementation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103501445B (en) |
Families Citing this family (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103763599A (en) | 2014-01-26 | 2014-04-30 | 京东方科技集团股份有限公司 | Signal processing method, signal receiving and processing device and television system |
| CN103888816A (en) * | 2014-03-07 | 2014-06-25 | 四川长虹电器股份有限公司 | Social contact system and social contact method based on smart television living program |
| CN104333794A (en) * | 2014-11-18 | 2015-02-04 | 电子科技大学 | Channel selection method based on depth gestures |
| CN105245964A (en) * | 2015-09-30 | 2016-01-13 | 天脉聚源（北京）科技有限公司 | Method and device for setting interactive information of interactive television system |
| KR102557574B1 (en) * | 2016-05-17 | 2023-07-20 | 엘지전자 주식회사 | Digital device and controlling method thereof |
| CN105872690B (en) * | 2016-05-31 | 2019-04-26 | 微鲸科技有限公司 | Smart television control system and control method |
| CN106054650A (en) * | 2016-07-18 | 2016-10-26 | 汕头大学 | Novel intelligent household system and multi-gesture control method thereof |
| CN107801063A (en) * | 2016-09-05 | 2018-03-13 | 中兴通讯股份有限公司 | Obtain method, terminal and the system of TV program information |
| US11153585B2 (en) | 2017-02-23 | 2021-10-19 | Netflix, Inc. | Optimizing encoding operations when generating encoded versions of a media title |
| US10742708B2 (en) | 2017-02-23 | 2020-08-11 | Netflix, Inc. | Iterative techniques for generating multiple encoded versions of a media title |
| US10897618B2 (en) * | 2017-02-23 | 2021-01-19 | Netflix, Inc. | Techniques for positioning key frames within encoded video sequences |
| US11166034B2 (en) | 2017-02-23 | 2021-11-02 | Netflix, Inc. | Comparing video encoders/decoders using shot-based encoding and a perceptual visual quality metric |
| WO2018184233A1 (en) * | 2017-04-07 | 2018-10-11 | 深圳市柔宇科技有限公司 | Hand gesture recognition method and related device |
| US10666992B2 (en) | 2017-07-18 | 2020-05-26 | Netflix, Inc. | Encoding techniques for optimizing distortion and bitrate |
| CN107991893A (en) * | 2017-11-14 | 2018-05-04 | 美的集团股份有限公司 | Realize method, gesture identification module, main control module and the home appliance of communication |
| CN110189246B (en) * | 2019-05-15 | 2023-02-28 | 北京字节跳动网络技术有限公司 | Image stylization generation method and device and electronic equipment |
| CN110703913B (en) * | 2019-09-27 | 2023-09-26 | 腾讯科技（深圳）有限公司 | Object interaction method and device, storage medium and electronic device |
| CN111222581A (en) * | 2020-01-13 | 2020-06-02 | 山东汇贸电子口岸有限公司 | Cloud storage gesture recognition system and method based on improved classification algorithm |
| CN111581710B (en) * | 2020-05-19 | 2021-04-13 | 北京数字绿土科技有限公司 | Automatic acquiring method and device for deflection of overhead transmission line tower |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101546233A (en) * | 2009-05-05 | 2009-09-30 | 上海华勤通讯技术有限公司 | Identification and operation method of touch screen interface gestures |
| CN101662617A (en) * | 2008-08-07 | 2010-03-03 | 索尼株式会社 | Handheld terminal, information providing method, server, system and broadcasting reception apparatus |
| CN102523502A (en) * | 2011-12-15 | 2012-06-27 | 四川长虹电器股份有限公司 | Intelligent television interaction system and interaction method |
| CN102572569A (en) * | 2012-02-24 | 2012-07-11 | 北京原力创新科技有限公司 | Set top box, internet television and method for processing intelligent control signals |
| CN102854983A (en) * | 2012-09-10 | 2013-01-02 | 中国电子科技集团公司第二十八研究所 | Man-machine interaction method based on gesture recognition |
| CN102883224A (en) * | 2011-07-12 | 2013-01-16 | 上海帕科软件科技有限公司 | IPTV (internet protocol television) system with multiple processes for accessing VOD (video-on-demand) play |
| CN103226432A (en) * | 2013-05-22 | 2013-07-31 | 青岛旲天下智能科技有限公司 | Intelligent human-machine interaction operating system |
| CN103248919A (en) * | 2013-05-22 | 2013-08-14 | 青岛旲天下智能科技有限公司 | IPTV (Internet Protocol Television) system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100169842A1 (en) * | 2008-12-31 | 2010-07-01 | Microsoft Corporation | Control Function Gestures |
-
2013
- 2013-10-12 CN CN201310477038.3A patent/CN103501445B/en not_active Expired - Fee Related
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101662617A (en) * | 2008-08-07 | 2010-03-03 | 索尼株式会社 | Handheld terminal, information providing method, server, system and broadcasting reception apparatus |
| CN101546233A (en) * | 2009-05-05 | 2009-09-30 | 上海华勤通讯技术有限公司 | Identification and operation method of touch screen interface gestures |
| CN102883224A (en) * | 2011-07-12 | 2013-01-16 | 上海帕科软件科技有限公司 | IPTV (internet protocol television) system with multiple processes for accessing VOD (video-on-demand) play |
| CN102523502A (en) * | 2011-12-15 | 2012-06-27 | 四川长虹电器股份有限公司 | Intelligent television interaction system and interaction method |
| CN102572569A (en) * | 2012-02-24 | 2012-07-11 | 北京原力创新科技有限公司 | Set top box, internet television and method for processing intelligent control signals |
| CN102854983A (en) * | 2012-09-10 | 2013-01-02 | 中国电子科技集团公司第二十八研究所 | Man-machine interaction method based on gesture recognition |
| CN103226432A (en) * | 2013-05-22 | 2013-07-31 | 青岛旲天下智能科技有限公司 | Intelligent human-machine interaction operating system |
| CN103248919A (en) * | 2013-05-22 | 2013-08-14 | 青岛旲天下智能科技有限公司 | IPTV (Internet Protocol Television) system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103501445A (en) | 2014-01-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103501445B (en) | Gesture-based interaction two-way interactive digital TV box system and implementation method | |
| CN103533391B (en) | The method of work of the Bidirectional interdynamic digital television box system that a kind of voice-control is mutual | |
| CN103501446B (en) | Internet television system based on gesture human-computer interaction technology and its implementation | |
| CN103533415B (en) | Internet television system based on sound control man-machine interaction technology and its implementation | |
| CN109417568A (en) | For the method and system of media list to be presented based on service quality at user equipment | |
| CN105245921B (en) | Digital receiver and its method that real-time audience ratings is provided | |
| US20170161320A1 (en) | Systems and methods for generating smart responses for natural language queries | |
| CN109804637A (en) | System and method according to the acute record of storage management series can be used | |
| CN109074391A (en) | Recommend the method and system of media asset to user based on the content of other media assets | |
| CN101639841B (en) | Method and system for providing multimedia data searching and querying service | |
| CN104488280B (en) | The user interface of comment is provided to interested point in multimedia presentation or period | |
| CN109416789A (en) | Activity recommends media asset to include the method and system in the playlist of second user to checking based on second user to the first user | |
| CN104267968A (en) | Interface switching method and device | |
| CN103124377A (en) | System for minimizing interactions with at least an input mechanism | |
| CN110036442A (en) | System and method for restoring media asset | |
| CN107710771A (en) | For the system and method that synchronized multimedia assets are reset in multiple equipment | |
| US10884602B2 (en) | Direction based content navigation | |
| CN102752655A (en) | Display method of electronic program guide | |
| CN110168541A (en) | The system and method for eliminating word ambiguity based on static and temporal knowledge figure | |
| CN103237254A (en) | Television receiving terminal and electronic program menu information processing method | |
| CN103248919B (en) | A kind of IPTV system | |
| CN110168528A (en) | System and method for restoring media asset | |
| CN104581415A (en) | Intelligent television set and tabletop switching method thereof | |
| CN106406111A (en) | Intelligent household electrical appliance operation method based on AR technology and image recognition technology | |
| CN107771315A (en) | The system and method for display and navigation content are mapped based on dynamic icon |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170222 Termination date: 20171012 |