CN112995724A - Intelligent picture recognizing method based on broadcasting and television set top box - Google Patents
Intelligent picture recognizing method based on broadcasting and television set top box Download PDFInfo
- Publication number
- CN112995724A CN112995724A CN202110161006.7A CN202110161006A CN112995724A CN 112995724 A CN112995724 A CN 112995724A CN 202110161006 A CN202110161006 A CN 202110161006A CN 112995724 A CN112995724 A CN 112995724A
- Authority
- CN
- China
- Prior art keywords
- top box
- television
- picture
- set top
- intelligent
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 22
- 230000033001 locomotion Effects 0.000 claims description 12
- 230000003993 interaction Effects 0.000 claims description 5
- 239000002699 waste material Substances 0.000 claims description 4
- 238000013461 design Methods 0.000 abstract description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44222—Analytics of user selections, e.g. selection of programs or purchase activity
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64746—Control signals issued by the network directed to the server or the client
- H04N21/64753—Control signals issued by the network directed to the server or the client directed to the client
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64746—Control signals issued by the network directed to the server or the client
- H04N21/64761—Control signals issued by the network directed to the server or the client directed to the server
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Signal Processing (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Computer Networks & Wireless Communication (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Social Psychology (AREA)
- Databases & Information Systems (AREA)
- Computer Security & Cryptography (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses an intelligent image recognizing method based on a broadcasting and television set top box, which can realize the identification of an actor image on a television through quick gesture operation, display the related information of the actor, automatically match the resources of the actor in a media asset library to intelligently recommend a video program, and greatly improve the calling efficiency of the resources and the information. Meanwhile, the method has richer design in specific operation and positioning, the positioning accuracy can be improved, the efficiency is improved, and the user experience is enhanced.
Description
Technical Field
The invention belongs to the technical field of broadcast television networks, and relates to an intelligent picture recognizing method based on a broadcast television set top box.
Background
In recent years, mobile internet is in the weather, the use frequency and the use duration of a user using a smart phone far exceed those of a smart television, and the traditional television service is far thrown behind. In 13 hundred million mobile users, WeChat monthly users exceed 9 hundred million, various video APPs and news APPs are also high leaders, even sniper the continuously growing movie box office market, the mobile phone is almost standard after 80, 90, 00 and 10 for watching video and live broadcast, and the newly growing generation of the mobile internet even hardly watches the traditional television. Therefore, the business foundation of radio and television operators has been greatly changed by the rise of smart phones. The existing radio and television systems and networks are completely abandoned, and the conversion to a pure mobile internet is not practical, so that a large amount of waste is caused, and therefore, how to combine the radio and television systems with a mobile internet application mode is becoming a research hotspot in the systems.
When watching television, people often try to inquire some information of an interested actor after seeing the actor and pay attention to related works and news of the actor, and the conventional mode is to inquire by using a mobile phone or a computer, so that a conversion platform is needed, and the efficiency is low.
Disclosure of Invention
In order to solve the problems, the invention discloses an intelligent image recognizing method based on a broadcasting and television set top box, which can recognize actor images on a television and further call out related information according to the actor images.
In order to achieve the purpose, the invention provides the following technical scheme:
the intelligent picture recognizing method based on the broadcasting and TV set-top box comprises the following steps:
step 1, the intelligent mobile terminal and the set top box of the radio and television system can carry out information interaction;
step 2, an operator holds the intelligent mobile terminal to send a screen capturing instruction, and the screen capturing instruction is transmitted to the set top box;
step 3, the set-top box intercepts a television-end playing picture after receiving a screen capturing instruction sent by the intelligent mobile terminal;
and 4, forwarding the screenshot picture in the step 3 to a background server, identifying the screenshot picture by the background server, sending the identified actor information and related program content to the intelligent mobile terminal and/or the set top box, displaying the actor information, and pushing the program.
Further, the sending time of the screen capturing instruction and the screen capturing instruction in the step 2 are synchronously transmitted to the set top box, and the set top box finds and captures the picture played by the television at the corresponding operation time in the stored television content according to the time of the operation.
Further, in step 4, the actor information identified by the background server may be sent to the set-top box and displayed on the television.
Further, when there are multiple actors in the screenshot in step 3, all actors that have been entered in the data and exist on the screenshot are identified in the background server in step 4, and when the actor information is sent back to the smart mobile terminal or the set-top box, the detailed information and the related programs are displayed on the terminal interface or the television after being selected by the operator in an optional manner.
Furthermore, a motion sensing device is arranged in the set top box or the intelligent television, the motion sensing device identifies the motion and the position of the intelligent mobile terminal, the specific position in the television picture which is attempted to be circled by the intelligent operator is obtained by combining the orientation of the television, the background server obtains the specific position and the screenshot picture, only the actor at the specific position in the picture is identified, and the information and the related programs are retrieved and pushed.
Furthermore, when the operator circles the position of a specific actor, the set top box controls the television to display the screen capture picture, and the circle is displayed at the specific position so as to display the specific actor selected by the operator to the operator, so that background resource waste caused by misoperation of the operator is avoided.
Furthermore, a face recognition program can be preset in the set-top box, a plurality of face positions in the screen capture picture are recognized, and circles are drawn around the actor face position closest to the specific position.
Compared with the prior art, the invention has the following advantages and beneficial effects:
based on the method, the actor picture recognition on the television can be realized through rapid gesture operation, the actor related information is displayed, the resources of the actor in the media asset library can be automatically matched for carrying out intelligent recommendation of the film and television programs, and the resource and information calling efficiency is greatly improved. Meanwhile, the method has richer design in specific operation and positioning, the positioning accuracy can be improved, the efficiency is improved, and the user experience is enhanced.
Detailed Description
The technical solutions provided by the present invention will be described in detail below with reference to specific examples, and it should be understood that the following specific embodiments are only illustrative of the present invention and are not intended to limit the scope of the present invention.
In order to realize the method, the information interaction can be carried out between the intelligent mobile terminal and the set top box of the radio and television system, and the information interaction can be carried out through WeChat interaction. The intelligent mobile terminal can adopt mobile common equipment such as a mobile phone, a tablet personal computer and an intelligent remote controller. And the set-top box is provided with a corresponding application program.
When people watch television, people can hold the intelligent mobile terminal to perform simple operation to send a screen capturing instruction when seeing interested actors, for example, clicking a screen control or performing gesture operation (such as shaking and rotating), and after the corresponding operation is identified by WeChat, the instruction is sent to the application in the set top box.
And the set-top box acquires a television-end playing picture after receiving the screen capturing instruction. The acquisition method can be realized by screen capture, and related video data can also be directly acquired from the television data stream. Specifically, the set top box starts to call a bottom screenshot interface of the chip to capture an original image, and then sends the original image to a JPEG encoder carried by the chip for compression.
Further, since signal transmission may be delayed, a database may be set in the set-top box or the smart tv to store the tv content played recently (e.g. within 5 minutes), and after recognizing the operation of the user, the WeChat in the handheld smart terminal synchronously records and transmits the time when the operation occurs to the set-top box. And the set top box finds and acquires the picture played by the television at the corresponding operation time in the stored television content according to the operation occurrence time. The obtaining method is the same as the content in the previous section.
The obtained screen capture picture is stored in the set-top box.
The invention can identify the actors in the image based on the screen capture, display the information of the actors on the television or the intelligent mobile terminal, and can be connected with a broadcast and television media resource system to recommend programs according to the identified actors. The specific process is that the intelligent mobile terminal downloads the screenshot picture from the set-top box, the picture file is converted into a base64 encrypted format after being uploaded to the mobile phone and then forwarded to the background server, the application server decrypts and restores the picture to the picture format, meanwhile, the screenshot picture is identified after the image resolution is processed, and then the identified actor information is sent to the intelligent mobile terminal, and the information can also be sent to the set-top box directly or through the intelligent mobile terminal and displayed on the television. Of course, the set-top box may also directly send the screenshot picture to the background server and then perform the identification and information return processing. Meanwhile, the broadcast and television media system transmits the program content related to the actor to the set-top box according to the identified actor information, and finally displays the program content on the television in the form of a recommended picture and a list, so that an operator can select an interested program to directly click and watch the program.
Since there may be multiple actors in the screenshot and one of them may be of interest to the operator, if not distinguished, all actors that have been entered in the data and are present on the screenshot are identified in the background server, when the actor information is sent back to the smart mobile terminal or the set-top box, it is preferable to optionally let the operator make a selection on the terminal interface or the television set before displaying the detailed information or performing specific interactive push and listing to avoid display failure due to too much content being displayed on the interface and the television set at one time.
The motion sensing device can be further combined with the accurate operation of the motion sensing device and the intelligent mobile terminal to accurately position a specific actor in a television picture, the motion sensing device is arranged in the set top box or the intelligent television, the intelligent mobile terminal adopts a relatively accurate gesture operation method, for example, after the head of the intelligent mobile terminal (or a remote controller) is aligned with the actor in the television, the actor is circled in the air, the motion sensing device can identify the motion and the position of the intelligent mobile terminal, and the specific position in the television picture which an intelligent operator tries to circle can be obtained by combining the direction of the television. The specific position and the screen capture picture are both sent to the background server, and the background server only identifies the actors at the specific position in the picture, retrieves the information of the actors and the related programs and pushes the information. Preferably, when the operator circles the position of the actor, the set top box controls the television to display the screenshot picture after screenshot, and displays the circle at the specific position so as to show the specific actor selected by the operator to the operator, thereby avoiding background resource waste caused by misoperation of the operator. Furthermore, because the gesture action and the movement direction are not necessarily very accurate when the operator operates, a face recognition program can be preset in the set top box, a plurality of face positions in the picture can be recognized, and circles are drawn around the positions of the faces of the actors closest to the specific positions (instead of drawing circles according to the specific positions) so as to achieve a more effective positioning effect and make the operator have better impression. The operator can also switch the circle to other faces in the picture even through the intelligent mobile terminal in cooperation with the gesture or the control on the terminal, and the operation feeling is stronger.
The technical means disclosed in the invention scheme are not limited to the technical means disclosed in the above embodiments, but also include the technical scheme formed by any combination of the above technical features. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principle of the present invention, and such improvements and modifications are also considered to be within the scope of the present invention.
Claims (7)
1. An intelligent picture recognizing method based on a broadcasting and TV set-top box is characterized by comprising the following steps:
step 1, the intelligent mobile terminal and the set top box of the radio and television system can carry out information interaction;
step 2, an operator holds the intelligent mobile terminal to send a screen capturing instruction, and the screen capturing instruction is transmitted to the set top box;
step 3, the set-top box intercepts a television-end playing picture after receiving a screen capturing instruction sent by the intelligent mobile terminal;
and 4, forwarding the screenshot picture in the step 3 to a background server, identifying the screenshot picture by the background server, sending the identified actor information and related program content to the intelligent mobile terminal and/or the set top box, displaying the actor information, and pushing the program.
2. The intelligent picture recognizing method based on the broadcasting and television set top box as claimed in claim 1, wherein: and 2, synchronously transmitting the screen capturing instruction sending time and the screen capturing instruction to the set top box, and finding and capturing the picture played by the television at the corresponding operation time in the stored television content by the set top box according to the operation occurrence time.
3. The intelligent picture recognizing method based on the broadcasting and television set top box as claimed in claim 1, wherein: in step 4, the actor information identified by the background server may be sent to the set-top box and displayed on the television.
4. The intelligent picture recognizing method based on the broadcasting and television set top box as claimed in claim 1, wherein: and in the step 3, when a plurality of actors exist in the screenshot, all actors which are recorded in the data and exist on the screenshot are identified in the background server in the step 4, and when the actor information is sent back to the intelligent mobile terminal or the set top box, the detailed information and the related programs are displayed after the actors are selected on the terminal interface or the television in a selectable mode.
5. The intelligent picture recognizing method based on the broadcasting and television set top box as claimed in claim 1, wherein: the method comprises the steps that a motion sensing device is arranged in a set top box or an intelligent television, the motion sensing device identifies the motion and the position of an intelligent mobile terminal, the specific position in a television picture which an intelligent operator tries to circle is obtained by combining the direction of the television, a background server obtains the specific position and a screen capture picture, only actors at the specific position in the picture are identified, and information and related programs of the actors are retrieved and pushed.
6. The intelligent picture recognizing method based on the broadcasting and television set top box as claimed in claim 1, wherein: when the operator circles the position of a specific actor, the set top box controls the television to display the screen capture picture, and displays a circle at the specific position so as to display the specific actor selected by the operator to the operator, so that background resource waste caused by misoperation of the operator is avoided.
7. The intelligent picture recognizing method based on the broadcasting and television set top box as claimed in claim 6, wherein: the set-top box can be preset with a face recognition program to recognize a plurality of face positions in the screen shot and draw circles around the actor face position closest to the specific position.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110161006.7A CN112995724A (en) | 2021-02-05 | 2021-02-05 | Intelligent picture recognizing method based on broadcasting and television set top box |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110161006.7A CN112995724A (en) | 2021-02-05 | 2021-02-05 | Intelligent picture recognizing method based on broadcasting and television set top box |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112995724A true CN112995724A (en) | 2021-06-18 |
Family
ID=76348032
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110161006.7A Pending CN112995724A (en) | 2021-02-05 | 2021-02-05 | Intelligent picture recognizing method based on broadcasting and television set top box |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112995724A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106886350A (en) * | 2017-01-20 | 2017-06-23 | 维沃移动通信有限公司 | A kind of communication information display method and mobile terminal based on image |
| CN108111898A (en) * | 2017-12-20 | 2018-06-01 | 聚好看科技股份有限公司 | The display methods and smart television of the graphic user interface of television image sectional drawing |
| CN108391160A (en) * | 2018-01-15 | 2018-08-10 | 山东浪潮商用系统有限公司 | A kind of screenshotss method, system and set-top box |
| CN109922363A (en) * | 2019-03-15 | 2019-06-21 | 青岛海信电器股份有限公司 | A kind of graphical user interface method and display equipment of display screen shot |
-
2021
- 2021-02-05 CN CN202110161006.7A patent/CN112995724A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106886350A (en) * | 2017-01-20 | 2017-06-23 | 维沃移动通信有限公司 | A kind of communication information display method and mobile terminal based on image |
| CN108111898A (en) * | 2017-12-20 | 2018-06-01 | 聚好看科技股份有限公司 | The display methods and smart television of the graphic user interface of television image sectional drawing |
| CN108391160A (en) * | 2018-01-15 | 2018-08-10 | 山东浪潮商用系统有限公司 | A kind of screenshotss method, system and set-top box |
| CN109922363A (en) * | 2019-03-15 | 2019-06-21 | 青岛海信电器股份有限公司 | A kind of graphical user interface method and display equipment of display screen shot |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10536736B2 (en) | System and method for surveying broadcasting ratings | |
| CN104427352B (en) | A kind of method and system for the mobile terminal recording playback television video that user interaction is shared | |
| US8301618B2 (en) | Techniques to consume content and metadata | |
| CN103404129B (en) | Square matrix code is used to promote to change places broadcasting | |
| CN105100829B (en) | Video content intercept method and device | |
| US20110289532A1 (en) | System and method for interactive second screen | |
| US10250838B1 (en) | System and method for converting live action alpha-numeric text to re-rendered and embedded pixel information for video overlay | |
| CN102421012B (en) | Method and system for acquiring screenshot picture of television program | |
| CN107682714B (en) | Method and device for acquiring online video screenshot | |
| US20130205322A1 (en) | Method and system for synchronization of dial testing and audience response utilizing automatic content recognition | |
| CN102917247B (en) | Automatically the method identifying television channel and TV programme | |
| CN102428708A (en) | User-based media content chaptering systems and methods | |
| CN103828379A (en) | Using gestures to capture multimedia clips | |
| CN103533394A (en) | Information pushing method and device and server | |
| US20160277808A1 (en) | System and method for interactive second screen | |
| US10205973B2 (en) | Method and system for linking real-time broadcasting with non-real-time video service using user history information | |
| WO2016119504A1 (en) | Method and apparatus for sharing media programme | |
| CN110750719A (en) | IPTV-based information accurate pushing system and method | |
| EP2741490B1 (en) | Information processing apparatus and control methods for the same | |
| CN103368925A (en) | Device authentication method | |
| CN110557686A (en) | System and method for realizing playing satellite low-bit-rate live broadcast program by mobile terminal | |
| CN103828348A (en) | Using multimedia search to identify what viewers are watching on television. | |
| CN103108228A (en) | Method for identifying video contents in cross-screen mode through video images | |
| CN112995724A (en) | Intelligent picture recognizing method based on broadcasting and television set top box | |
| US20150288731A1 (en) | Content switching method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210618 |