CN111491177A - Video information extraction method, device and system - Google Patents
Video information extraction method, device and system Download PDFInfo
- Publication number
- CN111491177A CN111491177A CN201910079450.7A CN201910079450A CN111491177A CN 111491177 A CN111491177 A CN 111491177A CN 201910079450 A CN201910079450 A CN 201910079450A CN 111491177 A CN111491177 A CN 111491177A
- Authority
- CN
- China
- Prior art keywords
- information
- video
- displaying
- acquiring
- party application
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000605 extraction Methods 0.000 title claims abstract description 41
- 238000000034 method Methods 0.000 claims abstract description 19
- 230000003068 static effect Effects 0.000 claims description 5
- 230000004075 alteration Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000000354 decomposition reaction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application provides a video information extraction method, which comprises the following steps: displaying the video; receiving a feature selection instruction about a video; searching for feature elements in the video according to the feature selection instruction, wherein the feature elements comprise object images in the images of the video and/or object names in the sound of the video; acquiring corresponding object information according to the characteristic elements; and displaying related suggested information corresponding to the things and/or related information of the things in a third-party application according to the things information. The application also provides a device and a system applying the video information extraction method. By the method, the content information can be directly extracted in the video playing process, the related suggestions and the corresponding third-party application service are obtained, a user can conveniently know the interesting things in the video, and meanwhile, the related service is provided for the user immediately.
Description
Technical Field
The application relates to the technical field of videos, in particular to a video information extraction method, and a video information extraction device and a video information extraction system applying the video information extraction method.
Background
Along with the development of technology and the improvement of living standard of people, the entertainment life is gradually enriched. In daily entertainment, the information acquisition of video playing also becomes an important issue.
In the current video playing service, the user only needs to simply push video production information, and if the user is interested in a certain object in the video, the user needs to search for relevant information by himself or search for relevant third-party application service by himself, which is very inconvenient.
In view of the various defects in the prior art, the inventors of the present application have made extensive studies to provide a video information extraction method, and a video information extraction apparatus and a video information extraction system using the video information extraction method.
Disclosure of Invention
The video information extraction method, the video information extraction device and the video information extraction system using the video information extraction method can extract content information directly in a video playing process, obtain related suggestions and corresponding third-party application services, facilitate users to know interested things in videos, and provide related services for the users instantly.
In order to solve the above technical problem, the present application provides a video information extraction method, including the following steps: displaying the video; receiving a feature selection instruction about a video; searching for feature elements in the video according to the feature selection instruction, wherein the feature elements comprise object images in the images of the video and/or object names in the sound of the video; acquiring corresponding object information according to the characteristic elements; and displaying related suggested information corresponding to the things and/or related information of the things in a third-party application according to the things information.
In one embodiment, the step of displaying the video specifically includes: acquiring a video picture; decomposing continuous video pictures into independent static pictures, and numbering different static pictures; and displaying the numbered video pictures.
In one embodiment, the step of receiving a feature selection instruction for a video specifically includes: acquiring a screen contact or voice information of a video; and acquiring a feature selection instruction corresponding to the video picture according to the screen contact, or acquiring a feature selection instruction corresponding to the video sound according to the voice information.
In one embodiment, the step of acquiring the corresponding object information according to the feature element specifically includes: identifying feature elements in the video; and acquiring the object information corresponding to the characteristic elements through the cloud server.
In one embodiment, the step of displaying relevant suggested information corresponding to the object and/or relevant information of the object in the third-party application according to the object information specifically comprises the following steps: acquiring and displaying related suggestion information corresponding to the object through a cloud server according to the object information; or finding and displaying the related information of the object information in the third-party application.
In one embodiment, the step of searching and displaying the related information of the object information in the third-party application specifically includes: judging the classification of the object information; opening third-party applications of corresponding categories according to the classification of the object information; and searching and displaying related information in the third-party application according to the object information.
In one embodiment, the step of determining the category of the object information further includes: and storing the classification standard of the object information according to the prestored third-party application function.
In one embodiment, the step of searching and displaying relevant information in a third-party application according to the transaction information specifically includes: judging the number of third-party applications corresponding to the classification of the object information; if the number of the third-party applications is equal to one, calling and displaying a related information interface of the object information in the third-party applications; and if the number of the third-party applications is more than one, displaying all the third-party application identifications and acquiring application selection instructions, and calling and displaying relevant information interfaces of the corresponding object information in the third-party applications according to the application selection instructions.
The application also provides a video information extraction device, which comprises a vehicle-mounted terminal; the vehicle-mounted terminal is used for displaying videos, receiving a feature selection instruction related to the videos, searching feature elements in the videos according to the feature selection instruction, acquiring corresponding object information according to the feature elements, and displaying related suggestion information corresponding to the objects and/or related information of the objects in third-party application according to the object information.
The application also provides a video information extraction system, which comprises the video information extraction device and a cloud server; the video information extraction device obtains the object information and the third-party application through the cloud server.
The video information extraction method, the video information extraction device and the video information extraction system which are used for extracting the video information can extract content information in the video playing process directly and obtain related suggestions and corresponding third-party application services. By the mode, the method and the device for providing the video can facilitate the user to know the interesting things in the video, and simultaneously provide the relevant service for the user in real time.
The foregoing description is only an overview of the technical solutions of the present application, and in order to make the technical means of the present application more clearly understood, the present application may be implemented in accordance with the content of the description, and in order to make the above and other objects, features, and advantages of the present application more clearly understood, the following preferred embodiments are described in detail with reference to the accompanying drawings.
Drawings
Fig. 1 is a flowchart illustrating a video information extraction method according to a first embodiment of the present application.
Fig. 2 is a flowchart illustrating a video information extraction method according to a second embodiment of the present application.
Fig. 3 is a schematic structural diagram of a video information extraction system according to an embodiment of the present application.
Detailed Description
To further clarify the technical measures and effects taken by the present application to achieve the intended purpose, the present application will be described in detail below with reference to the accompanying drawings and preferred embodiments.
While the present application has been described in terms of specific embodiments and examples for achieving the desired objects and objectives, it is to be understood that the invention is not limited to the disclosed embodiments, but is to be accorded the widest scope consistent with the principles and novel features as defined by the appended claims.
Fig. 1 is a flowchart illustrating a video information extraction method according to a first embodiment of the present application. As shown in fig. 1, the video information extraction method of the present embodiment includes the following steps:
step S11: and displaying the video.
Specifically, in an embodiment, the vehicle-mounted terminal displays a video through a display screen of the driving computer in this embodiment. In another embodiment, the in-vehicle terminal displays the video through a mobile terminal connected with the in-vehicle terminal in a wired or wireless manner.
Specifically, in an embodiment, the video includes, but is not limited to, a video acquired by the vehicle-mounted terminal through the internet of vehicles and/or a video acquired by the vehicle-mounted camera.
Step S12: a feature selection instruction is received for a video.
Specifically, in one embodiment, the vehicle-mounted terminal receives a feature selection instruction about a video in a video display process through a display screen input mode and/or a voice input mode.
Step S13: and searching for characteristic elements in the video according to the characteristic selection instruction.
In particular, in an embodiment, the feature elements comprise an image of a thing in an image of the video and/or a name of the thing in a sound of the video. The object image includes, but is not limited to, an individual object, a building, and a place environment in the video.
Step S14: and acquiring corresponding object information according to the characteristic elements.
Specifically, in one embodiment, the vehicle-mounted terminal acquires the object information corresponding to the feature element through the cloud server.
Step S15: and displaying related suggested information corresponding to the things and/or related information of the things in a third-party application according to the things information.
Specifically, in one embodiment, the vehicle-mounted terminal acquires relevant suggestion information corresponding to the object according to the object information and displays the relevant suggestion information through an interface for displaying videos. In another embodiment, the vehicle-mounted terminal acquires the related information of the object through a third-party application, and displays the related information of the object on the interface of the third-party application through the interface for displaying the video. The vehicle-mounted terminal can acquire the corresponding third-party application through the cloud server.
Specifically, in one embodiment, the vehicle-mounted terminal provides corresponding third-party application services according to object categories. For example, when the things are specific articles, the vehicle-mounted terminal provides corresponding e-commerce shopping service; when the things are specific buildings, the vehicle-mounted terminal provides corresponding navigation service; when the things are the place environment, the vehicle-mounted terminal provides corresponding place navigation service and weather forecast service (when the place appears in the future).
The video information extraction method of the embodiment can extract content information directly in the video playing process, obtain related suggestions and corresponding third-party application services, facilitate users to know interesting things in videos, and provide related services for the users in real time.
Fig. 2 is a flowchart illustrating a video information extraction method according to a second embodiment of the present application. As shown in fig. 2, the video information extraction method of the present embodiment includes the following steps:
step S21: and acquiring a video picture.
Step S22: successive video pictures are decomposed into separate still pictures and the different still pictures are numbered.
Specifically, in one embodiment, the vehicle-mounted terminal acquires characteristic elements of object images appearing in the video picture through decomposition processing of the video picture.
Step S23: and displaying the numbered video pictures.
Step S24: screen contact or voice information of the video is acquired.
Step S25: and acquiring a feature selection instruction corresponding to the video picture according to the screen contact, or acquiring a feature selection instruction corresponding to the video sound according to the voice information.
Step S26: feature elements in the video are identified.
Specifically, in one embodiment, the vehicle-mounted terminal acquires the feature selection instruction corresponding to the object image in the video picture by identifying a static picture corresponding to the screen touch point time and a picture position corresponding to the screen touch point position. In another embodiment, the vehicle-mounted terminal acquires the feature selection instruction corresponding to the name of the object in the video sound by identifying the voice information and comparing the voice information with the video voice information and/or the video subtitle information.
Step S27: and acquiring the object information corresponding to the characteristic elements through the cloud server.
Step S28: and acquiring and displaying related suggestion information corresponding to the object through the cloud server according to the object information, or searching and displaying related information of the object information in third-party application.
Specifically, in one embodiment, the vehicle-mounted terminal stores the classification standard of the object information according to a pre-stored third-party application function. The vehicle-mounted terminal judges the classification of the object information after acquiring the object information, then opens a third-party application of a corresponding category according to the classification of the object information, and finally searches and displays related information in the third-party application according to the object information.
Specifically, in one embodiment, the vehicle-mounted terminal determines the number of third-party applications corresponding to the classification of the object information. And if the number of the third-party applications is equal to one, the vehicle-mounted terminal calls and directly displays a related information interface of the object information in the third-party applications on the video display interface. If the number of the third-party applications is larger than one, the vehicle-mounted terminal displays all the third-party application identifications and acquires application selection instructions on the video display interface, and calls and displays the corresponding information interfaces of the object information in the third-party applications according to the application selection instructions.
The video information extraction method of the embodiment can directly provide the related information of things and the corresponding third-party application service for the user in the video playing process, and is convenient and quick.
Fig. 3 is a schematic structural diagram of a video information extraction system according to an embodiment of the present application. As shown in fig. 3, the video information extraction system in the present embodiment includes a video information extraction device 10 and a cloud server 20. The video information extraction device 10 includes a vehicle-mounted terminal 11.
The vehicle-mounted terminal 11 is used for displaying a video, receiving a feature selection instruction about the video, searching feature elements in the video according to the feature selection instruction, acquiring corresponding object information according to the feature elements, and displaying related suggestion information corresponding to the object and/or related information of the object in a third-party application according to the object information. In one embodiment, the vehicle-mounted terminal 11 acquires the object information corresponding to the feature element and the related suggestion information corresponding to the object through the cloud server 20. In another embodiment, the in-vehicle terminal 11 obtains the third-party application through the cloud server 20.
According to the method and the device, the content information can be directly extracted in the video playing process, and the related suggestions and the corresponding third-party application services are obtained. By the mode, the method and the device for providing the video can facilitate the user to know the interesting things in the video, and simultaneously provide the relevant service for the user in real time.
Although the present application has been described with reference to a preferred embodiment, it should be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the application, and all changes, substitutions and alterations that fall within the spirit and scope of the application are to be understood as being covered by the following claims.
Claims (10)
1. A method for extracting video information, comprising:
displaying the video;
receiving a feature selection instruction for the video;
searching for feature elements in the video according to the feature selection instruction, wherein the feature elements comprise object images in the images of the video and/or object names in the sound of the video;
acquiring corresponding object information according to the characteristic elements;
and displaying related suggestion information corresponding to the things and/or related information of the things in a third-party application according to the things information.
2. The method for extracting video information according to claim 1, wherein the step of displaying the video specifically comprises:
acquiring a video picture;
decomposing continuous video pictures into independent static pictures, and numbering different static pictures;
and displaying the numbered video pictures.
3. The method for extracting video information according to claim 1, wherein the step of receiving a feature selection instruction on the video specifically comprises:
acquiring a screen contact or voice information of the video;
and acquiring a feature selection instruction corresponding to the video picture according to the screen contact, or acquiring a feature selection instruction corresponding to the video sound according to the voice information.
4. The method for extracting video information according to claim 1, wherein the step of obtaining corresponding thing information according to the feature element specifically includes:
identifying feature elements in the video;
and acquiring the object information corresponding to the characteristic elements through a cloud server.
5. The method for extracting video information according to claim 1, wherein the step of showing relevant suggestion information corresponding to the thing and/or relevant information of the thing in a third-party application according to the thing information specifically comprises:
acquiring and displaying related suggestion information corresponding to the object through a cloud server according to the object information; or
And searching and displaying the related information of the transaction information in the third-party application.
6. The method for extracting video information according to claim 5, wherein the step of searching and displaying the related information of the transaction information in the third-party application specifically comprises:
judging the classification of the object information;
opening third-party applications of corresponding categories according to the classification of the object information;
and searching and displaying related information in the third-party application according to the transaction information.
7. The method for extracting video information according to claim 6, wherein the step of determining the category of the thing information further comprises:
and storing the classification standard of the object information according to the prestored third-party application function.
8. The method for extracting video information according to claim 6, wherein the step of searching and displaying related information in the third-party application according to the transaction information specifically comprises:
judging the number of third-party applications corresponding to the classification of the object information;
if the number of the third-party applications is equal to one, calling and displaying a related information interface of the object information in the third-party applications;
and if the number of the third-party applications is more than one, displaying all the third-party application identifications and acquiring application selection instructions, and calling and displaying related information interfaces of the object information in the corresponding third-party applications according to the application selection instructions.
9. The video information extraction device is characterized by comprising a vehicle-mounted terminal; the vehicle-mounted terminal is used for displaying videos, receiving feature selection instructions related to the videos, searching feature elements in the videos according to the feature selection instructions, acquiring corresponding object information according to the feature elements, and displaying related suggestion information corresponding to the objects and/or related information of the objects in third-party application according to the object information.
10. A video information extraction system comprising the video information extraction apparatus according to claim 9 and a cloud server; the video information extraction device acquires the object information and a third-party application through the cloud server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910079450.7A CN111491177A (en) | 2019-01-28 | 2019-01-28 | Video information extraction method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910079450.7A CN111491177A (en) | 2019-01-28 | 2019-01-28 | Video information extraction method, device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111491177A true CN111491177A (en) | 2020-08-04 |
Family
ID=71795768
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910079450.7A Pending CN111491177A (en) | 2019-01-28 | 2019-01-28 | Video information extraction method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111491177A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011080763A1 (en) * | 2009-12-31 | 2011-07-07 | Tata Consultancy Services Limited | A method and system for preprocessing the region of video containing text |
| CN102419945A (en) * | 2011-12-09 | 2012-04-18 | 上海聚力传媒技术有限公司 | Method, device, equipment and system for presenting display information in video |
| CN104113786A (en) * | 2014-06-26 | 2014-10-22 | 小米科技有限责任公司 | Information acquisition method and device |
| CN104113768A (en) * | 2014-06-26 | 2014-10-22 | 小米科技有限责任公司 | Associated information generation method and device |
| CN106534943A (en) * | 2016-11-25 | 2017-03-22 | 努比亚技术有限公司 | Video playing method and device |
| CN108462889A (en) * | 2017-02-17 | 2018-08-28 | 阿里巴巴集团控股有限公司 | Information recommendation method during live streaming and device |
| CN108882020A (en) * | 2017-05-15 | 2018-11-23 | 北京大学 | A kind of video information processing method, apparatus and system |
-
2019
- 2019-01-28 CN CN201910079450.7A patent/CN111491177A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011080763A1 (en) * | 2009-12-31 | 2011-07-07 | Tata Consultancy Services Limited | A method and system for preprocessing the region of video containing text |
| CN102419945A (en) * | 2011-12-09 | 2012-04-18 | 上海聚力传媒技术有限公司 | Method, device, equipment and system for presenting display information in video |
| CN104113786A (en) * | 2014-06-26 | 2014-10-22 | 小米科技有限责任公司 | Information acquisition method and device |
| CN104113768A (en) * | 2014-06-26 | 2014-10-22 | 小米科技有限责任公司 | Associated information generation method and device |
| CN106534943A (en) * | 2016-11-25 | 2017-03-22 | 努比亚技术有限公司 | Video playing method and device |
| CN108462889A (en) * | 2017-02-17 | 2018-08-28 | 阿里巴巴集团控股有限公司 | Information recommendation method during live streaming and device |
| CN108882020A (en) * | 2017-05-15 | 2018-11-23 | 北京大学 | A kind of video information processing method, apparatus and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111970577B (en) | Subtitle editing method and device and electronic equipment | |
| US20130243249A1 (en) | Electronic device and method for recognizing image and searching for concerning information | |
| KR20130022491A (en) | Apparatus and method for automatically recommending application using augmented reality data | |
| WO2005066882A1 (en) | Character recognition device, mobile communication system, mobile terminal device, fixed station device, character recognition method, and character recognition program | |
| US10701301B2 (en) | Video playing method and device | |
| CN103020173B (en) | Video image information searching method and system for mobile terminal and mobile terminal | |
| CN112672208B (en) | Video playing method, device, electronic equipment, server and system | |
| US10628955B2 (en) | Information processing device, information processing method, and program for identifying objects in an image | |
| CN110930220A (en) | Display method, display device, terminal equipment and medium | |
| CN113723087B (en) | Information processing method, device, equipment, readable storage medium and product | |
| EP2503545A1 (en) | Arrangement and method relating to audio recognition | |
| US20080215884A1 (en) | Communication Terminal and Communication Method Thereof | |
| CN110827849A (en) | Human voice separation method and device for database building, terminal and readable storage medium | |
| CN112148962B (en) | Method and device for pushing information | |
| CN112287790A (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN109151599B (en) | Video processing method and device | |
| CN111491177A (en) | Video information extraction method, device and system | |
| CN109672932B (en) | Method, system, device and storage medium for assisting vision-impaired person to watch video | |
| CN104866477A (en) | Information processing method and electronic equipment | |
| US11392646B2 (en) | Information processing device, information processing terminal, and information processing method | |
| CN113486212A (en) | Search recommendation information generation and display method, device, equipment and storage medium | |
| CN111414768A (en) | Information display method and device and electronic equipment | |
| US11792494B1 (en) | Processing method and apparatus, electronic device and medium | |
| CN114697761B (en) | Processing method, processing device, terminal equipment and medium | |
| CN113132789B (en) | Multimedia interaction method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Room 208, building 4, 1411 Yecheng Road, Jiading District, Shanghai, 201821 Applicant after: Botai vehicle networking technology (Shanghai) Co.,Ltd. Address before: Room 208, building 4, 1411 Yecheng Road, Jiading District, Shanghai, 201821 Applicant before: SHANGHAI PATEO ELECTRONIC EQUIPMENT MANUFACTURING Co.,Ltd. |
|
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200804 |