TW201843606A - Real-time information searching apparatus when playing image and operation method thereof - Google Patents

Abstract

An operation method of a real-time information searching apparatus when playing an image includes: providing a display image through a display screen; receiving an image capturing command; generating a capturing image captured from the display image according to the image capturing command; automatically lunching an image recognition program to recognize the capturing image to automatically frame at least one object's image from the capturing image; receiving an object selection command to select at least one of all framed object's image as a searching target according to the object selection command; automatically lunching a network searching function to search information corresponding to the searching target from an internet; and, displaying the corresponding information on the display screen.

Description

Instant information searching device in image playing and operation method thereof

The present invention relates to an electronic device and an operation method thereof, and more particularly to an instant information search device for image playback and an operation method thereof.

Movies such as movies or dramas are often popular indicators, often interspersed with popular objects, so viewers are often interested in the objects that appear in the film. On the other hand, objects appearing in educational films, such as animals, plants or artifacts, often allow viewers to watch the film and hope to obtain further information about the above objects.

However, the current device does not provide a convenient and fast way for the viewer to instantly find the information of the object or obtain similar objects. If you really want to search, you have to do it step by step.

The invention provides an instant information searching device and a method for operating the same in the image playing, so that the viewer can use the image captured in the video playing to instantly find the information of the object in the image or instantly find the object similar to the object in the image. Viewers can easily refer to or purchase.

According to an embodiment of the present invention, a method for operating an instant information search device for video playback includes providing a display image through a display screen, receiving an image capture instruction, and intercepting the display image according to the image capture instruction to generate a captured image; automatically opening the image recognition The program recognizes the captured image to automatically capture the image of at least one object in the image; and receives the object selection instruction to select at least one of the images of all the selected objects as the search target according to the object selection instruction; automatically opening the network search function To search for the corresponding information on the Internet for the target search; and display the corresponding information through the display screen.

As an optional implementation manner, the method for operating the instant information searching device in the video playback further includes receiving an image frame selection command to select an image of at least one object in the image as a search target according to the image frame selection instruction frame.

As an optional implementation manner, the method for operating the instant information searching device in the video playback further includes storing an image of at least one object.

According to another embodiment of the present invention, an instant information searching device for video playback is provided, including a display screen, a display screen driver, an instruction receiving unit, and a system control unit. The display screen is used to provide a display image. The display driver is electrically coupled to the display screen for receiving the image signal, and displaying the display image according to the image signal control display screen. The instruction receiving unit is configured to receive an image interception instruction or an object selection instruction. The system control unit is electrically coupled with the instruction receiving unit and the display screen driver for: (1) intercepting the display image according to the image capturing instruction to generate a captured image; (2a) automatically turning on the image recognition program to identify the captured image, and automatically selecting the captured image. Selecting at least one object in the image according to the object selection instruction, and selecting at least one of the images of all the selected objects as the search target; (3) automatically turning on the network search function to search for the corresponding information on the target search internet; (4) Display the corresponding information by displaying the screen driver through the display screen.

As an optional implementation, the command receiving unit is further configured to receive an image frame selection instruction, and the system control unit is further configured to: (2b) select, according to the image frame selection instruction frame, an image of at least one object in the image as a search target.

In an optional embodiment, the instant information searching device for video playback further includes a storage unit electrically coupled to the system control unit for storing an image of at least one object and providing the stored image of at least one object to the system. control unit.

The instant information searching device and the operation method thereof in the image playing of the embodiment of the invention provide a viewer with a screenshot searching function, so that when viewing the dynamic or static image, the viewer can find the interested person or object through the function, so that The system screenshot, and the viewer can select the object to be searched, the system will automatically open the web search engine and search the image of the object to achieve the purpose of instantly searching for object information or similar object information.

The specific embodiments of the present invention are shown in the following drawings and the written description, and the contents of the drawings and the text are examples, and are not intended to limit the scope of the invention.

Please refer to FIG. 1A. FIG. 1A is a flowchart of a method for operating an instant information searching device in video playback according to an embodiment of the present invention. 2 is a schematic diagram of an operation state of an instant information searching device in video playback according to an embodiment of the present invention, FIG. 3 is a schematic diagram of an operation of intercepting an image according to an embodiment of the present invention, and FIG. 4 is a schematic diagram of an embodiment of the present invention. FIG. 5 is a system block diagram of an instant information searching device for video playback according to an embodiment of the present invention.

In order to enable the viewer to view the dynamic or static image through the display screen, first, in step S110, the display image 112 is provided through the display screen 110, and the display image 112 may be a continuously changing dynamic movie or a still picture. In the present embodiment, as shown in FIG. 2, the display image 112 is a movie or a picture in which a plurality of women pick up rice ears in the field. When viewing the display image 112, the viewer can find that the displayed image has the content of interest, and can operate the instruction receiving unit 130 to issue the image capturing instruction Sc1. The command receiving unit 130 can be, for example, a device having a command input and receive function, such as a remote control device, a touch panel, a gesture sensing device, an image detecting device, a mouse or a keyboard, and a peripheral module thereof, and the command receiving unit 130 can be provided with a button. Or a defined operational type (eg, a specific gesture) to correspond to the image capture instruction Sc1. In step S112, after the video information capture device receives the image capture command Sc1 sent by the viewer operation command receiving unit 130, step S114 may be performed: the captured image 112 is captured according to the image capture command to generate the captured image 210. (As shown in Figure 3). In the present embodiment, the captured image 210 is generated by intercepting the full screen of the display screen 110, but is not limited thereto. Then, the instant information searching device 100 can perform the step S116A: automatically opening the image recognition program to recognize the captured image 210, and then automatically capturing the image 212 of the at least one object in the image 210.

For example, please refer to Figure 3. The image recognition program can recognize the image 212 of the object 210, such as a garment, a cap, a backpack, and the like, in the image 210, but the identifiable object is not limited thereto, and the image recognition program is The database can contain information about objects that other viewers are interested in. In addition, the image recognition program can operate in an offline device or through the operation of the cloud computing center to upload the captured image to a remote database for calculation.

Through the step S116A, the instant information searching device 100 during image playback can obtain the image 212 of at least one object. In the embodiment shown in FIG. 3, the image 212 of the three objects is automatically selected, but is not limited thereto. Then, step S117 is executed: the object selection instruction Sc3 is received, and at least one of the images 212 of all the selected objects is selected as the search target according to the object selection instruction Sc3. In other words, the viewer can send the object selection command Sc3 to the instant information search device 100 for video playback through the command receiving unit 130, and select at least one of the images 212 of all the selected objects as the search target through the object selection command Sc3. Further, in step S118, the network search function is automatically turned on, and the image of at least one object selected in step S117 is used as a search target to search for corresponding information 216 on the Internet (as shown in FIG. 4). For example, in the video playing, the instant information searching device 100 can use the image of the object as an input image of the network search engine to perform image search, and the network search engine can, for example, search for images of each portal website (Google image Search) or the image search function of the online store, or you can use the image search function to find the text information corresponding to the image of the object, and then use the obtained text information as the product search target of the online store, and then obtain Correspondence information on the Internet 216. The corresponding information 216 is, for example but not limited to, an associated picture, name, price, or introduction of the object as the search target. For example, please refer to FIG. 4. FIG. 4 is a schematic diagram of corresponding information display according to an embodiment of the present invention. In FIG. 4, after the screen 110 is searched for the image 212 of the object of FIG. 3 and searched for the corresponding information 216 on the Internet, the display information of the similar items provided by the current network selling places may be displayed, including The item name and the price, that is, step S119: the corresponding information 216 is displayed through the display screen 110. In addition, the application scope of the present invention is not limited to the application of online shopping. In educational use, an image of an object can also be used to search for academic information related to the object.

Referring to the embodiment of FIG. 1B, FIG. 1B is a flowchart of a method for operating an instant information searching device in video playback according to an embodiment of the present invention. In general, the flow difference between FIG. 1A and FIG. 1B is that step S116A is an automatic frame selection object (requires step S117 to manually select an object to be searched for), and step S116B is to manually select an object to be searched (step S117 is not required). In step S116B, the instant information searching device 100 during image playback can also receive the image frame selection command Sc2 to select an image of at least one object in the image 210 according to the image frame selection command Sc2. In detail, in step S116B, the viewer is allowed to input the image frame selection command Sc2 through the command receiving unit 130, and directly informs the image capturing device that the current information searching device 100 is currently interested in the captured image 210 during the video playing. The block position is selected, and the image 214 of at least one object in the image 210 is selected. In the embodiment shown in FIG. 3, the viewer manually selects an image 214 of an object, but is not limited thereto. Then, the network search function is automatically started in step S118, and the image 214 of the at least one object selected in step S116B is used as a search target to search for corresponding information on the Internet.

As an optional implementation, please refer to FIG. 1C and refer to FIG. 3 together. FIG. 1C is a flowchart of a method for operating an instant information searching device in video playback according to an embodiment of the present invention. In step S116A, the image recognition program automatically recognizes the captured image 210 and automatically selects the image 212 of the at least one object in the image 210. Then, in step S117, the instant information searching device 100 during the video playback can receive the object selection instruction Sc3, and according to The object selection instruction Sc3 selects at least one of the images 212 of all the selected objects as the search target. If the viewer finds that there is an object that is interested in searching for the information, the viewer can also input the image frame selection command Sc2 through the command receiving unit 130, so that the instant information searching device 100 during the video playback receives the image in step S116B. The frame selection instruction Sc2 is used to select the image 214 of the at least one object in the image 210 as the search target according to the image frame selection command Sc2. Further, in step S118, the network search function is automatically turned on, and the image 212 of at least one object manually selected in step S117 and the image 214 of at least one object manually selected in step S116B are used as search targets to search for corresponding information on the Internet.

In addition, please refer to FIG. 1D. FIG. 1D is a partial flowchart of a method for operating an instant information searching device in video playback according to an embodiment of the present invention. In each embodiment, after the image of one or more objects is obtained through steps S116A and S117 or S116B, the instant information searching device 100 during image playback may store the acquired one or more objects before performing the next step. The images 212, 214 are used to facilitate subsequent steps or upload the cloud for big data analysis.

Through the operation method of the instant information searching device in the video playing according to the above embodiment of the present invention, the viewer's screenshot search function is provided, so that when viewing the dynamic or static image, the viewer can find the interested person or thing through the function. A screenshot of the system, and the viewer can select the object to be searched or automatically recognize the object in the screenshot via the device, and automatically open the web search engine and perform image search on the image of the object, thereby realizing instant search for object information or similar objects. The role of information.

The above is a flow chart of the operation method of the instant information searching device in the video playing according to the embodiment of the present invention. The above steps are not specifically described in the order of execution of the above steps unless otherwise stated or technically caused. The limit. The system architecture of the instant information search device for video playback according to the embodiment of the present invention is described below, which can be operated by, but not limited to, the above-described operation method.

Please refer to Figure 5. The instant information search device 100 during video playback includes a display screen 110, a display screen driver 120, an instruction receiving unit 130, and a system control unit 140.

The display screen 110 is used to provide the display image 112. In other words, the display screen 110 can perform step S110. The display screen 110 can be, for example, a liquid crystal display or an organic light emitting diode display. Display image 112 can be a dynamic or static image.

The display screen driver 120 is electrically coupled to the display screen 110. The display screen driver 120 is configured to receive the image signal Vd and control the display screen 110 according to the image signal Vd to provide the display image 112. In detail, the display screen driver 120 is, for example, an assembly that displays the underlying control circuit of the screen 110 and the upper layer control circuit. The underlying control circuit is, for example, a source driving circuit for displaying a screen, a gate driving circuit, a timing control circuit, and peripheral circuits thereof. The upper layer control circuit can be, for example, a video signal decoder and its peripheral circuits, and the like, and can be used to provide signals required for driving the underlying control circuit. In addition, in the present specification, "(electrical) coupling" or "(electrical) connection" does not limit the direct connection or coupling between the two elements.

The command receiving unit 130 is configured to receive the image capture command Sc1 or the image frame selection command Sc2 or the object selection command Sc3. In detail, the command receiving unit 130 can be, for example, a remote control device, a touch panel, a gesture sensing device, an image detecting device, A device having a command input and receive function, such as a mouse or a keyboard, and a peripheral module thereof. The instruction receiving unit 130 and the system control unit 140 communicate with each other to provide instructions for the viewer to issue and process the viewer's instructions. The instruction receiving unit 130 may send the instruction issued by the viewer to the system control unit 140 after being processed. In addition, in the present specification, if “or” is used to juxtapose a plurality of elements, there is no suggestion or explicit that the elements that are juxtaposed are mutually exclusive and can only be selected. In other words, the term “or” is used in this specification. Cannot be directly interpreted as "mutually exclusive or".

The system control unit 140 is electrically coupled to the instruction receiving unit and the display screen driver 120. The system control unit 140 is configured to: (1) intercept the display image 112 according to the image capturing instruction Sc1 to generate the captured image 210; (2a) automatically turn on the image recognition program identification The image 210 is intercepted, and the image 212 of at least one object in the image 210 is automatically selected, and at least one of the images 212 of all the selected objects is selected as a search target according to the object selection instruction Sc3; (2b) according to the image frame selection instruction The Sc2 frame selects the image 214 of the at least one object in the image 210 as the search target; (3) automatically turns on the network search function to search for the corresponding information on the target search internet; and (4) controls the display screen 110 through the display screen driver 120. The corresponding information 216 is displayed.

In detail, the system control unit 140 is, for example, a processor of the instant information search device 100 during video playback and an assembly of peripheral circuits thereof, and the system control unit 140 and the command receiving unit 130 communicate with each other, and can process the instant information search device during video playback. The interaction operation between the viewer and the viewer is performed in response to an instruction issued by the instruction receiving unit 130 by the viewer (for example, turning on and executing a specific program, performing a specific circuit operation, and controlling the instant information search device 100 in the video playback. Other circuits), and respond to instructions from the viewer. The system control unit 140 can be integrated with the display screen driver 120 or partially integrated, and the system control unit 140 can control the display screen driver 120 to respond to the viewer's instructions, and then control the display screen 110 through the display screen driver 120 to generate an appropriate display. content.

Therefore, the system control unit 140 can use the image capturing instruction Sc1 provided by the instruction receiving unit 130 to intercept the display image 112 to generate the captured image 210, and automatically open the image recognition program to identify the captured image 210. The image recognition program can be stored in the system control unit 140 for storage. The device or the remote computing center, the image recognition program identifies the captured image 210 to automatically frame the image 212 of the at least one object in the captured image. The system control unit 140 may be configured to select the image 214 of the at least one object in the captured image according to the image frame selection instruction Sc2 provided by the instruction receiving unit 130. After the images 212 and 214 of the object are obtained, the system control unit 140 is configured to automatically enable the network search function to search for the corresponding information 216 on the Internet by using at least one object as a search target, that is, the system control unit 140 can automatically The images 212, 214 of the object are provided as input commands for the network search function, and the corresponding information 216 returned by the network search function is received. Thereafter, in order to enable the viewer to view the corresponding information 216, the system control unit 140 can control the display screen driver 120 to cause the display screen 110 to display the corresponding information 216.

According to an optional embodiment, the instant information searching device 100 for image playback further includes a storage unit 150. The storage unit 150 is electrically coupled to the system control unit 140. The storage unit 150 is configured to store images 212 and 214 of at least one object and provide The stored images 212, 214 of at least one object are supplied to the system control unit 140. In particular, the storage unit 150 can be, for example, a volatile memory device or a non-volatile memory device such as a hard disk or a memory. The storage unit 150 can be configured to automatically open the image recognition program to identify the image 212 of the object captured by the captured image 210 or store the image 214 of the at least one object in the captured image 210 according to the image frame selection instruction Sc2 to facilitate the subsequent network. The application of the road search, for example, provides the system control unit 140 to read an image of the stored object.

In summary, the present invention provides an instant information search device for video playback and an operation method thereof. Through the instant information search device and the operation method thereof, the viewer can utilize the image captured during the video playback. Instantly find information about the objects in the picture or instantly find objects similar to the objects in the picture so that the viewer can easily refer to or purchase.

S110~S119, S120‧‧‧ steps of the operation method of the instant information search device during video playback

100‧‧‧Instant information search device for video playback

110‧‧‧ Display screen

112‧‧‧Display image

120‧‧‧Display screen driver

130‧‧‧Instruction Receiving Unit

140‧‧‧System Control Unit

150‧‧‧storage unit

210‧‧‧ Capture images

212‧‧‧Image of objects

214‧‧‧Image of objects

216‧‧‧ Corresponding information

Vd‧‧‧ video signal

Sc1‧‧‧ image capture instruction

Sc2‧‧‧ image frame selection instruction

Sc3‧‧‧object selection instruction

1A, FIG. 1B and FIG. 1C are respectively a flowchart of an operation method of an instant information searching device in video playback according to an embodiment of the present invention; FIG. 1D is a partial flow chart of an operation method of an instant information searching device in video playback according to an embodiment of the present invention; FIG. 2 is a schematic diagram of an operation state of an instant information search device in an image playback according to an embodiment of the present invention; FIG. 3 is a schematic diagram of an operation of intercepting an image according to an embodiment of the present invention; FIG. 5 is a system block diagram of an instant information searching device for video playback according to an embodiment of the present invention.

Claims (6)

An operation method for an instant information search device in image playback, comprising: providing a display image through a display screen; receiving an image capture instruction; intercepting the display image according to the image capture instruction to generate a captured image; automatically enabling image recognition program identification Intercepting an image to automatically select an image of the at least one object in the captured image; receiving an object selection instruction to select at least one of the images of all the selected objects as a search target according to the object selection instruction; The road search function searches the corresponding information on the Internet with the search target; and displays the corresponding information through the display screen. The method for operating an instant information search device for video playback as described in claim 1, further comprising receiving an image frame selection command to select an image of at least one of the captured images according to the image frame selection instruction frame. Search for the target. The method for operating an instant information search device for video playback as described in claim 1, further comprising storing an image of the at least one object. An instant information searching device for video playback includes: a display screen for providing a display image; a display screen driver electrically coupled to the display screen for receiving an image signal and controlling the display according to the image signal The display unit provides an image capture unit for receiving an image capture command or an object selection command; a system control unit electrically coupled to the command receiving unit and the display screen driver for intercepting instructions according to the image Intercepting the display image to generate a captured image; automatically opening the image recognition program to identify the captured image to automatically select an image of the at least one object in the captured image; selecting at least one of the images of all the selected objects according to the object selection instruction As a search target; automatically opening a network search function, searching for the corresponding information on the Internet by the search target; and controlling the display screen to display the corresponding information through the display screen driver. The instant information searching device for video playback according to the fourth aspect of the invention, wherein the command receiving unit is further configured to receive an image frame selection command, and the system control unit is further configured to select a frame according to the image frame selection instruction The image of at least one object in the captured image is used as the search target. The instant information search device for image playback according to the fourth aspect of the invention, further comprising a storage unit electrically coupled to the system control unit for storing an image of the at least one object and providing the stored at least one The image of the object is given to the system control unit.