KR101335317B1 - Video playing apparatus, terminal with video remote control function and operating method thereof - Google Patents

Abstract

According to the present invention, after downloading book information and video frame matching data to a video player, a book is photographed to check the page of the book using the book image and the book information, and to play a video frame matching the confirmed book page. The device and the terminal for requesting the video playback device to download the electronic book content or book information and video frame matching data, etc. to the terminal and to recognize the page of the book on the terminal and to play the video matching the book contents while viewing the book. The driving method relates to implementing a book and a video so as to utilize both the book and the video, thereby inducing an interest to the user and inducing more active reading.

Description

VIDEO PLAYING APPARATUS, TERMINAL WITH VIDEO REMOTE CONTROL FUNCTION AND OPERATING METHOD THEREOF}

The present invention relates to a video reproducing apparatus, a terminal having a video reproducing request function, and a driving method thereof. A video playback device for playing a synchronized video, and a terminal having a video playback request function for requesting a video playback device to play a video synchronized to a page, and a driving method thereof.

The importance of reading is constantly being emphasized, yes and now. However, as the contents provided through electronic media such as televisions, computers and smart phones are diversified and enormous, people's reading time is gradually decreasing.

People are bothered by readings that require static concentration because people are always exposed to video media, which makes it difficult for them to have a chance to read. Therefore, there is a need for a new way to induce interest and interest in reading that is falling dramatically.

In addition, there is a need for a new concept of reading method that can give fun and immersion by using video media because of difficulty for reading instruction of infants or students.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and an object of the present invention is to provide a method for inducing reading that can increase interest and immersion, in general, from static and boring reading.

Another object of the present invention is to enhance the reading fun of the user through the linkage between reading the book and viewing the image by playing the video matching the current book page when the user simultaneously watching the related video while viewing the book.

To this end, according to a first aspect of the present invention, a video playback system according to the present invention, a content providing device for providing book information and video frame matching data; A camera for photographing the book to generate a book image; Downloading book information and video frame matching data from the content providing device, checking a book page from the generated book image based on the book information, and matching a video frame to the checked book page based on the video frame matching data. It characterized in that it comprises a video playback device for playing the video.

According to a second aspect of the present invention, a video reproducing apparatus according to the present invention comprises a page checking unit for checking a book page from a book image photographed and generated by a camera using book information; A frame extractor which extracts a video frame matching the identified book page using the video frame matching data; And a playback unit for playing the extracted video frame.

According to a third aspect of the present invention, a terminal having a video playback request function according to the present invention includes a download unit for downloading electronic book content and video frame matching data from a content providing device through a communication network; A memory unit for storing the electronic book content and video frame matching data; A display unit which displays the electronic book contents; And a video playback request unit for requesting playback of a video frame matching a specific page of the electronic book content using the video frame matching data.

According to a fourth aspect of the present invention, a terminal having a video playback request function according to the present invention includes a download unit for downloading book information and video frame matching data from a content providing device through a communication network; A memory unit which stores the book information and video frame matching data; A photographing unit which photographs a book and generates a book image; A page checking unit which checks a book page from the generated book image by using the book information; A frame extractor configured to extract a video frame matching the book page using the video frame matching data; And a video playback request unit for requesting playback of the extracted video frame.

According to a fifth aspect of the present invention, a video playback method according to the present invention includes a photographing step of photographing a book to generate a book image; A page checking step of checking a book page from the generated book image by using book information; A frame extraction step of extracting a video frame matching the book page using video frame matching data; And a reproducing step of reproducing the extracted video frame.

According to a sixth aspect of the present invention, a video reproducing method using a terminal according to the present invention includes a download step of downloading electronic book content and video frame matching data from a content providing device through a communication network; A display step of displaying the electronic book contents; And a video play request step of requesting to play a video frame matched to a specific page of the electronic book content by using the video frame matching data.

According to a seventh aspect of the present invention, a video playback method using a terminal according to the present invention includes a download step of downloading electronic book content from a content providing device through a communication network; A display step of displaying the electronic book contents; And a video play request step of requesting a video play device to play a video associated with the electronic book content.

According to an eighth aspect of the present invention, a video reproducing method using a terminal according to the present invention includes a download step of downloading book information and video frame matching data from a content providing device through a communication network; A photographing step of generating a book image by photographing the book; A page checking step of checking a book page from the generated book image by using the book information; A frame extracting step of extracting a video frame matching the book page using the video frame matching data; And a video play request step of requesting a video play device to play the extracted video frame.

According to the present invention, by matching the existing video content and the book to play the video frame of the portion corresponding to the page when the page switching of the book, providing a new reading experience through the linkage between the reading of the book and the video view and It has an interesting effect.

According to the present invention, since the video playback apparatus can reproduce the content matching the book without a separate operation, there is an effect of providing convenience to the user.

In addition, you can request the playback of the video associated with the part you are currently reading while viewing the electronic book or book through a terminal such as an electronic book device or a smart phone, which can induce reading interest and operate the video playback device without a separate remote control. It has an effect.

1 is a view schematically showing the technical configuration of a video playback system according to an embodiment of the present invention.
2 is a diagram schematically illustrating a technical configuration of a video reproducing apparatus according to an embodiment of the present invention.
3 is a flowchart illustrating a video playback method according to an embodiment of the present invention.
4 is a diagram schematically illustrating a video playback request system according to an embodiment of the present invention.
5 is a diagram schematically illustrating a technical configuration of a terminal having a video play request function according to an embodiment of the present invention.
6 is a flowchart illustrating a method of playing a video using a terminal according to an embodiment of the present invention.
7 is a flowchart illustrating another method of playing a video using a terminal according to an embodiment of the present invention.
8 is a diagram schematically illustrating a video playback request system according to another embodiment of the present invention.
9 is a diagram schematically illustrating a technical configuration of a terminal having a video play request function according to another embodiment of the present invention.
10 is a flowchart illustrating a method of playing a video using a terminal according to another embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. The configuration of the present invention and the operation and effect thereof will be clearly understood through the following detailed description. Before describing the present invention in detail, the same components are denoted by the same reference symbols as possible even if they are displayed on different drawings. In the case where it is judged that the gist of the present invention may be blurred to a known configuration, do.

Referring to Figure 1 to describe the technical configuration of the video playback system according to an embodiment of the present invention.

As illustrated, the video playback system includes a content providing device 10, a camera 20, and a video playback device 30.

The moving picture may be stored in a DVD (Digital Versatile Disc) or may be downloaded through a communication interface and stored in the moving picture reproducing apparatus 30.

The content providing device 10 provides book information and video frame matching data. The content providing device 10 provides corresponding data when a request for downloading the book information and video frame matching data is received from the video reproducing apparatus 30.

Here, the book information is unique identification information attached to the pages of the book, and the book information contains the title information and the page information of the book, and when checking the book information, it is possible to know which page of the book.

For example, a 13-digit number of an international standard book number (ISBN) code, which is a unique identifier attached to a book, may be formed by adding the number of the corresponding page. For example, the book's 13 page book information may be 97889 *** 21557 13, page 13 of the book's ISBN 97889 *** 21557.

For reference, ISBN codes are internationally unique identifiers that are standardized in ISO2108 and KSX6004. A three-digit prefix (978), consisting of 13 digits, added to match EAN, a 2-digit national language code identifying the manufacturer's country ('89' in Korea), and a 3-digit publisher assigned to the manufacturer or salesman. It consists of 13 digits, including a code, a 4-digit title code, and a 1-digit check digit that verifies a barcode error.

The video frame matching data refers to a data table in which a reproduction start time and an end time of a video frame matched with a page are recorded.

Table 1 below is an example of video frame matching data.

Video frame number Playback start time (seconds) End time (seconds) One 0:00 4:59 2 5:00 8:59 ... ... ... N 55:00 59:59

The camera 20 includes a lens, a camera module, and the like, and serves to generate a book image by the user taking a book. The camera module converts the optical signal from the lens into an analog electrical signal, and converts the electrical signal into digital data through a slight processing of a current or voltage proportional to the image brightness. The book image generated by the camera 20 is digital data and is transmitted to the moving picture reproducing apparatus 30.

The video reproducing apparatus 30 downloads book information and video frame matching data from the content providing apparatus 10, checks a book page from the generated book image based on the book information, and based on the video frame matching data. Play a video frame matching the identified book page.

A detailed description of the video reproducing apparatus 30 will be described with reference to FIG. 2.

Referring to the drawings, the video reproducing apparatus 30 includes a communication interface (I / F) 31, a download unit 32, a memory unit 33, a page check unit 34, a frame extractor 35, and a reproduction unit. The unit 36 includes an image display unit 37 and a user interface (I / F) 38.

The communication I / F 31 plays a role in which the video player 30 communicates with an external device such as the content providing device 10.

The download unit 32 downloads book information and video frame matching data from the content providing device 10 through a communication network.

The memory unit 33 stores book information and video frame matching data received from the download unit 32.

The page checker 34 checks book pages from book images photographed by the camera. The page identification unit 34 first extracts identification information (for example, a character string, a string of characters, or a combination of letters and numbers) of a computer-readable data form from a book image, and extracts the identification information and the memory unit 33. Check the book page using the book information stored in.

The frame extractor 35 extracts a video frame matching the book page checked by the page checker 34. The frame extractor 35 matches book information with video frame matching data stored in the memory 33 to extract a video frame matching the book page.

The playback unit 36 plays a video frame extracted by the frame extraction unit 35. The playback unit 36 requests the image display unit 37 to play back the video frame extracted by the frame extraction unit 35 and visually display the image frame so that the user can recognize it.

The image display unit 37 serves to visually display a video frame reproduced at the request of the playback unit 36. The image display unit 300 includes display devices such as a cathode ray tube (CRT), a liquid crystal display (LCD), and a touch screen.

The user I / F 38 serves as an operation means for supporting a user to perform an operation for driving a video. The user I / F 38 may be a keypad or touch pad.

Next, a video reproducing method using the video reproducing apparatus 30 will be described with reference to FIG. 3.

The video reproducing apparatus 30 is connected to the content providing apparatus 10 through the communication I / F 31 of the video reproducing apparatus 30, and downloads book information and video frame matching data from the content providing apparatus 10. The memory unit 33 stores the data in the memory unit 33 (S100).

Next, by using the camera 20, the page of the book spread out within the shooting range is photographed to generate a book image (S110). The generated book image is transmitted to the video reproducing apparatus 30 connected to the camera 20.

The page checking unit 34 of the moving image reproducing apparatus 30 that receives the generated book image recognizes an identification code in the book image (S120).

Next, the page checking unit 34 converts the recognized identification code into information in a form that can be recognized by the computer (S130), and compares the converted identification code with the book information stored in the memory unit 33 to read a book. How many pages of the book page is checked (S140). Information about the confirmed book page is transmitted to the frame extraction unit 35.

The frame extractor 35 receiving the information about the book page extracts a video frame matching the book page, which is the received information, by using the video frame matching data stored in the memory 33 (S150). The extracted video frame information is transmitted to the playback unit 36.

When the video frame information is transmitted to the playback unit 36, the playback unit 36 plays back the extracted video frame (S160), and visually displays the video data to be reproduced on the video display unit 37 so that the user can recognize it. .

If a video image of a new book page is received from the camera while the video reproducing apparatus 30 is playing the video frame in the same manner as above, the video frame matching the book information of the book image is extracted through the above steps, It is determined whether to stop playing the video frame being played.

For the above determination, the playback unit 36 checks the playing time of the video frame to determine whether the preset time has been exceeded.

If the playback time of the previous video frame exceeds the preset time, the playback of the previous video frame is maintained, and when the playback of the previous video frame is completed, the next extracted video frame is played.

If the playback time of the previous video frame does not exceed the preset time, the playback of the previous video frame is stopped and the next extracted video frame is played.

4 and 5, a technical configuration of a terminal 40 (hereinafter referred to as a video playback request terminal) having a video playback request function according to an embodiment of the present invention will be described.

The video play request system includes a content providing device 10, a video play request terminal 40, and a video play device 130.

The content providing device 10 is a device for providing electronic book content and video frame matching data, and serves to provide corresponding data when a download request for the electronic book content and video frame matching data is requested from the video playback request terminal 40. do.

The video playback request terminal 40 downloads the electronic book content and video frame matching data from the content providing device 10 and matches the video frame with a specific page of the electronic book content displayed on the video playback request terminal 40. Serves to request the regeneration of.

E-book content refers to e-books that provide books that are published offline through the Internet. Instead of using traditional paper books, the e-book content uses the Hypertext Markup Language (HTML) and the Extensible Markup Language (XML). Speak a digitized book.

The video play request terminal 40 has a function of an electronic book reading terminal (hereinafter, abbreviated as a video play request terminal) for a user to read data contained in an electronic book. In the video playback request terminal 40, a convergence type integrated terminal such as an electronic book reader, a mobile communication terminal, or a PDA may be used.

The video reproducing apparatus 130 plays a corresponding video frame in response to a request from the video reproducing request terminal 40.

The structure of the video reproduction request terminal 40 will be described with reference to FIG. 5.

As illustrated, the video reproduction request terminal 40 includes a download unit 41, a memory unit 42, a display unit 43, a video reproduction request unit 44, and a user input unit 45.

The download unit 41 downloads electronic book content and video frame matching data from a content providing device through a communication network.

The memory 42 stores the electronic book content and the video frame matching data.

The display unit 43 serves to retrieve and visually display electronic book content stored in the memory unit 42 by an input of the user input unit 45. The display unit 43 may be an LCD or a touch screen. In the case of a touch screen, the display unit 43 may receive a user's manipulation signal.

The video playback request unit 44 serves to request playback of a video frame matching a specific page of electronic book content displayed on the display 43.

The video play request unit 44 may be implemented in an accessory form and provided to the terminal 40.

Hereinafter, a method of playing a video using a terminal according to an embodiment of the present invention will be described with reference to FIG. 6.

The download unit 41 of the video reproduction request terminal 40 downloads the electronic book content and the video frame matching data from the content providing device 10 through the communication network and stores the electronic book content and the video frame matching data in the memory unit 42 (S200).

One of the electronic book contents stored in the memory unit 42 is selected through the user input unit 45 and displayed on the display unit 43 (S210).

The video reproduction request unit 44 extracts a video frame matching the specific page of the electronic book content displayed on the display unit 43 using the video frame matching data. The extraction is performed using moving picture frame matching data that matches the identification code embedded in each page of the electronic book content. The video reproducing request unit 44 transmits a signal for requesting reproduction of the extracted video frame to the video reproducing apparatus 130 using near field communication (S220).

Examples of the near-field communication method of the electromagnetic period include infrared communication, Bluetooth, ZigBee, ultra wideband (UWB), WiFi, and digital living area network (DLNA).

Next, another method of playing a video using a terminal according to an embodiment of the present invention will be described with reference to FIG. 7.

In order to play a video using the video reproducing request terminal 40, first, electronic book content is downloaded from the content providing device 10 through a communication network and stored in the memory unit 42 (S205).

Next, when the user selects the desired electronic book content through the user input unit 45, the selected content is displayed on the touch screen (S210). When the selected content is displayed, the display unit 43 displays a page switch button on the page of the electronic book content (S215).

When the page switch button is touched, a request for reproduction of a video frame is requested according to a signal detected by the touch screen (S225). The playback request is performed by transmitting a signal for moving to the video of the previous or next frame to the video playback device 130 when a touch that turns over the page of the electronic book content displayed on the touch screen is detected.

In addition, when a touch for turning over the page of the electronic book content displayed on the touch screen is detected regardless of the page switch button, a signal for moving to the video of the previous or next frame may be transmitted to request playback of the video frame.

A search setting button may be displayed on a portion of the touch screen such as a play setting button for adjusting a play state of a moving picture, a pause, etc., a search start button for searching another frame, and a search stop button.

When various buttons on the touch screen are touched, a signal for requesting playback, stop, search, etc. corresponding to the various buttons is transmitted to the video reproducing apparatus 130 using near field communication.

The video reproducing apparatus 130 which has received a request signal from the video reproducing request terminal 40, such as reproduction, midpoint, retrieval start, and retrieval stop, executes replay and retrieval according to the request signal.

Next, a video playback request system according to an exemplary embodiment of the present invention will be described with reference to FIG. 8. The video playback request system includes a content providing apparatus 10, a video playback request terminal 140, and a video playback apparatus 130. It includes.

The content providing device 10 provides book information and video frame matching data, and serves to provide corresponding data when a download request for the book information and video frame matching data is received from the video reproduction request terminal 140. .

The video playback request terminal 140 downloads book information and video frame matching data from the content providing device, photographs a book image, checks a book page using the photographed book image and the downloaded book information, and the video. Based on the frame matching data, it plays a role of requesting reproduction of a video frame matching the identified book page.

The video player 130 plays a corresponding video frame in response to a request from the video play request terminal 140.

Next, a structure of a video playback request terminal according to another embodiment of the present invention will be described with reference to FIG. 9. As shown, the video playback request terminal 140 includes a communication I / F 141 and a download unit. 142, a memory unit 143, a photographing unit 144, a page checking unit 145, a frame extracting unit 146, and a video reproduction requesting unit 147.

The communication I / F 141 plays a role in which the video reproduction request terminal 40 communicates with an external device such as the content providing device 10 or the camera 20.

The download unit 142 downloads book information and video frame matching data from the content providing device 10 through a communication network.

The memory unit 143 stores the book information and the video frame matching data downloaded from the download unit 142.

The photographing unit 144 includes a lens, a camera module, and the like, and serves to generate a book image by the user photographing the book. A camera module (not shown) converts an optical signal from a lens into an analog electric signal and converts the electric signal into digital data through a slight process of a current or voltage proportional to the image brightness.

The page checking unit 145 checks a book page from the book image photographed by the photographing unit 144. The page identification unit 145 extracts identification information (for example, a character string, a string, or a combination of letters and numbers) of a computer-readable data form from the book image, and extracts the identification information and the memory unit 143 into the extracted identification information. Check the book page using the saved book information.

The frame extractor 146 extracts a video frame matching the book page checked by the page checker 145. The frame extractor 146 matches the book information with the video frame matching data stored in the memory 143 to extract a video frame matching the book page.

The video play request unit 147 serves to request playback of the video frame extracted by the frame extractor 146. The video play request unit 147 may be implemented in an accessory form and provided to the terminal 40.

A method of playing a video using a terminal according to another embodiment of the present invention will be described with reference to FIG. 10. The video playback request terminal 140 connects to the content providing device 10 through the communication I / F 141, downloads book information and video frame matching data from the content providing device 10, and executes the video playback device ( 10 is stored in the memory unit 143 (S300).

Next, the photographing unit 144 photographs the pages of the book spread out within the photographing range and generates a book image of the photographed book page (S310). The generated book image is transmitted to the page confirmation unit 145.

The received page confirmation unit 145 recognizes the identification code displayed on the book from the generated book image (S320).

Next, the page checking unit 145 converts the recognized identification code into information that can be recognized by the computer (S330), and then converts the converted identification information into a book using the book information stored in the memory unit 143. How many pages of the book page is checked (S340). Information about the confirmed book page is transmitted to the frame extractor 146.

The received frame extractor 146 extracts a video frame matching the book page, which is the received information, by using the video frame matching data stored in the memory 143 (S350). The frame extractor 146 transmits the extracted video frame information to the video reproduction request unit 147.

The video play request unit 147 having received the video frame information transmits a signal for requesting the play of the video frame to the video play device 130 to request the play of the video frame (S360).

The video player 130 that receives the play request signal plays the video frame according to the play request signal. When the video reproducing apparatus 130 receives a new play request signal even when the video frame is being played, the video play device 130 stops playing the video frame being played and plays the corresponding video frame according to the new play request signal.

The foregoing description is merely illustrative of the present invention, and various modifications may be made by those skilled in the art without departing from the spirit of the present invention. Accordingly, the embodiments disclosed in the specification of the present invention are not intended to limit the present invention. The scope of the present invention should be construed according to the following claims, and all the techniques within the scope of equivalents should be construed as being included in the scope of the present invention.

According to the present invention, by linking video content such as books and DVDs, the possibility of utilization as educational tools and entertainment devices that induce user's interest increases.

In addition, the simple way to find and play DVDs that map to books improves media accessibility for people who have difficulty handling machines.

10: content providing device 30, 130: video playback device
40, 140: video playback request terminal
31: Communication I / F 32, 41, 142: Download section
33, 42, 143: memory 34, 145: page confirmation
35, 146: frame extraction section 36: playback section
37: video display unit 38: user I / F
44, 147: video playback request unit 45: user input unit
144: the shooting unit

Claims (23)

A content providing device providing book information and video frame matching data;
A camera for photographing the book to generate a book image; And
Downloading book information and video frame matching data from the content providing device, checking a book page from the generated book image based on the book information, and matching a video frame to the checked book page based on the video frame matching data. Video playback device to play
Includes, the video playback device is
When a new book page is checked during playback of a specific video frame, it is determined whether the playback time of the video frame that matches the previous page exceeds the preset time, and if the playback time of the previous video frame exceeds the preset time, To continue playing, when the previous video frame is complete, play the next extracted video frame,
And if the playing time of the previous video frame does not exceed the preset time, the playback of the previous video frame is stopped and the new video frame is played. A page checking unit for checking a book page from a book image photographed and generated by a camera using book information;
A frame extractor which extracts a video frame matching the identified book page using the video frame matching data; And
A playback unit for playing the extracted video frames;
Includes, the regeneration unit
When a new book page is checked during playback of a specific video frame, it is determined whether the playback time of the video frame that matches the previous page exceeds the preset time, and if the playback time of the previous video frame exceeds the preset time, To continue playing, when the previous video frame is complete, play the next extracted video frame,
If the playback time of the previous video frame does not exceed the preset time, the playback of the previous video frame is stopped, the video playback device characterized in that for playing a new video frame. The apparatus of claim 2, wherein the page identification unit recognizes the identification code displayed on the book from the photographed book image. The apparatus of claim 2, further comprising: a downloader configured to download the book information and the video frame matching data from a content providing device and store it in a memory through a communication network;
Image display unit for visually displaying the video frame to be played
The video playback device further comprising. The apparatus of claim 4, wherein the video frame matching data is a data table that sets a playback start time and a stop time of a video frame matching a book page. delete delete delete A photographing step of generating a book image by photographing the book;
A page checking step of checking a book page from the generated book image by using book information;
A frame extraction step of extracting a video frame matching the book page using video frame matching data; And
A playback step of playing back the extracted video frame;
The playback step of playing the extracted video frame includes:
When a new book page is checked during playback of a specific video frame, it is determined whether the playback time of the video frame that matches the previous page exceeds the preset time, and if the playback time of the previous video frame exceeds the preset time, To continue playing, when the previous video frame is complete, play the next extracted video frame,
If the playback time of the previous video frame does not exceed the preset time, stopping playback of the previous video frame and executing playback of the new video frame;
The video playing method further comprising. The method of claim 9, further comprising downloading and storing book information and video frame matching data from a content providing device through a communication network.
In the page checking step, the book page is identified from the generated book image using the book information, and in the frame extracting step, a video frame matching the checked book page is extracted using the video frame matching data. How to play video. The method of claim 9, wherein the checking of the page comprises: recognizing an identification code displayed on the book from the generated book image;
And converting the recognized identification code into information in a computer readable data format. delete delete delete delete delete delete delete delete delete delete delete A photographing step of generating a book image by photographing the book;
A page checking step of checking a book page from the generated book image by using book information;
A frame extraction step of extracting a video frame matching the book page using video frame matching data;
A playback step of playing back the extracted video frame;
The playback step of playing the extracted video frame includes:
When a new book page is checked during playback of a specific video frame, it is determined whether the playback time of the video frame that matches the previous page exceeds the preset time, and if the playback time of the previous video frame exceeds the preset time, To continue playing, when the previous video frame is complete, play the next extracted video frame,
A computer-readable recording medium having recorded thereon a program for stopping playback of a previous video frame and executing playback of a new video frame when the playback time of the previous video frame does not exceed the preset time.

Images