JP2014027635A - Portable terminal device and information communication system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable terminal device capable of allowing a video-recording content reproduction device to reproduce a highlight scene selected by a user after allowing a user to obtain the contents of a highlight scene.SOLUTION: A portable terminal device 10 includes: a program related information acquisition unit 51 that can control an image display device 3 capable of reproducing a video-recorded television program and acquires merchandise information and time information of a television program preserved in the image display device 3 from a server device 20 for storing merchandise information related to a merchandise, etc. introduced in a television program and time information when the merchandise, etc., has been introduced by association for each television program; a display unit 11 for displaying acquired merchandise information in a television program; a UI unit 12 for selecting merchandise information displayed in the display unit; and a recorder control unit 53 for reproducing a television program corresponding to merchandise information from a scene corresponding to a time indicated by time information associated with the merchandise information when the UI unit 12 selects the merchandise information.

Description

  The present invention includes a mobile terminal device that can record video content, control a recorded content playback device that plays back the recorded video content, and a mobile terminal device and a server device that can communicate with each other via a communication network. To an information communication system.

  In recent years, recording apparatuses having a so-called “whole recording” function for recording all television programs broadcast on each broadcasting channel have become widespread. Using such a recording device, the user records a television program broadcast on all channels during a specified period, and later selects a television program to be viewed from the plurality of recorded television programs. It is possible to watch.

  However, on the other hand, since the time for watching TV programs is limited for the user, if many TV programs are recorded in this way, the number of TV programs stored unviewed increases. However, it tends to be difficult to view all stored TV programs. Therefore, in order to resolve this situation, when watching a recorded and saved TV program, you can watch only the highlight scene of the TV program, rather than watching from the start to the end of the program. There is a request to do.

  For example, Patent Documents 1 and 2 disclose methods according to the related art for solving such problems.

  Patent Document 1 describes, in the control information, additional data such as subtitle comments posted by a plurality of users for the video content in conjunction with the playback of the video content, such as Nico Nico Douga (registered trademark). In a video content playback apparatus that plays back based on the playback start time and playback end time, and the display position, a scene where a large amount of additional data is concentrated per unit time is extracted from the video content, for example, A technique is disclosed in which only the extracted scenes are sequentially reproduced when a user presses a skip reproduction button provided on a remote controller.

  Patent Document 2 discloses a technique for ranking recorded scenes of video content based on audio power in each scene and sequentially reproducing only the higher-ranked scenes.

JP 2010-10737 A JP 2008-193270 A

  According to the technique disclosed in Patent Document 1, a user can reproduce and view only scenes that many people are interested in or have noticed. Further, according to the technique disclosed in Patent Document 2, the user can reproduce and view only scenes set with high importance according to a predetermined criterion.

However, in any of the technologies, the user cannot grasp what kind of highlight scene is extracted from the video content, and must sequentially watch the automatically extracted highlight scene. I must. For this reason, the user is forced to view a highlight scene that is not so important for the user, which is not convenient for the user.

  An object of the present invention is a portable terminal device capable of controlling a recorded content playback apparatus that records video content and plays back the recorded video content, and allows the user to grasp the contents of a highlight scene. It is intended to provide a mobile terminal device capable of causing a recorded content playback device to play back a highlight scene selected by the above, and an information communication system including the mobile terminal device and a server device.

The present invention is a portable terminal device capable of acquiring content identification information for identifying video content from a recorded content playback device capable of playing back stored video content and controlling the recorded content playback device. ,
Video content that matches the content identification information by transmitting the content identification information to a server device that stores the video content related information related to the video content and time information indicating the playback position of the video content in association with each other Video content related information acquisition means for acquiring video content related information and time information,
Display means for displaying the video content related information acquired by the video content related information acquisition means for each video content;
Selecting means for selecting one video content related information from the video content related information displayed on the display means;
When one video content related information is selected by the selection means, the video content corresponding to the one video content related information corresponds to the time indicated by the time information associated with the one video content related information. A portable terminal device comprising control signal output means for outputting a control signal for reproducing from a scene to the recorded content reproduction device.

  Further, the present invention is characterized in that the content identification information is a set of identification information of a broadcasting station where the video content is broadcast and a time when the video content is broadcasted.

  The display unit may display the video content related information in association with a time axis indicating a broadcast time of the video content corresponding to the video content related information based on the time information. And

The present invention also provides climax information indicating the degree of climax for the video content at each divided time obtained by dividing the broadcast time of the video content at a predetermined time interval for each video content broadcast on each broadcast channel. Further comprising a climax information acquisition means for acquiring the climax information of the video content stored in the recorded content playback device from the server device for storing;
The display means displays the climax information acquired by the climax information acquisition means in association with the time axis.

Further, the present invention is characterized in that the degree of climax in each of the divided times is calculated from the number of miniblog posts related to the video content posted in the divided time.
Further, in the present invention, the time axis displayed on the display means can select any time on the time axis by the selection means,
When an arbitrary time on the time axis is selected by the selection means, the control signal output means reproduces video content corresponding to the time axis from a scene corresponding to the time selected by the selection means. A control signal is output to the recorded content reproduction apparatus.

  Further, the present invention is characterized in that the display means displays the title information included in the video content corresponding to the video content related information together with the video content related information.

The present invention also provides login information storage means for storing login information for logging in to a predetermined server device;
Using login information stored in the login information storage means, further including user information acquisition means for acquiring user information of the user related to the login information from the predetermined server device;
The video content related information acquisition means acquires video content related information corresponding to the user based on the user information acquired by the user information acquisition means.

The present invention is also an information communication system comprising a mobile terminal device and a server device that can communicate with each other via a communication network,
The server device
Video content related information storage means for storing video content related information related to the video content and time information indicating a playback position of the video content in association with each other;
Video content related information transmitting means for transmitting video content related information and time information stored in the video content related information storage means to the mobile terminal apparatus for video content that matches content identification information received from the mobile terminal device; Including
The mobile terminal device can acquire content identification information for identifying video content from a recorded content playback device capable of playing back stored video content, and can control the recorded content playback device,
Request signal transmission means for transmitting to the server device the content identification information acquired from the recorded content playback device in the request signal for requesting video content related information of the video content stored in the recorded content playback device;
Video content related information and time information for video content that matches the content identification information included in the request signal, transmitted from the video content related information transmission unit in response to the request signal transmitted by the request signal transmission unit. Video content related information acquisition means for acquiring
Display means for displaying the video content related information acquired by the video content related information acquisition means for each video content;
Selecting means for selecting one video content related information from the video content related information displayed on the display means;
When one video content related information is selected by the selection means, the video content corresponding to the one video content related information corresponds to the time indicated by the time information associated with the one video content related information. An information communication system comprising control signal output means for outputting a control signal for reproduction from a scene to the recorded content reproduction apparatus.

In the present invention, the video content related information is information related to any of a product, a facility, a person, a character, and a place that appear in the video content corresponding to the video content related information.
The time information is a time when the video content related information appears in the video content.

In the present invention, the video content related information is a post message of a miniblog related to video content corresponding to the video content related information posted by a predetermined poster.
The time information is a time when the video content related information is posted.

  According to the present invention, it is possible to cause the recorded content playback apparatus to play back the highlight scene selected by the user after allowing the user to grasp the contents of the highlight scene.

1 is a schematic configuration diagram showing a schematic configuration of an information communication system 1 according to an embodiment of the present invention. It is a top view which shows the external appearance of the portable terminal device 10 which concerns on one Embodiment of this invention. It is a block diagram which shows one Example of a structure of the portable terminal device 10, the server apparatus 20, and the video display apparatus 3 which comprise the information communication system 1 which concerns on one Embodiment of this invention. It is a figure which shows one Example of the transition of the screen displayed on the display part 11 at the time of remotely operating the video display apparatus 3 using the portable terminal device 10 which concerns on this embodiment. It is a figure which shows the goods list screen D5 which concerns on another Example. It is a figure which shows the other Example of the transition of the screen displayed on the display part at the time of remotely operating the video display apparatus 3 using the portable terminal device 10 which concerns on this embodiment. It is a figure which shows the further another Example of the transition of the screen displayed on the display part 11 at the time of remotely operating the video display apparatus 3 using the portable terminal device 10 which concerns on this embodiment. It is a figure which shows the goods list screen D9 which concerns on another Example. It is a figure which shows the goods list screen D10 which concerns on another Example. It is a figure which shows the miniblog list screen D11 which concerns on another Example. It is a figure which shows the miniblog list screen D12 which concerns on another Example. It is a figure which shows the miniblog list screen D13 which concerns on another Example.

  FIG. 1 is a schematic configuration diagram showing a schematic configuration of an information communication system 1 according to an embodiment of the present invention. The information communication system 1 according to the present embodiment includes a mobile terminal device 10 and a server device 20 that can communicate with each other via a communication network 2.

  FIG. 2 is a plan view showing an appearance of the mobile terminal device 10 according to the embodiment of the present invention. The mobile terminal device 10 according to the present embodiment is configured to be communicable with the server device 20 via the communication network 2, and further stores a recorded TV program and can display a stored TV program. The apparatus 3 (recorded content playback apparatus) is configured to be remotely controllable.

When the portable terminal device 10 receives an operation for inputting a command or data to the display unit 11 that can display an image and the control unit 13 and receives an operation by the user, the command signal or input data corresponding to the operation is received. Is realized by a UI (User Interface) unit 12, a flash memory and an HDD (Hard Disk Drive), etc., and a storage device for storing various programs and data, a CPU (Central Processing Unit), a ROM (Read Only Memory), RAM (Random Access Memory) and the like, and a control unit 13 (see FIG. 3) that controls the entire mobile terminal device 10 according to various programs stored in a ROM or a storage device, and a communication unit 14 ( (See FIG. 3).

In the present embodiment, the storage device stores an application program for realizing a function of remotely operating the video display device 3. The display unit 11 is realized by, for example, a liquid crystal display including a liquid crystal panel and a backlight unit, an organic EL (Electroluminescence) display, or the like. In the present embodiment, the UI unit 12 is realized by a touch panel 12a that can detect a touch input to an image display area in the display unit 11.

  The communication unit 14 functions as a communication interface for performing communication with the video display device 3 by short-range wireless communication. In the present embodiment, communication between the mobile terminal device 10 and the video display device 3 is performed using a wireless local area network (LAN) such as the IEEE 802.11 standard. In another embodiment, communication using infrared rays may be used, and communication based on wireless communication standards such as Bluetooth (registered trademark) and Zigbee (registered trademark) may be used.

  Further, the communication unit 14 includes a communication control unit and an antenna. The communication control unit performs wireless communication with the mobile phone base station via the antenna, and realizes a voice call with another terminal having a telephone function. In addition, the communication control unit realizes data communication with the server device 20 via the communication network 2 including the mobile phone network and the Internet.

  Communication with the server device 20 may be performed via a wireless LAN router (not shown). In this case, the wireless LAN router is connected to the Internet by FTTH or the like, and the wireless LAN router relays communication of the mobile terminal device 10 with the Internet. In this case, the video display device is also connected to the wireless LAN router, and communication between the mobile terminal device 10 and the video display device is performed via the wireless LAN router.

  In the present embodiment, a smartphone is assumed as the mobile terminal device 10, but the present invention is not limited to this, and in other embodiments, for example, a conventional mobile phone device (feature phone) that is not a smartphone or a PDA It may be realized by a terminal device that does not have a telephone function such as (Personal Digital Assistant).

  FIG. 3 is a block diagram showing an example of the configuration of the mobile terminal device 10, the server device 20, and the video display device 3 constituting the information communication system 1 according to the embodiment of the present invention.

First, the configuration of the video display device 3 will be described.
The video display device 3 includes a display unit 31 that can display an image, a program receiving unit 32, a communication unit 33, a control unit 34 that controls the entire video display device 3, and a program storage unit 35. Is done.

  The display unit 31 is realized by, for example, a liquid crystal display, a plasma display, an organic EL display, or the like. The program receiving unit 32 receives and decodes broadcast waves transmitted by, for example, terrestrial broadcasting, satellite broadcasting, cable TV, and the like.

  The communication unit 33 functions as a communication interface for performing communication with the mobile terminal device 10 by short-range wireless communication. In the present embodiment, communication between the mobile terminal device 10 and the video display device 3 is performed using the wireless LAN as described above.

The control unit 34 is a signal transmitted from the recorder control unit 53 and receives a channel selection signal for selecting one broadcast channel from among a plurality of broadcast channels, and broadcasts on the selected broadcast channel. The television program in the middle is displayed on the display unit 31.

  In addition, when a recording command or a recording reservation command is input by the user using a dedicated remote controller, the control unit 34 records a television program related to the recording command or the recording reservation command, and stores the data of the recorded television program as a program Stored in section 35. The recording command or the recording reservation command may designate one television program, and the video display device 3 has a so-called “whole recording” function for recording all the television programs broadcast on each broadcasting channel. If it has, it may specify the period to record all.

  The program storage unit 35 is realized by a storage medium such as an HDD, and is built in the display device constituting the display unit 31 in the present embodiment. The program storage unit 35 may be any storage medium other than the HDD as long as it can store TV program data.

  In this embodiment, when the communication unit 33 receives a recording list request signal transmitted from the mobile terminal device 10 and requesting a list of television programs stored in the program storage unit 35, the control unit 34 Recording list data indicating a list of TV programs stored in 35 is created, and the communication unit 33 is caused to transmit the created recording list data to the mobile terminal device 10 that has transmitted the recording list request signal. The recording list data includes at least program identification information for uniquely identifying a recorded program. For example, in television broadcasting, since a program can be uniquely determined by a set of a broadcasting station name and a broadcasting time, this information is used.

  In the present embodiment, one of the TV programs transmitted from the mobile terminal device 10 and stored in the program storage unit 35 is requested to be played from the beginning of the program or from a specified time. When the communication unit 33 receives the reproduction request signal to be reproduced, the control unit 34 extracts the television program that is requested to be reproduced from the program storage unit 35, and the extracted television program is extracted based on the reproduction request signal. Play from the beginning or from a specified time. Thereby, the television program requested to be reproduced is displayed on the display unit 31 from the beginning of the program or from the designated time.

  The video display device 3 according to the present embodiment is configured by incorporating the HDD that configures the program storage unit 35 in the display device that configures the display unit 31, but in other embodiments, the display device is configured as a display device. The video display device may be configured by electrically connecting a recording device having a recording function, which is provided separately from the display device, to each other. For example, a configuration in which the video display device is an HDD recorder, the display unit is a liquid crystal display, and they are connected by an HDMI cable is conceivable.

Next, the configuration of the server device 20 will be described.
The server device 20 includes a communication unit 41, a control unit 42 that controls the entire server device 20, and a program related information storage unit 43. The communication unit 41 functions as a communication interface for communicating with the mobile terminal device 10 via the communication network 2.

  In the present embodiment, the program-related information storage unit 43, for each television program broadcast on each broadcast channel, program identification information for uniquely identifying the program, products and facilities introduced in the television program ( Store) and location information, and information on persons and characters that appeared in the TV program (hereinafter, these information will be collectively referred to as “product information”) and the time when the product information was introduced in the TV program or The time information indicating the time of appearance is associated and stored. In television broadcasting, since a program can be uniquely determined by a set of a broadcasting station name and a broadcasting time, this information is used as program identification information. Similarly, the program identification information included in the recording list data is based on the broadcast station name and the broadcast time, so that the video display device 3 and the server device 20 can uniquely identify the program.

  In the present embodiment, when the communication unit 41 receives a product information request signal for requesting product information transmitted from the mobile terminal device 10 and stored in the program-related information storage unit 43, the control unit 42 receives the product information request. Analyzing the signal, extracting the requested product information and time information from the program related information storage unit 43, and transmitting the extracted product information and time information to the communication unit 41, the product information request signal 10 is transmitted.

Finally, the configuration of the mobile terminal device 10 will be described.
As described above, the mobile terminal device 10 includes the display unit 11, the UI unit 12, the control unit 13, and the communication unit 14. Further, the control unit 13 executes the application program for realizing the function of remotely operating the video display device 3 stored in the storage device, thereby displaying the program related information acquisition unit 51 and the program related information display. It functions as a control unit 52, a recorder control unit 53, an overall control unit 54, and a data storage unit 55.

  In response to an instruction from the overall control unit 54, the program related information acquisition unit 51 receives the product information introduced in the TV program stored in the program storage unit 35 of the video display device 3 to be controlled by the mobile terminal device 10. The requested product information request signal is generated, and the communication unit 14 transmits the generated product information request signal to the server device 20.

  In addition, the program related information acquisition unit 51 acquires product information and time information transmitted from the server device 20 via the communication unit 14 in response to the product information request signal transmitted to the server device 20. The program related information acquisition unit 51 passes the acquired product information and time information to the overall control unit 54.

  In response to a command from the overall control unit 54, the program related information display control unit 52 causes the display unit 11 to display the product information acquired by the program related information acquisition unit 51 in a predetermined display mode.

  In response to a command from the overall control unit 54, the recorder control unit 53 generates a recording list request signal for requesting a list of TV programs stored in the video display device 3 to be controlled by the mobile terminal device 10. The unit 14 is caused to transmit the generated recording list request signal to the video display device 3. In addition, the recorder control unit 53 acquires the recording list data transmitted by the video display device 3 via the communication unit 14 in response to the recording list request signal transmitted to the video display device 3.

  Furthermore, the recorder control unit 53 receives an instruction from the overall control unit 54, and selects one of the television programs stored in the video display device 3 to be controlled by the mobile terminal device 10 as the beginning of the program. Or a reproduction request signal for requesting reproduction from a designated time is generated, and the communication unit 14 is caused to transmit the generated reproduction request signal to the video display device 3. The above-described program identification information is used for identifying a television program.

  The overall control unit 54 controls the program related information acquisition unit 51, the program related information display control unit 52, the recorder control unit 53, and the data storage unit 55. In addition, command signals and input data corresponding to user operations on the touch panel 12 a and the operation buttons 12 b are input from the UI unit 12 to the overall control unit 54.

  The data storage unit 55 stores the product information and time information acquired by the program related information acquisition unit 51 and the recording list data acquired by the recorder control unit 53.

Hereinafter, using the mobile terminal device 10 according to the present embodiment, the video display device 3 is remotely operated,
An operation when a television program stored in the program storage unit 35 is reproduced will be described.

  FIG. 4 is a diagram illustrating an example of transition of screens displayed on the display unit 11 when the video display device 3 is remotely operated using the mobile terminal device 10 according to the present embodiment. FIG. 4A is a diagram illustrating the home screen D1 of the mobile terminal device 10.

  On the home screen D1, an icon I1 for executing an application program for realizing a function of remotely operating the video display device 3 is displayed together with an icon I2 for executing another application program. When the icon I1 is tapped by the user on the home screen D1, an application for realizing a function of remotely operating the video display device 3 is activated.

  FIG. 4B is a diagram showing a server list screen D2 displayed after activation of an application for realizing the function of remotely operating the video display device 3 (hereinafter referred to as “remote operation application”). When the remote operation application is activated, the overall control unit 54 creates server list data indicating a list of video display apparatuses 3 that can be remotely operated via the communication unit 14. For example, when a remote operation application is activated in a house and there are three video display devices 3 that can be remotely operated using the wireless LAN in the home, the three video display devices 3 are listed. Will be up.

  When creating the server list data indicating the list of remotely operable video display devices 3, the overall control unit 54 stores the server list data in the data storage unit 55 and, based on the server list data, the server list screen. A command for displaying D2 on the display unit 11 is given to the program-related information display control unit 52. When receiving the instruction, the program related information display control unit 52 displays the server list screen D2 on the display unit 11.

  On the server list screen D2, for each remotely operable video display device 3, a server selection button B1 in which a name or ID for specifying the video display device 3 is described is displayed. On the server list screen D2, if the number of remotely operable video display devices 3 increases and all of the server selection buttons B1 cannot be displayed in one screen, the screen is scrolled up and down on the screen. A scroll region that can be made to operate is provided.

  FIG. 4C is a diagram showing a recording list screen D3 displayed after an arbitrary server selection button B1 is tapped on the server list screen D2. When an arbitrary server selection button B1 is tapped by the user on the server list screen D2 shown in FIG. 4B, the overall control unit 54 specifies the video display device 3 corresponding to the tapped server selection button B1. Remote control target device information for storing is stored in the data storage unit 55, and a list of TV programs stored in the video display device 3 is acquired from the video display device 3 corresponding to the tapped server selection button B1. To the recorder control unit 53.

  When the recorder control unit 53 receives the instruction, the recorder control unit 53 generates a recording list request signal and transmits the recording list request signal to the communication unit 14. When the recording list data is acquired via the communication unit 14, the recorder control unit 53 54.

  The overall control unit 54 stores the recording list data given from the recorder control unit 53 in the data storage unit 55 and, based on the recording list data, issues a command for causing the display unit 11 to display the recording list screen D3. To the program related information display control unit 52. When receiving the instruction, the program related information display control unit 52 displays the recording list screen D3 on the display unit 11.

  In the present embodiment, the recording list data includes, for each television program stored in the video display device 3, program identification information, the title of the television program, the name of the broadcasting station that broadcasts the television program, and the television. Information indicating the recording start date and time when the recording of the program is started is stored.

  On the recording list screen D3, for each television program stored in the video display device 3, a selectable program selection button B2 in which a program title, a broadcasting station name, and a recording start date and time are described is displayed. At this time, when there are a plurality of television programs stored in the video display device 3, as shown in FIG. 4C, for example, the recording start date and time are displayed in order from the latest one.

  As shown in FIG. 4C, the number of selectable program selection buttons B2 is also increased in the recording list screen D3, and all the program selection buttons B2 are displayed in one screen. If the screen cannot be scrolled, a scroll area Sc that can be scrolled in the vertical direction of the screen is set.

  On the recording list screen D3, a return button B3 for returning to the screen displayed in the previous stage is displayed at the top of the screen. When the user taps the return button B3, the overall control unit 54 stores the data in the memory. Based on the server list data stored in the unit 55, a command for causing the display unit 11 to display the server list screen D2 shown in FIG.

  FIG. 4D is a diagram showing a product list screen D4 displayed after an arbitrary program selection button B2 is tapped on the recording list screen D3. When an arbitrary program selection button B2 is tapped by the user on the recording list screen D3 shown in FIG. 4C, the overall control unit 54 acquires product information related to the television program corresponding to the program selection button B2. Is given to the program related information acquisition unit 51.

  When receiving the instruction, the program related information acquisition unit 51 generates a product information request signal for requesting product information related to the television program corresponding to the program selection button B2, and causes the communication unit 14 to transmit the product information request signal. This signal includes at least program identification information. The server device 20 returns product information and time information for the program identified by the program identification information. When the communication unit 14 acquires product information and time information from the server device 20, the communication unit 14 gives the acquired product information and time information to the overall control unit 54.

  The overall control unit 54 stores the product information and time information given from the recorder control unit 53 in the data storage unit 55 and displays the product list screen D4 on the display unit 11 based on the product information and time information. Is given to the program related information display control unit 52. When receiving the instruction, the program related information display control unit 52 displays the product list screen D4 on the display unit 11.

  In the present embodiment, the product information includes image data depicting a product, a facility (store), a place, a person or a character (hereinafter referred to as “product etc.”), and information indicating the name of the product etc. ing. In the time information, the time when the product or the like of the product information associated with the time information was introduced or appeared in the television program is described.

  The product list screen D4 displays the program title, broadcast station name and recording start date and time described in the program selection button B2 selected by the user on the recording list screen D3, and displays the television program on the video display device 3. At the beginning, an opening reproduction button B4 for reproducing from the beginning is displayed.

  Further, on the product list screen D4, for each product information acquired from the server device 20, the image of the product etc., the name of the product etc., and the time when the product etc. was introduced or the time when it appeared, A highlight reproduction button B5 for reproducing the program from the time when the product or the like is introduced or the time when the program appears is displayed on the video display device 3. At this time, when there are a plurality of product information related to the television program, as shown in FIG. 4D, the introduced time or the appearing time is displayed in order from the earliest one.

  Further, on the product list screen D4, similarly to the recording list screen D3, a return button B3 for returning to the screen displayed in the previous stage is displayed at the top of the screen. When the user taps the return button B3, Based on the product information and time information stored in the data storage unit 55, the overall control unit 54 displays a program related information display instruction for displaying the recording list screen D3 shown in FIG. This is given to the control unit 52.

  As shown in FIG. 4 (d), the number of pieces of product information acquired from the server device 20 is also increased on the product list screen D4, and all the product information is displayed in one screen. If the screen cannot be scrolled, a scroll area Sc that can be scrolled in the vertical direction of the screen is set.

  In the product list screen D4 shown in FIG. 4D, when the start playback button B4 is tapped by the user, the overall control unit 54 plays back the TV program displayed on the product list screen D4 from the beginning of the program. Is given to the recorder control unit 53.

  When the recorder control unit 53 receives the instruction, the recorder control unit 53 generates a reproduction request signal for reproducing the television program from the beginning of the program, and transmits the reproduction request signal to the communication unit 14. In the video display device 3, when the communication unit 33 receives the reproduction request signal, the control unit 34 extracts the television program that is requested to be reproduced from the program storage unit 35, and uses the extracted television program as the reproduction request signal. Based on this, the program is played from the beginning. Thereby, the television program requested to be reproduced is displayed on the display unit 31 from the beginning of the program.

  When the user taps an arbitrary highlight playback button B5 on the product list screen D4, the overall control unit 54 selects the television program displayed on the product list screen D4 as the tapped highlight playback button B5. Is given to the recorder control unit 53 in order to reproduce from the scene corresponding to the time described corresponding to the time, in other words, the scene where the product described corresponding to the highlight reproduction button B5 appears.

  When the recorder control unit 53 receives the instruction, the recorder control unit 53 generates a reproduction request signal for reproducing the television program from the scene, and transmits the reproduction request signal to the communication unit 14. In the video display device 3, when the communication unit 33 receives the reproduction request signal, the control unit 34 extracts the television program that is requested to be reproduced from the program storage unit 35, and uses the extracted television program as the reproduction request signal. Based on the scene, it is played back. As a result, the television program requested to be reproduced is displayed on the display unit 31 from the scene where the product selected by the user appears.

  The server list screen D2 is displayed only when the remote operation application is activated for the first time. When the remote operation application is activated for the second time or later, the data storage unit 55 stores the remote operation target device information in detail. May be omitted if is stored.

In this case, a list of television programs stored in the video display device 3 corresponding to the remote operation target device information stored in the data storage unit 55 is displayed on the recording list screen D3. In this case, when the return button B3 is tapped on the recording list screen D3, the overall control unit 54 creates list data indicating a list of the video display devices 3 that can be remotely operated via the communication unit 14, Based on the list data, the program related information display control unit 52 displays the server list screen D2 on the display unit 11.

  If the home button included in the operation button 12b is pressed by the user while the remote operation application activation screen, that is, the server list screen D2, the recording list screen D3, or the product list screen D4 is displayed, The remote operation application is terminated, and the home screen D1 is displayed on the display unit 11.

  As described above, according to the present embodiment, the user confirms the contents of each highlight scene by confirming the product list screen D4 displayed on the display unit 11 of the mobile terminal device 10, and then selects the desired item. The highlight scene can be selected, and the highlight scene can be displayed on the video display device 3. Therefore, convenience for the user can be improved.

  In the above embodiment, when the user taps the opening playback button B4 on the product list screen D4, the instruction for playing the TV program displayed on the product list screen D4 from the beginning of the program is Although it is configured to be provided from the control unit 54 to the recorder control unit 53, in another embodiment, when the user selects an arbitrary program selection button B2 on the recording list screen D3, the product list screen D4 is displayed. A command for displaying the television program corresponding to the program selection button B <b> 2 from the beginning of the program may be provided from the overall control unit 54 to the recorder control unit 53. Thus, since the program is reproduced from the beginning without pressing the beginning reproduction button B4 on the product list screen D4, the user's operation procedure can be reduced, and convenience is improved.

  Further, in the above-described embodiment, after the user selects an arbitrary program selection button B2 on the recording list screen D3, product information and time information regarding the TV program corresponding to the program selection button B2 are obtained as program related information. However, in another embodiment, when the recording list data is acquired, the overall control unit 54 is listed in the recording list data, in other words, the video. The program-related information acquisition unit 51 may be configured to give a command for acquiring product information regarding all television programs stored in the display device 3.

  In this case, when product information and time information regarding all TV programs are acquired by the program related information acquisition unit 51, the overall control unit 54 stores product information regarding all TV programs given from the recorder control unit 53 and Time information is stored in the data storage unit 55. When an arbitrary program selection button B2 is tapped by the user on the recording list screen D3, the overall control unit 54 obtains product information and time information regarding the television program corresponding to the program selection button B2 from the data storage unit 55. Based on the extracted product information and time information, the program related information display control unit 52 is given a command for displaying the product list screen D4 on the display unit 11. Thereby, the time from tapping the program selection button B2 on the program list screen D3 to displaying the product list screen D4 can be shortened, and convenience is improved.

  In another embodiment, login information for logging in to a shopping site in which a user registers an account is stored in the data storage unit 55, and the program related information acquisition unit 51 stores the product in the server device 20. When requesting information, user information such as a purchase history of a product is acquired from the server device of the shopping site based on login information stored in the data storage unit 55, and the user is acquired based on the acquired user information. You may make it request | require only the merchandise information according to liking. The server device of the shopping site may be the same server as the server device 20. In this case, when the program related information acquisition unit 51 requests the product information, the server device 20 returns only the product information according to the user's preference.

  FIG. 5 is a diagram illustrating a product list screen D5 according to another embodiment. In the product list screen D4 shown in FIG. 4 (d), only product information and time information related to the TV program selected by the user on the recording list screen D3 are displayed. However, like the product list screen D5 shown in FIG. For each TV program listed in the recording list data, in accordance with the order of the TV programs displayed on the recording list screen D3, together with the program title, broadcasting station name, recording start date and time, and start playback button B4, product information and time Information may be displayed.

  Similarly, in the product list screen D5 shown in FIG. 5, when product information and time information regarding all television programs cannot be displayed in one screen, a scroll area that can be scrolled in the vertical direction of the screen. Sc is set.

  In this case, when an arbitrary program selection button B2 is tapped by the user on the recording list screen D3, product information and time information regarding the TV program corresponding to the program selection button B2 are displayed on the product list screen D4. Is displayed. When scrolling up from there, product information and time information of programs broadcast before the TV program corresponding to the program selection button B2 are displayed in order, and when scrolling down, the TV corresponding to the program selection button B2 is displayed. Product information and time information of programs broadcast after the program are displayed in order.

  FIG. 6 is a diagram illustrating another example of transition of screens displayed on the display unit 11 when the video display device 3 is remotely operated using the mobile terminal device 10 according to the present embodiment. 6 (a) and 6 (b) are the same as FIGS. 4 (a) and 4 (b), respectively, and a description thereof will be omitted.

  The embodiment shown in FIG. 6 is viewable on the video display device 3 corresponding to the server selection button B1 tapped by the user on the server list screen D2 shown in FIG. 6B when the remote operation application is executed. This is an embodiment in the case where all the TV programs broadcast on each broadcasting channel are recorded.

  FIG. 6C is a diagram showing a broadcast station list screen D6 displayed after the server selection button B1 corresponding to the video display device 3 that is executing the whole recording is tapped on the server list screen D2.

  In the server list screen D2 shown in FIG. 6B, when the server selection button B1 corresponding to the video display device 3 that is executing the whole recording is tapped by the user, the overall control unit 54 displays the tapped server selection button. Remote operation target device information for specifying the video display device 3 corresponding to B1 is stored in the data storage unit 55, and from the video display device 3 corresponding to the tapped server selection button B1 to the video display device 3. A command for obtaining a list of stored TV programs and TV programs being stored is given to the recorder control unit 53.

  When the recorder control unit 53 receives the instruction, the recorder control unit 53 generates a recording list request signal and transmits the recording list request signal to the communication unit 14. When the recording list data is acquired via the communication unit 14, the recorder control unit 53 54.

  The overall control unit 54 stores the recording list data given from the recorder control unit 53 in the data storage unit 55 and, based on the recording list data, instructs the display unit 11 to display the broadcast station list screen D6. Is provided to the program related information display control unit 52. When receiving the instruction, the program related information display control unit 52 displays the broadcast station list screen D6 on the display unit 11.

On the broadcast station list screen D6, for each viewable broadcast station, a selectable broadcast station selection button B6 in which the broadcast station name and the program title of the currently broadcast TV program are described is displayed.
Similarly, in the broadcast station list screen D6 shown in FIG. 6C, the number of selectable broadcast station selection buttons B6 increases, and all the broadcast station selection buttons B6 are displayed in one screen. If the screen cannot be scrolled, a scroll area Sc that can be scrolled in the vertical direction of the screen is set.

  FIG. 6D is a diagram showing a product list screen D7 displayed after an arbitrary broadcast station selection button B6 is tapped on the broadcast station list screen D6. In the broadcast station list screen D6 shown in FIG. 6C, when an arbitrary broadcast station selection button B6 is tapped by the user, the overall control unit 54, among the TV programs listed in the recording list data, The program related information acquisition unit 51 is given a command for acquiring product information related to a TV program broadcast on a broadcast station corresponding to the broadcast station selection button B6 and a TV program being broadcast.

  When the program-related information acquisition unit 51 receives the instruction, the program-related information acquisition unit 51 generates a product information request signal for requesting product information related to the TV program broadcast on the broadcast station corresponding to the broadcast station selection button B6 and the TV program being broadcast. When the product information and time information are acquired from the server device 20 and transmitted to the communication unit 14, the acquired product information and time information are given to the overall control unit 54.

  The overall control unit 54 stores the product information and time information given from the recorder control unit 53 in the data storage unit 55 and displays the product list screen D7 on the display unit 11 based on the product information and time information. Is given to the program related information display control unit 52. When receiving the instruction, the program related information display control unit 52 displays the product list screen D7 on the display unit 11.

  In the product list screen D7, for each TV program broadcast on the broadcast station corresponding to the broadcast station selection button B6 and the TV program being broadcast, the program title, the recording start / end are recorded in order from the latest recording start date and time. The product information, time information, and highlight reproduction button B5 acquired from the server device 20 are displayed together with the date and time and the beginning reproduction button B4.

  In addition, in the product list screen D7 shown in FIG. 6D, when the user flicks in the horizontal direction of the screen, the displayed broadcast stations are switched according to the order of the broadcast stations displayed on the broadcast station list screen D6. Also good. For example, when the B broadcast station is displayed on the product list screen D7, switching from the right to the left switches to the next broadcast station C, and tracing in the opposite direction switches to the previous broadcast station A.

  FIG. 7 is a diagram illustrating still another example of the transition of the screen displayed on the display unit 11 when the video display device 3 is remotely operated using the mobile terminal device 10 according to the present embodiment. Since FIG. 7A and FIG. 7B are the same as FIG. 4A and FIG.

  In the embodiment shown in FIG. 7, as in the embodiment shown in FIG. 6, when the remote operation application is executed, the server selection button B1 tapped by the user on the server list screen D2 shown in FIG. This is an embodiment in the case where all television programs broadcast on each viewable broadcast channel are recorded in the corresponding video display device 3.

  FIG. 7C is a diagram showing a product list screen D8 that is displayed after the server selection button B1 corresponding to the video display device 3 that is executing the whole recording is tapped on the server list screen D2.

In the server list screen D2 shown in FIG. 7B, when the server selection button B1 corresponding to the video display device 3 that is executing the whole recording is tapped by the user, the overall control unit 54 displays the tapped server selection button. Remote operation target device information for specifying the video display device 3 corresponding to B1 is stored in the data storage unit 55, and from the video display device 3 corresponding to the tapped server selection button B1 to the video display device 3. A command for obtaining a list of stored TV programs and TV programs being stored is given to the recorder control unit 53.

  When the recorder control unit 53 receives the instruction, the recorder control unit 53 generates a recording list request signal and transmits the recording list request signal to the communication unit 14. When the recording list data is acquired via the communication unit 14, the recorder control unit 53 54.

  The overall control unit 54 stores the recording list data given from the recorder control unit 53 in the data storage unit 55 and is listed in the recording list data, in other words, all stored in the video display device 3. The program related information acquisition unit 51 is given a command for acquiring product information related to the TV program.

  When product information and time information regarding all TV programs are acquired by the program related information acquisition unit 51, the overall control unit 54 stores product information and time information regarding all TV programs given from the recorder control unit 53 as data. Stored in section 55.

  The overall control unit 54 then issues a command to display the product list screen D8 on the display unit 11 based on the recording list data, product information, and time information stored in the data storage unit 55, and program related information display control. Part 52. When receiving the instruction, the program related information display control unit 52 displays the product list screen D8 on the display unit 11.

  On the product list screen D8, television stations listed in the recording list data in the form of a program table showing broadcast stations that can be viewed along the horizontal direction of the screen and showing the flow of time along the vertical direction of the screen. For each program, product information, time information, and highlight playback button B5 acquired from the server device 20 are displayed together with the program title and opening playback button B4. In the product list screen D8 shown in FIG. 7C, the entire program guide cannot be displayed on one screen, so a scroll area Sc that can be scrolled in the vertical and horizontal directions of the screen is set. The

  Further, when the number of product information acquired from the server device 20 is large for one television program, as shown in FIG. 7C, all the product information and time information related to the television program and the beginning playback are displayed. A more viewing button B7 for changing to another screen displaying the button B4 and the highlight reproduction button B5 may be displayed in association with the television program. When the view more button B7 is tapped, a screen similar to the product list screen D4, the product list screen D5, or the product list screen D7 is displayed.

  FIG. 8 is a diagram illustrating a product list screen D9 according to another embodiment. Since the product list screen D9 in this embodiment is similar to the product list screen D7 shown in FIG. 6D, the same components are denoted by the same reference numerals and description thereof is omitted.

  In the product list screen D9 shown in FIG. 8, the product information acquired from the server device 20 is based on the time information associated with the product information, and the time axis indicates the broadcast time of the television program in which the product information is introduced. Displayed in association with J.

The time axis J displayed on the product list screen D9 can select a scene corresponding to an arbitrary time by tapping an arbitrary position on the time axis J. When an arbitrary position on the time axis J is tapped by the user on the product list screen D9, the overall control unit 54 reproduces the TV program corresponding to the time axis J from the scene corresponding to the tapped time. A command for causing the recorder control unit 53 to give a command.

  When the recorder control unit 53 receives the instruction, the recorder control unit 53 generates a reproduction request signal for reproducing from the scene corresponding to the tapped time, and transmits the reproduction request signal to the communication unit 14. In the video display device 3, when the communication unit 33 receives the reproduction request signal, the control unit 34 extracts the television program that is requested to be reproduced from the program storage unit 35, and uses the extracted television program as the reproduction request signal. Based on the scene corresponding to the tapped time, playback is performed. As a result, the television program requested to be reproduced is displayed on the display unit 31 from the scene corresponding to the tapped time.

  As described above, the user can play back not only from a scene where a product or the like appears, but also from an arbitrary scene. For example, it is possible to know the flow of a program in which a product has appeared by playing it back a little while ago. This further improves convenience for the user.

  FIG. 9 is a diagram showing a product list screen D10 according to still another embodiment. Since the product list screen D10 in the present embodiment is similar to the product list screen D9 shown in FIG. 8, the same components are denoted by the same reference numerals and description thereof is omitted.

  In the product list screen D10 shown in FIG. 9, the product information acquired from the server device 20 is based on the time information associated with the product information, and the time axis indicates the broadcast time of the television program in which the product information is introduced. J is displayed in association with J, and indicates the degree of climax for the television program at each divided time obtained by dividing the broadcast time of the television program by a predetermined time interval (2 minutes in the example shown in FIG. 9). The climax information K is displayed in association with the time axis J in the form of a bar graph.

  In the present embodiment, the degree of excitement is a value calculated from the number of posts of a miniblog such as Twitter (registered trademark) related to the television program posted in each divided time. Such climax information K is created and stored in the server device 20 or a server device different from the server device 20, and by a command from the overall control unit 54, the program related information acquisition unit 51 passes through the communication unit 14. And obtained from the server device.

  The climax information K acquired from the server device is given to the overall control unit 54, and the overall control unit 54 determines the product based on the climax information K and the product information and time information acquired from the server device 20. A command for displaying the list screen D10 on the display unit 11 is given to the program related information display control unit 52. When receiving the command, the program related information display control unit 52 displays the product list screen D10 on the display unit 11.

  As described above, according to the present embodiment, the user can reproduce not only from a scene where a product or the like appears but also from an arbitrary scene while confirming a lively situation. For example, on the product list screen D10, the product with the product name “DEF” appeared at 20:23, but if you look at the graph, you can see that it has risen around 20:18, and it will be played from around that time. For example, it can be expected that a series of scenes related to the product can be viewed. This further improves convenience for the user.

  FIG. 10 is a diagram showing a miniblog list screen D11 according to still another embodiment. Since the miniblog list screen D11 in this embodiment is similar to the product list screen D7 shown in FIG. 6D, the same components are denoted by the same reference numerals and description thereof is omitted.

  In this embodiment, the server device 20 replaces the product information introduced in each television program with each television program broadcast on each broadcast channel, for example, a message posted on a miniblog such as Twitter. -Miniblog information indicating the message is stored in association with the time information indicating the time when the message was posted, and is used to acquire the miniblog information instead of the product information while the remote operation application is being executed. When the command is given from the overall control unit 54 to the program related information acquisition unit 51, the program related information acquisition unit 51 uses a predetermined contributor, for example, the mobile terminal device 10, from the server device 20 via the communication unit 14. Other users who are friends in miniblogs (followers in Twitter) To get the mini-blog information and the time information that has been posted by etc.).

  When the mini-blog information and time information are given from the program-related information acquisition unit 51, the overall control unit 54 instructs the display unit 11 to display the mini-blog list screen D11 based on the mini-blog information and time information. Is provided to the program related information display control unit 52. When receiving the instruction, the program related information display control unit 52 displays the miniblog list screen D11 on the display unit 11.

  Therefore, the user can confirm at what timing the user's friend or the like posted the message in the program on the miniblog list screen D11 displayed on the display unit 11 of the mobile terminal device 10. Since a scene where a friend posted a message is likely to be a scene that is also interesting for the user, it is worth extracting as a highlight scene. In addition, since you can check the content of the posted message, you can understand the content of the scene. After judging whether the scene is interesting to you, select the highlight scene and highlight it. The scene can be displayed on the video display device 3. Therefore, convenience for the user can be improved.

  FIG. 11 is a diagram showing a miniblog list screen D12 according to still another embodiment. The miniblog list screen D12 in the present embodiment is the same as the miniblog list screen D11 shown in FIG. 10 except that the miniblog information is displayed in association with the time axis J.

  In this embodiment, as in the embodiment shown in FIG. 8, the time axis J displayed on the miniblog list screen D12 corresponds to an arbitrary time by tapping an arbitrary position on the time axis J. The scene to be selected can be selected. Therefore, the user can play back not only from a scene where a miniblog is posted by a friend but also from an arbitrary scene. For example, it is possible to know the flow of a program in which a message is posted by playing it from a time just before a certain message is posted. This further improves convenience for the user.

  FIG. 12 is a diagram showing a miniblog list screen D13 according to still another embodiment. The product list screen D13 in the present embodiment is the same as the miniblog list screen D12 shown in FIG. 11 except that the climax information K is displayed in association with the time axis J. According to the present embodiment, the user can reproduce not only from a scene where a miniblog is posted by a friend, but also from an arbitrary scene while confirming a lively situation. For example, in the mini blog list screen D13, Mr. A's message was posted at 20:08, but if you look at the graph, you can see that it is exciting from around 20:02, and if you play from around that time, A series of scenes related to the message can be expected to be viewed. This further improves convenience for the user.

DESCRIPTION OF SYMBOLS 1 Information communication system 3 Video display apparatus 10 Portable terminal device 11 Display part 12 UI part 13 Control part 14 Communication part 20 Server apparatus 31 Display part 32 Program receiving part 33 Communication part 34 Control part 35 Program storage part 41 Communication part 42 Control part 43 Program related information storage unit 51 Program related information acquisition unit 52 Program related information display control unit 53 Recorder control unit 54 Overall control unit 55 Data storage unit

Claims (11)

A mobile terminal device capable of acquiring content identification information for identifying video content from a recorded content playback device capable of playing back stored video content and controlling the recorded content playback device,
Video content that matches the content identification information by transmitting the content identification information to a server device that stores the video content related information related to the video content and time information indicating the playback position of the video content in association with each other Video content related information acquisition means for acquiring video content related information and time information,
Display means for displaying the video content related information acquired by the video content related information acquisition means for each video content;
Selecting means for selecting one video content related information from the video content related information displayed on the display means;
When one video content related information is selected by the selection means, the video content corresponding to the one video content related information corresponds to the time indicated by the time information associated with the one video content related information. A portable terminal device comprising: control signal output means for outputting a control signal for reproduction from a scene to the recorded content reproduction device.   2. The portable terminal device according to claim 1, wherein the content identification information is a set of identification information of a broadcasting station where the video content is broadcast and a time when the video content is broadcast.   The display means displays the video content related information in association with a time axis indicating a broadcast time of the video content corresponding to the video content related information based on the time information. Or the portable terminal device of Claim 2. For each video content broadcast on each broadcast channel, from a server device that stores climax information indicating the degree of climax for the video content at each divided time obtained by dividing the broadcast time of the video content at a predetermined time interval , Further comprising climax information acquisition means for acquiring climax information of the video content stored in the recorded content playback device,
The portable terminal device according to claim 3, wherein the display means displays the climax information acquired by the climax information acquisition means in association with the time axis.   5. The mobile terminal device according to claim 4, wherein the degree of swell in each division time is calculated from the number of posts of the miniblog related to the video content posted in the division time. The time axis displayed on the display means can select any time on the time axis by the selection means,
When an arbitrary time on the time axis is selected by the selection means, the control signal output means reproduces video content corresponding to the time axis from a scene corresponding to the time selected by the selection means. The mobile terminal device according to any one of claims 3 to 5, wherein a control signal for output is output to the recorded content reproduction device.   The portable terminal according to claim 1, wherein the display unit displays title information included in video content corresponding to the video content related information together with the video content related information. apparatus. Login information storage means for storing login information for logging in to a predetermined server device;
Using login information stored in the login information storage means, further including user information acquisition means for acquiring user information of the user related to the login information from the predetermined server device;
The video content related information acquisition unit acquires the video content related information corresponding to the user based on the user information acquired by the user information acquisition unit. The portable terminal device described in one. An information communication system comprising a mobile terminal device and a server device that can communicate with each other via a communication network,
The server device
Video content related information storage means for storing video content related information related to the video content and time information indicating a playback position of the video content in association with each other;
Video content related information transmitting means for transmitting video content related information and time information stored in the video content related information storage means to the mobile terminal apparatus for video content that matches content identification information received from the mobile terminal device; Including
The mobile terminal device can acquire content identification information for identifying video content from a recorded content playback device capable of playing back stored video content, and can control the recorded content playback device,
Request signal transmission means for transmitting to the server device the content identification information acquired from the recorded content playback device in the request signal for requesting video content related information of the video content stored in the recorded content playback device;
Video content related information and time information for video content that matches the content identification information included in the request signal, transmitted from the video content related information transmission unit in response to the request signal transmitted by the request signal transmission unit. Video content related information acquisition means for acquiring
Display means for displaying the video content related information acquired by the video content related information acquisition means for each video content;
Selecting means for selecting one video content related information from the video content related information displayed on the display means;
When one video content related information is selected by the selection means, the video content corresponding to the one video content related information corresponds to the time indicated by the time information associated with the one video content related information. An information communication system comprising: control signal output means for outputting a control signal for reproduction from a scene to the recorded content reproduction apparatus. The video content related information is information regarding any of products, facilities, people, characters, and places that appear in the video content corresponding to the video content related information,
10. The information communication system according to claim 9, wherein the time information is a time when the video content related information appears in the video content. The video content related information is a miniblog post message related to video content corresponding to the video content related information posted by a predetermined poster,
The information communication system according to claim 9, wherein the time information is a time when the video content related information is posted.