JP2009065305A - Terminal cooperation system for seamless viewing and listening, terminal, server, and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a suitable technology for providing comfortable seamless viewing and listing using a mobile terminal and an information receiving terminal apparatus having a big screen, without depending on a place. <P>SOLUTION: The information receiving terminal apparatus includes a means for transmitting a mobile viewing and listening information to a mobile terminal. A video image information system performs controlling of a viewing and listening environment where requests from two or more users are satisfied. The system can provide viewing and listening by transmission/reception of a content to/from the mobile terminal for seamless viewing and listening to at the mobile terminal the content viewed and listened with the information receiving terminal apparatus, and also can provide, on the contrary, seamless viewing and listening to at the information receiving terminal the content viewed and listened by the mobile terminal, based on inter terminal cooperation and center cooperation of a time code information for seamless content viewing and listening from with the information receiving terminal apparatus to with the mobile terminal. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The technical field relates to a system for viewing content such as video, and more particularly to a system for continuously viewing content via a network in a plurality of devices.

  Regarding the above technical field, for example, Japanese Patent Application Laid-Open No. 2004-228620 describes that “when switching terminals, content that was viewed on the switching source terminal can be continuously and continuously viewed on the switching destination terminal without logging in again from the switching destination terminal. (Refer to Patent Document 1 [0006]), and as a means for solving the problem, a “system for seamlessly handing over content (MetaPORT), a viewing history management server compliant with the TV-Anytime Forum specification, and content Realized in cooperation with meta server, location resolution server, presence management server compliant with IETF regulations, etc. MetaPORT takes over the context of the content viewed by the user at the switching source terminal and adapts to the presence of the switching destination terminal Delivery and playback This is a viewing continuation control server (MetaPORT server) that realizes the Suspend and Resume function as a network service for the user to select a switching source / switching destination terminal on the terminal (MetaPORT terminal) screen and instruct a handover. Provide a user interface and access a presence server and a location resolution server according to an input from the user to realize a seamless handover function to a switching destination terminal ”(see Patent Document 1 [0008]), etc. Has been.

  Further, Patent Document 2 states that “in a content viewing in a general home network environment, even if the user stops viewing the content, the viewing can be easily resumed from the interrupted position, and the home network AV server and home “Providing a network AV server program” (see Patent Document 2 [0006]), and as a means for solving the problem, “... in the home network AV server, the current transmission position of the content data transmitted to the client terminal is determined. A data transmission position detection unit to detect, and a data position that has been stopped based on a current transmission position of the content data output from the data transmission position detection unit when a playback stop request is received from the client terminal, as a playback start position Create content information for mid-start and A content information creation unit for mid-start to be stored in the content information list storage unit, and the transmission data creation unit refers to the content information for mid-start in the content information list storage unit when viewing and playback from the client terminal is started And transmitting the content data from the reproduction start position ”(see Patent Document 2 [0007]).

JP 2004-336310 A JP 2005-323068 A

  However, in Patent Documents 1 and 2, in the case of continuous viewing, the center equipment, such as a viewing history management server installed in the center, is large in the home network, and there is a difference in the continuous viewing start point of the viewing interruption point. The user may not be able to maintain the comfort of viewing continuity in the sending server, the switching source terminal, and the switching destination terminal (for example, the video being viewed becomes discontinuous). .

  Further, if the viewing environment is limited to the AV home server or the home network, there is a risk that the advantage of the portable terminal that provides a viewing environment independent of location may be reduced.

  In addition, for example, when a plurality of people are watching a certain content on one television receiver, some of the plurality of people are continuously watching with the mobile terminal device and separated from the television receiver. However, Patent Documents 1 and 2 are not considered for the need for the remaining person to continuously view the content on the television receiver.

  Thus, for example, a receiving terminal device such as a television receiver in a home provides content at home and provides continuous viewing of content on a mobile terminal device upon request so that the content can be viewed for each individual. It is preferable to do.

  Specifically, as one embodiment, a mobile terminal device such as a mobile phone owned by an individual user is based on means for acquiring viewing information on a receiving terminal device such as a TV owned by a family and the viewing information. It is configured to transmit a content request and control information on whether or not to continue viewing to the receiving terminal device to the content distribution device installed in the service center.

  Further, the receiving terminal device has means for transmitting status information being viewed on the receiving terminal device and parameter information for moving viewing to the mobile terminal device.

  In addition, the content distribution device controls the viewing environment that satisfies the requirements of a plurality of users, links the mobile terminal device, the receiving terminal device, and the content distribution device with parameter information for mobile viewing such as time code information, and receives the content. The content being viewed on the terminal device can be continuously viewed on the mobile terminal device, or conversely, the content being viewed on the mobile terminal device can be continuously viewed on the receiving terminal device.

  According to these configurations, for example, a portable terminal device that can be carried around by each individual while watching the content viewed by the family in a living room with a large screen receiving terminal device (for example, a television receiver). Thus, it becomes possible to acquire information and data according to individual circumstances.

  According to the above means, continuous viewing of content in consideration of a plurality of devices and / or a plurality of users can be realized more smoothly.

  Hereinafter, an example (example) of an embodiment suitable for the present invention will be described with reference to the drawings. However, the present invention is not limited to this embodiment. In the present embodiment, a system including a mobile terminal connected to a network, an information receiving terminal device such as a digital TV, and a content distribution device is illustrated.

  FIG. 1 shows a configuration example of a mobile terminal cooperative video movement continuous viewing system in the present embodiment. When the whole family is watching content in the living room by the information receiving terminal device 100 such as a television receiver (TV) connected to the network, the mobile terminal 101 can watch the content while the family is moving or at the destination. A case to be described will be described.

  In FIG. 1, an information receiving terminal device 100 receives a video stream distributed from a content distribution device 103 via a broadband Internet line 104 and displays content. Further, the mobile terminal 101 is connected to a line via the wireless relay device 102, and content viewing corresponding to the performance and function of each mobile terminal 101 is possible. Here, it is assumed that the information receiving terminal device 100 is a television receiver. The information receiving terminal device 100 and the portable terminal 101 are collectively referred to as a receiving terminal and a receiving terminal device.

  The information receiving terminal device 100, the portable terminal 101, and the distribution device 103 each have hardware such as a CPU, a memory, and a communication IF. The CPU executes software and executes transmission processing, reception processing, and control thereof. These are also referred to as a transmission unit, a reception unit, and a control unit.

  In the present embodiment, the information receiving terminal device 100 receives the video stream from the broadband Internet line 104, but may receive both or one of the video streams from the digital television broadcast network. The broadband internet line 104 may be, for example, an optical fiber such as FTTH, ADSL, wireless LAN, or the like.

  In this embodiment, mutual screen switching is performed between the information receiving terminal device 100 and the mobile terminal 101. Mutual screen switching refers to switching of terminals on which content is viewed among a plurality of terminals. For example, between the information receiving apparatus 100 that is commonly viewed by the family and the mobile terminal 101 that the family owns, the apparatus that performs content viewing by switching the button of the mobile terminal 101 is switched, and the content is displayed on both displays. Switching between displaying and displaying content on one of the displays. Thus, the content viewing can be continued even if the portable terminal 101 moves from the living room to another room or outside the house. In addition, you may make it output externally so that it can display on the display not only of a display but another housing | casing. Display and external output are collectively referred to as output.

  The portable terminal 101 switches screens by selecting content to be viewed via the Internet 104 and designating a destination address via the wireless relay device 102 to the content distribution device 103. The switching is, for example, a request for analyzing the address of the mobile terminal 101 or the address of the information receiving terminal device 100 to which the content is displayed by switching, and transmitting video streaming to the information receiving terminal device 100 and / or the mobile terminal 101. This is realized by performing (also referred to as a transmission request).

  The content distribution device 103 is configured to perform distribution control according to the function of the terminal based on a transmission request from the portable terminal 101. Based on the mapped URL information and address information, transmission is performed to the information receiving terminal device 100 and the portable terminal 101 at the switching destination.

  Here, for example, in the case where the content distribution apparatus 103 has two contents of the same content but high image quality and low image quality, when the content is requested to be transmitted, the mobile terminal 101 has high image quality. To see if the content can be displayed. For example, when determining whether or not display is possible, when connecting to a network, the device information is acquired using the function of uPnP (Universal Plug and Play) defined by DLNA (Digital Living Network Alliance), and the content that can be played back Resource information on type distinction, device computing capability, and video processing capability is exchanged via the network.

  Low-quality content is transmitted to the portable terminal 101, while high-quality content is transmitted to the information receiving terminal device 100 that can display high-quality content. Further, for example, when the content distribution apparatus 103 has a plurality of contents having the same contents and different compression systems (for example, MPEG4 and H.264), the content of the compression system suitable for the transmitting apparatus is selected in the same manner as described above. Or convert and send. As another method, by providing a function for acquiring a device-specific ID, vendor name, etc., in the device authentication function when connecting to a content distribution service portal, the center side has a device ID and video processing capability. It is possible to make a determination based on the processing capability of the portable terminal 101 by having a table.

  The mobile terminal 101 can also control content viewed on the information receiving terminal device 100. The content control is, for example, instructing the information receiving terminal device 100 to start / stop content viewing, screen switching, moving viewing, or moving continuous viewing. If a setting file suitable for content control is created in advance, a viewing operation related to control of the content can be easily performed. As this method, the information receiving terminal device 100 is provided with means for storing a control command file from the network from the portable terminal 101, and an operation command from the remote controller generally used and an operation command from the portable terminal 101 are stored. This can be realized by providing a table. Thereby, the information receiving terminal device 100 can determine whether the control is from the remote controller or the control from the mobile terminal 101, and viewing start and stop that can be shared by the remote controller and the mobile terminal 101 are performed by software. It can be shared and the software scale can be reduced.

  FIG. 2 illustrates an example of a sequence in the system of FIG. FIG. 2 shows a sequence in which the display screen is switched to the portable terminal 101 from the case of viewing with the information receiving terminal device 100.

  First, (1) a content viewing request is made from the information receiving terminal device 100 to the content distribution system 103 for normal viewing. In this case, it is configured to be realized by selecting content on the service portal screen.

  In response to the request, the content distribution apparatus 103 (2) performs transmission destination confirmation, and confirms the presence or absence of a terminal apparatus (target transmission destination) other than the information receiving terminal apparatus 100 that issued the request. (3) Receives a transmission destination reply from the information receiving terminal device 100, recognizes a terminal as a transmission destination, and (4) transmits content.

  When screen switching is performed on the mobile terminal 101 in such a situation, the mobile terminal 101 transmits (5) a moving viewing parameter request to the information receiving terminal device 100, and content that has been viewed on the information receiving terminal device 100. Request to get the time code.

  The mobile terminal 101 acquires the top time code of the content switching playback content for performing playback after switching of the content viewed on the information receiving terminal device 100 by receiving the (6) viewing status reply.

  The moving viewing parameter refers to the time code indicating the time of the content currently being viewed, the title of the content being viewed, the viewing record of how far the previously viewed content has been viewed, and the content that can be played back and displayed. The video processing capability of the device that determines the type may be included. In the present embodiment, the case of realizing moving viewing of the currently viewed video content is described, and moving viewing by time code is described. The time code may indicate a playback time from the start of the content, or may be a time stamp such as DTS, PTS, ATS. Also called time information or synchronization information.

  In addition, depending on the user, moving viewing according to the story of the content content, such as playback from 3 minutes before playback from the same time, playback from the immediately preceding CM, and the like, is also possible. The viewing status can be extended to such a case, not only returning the time code status to the exact viewing time, but also 3 minutes after the previous CM, 1 minute after the scene change, etc. By returning the status corresponding to the viewing style, it is possible to realize a mobile viewing function that is easier for the user to view. The start time code is a time code indicating the start of playback when playback is performed during mobile viewing. The user's request is parameterized in advance, and the time code until the end of the previous CM is added to the start time code as an offset. It is also possible to set it as the leading time code.

  The portable terminal 101 makes a (7) screen switching viewing request to the content distribution device 103 based on the head time code. Also, (8) information receiving terminal transmission device viewing stop transmission is performed, content viewing stop processing is performed on the information terminal device 100, and the content distribution device 103 transmits (9) content to the target mobile terminal 101. . Thereby, the screen switching process to the information receiving terminal 101 is completed.

  Conversely, in switching viewing from viewing on the mobile terminal 101 to the information receiving terminal device, the information receiving terminal device 100 that is the switching destination is designated from the mobile terminal 101 by (10) the information receiving terminal, and (11) the information receiving terminal. After the apparatus 100 is activated, the content distribution apparatus 103 makes a content transmission request to the information receiving terminal apparatus 100 to the content distribution apparatus 103, and the content distribution apparatus 103 is configured to distribute the content (13). You may switch from the portable terminal 101 to another portable terminal 101. Alternatively, switching may be performed by executing (5) from the information receiving terminal device 100 that is the switching destination or another portable terminal 101.

  FIG. 3 shows a configuration example of a system when a family member takes the mobile terminal device 100 out of the house. Utilizing the mobile network facility 105, the content can be continuously viewed both inside and outside the home, and various services can be interleaved. For example, by having a table of IDs unique to devices used in the mobile network equipment 105 and IDs in a LAN environment when viewing in the home on the center side, it is possible to mutually enter services. By storing the MAC address of the home LAN in a SIM card mounted on the portable terminal 101 overseas, it is possible to use this MAC address for viewing when making a mobile viewing request to the center side. Further, by inserting the SIM card into the mobile terminal 101 of a friend or relative while away from home, it is possible to view the content not only with the mobile terminal 101 owned by the user but also with the friend or relative.

  The card may be a memory card. Furthermore, it is possible to determine whether or not there is a service contract, and it is possible to flexibly deal with the types of services such as services that can be freely viewed without limitation for a limited time.

  FIG. 4 shows an example of a sequence diagram in the case where one of the family members continuously views the content viewed by the family on the portable terminal 101 by moving in the home such as a kitchen or a toilet or going out.

  The processes (1) to (6) are performed in the same sequence as in FIG. 2, and the mobile terminal 101 makes a (7) ′ movement viewing request. The (7) screen switching viewing request in FIG. 2 means that when the information receiving terminal device 100 is viewed by a plurality of families, even if one of the families performs mobile viewing with the mobile terminal 101 at home, the remaining family However, the information receiving terminal device 100 can be viewed as it is.

  Also, (8) ′ information reception terminal device continuous viewing necessity transmission is performed. (8) in FIG. 2 is that when the information receiving terminal device 100 is viewed by a plurality of families, even if one of the family members performs mobile viewing with the mobile terminal 101 at home, the remaining family members receive the information. This is different in that the power is not turned off so that the terminal device 100 can be viewed as it is, and it is also possible to achieve without disturbing the comfortable viewing of the family who was watching the content together on the information receiving terminal 100 together.

  (8) By performing the “required” process in ′, continuous viewing on the information receiving terminal device 100 is possible without affecting the family who continuously views on the information receiving terminal device 100.

  When “No” is processed in (8) ′, the power of the information receiving terminal device 100 can be turned off, and when performing mobile viewing with the mobile terminal 101 alone, without performing a series of operations. In addition, by using this function in reverse, by giving a mobile viewing instruction when returning home, the information receiving terminal device 100 is turned on, and content can be viewed immediately.

  In FIG. 4, information receiving terminal device continuous viewing necessity is transmitted to the content distribution device 103, but is transmitted to the information receiving terminal device 100, and in the case of “No”, the information receiving terminal device The display or reception may be stopped at 100, or the transmission may be stopped from the information receiving terminal device 100 to the distribution device 103. In this case, it is effective when the information receiving terminal device 100 is limited as a service target, and the viewing history is accumulated in the storage device in the information receiving terminal device 100, so that it can be managed centrally, and malicious content It is also possible to avoid damages such as illegal charges from service providers, restrict viewing of family members, and prevent viewing of malicious content. However, a storage area for accumulating management information is required, which increases the cost of the apparatus, reduces the recording capacity of content, and downloads, and if the information increases, management may be troublesome.

  The content distribution device 103 is configured with a distribution function of a plurality of content streams of the same content based on (7) information reception terminal device continuation necessity information from the mobile terminal 101. The number of mobile terminals 101 is not limited to one.

  In addition, by providing the mobile terminal 101 with a time code calculation function for starting mobile viewing, for example, the original time code calculation of n seconds ago is performed on the acquired value of the start time code of the mobile viewing request according to the system. In addition, mobile viewing can be realized without obstructing the content. As a result, when viewing is performed on a plurality of receiving terminals (the mobile terminal 101 and the information receiving terminal device 100), it is possible to cope with temporal shifts in content at the receiving terminals.

  For example, a user is watching with the information receiving terminal device 100 in the living room with his / her family, viewing the portable terminal 101 by taking it to the toilet and his / her room, and returning to the living room to see the information receiving terminal with the family. When viewing with the device 100, for example, while moving to a toilet or own room, or operating the device, the content received by the information receiving terminal device 100 and the portable terminal 101 is temporal. Misalignment will occur. Then, when the user returns to the living room, the content that is being viewed on the information receiving terminal device 100 is more advanced than the mobile terminal 101, and the user of the mobile terminal 101 cannot return to viewing on the information receiving terminal device 100. Or there is a concern that a scene to be missed may appear.

  In this regard, for example, in order to match the time codes of the contents viewed on the information receiving terminal device 100 and the mobile terminal 101 (but not necessarily completely match), the mobile terminal 101 has a monitoring function of the reception bit rate, Based on the result of the bit rate, it is possible to control the changing of the playback speed or skipping the CM, such as playing back only the I frame, so that the viewing of the mobile terminal 101 and the information receiving terminal device 100 can be synchronized. It becomes. This operation may be executed mainly by the mobile terminal 101 or may be executed mainly by the distribution device 103.

  Further, by monitoring the distance from the information receiving terminal device with the GPS function of the mobile terminal 101 or the like, it is possible to synchronize the viewing content as the mobile terminal 101 approaches the information receiving terminal. By using this function, connection switching from a mobile network service to a home wireless LAN environment is possible.

  In addition, when the screen is switched in this embodiment, the content (program) is switched to arouse the story, and at the start of viewing, the scene similar to the viewing is overlapped for a predetermined time intentionally immediately before switching to maintain the story of the content. This function can also be realized.

  These mobile continuous viewing functions and the screen switching function from the information receiving terminal device 100 to the mobile terminal 101 and vice versa enable continuous mobile viewing not only inside the home but also outside the home utilizing the characteristics of the mobile terminal 101. Thus, a seamless content viewing style can be realized between the large-screen information receiving terminal 100 and the portable terminal 101 by the portable terminal 101 and the information receiving terminal device 100 such as a TV.

  In addition, the camera function in which the mobile terminal 101 is mounted on the go has a capture function such as video and information, which can be transmitted to the information receiving terminal device 100 via the center. When the mobile viewing destination is set in the information receiving terminal device 100 in the grandparent's house, it is possible to view the grandchild's video on the information receiving terminal 100 in the remote location of the grandparent's house via the mobile network. Become.

  Since the target information receiving terminal 100 is connected to the network, mobile viewing of the information receiving terminal device 100 desired by the user is also possible.

  FIG. 5 shows an example of an operation screen on the mobile terminal 101. A remote control menu for viewing, stopping, pausing and the like, and a screen switching, moving viewing, and continuous moving viewing menu for switching viewing styles between the two terminal devices are displayed on the mobile terminal 101, and the system has high operability. It has a configuration. By detecting selection of these menus, each process in the sequence of FIG. 2 or FIG. 4 is executed.

  The menu screen may be realized as a portal screen on the center side or an application on the terminal side.

The figure which shows the structural example of a portable terminal cooperation image | video movement continuous viewing-and-listening system. The figure which shows an example of the protocol sequence of screen switching. The figure which shows the structural example of the portable terminal cooperation image | video movement continuous viewing system which implement | achieves the movement viewing in the house and the outside of a house. The figure which shows an example of the protocol sequence of a movement continuation viewing / listening. The figure which shows the example of a display of the menu of an operation screen.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 100 ... Information receiving terminal device, 101 ... Mobile terminal, 102 ... Wireless relay device, 103 ... Content distribution device, 104 ... Internet, 105 ... Mobile network equipment, 601 ... Operation screen, 602 ... Viewing, 603 ... Stop, 604 ... Temporary Stop, 605 ... Screen switching, 606 ... Moving viewing, 607 ... Moving continuous viewing

Claims (6)

A terminal-linked continuous viewing system,
A distribution device for transmitting video content;
A first terminal that outputs video content received from the distribution device;
A second terminal that obtains information on the video content output by the first terminal and transmits request information for receiving the video content and information on whether or not to continue viewing the video content to the first terminal; including. The terminal-linked continuous viewing system according to claim 1,
When the second terminal transmits a request for viewing video content on the first terminal, the time code of the video content viewed on the second terminal and the first terminal is matched. Control viewing of video content on the second terminal. The terminal-linked continuous viewing system according to claim 1,
The distribution device switches the image quality or compression method of the video content according to the types of the first terminal and the second terminal. A content receiving terminal,
An acquisition unit that acquires information of video content that the user is viewing on a receiving terminal different from the receiving terminal;
A transmission unit configured to transmit the video content reception request information and the video content transmission continuation necessity information to the first terminal to a distribution device that distributes the video content; A content distribution device,
A transmission unit for transmitting content;
A receiving unit that receives a content distribution request from the first terminal and whether or not to continue transmission of content to a second terminal different from the first terminal;
A control unit that causes the transmission unit to stop transmitting content to the second terminal and to transmit the content to the first terminal when the reception unit receives a continuation failure of transmission to the second terminal And have. A terminal-linked continuous viewing method,
Watch the content on the first device,
Receiving a request for continuous viewing of content on the second terminal;
The viewing of the video content on the second terminal is controlled so as to match the time information of the video content viewed on the second terminal with the time information on the video content viewed on the first terminal.

Images