JP2009130876A - Terminal cooperation continuation viewing-and-listening system, terminal, server, and method - Google Patents

Terminal cooperation continuation viewing-and-listening system, terminal, server, and method Download PDF

Info

Publication number
JP2009130876A
JP2009130876A JP2007306749A JP2007306749A JP2009130876A JP 2009130876 A JP2009130876 A JP 2009130876A JP 2007306749 A JP2007306749 A JP 2007306749A JP 2007306749 A JP2007306749 A JP 2007306749A JP 2009130876 A JP2009130876 A JP 2009130876A
Authority
JP
Japan
Prior art keywords
content
terminal
information receiving
viewing
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2007306749A
Other languages
Japanese (ja)
Inventor
Hideki Kamimaki
Hiroo Miyamoto
Nobuhiro Sekimoto
啓生 宮本
秀樹 神牧
信博 関本
Original Assignee
Hitachi Ltd
株式会社日立製作所
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Ltd, 株式会社日立製作所 filed Critical Hitachi Ltd
Priority to JP2007306749A priority Critical patent/JP2009130876A/en
Priority claimed from US12/204,429 external-priority patent/US20090070840A1/en
Publication of JP2009130876A publication Critical patent/JP2009130876A/en
Application status is Pending legal-status Critical

Links

Images

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology suitable for offering a viewing and listening style, which is seamless and independent of place, by using a mobile terminal and an information receiving terminal device. <P>SOLUTION: It is characterized by configuration capable of switching content indications between viewing and listening obtained by transceiving the content to the mobile terminal in order to view and listen to continuously the content, which was viewed and listened to by using the information receiving terminal device through operation of the mobile terminal, and viewing and listening of the content, which was viewed and listened to at the mobile terminal, by using the information terminal device in an inverse way. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The technical field relates to a system for viewing content such as video, and more particularly to a system for continuously viewing content via a network in a plurality of devices.

  Regarding the above technical field, for example, Japanese Patent Application Laid-Open No. 2004-228620 describes that “when switching terminals, content that was viewed on the switching source terminal can be continuously and continuously viewed on the switching destination terminal without logging in again from the switching destination terminal. (Refer to Patent Document 1 [0006]), and as a means for solving the problem, a “system for seamlessly handing over content (MetaPORT), a viewing history management server compliant with the TV-Anytime Forum specification, and content Realized in cooperation with meta server, location resolution server, presence management server compliant with IETF regulations, etc. MetaPORT takes over the context of the content viewed by the user at the switching source terminal and adapts to the presence of the switching destination terminal Delivery and playback This is a viewing continuation control server (MetaPORT server) that realizes the Suspend and Resume function as a network service for the user to select a switching source / switching destination terminal on the terminal (MetaPORT terminal) screen and instruct a handover. Provide a user interface and access a presence server and a location resolution server according to an input from the user to realize a seamless handover function to a switching destination terminal ”(see Patent Document 1 [0008]), etc. Has been.

  Further, Patent Document 2 states that “in a content viewing in a general home network environment, even if the user stops viewing the content, the viewing can be easily resumed from the interrupted position, and the home network AV server and home “Providing a network AV server program” (see Patent Document 2 [0006]), and as a means for solving the problem, “... in the home network AV server, the current transmission position of the content data transmitted to the client terminal is determined. A data transmission position detection unit to detect, and a data position that has been stopped based on a current transmission position of the content data output from the data transmission position detection unit when a playback stop request is received from the client terminal, as a playback start position Create content information for mid-start and A content information creation unit for mid-start to be stored in the content information list storage unit, and the transmission data creation unit refers to the content information for mid-start in the content information list storage unit when viewing and playback from the client terminal is started And transmitting the content data from the reproduction start position ”(see Patent Document 2 [0007]).

JP 2004-336310 A JP 2005-323068 A

  However, in the above Patent Documents 1 and 2, there are few considerations for simply performing switching. For example, it is time-consuming for the user to determine whether the mobile terminal is moving from the TV to the TV or from the TV to the mobile terminal, and to adjust the difference in output capability (screen size, etc.) on the mobile terminal or TV. There is such a problem.

  Therefore, for example, in the terminal cooperative viewing system, the means for holding the screen display movement state information, and the portable terminal operation, the portable display from the portable terminal to the information receiving terminal device based on the screen display movement state information. Means for switching a display video output destination to the terminal. Furthermore, a means for discriminating the content type, a means for mutually transmitting and receiving information on the display resolution and size of the information receiving terminal device or portable terminal that is the display switching target, and a display that converts the resolution and size based on the information. Means.

  According to the above means, it is possible to more smoothly realize viewing of content on a plurality of devices.

  Hereinafter, an example (example) of an embodiment suitable for the present invention will be described with reference to the drawings. However, the present invention is not limited to this embodiment. In the present embodiment, a system including a mobile terminal connected to a network, an information receiving terminal device such as a digital TV, and a content distribution device is illustrated.

  FIG. 1 shows a configuration example of a mobile terminal cooperative video movement continuous viewing system in the present embodiment. Ne

When the entire family is viewing content in the living room using the information receiving terminal device 100 such as a television receiver (television) connected to the network, the content can be viewed on the portable terminal 101 while one of the family members is moving. A case to be described will be described.

  In FIG. 1, an information receiving terminal device 100 receives a video stream distributed from a content distribution device 103 via a broadband Internet line 104 and displays content. Further, the mobile terminal 101 is connected to a line via the wireless relay device 102, and content viewing corresponding to the performance and function of each mobile terminal 101 is possible. Here, it is assumed that the information receiving terminal device 100 is a television receiver. The information receiving terminal device 100 and the portable terminal 101 are collectively referred to as a receiving terminal and a receiving terminal device.

  The information receiving terminal device 100, the portable terminal 101, and the distribution device 103 each have hardware such as a CPU, a memory, and a communication IF. The CPU executes software and executes transmission processing, reception processing, and control thereof. These are also referred to as a transmission unit, a reception unit, and a control unit.

  In the present embodiment, the information receiving terminal device 100 receives the video stream from the broadband Internet line 104, but may receive both or one of the video streams from the digital television broadcast network. The broadband internet line 104 may be, for example, an optical fiber such as FTTH, ADSL, wireless LAN, or the like.

  In this embodiment, mutual screen switching is performed between the information receiving terminal device 100 and the mobile terminal 101. Mutual screen switching refers to switching of terminals on which content is viewed among a plurality of terminals. For example, between the information receiving apparatus 100 that is commonly viewed by the family and the mobile terminal 101 that the family owns, the apparatus that performs content viewing by switching the button of the mobile terminal 101 is switched, and the content is displayed on both displays. Switching between displaying and displaying content on one of the displays. Thus, the content viewing can be continued even if the portable terminal 101 moves from the living room to another room or outside the house. In addition, you may make it output externally so that it can display on the display not only of a display but another housing | casing. Display and external output are collectively referred to as output.

  The portable terminal 101 switches screens by selecting content to be viewed via the Internet 104 and designating a destination address via the wireless relay device 102 to the content distribution device 103. The switching is, for example, a request for analyzing the address of the mobile terminal 101 or the address of the information receiving terminal device 100 to which the content is displayed by switching, and transmitting video streaming to the information receiving terminal device 100 and / or the mobile terminal 101. This is realized by performing (also referred to as a transmission request).

  The content distribution device 103 is configured to perform distribution control according to the function of the terminal based on a transmission request from the portable terminal 101. Based on the mapped URL information and address information, transmission is performed to the information receiving terminal device 100 and the portable terminal 101 at the switching destination.

  Here, for example, in the case where the content distribution apparatus 103 has two contents of the same content but high image quality and low image quality, when the content is requested to be transmitted, the mobile terminal 101 has high image quality. To see if the content can be displayed. For example, when determining whether or not display is possible, when connecting to a network, the device information is acquired using the function of uPnP (Universal Plug and Play) defined by DLNA (Digital Living Network Alliance), and the content that can be played back Resource information on type distinction, device computing capability, and video processing capability is exchanged via the network.

  Low-quality content is transmitted to the portable terminal 101, while high-quality content is transmitted to the information receiving terminal device 100 that can display high-quality content. Further, for example, when the content distribution apparatus 103 has a plurality of contents having the same contents and different compression systems (for example, MPEG4 and H.264), the content of the compression system suitable for the transmitting apparatus is selected in the same manner as described above. Or convert and send. As another method, by providing a function for acquiring a device-specific ID, vendor name, etc., in the device authentication function when connecting to a content distribution service portal, the center side has a device ID and video processing capability. It is possible to make a determination based on the processing capability of the portable terminal 101 by having a table.

  The mobile terminal 101 can also control content viewed on the information receiving terminal device 100. The content control is, for example, instructing the information receiving terminal device 100 to start / stop content viewing, screen switching, moving viewing, or moving continuous viewing. If a setting file suitable for content control is created in advance, a viewing operation related to control of the content can be easily performed. As this method, the information receiving terminal device 100 is provided with a function of storing a control command file from the network from the portable terminal 101, and an operation command from the remote controller generally used and an operation command from the portable terminal 101 are stored. This can be realized by providing a table. Thereby, the information receiving terminal device 100 can determine whether the control is from the remote controller or the control from the mobile terminal 101, and viewing start and stop that can be shared by the remote controller and the mobile terminal 101 are performed by software. It can be shared and the software scale can be reduced.

  FIG. 2 illustrates an example of a sequence in the system of FIG. FIG. 2 shows a sequence in which the display screen is switched to the portable terminal 101 from the case of viewing with the information receiving terminal device 100.

  First, (1) a content viewing request is made from the information receiving terminal device 100 to the content distribution system 103 for normal viewing. In this case, it is configured to be realized by selecting content on the service portal screen.

  In response to the request, the content distribution apparatus 103 (2) performs transmission destination confirmation, and confirms the presence or absence of a terminal apparatus (target transmission destination) other than the information receiving terminal apparatus 100 that issued the request. (3) Receives a transmission destination reply from the information receiving terminal device 100, recognizes a terminal as a transmission destination, and (4) transmits content.

  When screen switching is performed on the mobile terminal 101 in such a situation, the mobile terminal 101 transmits (5) a moving viewing parameter request to the information receiving terminal device 100, and content that has been viewed on the information receiving terminal device 100. Request to get the time code.

  The mobile terminal 101 acquires the top time code of the content switching playback content for performing playback after switching of the content viewed on the information receiving terminal device 100 by receiving the (6) viewing status reply.

  The moving viewing parameter refers to the time code indicating the time of the content currently being viewed, the title of the content being viewed, the viewing record of how far the previously viewed content has been viewed, and the content that can be played back and displayed. The video processing capability of the device that determines the type may be included. In the present embodiment, the case of realizing moving viewing of the currently viewed video content is described, and moving viewing by time code is described. The time code may indicate a playback time from the start of the content, or may be a time stamp such as DTS, PTS, ATS. Also called time information or synchronization information.

  In addition, depending on the user, moving viewing according to the story of the content content, such as playback from 3 minutes before playback from the same time, playback from the immediately preceding CM, and the like, is also possible. The viewing status can be extended to such a case, not only returning the time code status to the exact viewing time, but also 3 minutes after the previous CM, 1 minute after the scene change, etc. By returning the status corresponding to the viewing style, it is possible to realize a mobile viewing function that is easier for the user to view. The start time code is a time code indicating the start of playback when playback is performed during mobile viewing. The user's request is parameterized in advance, and the time code until the end of the previous CM is added to the start time code as an offset. It is also possible to set it as the leading time code.

  The portable terminal 101 makes a (7) screen switching viewing request to the content distribution device 103 based on the head time code. Also, (8) information receiving terminal transmission device viewing stop transmission is performed, content viewing stop processing is performed on the information terminal device 100, and the content distribution device 103 transmits (9) content to the target mobile terminal 101. . Thereby, the screen switching process to the information receiving terminal 101 is completed.

  Conversely, in switching viewing from viewing on the mobile terminal 101 to the information receiving terminal device, the information receiving terminal device 100 that is the switching destination is designated from the mobile terminal 101 by (10) the information receiving terminal, and (11) the information receiving terminal. After the apparatus 100 is activated, the content distribution apparatus 103 makes a content transmission request to the information receiving terminal apparatus 100 to the content distribution apparatus 103, and the content distribution apparatus 103 is configured to distribute the content (13). You may switch from the portable terminal 101 to another portable terminal 101. Alternatively, switching may be performed by executing (5) from the information receiving terminal device 100 that is the switching destination or another portable terminal 101.

  FIG. 3 shows a configuration example of a system when a family member takes the mobile terminal device 100 out of the house. Utilizing the mobile network facility 105, the content can be continuously viewed both inside and outside the home, and various services can be interleaved. For example, by having a table of IDs unique to devices used in the mobile network equipment 105 and IDs in a LAN environment when viewing in the home on the center side, it is possible to mutually enter services. By storing the MAC address of the home LAN in a SIM card mounted on the portable terminal 101 overseas, it is possible to use this MAC address for viewing when making a mobile viewing request to the center side. Further, by inserting the SIM card into the mobile terminal 101 of a friend or relative while away from home, it is possible to view the content not only with the mobile terminal 101 owned by the user but also with the friend or relative.

  The card may be a memory card. Furthermore, it is possible to determine whether or not there is a service contract, and it is possible to flexibly deal with the types of services such as services that can be freely viewed without limitation for a limited time.

  FIG. 4 shows an example of a sequence diagram in the case where one of the family members continuously views the content viewed by the family on the portable terminal 101 by moving in the home such as a kitchen or a toilet or going out.

  The processes (1) to (6) are performed in the same sequence as in FIG. 2, and the mobile terminal 101 makes a (7) ′ movement viewing request. The (7) screen switching viewing request in FIG. 2 means that when the information receiving terminal device 100 is viewed by a plurality of families, even if one of the families performs mobile viewing with the mobile terminal 101 at home, the remaining family However, the information receiving terminal device 100 can be viewed as it is.

  Also, (8) ′ information reception terminal device continuous viewing necessity transmission is performed. (8) in FIG. 2 is that when the information receiving terminal device 100 is viewed by a plurality of families, even if one of the family members performs mobile viewing with the mobile terminal 101 at home, the remaining family members receive the information. This is different in that the power is not turned off so that the terminal device 100 can be viewed as it is, and it is also possible to achieve without disturbing the comfortable viewing of the family who was watching the content together on the information receiving terminal 100 together.

  (8) By performing the “required” process in ′, continuous viewing on the information receiving terminal device 100 is possible without affecting the family who continuously views on the information receiving terminal device 100.

  When “No” is processed in (8) ′, the power of the information receiving terminal device 100 can be turned off, and when performing mobile viewing with the mobile terminal 101 alone, without performing a series of operations. In addition, by using this function in reverse, by giving a mobile viewing instruction when returning home, the information receiving terminal device 100 is turned on, and content can be viewed immediately.

  In FIG. 4, information receiving terminal device continuous viewing necessity is transmitted to the content distribution device 103, but is transmitted to the information receiving terminal device 100, and in the case of “No”, the information receiving terminal device The display or reception may be stopped at 100, or the transmission may be stopped from the information receiving terminal device 100 to the distribution device 103. In this case, it is effective when the information receiving terminal device 100 is limited as a service target, and the viewing history is accumulated in the storage device in the information receiving terminal device 100, so that it can be managed centrally, and malicious content It is also possible to avoid damages such as illegal charges from service providers, restrict viewing of family members, and prevent viewing of malicious content. However, a storage area for accumulating management information is required, which increases the cost of the apparatus, reduces the recording capacity of content, and downloads, and if the information increases, management may be troublesome.

  The content distribution device 103 is configured with a distribution function of a plurality of content streams of the same content based on (7) information reception terminal device continuation necessity information from the mobile terminal 101. The number of mobile terminals 101 is not limited to one.

  In addition, by providing the mobile terminal 101 with a time code calculation function for starting mobile viewing, for example, the original time code calculation of n seconds ago is performed on the acquired value of the start time code of the mobile viewing request according to the system. In addition, mobile viewing can be realized without obstructing the content. As a result, when viewing is performed on a plurality of receiving terminals (the mobile terminal 101 and the information receiving terminal device 100), it is possible to cope with temporal shifts in content at the receiving terminals.

  For example, a user is watching with the information receiving terminal device 100 in the living room with his / her family, viewing the portable terminal 101 by taking it to the toilet and his / her room, and returning to the living room to see the information receiving terminal with the family. When viewing with the device 100, for example, while moving to a toilet or own room, or operating the device, the content received by the information receiving terminal device 100 and the portable terminal 101 is temporal. Misalignment will occur. Then, when the user returns to the living room, the content that is being viewed on the information receiving terminal device 100 is more advanced than the mobile terminal 101, and the user of the mobile terminal 101 cannot return to viewing on the information receiving terminal device 100. Or there is a concern that a scene to be missed may appear.

  In this regard, for example, in order to match the time codes of the contents viewed on the information receiving terminal device 100 and the mobile terminal 101 (but not necessarily completely match), the mobile terminal 101 has a monitoring function of the reception bit rate, Based on the result of the bit rate, it is possible to control the changing of the playback speed or skipping the CM, such as playing back only the I frame, so that the viewing of the mobile terminal 101 and the information receiving terminal device 100 can be synchronized. It becomes. This operation may be executed mainly by the mobile terminal 101 or may be executed mainly by the distribution device 103.

  Further, by monitoring the distance from the information receiving terminal device with the GPS function of the mobile terminal 101 or the like, it is possible to synchronize the viewing content as the mobile terminal 101 approaches the information receiving terminal. By using this function, connection switching from a mobile network service to a home wireless LAN environment is possible.

  In addition, when the screen is switched in this embodiment, the content (program) is switched to arouse the story, and at the start of viewing, the scene similar to the viewing is overlapped for a predetermined time intentionally immediately before switching to maintain the story of the content. This function can also be realized.

  These mobile continuous viewing functions and the screen switching function from the information receiving terminal device 100 to the mobile terminal 101 and vice versa enable continuous mobile viewing not only inside the home but also outside the home utilizing the characteristics of the mobile terminal 101. Thus, a seamless content viewing style can be realized between the large-screen information receiving terminal 100 and the portable terminal 101 by the portable terminal 101 and the information receiving terminal device 100 such as a TV.

  In addition, the camera function in which the mobile terminal 101 is mounted on the go has a capture function such as video and information, which can be transmitted to the information receiving terminal device 100 via the center. When the mobile viewing destination is set in the information receiving terminal device 100 in the grandparent's house, it is possible to view the grandchild's video on the information receiving terminal 100 in the remote location of the grandparent's house via the mobile network. Become.

  Since the target information receiving terminal 100 is connected to the network, mobile viewing of the information receiving terminal device 100 desired by the user is also possible.

  FIG. 5 shows an example of an operation screen on the mobile terminal 101. A remote control menu for viewing, stopping, pausing and the like, and a screen switching, moving viewing, and continuous moving viewing menu for switching viewing styles between the two terminal devices are displayed on the mobile terminal 101, and the system has high operability. It has a configuration. By detecting selection of these menus, each process in the sequence of FIG. 2 or FIG. 4 is executed.

  The menu screen may be realized as a portal screen on the center side or an application on the terminal side.

  Further, the content stored in the storage medium of the mobile terminal 101 and the content being viewed from the mobile network are displayed on the display device with different resolution and size provided in the information receiving terminal device 100, and the information is reversed. It is also possible to display the content viewed on the receiving terminal device 100, the content recorded on the HDD device, and the downloaded content on the display device provided in the portable terminal 101. This will be described in detail below.

  FIG. 6 shows an example of the hardware configuration of the mobile terminal 101.

  The portable terminal 101 includes a wireless interface unit 720, and thereby performs bidirectional communication with the information receiving terminal device 100. The mobile terminal 101 will be described by taking a mobile phone as an example. However, as long as the mobile terminal 101 has a network function and has a function of transmitting and receiving control information and content information with the information receiving terminal device 100, other mobile devices such as a mobile game machine. It doesn't matter. Transmission and reception control of data and information to the information receiving terminal device 100 by the terminal device 101 will be described.

  The operation unit 713 includes a keyboard including a cursor key, a numeric key, a determination key, and the like, and a desired information receiving terminal device 100 can be selected by operating these keys. Specifically, the display control of the content display is performed using the selection menu displayed on the display 711 and the keyboard. In addition to the normal operation mode, there is a display content movement mode between the information terminal device 100 and the portable terminal 101. In the display content movement mode, the display content is displayed by each key operation or one touch of the operation screen. The display optimized for the resolution and size of the display can be made possible.

  When the user operates the portable terminal 101, the CPU 701 refers to the mode selection menu screen displayed on the display 711 of the portable terminal 101 as shown in FIG. 7 according to the program stored in the main memory 702. And select the display content movement mode. This selection is executed by moving to a desired icon with a cursor key or the like of a keyboard (not shown) and pressing a determination key (not shown). In addition, a touch panel may be provided on the display surface of the display 711, and the icon 905 may be selected by directly touching the display surface.

  In the example of FIG. 7, it is assumed that the cursor is positioned on the content display movement mode icon 805 and the content display movement mode is selected. This selection menu is hierarchized, can be customized based on the user's operation history, and can be selected by key operation. For example, the menu screen shown in FIG. 7 is displayed in the normal operation mode 901, the mobile link mode 902, the remote control mode 903, the display screen movement mode 904, the content display movement mode 905, the related content display mode 906, etc. Contains an icon that is an option for selecting an operation. In this example, six icons are displayed, which are “normal operation mode”, “mobile link mode”, “remote control mode”, “display screen movement mode”, “content display movement mode”, and “related content display”, respectively. It corresponds to "mode".

  The “normal operation mode” is a normal operation that does not use the cooperation function of the mobile terminal 101. For example, a normal content processing operation such as making a call for a call or displaying a menu such as Internet access is performed. The mode to perform.

  In the “portable link mode”, for example, processing capability information such as the display 805 and the media processing / display control unit 804 of the information receiving apparatus 100, information on a list of contents recorded and downloaded in the HDD 815 are held in the storage medium 706, and information is stored. Cooperation operation mode with the receiving terminal device 100.

  The “remote control mode” in the “mobile link mode” is a mode in which the remote controller for operating the information receiving terminal device 100 (not shown) is operated from the mobile terminal 101 to control the content control unit 805 to receive broadcasts. A remote controller of the information receiving terminal device 100 for receiving live broadcast content from broadcast waves received from the control unit 809, recorded content to the HDD 815, streaming content received from the IP broadcast reception / communication control unit 812, and download content to the HDD 815 Mode that performs equivalent operations.

  The “display screen movement mode” in the “mobile link mode” is a content determination / display state control unit 703, 812 provided in both the mobile terminal 101 and the information receiving terminal device 100, for example, by one-touch operation of the mobile terminal 101. Mode that controls the display.

  Among the “display screen movement modes”, the “content display movement mode” is a screen between the information receiving terminal device 100 and the mobile terminal 101, and the display 711 of the mobile terminal 101 and the display of the information receiving terminal device 100 like a catch ball. A mode for switching the content to be displayed in 805.

  In the “display screen movement mode”, the “related content display mode” is the related information related to the content when the content display is moved from the portable terminal 101 to the information receiving terminal device 100, for example, Web information from the Internet regarding the content. In this mode, subtitle information and the like are displayed on the display 705 of the portable terminal 101 and audio information is output to the speaker 712. The content described above is not limited to video content, but may be any digital content such as text data such as newspapers, JPEG data such as photographs, music data, and the like. All contents that the portable terminal 101 and the information receiving terminal apparatus 100 can obtain from the Internet, one-segment broadcasting, full-segment broadcasting waves, and portable bridge media are targeted.

  Further, the main memory 702 that is a memory for executing an application program (for example, a program for controlling screen movement) of the mobile terminal 101 is a screen display movement from the mobile terminal 101 to the information receiving terminal device 100, or information Whether the screen display is moved from the receiving terminal device 100 to the portable terminal 101 is held. As a result, the source (movement source) and destination (movement destination) for moving the screen display are determined according to the user's action. A memory other than the main memory 702 (for example, a ROM storing an application program) may be used.

  In addition, identification information (for example, device-specific MAC address information) of the terminal that is the target of screen display movement, processing capability information of the terminal (for example, display size provided by the device, extension of a decodable video format, support, etc. A player such as Flash, an executable environment such as a JPEG viewer, a slide show, and a PDF viewer) are stored in the main memory 702 or the like. The content determination / display state control unit 703 interprets the information and the received data, and operates to execute a screen display movement process.

  The content determination / display state control unit 703 of the mobile terminal 101 is controlled by a program executed by the CPU 701 in accordance with the mode selection shown in FIG. 7, and its output is sent from the communication control unit 705 of the mobile terminal 101 to the information receiving terminal device 100. send. The IP broadcast reception / communication control unit 812 of the information receiving terminal device 100 transmits and receives content between the devices via the network I / Fs 708 and 811, and also displays the display resolution and screen size of the mobile terminal 101 and the information receiving terminal device 100. The content type, the list of content titles held by each device, and the like are acquired in the initial connection sequence.

  For the content list, it is possible to use a mechanism in which a standardized standard is defined by DLNA. In this way, the content determination / display state control unit 703 determines whether the MPEG-2 / MPEG-4 / AVC video format, the standard definition, or the high definition is based on the information acquired from the terminal. By determining whether the format is AAC or MP3, the media processing / display control unit 709 of the device itself is automatically activated to process content and display data as optimal display data for the display 711. To work. This function is provided in both the mobile terminal 101 and the information receiving terminal device 100, so that the display screen can be moved from the mobile terminal 101 to the information receiving terminal device 100 and vice versa. Thus, music playback can be output from the speaker 806 of the high-quality information receiving terminal device 100, and a still image such as a high-definition photograph can be displayed on the screen.

  Further, the content determination / display state control unit 703 analyzes not only the content to be reproduced but also the information related to the multiplexed content, for example, information that enables the CPU 701 to process the URL information of the website. For example, displaying only the Web information acquired by the CPU 701 on the screen of the mobile terminal 101, such as displaying the content to be operated on the mobile terminal 101 at the same time as moving the display screen. Yes.

  Thereby, the display content reproduction which combined the main content of the portable terminal 101, subordinate content, the main content of the information receiving terminal device 100, and subordinate content is attained. Here, the display screen is described as an example, but moving reproduction of audio data, combined reproduction of photo data and audio data, and the like are also possible.

  The information receiving terminal device 100 obtains information such as the format from the information from the media processing / display control unit 804, and performs processing according to the specifications of the display 711 of the portable terminal 101 and the display 805 of the information receiving terminal device 100. Thus, it is possible to perform content display suitable for the capabilities of individual devices.

  In addition, the content determination / display state control units 703 and 813 of each device indicate which device is displaying the content by the operation of the mobile terminal 101, and the displayed content is content whose source is the mobile terminal 101. By managing whether the information is received from the information receiving terminal device 100, the content display is moved from the portable terminal 101 to the information receiving terminal device 100 by the next operation of the portable terminal 101, or vice versa. It is determined whether the content display is to be moved, and the content display is moved.

  As a result, even if the content source is the mobile terminal 101 or the information receiving terminal device 100, the mobile terminal 101 can be used to move and display content between devices having different display sizes and resolutions. Various cooperative operations are possible with the portable terminal.

  FIG. 8 shows an example of a system configuration diagram using the super-resolution technique. By providing the mobile terminal 101 and the information receiving terminal device 100 with the super-resolution processing units 901 and 902, the super-resolution processing is performed based on the content type determination information from the content determination unit / display state control units 703 and 813. By performing the above, high-quality content can be displayed without being caught by the resolution of the source content.

The figure which shows the structural example of a portable terminal cooperation image | video movement continuous viewing-and-listening system. The figure which shows an example of the protocol sequence of screen switching. The figure which shows the structural example of the portable terminal cooperation image | video movement continuous viewing system which implement | achieves the movement viewing in the house and the outside of a house. The figure which shows an example of the protocol sequence of a movement continuation viewing / listening. The figure which shows the example of a display of the menu of an operation screen. Configuration examples of the mobile terminal 100 and the information receiving terminal device 101 will be shown (second embodiment). An example of the mode selection screen of portable terminal cooperation is shown. (Example 3) The structural example of the portable terminal 100 and the information receiving terminal device 101 using a super-resolution technique is shown.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 100 ... Information receiving terminal device, 101 ... Mobile terminal, 102 ... Wireless relay device, 103 ... Content distribution device, 104 ... Internet, 105 ... Mobile network equipment, 601 ... Operation screen, 602 ... Viewing, 603 ... Stop, 604 ... Temporary Stop, 605 ... Screen switching, 606 ... Moving viewing, 607 ... Moving continuous viewing, 701 ... CPU, 702 ... Main memory, 703 ... Content discrimination / display state control unit, 704 ... Control I / F, 705 ... Communication control unit 706 ... Storage media, 707 ... Content data I / F, 708 ... Network I / F, 709 ... Media processing / display controller, 710 ... Work memory, 711 ... Display, 712 ... Speaker, 801 ... CPU, 802 ... Main memory, 803 ... Control I / F unit, 804 ... Media processing / display control unit, 805 ... Display, 806 ... Speaker, 807 ... Work memory, 808 ... Broadcast reception I / F, 809 ... Broadcast reception control unit, 810 ... content control unit, 811 ... network I / F, 812 ... IP broadcast reception / communication control unit, 813 ... content discrimination / display state control unit, 814 ... content data I / F, 815 ... HDD, 901 ... super-resolution processing unit, 902 ... super-resolution processing unit

Claims (5)

  1. A terminal-linked viewing system,
    Means for holding screen display movement state information;
    A terminal-linked viewing system including means for switching a display video output destination from a portable terminal to an information receiving terminal device and from an information receiving terminal device to a portable terminal based on the screen display movement state information by a portable terminal operation.
  2. The terminal-linked viewing system according to claim 1,
    Means for determining the content type;
    Means for mutually transmitting and receiving information on the display resolution and size of the information receiving terminal device or portable terminal to be switched,
    A terminal cooperative viewing system having means for converting and displaying the resolution and size based on the information.
  3. The terminal-linked viewing system according to claim 2,
    A terminal-linked viewing system that converts resolution by super-resolution.
  4. The terminal-linked viewing system according to claim 1,
    A terminal-linked viewing system that displays a menu screen of content information or the like on a portable terminal when the output destination of a display video is switched from the portable terminal to the information receiving terminal device.
  5. The terminal-linked viewing system according to claim 4,
    A terminal-linked viewing system including information acquired from the Internet on the menu screen.
JP2007306749A 2007-11-28 2007-11-28 Terminal cooperation continuation viewing-and-listening system, terminal, server, and method Pending JP2009130876A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2007306749A JP2009130876A (en) 2007-11-28 2007-11-28 Terminal cooperation continuation viewing-and-listening system, terminal, server, and method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2007306749A JP2009130876A (en) 2007-11-28 2007-11-28 Terminal cooperation continuation viewing-and-listening system, terminal, server, and method
US12/204,429 US20090070840A1 (en) 2007-09-05 2008-09-04 Terminal-Cooperated System, Terminal, Server and Method for Uninterrupted Reception of Contents

Publications (1)

Publication Number Publication Date
JP2009130876A true JP2009130876A (en) 2009-06-11

Family

ID=40821311

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2007306749A Pending JP2009130876A (en) 2007-11-28 2007-11-28 Terminal cooperation continuation viewing-and-listening system, terminal, server, and method

Country Status (1)

Country Link
JP (1) JP2009130876A (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013514006A (en) * 2009-12-09 2013-04-22 インターデイジタル パテント ホールディングス インコーポレイテッド Method and apparatus for session replication and session sharing
JP2013126059A (en) * 2011-12-14 2013-06-24 Sharp Corp Content reproduction system, television receiver, program and recording medium recording that program
JP2013141181A (en) * 2012-01-06 2013-07-18 Toshiba Corp Communication system using mobile terminal and television apparatus, mobile terminal, television apparatus, method for communication of mobile terminal, and operation program of mobile terminal
WO2014010069A1 (en) * 2012-07-13 2014-01-16 日立コンシューマエレクトロニクス株式会社 Video transmission method, caption display device, and video transmission device
JP2014120806A (en) * 2012-12-13 2014-06-30 Toshiba Corp Information processing unit, control method, and control program
US8943217B2 (en) 2010-12-06 2015-01-27 Sony Corporation Systems and methods for operating an appliance control device for an appliance
WO2015033429A1 (en) * 2013-09-06 2015-03-12 日立マクセル株式会社 Terminal device, network-terminal system, and display device
JP2015508531A (en) * 2011-12-28 2015-03-19 ノキア コーポレイション Application Switcher
JP2015521431A (en) * 2012-05-17 2015-07-27 華為技術有限公司Huawei Technologies Co.,Ltd. Multi-screen interaction method and system
US9438876B2 (en) 2010-09-17 2016-09-06 Thomson Licensing Method for semantics based trick mode play in video system
US9866922B2 (en) 2010-03-31 2018-01-09 Thomson Licensing Trick playback of video data
US9983771B2 (en) 2011-12-28 2018-05-29 Nokia Technologies Oy Provision of an open instance of an application
US10171720B2 (en) 2011-12-28 2019-01-01 Nokia Technologies Oy Camera control application

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007074529A (en) * 2005-09-08 2007-03-22 Mitsubishi Electric Corp Contents continuously viewing system

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007074529A (en) * 2005-09-08 2007-03-22 Mitsubishi Electric Corp Contents continuously viewing system

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013514006A (en) * 2009-12-09 2013-04-22 インターデイジタル パテント ホールディングス インコーポレイテッド Method and apparatus for session replication and session sharing
US9866922B2 (en) 2010-03-31 2018-01-09 Thomson Licensing Trick playback of video data
US9438876B2 (en) 2010-09-17 2016-09-06 Thomson Licensing Method for semantics based trick mode play in video system
US8943217B2 (en) 2010-12-06 2015-01-27 Sony Corporation Systems and methods for operating an appliance control device for an appliance
JP2013126059A (en) * 2011-12-14 2013-06-24 Sharp Corp Content reproduction system, television receiver, program and recording medium recording that program
US9983771B2 (en) 2011-12-28 2018-05-29 Nokia Technologies Oy Provision of an open instance of an application
US9479568B2 (en) 2011-12-28 2016-10-25 Nokia Technologies Oy Application switcher
JP2015508531A (en) * 2011-12-28 2015-03-19 ノキア コーポレイション Application Switcher
US10171720B2 (en) 2011-12-28 2019-01-01 Nokia Technologies Oy Camera control application
JP2013141181A (en) * 2012-01-06 2013-07-18 Toshiba Corp Communication system using mobile terminal and television apparatus, mobile terminal, television apparatus, method for communication of mobile terminal, and operation program of mobile terminal
US8782718B2 (en) 2012-01-06 2014-07-15 Kabushiki Kaisha Toshiba Mobile terminal, television receiver, and communication system including the mobile terminal and the television receiver
US9973812B2 (en) 2012-05-17 2018-05-15 Huawei Technologies Co., Ltd. Multi-screen interaction method and system
US9538237B2 (en) 2012-05-17 2017-01-03 Huawei Technologies Co., Ltd. Multi-screen interaction method and system
JP2015521431A (en) * 2012-05-17 2015-07-27 華為技術有限公司Huawei Technologies Co.,Ltd. Multi-screen interaction method and system
WO2014010069A1 (en) * 2012-07-13 2014-01-16 日立コンシューマエレクトロニクス株式会社 Video transmission method, caption display device, and video transmission device
JP2014120806A (en) * 2012-12-13 2014-06-30 Toshiba Corp Information processing unit, control method, and control program
WO2015033429A1 (en) * 2013-09-06 2015-03-12 日立マクセル株式会社 Terminal device, network-terminal system, and display device

Similar Documents

Publication Publication Date Title
US8135844B2 (en) Content providing server, information processing device and method, and computer program
ES2615344T3 (en) Portable terminal, information processing device, content display system and content display method
EP2080349B1 (en) Sharing multimedia content in a peer-to-peer configuration
KR101511881B1 (en) Adaptive media content scrubbing on a remote device
CN1649411B (en) System and method for configuration of user interfaces
CN100539663C (en) Information processing system, recording apparatus, communication apparatus, information processing method
EP2547100A1 (en) Personal video recorder functionality for placeshifting systems
EP1133120A2 (en) Control data system and control data transmission method
US20050246757A1 (en) Convergence of network file system for sharing multimedia content across several set-top-boxes
JP2008219929A (en) Broadcast program storing apparatus
EP1455531A2 (en) Information apparatus and resource control method
EP1909457B1 (en) Apparatus for receiving adaptive broadcast signal and method thereof
US7890628B2 (en) Method for controlling services
EP1372333B1 (en) Picture transfer between mobile terminal and digital broadcast receiver
JP2006227843A (en) Content information management system, content information management device, content information management method and computer program
EP1761049A2 (en) Method and apparatus for constructing dynamic menu for user interface
JP2011118470A (en) Control device and control method
WO2004090735A1 (en) Content providing server, information processing device and method, and computer program
KR20090018664A (en) Signal distribution system with interrupt processing and trick play functionality
WO2005011133A2 (en) Power line home network
JP2004222044A (en) Information processor and communication control method
CA2820402A1 (en) Method and device for controlling a video receiver
EP2382774B1 (en) Shared television sessions
US20080155062A1 (en) System for providing media data
CN102484747A (en) Information processing device, data management method, and program

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20100921

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20121025

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20121030

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20130305