JP2008065701A - Gateway apparatus, and method of relaying information - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To view a content desired by a user using a mobile terminal of high versatility. <P>SOLUTION: An IP gateway device 20 comprises an Internet communication circuit 50, a content communication terminal 56 and a CPU 60. The Internet communication circuit 50 communicates information and data with the mobile terminal through an IP telepnone network. The content communication terminal 56 communicates the information and data between an image accumulation device 29 and itself. A CPU 60 processes the information and data communicated by the Internet communication circuit 50 and information communicated by the content communication part 56. The CPU 60 makes a program etc. used for inputting a retrieval condition to be transmitted to the mobile terminal, makes information expressing the retrieval condition to be transmitted to the image accumulation device 29, makes the result of retrieval to be transmitted to the mobile terminal, makes program or the like used to specify the image data to be transmitted to the mobil terminal and makes a part of image data to be transmitted to the mobile terminal. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a gateway device and an information relay method, and more particularly to a gateway device and an information relay method for transmitting and reproducing image information.

  Patent Document 1 discloses a television receiving system including a television receiving device that receives a television broadcast signal, reproduces it, and outputs or records it, and a mobile terminal connected to the television receiving device via a communication line. The television receiver disclosed in Patent Literature 1 includes a communication unit, an image quality determination unit, an encoding unit, and a transmission unit. The communication unit is connected to the mobile terminal via a communication line. The image quality determination unit determines the image quality to be transmitted to the mobile terminal based on the transmission request of the television broadcast signal from the mobile terminal connected via the communication line and the image quality information received from the mobile terminal. The encoding unit encodes a television broadcast being received or recorded based on the determination result of the image quality determination unit. The transmission unit transmits the television broadcast signal encoded by the encoding unit via the communication unit. The portable terminal includes a transmission request unit, an image quality information transmission unit, a decoding unit, and a display unit. The transmission request unit requests transmission of a television broadcast signal. The image quality information transmission unit transmits the image quality information determined by the image quality determination unit. The decoding unit decodes the encoded television broadcast signal received from the television receiver. The display unit displays the television broadcast signal decoded by the decoding unit.

According to the invention disclosed in Patent Document 1, a program received using a television receiving system can be viewed at a place away from a place where a monitor TV connected to a receiving apparatus is installed, and a recorded program is recorded. Can be viewed at a location away from the installation location of the monitor TV connected to the receiving device.
JP 2004-96394 A

  However, in the invention disclosed in Patent Document 1, in order to view a program recorded at a place away from the place where the monitor TV is installed, it is necessary to use a portable terminal that is not very versatile. There is. This is because dedicated software for controlling from the selection of a program to the end of viewing is required.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a gateway device and a method for relaying information that allow a user to view content desired by a highly versatile communication device. There is.

In order to achieve the above object, according to one aspect of the present invention, a gateway device includes Internet communication means, content communication means, and processing means. The Internet communication means communicates information and data with a communication device through the Internet. The content communication means communicates information and data with a storage device that stores content data that is data representing content by at least one of video and audio. The processing means processes information and data communicated by the Internet communication means and information and data communicated by the content communication means. The processing means includes search program control means and relay means. The search program control means controls the storage means and the Internet communication means so as to transmit data including the search program when the Internet communication means receives information indicating a request for data including the search program from the communication device. The relay means includes information indicating search conditions generated by execution of the search program, information indicating content data satisfying the search information, information indicating selected content data that is content data satisfying the search information, and selected content data Are relayed between the communication device and the storage device.

  Moreover, it is desirable that the relay unit described above includes a condition information control unit, a content information control unit, a selection information control unit, and a partial data control unit. The condition information control unit controls the content communication unit to transmit information representing the search condition when the Internet communication unit receives the information representing the search condition. The content information control means controls the Internet communication means to transmit information representing content data satisfying the search information when the content communication means receives information representing content data satisfying the search information from the storage device. The selection information control unit controls the content communication unit to transmit information representing the selected content data when the Internet communication unit receives information representing the selected content data. The partial data control unit controls the Internet communication unit to transmit the selected content data part by part when the content communication part receives the selected content data part by part from the storage device.

  Alternatively, the partial data control means described above preferably includes means for controlling the Internet communication means so as to transmit a part of the selected content data as a packet.

  According to another aspect of the present invention, the information relay method includes a search program transmission step, a condition information transmission step, a content information transmission step, a selection information transmission step, and a partial data transmission step. In the search program transmission step, when the Internet communication means for communicating information and data with the communication device through the Internet receives information representing a request for data including the search program, which is a program used for inputting search conditions, from the communication device, Send data including search program. In the condition information transmission step, when the information indicating the search condition is received by the Internet communication means, information and data are communicated with a storage device that stores content data that is data representing content by at least one of video and audio. The content communication means transmits information representing the search condition. When the content communication means receives the content information transmitting step and the information representing the content data satisfying the search information from the storage device, the Internet communication means transmits the information representing the content data satisfying the search information. When the Internet communication means receives the selection information transmitting step and the information representing the selected content data, the content communication means transmits the information representing the selected content data. In the partial data transmission step, when the content communication means receives the selected content data part by part from the storage device, the Internet communication means transmits the selected content data part by part.

  With the gateway device and the information relay method according to the present invention, it is possible to view the content desired by the user using a highly versatile communication device.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

FIG. 1 shows a configuration of a content viewing system according to the present embodiment. Referring to FIG. 1, the content viewing system according to the present embodiment includes an IP gateway device 20, an image storage device 29, and a mobile terminal 32. The IP gateway device 20 is a device that relays information and data between the image storage device 29 and the portable terminal 32. Image storage device 29
Is an apparatus for storing image data representing content and image information representing the content. The image storage device 29 may be a digital camera or any other device. In the case of the present embodiment, the two image storage devices 29 shown in FIG. 1 are a hard disk recorder and a personal computer. And One provider of image data and image information stored in the image storage device 29 is a server 34. The server 34 is a device that communicates with the image storage device 29 via the IP telephone network 30. The mobile terminal 32 is a device that accepts user operations, requests content desired by the user from the image storage device 29, and displays image data representing content transmitted by the image storage device 29. The portable terminal 32 may be any device such as a PDA (Personal Digital Assistants), but in the present embodiment, the portable terminal 32 is a cellular phone.

  FIG. 2 is a hardware configuration diagram of the IP gateway device 20. Referring to FIG. 2, an IP gateway device 20 includes an Internet communication circuit 50, a memory 52, a wireless communication circuit 54, a content communication circuit 56, a SLIC (Subscriber Line Interface Circuit) 58, a CPU (Central Processing Unit). ) 60 and a power source 62.

  The Internet communication circuit 50 is a circuit that communicates data described below with the portable terminal 32 and the server 34 via the IP telephone network 30. The data is image data and image information. In the present embodiment, “image data” is content data representing the content itself viewed by the user using the mobile terminal 32. The image data may include sound data that is data representing sound. In the present embodiment, “image information” is data representing the contents of performers and other contents. In this embodiment, these data are communicated as packets.

  The memory 52 includes information necessary for the CPU 60 to control devices and circuits constituting the IP gateway device 20, data including a program used for inputting search conditions, and data including a program used for specifying content data. It is a device to memorize.

  The wireless communication circuit 54 is a circuit that performs wireless communication with a communication device (not shown). The content communication circuit 56 is a device that mutually converts a signal that can be communicated with the image storage device 29 and a signal that can be used by the CPU 60. The content communication circuit 56 operates as a device for communicating with the image storage device 29. In the present embodiment, a PHY (Physical Layer Chip) operates as the content communication circuit 56.

  The SLIC 58 is a device that mutually converts a signal that can be used by the CPU 60 and a signal that can be used by an analog telephone (not shown). The SLIC 58 operates as a device for communicating with a plurality of analog telephones. The SLIC 58 is also a device that controls the operation of the analog telephone through control of signal waveforms.

  The CPU 60 is a device that controls the Internet communication circuit 50, the wireless communication circuit 54, the content communication circuit 56, and the SLIC 58. The CPU 60 is also a device that performs processing necessary to control these. The power source 62 is a device that supplies power to devices and circuits that constitute the IP gateway device 20.

  FIG. 3 is a functional block diagram of the CPU 60. Referring to FIG. 3, the function of CPU 60 includes a search program control unit 150 and a relay unit 152.

When the Internet communication circuit 50 receives information representing a request for data including a search program from the portable terminal 32, the search program control unit 150 causes the memory 52 and the Internet communication circuit 50 to transmit data including the search program. It is a function to control. In the case of the present embodiment, for such control, the search program control unit 150 reads data including a program used to input search conditions stored in the memory 52, and transmits a packet including the data to the Internet communication circuit 50. Output to. Thereafter, the search program control unit 150 outputs a control signal for transmitting the packet to the Internet communication circuit 50. In the case of the present embodiment, “data including a program used for inputting a search condition” means data described in HTML including a program used for inputting a search condition.

  Relay unit 152 includes information representing search conditions generated by execution of the search program, information representing content data satisfying the search information, information representing selected content data that is content data satisfying the search information, and selected content This is a function for relaying data between the portable terminal 32 and the image storage device 29.

  Relay unit 152 includes a condition information control unit 162, a content information control unit 164, a selection information control unit 166, and a partial data control unit 168.

  The condition information control unit 162 has a function of controlling the content communication circuit 56 to transmit information representing the search condition when the Internet communication circuit 50 receives the information representing the search condition. When the content communication circuit 56 receives information representing content data satisfying the search information from the image storage device 29, the content information control unit 164 controls the Internet communication circuit 50 to transmit information representing content data satisfying the search information. It is a function to do. The selection information control unit 166 has a function of controlling the content communication circuit 56 to transmit information representing the selected content data when the Internet communication circuit 50 receives the information representing the selected content data. The partial data control unit 168 has a function of controlling the Internet communication circuit 50 so that when the content communication circuit 56 receives selected content data from the image storage device 29 part by part, the selected content data is transmitted part by part.

  The condition information control unit 162 includes a first generation unit 202 and a second control unit 204. When the Internet communication circuit 50 receives information representing a search condition from the portable terminal 32, the first generation unit 202 generates information representing the search condition in a format that can be used by the image storage device 29. The second control unit 204 controls the content communication circuit 56 so as to transmit the information generated by the first generation unit 202.

  The content information control unit 164 includes a second generation unit 206 and a third control unit 208. The second generation unit 206 generates data including a program used for specifying content data represented by information representing a result. When the content communication circuit 56 receives information representing the result of searching for content data satisfying the search condition from the image storage device 29, the second generation unit 206 generates the data. The second generation unit 206 generates data using data including a program used for specifying content data and information indicating the result. In the case of the present embodiment, “data including a program used for specifying content data” means data described in HTML including a program used for specifying content data. “Data including a program used for specifying content data represented by information representing results” means data described in HTML including a program used for identifying content data represented by information representing results. The second generation unit 206 generates data including a program used for specifying content data represented by information representing a result by changing the content of data including a program used for specifying content data. Due to this change, a part of the data including the program used for specifying the content data is changed along with the information representing the result. The third control unit 208 controls the Internet communication circuit 50 so as to transmit the data generated by the second generation unit 206.

  The selection information control unit 166 includes a third generation unit 210 and a fourth control unit 212. The third generation unit 210 generates information in a format that can be used by the image storage device 29. The information generated by the third generation unit 210 is information representing the content data specified by the information specifying any of the content data. When information specifying any of the content data represented by the information indicating the result is received, third generating unit 210 generates the information. The fourth control unit 212 controls the content communication circuit 56 so as to transmit the information generated by the third generation unit 210.

  The partial data control unit 168 includes a fourth generation unit 214 and a fifth control unit 216. When the content communication circuit 56 receives part of the content data, the fourth generation unit 214 generates information in a format that can be used by the mobile terminal 32, including part of the content data. The “content data” is content data specified by information for specifying any of the content data. The fifth control unit 216 controls the Internet communication circuit 50 so as to transmit the information generated by the fourth generation unit 214.

  FIG. 4 is a hardware configuration diagram of the image storage device 29 which is a hard disk recorder. Referring to FIG. 4, image storage device 29 includes HD (Hard Disk) device 70, tuner 72, decoding unit 76, I / O (Input / Output) 78, control unit 80, memory 82, and so on. And an operation unit 84.

  The HD device 70 is a device that records user-desired image data as a signal on a hard disk and reads the recorded signal. Here, examples of the signal recorded on the hard disk include a video file conforming to the MPEG2 standard and an audio file conforming to the MP3 (MPEG-1 Audio Layer3) standard. The HD device 70 stores an operation program for the control unit 80.

  The HD device 70 includes a read head and a recording head. The read head is a device that reads either image data or image information recorded on a recording medium (in the present embodiment, a hard disk). The recording head is a device that records a signal and information representing a chapter (boundary of a period during which a broadcast signal is received) on a recording medium.

  The tuner 72 is a device that extracts and outputs a broadcast signal of a channel designated by the control unit 80 when the external terminal 90 connected to the tuner 72 receives the broadcast signal. As a result, the tuner 72 selects any of the broadcasts received by the antenna 100. The broadcast signal received by the external terminal 90 is a signal representing image data or image information transmitted from a broadcast station received by the antenna 100.

  When one of the signal read from the hard disk built in HD device 70 and the signal extracted by tuner 72 is given by switching control of control unit 80, decoding unit 76 accepts the given digital signal, It is a device that decodes and outputs. The decoding unit 76 is also a device that compresses the digital signal under the control of the control unit 80 so that the HD device 70 records the broadcast signal received by the external terminal 90 and the signal received by the I / O 78.

  In the memory 82, broadcast channels that can be received by the tuner 72 are acquired and stored in advance by channel scanning (auto scanning). The memory 82 also stores flags and data for information processing to be described later. The memory 82 also stores program data recorded by the HD device 70. The program data is copied from the HD device 70 when the image storage device 29 is activated.

  The I / O 78 is a device that outputs image data and image information read by the reading head from the hard disk and decoded by the decoding unit 76. The I / O 78 is also a device that receives image data and image information transmitted by the server 34 using the IP telephone network 30.

  The operation unit 84 is a device that generates various command signals according to user operations. The operation unit 84 transmits the generated command signal to the control unit 80.

  The control unit 80 is a device that controls devices and circuits constituting the image storage device 29 based on an operation program stored in the memory 82. The control unit 80 is also a device that controls the HD device 70 so that a broadcast signal selected by the tuner 72 and a signal read from a DVD disk by a DVD (Digital Versatile Disc) drive (not shown) are recorded on the hard disk of the HD device 70. .

  FIG. 5 is a diagram showing a hardware configuration of portable terminal 32 according to the present embodiment. Referring to FIG. 5, mobile terminal 32 includes a communication unit 110, a speaker 112, a microphone 114, an operation unit 116, a display unit 118, a control unit 120, and a storage unit 122. The communication unit 110 is a device that communicates with the IP gateway device 20 through the IP telephone network 30. The speaker 112 is a device that converts an audio signal into audio and outputs the converted audio. The microphone 114 is a device that converts voice uttered by the user into a voice signal. The operation unit 116 is a device that generates various command signals in accordance with user operations. The operation unit 116 transmits the generated command signal to the control unit 120. The display unit 118 is a device that displays information. The control unit 120 is a device that controls each unit constituting the mobile terminal 32. The storage unit 122 is a device that stores information necessary for the control unit 120 to control each unit configuring the mobile terminal 32.

  Referring to FIG. 6, the program executed in IP gateway device 20 performs the following control with respect to image data search.

  In step S <b> 150, the Internet communication circuit 50 receives a packet from the mobile terminal 32. When the packet is received, the search program control unit 150 of the CPU 60 analyzes the information represented by the packet. As a result of the analysis, if the information is information requesting transmission of data including a program used for inputting a search condition, the search program control unit 150 transmits data including a program used for inputting the search condition. The memory 52 and the Internet communication circuit 50 are controlled. If the information is not information requesting transmission of data including a program used for inputting a search condition, the search program control unit 150 performs control according to the content of the information. Thereafter, the Internet communication circuit 50 receives the search message by the portable terminal 32. In the present embodiment, the “search message” is information described below. The information is information indicating that the user has requested the image storage device 29 to search for image data and the search condition. The search message format does not matter. Since the format of the information is not limited, the search message is communicated as a packet in some cases and as a code in some cases. The internet communication circuit 50 outputs the received search message to the first generation unit 202 of the CPU 60.

  In step S152, the first generation unit 202 of the CPU 60 analyzes the search message. Thereby, the search condition included in the search message is identified by the first generation unit 202. When the search condition is identified, the first generation unit 202 generates a code representing the search condition. The code is a code in a format that can be used by the image storage device 29 to perform a search.

In step S154, the content communication circuit 56 follows the control of the second control unit 204.
The code generated in step S152 is transmitted as a search message to all the image storage devices 29 under its control. In the present embodiment, “subordinate” means the image storage device 29 directly connected to the IP gateway device 20.

  In step S <b> 156, the content communication circuit 56 of the IP gateway device 20 receives a response message from the image storage device 29. In the present embodiment, “response message” means information that is a response to information when a certain device transmits information to another device. The format of the response message does not matter. Since the format of the information does not matter, the response message is communicated as a packet in some cases and as a code in some cases. In this step, the information corresponding to the response message is information representing the result of searching for image data that satisfies the search condition.

  In step S158, the second generation unit 206 of the CPU 60 determines whether or not response messages have been received from all of the subordinate image storage devices 29. If it is determined that response messages have been received from all image storage devices 29 (YES in step S158), the process proceeds to step S160. If not (NO in step S158), the process proceeds to step S156.

  In step S160, second generation unit 206 of CPU 60 obtains the content of the response message received by content communication circuit 56 in step S156 and information indicating that there is no image data satisfying the search condition stored in memory 52. By comparing, it is determined whether or not image data satisfying the search condition exists in the image data stored by the image storage device 29. If it is determined that there is image data that satisfies the search condition (YES in step S160), the process proceeds to step S162. If not (NO in step S160), the process proceeds to step S166.

  In step S <b> 162, the second generation unit 206 of the CPU 60 stores the information described below in a predetermined area of the memory 52. The first information is information representing the image storage device 29 that stores image data that satisfies the search condition. The second information is image information regarding image data that satisfies the search condition. When these pieces of information are stored, the second generation unit 206 generates data including the program using the data including the program used for specifying the content data and the response message in step S156. This program is a program used for specifying content data. This content data is content data represented by information representing a result.

  In step S164, the Internet communication circuit 50 returns the data generated in step S162 under the control of the third control unit 208 of the CPU 60.

  In step S166, the second generation unit 206 uses the data including the program used for specifying the content data and the response message in step S156 to display that there is no image data that satisfies the search condition. Is generated. When the data is generated, the Internet communication circuit 50 returns the data generated by the second generation unit 206 under the control of the third control unit 208. In the present embodiment, a response message indicating that there is no image data satisfying the search condition is referred to as an “error message”.

  Referring to FIG. 7, the program executed on portable terminal 32 performs the following control with respect to a request for image information.

In step S <b> 170, the user of the portable terminal 32 operates the operation unit 116 to access the IP gateway device 20. The operation unit 116 generates a command signal in accordance with a user operation. The generated command signal is output to the control unit 120. Thereby, the communication unit 110 of the portable terminal 32 transmits a packet including information requesting transmission of data including a program used for inputting the search condition. Thereafter, the communication unit 110 receives data including a program used for inputting search conditions. As described above, in the present embodiment, “data including a program used for inputting search conditions” is data described in HTML including a program used for inputting search conditions. As a result, the control unit 120 of the portable terminal 32 displays an image that prompts the user to input search conditions on the display unit 118 by executing so-called browser software. The operation unit 116 also accepts user input representing search conditions.

  In step S172, control unit 120 creates a search message based on the signal generated by operation unit 116 in step S170. When the search message is created, the communication unit 110 transmits the search message to the IP gateway device 20 under the control of the control unit 120.

  In step S174, communication unit 110 receives a response message. Communication unit 110 outputs information representing the content of the response message to control unit 120. The control unit 120 analyzes the information output from the communication unit 110.

  In step S176, control unit 120 determines whether or not the user has successfully searched for image data that the user wants to view based on whether or not the content of the information analyzed in step S174 is the content of an error message. If it is determined that the search is successful (YES in step S176), the process proceeds to step S178. If not (NO in step S176), the process proceeds to step S180.

  In step S178, the display unit 118 displays information analyzed by the control unit 120 in step S174 under the control of the control unit 120. The control unit 120 controls the display unit 118 by executing the program received as part of the response message in step S174. This program is a program used for specifying content data. This content data is content data represented by information representing a result.

  In step S180, display unit 118 displays information indicating that the image data that the user wants to view was not found under the control of control unit 120.

  Referring to FIG. 8, the program executed by image storage device 29 executes the following control with respect to image data search.

  In step S <b> 190, the I / O 78 receives a search message from the IP gateway device 20. The I / O 78 outputs information representing the content of the search message to the control unit 80.

  In step S192, control unit 80 searches image data recorded by HD device 70 for image data that satisfies the condition indicated by the search message.

  In step S194, control unit 80 determines whether there is image data that satisfies the condition represented by the search message received by I / O 78 in step S190, based on the search result in step S192. If it is determined that there is image data (YES in step S194), the process proceeds to step S196. If not (NO in step S194), the process proceeds to step S198.

  In step S 196, the I / O 78 transmits the following information to the IP gateway device 20 under the control of the control unit 80. The first information is information representing the image storage device 29 including the I / O 78. The second information is image information regarding image data that satisfies the search condition.

  In step S 198, the I / O 78 returns a response message “no image data” to the IP gateway device 20 under the control of the control unit 80.

  Referring to FIG. 9, the program executed in IP gateway device 20 performs the following control regarding the relay of image data.

  In step S <b> 200, the Internet communication circuit 50 receives the call connection message by the mobile terminal 32. Internet communication circuit 50 outputs information representing the content of the call connection message to CPU 60.

  In step S202, the third generation unit 210 of the CPU 60 analyzes the content of the packet representing the call connection message, that is, the image data viewed by the user. As a result, the CPU 60 reads out information specifying the image data that the user wants to view from the image data represented by the information representing the search result from the call connection message.

  In step S204, third generation unit 210 of CPU 60 determines whether or not the image data represented by the call connection message is the image data that it has determined that “exists” in step S160. The third generation unit 210 of the CPU 60 determines that based on the information stored in the memory 52 in step S162. If the image data exists (YES in step S204), the process proceeds to step S206. If not (NO in step S204), the process proceeds to step S216.

  In step S206, third generation unit 210 generates a code representing the image data specified by the call connection message. When the code is generated, the fourth control unit 212 controls the content communication circuit 56 so that the information generated by the third generation unit 210 is transmitted. The transmission destination is the image storage device 29 that stores the image data represented by the call connection message.

  In step S208, the content communication circuit 56 receives part of the image data as a response message from the image storage device 29. The fourth generation unit 214 generates a packet including a part of the image data.

  In step S210, Internet communication circuit 50 transmits a response message indicating that transmission of image data is started under the control of fifth control unit 216 of CPU 60.

  In step S212, the Internet communication circuit 50 transmits the packet generated in step S208 to the mobile terminal 32 under the control of the fifth control unit 216 of the CPU 60. At this time, the fifth control unit 216 controls the Internet communication circuit 50 so as to transmit the information generated by the fourth generation unit 214 according to a protocol capable of communicating voice data in packets. In the case of the present embodiment, the protocol is a protocol capable of streaming, that is, TCP / IP (Transmission Control Protocol / Internet Protocol).

In step S <b> 214, the fifth control unit 216 determines whether the Internet communication circuit 50 has received a disconnect message from the mobile terminal 32. In the present embodiment, the “disconnect message” is a packet representing interruption of image data communication. If it is determined that a disconnect message has been received (YES in step S214), the process proceeds to step S2.
Moved to 00. If not (NO in step S214), the process proceeds to step S218.

  In step S218, the fifth control unit 216 determines whether or not the processing for transmitting the image data has been completed. If it is determined that the process has been completed (YES in step S218), the process proceeds to step S220. If not (NO in step S218), the process proceeds to step S212.

  In step S216, the Internet communication circuit 50 returns a packet indicating that the image storage device 29 in which the image data requested to be transmitted is not stored is controlled by the control of the third generation unit 210 of the CPU 60. .

  In step S <b> 220, Internet communication circuit 50 transmits a packet indicating termination of communication addressed to portable terminal 32 under the control of fifth control unit 216.

  Referring to FIG. 10, the program executed on portable terminal 32 performs the following control regarding the reproduction of the content represented by the image data.

  In step S230, the user operates the operation unit 116 to input information about image data that the user wants to view. The operation unit 116 generates a command signal corresponding to a user operation. The generated command signal is output to the control unit 120.

  In step S232, control unit 120 generates a call connection message based on the signal output from operation unit 116 in step S230. This call connection message includes information for specifying image data that the user wants to view. The communication unit 110 transmits the call connection message to the IP gateway device 20 under the control of the control unit 120.

  In step S234, communication unit 110 receives a response message. Information represented by the response message is output to control unit 120.

  In step S236, control unit 120 determines whether or not image data that the user wants to view can be received based on the information output from communication unit 110 in step S234. If it is determined that image data can be received (YES in step S236), the process proceeds to step S238. If not (NO in step S236), the process proceeds to step S248.

  In step S238, communication unit 110 receives a packet including a part of image data. The communication unit 110 outputs a part of the received image data to the storage unit 122 in accordance with the control of the control unit 120. The storage unit 122 stores a part of the image data.

  In step S240, control unit 120 reads a part of the image data stored in storage unit 122. When a part of the image data is read, control unit 120 outputs a part of the read image data to display unit 118. When a part of the image data represents sound, control unit 120 outputs the part to speaker 112. Display unit 118 displays an image representing a part output by control unit 120. The speaker 112 outputs sound representing the portion output from the display unit 120. Thereby, a part of the content represented by the image data is reproduced.

In step S242, control unit 120 determines whether or not to continue content reproduction, that is, output of image data, based on the command signal output from operation unit 116. If it is determined that the reproduction is continued (YES in step S242), the process proceeds to step S238. If not (NO in step S242), the process proceeds to step S244.

  In step S244, control unit 120 determines whether or not the packet received by communication unit 110 indicates that transmission of image data is interrupted. If it is determined that it represents an interruption (YES in step S244), the process ends. If not (NO in step S244), the process proceeds to step S246.

  In step S246, communication unit 110 transmits a packet indicating termination of communication under the control of control unit 120.

  In step S248, display unit 118 outputs a message indicating that image data cannot be received under the control of control unit 120.

  Referring to FIG. 11, the program executed by image storage device 29 executes the following control with respect to transmission of image data.

  In step S 260, I / O 78 receives a message indicating that image data is requested from IP gateway device 20.

  In step S262, HD device 70 reads the image data represented by the message received by I / O 78 in step S260 under the control of control unit 80. When the image data is read, HD device 70 outputs the data to decoding unit 76. The decoding unit 76 decodes the data. The decoding unit 76 outputs a part of the decoded image data to the I / O 78. The I / O 78 transmits a packet including a part of the image data to the IP gateway device 20.

  In step S264, control unit 80 determines whether or not to end the transmission of the image data based on the data read by HD device 70. If it is determined that transmission of image data is to be terminated (YES in step S264), the process proceeds to step S260. If not (NO in step S264), the process proceeds to step S262.

  The operation of the content viewing system based on the above structure and flowchart will be described.

  FIG. 12 is a diagram showing a flow of information between devices constituting the content viewing system in the present embodiment. The operation of the content viewing system according to the present embodiment will be described with reference to FIG.

  The user of the portable terminal 32 inputs conditions for image data that the user desires to view (step S170). When the condition is input, the communication unit 110 transmits a search message to the IP gateway device 20 (step S172). In FIG. 12, an arrow from the portable terminal 32 to which the comment “image information request” is attached to the IP gateway device 20 represents this transmission process.

The IP gateway device 20 receives the search message from the mobile terminal 32 (step S150). When the search message is received, the CPU 60 of the IP gateway device 20 analyzes the search message (step S152). When the search message is analyzed, the content communication circuit 56 transmits the search message to all the image storage devices 29 under the control of the CPU 60 (step S154). In FIG. 12, an arrow with a comment “image information request” addressed to “first image storage device” and “second image storage device” from the IP gateway device 20 represents this transmission processing.

  The I / O 78 of the image storage device 29 receives the search message from the IP gateway device 20 (step S190). When the search message is received, the control unit 80 searches the image data recorded in the HD device 70 (step S192). When the image data is searched, the control unit 80 determines whether there is image data that satisfies the condition represented by the search message (step S194). In this case, if there is raw image data (YES in step S194), the I / O 78 transmits image information on image data that satisfies the search condition to the IP gateway device 20 (step S196). . In FIG. 12, arrows from “first image storage device” and “second image storage device” to “IP gateway device” with a comment “reply image information” represent this reply processing.

  The content communication circuit 56 of the IP gateway device 20 receives the response message from the image storage device 29 (step S156). When the response message is received, the CPU 60 determines whether or not response messages have been received from all the image storage devices 29 (step S158). In this case, assuming that response messages have been received from all image storage devices 29 (YES in step S158), CPU 60 determines whether there is image data that satisfies the search condition (step S160). In this case, if such image data exists (YES in step S160), second generation unit 206 stores information described below in a predetermined area of memory 52. The first information is information representing the image storage device 29 that stores image data that satisfies the search condition. The second information is image information regarding image data that satisfies the search condition. When these pieces of information are stored, the second generation unit 206 uses the data including the program used for specifying the content data and the response message in step S156 to use the program used for specifying the content data represented by the information indicating the result. Is generated (step S162). When the data is generated, the Internet communication circuit 50 returns the data generated in step S162 under the control of the third control unit 208 of the CPU 60 (step S164). In FIG. 12, an arrow from “IP gateway device” to “portable terminal” with a comment “image information reply” represents this reply processing.

  The communication unit 110 of the mobile terminal analyzes the response message transmitted by the IP gateway device 20 (step S174). When the response message is analyzed, the control unit 120 determines whether the search is successful (step S176). In this case, since the search is successful (YES in step S176), display unit 118 displays information representing the result of the search (step S178).

  Thereafter, the user of the mobile terminal 32 operates the operation unit 116 to input information of image data that the user desires to view (step S230). When the information is input, the control unit 120 causes the communication unit 110 to transmit a call connection message to which image data information is added (step S232). In FIG. 12, an arrow from “portable terminal” to “IP gateway device” with a comment “transmit a signal representing the influence of connection” represents this transmission process.

The IP gateway device 20 receives the call connection message from the mobile terminal 32 (step S200). When the call connection message is received, the CPU 60 analyzes the information included in the call connection message (step S202). When the information is analyzed, CPU 60 determines whether or not the image data represented by the call connection message is the image data that it has determined that “exists” in step S160 (step S204). In this case, if it is such image data (YES in step S204), content communication circuit 56 transmits a message indicating that image data is requested to image storage device 29 under the control of CPU 60 (step S206). ). In FIG. 12, an arrow from “IP gateway device” to “first image storage device” with a comment “request image data” represents this transmission processing. The image storage device 29 receives a message requesting image data from the IP gateway device 20 (step S260). When the message is received, the I / O 78 transmits the image data to the IP gateway device 20 (step S262). In FIG. 12, an arrow from “first image storage device” to “IP gateway device” with a comment of “reply image data” represents this transmission processing.

  When a part of the image data is transmitted, the control unit 80 determines whether or not to end the transmission of the image data (step S264). Since transmission is not completed for the time being (NO in step S264), the processes in steps S262 and S264 are repeated.

  Meanwhile, the content communication circuit 56 of the IP gateway device receives a part of the image data from the image storage device 29 (step S208). When a part of the image data is received, the Internet communication circuit 50 returns a response message to the portable terminal 32 (step S210), and then transmits a part of the image data (S212). In FIG. 12, an arrow from “IP gateway device” to “portable terminal” with a comment “Reply image data” represents this transmission processing.

  When a part of the image data is transmitted, the CPU 60 determines whether or not a disconnect message is received from the portable terminal 32 (step S214). In this case, if such a message has not been received (NO in step S214), CPU 60 determines whether or not the transmission of the image data has ended (step S218). Since transmission is not completed for the time being (NO in step S218), the processing from step S212 to step S218 is repeated.

  Meanwhile, after the communication unit 110 of the mobile terminal 32 receives the response message (step S234), the control unit 120 determines whether the image data can be received (step S236). In this case, since image data can be received (YES in step S236), communication unit 110 receives part of the image data (step S238). When a part of the image data is received, display unit 118 and speaker 112 reproduce the content represented by the image data (step S240). When the content is reproduced, the control unit 120 determines whether or not to continue the reproduction (step S242). Since reproduction is continued for the time being (YES in step S242), the processing from step S238 to step S242 is repeated.

  Thereafter, when the image storage device finishes transmitting the image data (YES in step S264), I / O 78 waits for reception of a message requesting the image data (step S260). CPU 60 of IP gateway device 20 determines that the transmission of the image data has been completed (YES in step S218), and therefore transmits a disconnect message to portable terminal 32 (step S220). Since control unit 120 of portable terminal 32 determines that the reproduction is not continued (NO in step S242), it determines whether a disconnect message is received from IP gateway device 20 (step S244). In this case, since the disconnect message has been received (NO in step S244), the process ends.

  As described above, the content viewing system in the present embodiment can receive the image data stored in the image storage device with the mobile terminal and allow the user to view the content represented by the image data. Thus, as long as the user can communicate with the IP gateway device through the IP telephone network, the user can efficiently view the desired content. As a result, it is possible to provide a content viewing system that can efficiently view content desired by the user.

  Moreover, the gateway apparatus in this Embodiment transmits the data containing a program with respect to a portable terminal. Thereby, even if special software is not mounted, the portable terminal can search image data and view image data that matches the search condition.

  In addition, the gateway device in the present embodiment communicates information according to a protocol capable of communicating voice data in packets. Such a protocol has many countermeasures in case information cannot be communicated well. This increases the possibility that data can be transmitted accurately. In addition, it is easy to use a general mobile phone as the mobile terminal described above.

  In addition, the gateway device in the present embodiment communicates information according to a protocol that allows streaming. This makes it possible to reproduce content even with a general mobile phone in which it is difficult to reproduce the content based on the image data once the entire image data is downloaded.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

It is a figure showing the structure of the content viewing-and-listening system which concerns on embodiment of this invention. It is a hardware block diagram of the IP gateway apparatus which concerns on embodiment of this invention. It is a functional block diagram of CPU of the IP gateway apparatus which concerns on embodiment of this invention. It is a hardware block diagram of the image storage device concerning an embodiment of the invention. It is a hardware block diagram of the portable terminal which concerns on embodiment of this invention. It is a flowchart which shows the procedure of control of the search process of the IP gateway apparatus which concerns on embodiment of this invention. It is a flowchart which shows the procedure of control of the search process of the portable terminal which concerns on embodiment of this invention. It is a flowchart which shows the procedure of control of the search process of the image storage apparatus which concerns on embodiment of this invention. It is a flowchart which shows the procedure of control of the relay process of the image data of the IP gateway apparatus of this invention. It is a flowchart which shows the procedure of control of the reproduction | regeneration processing of the content of the form terminal which concerns on embodiment of this invention. It is a flowchart which shows the procedure of control of the transmission process of the image storage device which concerns on embodiment of this invention. It is a figure showing operation | movement of the content viewing-and-listening system which concerns on embodiment of this invention.

Explanation of symbols

20 IP gateway device, 29 Image storage device, 30 IP telephone network, 32 Mobile terminal, 34 Server, 50 Internet communication circuit, 52 Memory, 54 Wireless communication circuit, 56 Content communication circuit, 58 SLIC, 60 CPU, 62 Power supply, 70 HD device, 72 tuner, 76 decoding unit, 78 I / O, 80, 120 control unit, 82
Memory, 84, 116 Operation unit, 90 External terminal, 100 Antenna, 110 Communication unit, 112 Speaker, 114 Microphone, 118 Display unit, 122 Storage unit, 150 Search program control unit, 152 Relay unit, 162 Condition information control unit, 164 Content information control unit, 166 selection information control unit, 168 partial data control unit, 202 first generation unit, 204 second control unit, 206 second generation unit, 208 third control unit, 210 third generation unit, 212 first 4 control part, 214 4th production | generation part, 216 5th control part.

Claims (4)

Internet communication means for communicating information and data with a communication device over the Internet;
Content communication means for communicating information and data with a storage device that stores content data that is data representing content by at least one of video and audio;
Processing means for processing information and data communicated by the Internet communication means and information and data communicated by the content communication means;
Storage means for storing data including a search program that is a program used for inputting search conditions,
The processing means includes
When the Internet communication unit receives information representing a request for data including the search program from the communication device, the Internet communication unit controls the storage unit and the Internet communication unit to transmit the data including the search program. Search program control means;
Information representing search conditions generated by execution of the search program, information representing content data satisfying the search information, information representing selected content data that is content data satisfying the search information, and the selected content data Including a relay means for relaying between the communication device and the storage device. The relay means is
Condition information control means for controlling the content communication means to transmit information representing the search condition when the Internet communication means receives the information representing the search condition;
Content information control for controlling the Internet communication means to transmit information representing content data satisfying the search information when the content communication means receives information representing content data satisfying the search information from the storage device Means,
Selection information control means for controlling the content communication means to transmit information representing the selected content data when the internet communication means receives the information representing the selected content data;
And a partial data control unit for controlling the Internet communication unit to transmit the selected content data part by part when the content communication unit receives the part selection data from the storage device part by part. Item 4. The gateway device according to Item 1.   The gateway device according to claim 2, wherein the partial data control means includes means for controlling the Internet communication means to transmit a part of the selected content data as a packet. When Internet communication means for communicating information and data with a communication device via the Internet receives information representing a data request including a search program, which is a program used for inputting search conditions, from the communication device, the search program includes the search program. A search program sending step for sending data;
Content communication means for communicating information and data with a storage device for storing content data, which is data representing content by at least one of video and audio, when the Internet communication means receives information representing the search condition Transmitting a condition information transmitting step for transmitting information representing the search condition;
A content information transmitting step in which when the content communication means receives information representing content data satisfying the search information from the storage device, the Internet communication means transmits information representing content data satisfying the search information;
A selection information transmitting step in which when the Internet communication means receives the information representing the selected content data, the content communication means transmits the information representing the selected content data;
An information relay method comprising: a partial data transmission step in which the Internet communication means transmits the selected content data part by part when the content communication part receives the selected content data part by part from the storage device.

Images