JP5227279B2 - System and method for generating summary content according to activation state of remote control device - Google Patents

Description

  The present invention relates to a technique for displaying digital broadcast content on an operation target device and operating the operation target device from a remote operation device such as a remote controller device.

  According to the terrestrial digital broadcast service, an operation target device such as a television device receives digital broadcast content and displays video data of the received broadcast content on a display. The received broadcast content may be stored in a television device or a recorder device equipped with a storage device such as a hard disk device. By increasing the capacity of the storage device, the viewer can record the broadcast content for a long time and reproduce the broadcast content at any time. The operation target device is not limited to the television device, and may be a personal computer, for example.

  The digital broadcast content includes caption information (closed caption) in addition to video data and audio data. The caption information is a character string such as a conversation or a dialogue about the video. For example, the television apparatus reproduces the video data and audio data in the received broadcast data, and also displays the caption information data in the broadcast data in parallel with the video data being reproduced and displayed.

  A television device as an operation target device is operated from a remote position by a remote control device. The remote control device is generally a wireless type, and in particular, an infrared method or a radio wave method is used (in addition, there are an ultrasonic method and a visible light method). For example, an infrared system is generally used for a remote control device for operating a television device. The remote control device has an infrared light emitting unit, and the television device has an infrared light receiving unit.

  Infrared radiation has a wavelength between about 750 and 1,000 nm. In order to distinguish between infrared rays emitted from nature and infrared rays emitted from the remote control device, the remote control device transmits infrared rays modulated by the carrier frequency. The carrier frequency is generally about 38 to 40 kHz.

  FIG. 1 is a system configuration diagram in the prior art.

  According to FIG. 1, the remote control device 5 transmits an infrared operation signal and operates the operation target device 4. A television device is represented as the operation target device. The remote control device A and the remote control device B are within the operable range of the television device 4. This means that the user who owns the remote control device A and the user who owns the remote control device B are in the viewable range of the television device 4.

  Here, it is assumed that the user B who owns the remote control device B leaves the viewable range of the television device 4 and returns again within the viewable range of the television device 4 after a predetermined time has elapsed. The user B misses the broadcast content of the television device 4 during the absence time, and views the television device 4 again without knowing the broadcast content.

  In such a case, the user B can understand the broadcast content by reproducing the broadcast content of the absent time portion. When playing back the recorded broadcast content, the viewer may play from the beginning to the end of the broadcast content, or may play back only a part. In particular, the viewer often desires to view only the outline of the broadcast content in a short time due to time constraints. In this case, the viewer views only the portion of the scene he / she wants to see by normal playback while playing back in fast-forward.

  There is a technique for generating summary content in order for the viewer to understand the outline of the broadcast content in a short time. The summary content includes, for example, one obtained by concatenating partially extracted video data from the original content, and one obtained by generating an animation from a partially extracted still image.

  In addition, for example, there is a technique of switching and displaying a still image cut out from video data together with the display of a subtitle character string included in digital broadcast content (see, for example, Patent Document 1). According to this technology, the viewer can view the entire broadcast content in a short time.

  There is also a technique for generating a summary sentence from a narration or a telop for a missed portion of broadcast content (see, for example, Patent Document 2). According to this technology, by displaying this summary sentence while viewing broadcast content, the viewer can understand the content of the broadcast that was missed.

JP 2009-076970 A JP 2008-252322 A

  However, when a plurality of viewers are viewing one broadcast content, the viewer who has been absent cannot immediately know the broadcast content during the absence time when the viewer returns.

  According to the technique described in Patent Document 1, the summary content is generated for the entire broadcast content. Therefore, the viewer must search only the missed portion from the summary content. Also, the viewer needs only the summary content of the missed portion.

  Further, according to the technique described in Patent Document 2, the viewer can browse only a summary sentence in a missed portion of the broadcast content. In many cases, viewers cannot fully understand the content of the broadcast by using only a summary sentence that does not include video data.

  Therefore, according to the present invention, when a plurality of viewers exist in the viewable range of the television apparatus, summary content of the absence time is automatically generated for each viewer, and the summary content is viewed. It is an object to provide a system and method that can be viewed only by a person.

According to the present invention, a remote operation device that transmits an operation signal via a first wireless link, and an operation target device that receives the operation signal via the first wireless link and operates according to the contents thereof. A system for generating summary content in content reproduced by an operation target device,
The remote control device has a second wireless communication means for establishing a second wireless link,
The system further includes an activation state detection device and a summary content generation device,
The startup state detection device
An activation state detecting means for detecting one or more remote operation devices existing in a viewable range of the operation target device according to an established state of the second wireless link in the remote operation device;
Each remote operation device has activation state transmission means for transmitting activation state information indicating “presence” / “absence” in the viewable range of the operation target device to the summary content generation device,
The summary content generation device
Summary content generation means for generating summary content of the content being played back by the operation target device;
When starting status information “absent” is received with respect to the remote control device, the summary content generating unit is instructed to start generating summary content. Generation control means for instructing the content generation means to end generation of summary content;
Summary content transmission means for transmitting the summary content generated by the summary content generation means to the remote control device.

According to another embodiment of the system of the present invention,
The digital broadcast content reproduced by the operation target device includes a video and a subtitle character string,
The summary content generation means of the summary content generation device includes:
Subtitle character string extraction means for extracting a subtitle character string unit from digital broadcast content;
Video extraction means for extracting video from digital broadcast content in units of subtitle character strings;
Image extracting means for extracting one still image from video based on a unit of subtitle character string;
It is also preferable to have content linking means for generating summary content linking still images and subtitle character strings.

  According to another embodiment of the system of the present invention, the first wireless link is preferably a directional infrared communication link, and the second wireless link is preferably a non-directional short-range wireless link. .

  According to another embodiment of the system of the present invention, it is also preferable that the short-range wireless link is Bluetooth, and the remote control device transmits the identifier by periodically executing a page (Page) sequence. .

  According to another embodiment of the system of the present invention, it is also preferable that the short-range wireless link is a wireless local area network (LAN), and the remote control device periodically transmits a data packet including the identifier.

  According to another embodiment of the system of the present invention, the operation target device is a television device, the remote operation device is a mobile phone, and an infrared light emitting unit and a short-range wireless communication unit mounted on the mobile phone are provided. It is also preferable to use it.

  According to another embodiment of the system of the present invention, it is also preferable that the operation target device integrally includes an activation state detection device and / or a summary content generation device.

According to the present invention, a remote operation device that transmits an operation signal via a first wireless link, and an operation target device that receives the operation signal via the first wireless link and operates according to the contents thereof. A method for generating summary content in content reproduced by an operation target device for a system having:
The remote control device has a second wireless link communication function,
The system further includes an activation state detection device and a summary content generation device,
A first step in which the activation state detection device detects one or more remote operation devices existing in the viewable range of the operation target device according to an established state of the second wireless link in the remote operation device;
A second step of transmitting activation state information indicating “existence” / “absence” in the viewable range of the operation target device for each remote operation device to the summary content generation device;
A third step of starting the generation of the summary content of the content being played back by the operation target device when the summary content generation device receives the activation state information “absent” from the remote operation device;
A fourth step of terminating the generation of the summary content when the summary content generation device receives the activation state information “existence” from the remote control device;
The summary content generation device includes a fifth step of transmitting the generated summary content to the remote control device.

  According to the system and method of the present invention, when a plurality of viewers exist in the viewable range of the television apparatus, the summary content of the absence time is automatically generated for each viewer, and the summary content is generated. It can be browsed only by the viewer.

It is a system block diagram in a prior art. It is a display image in the present invention. 1 is a first system configuration diagram in the present invention. FIG. It is a functional block diagram of the starting state detection apparatus and summary content generation apparatus in this invention. It is explanatory drawing showing the correspondence of a still image and a caption character string. It is a functional block diagram of the mobile telephone in this invention. It is a 2nd system block diagram in this invention. FIG. 10 is a sequence diagram for notifying activation state detection of the presence of the remote control device itself.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 2 is a display image in the present invention.

  According to FIG. 2, a mobile phone is represented as the remote control device 3. The mobile phone includes a display for viewers. In the following description, the remote operation device will be described as a typical mobile phone, but may of course be a PDA (Personal Digital Assistant) or a mobile terminal.

  According to FIG. 2, the mobile phone A and the mobile phone B are in the viewable range of the television device 4. Here, it is assumed that only the mobile phone B leaves the operable range of the television device 4 and returns to the operable range of the television device 4 after a certain period of time has elapsed.

  The mobile phone B receives the summary content of the broadcast content while away from the television apparatus 4 via the Internet. The mobile phone B displays the summary content on the display for the viewer.

  Thereby, the viewer who operates the mobile phone B can understand the broadcast content while away from the television apparatus 4 and can view the broadcast content again. Also, the viewer who operates the mobile phone A can view the broadcast contents without being interrupted by the viewer who operates the mobile phone B.

  The summary content in the present invention is content obtained by extracting one still image for each unit of subtitle character string from the original broadcast content. According to the present invention, when a still image is displayed on a display, a subtitle character string corresponding to that portion is also displayed simultaneously.

  A browser screen is displayed on the display of the mobile phone 3. In the browser screen, still images and subtitle character strings are arranged vertically. Still images and subtitle character strings may be switched and displayed at regular intervals. Still images and subtitle character strings may be arranged in the left-right direction in the browser screen.

  FIG. 3 is a first system configuration diagram according to the present invention.

  The system of FIG. 3 includes an activation state detection device 1 (set top box), a summary content generation device 2, a remote operation device 3, and an operation target device 4. According to FIG. 3, a mobile phone is represented as the remote operation device 3, and a television device is represented as the operation target device 4.

  According to the system of FIG. 3, as in FIG. 1, the mobile phone 3 operates the television device 4 by transmitting an infrared operation signal via an infrared communication link (first wireless link). Since the infrared communication link is directional, an infrared operation signal can be transmitted by directing the infrared light emitting portion of the mobile phone to the television apparatus.

  A mobile phone generally has an infrared light emitting unit conforming to an infrared communication standard IrDA (Infrared Data Association). The IrDA specification is different from the infrared communication specification used in general remote control devices. The mobile phone functions as a remote control device by emulating a remote control operation signal for an IrDA-compliant infrared light emitting unit by activating a remote control application.

  The mobile phone A and the mobile phone B exist within the operable range of the television apparatus 4 and transmit, for example, an infrared operation signal for channel switching (or power on / off) to the television apparatus 4. At this time, when viewed from the television apparatus 4, the mobile phone A and the mobile phone B are in the viewable range. Further, when viewed from the activation state detection device 1 arranged near the television device 4, the mobile phone A and the mobile phone B are present in the vicinity thereof.

  Each mobile phone has a device identifier and / or a user identifier (hereinafter referred to as “identifier”). The device identifier is a device identifier unique to the mobile phone, and the user identifier is an identifier specific to the user who operates the mobile phone.

  The activation state detection device 1 and the mobile phone 3 are equipped with a short-range wireless communication unit. The short-range wireless link may be Bluetooth or a wireless LAN such as Wi-Fi (Wireless Fidelity). By using a short-distance wireless link having no directivity, communication with the activation state detection apparatus 1 can be performed without being affected by the orientation of the mobile phone.

  The cellular phone A and the cellular phone B transmit the identifier to the activation state detection device 1 via the short-range wireless link (second wireless link). As a result, the activation state detection device 1 recognizes that the mobile phone A and the cellular phone B exist around the activation state detection device 1. Further, since the activation state detection device 1 is arranged near the television device 4, it is recognized that the mobile phone A and the mobile phone B exist within the viewable range of the television device 4.

  The identifier is periodically transmitted from each mobile phone 3 to the activation state detection device 1 via the short-range wireless link. The periodic transmission of the identifier serves as an active signal (or an alive signal) that means that the mobile phone 3 exists in the peripheral area of the operation activation state detection device 1. Thereby, the starting state detection apparatus 1 can recognize the mobile phone 3 which exists in its periphery at each time. On the other hand, when the activation state detection device 1 does not receive the identifier that has been received regularly, the activation state detection device 1 recognizes that the mobile phone 3 corresponding to the identifier no longer exists in the vicinity thereof.

  The activation state detection device 1 transmits activation state information indicating “presence” / “absence” in the viewable range to the summary content generation device 2 for each mobile phone.

  The summary content generation device 2 receives the activation state information. The summary content generation device 2 knows the absence time in the viewable range of the television device 4 from the activation state information. The summary content generation device 2 generates summary content of the absence time in the viewable range of the television device 4 from the digital broadcast content.

  The summary content generation device 2 transmits the summary content to the mobile phone B. Here, the summary content may be transmitted to the mobile phone B via the short-range wireless link via the activation state detection device 1. In addition, when the activation state detection device 1 has the function of a femtocell access point, the summary content may be transmitted to the mobile phone B via the femtocell radio wave. Furthermore, the summary content may be transmitted from the mobile phone network via the access state and the Internet via the activation state detection device 1.

  It is preferable that the activation state detection device 1 is connected to the television device and is disposed near the television device. It can be recognized that the mobile phone detected by the activation state detection device 1 via the short-range wireless link exists in the viewable range of the television device. Further, the function of the activation state detection device 1 may be incorporated in the operation target device (the television device itself) 4. Further, the function of the summary content generation device 2 may be built in the operation target device 4.

  FIG. 4 is a functional configuration diagram of the activation state detection device and the summary content generation device according to the present invention.

  The activation state detection device 1 in FIG. 4 includes a short-range wireless communication unit 10, an identifier reception unit 11, an activation state detection unit 12, an activation state transmission unit 13, and a communication interface unit 14.

  The short-range wireless communication unit 10 receives the identifier of the remote control device 3 via the short-range wireless link. The short-range wireless communication unit 10 outputs the received identifier to the identifier receiving unit 11.

  The identifier receiving unit 11 outputs the identifier to the activation state detecting unit 12. The identifier receiving unit 11 may receive the identifier by a call (Page) sequence issued from the remote operation device 3. Moreover, after establishing a radio link by a calling sequence, a data packet including an identifier may be received.

  The activation state detection unit 12 recognizes that a mobile phone corresponding to the received identifier exists in its peripheral range according to the establishment state of the Bluetooth wireless link. Here, the activation state detection unit 12 periodically receives the identifier from the mobile phone that exists in its peripheral range. On the other hand, the activation state detection unit 12 recognizes that the mobile phone corresponding to the identifier no longer exists in its own peripheral area when the identifier has not been received for a certain period of time. The activation state detection unit 12 outputs the identifier of the mobile phone existing in its peripheral range to the activation state transmission unit 13.

  The activation state transmission unit 13 generates activation state information indicating “presence” / “absence” of the remote operation device 3 in the viewable range of the operation target device 4 based on the received identifier. The activation state transmission unit 13 transmits activation state information to the summary content generation device 2 via the communication interface unit 14.

  Also, according to FIG. 4, the summary content generating apparatus 2 includes a broadcast receiving unit 200, a demodulating unit 201, a video decoding unit 202, a caption information decoding unit 203, an audio decoding unit 204, and a recording management unit 205. A content storage unit 206, a communication interface unit 207, a generation control unit 208, a summary content generation unit 209, and a summary content transmission unit 210.

  The broadcast receiving unit 200 receives a digital broadcast signal from the television apparatus being reproduced and displayed, and outputs the broadcast signal to the demodulation unit 201. The demodulator 201 demodulates the broadcast signal. Then, the video data is output to the video decoding unit 202, the subtitle information data is output to the subtitle information decoding unit 203, and the audio data is output to the audio decoding unit 204. The video decoding unit 202 decodes video data, the subtitle information decoding unit 203 decodes subtitle information data, and the audio decoding unit 204 decodes audio data. The decoded video data, caption information data, and audio data are output to the recording management unit 205. The recording management unit 205 stores the video data, caption information data, and audio data as one content in the content storage unit 206. The content storage unit 206 is a large-capacity storage device such as a hard disk device.

  Note that the above-described functional components 200 to 205 are not essential components in the present invention. According to the present invention, the content storage unit 206 needs to temporarily store broadcast content including video data and caption information data in order to generate summary content.

  The generation control unit 208 receives the activation state information of the remote operation device 3 from the activation state detection device 1 via the communication interface unit 207. When receiving the activation status information “absent” of the remote control device 3, the generation control unit 208 instructs the content storage unit 206 to start generating summary content. After that, when the activation state information “existence” is received, the generation of the summary content is instructed.

  The content storage unit 206 outputs the broadcast content to the summary content generation unit 209 in response to an instruction from the generation control unit 208.

  The summary content generation unit 209 generates summary content of the content being played back by the operation target device 4. The generated summary content is output to summary content transmission section 210.

  The summary content transmission unit 210 transmits the summary content to the remote control device 3 via the communication interface unit 207.

  According to FIG. 4, the summary content generation unit 209 includes a caption character string extraction unit 2091, a video extraction unit 2092, an image extraction unit 2093, and a content connection unit 2094.

  FIG. 5 is an explanatory diagram showing the correspondence between still images and subtitle character strings. In the following, FIG. 5 is described in conjunction with FIG.

  The subtitle character string extraction unit 2091 acquires one broadcast content from the content storage unit 206, and extracts a subtitle character string unit. FIG. 5B shows a unit of a caption character string. The subtitle character string may be detected by video data having a short interval of about 2 seconds, or may be detected by video data having a long interval of 10 seconds or more. The caption character string extraction unit 2091 outputs the unit of the caption character string to the video extraction unit 2092 and the content connection unit 2094.

  The video extraction unit 2092 acquires one digital broadcast content from the content storage unit 206 and inputs the detection timing of the subtitle character string from the subtitle character string extraction unit 2091. FIG. 5A shows a frame of video data. The video extraction unit 2092 detects the relationship shown in FIGS. 5 (a) and 5 (b). The video extraction unit 2092 outputs a video based on the subtitle character string unit to the image extraction unit 2093.

According to FIG. 5, the subtitle character string C ₁ is detected when the frame F ₁ is reproduced, and then the subtitle character string C ₂ is detected when the frame F ₇ is reproduced. In this case, a plurality of frames F _{1 to} F ₆ are associated with one caption character string C ₁ . To the viewer, the display, during the playback display of a plurality of frames F ₁ to F _6, and displays the superimposed subtitle string C _1. According to FIG. 5, the next Similarly, display, during the playback display of a plurality of frames F ₇ to F _13, and displays the superimposed subtitle string C _2.

  The image extraction unit 2093 inputs a video based on the unit of the subtitle character string. Then, one image is extracted from the frame of the video data based on the subtitle character string unit. In general, a subtitle character string is displayed at a timing slightly earlier than the progress of a video. However, in live broadcast programs, subtitle character strings may be displayed later than video. For this reason, the progress of the video and the progress of the subtitle character string do not necessarily match. In order to extract a still image as appropriate as possible for the subtitle character string, the middle image is selected according to FIG. 5C. Of course, for example, the first image may be selected or may be selected at random. The image extraction unit 2093 outputs the still image to the content connection unit 2094.

  The content connection unit 2094 inputs a still image and a caption character string. The content connection unit 2094 generates summary content in which still images and subtitle character strings are connected. The generated summary content is output to the summary content transmission unit 210 and transmitted to the mobile phone 4.

  FIG. 6 is a functional configuration diagram of the mobile phone according to the present invention.

  6 includes a user operation unit 30, an infrared light emitting unit 31, an operation signal transmission unit 32, a short-range wireless communication unit 33, an activation state transmission unit 34, an identifier storage unit 35, and a communication interface. A unit 36, a summary content reproduction unit 37, and a display unit 38.

  The user operation unit 30 is a keyboard on which the user should input the operation content for the operation target device 4. The operation content operated by the user is output to the operation signal transmission unit 32.

  The operation signal transmission unit 32 inputs the operation content from the user operation unit 30 and outputs the operation content to the infrared light emitting unit 31 as an operation signal. Specifically, a remote control operation signal is emulated to the IrDA-compliant infrared light emitting unit 31 by starting a remote control application on a mobile phone.

  The infrared light emitting unit 31 transmits the operation signal output from the operation signal transmitting unit 32 to the operation target device 4 using directional infrared rays. The infrared light emitting unit 31 is, for example, IrDA compliant.

  The short-range wireless communication unit 33 communicates with the activation state detection device 1 via the short-range wireless link. The short-range wireless communication unit 33 is preferably compatible with Bluetooth and wireless LAN. Since such a short-range wireless link has no directivity, the identifier can be transmitted to the activation state detection device 1 without being affected by the orientation of the mobile phone.

  The identifier storage unit 35 stores a device identifier and / or a user identifier, and outputs this identifier to the activation state transmission unit 34. The device identifier may be, for example, a device ID of a Bluetooth wireless module or an identification number of a SIM card mounted on a mobile phone. Further, the user identifier may be a telephone number of a mobile phone or an identifier that can be used only within the home network.

  The activation state transmission unit 34 transmits the identifier output from the identifier storage unit 35 to the activation state detection device 1 via the short-range wireless communication unit 33.

  Here, when the short-range wireless communication unit 33 is Bluetooth, the activation state transmission unit 34 may periodically execute a call (Page) sequence. A device ID (device identifier) can be transmitted in the calling sequence. Alternatively, a data packet including an identifier may be transmitted after a wireless link is established by a call (Page) sequence. Furthermore, when the short-range wireless communication unit 33 is a wireless LAN, the activation state transmission unit 34 may periodically transmit a data packet including an identifier.

  Note that the activation state transmission unit 34 operates to retransmit the identifier to the activation state detection apparatus 1 after waiting for a certain period of time when a transmission error occurs due to contention in the short-range wireless link.

  The communication interface unit 36 communicates with a base station of a mobile phone network. Here, the activation state detection apparatus 1 may be an access point for femtocells. In this case, the communication interface unit 36 may be directly connected to the activation state detection device 1 through a wireless link for mobile phones. The communication interface unit 36 receives the summary content and outputs the summary content to the summary content reproduction unit 37.

  The summary content reproduction unit 37 reproduces the summary content on the display unit 38. The summary content looks like a flip book consisting of a still image and a subtitle character string.

  FIG. 7 is a second system configuration diagram according to the present invention.

  For example, first, it is assumed that only the mobile phone A activates the remote control application within the operable range of the television apparatus a. Next, it is assumed that the mobile phone B activates the remote control application at the location within the operable range of the television apparatus a. At this time, the cellular phone B transmits a short-distance wireless link inquiry request to the surrounding area. When the mobile phone A responds to the inquiry request, a short-distance wireless link can be established between the mobile phone A and the mobile phone B. Of course, conversely, the mobile phone A may send an inquiry request, and the mobile phone B may respond to the inquiry request to establish a short-range wireless link. Thereby, the mobile phone A recognizes that the mobile phone B exists in the vicinity thereof.

  It is assumed that the range in which the mobile phone A can operate the television device a matches the range in which the user who owns the mobile phone A can view the television device a. Further, when the mobile phone A and the mobile phone B can communicate via the short-range wireless link, it is assumed that the mobile phone B is also within the operable range of the television apparatus a. That is, it is assumed that the user who has the mobile phone B can also view the television apparatus a.

  Next, the mobile phone A and the mobile phone B exchange identifiers with each other via the short-range wireless link. The mobile phone A that has previously activated the remote control application and is operating the television device a receives the device identifier ID-B from the mobile phone B.

  Then, the mobile phone A associates the device identifier ID-A of the mobile phone A with the device identifier ID-B and transmits the device identifier ID-B to the activation state detection device 1. The activation state detection apparatus 1 can recognize that the mobile phone B exists around the mobile phone A.

  Here, it is preferable that the mobile phone A further associates the device identifier ID-a of the television device (operation target device). As a result, it is recognized that “the mobile phone with the device identifier ID-B exists in the vicinity of the mobile phone (remote control device) with the device identifier ID-A operating the television device with the device identifier ID-a”. Is done.

  FIG. 8 is a sequence diagram for notifying the activation state detection device of the presence of the remote control device itself.

  According to FIG. 8, the activation state detection device (set top box) 1 and the mobile phone (remote operation device) 3 have a protocol configuration based on Bluetooth. Among them, LMP (Link Management Protocol) realizes connection establishment, connection control and security in a wireless link. In establishing an LMP connection, an inquiry (Inquiry) state and a call (Page) state in Bluetooth are executed.

(S81) When the mobile phone 3 starts the remote control application, it broadcasts an inquiry request (Inquiry) message to the Bluetooth wireless link. The activation state detection apparatus 1 existing in a range where Bluetooth radio waves can be received receives this inquiry request (Inquiry) message. In response to this, the activation state detection apparatus 1 returns an FHS response message. The FHS packet includes information such as Bluetooth class, device ID (identifier), and clock. Thereby, the mobile phone 3 recognizes the presence of the activation state detection device 1.

(S82) Thereafter, the mobile phone 3 periodically executes an identifier notification sequence. The identifier notification sequence can be executed, for example, as a page (Page) state sequence, whereby the identifier (for example, device ID) of the mobile phone 3 can be transmitted to the activation state detecting device 1.

(S821) The mobile phone 3 transmits a page (Page) request message to the activation state detection apparatus 1. On the other hand, the activation state detection apparatus 1 returns a reception response message to the mobile phone 3.
(S822) Next, the mobile phone 3 transmits an FHS request message to the activation state detection apparatus 1. The FHS packet includes information such as Bluetooth class, device ID (identifier), and clock. Thereby, the activation state detection device 1 can recognize the presence of the mobile phone 3. Then, the activation state detection device 1 returns a reception response message to the mobile phone 3.
(S823) Immediately, the cellular phone 3 transmits a connection release request to the activation state detection device 1. The mobile phone 3 only needs to be able to notify the activation state detection device 1 of the identifier of the mobile phone 3 using a Bluetooth wireless link. That is, it is not necessary to maintain a Bluetooth wireless link. The activation state detection apparatus 1 that has received the connection release request returns a reception response message to the mobile phone 3.

  In addition, after establishing a wireless link by S821 and S822, a data packet including an identifier may be transmitted. After transmitting the data packet to the activation state detection apparatus 1, the cellular phone 3 releases the connection in S823.

  Here, according to the present invention, the mobile phone 3 immediately transmits a connection release request to the activation state detection device 1 in S823. The reason for this is that Bluetooth is usually based on one-to-one communication and tends to be unstable in the case of one-to-many communication where the processing load increases. Therefore, according to the present invention, by repeating connection / release for a Bluetooth wireless link, short-range wireless communication between a short-range wireless communication unit of one activation state detection device and a plurality of mobile phones located in the vicinity thereof It can be connected to the part.

(S83) The identifier notification sequence executed in S82 is periodically executed. Each time the identifier notification sequence is executed, the activation state detection apparatus 1 recognizes the presence of the mobile phone 3. Here, when the mobile phone 3 moves away from the vicinity of the activation state detection device 1, the identifier notification sequence from the mobile phone 3 is not executed. At this time, the activation state detection device 1 recognizes that the mobile phone 3 does not exist around the activation state detection device 1.

  The data structure of the FHS request message transmitted from the mobile phone 3 to the activation state detection device 1 is a general data structure of Bluetooth. The general data structure of Bluetooth consists of an access code part, a header part, and a payload part. The access code part includes a preamble and the like. The header part includes a Bluetooth address, type code (control / voice / data), flow control, ARQN, sequence number, and checksum. Here, the payload portion includes the contents of the FHS. The FHS mainly includes a Bluetooth class, a device identifier (ID), a clock, and the like. With this device identifier, the activation state detection apparatus 1 can recognize the mobile phone 3.

  As described above in detail, according to the system and method of the present invention, when a plurality of viewers exist in the viewable range of the television apparatus, the summary content of the absence time is automatically displayed for each viewer. And the summary content can be viewed only by the viewer. Thus, the viewer can view the summary content of only the part that the broadcast content is overlooked on his / her mobile phone. Accordingly, viewers who have returned without being present or viewers who have joined in the middle can catch up with the current playback display of the broadcast content in a short viewing time. Since the summarized content is generated only for the missed portion, the data size is small compared to the summary content for the entire broadcast content, and is suitable for viewing on a mobile phone.

  Various changes, modifications, and omissions of the above-described various embodiments of the present invention can be easily made by those skilled in the art. The above description is merely an example, and is not intended to be restrictive. The invention is limited only as defined in the following claims and the equivalents thereto.

DESCRIPTION OF SYMBOLS 1 Activation state detection apparatus 10 Near field communication part 11 Identifier reception part 12 Activation state detection part 13 Activation state transmission part 14 Communication interface part 2 Summary content production | generation apparatus 200 Broadcast reception part 201 Demodulation part 202 Video decoding part 203 Subtitle information decoding part 204 audio decoding unit 205 recording management unit 206 content storage unit 207 communication interface unit 208 generation control unit 209 summary content generation unit 2091 subtitle character string extraction unit 2092 video extraction unit 2093 image extraction unit 2094 content connection unit 210 summary content transmission unit 3 remote Operation device, mobile phone 30 User operation unit 31 Infrared light emitting unit 32 Operation signal transmission unit 33 Short-range wireless communication unit 34 Start-up state transmission unit 35 Identifier storage unit 36 Communication interface unit 37 Summary content reproduction unit 8 display unit 4 the operation target apparatus, the television apparatus 5 remote device

Claims (8)

A remote operation device that transmits an operation signal via a first wireless link; and an operation target device that receives the operation signal via the first wireless link and operates according to the contents thereof. A system for generating summary content in content played by a target device,
The remote control device has a second wireless communication means for establishing a second wireless link;
The system further includes an activation state detection device and a summary content generation device,
The activation state detection device includes:
An activation state detecting means for detecting one or more remote control devices existing in a viewable range of the operation target device according to an established state of a second wireless link in the remote control device;
Activation state transmitting means for transmitting activation state information indicating “presence” / “absence” in the viewable range of the operation target device to the summary content generation device for each remote operation device;
The summary content generation device includes:
Summary content generation means for generating summary content of the content being played by the operation target device;
When receiving the activation status information “absent” to the remote control device, it instructs the summary content generation means to start generating the summary content, and then receives the activation status information “existence” A generation control unit for instructing the summary content generation unit to end generation of the summary content;
A summary content transmission unit that transmits the summary content generated by the summary content generation unit to the remote control device. The digital broadcast content reproduced by the operation target device includes a video and a subtitle character string,
The summary content generation means of the summary content generation device comprises:
Subtitle character string extraction means for extracting a unit of the subtitle character string from the digital broadcast content;
Video extraction means for extracting the video for each unit of the subtitle character string from the digital broadcast content;
Image extracting means for extracting one still image from the video based on the unit of the subtitle character string;
The system according to claim 1, further comprising: content linking means for generating the summary content obtained by linking the still image and the subtitle character string. The first wireless link is a directional infrared communication link,
The system according to claim 1 or 2, wherein the second wireless link is a short-distance wireless link having no directivity. The short-range wireless link is Bluetooth;
The system according to claim 3, wherein the remote control device transmits the identifier by periodically executing a page (Page) sequence. The short-range wireless link is a wireless LAN (Local Area Network),
The system according to claim 3, wherein the remote control device periodically transmits a data packet including the identifier. The operation target device is a television device,
The system according to any one of claims 1 to 5, wherein the remote control device is a mobile phone and uses an infrared light emitting unit and a short-range wireless communication unit mounted on the mobile phone.   The system according to any one of claims 1 to 6, wherein the operation target device integrally includes the activation state detection device and / or the summary content generation device. Regarding a system having a remote operation device that transmits an operation signal via a first wireless link, and an operation target device that receives the operation signal via the first wireless link and operates according to the contents thereof, A method for generating summary content in content reproduced by an operation target device,
The remote control device has a communication function of a second wireless link;
The system further includes an activation state detection device and a summary content generation device,
A first step in which the activation state detection device detects one or more remote operation devices existing in a viewable range of the operation target device according to an established state of a second wireless link in the remote operation device;
A second step of transmitting activation state information indicating “existence” / “absence” in the viewable range of the operation target device to the summary content generation device for each remote operation device;
Third step of starting generation of summary content of content being played back by the operation target device when the summary content generation device receives the activation state information “absent” from the remote operation device When,
A fourth step of ending generation of the summary content when the summary content generation device receives the activation state information “existence” from the remote control device;
The summary content generation device includes a fifth step of transmitting the generated summary content to the remote control device.

Images