JP2007189341A - Recording system for object-associated information, recording method of object-associated information, display controller, display control method, recording terminal, information recording method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology whereby a user can easily record information associated with an object on a screen. <P>SOLUTION: A display controller 1 performs the flickering display of a screen 1a of a display means for a period not sensed by humans so as to output associated information of the object on the screen 1a as an optical signal. Then a recording terminal 2 receives the optical signal and demodulates the associated information to record the information. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a system, method, apparatus, and program that can easily record information related to objects on a screen.

  In television broadcasting and the like, there are many cases where application destinations for presents displayed on the screen, recipes for cooking programs, etc. are recorded on a memo paper and used later. In addition, there are many cases where train transfer information and maps displayed by software such as a web browser on the Internet, including a computer display, are recorded on a recording sheet and used later.

  Regarding the recording of information on this screen, it is common to prepare memo paper and copy it, or if there is a function such as a screen memo that temporarily freezes the screen display, temporarily suspend the screen display and write it on the memo paper. . In addition, if there is a recorder, the program may be recorded once, and the recorded video may be played back and then transcribed on a memo paper by being stopped at a required scene. Also, if you have a digital camera (or a mobile phone equipped with that function), you can take a picture of the screen with a digital camera and display the video taken later as a memo. In addition, if the computer is compatible with the connection of a printer or a part of the television, the printer can also perform printing.

  However, regarding the recording of information on the screen, when copying on memo paper, it is necessary to hurry up and prepare memo paper and pencils before the screen changes, and the user only needs to watch the program in a steady state Rather, there is a possibility of failing to record. If there is a screen memo function, the user can prepare memo paper with sufficient margin and transcribe it. However, when there is a large amount of transcribed data, the time and effort to transcribe by hand is large, and there is a possibility of mistakes.

  Also, even when recording once with a recorder and recording the playback video temporarily, it is not only difficult to record the broadcast in preparation for the need for memos. If it is operated for a long time, the life of the recorder will be shortened for a purpose different from the main purpose of time-shifted viewing of the video, that is, for taking notes.

  On the other hand, a digital camera or a mobile phone equipped with this function can be recorded without any hassle and without mistake, but if you turn on the power or call a function when necessary, the shooting function can be used. Because it takes time, the program you want to take note of may change and you may miss recording. Furthermore, as shown in FIG. 1, since the display screen 51 of the digital camera 50 is generally small, even if the screen is photographed, the characters on the screen will be displayed very small when displayed later. It is very difficult to read.

  Further, even when printing with a printer, in order to prevent the same recording failure, it is necessary to always start up ignoring energy saving, which is inefficient. In addition to installing a relatively large device called a printer, printing may not be possible without paying attention to lack of printing paper and ink.

  For this reason, the user has no way to record the necessary information immediately when it is needed for a program, etc., and carry it later, and it cannot be used even if the information is obtained through a corner program etc. Many cases are wasted.

Conventionally, a technology that aims at the convenience of the user in connection with the above-mentioned application, recipe, transfer information, telop such as a map, or an object on the screen such as a specific subject (product, person, etc.) in a video In the literature, there has been a technique that makes it easy to select an object on the screen, such as the following (a) and (b).
(A) A three-dimensional magnetic sensor for measuring the position and orientation of the remote control with respect to the broadcast receiving apparatus is provided, and based on the measurement result, the position indicated by the remote control on the monitor screen of the broadcast receiving apparatus is calculated, and the position is A cursor is displayed (Patent Document 1).

  (B) Infrared light emitting diodes are arranged at the three corners of the screen of the receiver. The remote control device captures the screen of the receiver, detects the coordinates of the three corner positions of the screen on the raster, and transmits the coordinates to the receiver. The receiver compares this coordinate with the coordinates of the three corner positions of the actual screen, and calculates the actual coordinates on the screen of the receiver corresponding to the coordinates of the center point on the raster imaged by the receiver. Then, a cursor is displayed at that position (Patent Document 2).

JP 2003-280794 A (paragraph numbers 0016 to 0031, FIGS. 1 to 3) JP 2003-208260 A (paragraph numbers 0014 to 0026, FIGS. 1 and 2)

  However, there has been no technology that can easily record information related to objects on the screen.

  In view of the above-described points, an object of the present invention is to enable a user to easily record information related to an object on a screen.

  In order to solve the above problems, an object related information recording system according to the present invention includes a display control device including a storage unit, a display driving unit, and a control unit, and a recording terminal device. In the case where the control means acquires the video data and the related information related to the object displayed on the screen by the video data from the outside of the display control device, the related information is stored in the storage means, The video data is supplied to the display driving means, and the display driving means of the display control device displays the video data on the display means, and the screen of the display means is stored in the storage means. The recording terminal device receives the light from the screen of the display means and converts it into an electrical signal. A light receiving means, for the electric signal converted by the light receiving means and demodulating means for demodulating the additional information, comprising the memory means for storing the related information demodulated by the demodulation means.

  This recording system includes a display control device that controls display means and a recording terminal device that is operated by a user.

In the display control apparatus, the following processes (1) to (3) are performed.
(1) The control means acquires the video data and related information related to the object displayed on the screen by the video data from the outside of the display control device.
(1) The control means stores the related information in the storage means and supplies the video data to the display driving means.
(3) The display driving means displays the video data on the display means, and causes the screen of the display means to blink and display at a cycle modulated by the related information stored in the storage means.
In this way, the relevant information of the object displayed on the screen is output as an optical signal from the screen itself of the display means.

When the user directs the light receiving means of the recording terminal device to the screen of the display means in a state where the optical signal is output, the recording terminal device performs the following processes (1) to (3). Is called.
(1) The light receiving means converts this optical signal into an electrical signal.
(2) The demodulating means demodulates the related information from the electrical signal converted by the light receiving means.
(3) The storage means records the demodulated related information.
Thereby, the related information of the object output as an optical signal from the screen of the display means is recorded in the recording terminal device.

  In this manner, the user can accurately record the information related to the object on the screen immediately by selecting a location by simply performing a simple operation of pointing the recording terminal device toward the screen.

  Next, in the object related information recording method according to the present invention, the display control device acquires the video data and the related information related to the object displayed on the screen by the video data from the outside of the display control device. A first step, a second step in which the display control device stores the related information acquired in the first step in a storage means, and a display control device acquired in the first step. A third step of displaying the video data on the display means, and displaying the screen of the display means in a blinking manner with a period modulated according to the related information stored in the second step; and a recording terminal device, A fourth step of receiving light from the screen of the display means and converting it into an electrical signal, and the recording terminal device detects from the electrical signal converted in the fourth step. A fifth step of demodulating the additional information, the recording terminal device, and having a sixth step of storing the related information demodulated by the fifth step in the storage means.

  This recording method corresponds to a series of processing procedures by the recording system according to the present invention described above, and the user simply performs a simple operation of directing the recording terminal device to the screen, without choosing a place. Immediately, information related to objects on the screen can be recorded.

  Next, a display control apparatus according to the present invention includes storage means, display drive means, and control means. The control means includes video data and related information related to an object displayed on the screen by the video data. When supplied from the outside of the display control device, the related information is stored in the storage means and the video data is supplied to the display driving means. The display driving means is supplied from the video receiving means. The video data is displayed on the display means, and the screen of the display means is blinked and displayed with a period modulated by the related information stored in the storage means.

  This display control device is a display control device constituting the recording system according to the present invention described above, and a user operating the recording terminal device simply performs a simple operation of directing the recording terminal device to the screen. , You can immediately record information related to objects on the screen, regardless of location.

  Next, the display control method according to the present invention includes a first step of acquiring video data and related information related to an object displayed on the screen by the video data, and the first step acquired in the first step. The second step of storing the related information in the storage means, and the video data acquired in the first step are displayed on the display means, and the screen of the display means is stored in the second step. And a third step of blinking display with a period modulated according to the information.

  This display control method corresponds to a series of processing procedures by the above-described display control device according to the present invention, and a simple operation in which a user operating the recording terminal device points the recording terminal device to the screen. You can record information related to objects on the screen instantly, regardless of location.

  Next, a program according to the present invention is obtained by a first procedure for obtaining video data and related information related to an object displayed on the screen by the video data, and the first procedure. The second procedure for storing the related information in the storage means, and the video data acquired in the first procedure are displayed on the display means, and the screen of the display means is stored in the second procedure. And a third procedure for performing blinking display with a period modulated according to related information.

 This program corresponds to a program for causing the above-described series of processing procedures of the display control device according to the present invention to be executed under the control of a computer provided in the display control device. A user who operates the apparatus can record information related to the object on the screen immediately without selecting a place by simply performing a simple operation of pointing the recording terminal device to the screen.

  Next, the recording terminal device according to the present invention receives light from the screen of the display means that is blinked and displayed with a period modulated by predetermined information, and a light receiving means for converting the light into an electric signal, A demodulating means for demodulating the predetermined information from the electrical signal converted by the light receiving means and a storage means for recording the information demodulated by the demodulating means are provided.

  This display control device is a recording terminal device that constitutes the recording system according to the present invention described above, and a user simply performs a simple operation of pointing to the screen, and immediately displays the above display without selecting a place. Information related to the object on the screen of the display means controlled by the control device can be recorded.

  Next, the information recording method according to the present invention includes a first step of receiving light from the screen of the display means displayed in a blinking manner with a period modulated by predetermined information, and converting the light into an electrical signal; A second step of demodulating the predetermined information from the electrical signal converted in the first step; and a third step of recording the information demodulated in the second step in a storage means. And

  This information recording method corresponds to the above-described series of processing procedures by the recording terminal device according to the present invention, and the user can change the location only by performing a simple operation of pointing the recording terminal device to the screen. Information relating to the object on the screen of the display means controlled by the display control device can be recorded immediately without selecting.

  Next, a program according to the present invention includes a first procedure for causing a computer to photoelectrically convert light received from a screen of a display unit that is blinked and displayed with a period modulated according to predetermined information. A second procedure for demodulating the predetermined information from the converted signal and a third procedure for recording the information demodulated in the second procedure in the storage means are executed.

 This program corresponds to a program for causing the above-described series of processing procedures of the recording terminal device according to the present invention to be executed under the control of a computer provided in the recording terminal device. By simply performing a simple operation of directing the recording terminal device to the screen, it becomes possible to immediately record information related to the object on the screen of the display means controlled by the display control device, regardless of the location. .

  According to the present invention, it is possible to obtain an effect that a user can immediately record information related to an object on a screen without selecting a place by simply performing a simple operation of directing the recording terminal device to the screen. .

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[Recording method of object related information]
First, a method for recording information related to objects on the screen according to the present invention will be described. As an outline, the display control device causes the screen of the display (display means) to blink and display at a cycle that is not felt by humans, thereby outputting the related information of the object on the screen as an optical signal. Then, the recording terminal device receives the optical signal and demodulates and records the related information.

  For example, as shown in FIG. 2, the range of the blinking display is the entire area 103 of the object 102 (the portion within the bold frame in FIG. 2B) for the object (car) 102 (FIG. 2A) displayed on the screen 101. ), Or in the case of a non-self-luminous display, it may be a light source unit region 104 (a portion within a bold line frame in FIG. 2C) that irradiates the region 103 with light. It may be a region 105 (a portion in a thick line frame in FIG. 2D) of a pixel unit (one or a plurality of pixels) constituting 103.

  Alternatively, when a plurality of objects are displayed on the screen at the same time, a range wider than the area of each object (a range that does not overlap each other) may be blinked in correspondence with the related information of the object. When only one object is displayed on the screen, the entire screen may be blinked.

  Regarding the method of blinking display, when a cold cathode fluorescent tube (CCFL) 111 that is difficult to blink at high speed is used as a light source, such as an LCD (liquid crystal display) 110 shown in FIG. 3A, visible light 113 from the light source is irradiated. Thus, high-speed blinking display is possible by switching between transmission and shielding of the liquid crystal cell in the liquid crystal panel 115 that obtains the image light 114.

  In addition, when an LED (light emitting diode) 117 is used as a light source as in the LCD 116 shown in FIG. 3B, the LED 117 can be blinked at a very high speed. Instead of switching between transmission and shielding of the liquid crystal cell in the liquid crystal panel 120 that obtains the light 119, or together with this switching, the LED 117 can be blinked to enable high-speed blinking display.

  Further, in a display (plasma display, organic EL display, inorganic EL display, etc.) that obtains image light 122 by blinking of the self-light-emitting element 121 as shown in FIG. 3C, the self-light-emitting element 121 can blink at high speed. By blinking the self-luminous element 121, high-speed blinking display is possible. In this way, high-speed blinking display can be performed on various general displays.

  The period of the blinking display is set such that the user does not perceive the blinking by utilizing the human visual characteristic that it is difficult to recognize the rapid blinking as the blinking because the afterimage of the received light remains. Also, using the visual characteristic that the brightness perceived by humans is almost equal to the integrated value of the received light when considered in a short time, the relationship between the brightness of the area to be blinked and the brightness of the area not to be blinked is blinked. An integral value within a certain period of luminance (for example, one frame period) corresponding to a predetermined gradation level in the display area and this certain period of luminance corresponding to this predetermined gradation level in the area where no blinking display is performed. Is set to be substantially equal to the integral value. As a result, for humans, an optical signal can be recognized only as a normal lighting, and viewing is not affected.

  Further, by modulating the blinking cycle according to the object related information, display is performed so that the related information is output as an optical signal. A video source of 60 fps (frames / second) is shown as an example in FIG. 4A, but in order to improve motion blur, a lighting period (Tua to Tda) once in one frame period (1000/60 milliseconds). And an extinguishing period (Tda to Tua ′). In addition, as shown in FIG. 4B, 120 fps display in which one frame period is divided into two frames may be performed. In that case, the lighting period (Tub once) is similarly performed in one frame period. To Tdb and Tuc to Tdc) and a light-off period (Tdb to Tuc and Tdc to Tub ′). As shown in FIGS. 4C to 4F, the same applies to the case where one frame period is divided into three or more frames for display.

  Therefore, as a first modulation method, blinking display is performed with a cycle shorter than the lighting period in the lighting period for improving the motion blur in each frame period, and the period is modulated by the related information of the object ( Called intra-frame modulation). For example, as shown in FIGS. 5A and 5B, in the case of 60 fps display (FIG. 5A), blinking display is performed at 1920 Hz during the lighting period (Tua to Tda) in each frame period (FIG. 5B). As shown in FIGS. 5C and 5D, in the case of 120 fps display (FIG. 5C), blinking display is performed at 1920 Hz during the lighting period (Tub to Tdb or Tuc to Tdc) in each frame period (FIG. 5D). . Furthermore, as shown in FIG. 5E for the case of 120 fps display, the blinking cycle is switched between 1920 Hz and 960 Hz.

  Then, if binary “0” is represented by one blink of 1920 Hz and binary “11” is represented by one blink of 960 Hz, “00000000”, A plurality of bits of data exemplified as “11011110” and “01100011” can be output as an optical signal. Thereby, the related information of the object can be output as an optical signal.

  Note that the relationship between the luminance Ia and the luminance Ib shown in FIG. 5 is the integration of the luminance Ia within one frame period and the integral of the luminance Ib within one frame period using the human visual characteristics as described above. Set so that the value is approximately equal.

  As a second modulation method, the repetition period itself of the lighting period and the extinguishing period for improving the motion blur may be modulated so as to extend over a plurality of frames according to the object related information (referred to as frame rate modulation). For example, as shown in FIGS. 6B and 6C, in the case of 120 fps display (FIG. 6B), one lighting period (Tub to Tuc) and one lighting period (Tuc to Tub ′) are provided across two frames (this The repetition period of the lighting period and the extinguishing period is the same as the repetition period of the lighting period and the extinguishing period in 60 fps display (FIG. 6A). If binary “0” is expressed by two blinks of 120 fps and binary “1” is expressed by one blink of 60 fps, as shown in FIGS. 6B and 6C by this frame rate modulation. One-bit data per two frames can be output as an optical signal.

  Further, as shown in FIGS. 6D and 6E, in the case of 240 fps display (FIG. 6D), one lighting period and extinguishing period are provided across two frames. Then, if binary “0” is expressed by one blinking of 240 fps and binary “11” is expressed by one blinking of 120 fps, 1 is illustrated as shown in FIGS. 6D and 6E by frame rate modulation. One-bit data per frame can be output as an optical signal. The modulation method is not limited to these examples.

  Then, for each object to be displayed on the screen, the object area and the related information of the object are recorded in correspondence in the storage means, and each object on the screen is recorded in a cycle modulated by the related information in the storage means. Make the area blink. Further, since the data length of the related information is usually different for each related information, a stop bit indicating the end of the data is added to the end of each related information.

  When the general high frame rate display as shown in FIG. 4 is performed by the modulation method shown in FIG. 5 or FIG. 6, the blinking display can be performed with the period modulated by the related information of the object.

For example, the following information (a) to (d) can be cited as the object related information to be recorded in the storage means.
(A) Information having the same content as the object (for example, when the object is a character telop, text data of the character telop).
(B) Supplemental information about the object (for example, text data such as a product name when the object is a product in the video).
(C) Electronic rights related to the object, such as electronic coupons, electronic money, and electronic tickets (for example, when the object is an actual store or facility in the video, or the name of the store or facility where the object actually exists) E-coupons that can be used at the store or facility if it is a text telop).
(D) Information indicating the location of the information providing device that provides detailed information about the object (URL on the Internet, address of the display control device itself on the LAN, etc.).

Examples of a method for acquiring the related information of these objects include the following methods (a) and (b).
(A) When related information of an object in the video of the program is provided in program-linked digital data broadcasting, the related information is acquired from the data packet in the received digital broadcast signal.
(B) When related information of an object in the video is added to the video content distributed via the Internet, the related information is acquired.

  On the other hand, the recording terminal device receives an optical signal from the display screen, demodulates related information from the optical signal, and records the demodulated related information. As a result, the user can immediately record the information related to the object on the screen regardless of the place by simply performing the simple operation of directing the recording terminal device to the screen.

Examples of methods for using information recorded by the recording terminal device include the following methods (a) to (c).
(A) Display to the user. For this purpose, the recording terminal device is provided with display means for displaying the recorded related information. As a result, when the related information is information having the same contents as the object (text data of telop, etc.) or its supplementary information, the user can display the object itself or its object even after the object disappears from the display screen. Supplemental information can be easily visually confirmed. In addition, unlike the case of shooting a screen with a digital camera as shown in FIG. 1, objects and their supplementary information can be displayed on the entire screen, so that characters can be read even if the display screen of the recording terminal device is small. Is easy.

  (B) Electronic presentation and transmission. For this purpose, the recording terminal device is provided with a transmission means for transmitting the recorded related information to an external device. As a result, when the related information is an electronic right such as an electronic coupon, electronic money or electronic ticket, the user can easily make a payment or receive various services using the related information. It becomes.

  (C) If the related information is information indicating the location of the information providing apparatus, detailed information about the object is requested to the information providing apparatus. For this purpose, the recording terminal device is provided with transmission / reception means for transmitting / receiving information to / from the information providing device. Thereby, the user can easily obtain detailed information about the object on the screen of the display.

[System configuration example]
Next, a configuration example of a system for realizing the above-described method for recording object related information will be described. FIG. 7 is a diagram illustrating the external appearance of the devices constituting this system. This system is a system in which supplementary information about a specific subject (a product such as an automobile shown in FIG. 2 or a person shown in FIG. 2) in a video of a TV program can be recorded and browsed. It is composed of a recording terminal device 2. The television receiver 1 is a device in which a display control device in claims is integrated with a television receiver that receives digital broadcasting.

  The recording terminal device 2 is a recording terminal device in the scope of the claims, and is used by a user by hand. On the surface of the recording terminal device 2, a light receiving surface 2a and a screen 2b are provided. When the user wants to record a telop displayed on the screen 1a of the television receiver 1, he orients the light receiving unit 2a to the screen 1a.

The television receiver 1 is supplied with a digital broadcast signal transmitted from a television broadcast station. As is well known, a digital broadcast signal is obtained by multiplexing the following packets (a) to (d) in a transport stream, scrambled, and modulated by a predetermined modulation method.
(A) A video / audio packet of a television program.
(B) A packet of non-storage type data (such as a character telop to be inserted into a TV program video) which is a part of the content of data broadcasting.
(C) Storage type data that is a part of data broadcasting content.
(D) Transmission control signal (PSI = Program Specific Information) for mutually identifying packets for a plurality of channels transmitted in the same frequency band, and program arrangement information (SI = information for creating an electronic program guide) Service Information) packets.

  As the storage type data (c) above, various data relating to the contents of a television program are generally prepared. Here, as related information related to a specific subject in the video of the TV program, supplementary information that supplementarily describes the subject with characters (for example, the vehicle type when the subject is a car as shown in FIG. 2). It is assumed that supplementary information explaining a name or the like is prepared with a stop bit added at the end. Also, information indicating the timing (frame) at which the subject is displayed on the screen and area information indicating the display area of the subject on the screen for each frame are prepared.

  FIG. 8 is a block diagram showing the main part of the hardware configuration of the television receiver 1. The television receiver 1 includes a tuner 11, a demodulator 12, a descrambler 13, a demultiplexer 14, a video decoder 15, an audio decoder 16, a microprocessor 17, a video signal processing circuit 18, and a display. A drive circuit 19, a region-related information pair storage memory 20, and a display 21 are provided.

  The tuner 11 is supplied with a digital broadcast signal received by a receiving antenna (not shown) or the like. When watching a TV program, the digital broadcast signal is selected by the tuner 11 based on the user's channel selection operation, demodulated by the demodulator 12, descrambled by the descrambler 13, and transported. After returning to the stream, the demultiplexer 14 uses video / audio packets of the TV program for the plurality of channels (packet (a) above) and non-storage type data packets (packet (b) above) , A storage-type data packet (packet (c) above), and a transmission control signal / program arrangement information packet (packet (d) above).

  Of the video / audio packets of the television program for a plurality of channels, the video and audio of the packet for one channel extracted based on the user's channel selection operation are decoded by the video decoder 15 and the audio decoder 16, respectively. Is done. Further, each packet of storage type data, non-storage type data, and transmission control signal / program arrangement information is sent to the microprocessor 17.

  The microprocessor 17 uses the non-storage type data to create a character signal for character telop. Then, the video signal decoded by the video decoder 15 and the character signal and the like are synthesized by the video signal processing circuit 18 so that display screen data for each frame to be displayed on the display 21 is generated and displayed. It is sent to the drive circuit 19.

  Further, as a feature of the present invention, the microprocessor 17 refers to the storage type data, and displays any one or a plurality of subjects that are the targets of the above-described supplemental information in a frame to be displayed. The above-mentioned related information (supplementary information) and region information are supplied to a region-related information pair storage memory (hereinafter also simply referred to as memory) 20.

  The memory 20 records supplementary information and region information about each subject supplied from the microprocessor 17 in correspondence with each other (hereinafter, a pair of supplementary information and region information in the memory 20 is recorded). The area-related information pair recorded in the immediately preceding frame is deleted. In this way, the memory 20 always holds a region-related information pair for a specific subject displayed in the current frame.

  The display drive circuit 19 is a driver that drives the display 21. The display drive circuit 19 drives the display 21 with reference to not only display screen data supplied from the video signal processing circuit 18 but also region-related information pairs in the memory 20. .

  FIG. 9 is a flowchart showing processing executed by the display driving circuit 19 under the control of the microprocessor 17. Waiting for display screen data to be supplied from the video signal processing circuit 18 (step S1), when the display screen data is supplied, data for one region of the display screen data is acquired (step S2). The size of this one area is the same size that a normal driver acquires data at one time. For example, the display 21 is an LCD using a cold cathode fluorescent tube (CCFL) as a light source as shown in FIG. 3A. In some cases, the area is illuminated by a single cold cathode fluorescent tube.

  Subsequently, it is confirmed whether or not area information indicating an area (at least a part of which overlaps with each other) corresponding to the area from which the data is acquired exists in the memory 20 (step S3). If it exists, the related information paired with the corresponding area is acquired from the memory 20 (step S4). And while displaying the data for 1 area acquired at step S2 on the display 21, the area | region corresponding to the relevant information acquired at step S4 among the 1 area is blinked and displayed with the period modulated by the relevant information. (Step S5).

  For example, if one area from which data is acquired in step S2 is an area including the upper half of the automobile 102 in FIG. 2, in step S5, the upper half of the automobile 102 is modulated by related information of the automobile 102. The blinking display is performed at the cycle. The flashing display range of the subject (object), the flashing display method according to the display type, and the flashing cycle modulation method are as described with reference to FIGS.

  If it does not exist in step S3, the data for one area acquired in step S2 is displayed on the display 21 as in the case of normal video display (step S6).

  When step S5 or S6 is completed, it is confirmed whether there is a region from which data is to be acquired next from the video signal processing circuit 18 (whether all the display screen data for one frame has not yet been acquired) (step S7). If it exists, the next one area of data is acquired from the video signal processing circuit 18 (step S8), and the processes in and after step S3 are repeated. If not, the process returns to step S1 for the display screen data of the next frame.

  With the processing of FIG. 9, the relevant information (supplementary information) of the subject is output as an optical signal from the area of the specific subject on the screen 1a of the television receiver 1.

  FIG. 10 is a block diagram illustrating a hardware configuration example of the recording terminal device 2 of FIG. The recording terminal device 2 is provided with a light receiving optical system 31, a light receiving element (photodiode) 32, a microprocessor 33, a memory 34, and a display unit (display and driver) 35. The light receiving surface 2 a in FIG. 7 is the incident surface of the light receiving optical system 31, and the screen 2 b in FIG. 7 is a display screen of the display unit 35.

  The light receiving optical system 31 does not receive light from the entire screen 1a of the television receiver 1 of FIG. 7 at a time, but receives light from each region (region of each object) on the screen 1a. This is an optical system. The focal length of the lens used in the light receiving optical system 31 (narrow field angle) and the maximum magnification (magnification of close-up capability) are the size of the object on the screen, as described with reference to FIG. What is necessary is just to determine according to the magnitude | size of the range of the blink display of an object, the size of the screen 1a of the television receiver 1, and the distance with the screen 1a at the time of using the recording terminal device 2. FIG. Further, the size and shape of the recording terminal device 2 shown in FIG. 7 are merely examples, and the size and shape of the recording terminal device 2 may be determined according to the size and shape of the light receiving optical system 31.

  FIG. 11 is a flowchart illustrating processing executed in the recording terminal device 2 under the control of the microprocessor 33. The light receiving element 32 converts the light received by the light receiving optical system 31 into an electric signal (step S11). Therefore, when the user directs the light receiving surface 2a of the recording terminal device 2 to a specific subject on the screen 1a of the television receiver 1, an optical signal output from the region of the subject is converted into an electrical signal.

  Then, the microprocessor 33 demodulates the related information (supplementary information) from this electric signal (restores the supplementary information by a demodulation method corresponding to the modulation method shown in FIG. 5 or FIG. 6) (step S12), The supplementary information is stored in the memory 34 (step S13).

  Subsequently, the microprocessor 33 confirms whether the supplementary information has been prepared to the end based on the stop bit added to the end of the supplementary information (step S14). If they are ready, the supplementary information in the memory 34 is displayed on the display unit 35, and the process returns to step S11. If not, the process returns to step S11 as it is.

  With the processing in FIG. 11, characters that supplementarily describe a specific subject output as an optical signal from the screen 1a of the television receiver 1 are displayed on the screen 2b (FIG. 7) of the recording terminal device 2. FIG. 12 is a diagram illustrating a display example of the screen 2b of the recording terminal device 2 when the subject that is the target of the supplemental information is a car as illustrated in FIG. A character “Ferrari” (Ferrari is a registered trademark) indicating the model name of the automobile is displayed.

  According to this system, the user simply performs a simple operation of directing the recording terminal device 2 toward the screen 1a of the television receiver 1, and immediately supplements the subject on the screen 1a without selecting a location. Can be recorded, and the supplementary information can be easily visually confirmed even after the display of the subject disappears from the screen 1a. Further, unlike the case where the screen is shot with a digital camera, the supplementary information can be displayed on the entire screen 2b of the recording terminal device 2, so that even if the screen 2b is small, it is easy to read characters.

[Example of change]
Next, modifications to the above system configuration example will be given as (1) to (10) below.

  (1) When the recording terminal device 2 performs the process of FIG. 11, the display unit 35 displays characters for notifying that recording of supplementary information has started, recording is in progress, and recording has been completed. In addition, when recording fails (for example, when supplementary information is not aligned to the end even after a lapse of a certain time from the start of recording), a character or the like for notifying that may be displayed on the display unit 35. . Alternatively, a speaker may be provided in the recording terminal device 2 and these notifications may be performed by voice. Thereby, the user can easily check whether or not the supplementary information about the subject to which the recording terminal device 2 is directed is recorded and whether or not the recording is normally completed. Is possible.

  (2) The recording terminal device 2 is provided with operation means (push button or the like) for switching recording on / off and display on / off, and the processing of FIG. 11 is executed according to the operation state of the operation means. You may make it do.

  (3) From the screen 1a of the television receiver 1, text data of the character telop may be output as an optical signal as related information of the character telop inserted in the video. For this purpose, as the above-mentioned storage type data in the digital broadcast signal, text data of a character telop (character telop in the non-storage type data) to be inserted into the video and the character telop on the screen for each frame Area information indicating the display area is prepared. Further, the microprocessor 17 in the television receiver 1 supplies the memory 20 with text data and area information about the character telop for each frame in which the character telop is to be displayed.

  By doing so, the user can record the character telop on the screen 1a immediately without selecting a place by simply performing the simple operation of directing the recording terminal device 2 toward the screen 1a of the television receiver 1. The character telop can be easily visually confirmed even after the display of the character telop disappears from the screen 1a.

  (4) From the screen 1a of the television receiver 1, electronic coupons, electronic money, electronic tickets, etc. that can be used in the stores and facilities are digitized as related information related to the actual stores and facilities in the video of the TV program. The right may be output as an optical signal. For this purpose, as storage-type data in the digital broadcast signal, electronic rights that can be used in the store or facility and area information indicating the display area of the store or facility on the screen for each frame are prepared. To do. Further, the microprocessor 17 in the television receiver 1 supplies the electronic right and area information to the memory 20 for each frame in which the store or facility is to be displayed.

  Alternatively, an electronic right that can be used in the store or facility may be output as an optical signal from the screen 1a of the television receiver 1 as related information of the character telop of the name of the actual store or facility. . To that end, as storage-type data in the digital broadcast signal, an electronic right that can be used in the store or facility and area information indicating the display area of the character telop on the screen for each frame are prepared. . Further, the microprocessor 17 in the television receiver 1 supplies the digitized right and area information to the memory 20 for each frame in which the character telop is to be displayed.

  In these cases, for example, as shown in FIG. 13, a non-contact IC card 41 is provided in the recording terminal device 2, and the microprocessor 33 assigns the electronic right in the memory 34 to the non-contact IC card 41. Supply.

  As a result, when a user actually goes to a store or facility that appears as a subject in a video of a TV program or whose name is written in a text telop, the user can record on the reader / writer 42 in the store or facility. Holding the non-contact IC card 41 of the apparatus 2 makes it possible to easily make payments and receive various services.

  (5) From the screen 1a of the television receiver 1, a URL on the Internet that provides detailed information about the subject as related information related to the subject in the video of the television program (for example, when the subject is a product) The URL of the server operated by the manufacturer, or the URL of the server operated by the store or facility when the subject is a store or facility may be output as an optical signal.

  Alternatively, from the screen 1a of the television receiver 1, a URL on the Internet where detailed information about the display contents of the character telop exists as related information of the character telop (for example, a character telop with the name of a product) The URL of the server operated by the manufacturer, or the URL of the dictionary site server in the case of a character telop of a foreign language or a difficult word may be output as an optical signal.

  For this purpose, the storage type data in the digital broadcast signal prepared and the processing of the microprocessor 17 in the television receiver 1 for that purpose are the same as those described in the above modification (4).

  In these cases, a communication interface 43 for network communication is provided in the recording terminal device 2 as shown in FIG. The microprocessor 33 accesses the server 44 of this URL from the communication interface 43 via the Internet 44 to request transmission of detailed information, and stores the information received from the server 44 in the memory 34 or displays it on the display unit 35. Let

  As a result, users can easily obtain detailed information about products and stores that appear as subjects in TV program images and whose names are listed in character telops, or for foreign languages and difficult to understand displayed as character telops. It is possible to easily check the meaning of simple words.

  (6) As a derivation of the modified example of (5) above, when the recording terminal device 2 requests transmission of detailed information via the Internet, it is an identification ID for identifying a television program or a broadcast station, or a television receiver or An identification ID for identifying the recording terminal device 2 may be transmitted together. As a result, the side providing detailed information (for example, manufacturers, stores, etc.) can investigate viewing trends, and the amount of information provided, the distribution of text and video in the information, the content of the information, etc. Can be determined according to the survey results, and more appropriate information can be provided to the user. In addition, it is possible to verify the effects when a manufacturer, a store, etc. introduces their products, stores, etc. in a TV program or TV CM.

  (7) Detailed information about the subject in the video of the TV program (information whose data amount is too large to be output as an optical signal from the screen 1a of the television receiver 1) is stored in the storage type data itself in the digital broadcast signal. If it is included, an identification ID for identifying detailed information about the subject may be output as an optical signal from the screen 1a of the television receiver 1 as related information related to the subject.

  In this case, an interface for bidirectional communication is provided in each of the television receiver 1 and the recording terminal device 2 (for example, a LAN interface is provided to connect to the LAN). Further, the microprocessor 17 in the television receiver 1 stores this detailed information in a memory (not shown) in the television receiver 1.

  Then, the microprocessor 33 in the recording terminal device 2 sends this identification ID to the television receiver 1 to request transmission of detailed information, and the microprocessor 17 in the television receiver 1 responds to this request with detailed information. Is transmitted to the recording terminal device 2, and the microprocessor 33 in the recording terminal device 2 stores the received detailed information in the memory 34 or displays it on the display unit 35.

  (8) Instead of the light receiving optical system 31 and the light receiving element 32, the recording terminal device 2 has a CCD camera or CMOS camera similar to that mounted on a normal camera-equipped mobile phone, and a part of the imaging area of the camera. Operation means for designating (an area having a size corresponding to the blinking display range of one object as exemplified in FIG. 2) is provided, and the microprocessor 33 designates from the output signal of this camera by this operation means. It is also possible to extract the signal of the imaged area and decode the related information of the object from the extracted signal.

  Alternatively, when only one object is displayed on the screen and the entire screen is blinked and displayed with a period modulated by the relevant information of the object, a CCD camera or a CMOS camera is simply provided, and the output signal of this camera is used. The microprocessor 33 may decode the related information of the object.

  (9) Not only for television broadcasting but also when video-related content distributed via the Internet is associated with information related to objects in the video, various devices that can be connected to the Internet, including computers, can display The related information may be output as an optical signal by blinking the screen.

  (10) A video output device comprising the television receiver 1 comprising the tuner 11, demodulator 12, descrambler 13, demultiplexer 14, video decoder 15, audio decoder 16, microprocessor 17 and video signal processing circuit 18 shown in FIG. The video signal processing circuit in this video output device is divided into two devices, a display drive circuit 19 (a television receiver having no display) and a display device comprising a display drive circuit 19, an area-related information pair storage memory 20 and a display 21. From 18, display screen data may be sent to the display drive circuit 19 in the display device via, for example, an HDMI (High Definition Multimedia Interface) cable which is a cable for digital audio / video signal transmission.

It is a figure which shows the example of an external appearance of a digital camera. It is a figure which illustrates the object on a screen, and its blink range. It is a figure which illustrates a general display. It is a figure which shows the example of a general high frame rate display. It is a figure which illustrates the modulation | alteration in a flame | frame. It is a figure which illustrates frame rate modulation. It is a figure which illustrates the external appearance of the apparatus which comprises the system which concerns on this invention. It is a block diagram which shows the structural example of the television receiver of FIG. It is a flowchart which shows the process by the display drive circuit of FIG. It is a block diagram which shows the structural example of the recording terminal device of FIG. It is a flowchart which shows the process by a recording terminal device. It is a figure which shows the example of a display of the screen of the recording terminal device of FIG. It is a block diagram which shows the example of a change of a structure of the recording terminal device of FIG. It is a block diagram which shows the example of a change of a structure of the recording terminal device of FIG.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Display apparatus, 1a Screen of display apparatus, 2 Recording terminal apparatus, 2a Light-receiving surface of recording terminal apparatus, 2b Screen of recording terminal apparatus, 17 Microprocessor, 18 Video signal processing circuit, 19 Display drive circuit, 20 Area-related information Memory for memory, 21 Display, 31 Light receiving optical system, 32 Light receiving element, 33 Microprocessor, 34 Memory, 35 Display unit, 41 Non-contact IC card, 43 Communication interface

Claims (29)

A display control device comprising a storage means, a display drive means and a control means, and a recording terminal device;
When the control means of the display control device acquires video data and related information related to an object displayed on the screen by the video data from the outside of the display control device, the related information is stored in the storage means. And storing the video data to the display driving means,
The display driving means of the display control device displays the video data on the display means, and causes the screen of the display means to blink and display at a cycle modulated by the related information stored in the storage means,
The recording terminal device
A light receiving means for receiving light from the screen of the display means and converting it into an electrical signal;
Demodulating means for demodulating the related information from the electrical signal converted by the light receiving means;
And a storage unit for storing the related information demodulated by the demodulating unit. The object related information recording system according to claim 1,
The control means of the display control device performs display control on video data, related information related to a plurality of objects in the video data, and area information indicating areas where the plurality of objects are respectively located on a screen. When received from the outside of the apparatus, each of the objects is stored in the storage means in association with the area information and the related information, and the video data is supplied to the display driving means,
The display driving means of the display control device displays the video data on the display means, and at least part of the area of the screen of the display means in which the area information is stored in the storage means. Flashing display with a period modulated according to the related information corresponding to the region,
The light receiving means of the recording terminal device converts the light from the display area of each object on the screen of the display means into an electric signal, and records the related information of the object. The object related information recording system according to claim 1,
The display means is a liquid crystal display using a fluorescent tube as a light source,
The object related information recording system, wherein the display driving means of the display control device performs the blinking display by switching between transmission and shielding in a liquid crystal cell of the liquid crystal display. The object related information recording system according to claim 1,
The display means is a liquid crystal display using a light emitting diode as a light source,
The display driving means of the display control device causes the blinking display to be performed by at least one of switching between transmission and shielding in a liquid crystal cell of the liquid crystal display and blinking of the light emitting diode. Information recording system. The object related information recording system according to claim 1,
The display means is a display using a self-luminous element,
The object related information recording system, wherein the display driving means of the display control device causes the blinking display to be performed by blinking of the light emitting element. The object related information recording system according to claim 1,
The system for recording related information of an object, wherein the display driving means of the display control device causes the blinking display to be performed at a cycle that is not perceived as blinking due to human visual characteristics. The object related information recording system according to claim 1,
The display driving unit of the display control device includes an integral value within a certain period of luminance corresponding to a predetermined gradation level in the area where the blinking display is performed, and the predetermined floor in the area where the blinking display is not performed. A system for recording related information of an object, characterized in that a luminance relationship of each region is set so that a luminance value corresponding to a tone level is substantially equal to an integrated value within the predetermined period. The object related information recording system according to claim 1,
The display driving means of the display control device causes the blinking display to be performed at a cycle shorter than the lighting period during the lighting period of the lighting period and the extinguishing period for improving moving image blur, and the period is related to the related A system for recording related information of an object, characterized by being modulated by information. The object related information recording system according to claim 1,
The display drive unit of the display control device modulates the repetition period of the lighting period and the extinguishing period for improving moving image blur so as to span a plurality of frames according to the related information. Recording system. The object related information recording system according to claim 1,
The object related information recording system, wherein the related information is information having the same contents as the object and / or supplementary information about the object. The object related information recording system according to claim 1,
The related information is information indicating a location of an information providing device that provides information about the object;
The recording terminal device
Object related information, further comprising: a transmission / reception unit for transmitting / receiving information to / from the information providing apparatus based on the related information, wherein the information received by the transmission / reception unit is stored in the storage unit Recording system. The object related information recording system according to claim 1,
The recording terminal device
An object related information recording system further comprising display means for displaying the related information stored in the storage means. The object related information recording system according to claim 1,
The recording terminal device
An object related information recording system, further comprising: a transmission unit configured to transmit the related information stored in the storage unit to an external device. A first step in which the display control device acquires video data and related information related to an object displayed on the screen by the video data from the outside of the display control device;
A second step in which the display control device stores the related information acquired in the first step in a storage unit;
The display control device displays the video data acquired in the first step on a display unit, and the display unit screen is modulated at a cycle modulated according to the related information stored in the second step. A third step for flashing display;
A recording terminal device that receives light from the screen of the display means and converts it into an electrical signal;
A fifth step in which the recording terminal apparatus demodulates the related information from the electrical signal converted in the fourth step;
The recording terminal device has a sixth step of storing the related information demodulated in the fifth step in a storage unit. Storage means, display drive means and control means,
When the video data and related information related to an object displayed on the screen by the video data are supplied from outside the display control device, the control means stores the related information in the storage means, Supplying the video data to the display driving means;
The display driving unit causes the display unit to display the video data supplied from the video receiving unit, and causes the screen of the display unit to blink and display at a cycle modulated by the related information stored in the storage unit. A display control device. The display control device according to claim 15, wherein
The control means receives video data, related information relating to a plurality of objects in the video data, and area information indicating areas where the plurality of objects are respectively located on the screen from the outside of the display control device. In this case, each of the objects is stored in the storage unit in association with the area information and the related information, and the video data is supplied to the display driving unit.
The display driving means displays the video data on the display means, and at least a part of the area of the screen of the display means in which the area information is stored in the storage means corresponds to the area. A display control apparatus, characterized by causing a blinking display with a period modulated according to related information. The display control device according to claim 15, wherein
The display means is a liquid crystal display using a fluorescent tube as a light source,
The display control device, wherein the display driving means causes the blinking display to be performed by switching between transmission and shielding in a liquid crystal cell of the liquid crystal display. The display control device according to claim 15, wherein
The display means is a liquid crystal display using a light emitting diode as a light source,
The display control device, wherein the display driving unit causes the blinking display to be performed by at least one of switching between transmission and shielding in a liquid crystal cell of the liquid crystal display and blinking of the light emitting diode. The display control device according to claim 15, wherein
The display means is a display using a self-luminous element,
The display control apparatus, wherein the display driving unit causes the blinking display to be performed by blinking of the self-light-emitting element. The display control device according to claim 15, wherein
The display control device, wherein the display driving unit causes the blinking display to be performed at a cycle that cannot be felt as blinking due to human visual characteristics. The display control device according to claim 15, wherein
The display driving unit corresponds to an integral value within a certain period of luminance corresponding to a predetermined gradation level in the area where the blinking display is performed, and to the predetermined gradation level in the area where the blinking display is not performed. A display control device, characterized in that the luminance relationship of each region is set so that the integrated value of luminance within the predetermined period is substantially equal. The display control device according to claim 15, wherein
The display driving means causes the blinking display to be performed with a cycle shorter than the lighting period during the lighting period of the lighting period and the non-lighting period for improving moving image blur, and the period is modulated by the related information. A display control device. The display control device according to claim 15, wherein
The display control device modulates a repetition period of a lighting period and an extinguishing period for improving moving image blur so as to span a plurality of frames according to the related information. The display control device according to claim 15, wherein
The display control apparatus according to claim 1, wherein the related information is information having the same content as the object and / or supplementary information about the object. A first step of obtaining video data and related information related to an object displayed on the screen by the video data;
A second step of storing in the storage means the related information acquired in the first step;
The video data acquired in the first step is displayed on the display means, and the screen of the display means is displayed in a blinking manner with a period modulated according to the related information stored in the second step. A display control method comprising: steps. On the computer,
A first procedure for obtaining video data and related information related to an object displayed on the screen by the video data;
A second procedure for storing the related information acquired in the first procedure in a storage means;
The video data acquired in the first procedure is displayed on the display means, and the screen of the display means is displayed in a blinking manner with a period modulated according to the related information stored in the second procedure. A program characterized by causing a procedure to be executed. A light receiving means for receiving light from the screen of the display means that blinks and displayed with a period modulated by predetermined information, and converting the light into an electrical signal;
Demodulation means for demodulating the predetermined information from the electrical signal converted by the light receiving means;
A recording terminal apparatus comprising storage means for storing information demodulated by the demodulation means. A first step of receiving light from the screen of the display means displayed in a blinking manner with a period modulated by predetermined information, and converting the light into an electrical signal;
A second step of demodulating the predetermined information from the electrical signal converted in the first step;
And a third step of storing in the storage means the information demodulated in the second step. On the computer,
A first procedure for photoelectrically converting light received from the screen of the display means blinking and displayed at a period modulated by predetermined information;
A second procedure for demodulating the predetermined information from the signal photoelectrically converted in the first procedure;
And a third procedure for storing in the storage means the information demodulated in the second procedure.

Images