JP2013229650A - Electronic apparatus control method, electronic apparatus, and electronic apparatus control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic apparatus control method, an electronic apparatus, and an electronic apparatus control program which, when a user designates a scene interesting the user to some program, are capable of providing a tag list relating to the scene for the user.SOLUTION: The electronic apparatus control method specifies some scene in a moving image displayed on a display, by user operation, next transmits information relating to the specified scene to a server, next receives from the server a tag list created on the basis of the information relating to the scene, and next displays a moving image program including the moving image reproduced by a moving image reproduction apparatus on the basis of the tag list.

Description

  Embodiments described herein relate generally to an electronic device control method, an electronic device, and an electronic device control program.

  Information reproducing apparatuses such as a television receiver and a disk recording / reproducing apparatus have a function of receiving a broadcast program signal and recording it on a recording medium. An apparatus including a plurality of tuners has a function of simultaneously recording broadcast program signals of a number of channels on a recording medium. This type of apparatus also has a function of recording a broadcast program signal received based on recording reservation data on a recording medium.

JP 2006-101324 A

  When many programs are recorded on the recording medium as described above, a huge amount of time is required for the user to view all the programs. Therefore, there are cases where the user desires to skip a scene of interest or a specific person, animal, or landscape.

  An object of the present invention is to provide an electronic device control method, an electronic device, and an electronic device that can provide a user with a tag list related to the scene when a user is interested in a certain program. It is to provide a control program.

  An electronic device control method according to an embodiment includes: specifying a scene with a moving image displayed on a display by a user operation; transmitting information related to the specified scene to a server; and information related to the scene Receiving a tag list created based on the video from the server, and displaying a video program including the video played by the video playback device based on the tag list.

  The information related to the scene may be contour information of an image forming the scene or program information of the moving image including the scene.

  The tag list received from the server may be of a plurality of types.

  If the plurality of tag lists are received, the user may be able to select a tag list.

  The tag list received from the server is a tag list related to a background included in the scene or an image different from the background.

  The tag list relating to an image different from the background is a plurality of tag lists relating to a plurality of images.

The figure which shows an example of the use condition of the electronic device to which embodiment is applied. The figure which shows the example of a scene and a tag list in order to demonstrate the example of operation | movement of embodiment. The figure which shows the example of the display screen which a portable terminal displays. The figure which shows the example of transmission / reception of information in order to demonstrate the example of operation | movement of embodiment. The figure which shows the example of transmission / reception of information in order to demonstrate the other operation example of embodiment. The figure which shows the typical structural example of the portable terminal which concerns on embodiment. The figure which shows the structural example of the moving image reproduction apparatus which concerns on embodiment. The figure which shows the structural example of the control part of the moving image reproduction apparatus of FIG. The figure which shows the structural example of the data collection and correction value production | generation part of FIG.

  Hereinafter, embodiments will be described with reference to the drawings.

  FIG. 1 is a system configuration diagram illustrating an example of a usage state of an electronic device to which the present embodiment is applied. Reference numeral 1100 denotes a mobile terminal included in the electronic apparatus, and the mobile terminal includes a tablet, a personal computer, a mobile phone, a personal digital assistant device, a navigator device, and the like. In the example of FIG. 1, an example of a tablet 1102 and a mobile phone 1103 is shown. The display unit of the tablet 1102 and the mobile phone 1103 also serves as a touch input unit, and various operations can be performed when the user touches the display unit.

  The mobile terminal 1100 can perform mutual communication with the moving image playback device 1200 included in the electronic device, and can receive and display a moving image from the moving image playback device 1200. The moving image reproducing device 1200 includes various devices. For example, the recording device 1201 includes a hard disk drive device, a Blu-ray disc recording / reproducing device, a digital versatile disk recording / reproducing device, and a semiconductor memory. Further, the television receiving device 1202 and the recording device 1201 may be connected. Then, the television receiving device 1202 may be used as a monitor.

  Furthermore, the recording device 1201 can also perform mutual communication with the mobile terminal 1100 and the television receiver 1202 using a short-range wireless communication method. Accordingly, the mobile terminal 1100 can control the operation of the recording device 1201 and receive a moving image signal distributed directly from the recording device 1201 or via the television receiving device 1202. The mobile terminal 1100 can also receive and display a moving image distributed via the Internet via a network described later.

  Reference numeral 1300 denotes a server included in the electronic device, which can be accessed by the mobile terminal 1100 via the network 1400. The network 1400 includes various communication means such as a telephone line, an Internet line, and an access point, and can perform long-distance communication.

  The server 1300 includes a network modem 1301 that is wirelessly and / or wired connected to the network 1400. The server 1300 includes a CPU (central processing unit) 1302 as a control unit for controlling various blocks in the server 1300. Furthermore, the server 1300 includes a receiving device 1303, and can receive television programs of a large number of channels, distribution videos from a large number of servers distributed on the Internet, and the like.

  The moving image received by the receiving device 1303 is stored in the recording device 1305 under the control of the CPU 1302. The recording device 1305 includes, for example, a hard disk drive device, a Blu-ray disc recording / reproducing device, a digital versatile disc recording / reproducing device, and a semiconductor memory.

  Also, the moving image received by the receiving device 1303 and the moving image recorded in the recording device 1305 can be processed by the tag list generating unit 1304 under the control of the CPU 1302. The tag list generation unit 1304 can generate a tag list of the received moving image. When generating a tag list, the tag list generation unit 1304 generates a tag list based on information related to a scene.

  Tags constituting the tag list are created as information indicating a time zone in which a specific scene appears, for example. The time is, for example, a relative time from the beginning of the program, and the tag indicates a time zone in which a specific scene can be viewed for a few seconds or a few dozen seconds. The width of this time zone is not limited to a few seconds or a few dozen seconds.

  The “scene-related information” described above includes the following various types.

(1) “Information related to a scene” is program information. The program information is, for example, the broadcast date and time of a television program. When the program information is sent from, for example, the portable terminal 1100, the server 1300 specifies a program to be processed from the sent program information. The program may be a live program currently being received or a program recorded in the recording device 1305. Then, a person, landscape, etc. in the specified program are searched, and a tag list of a specific scene in which the person appears and a tag list of a specific scene in which the scenery appears are created. The created tag list is recorded in the recording device 1305 in association with the program information.

  The tag list can also be transmitted to the mobile terminal 1100. For example, when program information is transmitted as “information related to a scene” from the mobile terminal 1100, a plurality of such acts can be presented as a recommended tag list. When a plurality of tag lists are presented on the mobile terminal 1100, the user can select a desired tag list. Thumbnails such as people and landscapes may be added to the plurality of tag lists sent from the server 1300.

(2) “Information related to a scene” is program information and time data of a representative specific scene. This time data is a relative time position from the head of the program. The program information and the time data of the representative specific scene are sent from the portable terminal 1100, for example. The server 1300 identifies a program to be processed based on the received program information. The tag list generation unit 1304 creates a tag list indicating a time zone in which a specific scene appears in the specified program. The created tag list is recorded in the recording device 1305 in association with the program information.

  In addition, the server 1300 transmits the created tag list to the mobile terminal that has transmitted the “information related to the scene”.

(3) “Information related to a scene” is program information and characteristic data of a representative specific scene. The feature data is, for example, contour information of the representative specific scene. Not only the contour information but also information indicating a color area may be used. “Information related to the scene” is sent from the portable terminal 1100, for example. The server 1300 identifies a program to be processed based on the received program information. The tag list generation unit 1304 uses each scene of the specified program and the feature information to create a tag list indicating a time zone in which the specific scene appears. The created tag list is recorded in the recording device 1305 in association with the program information.

  Also, the created tag list is transmitted to the portable terminal that has transmitted “information related to the scene”. When the feature information is used as “information related to the scene”, the mobile terminal 1100 reduces the data transmission amount and reduces the processing load.

(4) “Information related to a scene” is program information, characteristic data of the representative specific scene, and time data of the representative specific scene. In the “information related to the scene”, time data of the body surface specific scene is further added to the information described in (3). The server 1300 identifies a program to be processed based on the received program information. The tag list generation unit 1304 uses each scene of the specified program and the feature information to create a tag list indicating a time zone in which the specific scene appears. At this time, since the time data is also used, the time for determining the time zone of the first tag in which the specific scene appears is advanced.

  The server 1300 transmits the created tag list to the mobile terminal that has transmitted “information related to the scene”.

  When a tag list is sent from the server 1300, the mobile terminal 1100 can transmit the tag list to the video playback device 1200. The video playback device 1200 can play back a program corresponding to the received tag list by skipping the program based on the tag list. The moving image reproduction device 1200 transmits the reproduced moving image signal to the mobile terminal 1100. Thus, the user can use the mobile terminal 1100 to skip any program based on the tag list.

  It is assumed that the user is now receiving and viewing the program PX from the motion playback device 1200 using the tablet 1102. Here, in the program PX, it is assumed that the user gives an instruction to create a tag list for one scene in which a moon and a ship appear in the background of buildings. Various methods can be used as an instruction method for creating the tag list. For example, after selecting the item “Create tag list” on the menu screen, it is possible to instruct the creation of a tag list by playing a program. Alternatively, when a user wants to instruct the creation of a tag list while viewing a program, the user can instruct the creation of a tag list by pressing a “tag list creation key” provided in the frame.

  In a state where a tag list creation instruction is possible, when a scene in which the user is interested is displayed, the user touches the screen to bring the scene into a still display state. The tablet 1102 creates “information related to the scene” corresponding to the still display state image.

  “Information related to the scene” is transmitted to the server 1300.

  FIG. 2 shows an example of a tag list obtained when a scene with the moving image PX is specified in order to create a tag list. FIG. 3 shows an example of a display image of the tablet 1102.

  In the case of “scene-related information” for one scene where the moon and ship appear in the background where the buildings are lined up, the tag list includes a tab list tag-L1 based on the scene base including the background, and “month It is possible to create multiple tag lists with tag-L2 for "base" and tag-L3 for "ship" base. That is, it is possible to create a tag list regarding the background included in the scene and an image different from the background.

  The server 1300 can automatically create the plurality of tag lists in advance and store them in the recording device 1305 according to the operation setting by the administrator of the server 1300.

  In another embodiment, when the program information is sent from the tablet 1102, the server 1300 may transmit the selection items (a representative thumbnail is added) of the plurality of tag lists to the tablet 1102. it can. FIG. 3A shows a screen when the user touches a scene in which the user is interested. Fig. 3 (B) shows the user whether he wants a tab list tag-L1 based on the scene base including the background, tag-L2 related to the "moon" base, or tag-L3 related to the "ship" base. An example is shown in which selection items of a plurality of tag lists are displayed for inquiry. The user can select any tag list of list A, list B, and list C by a touch operation. On the screen, for example, a caption such as “There is a tag list for a plurality of objects, please select a desired tag list from A, B, C” is displayed.

  In another embodiment, as shown in FIG. 3C, selection marks A, B, and C are displayed for a plurality of objects when a scene in which the user is interested is in a still display state. Is done. Then, a caption such as “You can prepare a tag list for multiple objects, please specify the desired object” is displayed. The user selects a desired object selection mark A, B, or C, or a combination thereof, and operates a transmission button (not shown). The server 1300 can create a tag list related to the object corresponding to the selection mark and transmit it to the tablet 1102.

  FIG. 4 is a diagram for explaining an example of a communication operation among the mobile terminal 1100, the moving image playback device 1200, and the server 1300.

  The portable terminal 1100 requests program information from the video playback device 1200 (t1). The program information is information of a program recorded by the moving image playback device 1200 (t2). If the user wants to view a desired program, the user requests the video playback device 1200 to play back the program via the portable terminal 1100 (t3). The video playback device 1200 plays back the requested program and transmits the playback video to the mobile terminal 1100 (t4).

  When a scene of interest appears while viewing a program on the mobile terminal 1100, the user performs a pause operation (t5). At this time, if the mobile terminal 1100 is in the tag creation mode, the mobile terminal 1100 also requests the video playback device 1200 for the playback time of the paused scene (t6).

  When the portable terminal 1100 obtains the reproduction time information of the paused scene (t7), it creates feature information of the scene (t8). Next, the portable terminal 1100 transmits program information, reproduction time information, and scene feature information to the server 1300 (t9). The server 1300 identifies the scene feature information, plays a program based on the corresponding program information, and determines the time zone of the scene corresponding to the scene feature information (t10). This time zone information becomes a tag list (t11). After creating the tag list, the server 1300 notifies the portable terminal 1100 of this (t13). When the portable terminal 1100 that has received this notification requests the tag list from the server 1300 (t14), the tag list is transmitted from the server 1300 to the portable terminal 1100 (t15).

  The mobile terminal 1100 transmits the tag list to the video playback device 1200 (t16), and the video playback device 1200 uses the tag list of the specified program to play back the specified program (t16). Thereby, the user can view the skipped reproduction image based on the tag list (t17). The viewing of the video may be, for example, a monitor included in the video playback device 1200 or may be performed on the display unit of the mobile terminal 1100.

  FIG. 5 is a diagram for explaining another example of the communication operation between the mobile terminal 1100, the moving image playback device 1200, and the server 1300. The process from the time when the mobile terminal 1100 requests program information to the video playback device 1200 to the time when the playback time is sent from the video playback device 1200 to the mobile terminal 1100 (t1-t7) is the same as in the case of FIG.

  The portable terminal 1100 transmits the program information and the reproduction time information to the server 1300 (t21). In this example, the mobile terminal 1100 has not created feature information. Then, the server 1300 transmits feature information of a plurality of scenes in the program and / or feature information of a plurality of objects (persons, animals, etc.) (t22). The portable terminal 1100 displays the received feature information regarding the plurality of scenes and / or the plurality of objects, and waits for the user's selection (see t23, FIG. 3B). When the user selects scene feature information, the mobile terminal 1100 transmits program information, playback time information, selection information, and the like related to the program to the server 1300 (t24). The server 1300 identifies the feature information sent and creates a tag list related to the program (t25).

  After creating the tag list, the server 1300 notifies the portable terminal 1100 of this (t27). When the portable terminal 1100 that has received this notification requests the tag list from the server 1300 (t28), the tag list is transmitted from the server 1300 to the portable terminal 1100 (t29).

  The mobile terminal 1100 transmits the tag list to the video playback device 1200 (t30), and the video playback device 1200 plays back the specified program using the tag list of the specified program. Thereby, the user can view the skipped reproduction image based on the tag list (t40). The viewing of the video may be, for example, a monitor included in the video playback device 1200 or may be performed on the display unit of the mobile terminal 1100.

  The description of each operation shown in FIGS. 4 and 5 can be replaced as a functional block, means, module, or operation unit of the mobile terminal 1100, the moving image playback device 1200, and the server 1300.

  Skip viewing can be used to recall programs from past series. In addition, it is possible to find a program of particular interest by skipping from many programs, and to use this program for later viewing slowly.

  There are various cases when the server 1300 transmits the created tag list to the mobile terminal that has transmitted “information related to the scene”. For example, in the server 1300, a tag list of already recorded programs can be created immediately. However, “scene-related information” may be transmitted from the user's mobile terminal during the live distribution of the program. Also, it may take time to create a tag list. In such a case, the server 1300 may transmit a message such as “The tag list is being created now and will be sent later” to the mobile terminal 1100.

  The target of tag list creation is not necessarily limited to a television broadcast program. For example, a moving image (YouTube (registered trademark)) distributed via the Internet is also a target for creating a tag list.

  FIG. 6 shows an example of a typical internal configuration of, for example, a tablet as the mobile terminal 1100. The display unit 301 operates as a video display unit and can operate as a touch screen. When the user touches a desired item while the menu screen is displayed, the operation input is recognized by the operation command processing unit 324 of the control unit 320.

  For example, when the touch operation is an operation input for selecting a telephone function, the operation mode setting unit 326 sets the mobile terminal 1100 to the mobile phone mode.

  The display unit 301 displays an operation screen for dial input. When a dial input operation of a desired destination is performed, the mobile phone function unit 325 transmits a call signal of the communication partner via the data processing unit 302, the communication control unit 303, and the transceiver 304. When the line with the communication destination is connected, the signal from the communication partner is decoded via the transmitter / receiver 304, the communication control unit 303, and the data processing unit 302. Audio data is output from the speaker 306. The audio data is processed by the data processing unit 302 via the microphone 307 and sent to the communication control unit 303 as transmission data. Then, the transmission data is transmitted to the communication partner via the transceiver 304. A memory 321 as a storage medium is used for temporarily storing data or storing an application. Reference numeral 323 denotes a battery which can be charged. The applications stored in the memory 321 include program products having instructions (program codes) for realizing the operations described with reference to FIGS.

  That is, this apparatus has a program stored in a storage medium readable by the control unit, and this program is an instruction for specifying a scene with a moving image displayed on a display by a user operation, the specified Instructions for transmitting information related to the scene to the server, instructions for receiving a tag list created based on the information related to the scene from the server, and the video played based on the tag list Instructions for displaying a moving image program including The present invention also includes a storage medium storing the above program (in which the instructions are described).

  The portable terminal 1100 includes a data transfer unit 327 and an image processing unit 328. As described with reference to FIGS. 4 and 5, the data transfer unit 327 operates when the mobile terminal 1100 performs mutual communication with the video playback device 1200 and the server 1300. The data transfer unit 327 can make a program information request, a program playback request, a pause request, a playback time request, a tag list transfer, a tag list playback request, and the like to the video playback device 1200. Further, the data transfer unit 327 can make a tag list request to the server 1300. Also, it operates when transmitting program information, reproduction time information, selection information, etc. to the server 1300. The image processing unit 328 operates when creating scene feature information.

  In addition, the mobile terminal 1100 can download content or an application via the Internet. In addition, the downloaded content or application can be transferred to the video playback device based on the control of the data transfer unit 327. In this case, the mobile terminal 1100 functions as a repeater in appearance. Since the data amount of the reproduction program transmitted from the television receiver is a relatively large amount for the portable terminal 1100, the portable terminal 1100 functions as a monitor without saving the reproduction program.

  Further, the portable terminal 1100 can request the recording device or the television receiving device for the image data of the program guide, the reproduction data of the content, and the control screen data for controlling the recording device or the television receiving device. . The control screen data includes, for example, data of a menu screen, an image quality adjustment (resolution, brightness, etc.) screen, a color adjustment screen, and a volume adjustment screen. When acquiring the control screen, the user can give various adjustment inputs of the television receiver via the touch screen of the portable terminal. The adjustment data such as the adjustment level can be stored in the memory 321 and can be used for the next adjustment. For example, the adjustment data can be adjusted for other television receivers registered for use. It is also possible to provide data.

  The portable terminal 1100 includes a camera 308, and can process the captured image data with the image processing unit 328 and send the processed image data to a recording device or a television receiver.

  FIG. 7 shows a configuration example of the moving image playback apparatus 1200 (recording apparatus and / or television receiving apparatus). The moving image playback apparatus 1200 includes a plurality of tuners 102A, 102B, and 102C that receive, for example, scrambled digital terrestrial broadcast signals. The tuner 111 is, for example, a tuner for receiving BS / CS digital broadcasts. Although four tuners are shown in the figure, it goes without saying that additional tuners may be added.

  Broadcast program signals received by the tuners 102A, 102B, 102C, and 111 are input to the TS processing unit 122 functioning as a re-multiplexing unit, and TSs (Transport Streams) of a plurality of channels (CH) are re-converted into one TS. Is multiplexed.

  In the TS output from the TS processing unit 122, TS packets of a plurality of channels are time-division multiplexed. Therefore, for example, in the case of 4CH input, the TS processing unit 122 outputs a multiplexed TS by time-division multiplexing the packet arrangement at a rate five times the input. The control information packet is embedded in the packet array of the multiple TS. The control information packet carries control information such as time stamp information and packet arrangement order information of channel packets for each multiplexed channel.

  The TS re-multiplexing method is not limited to the method described here, and various methods are possible. The TS remultiplexed by the TS processing unit 122 is sent to the TS separator 123. The TS separator 123 generates an ECM (Entitlement Control Message) that is encrypted information from a broadcast program signal, and an EIT (Event Information Table) that is a table describing event information such as a program name, performer, and start time. To separate. Also, EPG (Electric Program Guide) information and the like are separated and supplied to the control device 200. The broadcast program TS is sent to the program TS processor 124.

  In the program TS processor 124, descrambling or the like is performed on the program stream related to the pay program. A key for descrambling is generated by the control device 200. The control device 200 generates a key by using information included in the ECM, contract information in the memory 165, and the like. The program stream related to the free program passes without being descrambled.

  The program TS output from the program TS processor 124 is supplied to the selector 125 and the recording / playback controller 141. The selector 125 selects a TS of a program that the user intends to view and supplies the selected TS to the AV decoder 126. Video data included in a video packet in the program TS is encoded by, for example, a moving picture expert group (MPEG) method, an advanced video coding (AVC) method, or the like. The audio data in the audio packet is encoded by, for example, a PCM (Pulse Code Modulation) method, a Dolby (registered trademark) / (Dolby (registered trademark)) method, an MPEG method, or the like. The AV decoder 126 separates the video packet and the audio packet of the program, and decodes the data in each packet according to each method.

  The decoded audio data is connected through a speaker system (for example, a speaker provided integrally with the display 130 or an AV (Audio / Video) amplifier device) after the volume and sound quality are adjusted by the audio processor 127. Supplied to an external speaker). The decoded video data is supplied to the display unit 130 after the display processor 128 adjusts the image quality, hue, display scale, number of lines, resolution, and the like. Control data for the audio processor 127 and the display processor 128 is given from the control device 200.

  The recording / reproducing controller 141 supplies the program TS from the program TS processing unit 124 to the hard disk driver 142 and / or the semiconductor memory (memory card) M attached to the disk recording / reproducing device 143 or the reader / writer 147. it can. The hard disk driver 142 is always connected to the recording / playback controller 141, and can record the received broadcast programs of a plurality of channels for one to two months, for example. The disk recording / reproducing apparatus 143 can reproduce a removable disk such as a DVD or a BD, or perform signal recording on the disk. The disc recording / reproducing apparatus 143 is connected to the recording / reproducing controller 141 via a network (home network) 145 and a modem 146, and can also function as a home server. The reader / writer 147 is an arbitrary number of broadcast programs held in a semiconductor memory (memory card) M to be mounted and / or video and / or audio recorded by an external device (hereinafter also abbreviated as contents). Can be supplied to a removable disk prepared in the disk recording / reproducing device 143 or a hard disk controlled by the hard disk driver 142 through the recording / reproducing controller 141. In addition, broadcast programs and / or contents held by a hard disk or a removable disk can be held (recorded) within a predetermined condition range.

  The video camera 144 can capture an image of the viewer who views the display 130 and the surrounding area. The imaging signal can be managed by the control device 200 for storage / reproduction / monitoring.

  The control device 200 will be described with reference to FIGS. A moving image playback apparatus 1200 equipped with this information control apparatus 200 can provide the mobile terminal 1100 with the program information described with reference to FIGS. In this case, the moving image playback apparatus 1200 can provide the mobile terminal 1100 with program information based on the recommended program information. For this reason, the user can easily specify program information of a program of interest from among many programs.

  The control device 200 includes an EPG data processing unit 201. The EPG data processing unit 201 uses EPG data relating to past, present, and future programs, and has already been stored in the hard disk driver 142. It is possible to connect and manage program guides related to (about one month) programs.

  Further, the EPG data processing unit 201 can add viewer or user-specific information to the EPG data. The user-specific information is information indicating that, when a certain broadcast program is a movie, the user has purchased or ordered a DVD or BD containing the movie. In addition, when a certain broadcast program is recorded with an orchestra concert, the information includes information such as having purchased an appreciation ticket for the orchestra concert. These pieces of information are information collected by the data collection / correction value generation unit 211. The EPG data is used as the program information described above.

  Furthermore, the control device 200 includes a communication control unit 202. The communication control unit 202 controls input / output data of the transceivers 161 and 162 and the remote control receiver 164 connected to the control device 200.

  The transceiver 161 is connected to the network NTW, and can be connected to a server on the Internet, for example. The transceiver 162 is for short-range wireless communication and can communicate with the portable terminal 1100 via the antenna 163. The transceiver 162 can also communicate with the portable terminal 1100 via a repeater (access point). The transceiver 162 may be either wireless or wired when connected to a repeater.

  The remote control transceiver 164 can accept an operation signal from the remote controller 174. The operation signal is analyzed by the operation command reflecting unit 204. The control device 200 can reflect the operation according to the operation signal in the system.

  In the present embodiment, the operation signal can also be given from the mobile terminal 1100 to the control device 200 via the transceiver 162.

  As described above, the mobile terminal 1100 can access the server via a base station, the Internet, or the like. It is possible to download various applications and game software as well as contents provided by the server and transfer them to the control device 200 via the transceiver 162. In the control device 200, when content, an application, or game software is transferred from the mobile terminal 1100, the communication control unit 202 operates. When content (for example, a moving image) has been transferred, the communication control unit 202 provides the received content to the recording / playback controller 141. The recording / playback controller 141 can cause the hard disk driver 142 to record the received content (moving image). In the hard disk driver 142, the content is managed as a content file. When an application or game software (updated version or new application or game software) is transferred from the mobile terminal, the communication control unit 202 provides the received application or game software to the recording / playback controller 141. . The recording / reproducing controller 141 can cause the hard disk driver 142 to record the received application or game software. In the hard disk driver 142, applications and game software are managed by application files and game software files.

  The types and versions of applications and game software are also managed by the application management unit 205 in the control device 200. When the menu of the application and game software is displayed, the data of the application management unit 205 is used.

  Menu screen data for display, program guide screen data, and the like are stored and / or managed in the display control unit 203. When menu display and program guide display are performed, menu screen data and program guide screen data are read from the data storage unit (memory or hard disk) based on the control of the display control unit 203, and the display processing unit 128 is displayed. To be supplied. Thereby, the menu screen and the program guide screen are displayed on the display unit 130.

  Display menu screen data, program guide screen data, and the like can also be transmitted to the mobile terminal 1100. When the portable terminal 1100 requests menu screen data, program guide screen data, etc., the display control unit 203 can transmit menu screen data and program guide screen data. The mobile terminal 1100 can display menu screen data and program guide screen data on the screen of the touch panel, and the user operates the moving image playback apparatus by touching an operation button displayed on the screen of the touch panel. Directives can be given.

  The control device 200 includes a data collection / correction value generation unit 211. The data collection / correction value generation unit 211 is a correction value of a weighting value for a program from various operation data (recording, reproduction, skipping, erasing, dubbing, recording reservation, etc.) generated inside the apparatus and communication data acquired from the outside. Can be generated. The correction value generated by the data collection / correction value generation unit 211 corrects the weight value of the program in the weight value correction unit 212. The corrected weight value is sent to the program pair weight storage unit 213 and stored.

  The weighting value for the program is used when the preference information generation unit 214 generates preference information (recommended program list) for the program. A preference level corresponding to the weighting value is set for the program. For example, program names can be arranged in descending order of weighting values and displayed on the display 130 as a recommended program list. The recommended program list is updated once a day, once every two days, or once every three days. The recommended program list can be transferred to the mobile terminal and displayed on the display of the mobile terminal in response to a request from the mobile terminal. The user can perform a favorite program playback operation on the screen of the mobile terminal.

  The control device 200 includes a camera image / audio processing unit 218. The camera image / audio processing unit 218 can capture image data from the camera 144, for example, and execute various processes according to the application. For example, it is possible to identify the captured face image of the viewer and create a table in which the face image is associated with the program information viewed by the viewer who is the face image. Also, it is possible to capture and analyze audio data from a microphone that is integral with or separate from the camera 144. For example, it is possible to create a table in which program names and scenes are associated when the viewer's voice (laughter) becomes louder.

  Using the above function, for example, if the captured viewer gesture is identified and the tag creation gesture is determined, a tag list can be created based on the program information, time, and scene being viewed. It is also possible to perform analysis by capturing audio data from a microphone that is integral with or separate from the camera 144. Therefore, for example, it is possible to create a table in which program names and scenes are associated with each other by a viewer's voice command. This is not limited to the camera and microphone of the moving image playback apparatus 1200, and the user can similarly instruct the table creation using the camera and microphone of the mobile terminal 1100.

  The control device 200 includes a used device management unit 219. The used device management unit 219 has a used device registration application. For example, the used device registration application can be activated by the remote controller 174. When the use device registration application is activated, when the portable terminal 1100 is operated or the hard disk driver 142 or the disk recording / reproducing device 143 is connected, these can be automatically registered as peripheral devices. Since the mobile terminal 1100 has identification (ID) information, this ID is registered as that of the mobile terminal.

  Further, the data collection / correction value generation unit 211 operates in conjunction with the communication control unit 202 and has a function of detecting a mobile terminal existing in the communication area. When the data collection / correction value generation unit 211 detects a mobile terminal, it can request communication data remaining in the memory of the mobile terminal. The communication data is blog data, mail data, search data, or the like. In addition, trace (history) data obtained by manipulating various contents remains in the memory of the mobile terminal. Such history data includes content identification data. The history data is also collected by the data collection / correction value generation unit 211 as communication data.

  The data collection / correction value generation unit 211 collects user action data related to a program and generates a correction value of a weighting value for the program. User actions can be classified into a machine system (may be referred to as a machine operation system) and a human relationship system (may be referred to as a device crossing system or a social system). The human relationship system also corresponds to a case where a user (mobile terminal) communicates with social media (communication).

  The mechanical system is reserved for recording, scheduled recording, but did not watch (playback) within a certain period (eg within one week), played after recording (pause, fast forward, skip playback, etc.) Including deletion), deletion, and dubbing. This action can be determined by identifying a command signal (instruction) input to the operation command reflection unit 204.

  The data collection / correction value generation unit 211 determines a command signal and generates, for example, the following correction values (points). This will be described with reference to FIG.

A program
When recording is reserved ... + 5
When a scheduled recording is made, but it is not viewed (reproduced) within a certain period of time (for example, within one week) ...- 1
When recorded and played back (including pause, fast forward, skip playback, etc.) or deleted, +1
When dubbing ... +2
Points.

  With respect to this point, that is, the correction value, the weight value correction unit 212 corrects the weight value of the program. The corrected weight value is stored in the program pair weight value storage unit 213. It should be understood that the value of this point is not limited to the value shown here, but is an example. Further, it may be classified finely so that plus points or minus points are generated. If this is collected by statistics, the viewer's preference for the program can be understood in detail.

  Also, viewing history information for the program is collected and stored in the program-to-viewing history management unit 221. The viewing history is stored for one month or two months, for example, and is erased sequentially from the oldest one. In the case of having a viewer (user) recognition function, the viewing history may be classified for each user.

  Next, communication data is also analyzed in the human relationship system, and a correction value of the weighting value is generated. For example, the following points occur.

That is,
The program name, program related information, performer information, etc. were discussed on the blog
... + 3
Program name, program related information, performer information, etc. were included in the search information
... + 3
Shopping information included program name, program related information, performer information, etc. in search information ... +3
Search information includes program name, program related information, performer information, etc. in media playback information such as DVD and BD
... + 3
Point (correction value) occurs.

  Furthermore, as a content purchase example, there is a content purchase example by video on demand (VOD). There are also examples of purchasing content such as CDs, DVDs, editions, and games. In order to collect such purchase histories, for example, Internet access information (information on URL) of a mobile terminal (including a personal computer) is analyzed. By this analysis, various order information and mail order providers (for example, Amazon (registered trademark)) are detected. Such purchase information is effective when detecting content that the user is particularly interested in.

  Therefore, when the purchase information (purchase action) is detected, the highest point (for example, +5) is generated.

  Further, the above table of program pair weight values may be classified for each identification (ID) information of the portable terminal. By performing this classification, it is possible to more accurately generate preference information of an individual who uses the mobile terminal exclusively.

  In addition to the above, a database of performer and actor face image data and their names, a car, a company name, and the like may be provided, and this database may be used. For example, when face image data such as performers and actors is input to the data collection / correction unit 211 from an external portable terminal, it is determined whether the input face image data is registered in the database. When the input face image data is registered in the database, the user may be determined to be highly interested in the program in which the performer or actor appears, and the weighting value of the program may be added. Also in this case, a table of program pair weight values classified for each of a plurality of portable terminals is created. Further, a table of program pair weight values classified for each of a plurality of users and a plurality of portable terminals may be created. A plurality of preference information created based on such classification corresponds to a plurality of users and a plurality of portable terminals.

  As described above, the present embodiment uses information on the mechanical system and human relations as a filtering method.

  Generally, about 20% say that they like a program because they like it. About 20% of fans for a certain program. Filtering by the above-described mechanical system is suitable for estimating the preference of this type of viewer.

  However, on the other hand, about 80% of people have no purpose and often leave the television receiver turned on. For example, there are many cases where a television receiver is turned on and a program is displayed during housework, during work, or when the family is full. To estimate the preference of this type of people, mechanical filtering is not optimal.

  Therefore, in the above-described embodiment, attention is paid to the fact that user actions are dispersed. That is, the user's true preference cannot be estimated only by the user's action on a certain device (for example, a television device in the home). In other words, the user's action is not performed only on the certain device.

  A user may communicate with social media and talk about a program name, a performer name, or the like.

  Therefore, in the above embodiment, communication data is taken in and key data is extracted from this data. Next, data related to the program (program name, program performer name, performer face image data, program related information) is detected from the key data. The program related information is, for example, a broadcasting station name, a channel number, a broadcasting time zone, and the like. This is because when data related to a program is detected, it can be assumed that the user is actively interested in the program. Thereby, a user's palatability is emphasized by communication data. As a result, this leads to relatively restrained preference (preference that tends to be emphasized by the mechanical system) due to the act of the user watching the broadcast program without any purpose.

  In the above example, data of a machine system (machine operation system) and a human relation system (device crossing system or social system) are handled in parallel. However, the present invention is not limited to such a data processing method. When there is a program handled by a machine system among a plurality of programs detected by a human relationship system, a process of increasing the weighting value may be added.

  There are various data classification methods, and the present invention is not limited to the above-described classification methods. For example, you may classify | categorize by the relationship of whole data, historical data, and preference data. “Overall data” is, for example, all information on the Internet, and is data acquired from program information, blogs, tweets, Internet news, and the like. “History data” is data generated by a user's action, and is generated depending on which program has been played back, recorded, and on which program the media has been purchased. Here, the preference data is obtained by assigning weight values to programs corresponding to the key data in the “history data”. Also in this case, human relationship information is used.

  The apparatus of the present disclosure is not limited to the above-described embodiment. The camera image / audio processing unit 218 can identify the captured face image of the viewer and create a table in which the face image is associated with the program information viewed by the viewer who is the face image. Also, it is possible to capture and analyze audio data from a microphone that is integral with or separate from the camera 144. Therefore, it is possible to create preference information for each viewer.

  However, when a plurality of viewers are detected, common preference information can be created. In addition, when the viewer's voice is recognized and laughed out loud, an additional point of the program being viewed may be generated.

  The data collection / correction value generation unit 211 can generate a correction value of the weighting value according to the collected data. However, there is a case where the collection value is not accepted and a correction value of the weighting value is not generated. In order to obtain this operation, key data (keywords) for rejecting acceptance is registered in advance from the portable terminal. The key data for rejecting acceptance is, for example, data that violates public order and morals, and is stored in the data collection / correction value generation unit 211.

  The special program registration unit 223 is used when the user wants to leave program information of a special program, or when the user wants to increase the priority of program information consciously. A special program is a program (for example, a memorial program or a program in which the user has appeared) that the user wants to set long-term storage (deletion prohibited). The program information of the special program registration unit may be sent to the mobile terminal 1100 as a special tag list creation candidate.

  In the above description and claims, when means are used, “means” can be replaced with “device”, “container”, “block”, and “module”, and it is of course within the scope of the present invention. Furthermore, in each constituent element of the claims, even when the constituent element is expressed in a divided manner, when a plurality of constituent elements are expressed together, or when they are expressed in combination, they are within the scope of the present invention. Even when the claims are expressed as a method, the apparatus of the present invention is applied.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

  102A, 102B, 102C, 111 ... tuner, 122 ... TS processor, 123 ... TS separator, 124 ... program TS processor, 125 ... selector, 126 ... AV decoder, 127 ... Audio processor, 128 ... Display processor, 130 ... Display, 141 ... Recording / playback controller, 142 ... Hard disk driver, 143 ... Disk recording / playback device, 144. ..Camera, 145 ... Home network, 146 ... Modem, 161,162 ... Transmitter / receiver, 200 ... Control device, 201 ... EPG data processing unit, 202 ... Communication control unit , 203 ... Display control unit, 204 ... Operation command reflection unit, 205 ... Application management unit, 212 ... Data collection / correction value generation unit, 212 ... Weight correction section, 213... Program pair weight value storage section, 214... Preference information generation section, 218... Camera image processing section, 219. Management unit, 223... Special program registration unit.

Claims (13)

An electronic device as a mobile terminal
The scene with the video displayed on the display is identified by user operation,
Sending information related to the identified scene to a server;
A tag list created based on information related to the scene is received from the server,
An electronic device control method for displaying a moving image program including the moving image reproduced by a moving image reproducing device based on the tag list.   The method according to claim 1, wherein the information related to the scene is outline information of an image forming the scene or program information of the moving image including the scene.   The method of controlling an electronic device according to claim 1, wherein the tag list received from the server is of a plurality of types.   The electronic device control method according to claim 3, wherein the electronic device receives selection of a tag list from a user when a plurality of tag lists are received.   The method of controlling an electronic device according to claim 1, wherein the tag list received from the server is a tag list related to a background included in the scene or an image different from the background.   The electronic device control method according to claim 1, wherein the tag list relating to an image different from the background is a plurality of tag lists relating to a plurality of images.   The electronic device control method according to claim 1, wherein a command by a gesture or voice is used as the user operation. Means for identifying a scene with a moving image displayed on a display by a user operation;
Means for transmitting information relating to the identified scene to a server;
Means for receiving from the server a tag list created based on information related to the scene;
An electronic apparatus having means for displaying a moving image program including the moving image reproduced by the moving image reproducing device based on the tag list.   9. The electronic apparatus according to claim 8, further comprising means for processing information related to the scene as contour information of an image forming the scene or program information of the moving image including the scene.   The electronic device according to claim 8, further comprising means for capturing a command by gesture or voice as the user operation. A program stored in a storage medium readable by the control unit,
This program includes instructions for specifying a scene with a moving image displayed on the display by a user operation,
Instructions for sending information relating to the identified scene to a server;
Instructions for receiving from the server a tag list created based on information related to the scene;
An instruction for displaying an animation program including the animation reproduced based on the tag list.   12. The information related to the scene includes instructions for processing the contour information and / or program information, which is contour information of an image forming the scene or program information of the moving image including the scene. The electronic device program described.   The electronic device program according to claim 10, wherein the user operation includes an instruction corresponding to a gesture or a voice.

Images