JP2012203549A - Content reproduction device, content reproduction method, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a content reproduction device or the like which is excellent in operability and, when a user wants to display a part of a content in a magnified manner, enables the user to rapidly specify the desired part.SOLUTION: A content reproduction device comprises association means and reproduction means. The association means refers to priority order of a plurality of characteristic parts included in a content to generate association information individually associating each of characteristic parts with each of predetermined operation keys of an input device included in the content reproduction device according to the priority order. In response to the detected operation key while displaying the content, the reproduction means reproduces the characteristic part corresponding to the operation key in a magnified display manner according to the association information.

Description

  The present invention relates to a content reproduction technique in a content sharing service for sharing content such as a photograph (still image) or a moving image between, for example, a terminal and another terminal.

  In accordance with the recent development of communication network technology, various services that perform two-way interactive communication with others at a distant place have become widespread. Among such various services, according to the so-called content sharing service, still images (photos), videos, document materials, etc., between other terminals used by other persons in the distance and the own terminal used by oneself. It is possible to communicate with each other while sharing various contents in real time. As an example of such a technique, Patent Document 1 discloses a technique for sharing / synchronizing content information among a plurality of users. Patent Document 2 discloses a technique for storing a display control operation history of video content and performing communication between a plurality of users in real time using the history. Patent Document 3 discloses a technique for displaying an image in which a predetermined area is enlarged on each terminal in accordance with an instruction operation by a user.

  When communicating between a plurality of terminals (information processing devices), for example, the control of images displayed on individual terminals for information sharing, and among such controls, for example, enlarge the feature location in the image that is the center of the topic Various ideas are necessary to display in this manner.

  By the way, as related technologies existing prior to the application of the present application, there are, for example, the following patent documents.

  That is, Patent Document 4 discloses a display control apparatus capable of enlarging / reducing a display screen in response to pressing of an enlarge button in a manual mode.

  Patent Document 5 discloses a technique in which content information has a plurality of feature points (feature regions) and a technique for enlarging and displaying a partial image based on these feature points.

  Patent Document 6 discloses an imaging apparatus capable of recording the position coordinates of a subject calculated at the time of photographing together with a photographed image.

  Patent Document 7 discloses a technique for recording a focus detection point and focus detection data at the moment when an image is captured in a captured image and making the data available to the user.

JP 2010-1114639 A JP 2005-236462 A JP 2008-040703 A JP 07-271505 A JP 2008-160427 A JP 2005-012307 A JP 2010-117680 A

  When a user uses a mobile terminal such as a mobile phone when using the content sharing service, the user interface (man machine interface) is limited. The operability of the operation to be instructed becomes a problem. In particular, this problem becomes prominent in a mobile terminal using physical operation keys provided on a terminal, unlike a so-called smartphone that can recognize a touch gesture on a screen by a user. That is, there are many cases where an unintended portion of the user is enlarged and displayed only by operating an operation key for instructing enlargement. Also, for example, in Patent Document 4, when a user desires an enlarged display, the user designates the desired part by combining the operations of predetermined operation keys for designating up, down, left, and right to designate the desired part. However, in order to specify the desired location by the user interface described in Patent Document 4, it is necessary to repeat key operations while looking at a small display screen, which is troublesome. Furthermore, in the case of such a user interface, the enlarged image often falls outside the range of the desired location. For this reason, the user is confused about the determination of the positional relationship between the enlarged image and the location he / she desires to enlarge.

  As described above, when a portable terminal using a physical operation key provided on the terminal is used for the content sharing service, operability and convenience are problematic. In particular, when sharing content such as photos during communication, a user of a mobile terminal having the above-described user interface needs to interrupt the conversation for a long time in order to obtain an enlarged image of a point of interest to be discussed. Therefore, comfortable communication with the other party is hindered.

  SUMMARY OF THE INVENTION The present invention has as its main object to provide a content playback apparatus that can quickly specify a location desired by a user when a part of content is enlarged and displayed, and has excellent operability.

  In order to achieve the above object, a content reproduction apparatus according to the present invention has the following configuration.

That is, the content reproduction apparatus according to the present invention is
By referring to the priority order between the characteristic locations that are targeted for a plurality of feature locations included in the content, the individual operation keys according to the priorities are assigned to the predetermined operation keys of the input device included in the device. An associating means for generating associating information for individually associating feature points;
According to the operation key detected at the time of displaying the content, according to the association information, a feature portion corresponding to the operation key is reproduced in an enlarged display mode.

For example, the reproduction means
In the content being displayed, the priority order is displayed so as to be superimposed on the feature location in a display mode in which individual priority orders can be discriminated.

In another aspect of the present invention, the reproducing means includes
The priority order is displayed together with the content being displayed or on a separate screen in a display mode in which the correspondence relationship with the feature location can be determined.

  This object can also be achieved by a content reproduction method corresponding to the content reproduction apparatus having the above-described configurations.

  The object can also be achieved by a content reproduction apparatus having the above-described configurations and a corresponding method by a computer program realized by a computer, and a computer-readable storage medium storing the computer program. Is done.

  According to the present invention described above, when a part of content is enlarged and displayed, it is possible to quickly specify a location desired by the user, and it is possible to provide a content reproduction apparatus with excellent operability.

It is a block block diagram of the content reproduction apparatus which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the reproduction | regeneration processing which the content reproduction apparatus concerning the 1st Embodiment of this invention performs. It is a block diagram which illustrates the hardware constitutions of the portable terminal employable in the 2nd Embodiment of this invention. It is a block diagram which shows the function structure for the image reproduction of the portable terminal which concerns on 2nd Embodiment. It is a figure which illustrates the system configuration which can be adopted when applying personal digital assistant 50 concerning a 2nd embodiment to a content share service. It is a flowchart which shows the content reproduction process which the portable terminal 50 which concerns on the 2nd Embodiment of this invention performs. It is a figure which illustrates typically the external shape of the portable terminal employable in the 2nd Embodiment of the present invention. In 2nd Embodiment of this embodiment, it is a figure which illustrates notionally the correlation information 14 which the priority determination part 18 of the portable terminal 50 produces | generates. In the second embodiment of the present embodiment, it is a diagram illustrating a display mode that is displayed when the playback unit 12 of the mobile terminal 50 executes the content playback processing. In the second embodiment of the present embodiment, it is a diagram illustrating another display mode that the playback unit 12 of the mobile terminal 50 displays when executing the content playback process. In the second embodiment of the present embodiment, it is a diagram illustrating a display mode including an enlarged image displayed by the playback unit 12 of the mobile terminal 50 when executing the content playback process. FIG. 10 is a diagram illustrating an example of displaying information written (edited) by the playback unit 12 of the portable terminal 50 for the content sharing service when executing the content playback process in the second embodiment of the present embodiment. . In 2nd Embodiment of this embodiment, it is a figure which illustrates the display example of the text information which the reproducing part 12 of the portable terminal 50 handles, and the information written for content sharing service. In the second embodiment of this embodiment, it is a figure which illustrates the user interface which the priority determination part 18 provides for the setting of a priority. It is a figure explaining the moving image which the reproducing part 12 of the portable terminal 50 displays in the 3rd Embodiment of this invention. It is a flowchart which shows the priority determination process which the priority determination part 18 of the portable terminal 50 performs in the 3rd Embodiment of this invention.

  Next, embodiments of the present invention will be described in detail with reference to the drawings.

<First Embodiment>
FIG. 1 is a block diagram of a content reproduction apparatus according to the first embodiment of the present invention. The content reproduction apparatus 1 includes an association unit 11, a reproduction unit 12, and an input device 13.

  The input device 13 includes operation keys such as numeric keys, for example.

  The associating unit 11 refers to the content 15, the characteristic location information 16, and the priority order information 17, so that each input device 13 included in the self-apparatus has an individual operation according to the priority order information 17 for a predetermined operation key. Associate (assign) feature locations individually. Thereby, the associating unit 11 generates the association information 14.

  Here, the feature location information 16 is information regarding a plurality of feature locations included in the content 15. In the present embodiment, the feature location is a feature point or a feature region in the content of interest (the same applies to the following embodiments). The content is presentation material including, for example, still images such as photographs, moving images, texts, Web page content, graphs, illustrations, and the like (the same applies to the following embodiments).

  The priority order information 17 is information representing the priority order between the feature locations represented by the feature location information 16.

  In accordance with the operation key detected when the content 15 is displayed, the reproduction unit 12 reproduces the characteristic portion corresponding to the operation key in an enlarged display mode according to the association information 14.

  FIG. 2 is a flowchart showing a reproduction process performed by the content reproduction apparatus according to the first embodiment of the present invention. The flowchart represents a processing procedure in the case where the above-described association unit 11 and playback unit 12 are realized by a software program executed by a CPU (Central Processing Unit) (not shown in FIG. 1).

  The content reproduction apparatus 1 obtains the content 15, such as image information, the characteristic location information 16, and the priority order information 17 from an external device (not shown in FIG. 1) (step S101).

  In accordance with the priority order information 17 obtained in step S101, the content reproduction apparatus 1 associates each feature location represented by the feature location information 16 with a predetermined number of operation keys in descending order of priority. Thereby, the content reproduction apparatus 1 generates the association information 14 (step S102).

  When the content reproduction apparatus 1 detects the operation of the operation key assigned with the priority in step S102 (YES in step S103), the content reproduction apparatus 1 refers to the association information 14 to detect the detected content 15. The feature portion assigned to the operation key is reproduced in an enlarged display mode (step S104).

  According to the content reproduction apparatus 1 according to the present embodiment as described above, when a part of the content is enlarged and displayed, it is possible to quickly specify a location desired by the user, thereby realizing excellent operability. be able to.

  That is, according to the content reproduction apparatus 1, even when the main apparatus is different from an apparatus that can be directly operated by a user's touch gesture on the screen, and the main operation is performed by a physical operation key, The individual characteristic portions and the operation keys of the own device are associated by the association unit 11. For this reason, the content reproduction apparatus 1 can reproduce quickly and accurately the characteristic portion desired by the user when the reproduction unit 12 performs the enlarged display.

<Second Embodiment>
Next, a second embodiment based on the content reproduction apparatus 1 according to the first embodiment described above will be described. In the following description, the characteristic part according to the present embodiment will be mainly described. At this time, the same reference numerals are assigned to the same configurations as those in the first embodiment described above, and the duplicate description is omitted.

  In the present embodiment, a case will be described in which the content reproduction device 1 described in the first embodiment is applied to a mobile terminal (mobile phone). First, the hardware configuration of the mobile terminal 50 according to the present embodiment will be described.

  FIG. 3 is a block diagram illustrating a hardware configuration of a portable terminal that can be employed in the second embodiment of the present invention. FIG. 7 is a diagram schematically illustrating an outer shape of a mobile terminal that can be employed in the second embodiment of the present invention.

  The portable terminal 50 includes a display 51, an input device (including operation keys 52) 52, an antenna 53, a wireless transmission / reception circuit 54, a speaker 55, a microphone 56, and a control circuit 100. The operation key 52 is a physically existing key, and the form of the key is a plurality of physically existing buttons, a resin sheet having a plurality of regions partitioned by printed characters and numbers, Or it shall include various forms, such as a software button displayed on the sub display which has a touch operation function.

  The control circuit 100 includes a CPU 101, a RAM (Random Access Memory) 102, and a ROM (Read Only Memory) 103. In such a hardware configuration, the CPU 11 controls the overall operation of the portable terminal 50 by executing various software programs while using the RAM 102 as a temporary storage area. And the portable terminal 50 performs the voice call and data communication as a general radio | wireless transmission / reception process by controlling these hardware. Since the operation of the hardware itself for voice communication and data communication can adopt a general method at present, a detailed description in this embodiment will be omitted.

  Furthermore, the portable terminal 50 executes processing unique to the present embodiment described below. FIG. 4 is a block diagram showing a functional configuration for image reproduction of the mobile terminal according to the second embodiment. The mobile terminal 50 further includes a priority order determination unit 18 in addition to the components described in the first embodiment. The priority determination unit 18 obtains image information 15A as an example of the content 15 and feature location information 16 representing a feature location included in the image information from an external device. Note that the image information 15A and the feature location information 16 may be one data set or separate data sets as long as the correspondence between these two types of information can be recognized by an identifier or the like.

  The priority order determination unit 18 generates priority order information (corresponding to the priority order information 17 in the first embodiment) based on the acquired image information 15A and feature location information 16. Here, the external device is, for example, a mobile terminal as a communication partner, a content server operated by a service provider, or the like.

  FIG. 5 is a diagram illustrating a system configuration that can be adopted when the portable terminal 50 according to the second embodiment is applied to a content sharing service. The mobile terminal 50 is connected to another mobile terminal (50) that is different from the mobile device (50) and the user terminal 200 via a general communication network (500) such as a wired and wireless communication line and the Internet. Communication with the content creator 300 and the service provider 400 is possible as appropriate.

  The user terminal 200 is, for example, a personal computer, a portable information processing device, or a so-called smartphone that can recognize a touch gesture. The content creator 300 represents, for example, an information processing apparatus such as a server that is used by a business operator who creates various contents such as image information used in the content sharing service. The service provider 400 is an information processing apparatus such as a server that is operated by an operator that provides a content sharing service or the like to the mobile terminal 50 or the like. The service provider 400 obtains content to be provided from, for example, the content creator 300.

  Next, the operation executed for the mobile terminal 50 to perform enlarged display in the present embodiment will be described with reference to the drawings from FIG.

  FIG. 6 is a flowchart showing content reproduction processing executed by the portable terminal 50 according to the second embodiment of the present invention. The portable terminal 50 starts this content reproduction process in response to detecting a predetermined key operation for instructing enlargement (step S201). In the present embodiment, it is assumed that the predetermined key operation is, for example, an * (asterisk) key, a # (sharp) key, or a combination of a plurality of keys other than numeric keys (0 to 9).

  The priority order determination unit 18 searches for the characteristic location information 16 for the image information 15A obtained from the external device (step S202). Here, the feature location information 16 includes, for example, a recognition result of a face image or a person image, an in-focus position (focus point), information indicating an area designated for image editing, or information written by a user of an external device when sharing content. Various types of information may be used as long as the information can be discriminated by the priority order determination unit 18 such as an area corresponding to, an area larger than a certain size, and the like.

  The feature location information 16 is not obtained from an external device, but the area corresponding to the information written by the user of the portable terminal 50 at the time of content sharing or the priority determination unit 18 itself is based on the image information 15A. Information obtained by general image processing may be used.

  As a result of the search in step S203, the priority order determination unit 18 determines how many characteristic portions exist in the currently focused image (image information 15A) (step S203). When the determination results in step S203 are 0 and 1, the priority order determination unit 18 passes the processing results to the reproduction unit 12. When the determination result of step S203 is two or more, the priority order determination unit 18 advances the process to step S205.

  When the number of feature points obtained from the priority order determination unit 18 is zero, the playback unit 12 displays the enlarged image of a predetermined area at the center of the image of interest on the display 51. It is displayed (reproduced) (step S204). Then, the playback unit 12 ends the display state, for example, when a predetermined time elapses.

  Further, when the number of feature points obtained from the priority order determination unit 18 is one, the playback unit 12 displays (plays back) the one feature point on the display 51 in an enlarged display mode (step S211). Then, the playback unit 12 ends the display state, for example, when a predetermined time elapses.

  If two or more feature locations are detected from the image of interest in step S203, the priority order determination unit 18 calculates the priority order of each feature location (step S205). Thereby, the priority order determination part 18 produces | generates the priority order information 17A. Furthermore, when the mobile terminal 50 uses the content sharing service, in this step, the priority order determination unit 18 may transmit the generated priority order information 17A to the external device via the wireless transmission / reception circuit 54. The reason is that the same priority can be shared for the same image between the external device and the terminal itself.

  Here, a method of calculating the priority (priority) will be described. In the present embodiment, the priority order determination unit 18 obtains the priority P by, for example, the following equation (1).

Priority P = gC * {C * S-fC (t)} + gR * {R * S-fR (t)} + gE * {E * S-fE (t)} + gF * {F * S-fF (t )} (1),
In the above formula (1), each parameter is as follows.

・ C: Write result by content sharing,
・ R: As a result of face recognition or person recognition,
E: Location (area) specified during image processing or image editing,
・ F: In-focus position (focus point)
The parameters C, R, E, and F are fixed values set by one of the user, the service provider, and the content creator. For example, C = 100, R = 50, E = 30, F A predetermined fixed value such as 20 or the like.

T: Elapsed time since the feature location appeared
S: A weight determined in accordance with the size of the feature location, for example, the ratio of the entire area of the moving image or still image (S is large for large feature locations). Since it can be determined that the smaller the feature location, the higher the necessity for enlargement, the value S may be increased as the feature location becomes smaller. As for which idea is adopted, for example, a configuration that can be changed by a user setting or the like for the mobile terminal 50 may be adopted as appropriate.

    FC (t), fR (t), fE (t), fF (t): An increasing function that lowers the priority over time. That is, the increase function may be fC (t1) ≦ fC (t2) if t1 ≦ t2. Most simply, a relationship of fC (t) = fR (t) = fE (t) = fF (t) = t may be employed. If the image information 15A is a still image, the relationship fR (t) = fE (t) = fF (t) = 0 may be employed.

    GC, gR, gE, gF: Coefficients indicating whether each characteristic location exists in the display range and corresponds to the above-described parameters C, R, E, F. Here, the display range is a range of an image displayed on the display 51 at a certain timing (for example, when the user performs an enlargement operation). The parameters gC, gR, gE, and gF are, for example, 1 within the display range and corresponding to each type, and 0 otherwise.

  The various parameters C, R, E, F, and S described above, and the increasing functions fC (t), fR (t), fE (t), and fF (t) are the mobile terminal 50, the user terminal 200, It is sufficient that at least one of the content creator 300 and the service provider 400 can be set. For example, C, R, E, and F are set by the user of the portable terminal 50, and S, fC (t), fR (t), fE (t), and fF (t) are set in advance by the service provider 400. You may employ | adopt the structure to carry out.

  In addition, for example, at least one of the methods described below can be adopted for setting the parameters and the increase function.

・ Entering numbers and expressions directly
-General user interface such as abstract pull-down menu and slide bar (knob), such as low-medium-high, 5-level evaluation, etc.
The priority order may be configured such that, among individual feature locations, the feature location whose priority is to be replaced can be replaced by a general operation such as dragging. Further, the user of the portable terminal 50 may be able to set the number of feature location candidates to be displayed (reproduced) in an enlarged display mode (for example, when using numeric keys, the minimum value is 1 and the maximum value is 10). ).

  In the case of a content sharing service, a plurality of participants participate in the service using the mobile terminal 50, the user terminal 200, or the like. In such a case, the priority order determination unit 18 may perform negotiation such as taking an average value based on the priority order set in the device used by each user.

  The priority order determination unit 18 refers to the priority order (priority P) determined in step S205, and assigns each feature location to a predetermined number of operation keys in descending order of the priority order. Thereby, the priority order determination part 18 produces | generates the correlation information 14 (step S206). The priority order determination unit 18 stores the generated association information 14 in a memory such as the RAM 102.

  FIG. 8 is a diagram conceptually illustrating the association information 14 generated by the priority determining unit 18 of the mobile terminal 50 in the second embodiment of the present embodiment. The example shown in FIG. 8 shows a state in which ten operation keys are assigned (associated) in order of priority.

  The playback unit 12 displays a playback image based on the image information 15A on the display 51, and displays the playback image and the priority order in a superimposed manner by referring to the association information 14 (step S207).

  FIG. 9 is a diagram exemplifying a display mode displayed by the playback unit 12 of the mobile terminal 50 when executing the content playback process in the second embodiment of the present embodiment. In the example shown in FIG. 9, the entire image reproduced based on the image information 15A is displayed over the entire display area of the display 51, and the characteristic portions included in the entire image are indicated by a broken line frame. In this embodiment, the whole image reproduced based on the image information 15A is a frame image generated by a camera function of a digital camera or a mobile terminal. Furthermore, in the example shown in FIG. 9, the corresponding priority order is displayed as a numerical value superimposed on each feature location. In the example of this figure, since there are seven feature locations included in the entire image, an example is shown in which numbers 1 to 7 are assigned to individual feature locations according to the priority order.

  In the example shown in FIG. 9, for convenience of explanation and illustration, the common numerical value is 1 when the correspondence between the numerical value in the priority order and the numerical key is in accordance with the association information 14 illustrated in FIG. 8. The display mode which displays only one is shown.

  FIG. 10 is a diagram for explaining another display mode displayed by the playback unit 12 of the mobile terminal 50 when executing the content playback process in the second embodiment of the present embodiment. In the example shown in FIG. 10, the list display area 51A is displayed in a separate frame from the entire image based on the image information 15A. That is, in the example shown in FIG. 10, the playback unit 12 performs a list display that can determine the correspondence between individual feature locations and priorities together with the entire image being displayed. Note that the display mode illustrated in FIG. 10 is an example, and the reproducing unit 12 may display the list display area 51A on a screen different from the entire image.

  When the reproducing unit 12 is displaying an image on the display 51 as described above in step S207, the reproducing unit 12 detects that any one of the operation keys assigned with the priority is operated (YES in step S208). ), The feature portion corresponding to the detected key operation is enlarged and displayed (step S209).

  FIG. 11 is a diagram illustrating a display mode including an enlarged image displayed by the playback unit 12 of the portable terminal 50 when executing the content playback process in the second embodiment of the present embodiment. In the example shown in FIG. 11, in the display mode shown in FIG. 9 or FIG. 10 described above, the priority is highest, and playback is performed in response to the number key 1 being operated among the plurality of operation keys 52. The part 12 has shown the state which overlapped and displayed the corresponding characteristic location on the said whole image.

  Note that the display mode of the enlarged image in step S209 is not limited to the display mode of FIG. 11, and the playback unit 21 may display the entire display area of the display 51, for example.

  The reproducing unit 12 determines whether or not an enlargement display end operation is performed (step S210). In this determination, for example, when the operation of the predetermined operation key 52 different from the numeric key described above is detected in step S201 (YES in step S210), the reproducing unit 12 ends the above-described series of processes, For example, only the entire image is displayed on the display 51. On the other hand, for example, when no key operation is detected for a predetermined time (NO in step S210), reproduction unit 12 returns the process to step S207.

  As described above, the mobile terminal 50 according to the present embodiment can be applied to the content sharing service. FIG. 12 shows an example of displaying information written (edited) for the content sharing service by the playback unit 12 of the portable terminal 50 in the second embodiment of the present embodiment when the content playback process is executed. FIG. That is, in the example shown in FIG. 12, the information written for the content sharing service (“I stayed at this hotel. The scenery was very good.”) The result recognized by the determination part 18 is represented. In the example shown in FIG. 12, it can be seen that the priority order associated with other feature locations has been updated from 2 to 7 (in this embodiment, the operation key assignment is also from 2 to 7).

  That is, in the present embodiment, the feature location included in the frame image is the result of editing the area corresponding to the result of image recognition (face image recognition, etc.) of the frame image, and the result of editing the image area by writing an arbitrary comment or the like. At least one of them.

  However, the content that can be reproduced by the mobile terminal 50 according to the present embodiment is not limited to image information. FIG. 13 is a diagram illustrating a display example of text information handled by the playback unit 12 of the portable terminal 50 and information written for the content sharing service in the second embodiment of the present embodiment. That is, in the example shown in FIG. 13, document data reproduced as a display screen (estimate) and information written for the content sharing service (comment indicating a mistake) are recognized as characteristic portions, It can be seen that the highest priority is assigned to the information, and the second order is assigned to the document data (the operation key assignment is also 1 to 2 in the present embodiment).

  Note that the above-mentioned arbitrary comment by writing may be written in advance prior to the execution of the content sharing service, or may be written when the service is being executed. Further, the arbitrary comment by writing may be included in advance in the image information (document data) 15A acquired from the external device. That is, in the case of the arbitrary comment, the characteristic portion corresponding to the arbitrary comment represents a position where the data written before or during execution of content sharing with the external device is to be displayed.

  Further, in the present embodiment, the priority order determination unit 18 may have a function for setting a priority order by the user to a feature location desired to be set among individual feature locations. FIG. 14 is a diagram illustrating a user interface provided by the priority order determination unit 18 for setting the priority order in the second embodiment of the present embodiment. That is, in the example shown in FIG. 14, the priority order determination unit 18 of the mobile terminal 50 displays a message on the display 51 that prompts the user of the terminal to set the priority order. In the example illustrated in FIG. 14, among the individual characteristic portions indicated by the broken line frame, the highest priority order is set for the face image, and then the bicycle indicated by the thick line frame to set the second priority order. Is selected by the user, and a numerical value “2” representing the second priority order is set. In this user interface, the user only needs to set the priority order for the desired feature location, and does not need to set the priority order for all feature locations individually.

  According to the portable terminal 50 according to the present embodiment, when the part of the content is enlarged and displayed, the portion desired by the user can be quickly displayed in the same manner as the content playback device 1 according to the first embodiment. Therefore, excellent operability can be realized. Moreover, according to the portable terminal 50, since the priority determination part 18 is provided, a priority (priority information 17A) can be set with an own terminal. That is, according to the mobile terminal 50 according to the present embodiment, it is possible to set the priority order according to the preference of the user of the own terminal. According to the portable terminal 50, as described above, for example, by providing the priority order information 17A to an external device that provides a content sharing service, content sharing such as images with the external device can be performed smoothly. It can be carried out.

(Modification of the second embodiment)
Based on the above-described second embodiment, a modification described below can be realized. Also by such a modification, the same effect as 1st and 2nd embodiment can be enjoyed.

  In other words, in the first modification, the playback unit 12 erases the display of the characteristic portion displayed in the display mode enlarged as the predetermined time elapses on the display screen in the display mode illustrated in FIG. When the specific operation key different from the operation key used for instructing enlargement (numerical key 1 in the example of FIG. 11) is operated, The feature location that was displayed last is displayed again in the same display mode or in a further expanded display mode. According to such a first modification, the convenience of the portable terminal 50 can be further improved.

  In the second modification, the priority order determination unit 18 has elapsed time since the appearance of a specific feature location (for example, highest priority order, human face image, etc.) in the screen displayed on the display 51. Change the priority order according to. According to the second modification, for example, even when the priority order automatically set by the own terminal or the external device does not match the preference of the user of the own terminal, the priority order is set after the predetermined time has elapsed. Be changed. Therefore, the convenience of the portable terminal 50 can be further improved.

  In the third modified example, the priority order determination unit 18 changes the priority order in accordance with the elapsed time after displaying the screen displayed on the display 51 as illustrated in FIGS. 9 to 11. According to the third modification, for example, even when the priority order automatically set by the own terminal or the external device does not match the preference of the user of the own terminal, the priority order is set after the predetermined time has elapsed. Be changed. Therefore, the convenience of the portable terminal 50 can be further improved.

<Third Embodiment>
Next, a third embodiment based on the portable terminal 50 according to the second embodiment described above will be described. In the following description, the characteristic part according to the present embodiment will be mainly described. In this case, the same reference numerals are assigned to the same configurations as those in the first and second embodiments described above, and redundant description is omitted.

  In the second embodiment described above, the mobile terminal 50 is mainly targeted for still images displayed by the image information 15 </ b> A as the content 15. On the other hand, in this embodiment, the case where the portable terminal 50 reproduces a moving image composed of a plurality of frame images as the image information 15A will be described.

  FIG. 15 is a diagram illustrating a moving image displayed by the playback unit 12 of the mobile terminal 50 in the third embodiment of the present invention. FIG. 16 is a flowchart showing the priority order determination process performed by the priority order determination unit 18 of the mobile terminal 50 in the third embodiment of the present invention.

  That is, in this embodiment, FIG. 15 shows a frame image in which the helicopter appears from the right to the left as shown in FIG. 15B in the landscape image shown in FIG. 15A, and then the helicopter passes. By disappearing from the screen, the landscape image shown in FIG. 15A is displayed on the display 51 again. In such a case, the priority order determination unit 18 determines whether or not a new feature location has occurred or an already recognized feature location has disappeared in the frame image of the moving image being played back (step S301). If the occurrence or disappearance of a feature location is detected in this determination (YES in step S301), the priority order determination unit 18 recalculates the priority order of each feature location included in the frame image of interest. To do. In the present embodiment, a general image processing technique can be adopted for detection of a moving object (a helicopter in the example of FIG. 15) in a frame image, and thus detailed description in the present embodiment is omitted. .

  In other words, in the present embodiment, the priority order determination unit 18 detects a feature portion newly included in the frame image being displayed on the display 51 from the adjacent frame images reproduced based on the image information 15A. Accordingly, the priority order is reset for a plurality of feature locations (three in the example of FIG. 15) including the new feature locations. Generally, as a tendency of human consciousness, there is a tendency that consciousness tends to be directed to an object that has newly entered the field of view. Therefore, in the present embodiment, the highest priority is set for the newly generated feature location.

  Then, in response to detecting that the feature location included in the frame image being displayed on the display 51 is out of the frame image, the priority determining unit 18 excludes the feature location (see FIG. The priority order is reset as 2).

  The associating unit 11 calculates the associating information 14 based on the new priority order. The reproduction unit 12 reproduces the moving image together with information indicating at least one of the priority order and the operation key number while referring to the new association information 14.

  Note that the priority recalculation processing by the priority determination unit 18 according to this embodiment is applied not only to moving images but also to various contents 15 such as still images and document data described in the second embodiment. Is possible. In this case, the priority order determination unit 18 recalculates the priority order in response to detecting the occurrence and disappearance of characteristic portions in the target content. In this case, the associating unit 11 calculates the associating information 14 based on the new priority order.

  Moreover, each modification which concerns on 2nd Embodiment mentioned above is applicable also to 3rd Embodiment.

  According to such a portable terminal 50 according to the present embodiment, as in the first and second embodiments, when a part of the content is enlarged and displayed, a user-desired portion is quickly designated. And excellent operability can be realized. In addition, since the mobile terminal 50 according to the present embodiment includes the priority order determination unit 18 that sets the priority order for moving images, the priority order (priority information 17A) that matches the tendency of human consciousness is provided. Can be set. According to the portable terminal 50, as described above, for example, by providing the priority order information 17A to an external device that provides a content sharing service, content sharing mainly with moving images with the external device is performed. Can be performed smoothly.

  The present invention described with reference to the first to third embodiments described above is a computer program capable of realizing the functions of the flowcharts (FIGS. 2, 6, and 16) referred to in the description. This is achieved by supplying the content reproduction apparatus 1 shown in FIG. 3 to the portable terminal 50 (FIG. 4) whose hardware configuration is illustrated in FIG. 3 and then reading the computer program to the CPU (101) and executing it. . Further, the computer program supplied to the content reproduction apparatus 1 and the portable terminal 50 may be stored in a readable / writable temporary storage memory (102) or a storage device (storage medium) such as a hard disk device or a nonvolatile memory (not shown). good.

  In the above case, the computer program can be supplied to the apparatus by installing it in the apparatus via various recording media such as a memory card or by downloading from the outside via a communication line such as the Internet. The general procedure can now be adopted, such as the method of doing so. In such a case, the present invention is configured by a computer program code or a storage medium storing the code.

  In each of the above-described embodiments, the configuration in which the present invention is applied to a content reproduction device applied to a so-called content sharing service has been described as an example. However, the present invention is not limited to such a configuration, and can also be applied to the case where only the user himself / herself uses the content reproduction apparatus without sharing the content with the other party.

DESCRIPTION OF SYMBOLS 1 Content playback apparatus 11 Association part 12 Playback part 13 Input device 14 Association information 15 Content 15A Image information 16 Feature location information 17, 17A Priority information 50 Portable terminal 51 Display 51 List display area 52 Operation key 53 Antenna 54 Wireless transmission / reception circuit 55 Speaker 56 Microphone 100 Control circuit 200 User terminal 300 Content creator 400 Service provider 500 Communication network

Claims (25)

By referring to the priority order between the characteristic locations that are targeted for a plurality of feature locations included in the content, the individual operation keys according to the priorities are assigned to the predetermined operation keys of the input device included in the device. An associating means for generating associating information for individually associating feature points;
A content reproduction apparatus comprising: reproduction means for reproducing, in an enlarged display manner, a characteristic portion corresponding to the operation key according to the association information in accordance with the operation key detected when the content is displayed. The reproducing means includes
2. The content reproduction apparatus according to claim 1, wherein the priority order is displayed in the content being displayed so as to be superimposed on the feature portion in a display mode in which individual priority orders can be discriminated. The reproducing means includes
2. The content reproduction apparatus according to claim 1, wherein the priority order is displayed together with the content being displayed or on a separate screen in a display mode in which a correspondence relationship with the characteristic portion can be determined. The reproducing means includes
When any of the operation keys is operated while the priority order is displayed for a predetermined time, the characteristic portion corresponding to the operated operation key is reproduced in an enlarged display mode.
The content reproduction apparatus according to claim 1, wherein the content reproduction apparatus is a content reproduction apparatus. The reproducing means includes
After erasing the reproduction of the enlarged display mode as the predetermined time elapses, the last display was performed in the enlarged display mode in response to the operation of a specific operation key different from the operation key. 5. The content reproduction apparatus according to claim 4, wherein the characteristic portion is displayed again in the same display form or in a further enlarged display form. The content playback device is a device having a plurality of physical keys,
The content according to any one of claims 1 to 5, wherein the associating unit associates the characteristic portions individually according to the priority order with respect to at least numeric keys among the plurality of physical keys. Playback device. The content according to any one of claims 1 to 6, wherein the content is a frame image, and the characteristic portion is information indicating a focus area pre-associated with the frame image. Playback device. The content playback apparatus according to claim 1, wherein the feature location is at least one of a feature point and a feature region included in the content. The content is a frame image, and the characteristic part is at least one of a region corresponding to a result of image recognition of the frame image and a result of editing the image region. Item 9. The content playback device according to any one of Items 8 to 10. 10. The feature location according to claim 1, wherein the feature location is a position at which data written prior to or during execution of content sharing with an external device is to be displayed. The content reproduction apparatus described in 1. 11. The content reproduction apparatus according to claim 1, further comprising priority order setting means for setting a priority order with respect to individual characteristic portions included in the content. The content is a moving image composed of a plurality of frame images,
The priority order setting means includes:
In response to detecting a feature location newly included in the frame image being displayed among adjacent frame images, the priority order is set for the plurality of feature locations including the new feature location. While resetting,
The priority order is reset from the feature location as a target in response to detecting that the feature location included in the frame image being displayed is out of the frame image. Item 12. The content playback device according to Item 11. The priority order setting means includes:
12. The content reproduction apparatus according to claim 11, wherein the priority order is changed in accordance with an elapsed time after a specific characteristic portion appears in the content being displayed. The priority order setting means includes:
12. The content reproduction apparatus according to claim 11, wherein the priority order is changed according to an elapsed time since the displayed content is displayed. The priority order setting means includes:
The priority order is determined based on the size of the feature location.
The content reproduction apparatus according to claim 11, wherein the content reproduction apparatus is a content reproduction apparatus. The priority order setting means includes:
16. The content reproduction apparatus according to claim 11, further comprising a user interface that allows a user to set the priority order.   17. A content sharing system comprising: the content reproduction device according to claim 1; and at least an external device that shares the content with the content reproduction device via a communication line. A content reproduction device according to any one of claims 1 to 10,
Priority order setting means for setting a priority order for each feature location included in the content;
A content sharing system including at least an external device sharing the content via a communication line with the content reproduction device. By referring to the priority order between the characteristic locations that are targeted for a plurality of feature locations included in the content, the individual operation keys according to the priorities are assigned to the predetermined operation keys of the input device included in the device. Generate association information that associates feature points individually,
In accordance with the operation key detected at the time of displaying the content, a feature location corresponding to the operation key is played in an enlarged display mode according to the association information. 20. The content reproduction method according to claim 19, wherein the priority order is displayed in the content being displayed so as to be superimposed on the feature portion in a display mode in which individual priority orders can be discriminated. 20. The content reproduction method according to claim 19, wherein the priority order is displayed together with the content being displayed or on a separate screen in a display mode in which a correspondence relationship with the feature location can be determined. The content is a moving image composed of a plurality of frame images,
In response to detecting a feature location newly included in the frame image being displayed among adjacent frame images, the priority order is set for the plurality of feature locations including the new feature location. While resetting,
The priority order is reset from the feature location as a target in response to detecting that the feature location included in the frame image being displayed is out of the frame image. Item 22. The content reproduction method according to any one of Items 19 to 21. The content reproduction method according to any one of claims 19 to 21, wherein the priority order is changed according to an elapsed time after a specific characteristic portion appears in the content being displayed. The content reproduction method according to any one of claims 19 to 21, wherein the priority order is changed in accordance with an elapsed time since the displayed content is displayed. A computer program for controlling the operation of the content playback apparatus, the computer program,
By referring to the priority order between the characteristic locations that are targeted for a plurality of feature locations included in the content, the individual operation keys according to the priorities are assigned to the predetermined operation keys of the input device included in the device. An association function for generating association information for individually associating feature points;
According to the operation key detected at the time of displaying the content, the computer realizes a reproduction function for reproducing the characteristic portion corresponding to the operation key in an enlarged display mode according to the association information. ·program.

Images