JP2012128766A - Information processing apparatus, information processing system, information processing method, and television receiver - Google Patents

Abstract

PROBLEM TO BE SOLVED: To appropriately specify an instruction position, even when a plurality of people are included in a captured image.SOLUTION: An information processing apparatus includes: an image acquisition part 41 for acquiring an image in which an indicator for indicating a position and an operator holding the indicator are captured; an operator specification part 44 for, when a plurality of people are included in the image, specifying the operator holding the indicator from the plurality of people; and a position specification part 45 for, on the basis of a position of the specified operator in the image and a position of the indicator in the image, specifying a position instructed with the indicator by the operator.

Description

  The present invention relates to an information processing apparatus, an information processing system, an information processing method, and a television receiver.

  In Patent Document 1, in a computer or game machine, an image of a person or the like located in front of a display screen is acquired by an image acquisition device, the image is analyzed, and the position of the person's head and the person's hand are analyzed. The position of the held object is specified, the relative position between the position of the person's head and the position of the object when observed from the image acquisition device is specified, and the point direction of the object is determined using the relative position. A method for determining and displaying the point direction on a display screen is disclosed.

Special table 2009-515553 US Patent Application Publication No. 2002/0102024

  By the way, in the configuration in which the indication position specified by the operator by the operator is specified based on the position of the operator and the position of the indicator in the captured image, an appropriate indication is given when the image includes a plurality of persons. It is conceivable that the position cannot be specified. For example, there is a possibility that the indicated position is specified based on the position of a person who does not actually hold the indicator (that is, a person who is not the operator), and the correct indicated position cannot be specified.

  Therefore, the present invention provides an information processing apparatus, an information processing system, an information processing method, and a television receiver that can appropriately specify a designated position even when a captured image includes a plurality of persons. The purpose is to provide.

  An information processing apparatus according to the present invention includes an image acquisition unit that acquires an image of an indicator for indicating a position and an operator holding the indicator, and the image includes a plurality of persons. The operator specifying means for specifying the operator holding the indicator from the plurality of persons, the position of the specified operator in the image, and the image in the image. And a position specifying means for specifying a position instructed by the operator based on the position of the indicator.

  In addition, an information processing system according to the present invention includes the information processing device, the indicator, the imaging device that captures the indicator and the operator, and outputs the image to the image acquisition unit. And a display control means for controlling an image displayed on the display device based on the position specified by the position specifying means.

  Further, the information processing method according to the present invention includes a step of acquiring an image obtained by capturing an image of an indicator for indicating a position and an operator holding the indicator, and the image includes a plurality of persons. The operator holding the indicator from the plurality of persons, the position of the specified operator in the image, and the indicator of the indicator in the image. And a step of specifying the position indicated by the indicator by the operator based on the position.

  The television receiver according to the present invention includes a display control for controlling an image displayed on the display device based on the information processing device, a display device for displaying an image, and a position specified by the position specifying means. Means.

  According to the present invention, it is possible to appropriately specify the designated position even when a plurality of persons are included in the captured image.

1 is a block diagram illustrating an example of a configuration of an information processing system in a first embodiment. 1 is a schematic external view showing an example of a configuration of an information processing system in Embodiment 1. FIG. It is a schematic perspective view which shows an example of a structure of an indicator. It is a block diagram which shows an example of a structure of information processing apparatus. It is a figure which shows an example of person detection information. It is a figure which shows an example of the captured image for demonstrating identification of an operator. It is a figure which shows an example of the captured image for demonstrating specification of an instruction | indication position. It is a figure which shows an example of the content displayed on a display apparatus. 6 is a flowchart illustrating an example of a processing procedure of the information processing apparatus related to cursor display in the first embodiment. It is a flowchart which shows an example of the procedure of the process of the information processing apparatus regarding the screen transition based on pressing of a determination button. 11 is a flowchart illustrating an example of a processing procedure of the information processing apparatus related to cursor display in the second embodiment. 11 is a block diagram illustrating an example of a configuration of an information processing device in Embodiment 3. FIG. 15 is a flowchart illustrating a first example of a processing procedure of the information processing apparatus related to cursor display in the third embodiment. 15 is a flowchart illustrating a second example of a processing procedure of the information processing apparatus related to cursor display in the third embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
Embodiment 1 FIG.
FIG. 1 is a block diagram illustrating an example of the configuration of the information processing system 100 according to the first embodiment. FIG. 2 is a schematic external view showing an example of the configuration of the information processing system 100 according to the first embodiment.

  In FIG. 1, the information processing system 100 includes an indicator 11, a light receiving device 12, an imaging device 13, a display device 14, and an information processing device 15. The light receiving device 12, the imaging device 13, and the display device 14 are connected to the information processing device 15 by wire or wirelessly. The light receiving device 12, the imaging device 13, the display device 14, and the information processing device 15 may be physically integrated, or may be separated from each other. In the example of FIG. 2, the light receiving device 12, the display device 14, and the information processing device 15 are housed in a single casing 21 and constitute a television receiver. The imaging device 13 is installed on the top of the housing 21.

  The information processing system 100 specifies a position where the indicator 11 is operated by an operator and the information processing device 15 is indicated by the indicator 11. Specifically, the information processing system 100 causes the information processing device 15 to move to the information processing apparatus 15 by moving the indicator 11 in the real space (specifically, in the predetermined coordinate space). This is a position (or coordinate) input system for inputting coordinates.

  In the example of FIG. 2, persons A and B exist in front of the display screen S of the display device 14, and the indicator 11 is held in the hand of the person A who is an operator. The operator A instructs the position on the display screen S by an operation of moving the indicator 11 in the real space. The information processing device 15 specifies the position indicated by the indicator 11 by the operator A based on the image picked up by the image pickup device 13 and displays the cursor C at the specified position on the display screen S. Therefore, when the operator A changes the spatial position of the indicator 11, the display position of the cursor C on the display screen S moves in accordance with the change in the spatial position of the indicator 11. Further, the indicator 11 is configured to emit light in response to the button operation of the operator A, and the information processing device 15 is configured to operate the button when the light emission of the indicator 11 is detected by the light receiving device 12. It is comprised so that the process according to may be performed.

  Hereinafter, the indicator 11, the light receiving device 12, the imaging device 13, the display device 14, and the information processing device 15 will be described in order.

  The indicator 11 is for indicating a position, and is held and operated by an operator. Specifically, the indicator 11 is for instructing the information processing device 15 of a position in a predetermined space, such as a position on the display screen S.

  Here, the indicator 11 is a remote controller (remote controller) for remotely operating the information processing apparatus 15, and specifically, a television remote controller for operating the television receiver. As shown in FIG. 3, the indicator 11 includes an operation unit 31 and a light emitting unit 32, and is configured such that the light emitting unit 32 emits light in response to an operation on the operation unit 31. Specifically, the operation unit 31 includes a plurality of operation buttons that accept a pressing operation from the operator, and the light emitting unit 32 is previously set with respect to the operation buttons when the operation button of the operation unit 31 is pressed. Blinks in a defined pattern. As an operation button, for example, there is a determination button 31a for determining selection of an item on the display screen S. The light emitting unit 32 includes, for example, a light emitting element such as a light emitting diode, and outputs infrared rays. Further, the indicator 11 includes a light emitting unit 33 that emits light for detecting the indicator in order to facilitate the detection of the indicator 11 by the information processing device 15. The light emitting unit 33 includes, for example, a light emitting element such as a light emitting diode, and outputs infrared rays or visible rays.

  When the light receiving device 12 receives light emitted from the indicator 11 and detects a blinking pattern corresponding to any operation button of the indicator 11, it indicates that the operation button corresponding to the blinking pattern has been pressed. Information (hereinafter referred to as “button input information”) is notified to the information processing apparatus 15.

  The imaging device 13 images the indicator 11 and the operator holding the indicator 11 and outputs the obtained image (specifically, digital image data) to the information processing device 15. When there are a plurality of persons including the operator in the imaging range of the imaging apparatus 13, the imaging apparatus 13 images the plurality of persons including the operator and the indicator 11. For example, in FIG. 2, the imaging device 13 images the indicator 11, the operator A, and the person B. Imaging and image output by the imaging device 13 are repeatedly performed, for example, 30 times per second.

  Here, the imaging device 13 includes a CCD (Charge Coupled Device) element, a lens, and the like, and acquires a grayscale image having a resolution of 320 × 240 pixels. However, the imaging device 13 may use an imaging element other than a CCD element, such as a CMOS (Complementary Metal Oxide Semiconductor) element. Further, the imaging device 13 may acquire a color image instead of a grayscale image. Further, the resolution of the image is not limited to 320 × 240 pixels, and may be a higher resolution or a lower resolution as long as the person and the indicator 11 can be detected. Note that although depending on the angle of view of the imaging device 13, in general, the higher the resolution, the more distant a person can be detected and the spatial resolution of the position specified by the information processing device 15 is improved.

  In the example of FIG. 2, the imaging device 13 is installed so that the front of the display screen S is an imaging range. Specifically, the imaging device 13 is installed on the upper part of the housing 21 so as to face the front of the display screen S so that an operator in front of the display screen S can be imaged. However, the position where the imaging device 13 is installed is not limited to the upper part of the casing 21 and may be a position where the operator can be imaged.

  The display device 14 is a device that displays an image, for example, a liquid crystal display device. The image displayed on the display screen S of the display device 14 is controlled by the information processing device 15.

  The information processing apparatus 15 specifies a position (hereinafter referred to as “indicated position”) designated by the operator 11 based on the image captured by the imaging apparatus 13. In this example, the information processing device 15 controls the content displayed on the display screen S of the display device 14, such as control of the display position of the cursor C, based on the specified indication position. In addition, the information processing device 15 performs predetermined processing such as screen transition of the display screen S in response to a button operation on the indicator 11 detected by the light receiving device 12.

  FIG. 4 is a block diagram illustrating an example of the configuration of the information processing apparatus 15. Hereinafter, an example of the configuration of the information processing apparatus 15 will be described with reference to FIG.

  4, the information processing apparatus 15 includes an image acquisition unit 41, a person detection unit 42, an indicator detection unit 43, an operator specification unit 44, a position specification unit 45, a button input information acquisition unit 46, and a display control unit 47. Have.

  The image acquisition unit 41 acquires an image in which the indicator 11 and the operator holding the indicator 11 are captured. Specifically, the image acquisition unit 41 acquires digital image data captured and output by the imaging device 13. The image acquisition unit 41 outputs the acquired image (hereinafter referred to as “captured image”) to the person detection unit 42 and the indicator detection unit 43.

  The person detection unit 42 detects a person from the captured image acquired by the image acquisition unit 41, and detects the position and size of the person in the captured image. Specifically, the person detection unit 42 detects the center coordinates of the face of the person in the coordinate system of the captured image as the position of the person, and detects the face of the person in the coordinate system of the captured image as the size of the person. The width (specifically, the horizontal width of the face) is detected. However, the person detection unit 42 uses the face length (specifically, the length in the vertical direction of the face), the shoulder width, the distance between both eyes, the position of each eye, and the apex of the head as the position and size of the person. Other information such as the coordinates may be detected. Further, the person detection unit 42 may detect the posture of the person such as an angle with respect to the vertical direction of the face.

  A method for detecting a person in the person detection unit 42 is not particularly limited, and for example, there is a method shown in Patent Document 2 called a viola-Jones method. In summary, the Viola-Jones method sets a small area in an image while changing the position and size of the small area in the image, extracts a feature amount from the small area, and uses the discriminator to extract the small area. It is determined whether or not the area is a face. For example, the person detection unit 42 applies the Viola-Jones method to the captured image, and then determines the center position and face of the face represented by the coordinate axes of the captured image from the position and size of the small area determined to be a face. Can be obtained. In addition, the person detection unit 42 can obtain the rotation angle when the face is rotating in parallel to the imaging surface of the imaging device 13 by applying the Viola-Jones method to the rotated captured image. .

  In a case where a plurality of persons are detected from the captured image, the person detection unit 42 detects the position and size of the person in the captured image for each of the detected plurality of persons.

  The person detection unit 42 outputs person detection information indicating the position and size of the detected person to the operator specifying unit 44. This person detection information may include information indicating the posture of the detected person. FIG. 5 shows an example of person detection information. In FIG. 5, “No.” is a number assigned to the detected person, “x coordinate” and “y coordinate” are the center coordinates of the face of each person, and “width” is the face of each person. The “rotation angle” is an angle with respect to the vertical direction of each person's face. In FIG. 1-No. The case where three persons of 3 are detected is shown.

  The indicator detection unit 43 detects the indicator 11 from the captured image acquired by the image acquisition unit 41, and detects the position of the indicator 11 in the captured image. Here, the indicator detection unit 43 detects a bright spot due to light emission of the light emitting unit 33 of the indicator 11 from the captured image, and detects the center coordinate of the bright spot in the coordinate system of the captured image as the position of the indicator 11. To do. Although the light emission part 33 may always light-emit, in order to make detection of the indicator 11 easier, you may repeat blinking by a predetermined pattern. In this case, the indicator detection unit 43 detects a position where the luminance change occurs in the predetermined pattern based on the series of captured images, and specifies the position as the position of the indicator 11.

  The indicator detection unit 43 outputs indicator detection information indicating the detected position of the indicator 11 to the operator specifying unit 44 and the position specifying unit 45.

  When a plurality of persons are included in the captured image acquired by the image acquisition unit 41, the operator specifying unit 44 specifies an operator holding the indicator 11 from the plurality of persons. Specifically, the operator specifying unit 44 includes information on a plurality of persons in the person detection information based on the person detection information from the person detection unit 42 and the indicator detection information from the indicator detection unit 43. In this case, an operator is specified from the plurality of persons.

  In one aspect, the operator specifying unit 44 specifies an operator as follows. Since the indicator 11 is used by being held by the operator, the position where the indicator 11 exists in the real space is limited within the reach of the operator. Therefore, the indicator 11 exists in the vicinity of the operator in the captured image. Therefore, the operator specifying unit 44 specifies an operator from among the plurality of persons based on the positions of the plurality of persons in the captured image and the position of the indicator 11 in the captured image. Specifically, the operator specifying unit 44 specifies an operator from among a plurality of persons based on the difference between the position of each person in the captured image and the position of the indicator 11. More specifically, for each of a plurality of persons, the operator specifying unit 44 evaluates the difference between the position of the person included in the person detection information and the position of the indicator 11 included in the indicator detection information. The value is obtained, and the person with the smallest evaluation value is specified as the operator. That is, the operator specifying unit 44 specifies, as an operator, a person having the smallest evaluation value indicating the difference between the position of the person in the captured image and the position of the indicator 11 in the captured image among the plurality of persons. .

For example, the operator specifying unit 44 calculates, as an evaluation value, for each person, the Euclidean distance between the position of the person in the captured image and the position of the indicator 11 in the captured image, and the calculated Euclidean distance is The smallest person is identified as the operator. For example, the acquired captured image shown in FIG. 6, the detected position of the two persons P1, P2 If the position P _dev indicators 11 has been detected, the operator specifying unit 44, the position and the position P1 The Euclidean distance L1 between Pdev and the Euclidean distance L2 (<L1) between the position P2 and the position Pdev are calculated, and the person at the position P2 having the smallest Euclidean distance is specified as the operator.

  However, the operator specifying unit 44 does not use the Euclidean distance, but the Manhattan distance between the position of the person and the position of the indicator 11 in the captured image and the horizontal distance (that is, the absolute value of the difference in the horizontal position). Alternatively, other values such as the absolute value of the difference between the x coordinates may be used as the evaluation value.

  Moreover, in another aspect, the operator specific | specification part 44 specifies an operator as follows. When the same person holds the indicator 11 in the same posture, the position of the person (for example, the center position of the face) in the captured image and the indicator 11 increases as the distance from the imaging device 13 to the person in the real space increases. The difference from the position (for example, Euclidean distance) becomes small. That is, the difference between the position of the person in the captured image and the position of the indicator 11 changes according to the distance from the imaging device 13 to the person in real space. Therefore, from the viewpoint of more accurately specifying the operator in consideration of the distance from the imaging device 13 to the person in the real space, the operator specifying unit 44 determines the position of each person and the position of the indicator 11 in the captured image. In addition, the operator is identified based on information representing the distance from the imaging device 13 to each person in the real space (hereinafter referred to as “distance information”). Specifically, the operator specifying unit 44 obtains, for each person, an evaluation value obtained by correcting the difference between the position of the person in the captured image and the position of the indicator 11 with the distance information of the person, and the evaluation value is The smallest person is identified as the operator. In one aspect, the operator specifying unit 44 uses the size of each person in the captured image as the distance information of each person.

  For example, the operator specifying unit 44 uses, as the evaluation value, for each person, a value representing the difference between the position of the person in the captured image and the position of the indicator 11 in the captured image. A value (that is, a quotient) divided by (for example, the width of the face) is calculated, and the person having the minimum value is specified as the operator. As described above, the value representing the difference between the position of the person in the captured image and the position of the indicator 11 in the captured image includes the Euclidean distance, the Manhattan distance, the horizontal distance, and the like.

  When the operator specifying unit 44 specifies the operator, instead of the position of the indicator 11 in the captured image, the average value or the median value of the position of the indicator 11 or the position of the indicator 11 in the most recent fixed period. A half value of the sum of the maximum value and the minimum value may be used. For example, the operator specifying unit 44 records the history of the indicator detection information from the indicator detector 43 for a certain period, and instead of the position of the indicator 11 in the captured image, the instruction for the recorded period is recorded. The average value or median value of the position of the vessel 11 or a half value of the sum of the maximum value and the minimum value may be used. The average value, median value, and half value of the position of the indicator 11 are obtained by, for example, obtaining the average value, median value, and half value of each of the x coordinate and the y coordinate.

  The operator specifying unit 44 outputs information indicating the specified operator to the position specifying unit 45 as the operator specifying result. Here, the operator specifying unit 44 outputs only the information on the specified operator among the information of the plurality of persons included in the person detection information from the person detecting unit 42 to the position specifying unit 45.

  When the operator is not specified, the operator specifying unit 44 may output information indicating that the operator is not specified or information indicating that no operator is present to the position specifying unit 45. For example, when the evaluation value for all persons is equal to or greater than a predetermined threshold, the operator specifying unit 44 does not specify the person who has the smallest evaluation value as the operator, but does not specify the operator. Or information indicating that there is no operator may be output. Note that there are cases where the operator is not specified, such as when the indicator 11 is not held by any person, or when the position of the indicator 11 is detected incorrectly.

  In one aspect, even when there is only one person included in the captured image, the operator specifying unit 44 specifies the operator. Specifically, when the number of persons detected by the person detecting unit 42 is 1, the operator specifying unit 44 determines whether or not the person is an operator. For example, the operator specifying unit 44 calculates an evaluation value for the person, and when the evaluation value is less than a predetermined threshold, specifies the person as an operator, and the evaluation value is greater than or equal to the threshold. Outputs information indicating that no operator is specified or information indicating that no operator exists. However, when there is one person included in the captured image, the operator specifying unit 44 may specify the person as the operator. In this case, the operator's specific processing amount in the operator specifying unit 44 is reduced.

  The position specifying unit 45 specifies the position indicated by the operator 11 with the indicator 11 based on the position of the operator specified by the operator specifying unit 44 in the captured image and the position of the indicator 11 in the captured image. To do. Specifically, the position specifying unit 45 specifies the indicated position from the positional relationship between the specified operator and the indicator 11 in the captured image. More specifically, the position specifying unit 45 specifies the indicated position based on the relative position of the indicator 11 based on the specified operator position in the captured image. Here, the position specifying unit 45 calculates the indicated coordinates indicating the indicated position based on the person detection information about the operator from the operator specifying unit 44 and the indicator detection information from the indicator detecting unit 43. The designated coordinates are specifically the coordinates in the coordinate system of the image displayed on the display device 14.

For example, the position specifying unit 45 calculates the indicated coordinates using a function that receives the difference between the position of the operator and the position of the indicator 11 in the captured image, as in the following equation (1).
P _point = (P _ope −P _dev ) × scale _offset + P _offset (1)
In the above equation (1), P _point is a vector value indicating the indicated coordinates, P _ope is a vector value indicating the position of the operator, and P _dev is a vector value indicating the position of the indicator 11 (see FIG. 7). . The scaleoffset is a coefficient that determines the sensitivity of the change in the indicated position specified with respect to the change in the position of the indicator 11, that is, a scalar value that defines the relationship between the change in the position of the indicator 11 and the change in the indicated coordinate. P _offset is a vector value that defines the relationship between the origin of the coordinate system of the designated coordinates (for example, the origin of the coordinate system of the image displayed on the display device 14) and the position of the operator (for example, the center coordinates of the face). As described above, in one aspect, the function for calculating the designated coordinate is a change in the designated position with respect to the change in the position of the indicator 11 with respect to the difference between the position of the operator and the position of the indicator 11 in the captured image. Includes multiplication of coefficients that define sensitivity.

  The difference between the position of the operator in the captured image and the position of the indicator 11 changes according to the distance from the imaging device 13 to the operator in real space. Therefore, from the viewpoint of more accurately specifying the indicated position in consideration of the distance from the imaging device 13 to the operator in real space, in one aspect, the position specifying unit 45 includes the position and instruction of the operator in the captured image. In addition to the position of the device 11, the designated position is specified based on information indicating the distance from the imaging device 13 to the operator in the real space (hereinafter referred to as “operator distance information”). The position specifying unit 45 uses, for example, the size of the operator in the captured image as the distance information of the operator. As the size of the operator in the captured image, for example, the width of the operator's face is used, but a distance between both eyes, a shoulder width, or the like may be used.

In this aspect, the position specifying unit 45 receives, for example, the difference between the position of the operator in the captured image and the position of the indicator 11 and the size of the operator in the captured image as in the following formula (2). The indicated coordinates are calculated by the function to perform.
P _point = (P _ope −P _dev ) / scale × scale _offset + P _offset (2)
In the above equation (2), scale is a scalar value indicating the size of the operator (for example, the horizontal width of the face) in the captured image (see FIG. 7). P _point , P _ope , P _dev , scaleoffset, and P _offset are the same as in equation (1). Thus, in one aspect, the function for calculating the designated coordinates includes a division by the size of the operator in the captured image with respect to the difference between the position of the operator in the captured image and the position of the indicator 11, And a multiplication of a coefficient that determines the sensitivity of the change of the indicated position to the change of the position of the device 11.

Above formula (1), (2), the value of scaleoffset and _{P offset,} in one embodiment, a preset fixed value. In this case, the value of scaleoffset and _{P offset} of the formula (1) may, for example, at a position apart a standard distance from the imaging device 13, the position of the limit of the human standard magnitude indicator 11 up, down, left and right Is set so that the calculated instruction coordinates become the coordinates indicating the positions of the upper, lower, left and right ends of the display screen S of the display device 14, respectively. The setting of the value includes the resolution of the display device 14, the center coordinates of the person's face in the captured image when the standard person moves the indicator 11 at the standard position, and the top and bottom of the indicator 11. This is based on the coordinates of the left and right limit positions. The value of scaleoffset and _{P offset} of the formula (2), for example, when a person of standard size moves the indicator 11 to the position of the vertical and horizontal limits, display instruction coordinates calculated in the display device 14 The coordinates are set to indicate the positions of the upper, lower, left and right edges of the screen S. The values are set according to the resolution of the display device 14, the size of the person in the captured image when the standard person moves the indicator 11, the center coordinates of the face, and the top, bottom, left, and right of the indicator 11. Based on the coordinates of the limit position.

In another embodiment, the values of scaleoffset and _{P offset} in the above formula (1), (2) is a variable value that varies in accordance with operation by the operator. For example, the position specifying unit 45 sets the scaleoffset (that is, the indicator 11 of the indicator 11) according to the operation of the indicator 11 by the operator so that the indication position specified by the position specifying unit 45 falls within a preset range. The coefficient that determines the sensitivity of the change of the indicated position with respect to the change of the position is adjusted. Specifically, the initial value of the scaleoffset is set to a value larger than the fixed value (that is, the sensitivity is set to be higher), and the position specifying unit 45 determines that the indicated coordinates to be calculated are in the horizontal direction of the display device 14. When the coordinate range or the coordinate range in the vertical direction is exceeded, that is, when the coordinate range that can be displayed on the display device 14 is exceeded, the value of the scaleoffset is decreased at a certain rate (that is, the sensitivity is lowered).

  When the calculated designated coordinate exceeds the preset effective range, the position specifying unit 45 may specify the coordinate within the effective range closest to the designated coordinate as the final designated coordinate. Alternatively, the position specifying unit 45 may assume that the operator is not performing an operation and does not output the instruction coordinates when the calculated instruction coordinates exceed the preset effective range. The effective range is, for example, a range in which the cursor C on the display screen S of the display device 14 can be displayed.

  The position specifying unit 45 outputs information indicating the specified pointing position to the display control unit 47. Here, the position specifying unit 45 outputs instruction coordinates indicating the position on the display screen S of the display device 14 to the display control unit 47.

  The button input information acquisition unit 46 acquires information (button input information) indicating that the operation button of the indicator 11 has been pressed from the light receiving device 12 and notifies the display control unit 47 of the information.

  The display control unit 47 controls the image displayed on the display device 14 based on the designated position specified by the position specifying unit 45. Here, the display control unit 47 controls the content displayed on the display device 14 by using the designated coordinates specified by the position specifying unit 45 and the button input information acquired by the button input information acquisition unit 46. . Specifically, the display control unit 47 controls a GUI (Graphical User Interface) screen displayed on the display device 14.

  For example, as shown in FIG. 8, the display control unit 47 displays a plurality of selectable areas 81 a to 81 f at predetermined positions on the display screen S of the display device 14 and is specified by the position specifying unit 45. The cursor C is displayed at the position of the designated coordinates. Here, when the operator presses the enter button 31a of the indicator 11, the button input information acquisition unit 46 notifies the display control unit 47 of button input information indicating that the enter button 31a has been pressed. Upon receiving the notification of the button input information, the display control unit 47 determines that the selectable area 81c existing at the position where the cursor C is displayed has been selected, and the process ( For example, screen transition of the display screen S) is performed.

  FIG. 9 is a flowchart illustrating an example of a processing procedure of the information processing apparatus 15 regarding display of the cursor C. Hereinafter, with reference to FIG. 9, a processing procedure of the information processing apparatus 15 related to the display of the cursor C will be described. This process is repeatedly performed at the same cycle as the imaging cycle of the imaging device 13, for example. However, it may be performed in a cycle longer than the cycle of imaging, such as once per N (N is an integer of 2 or more) captured images.

  First, the information processing device 15 acquires a captured image from the imaging device 13 (S11). Next, the information processing apparatus 15 detects a person from the acquired captured image, and detects the position and size of the person in the captured image (S12). Further, the information processing apparatus 15 detects the indicator 11 from the acquired captured image, and detects the position of the indicator 11 in the captured image (S13). Then, the information processing device 15 specifies an operator from the detected person based on the detected position of the indicator 11 and the detected position and size of the person (S14). Here, the operator is specified regardless of whether the number of detected persons is one or plural. Further, instead of specifying the operator, the operator may not be specified.

  Next, the information processing apparatus 15 determines whether or not an operator is specified in step S14 (S15).

  When it is determined that the operator has been identified (S15: YES), the information processing device 15 identifies the designated position based on the detected position of the indicator 11 and the identified position and size of the operator. (S16). Then, the information processing device 15 displays the cursor C at the specified position on the display screen S of the display device 14 (S17), and ends the process.

  On the other hand, when it is determined that the operator has not been specified (S15: NO), the information processing apparatus 15 ends the process without specifying the indicated position or displaying the cursor C.

  FIG. 10 is a flowchart illustrating an example of a processing procedure of the information processing apparatus 15 regarding screen transition based on pressing of the determination button 31a. Hereinafter, with reference to FIG. 10, a processing procedure of the information processing apparatus 15 related to screen transition based on pressing of the determination button 31 a will be described. This process is independent of the process of FIG. 10 described above, and the information processing apparatus 15 may execute the two processes of FIGS. 9 and 10 simultaneously or alternately. Further, there may be a difference in the frequency of performing each process.

  First, the information processing device 15 acquires button input information from the light receiving device 12 (S21). Next, the information processing apparatus 15 determines whether or not the determination button 31a is pressed based on the acquired button input information (S22), and when it is determined that the determination button 31a is not pressed (S22: NO). The process is terminated.

  On the other hand, when it is determined that the determination button 31a has been pressed (S22: YES), the information processing apparatus 15 can select an area on the display screen S where the cursor C is displayed (that is, the current designated position). It is determined whether any of 81a to 81f exists (S23).

  When it is determined that none of the selectable areas 81a to 81f exists (S23: NO), the information processing apparatus 15 ends the process.

  On the other hand, when it is determined that any of the selectable areas 81a to 81f exists (S23: YES), the information processing apparatus 15 selects the selectable area existing in the position of the cursor C (area 81c in FIG. 8). The screen transition assigned to is executed (S24), and the process is terminated.

According to the first embodiment described above, the following effects (1) to (8) can be obtained.
(1) When the captured image includes a plurality of persons, the information processing apparatus identifies an operator holding the indicator from the plurality of persons, and identifies the operator in the captured image Based on the position of the indicator and the position of the indicator in the captured image, the indicated position indicated by the operator with the indicator is specified. For this reason, even if it is a case where a picked-up image contains a several person, an instruction | indication position can be specified appropriately.

  Specifically, when a plurality of persons are included in the captured image, it is possible to prevent an erroneous designated position from being specified based on the positions of persons who are not actually operators.

  In addition, the indicated position can be obtained from the positional relationship between the operator and the indicator in the captured image. More specifically, the indicated position can be obtained from the relative position of the indicator based on the position of the operator in the captured image. Thereby, for example, the operational feeling of the operator is improved. Specifically, in the configuration in which the indication position is simply obtained from the position of the indicator in the captured image, even if the operator holds the indicator in the same posture, the instruction in the captured image is different if the operator's position is different. Since the position of the container is different, the indicated position (for example, the cursor position) is different. That is, when the position of the operator changes, the correspondence between the relative position of the indicator with respect to the operator and the indicated position changes, and the operational feeling is impaired. On the other hand, in the configuration in which the indicated position is obtained from the relative position of the indicator based on the position of the operator in the captured image, the correspondence between the relative position of the indicator and the indicated position with respect to the operator regardless of the position of the operator. It becomes possible to make the relationship constant, and it is possible to avoid or reduce the change in operational feeling depending on the position of the operator.

  (2) The operator specifying unit specifies an operator from the plurality of persons based on the positions of the plurality of persons in the captured image and the position of the indicator in the captured image. Thereby, the operator can be identified from the positional relationship between each person and the indicator in the captured image.

  (3) The operator specifying unit includes a plurality of positions based on information representing a distance from the imaging device to each of the plurality of persons in the real space, in addition to the positions of the plurality of persons and the position of the indicator in the captured image. The operator is identified from among the persons. Accordingly, the operator can be specified more accurately in consideration of the distance from the imaging device to each person in the real space.

  (4) The operator specifying unit may select an operator from among a plurality of persons based on the positions of the plurality of persons in the captured image and the positions of the indicators, as well as the sizes of the plurality of persons in the captured image. Is identified. Thereby, it is possible to more accurately identify the operator with a simple configuration in consideration of the distance from the imaging device to each person in real space. Specifically, the configuration is simple compared to a configuration in which a stereo image is acquired by a plurality of imaging devices and the distance to a person is measured, or a configuration using a special imaging device having a function of measuring the distance is used. And cost reduction.

  (5) The position specifying unit determines the indicated position based on information indicating the distance from the imaging device to the specified operator in the real space, in addition to the specified operator position and indicator position in the captured image. Identify. Accordingly, it is possible to specify a more appropriate designated position in consideration of the distance from the imaging device to the operator in real space. Specifically, when the indicator exists at the same position as viewed from the operator in the real space, it is possible to specify substantially the same indicated position regardless of the distance from the imaging device to the operator in the real space. Become. As a result, it is possible to avoid or reduce a change in operational feeling due to the distance from the imaging device to the operator in real space.

  (6) The position specifying unit specifies the indicated position based on the specified operator position and the indicator position in the captured image, and also based on the specified operator size in the captured image. Thereby, it is possible to specify a more appropriate indication position with a simple configuration in consideration of the distance from the imaging device to the operator in real space. Specifically, compared to a configuration in which a stereo image is acquired by a plurality of imaging devices and the distance to the operator is measured, or a configuration in which a special imaging device having a function to measure the distance is used, the configuration Simplification and cost reduction are possible.

  (7) The operator specifying unit specifies the operator even when the captured image includes one person. That is, it is determined whether the person is an operator. As a result, it is possible to prevent an erroneous designated position from being specified based on the position of a person who is not actually an operator.

  (8) The operator specifying unit, instead of the position of the indicator in the captured image, calculates the average value or the median value of the indicator position or the sum of the maximum value and the minimum value of the indicator position in the last fixed period. The half value of is used. Accordingly, when a plurality of persons are present at positions close to each other, it is possible to reduce the possibility that a person who does not actually hold the indicator is erroneously specified as an operator.

  In the above description, the indicator 11 includes the operation unit 31 and the light emitting unit 32. However, the indicator 11 may be detected by the information processing apparatus 15, and the operation unit 31 and the light emitting unit 32 may be It may be omitted. In this case, the light receiving device 12 and the button input information acquisition unit 46 can also be omitted. Further, in this case, the information processing apparatus 15 determines that the position of the cursor C on the display screen S is longer than a predetermined time in any one of the plurality of selectable areas instead of selecting the area by the determination button 31a. In some cases, it may be considered that the area has been selected, and a screen transition assigned to the area may be performed.

  Moreover, although the case where the indicator 11 was a television remote control was illustrated in said description, the indicator 11 is a thing imitating a gun, a thing imitating a cane, and a thing which can be used by being fitted to a fingertip. Other embodiments may be used.

  Moreover, in the above description, the case where the indicator detection unit 43 detects the position of the indicator 11 using the light emission from the light emitting unit 33 of the indicator 11 is exemplified. The position of the indicator 11 may be detected by a method. For example, the indicator 11 is provided with a reflecting material, and a light emitting unit is provided at a location different from the indicator 11, and the indicator detecting unit 43 detects light emitted from the light emitting unit and reflected by the reflecting material. By doing so, the structure which detects the position of the indicator 11 may be sufficient. Further, the indicator detection unit 43 may detect the position of the indicator 11 using the appearance characteristic of the indicator 11 (for example, an identification mark provided on the indicator 11). In these cases, the light emitting unit 33 may be omitted.

  9, 11, 13, and 14, for example, when the operator is not specified in S <b> 15 of FIG. 9, the processing is ended, but the information processing apparatus 15 does not specify the operator. In this case, instead of the position of the indicator 11 detected in the current process, the position of the indicator 11 detected in the previous process may be used to specify the operator and the specified position. In this case, even if there is an error in the detection of the position of the indicator 11, the indicated position can be specified. Specifically, when there is an error in the detection of the position of the indicator 11 in the current process and, as a result, the operator has not been specified, it is detected correctly instead of the position of the indicator 11 detected in error. It is possible to specify the operator and the specified position by using the previously detected position of the indicator 11 that may have been detected. Thereby, the influence of the erroneous detection of the position of the indicator 11 can be reduced.

  Moreover, although the case where the size of the person in the captured image is used as the distance information has been exemplified in the above description, the distance information may be acquired by other methods. For example, the information processing device 15 may obtain distance information by acquiring a stereo image with a plurality of imaging devices, or may obtain distance information using a special imaging device having a function of measuring distance. .

  In the above description, the case where the information processing device 15 is applied to a television receiver has been exemplified. However, the information processing device 15 can be applied to various devices and uses such as a computer and a game machine.

  Further, in the above description, the configuration in which the information processing device 15 performs display control based on the designated position is exemplified, but the information processing device 15 may have at least a function of specifying the designated position, and the display control may be performed. The unit 46 and the display device 14 may be provided outside the information processing device 15. In addition, information indicating the designated position specified by the information processing device 15 may be used for purposes other than display control, and the display control unit 46 and the display device 14 may be omitted.

Embodiment 2. FIG.
Hereinafter, the information processing system in Embodiment 2 will be described. Since this information processing system is almost the same as that of the first embodiment, the same parts as those of the first embodiment are denoted by the same reference numerals, and description thereof is omitted or simplified.

  In the present embodiment, the operator specifying unit 44, when the position and size of any person detected in the current captured image matches the position and size of the operator specified in the previous captured image. Is identified as the operator. Specifically, the operator specifying unit 44 detects the person detected this time based on the person detection information from the person detection unit 42 and the person detection information of the operator specified last time stored in a predetermined storage area. It is determined whether or not there is a person whose position and size match those of the operator specified last time. If there is a person who matches, the person is specified as the operator. Here, matching the position and size may include matching the position and size substantially. For example, the operator specifying unit 44 determines that the positions and sizes of the two coincide when the difference between the two positions is equal to or smaller than a predetermined threshold value and the difference between the two sizes is equal to or smaller than the predetermined threshold value. Also good.

  FIG. 11 is a flowchart illustrating an example of a processing procedure of the information processing apparatus 15 regarding the display of the cursor C in the second embodiment. Hereinafter, with reference to FIG. 11, a processing procedure of the information processing apparatus 15 related to the display of the cursor C will be described. This process is repeatedly performed at the same cycle as the imaging cycle of the imaging device 13, for example.

  First, the information processing apparatus 15 acquires a captured image from the imaging apparatus 13 (S31). Next, the information processing apparatus 15 detects a person from the acquired captured image, and detects the position and size of the person in the captured image (S32). Further, the information processing apparatus 15 detects the indicator 11 from the acquired captured image, and detects the position of the indicator 11 in the captured image (S33).

  Next, the information processing apparatus 15 determines whether the position and size of each person detected in step S32 matches the position and size of the operator specified in the previous process of FIG. It is determined whether there is a person whose position and size match the operator specified last time (S34). If the operator is not specified in the previous process of FIG. 11, the information processing apparatus 15 determines that there is no matching person.

  If it is determined that there is a matching person (S34: YES), the information processing apparatus 15 identifies the person as an operator (S35), and the process proceeds to step S38.

  On the other hand, if it is determined that there is no matching person (S34: NO), the information processing apparatus 15 detects the position based on the detected position of the indicator 11 and the position and size of the detected person. The operator is identified from the person (S36). Then, the information processing apparatus 15 determines whether or not the operator has been specified (S37). If it is determined that the operator has been specified (S37: YES), the process proceeds to step S38, and the operator Is determined not to be specified (S37: NO), the process is terminated.

  In step S <b> 38, the information processing apparatus 15 identifies the designated position based on the detected position of the indicator 11 and the identified position and size of the operator. Then, the information processing device 15 displays the cursor C at the specified indication position on the display screen S of the display device 14 (S39), and ends the process.

  As described above, in the present embodiment, the information processing apparatus 15 identifies the operator based on the position and size of each person in the current captured image and the position and size of the operator in the previous captured image. Do. As described above, the operator may be specified by a method other than the method shown in the first embodiment. In addition, for example, the information processing device 15 obtains a similarity between the feature of the appearance of the operator stored in advance and the feature of each person recognized from the captured image, and determines the person with the highest similarity as the operator. It is also possible to specify as

Embodiment 3 FIG.
Hereinafter, the information processing system in Embodiment 3 will be described. Since this information processing system is almost the same as that of the first embodiment, the same parts as those of the first embodiment are denoted by the same reference numerals, and description thereof is omitted or simplified.

  FIG. 12 is a block diagram illustrating an example of the configuration of the information processing apparatus 15 according to the third embodiment. As illustrated in FIG. 12, in the present embodiment, the information processing apparatus 15 further includes a detection target region setting unit 121. The detection target area setting unit 121 sets a detection target area that is a target for detecting the position of the indicator 11 based on the position of the specified operator in the captured image, or the position and size. The indicator detection unit 43 detects the position of the indicator 11 using the detection target region set by the detection target region setting unit 121 in the captured image as a detection target.

  Specifically, the detection target area setting unit 121 sets a position range of the indicator 11 such that the indicated position within a preset effective range is specified as the detection target area. The effective range is, for example, a range in which the cursor C on the display screen S of the display device 14 can be displayed.

For example, when the above equation (1) is used for calculation of the designated coordinates, the detection target region setting unit 121 determines that the equation (1) and the effective range of the vector P _point (that is, the effective range of the indicated position) For example, based on the resolution of the display device 14) and the vector P _ope (that is, the position of the specified operator), the range of the vector P _dev within which the vector P _point is within the effective range (that is, the position of the indicator 11) Is set as the detection target area.

When the above equation (2) is used to calculate the designated coordinates, the detection target region setting unit 121 determines that the equation (2) and the effective range of the vector P _point (that is, the effective range of the designated position) For example, based on the resolution of the display device 14, the vector P _ope (that is, the position of the specified operator), and the scalar scale (that is, the size of the specified operator), the vector P _point is an effective range. The range of the inner vector P _dev (that is, the range of the position of the indicator 11) is set as the detection target region.

  In one aspect, the operator specifying unit 44 specifies an operator by the method described in the second embodiment, for example, without using the position of the indicator 11. The detection target area setting unit 121 sets the detection target area based on the position of the identified operator or the position and size. The indicator detection unit 43 detects the position of the indicator 11 from the detection target region in the captured image, and outputs indicator detection information indicating the position to the position specifying unit 45. In this case, the indicator detection unit 43 may not output the indicator detection information to the operator specifying unit 44. An example of processing in this aspect will be described later according to FIG.

  In another aspect, when the position specifying unit 45 specifies the designated position, the detection target region setting unit 121 performs detection for the next process based on the specified operator position or position and size. Set the target area. Then, in the next process, the operator specifying unit 44 determines whether there is a person whose position and size match the operator specified last time among the persons detected this time, as in the second embodiment. If there is a matching person, the person is specified as the operator. When the operator specifying unit 44 determines that there is a matching person, the indicator detection unit 43 detects the position of the indicator 11 from the detection target area set in the previous process in the captured image, Indicator detection information indicating the position is output to the position specifying unit 45. In this case, the indicator detection unit 43 may not output the indicator detection information to the operator specifying unit 44. An example of processing in this aspect will be described later according to FIG.

  FIG. 13 is a flowchart illustrating a first example of a processing procedure of the information processing apparatus 15 regarding the display of the cursor C in the third embodiment. Hereinafter, a first example of processing related to the display of the cursor C will be described with reference to FIG. This process is repeatedly performed at the same cycle as the imaging cycle of the imaging device 13, for example.

  First, the information processing device 15 acquires a captured image from the imaging device 13 (S41). Next, the information processing apparatus 15 detects a person from the acquired captured image, and detects the position and size of the person in the captured image (S42).

  Next, the information processing apparatus 15 determines whether the position and size of each person detected in step S42 matches the position and size of the operator specified in the previous process of FIG. It is determined whether or not there is a person whose position and size match the operator specified last time (S43).

  When it is determined that there is a matching person (S43: YES), the information processing apparatus 15 identifies the person as an operator (S44), and determines the position and size of the person and the resolution of the display device 14. Based on the above, a detection target region is calculated (S45). Then, the information processing apparatus 15 detects the indicator 11 for only the detection target region in the captured image, detects the position of the indicator 11 in the captured image (S46), and advances the processing to step S50.

  On the other hand, when it is determined that there is no matching person (S43: NO), the information processing apparatus 15 detects the indicator 11 for the entire area of the captured image, and determines the position of the indicator 11 in the captured image. It is detected (S47). Then, the information processing device 15 identifies an operator from the detected person based on the detected position of the indicator 11 and the detected position and size of the person (S48). Next, the information processing apparatus 15 determines whether or not an operator has been specified (S49). If it is determined that an operator has been specified (S49: YES), the process proceeds to step S50, and the operation is performed. If it is determined that the person has not been identified (S49: NO), the process is terminated.

  In step S50, the information processing device 15 specifies the indicated position based on the detected position of the indicator 11 and the specified position and size of the operator. Then, the information processing device 15 displays the cursor C at the specified indication position on the display screen S of the display device 14 (S51), and ends the processing.

  FIG. 14 is a flowchart illustrating a second example of the processing procedure of the information processing apparatus 15 related to the display of the cursor C in the third embodiment. Hereinafter, with reference to FIG. 14, a second example of processing related to the display of the cursor C will be described. This process is repeatedly performed at the same cycle as the imaging cycle of the imaging device 13, for example.

  First, the information processing apparatus 15 acquires a captured image from the imaging apparatus 13 (S61). Next, the information processing apparatus 15 detects a person from the acquired captured image, and detects the position and size of the person in the captured image (S62).

  Next, the information processing apparatus 15 determines whether the position and size of each person detected in step S62 matches the position and size of the operator specified in the previous processing of FIG. It is determined whether there is a person whose position and size match the operator specified last time (S63).

  When it is determined that there is a matching person (S63: YES), the information processing apparatus 15 identifies the person as an operator (S64). Further, the information processing apparatus 15 detects the indicator 11 only for the detection target region set in step S70 (described later) of the previous processing of FIG. 14 in the captured image, and indicates the indicator 11 in the captured image. Is detected (S65), and the process proceeds to step S69.

  On the other hand, when it is determined that there is no matching person (S63: NO), the information processing apparatus 15 detects the indicator 11 for the entire area of the captured image, and determines the position of the indicator 11 in the captured image. It is detected (S66). Then, the information processing apparatus 15 identifies an operator from the detected person based on the detected position of the indicator 11 and the detected position and size of the person (S67). Next, the information processing apparatus 15 determines whether or not an operator has been specified (S68). If it is determined that an operator has been specified (S68: YES), the process proceeds to step S69, and the operation is performed. If it is determined that the person has not been identified (S68: NO), the process is terminated.

  In step S <b> 69, the information processing apparatus 15 identifies the designated position based on the detected position of the indicator 11 and the identified position and size of the operator. Then, the information processing device 15 calculates a detection target region based on the identified position and size of the operator and the resolution of the display device 14 (S70). The calculated detection target area is used in step S65 in the next process of FIG. Further, the information processing device 15 displays the cursor C at the specified indication position on the display screen S of the display device 14 (S71), and ends the process.

According to the third embodiment described above, the following effect (9) can be obtained.
(9) The information processing apparatus, based on the indicator detection unit that detects the position of the indicator in the captured image used for specifying the indication position, and the position of the specified operator in the captured image, or the position and size, A detection target region setting unit that sets a detection target region that is a target for detection of the position of the indicator, and the indicator detection unit uses the detection target region in the captured image as a detection target, and the position of the indicator Detection is performed. For this reason, the position of the indicator can be detected from an appropriate range corresponding to the position of the operator in the captured image. As a result, it is possible to reduce the load of the process for detecting the position of the indicator, and to reduce the occurrence of an error in the detection of the position of the indicator. Further, by setting the detection target region so that the designated position within the effective range can be obtained, it is possible to avoid specifying the invalid designated position.

  In the first to third embodiments described above, the function of the information processing apparatus 15 may be realized only by hardware resources such as an electronic circuit, or may be realized by cooperation of hardware resources and software. . When realized by the cooperation of hardware resources and software, the functions of the information processing apparatus 15 are realized by, for example, an information processing program being executed by a computer. More specifically, the function of the information processing device 15 is that a central processing unit (CPU) is read by reading an information processing program recorded in a recording medium such as a ROM (Read Only Memory) into a main storage device. It is realized by being executed. The information processing program may be provided by being recorded on a computer-readable recording medium such as an optical disk, or may be provided via a communication line such as the Internet.

  In addition, this invention is not limited to the said embodiment, In the range which does not deviate from the summary of this invention, it can implement with a various aspect.

  DESCRIPTION OF SYMBOLS 11 Indicator, 12 Light receiving device, 13 Imaging apparatus, 14 Display apparatus, 15 Information processing apparatus, 41 Image acquisition part, 42 Person detection part, 43 Indicator detection part, 44 Operator specific part, 45 Position specific part, 46 button An input information acquisition unit, 47 display control unit, 100 information processing system, 121 detection target region setting unit.

Claims (17)

An image acquisition means for acquiring an image captured by an indicator for indicating a position and an operator holding the indicator;
An operator specifying means for specifying the operator holding the indicator from the plurality of persons when the image includes a plurality of persons;
Position specifying means for specifying a position instructed by the operator by the operator based on the position of the specified operator in the image and the position of the indicator in the image;
An information processing apparatus comprising:   The operator specifying means specifies the operator from the plurality of persons based on the position of each of the plurality of persons in the image and the position of the indicator in the image. The information processing apparatus according to claim 1.   The information processing apparatus according to claim 2, wherein the operator specifying unit further specifies the operator from the plurality of persons based on a size of each of the plurality of persons in the image. .   The information processing apparatus according to claim 1, wherein the position specifying unit further specifies the position based on the size of the specified operator in the image. Indicator detecting means for detecting the position of the indicator in the image used for the position specifying means;
A detection target region setting means for setting a detection target region that is a target of detection of the position of the indicator based on the position of the specified operator in the image, or the position and size;
Further comprising
The indicator detection means detects the position of the indicator with the detection target region of the image as a detection target.
The information processing apparatus according to claim 1, wherein the information processing apparatus is an information processing apparatus.   The operator specifying means specifies, as the operator, a person having a minimum horizontal distance between the position of the person in the image and the position of the indicator in the image. The information processing apparatus according to claim 2.   The operator specifying means specifies, as the operator, a person having a minimum Euclidean distance between the position of the person in the image and the position of the indicator in the image among the plurality of persons. The information processing apparatus according to claim 2.   The operator specifying unit divides a horizontal distance between the position of the person in the image and the position of the indicator in the image by the size of the person in the image. The information processing apparatus according to claim 3, wherein a person having the smallest quotient is specified as the operator.   The operator specifying unit is a quotient obtained by dividing the Euclidean distance between the position of the person in the image and the position of the indicator in the image by the size of the person in the image. The information processing apparatus according to claim 3, wherein a person having a minimum is specified as the operator.   The position specifying means calculates the position by a function having as input a difference between the position of the specified operator in the image and the position of the indicator, and a size of the specified operator in the image. The information processing apparatus according to claim 4, wherein:   The function is based on the difference between the position of the specified operator in the image and the position of the indicator, the division by the size of the specified operator in the image, and the change in the position of the indicator. The information processing apparatus according to claim 10, further comprising: multiplication of a coefficient that determines sensitivity of the change in the specified position.   The position specifying means adjusts a coefficient for determining the sensitivity according to an operation of the indicator by the operator so that a position specified by the position specifying means falls within a preset range. The information processing apparatus according to claim 11.   The information according to claim 4, 10, 11, or 12, wherein the size of the specified operator in the image is defined by a width of the face of the specified operator in the image. Processing equipment.   The size of the specified operator in the image is defined by a distance between both eyes of the specified operator in the image. Information processing device. An information processing apparatus according to any one of claims 1 to 14,
The indicator;
An imaging device that images the indicator and the operator and outputs the image to the image acquisition means;
A display device for displaying an image;
Display control means for controlling an image displayed on the display device based on the position specified by the position specifying means;
An information processing system comprising: A step of acquiring an image in which an indicator for indicating a position and an operator holding the indicator are captured;
When the image includes a plurality of persons, identifying the operator holding the indicator from the plurality of persons;
Identifying a position indicated by the operator by the indicator based on the position of the specified operator in the image and the position of the indicator in the image;
An information processing method comprising: An information processing apparatus according to any one of claims 1 to 14,
A display device for displaying an image;
Display control means for controlling an image displayed on the display device based on the position specified by the position specifying means;
A television receiver comprising:

Images