JP5648866B2 - Imaging system, imaging method, imaging apparatus, and program - Google Patents

Description

The present invention, imaging system using visible light communication, photographing how, shooting device, and a program.

  2. Description of the Related Art Conventionally, digital cameras, digital video cameras, and the like have a function (for example, refer to Patent Documents 1 and 2) that performs a subject tracking function that recognizes a person as a subject from within an angle of view and sets exposure.

JP 2012-151544 A JP 2007-201979 A

  By the way, in the above-described conventional photographing apparatus, for example, when taking a video of a person who is playing sports such as tennis or golf, the photographing apparatus is fixed to an appropriate position with a tripod or the like, and an infrared remote controller or the like from a remote place. It is conceivable to remotely control the recording start timing using the. However, the above conventional technique has a problem that it is difficult to perform such remote control depending on the state of the subject.

Accordingly, the present invention aims at providing imaging system capable of performing a photography that meets the condition of the subject, imaging how, IMAGING DEVICE, and program.

The present invention is a photographing system including a light emitting device that emits visible light including arbitrary information and a photographing device having a plurality of photographing functions, wherein the light emitting device has the plurality of photographing functions of the photographing device. The imaging device includes a light emitting unit that emits visible light including command information corresponding to each, and the imaging unit receives visible light emitted from the light emitting unit by the imaging unit, and is included in the visible light. Visible light information acquisition means for acquiring the command information, and imaging instruction means for instructing execution of at least one of the plurality of imaging functions based on the command information acquired by the visible light information acquisition means; a trimming means for cutting a region where visible light is present, including the command information at a predetermined size, serial to record cropped image by said trimming means And control means, a photographing system comprising: a.

The present invention is a photographing method including a light emitting device that emits visible light including arbitrary information, and a photographing device that includes an imaging unit and has a plurality of photographing functions. A light emitting step for emitting visible light including command information corresponding to each of a plurality of photographing functions, and in the photographing device, visible light emitted in the light emitting step is received by the imaging means and included in the visible light A visible light information acquisition step for acquiring the command information; and a shooting instruction step for instructing execution of at least one of the plurality of shooting functions based on the command information acquired in the visible light information acquisition step; a trimming step of cutting the area where visible light is present, including the command information at a predetermined size, said trimming step A recording control step of recording the trimmed image, a photographing method characterized by having a.

This invention relates to a photographing apparatus having a plurality of photographing function, the visible light information received imaging means, the visible light including command information in the imaging unit, acquires the command information contained in the visible light Based on the command information acquired by the visible light information acquisition means, an imaging instruction means for instructing execution of at least one of the plurality of imaging functions, and visible light including the command information An imaging apparatus comprising: a trimming unit that cuts an existing area with a predetermined size; and a recording control unit that records an image trimmed by the trimming unit .

This invention has an imaging unit, the computer of the imaging device having a plurality of photographing functions, and receiving the visible light including command information in the imaging unit, acquires the command information contained in the visible light visible Based on the command information acquired by the optical information acquisition function, the visible light information acquisition function, an imaging instruction function for instructing execution of at least one of the imaging functions, and visible light including the command information A program for executing a trimming function for cutting an existing area with a predetermined size and a recording control function for recording an image trimmed by the trimming function .

  According to the present invention, it is possible to shoot a moving image that matches the situation of the subject.

1 is a block diagram illustrating a configuration of a photographing system 1 according to a first embodiment of the present invention. FIG. 2 is a block diagram illustrating configurations of an optical tag 10 and a photographing apparatus 20 according to the first embodiment. It is a conceptual diagram which shows an example of the color pattern which the optical tag 10 by this 1st Embodiment light-emits. It is a flowchart for demonstrating operation | movement of the optical tag 10 by this 1st Embodiment. It is a flowchart for demonstrating operation | movement of the imaging device 20 by this 1st Embodiment. It is a conceptual diagram for demonstrating operation | movement of the imaging | photography system 1 by this 1st Embodiment, (a) is 1st status, (b) is 2nd status, (c) is 3rd status, (d) is 1st status. 4 indicates status. It is a conceptual diagram for demonstrating operation | movement (pasto movie) of the imaging | photography system 1 by this 1st Embodiment. It is a block diagram which shows the structure of the optical tag 10 by 2nd Embodiment of this invention, and the imaging device 20. FIG. It is a conceptual diagram which shows an example of the color pattern which the optical tag 10 by this 2nd Embodiment light-emits. It is a flowchart for demonstrating operation | movement of the optical tag 10 by this 2nd Embodiment. It is a flowchart for demonstrating operation | movement of the imaging device 20 by this 2nd Embodiment. It is a flowchart for demonstrating operation | movement of the imaging device 20 by this 2nd Embodiment. It is a conceptual diagram for demonstrating operation | movement of the imaging | photography system 1 by this 2nd Embodiment, (a) is 1st status, (b) is 2nd status, (c) is 3rd status, (d) is 3rd status. 4 indicates status. It is a flowchart for demonstrating operation | movement of the imaging device 20 by this 3rd Embodiment. It is a flowchart for demonstrating operation | movement of the imaging device 20 by this 3rd Embodiment. It is a conceptual diagram for demonstrating operation | movement of the imaging | photography system 1 by this 3rd Embodiment, (a) is 1st status, (b) is 2nd status, (c) is 3rd status, (d) is 3rd status. 4 indicates status.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

A. Configuration of First Embodiment FIG. 1 is a block diagram showing a configuration of an imaging system 1 according to the first embodiment of the present invention. In FIG. 1, a photographing system 1 includes an optical tag 10 attached to a user's (subject) wrist or the like, and a photographing device 20 for photographing the subject. As shown in FIG. 1, the optical tag 10 has a removable belt-shaped main body, and can be attached to, for example, the wrist of a user (subject) as shown.

  In addition to the wrist, it may be attached to play equipment (a racket for tennis, a golf club for golf, etc.). Alternatively, it may be a structure that is attached to the shoulder or chest part that is lowered from the neck. On the outer peripheral surface of the optical tag 10, a light emitting unit 14 and a light emitting window 15 are provided so as to irradiate light to the outside, and a power switch 16 is provided so that the attached user can operate.

  As illustrated in FIG. 1, the photographing apparatus 20 includes a housing 20 a in which an optical lens unit 21 and an imaging unit 22 are provided, and a housing 20 b in which a display unit 25 is provided. The housing 20a is provided with a handle portion 20c so that it can be hooked and fixed on a wire mesh or the like.

  FIGS. 2A and 2B are block diagrams showing configurations of the optical tag 10 and the photographing apparatus 20 according to the first embodiment. 2A, the optical tag 10 includes a color pattern memory 11, a timing generator 12, a CPU 13, a light emitting unit 14, and a light emitting window 15. The color pattern memory 11 stores a preset color pattern 11a (first command information). As the color pattern 11a, red (R), green (G), and blue (B) are arranged in time series. In the first embodiment, for example, as shown in FIG. → Green (G) → Red (R) → Blue (B) →... As described above, by using the color pattern from the color components RGB as the visible light communication, the visibility by the user is excellent, and the photographing apparatus 20 can easily detect the photographed image.

  The timing generator 12 generates a stable clock signal CK having a predetermined period. The CPU 16 sequentially extracts the color pattern 11a from the color pattern data memory 11 in synchronization with the clock signal CK from the timing generator 12, and extracts the color pattern (signal) 11a extracted after the header information indicating data transmission. Is supplied to the light emitting unit 14.

  The light-emitting unit 14 includes RGB light-emitting elements (LEDs: Light Emitting Diodes). The light emitting unit 14 outputs light P having a color pattern whose color changes with time according to the color pattern (signal) 11 a through the light emission window 18 in synchronization with the clock signal CK from the timing generator 12. . In the first embodiment, as shown in FIG. 3, the light emission time of each color is 0.1 seconds. The imaging device 20 described later recognizes the optical tag 10 by receiving light of a color pattern whose color changes with time.

  2B, the photographing device 20 includes an optical lens unit 21, an imaging unit 22, a flash memory 23, a memory 24, a display unit 25, a key input unit 26, and a CPU 27. The imaging unit 22 is configured by a two-dimensional image sensor such as a charge-coupled devices (CCD) or a complementary metal-oxide semiconductor (CMOS), for example. The imaging unit 22 converts an image captured through the optical lens unit 21 at a predetermined frame rate into an electrical frame image signal, and sequentially stores it in the flash memory 23. In particular, in the first embodiment, the imaging unit 20 can perform partial reading (trimming) of an arbitrary size from an image captured via the optical lens unit 21.

  The flash memory 23 stores frames (images) from the imaging unit 22 in time series, or stores frames (images) that have been partially read (trimmed) of an arbitrary size in time series. The memory 24 includes a ROM (Read Only Memory) that stores programs and the like, and a RAM (Random Access Memory) that is used as a working memory of the CPU 27 described later. In particular, in the first embodiment, the memory 24 stores a preset color pattern (data) 24 a as in the optical tag 10. The color pattern 24a is the same color pattern as the color pattern 11a of the optical tag 10, that is, as shown in FIG. 3, red (R) → green (G) → red (R) → blue (B) →. To do.

  The display unit 25 includes a liquid crystal display, an organic EL display, and the like. The display unit 25 displays a captured image captured by the imaging unit 22 via the optical lens unit 21 and displays a moving image when the captured moving image is played back. The key input unit 26 includes a photographing button, various setting keys, and the like, and inputs an instruction operation by a user for controlling the operation of the photographing apparatus 20.

  The CPU 27 controls the operation of each unit described above by executing a predetermined program. Specifically, the CPU 27 analyzes the captured image for each frame unit of the image captured by the imaging unit 22 and forms a face outline or face of a subject (for example, a person or a pet) (eyes, mouth). The subject is detected by comprehensively determining the shape and positional relationship of the nose, forehead, and the like. In this case, when a plurality of subjects are included in the captured image, each subject is detected. Note that the subject recognition function including face detection is a technique that is generally used in the photographing apparatus, and since the known technique is used in the present embodiment, the detailed description thereof is omitted. .

  In particular, in the first embodiment, when the CPU 27 detects the predetermined color pattern 24a (11a) from the image captured by the imaging unit 22, the CPU 27 determines the subject to which the optical tag 10 is attached, Imaging is started, and the imaging operation by the imaging unit 22 is controlled so as to continue video imaging while the predetermined color pattern is detected.

Next, operations of the optical tag 10 and the imaging device 20 according to the first embodiment described above will be described.
FIG. 4 is a flowchart for explaining the operation of the optical tag 10 according to the first embodiment. First, the user attaches the optical tag 10 to a wrist or the like, and turns on the optical tag 10 before starting sports or the like. When the power is turned on, the CPU 13 of the optical tag 10 performs initialization processing (step S10), and sequentially reads the color pattern 11a from the color pattern memory 11 in synchronization with the clock signal CK from the timing generator 12 (step S12). ), The color pattern (signal) extracted following the header information indicating the data transmission is supplied to the light emitting unit 14 described later.

  The light emitting unit 14 emits the light P having the color pattern 11a that changes with time through the light emission window 18 in synchronization with the clock signal CK from the timing generator 12 (step S14). Next, the CPU 13 determines whether or not a power-off operation has been performed (step S16). If there is no power-off operation (NO in step S16), the CPU 13 returns to step S14 and repeats light emission of the color pattern 11a. On the other hand, if there is a power-off operation (YES in step S16), the process ends.

  FIG. 5 is a flowchart for explaining the operation of the photographing apparatus 20 according to the first embodiment. After preparing the optical tag 10, the user hooks and fixes the handle portion 20 c on a wire mesh or the like, and turns on the power of the photographing apparatus 20 from the key input portion 26 or the like. When the power is turned on, the CPU 27 of the photographing apparatus 20 performs an initialization process (step S20) and instructs the imaging unit 22 to start a live view (step S22). In response to the instruction, the imaging unit 22 starts a live view in which the image captured via the optical lens unit 21 is displayed on the display unit 25 (the image is not stored).

  Next, the CPU 27 performs subject recognition processing for recognizing a subject in the live view image by performing pattern recognition of a person or the like (step S24). Next, the optical tag 10 in the recognized subject frame is detected (step S26), and it is determined whether or not a predetermined color pattern 24a (= color pattern 11a) has been detected (step S28). If the predetermined color pattern 24a (= color pattern 11a) is not detected (NO in step S28), the process returns to step S26 to detect the optical tag 10, that is, the predetermined color pattern 24a (= color pattern 11a). Repeat detection.

  On the other hand, when the predetermined color pattern 24a (= color pattern 11a) is detected in the subject frame in the live view image (YES in step S28), the predetermined color pattern 24a (= color pattern 11a) is detected. The determined subject frame is determined as a specific subject (step S30). The specific subject is a subject to be photographed with the optical tag 10 attached thereto. When the CPU 27 determines a specific subject, the CPU 27 instructs the imaging unit 22 to start moving image shooting (step S32). Thereby, the imaging unit 22 starts moving image shooting. That is, the imaging unit 22 converts an image captured via the optical lens unit 21 at a predetermined frame rate into an electrical frame image signal, and sequentially stores it as a moving image in the flash memory 23.

  The imaging unit 22 may store the image captured via the optical lens unit 21 as a moving image as it is, but in the first embodiment, an image including a subject wearing the optical tag 10 is predetermined. May be cut out (trimmed) in size and recorded as a moving image.

  Next, the CPU 27 detects the optical tag 10 within the recognized subject frame even during moving image shooting (step S34), and determines whether or not a predetermined color pattern 24a (= color pattern 11a) has been detected. (Step S36). If a predetermined color pattern 24a (= color pattern 11a) is detected (YES in step S36), it is determined whether or not a moving image is being captured (step S38). If the moving image is being shot (YES in step S38), the CPU 27 determines whether or not a shooting stop instruction has been issued from the key input unit 26 or the like (step S44). If there is no shooting stop instruction (NO in step S44), the process returns to step S34, and the detection of the optical tag 10, that is, the detection of the predetermined color pattern 24a (= color pattern 11a) is repeated. Therefore, while the predetermined color pattern 24a (= color pattern 11a) is detected, moving image shooting is continued.

  On the other hand, when the predetermined color pattern 24a (= color pattern 11a) is not detected during moving image shooting (NO in step S36), the CPU 27 instructs the imaging unit 22 to temporarily stop moving image shooting. (Step S42). Thereby, the imaging unit 22 temporarily stops moving image shooting. It should be noted that when the predetermined color pattern 24a (= color pattern 11a) is no longer detected, the video shooting is not paused immediately, but a time lag is provided for a predetermined time (for example, about 20 seconds or about 30 seconds). When the predetermined color pattern 24a (= color pattern 11a) is not detected again even after the predetermined time has elapsed, moving image shooting may be paused.

  Next, the CPU 27 determines whether or not a shooting stop instruction is issued from the key input unit 26 or the like (step S44). If there is no shooting stop instruction (NO in step S44), the process returns to step S34, and the optical tag 10 , That is, detection of a predetermined color pattern 24a (= color pattern 11a) is repeated. Therefore, while the predetermined color pattern 24a (= color pattern 11a) is not detected for some reason (such as when the optical tag 10 is hidden by an obstacle), the moving image shooting is temporarily stopped.

  On the other hand, when the predetermined color pattern 24a (= color pattern 11a) is detected again while the moving image shooting is paused (YES in step S36), it is determined whether the moving image shooting is in progress (step S38). ). In this case, since moving image shooting is paused (NO in step S38), the CPU 27 instructs the imaging unit 22 to resume moving image shooting (step S40). Thereby, the imaging unit 22 resumes moving image shooting. Next, the CPU 27 determines whether or not a shooting stop instruction is issued from the key input unit 26 or the like (step S44). If there is no shooting stop instruction (NO in step S44), the process returns to step S34, and the optical tag 10 , That is, detection of a predetermined color pattern 24a (= color pattern 11a) is repeated. Therefore, when the predetermined color pattern 24a (= color pattern 11a) is detected again, moving image shooting is resumed.

  If there is a shooting stop instruction from the key input unit 26 or the like (YES in step S44), the CPU 27 instructs the imaging unit 22 to stop moving image shooting (step S46). Thereby, the imaging unit 22 stops moving image shooting. Thereafter, the CPU 27 ends the process.

FIG. 6 is a conceptual diagram for explaining the operation of the photographing system 1 according to the first embodiment.
For example, when there are a plurality of players A and B who are practicing on a tennis court, an attempt is made to photograph one player B among them. When the players A and B are not included in the angle of view of the imaging unit 22 as in the first status shown in FIG. 6A, the players A and B are not displayed on the display unit 25. The CPU 27 does not perform subject recognition by pattern recognition at the angle of view 250.

  Next, as in the second status shown in FIG. 6B, when a plurality of players A and B move to the tennis court, the players A and B enter the angle of view within the angle of view of the imaging unit 22, The players A and B are displayed in the section 25, and the CPU 27 detects a plurality of players A and B by subject recognition by pattern recognition at the angle of view 250. Recognized subjects are indicated by frames 30 and 31. The imaging unit 22 adjusts the subject frames 30 and 31 so that automatic focus and exposure are appropriate.

  Next, as shown in the third status shown in FIG. 6C, when the CPU 27 of the photographing device 20 detects the optical tag 10 (color pattern) worn by the specific player B, the player B is specified. The image is confirmed as a subject (frame 32), and the image 251 including the player B is cut (trimmed) as in the fourth status shown in FIG. 6D, and the cut image 251 is set as the angle of view to be recorded. , Start recording as a movie.

  According to the first embodiment described above, since the photographing device 20 detects the optical tag 10 which is a visible light communication transmission device attached to the subject itself, the moving image photographing is started. It is possible to shoot a movie in which the subject wearing the is focused and the exposure is appropriately adjusted. As a result, moving image shooting can be performed according to the state of the subject (moving in and out of the angle of view).

  In the first embodiment described above, the shooting is ended when there is a shooting stop instruction from the key input unit 26 or the like. However, the present invention is not limited to this, and the elapsed time from the start of shooting is counted, and a predetermined time has elapsed. It is also possible to automatically end shooting when triggered by this.

  Further, in the first embodiment described above, the color pattern stored in the optical tag 10 is set to a different color pattern for each user, and the shooting device 20 stores the different color pattern for each user. The user can be identified by detecting the color pattern. As a result, even when there are a plurality of users wearing optical tags within the angle of view, it is possible to determine and photograph a desired specific user as a specific subject.

  Further, in the first embodiment described above, as shown in FIG. 7, moving image shooting is not started after detecting the optical tag 10 that emits a predetermined color pattern, for example, a predetermined time from when the power is turned on. Minutes of images are recorded (recorded) while being constantly updated, and when an optical tag 10 emitting a predetermined color pattern is detected (detection position DP), a predetermined amount of time (for example, the optical tag 10) The recording may be performed from the time point (recording start position RP) (pasted movie). Thereby, it is possible to prevent missing a shooting opportunity due to a delay in the start of recording by the time until the color pattern is recognized.

B. Second Embodiment Next, a second embodiment of the present invention will be described.
FIGS. 8A and 8B are block diagrams showing configurations of the optical tag 10 and the photographing apparatus 20 according to the second embodiment of the present invention. In the figure, portions corresponding to those in FIGS. 2A and 2B are denoted by the same reference numerals and description thereof is omitted. In FIG. 8A, the color pattern memory 11 stores a first color pattern 11b (first command information) and a second color pattern 11c (second command information). As the first color pattern 11b and the second color pattern 11c, a pattern in which red (R), green (G), and blue (B) are arranged in time series is used. As the first color pattern 11b, for example, as shown in FIG. 9A, red (R) → blue (B) → green (G) → red (R) →... As shown in FIG. 9B, red (R) → green (G) → red (R) → blue (B) →... In the second embodiment, as shown in FIGS. 9A and 9B, the light emission time of each color is 0.1 second. As described above, by using the color pattern from the color components RGB as the visible light communication, the visibility by the user is excellent, and the photographing apparatus 20 can easily detect the photographed image.

  The acceleration sensor 17 detects the acceleration (the magnitude and speed of movement) of the optical tag 10, that is, the acceleration (the magnitude and speed of movement) of the subject wearing the optical tag 10. When the acceleration (the magnitude and speed of movement) of the optical tag 10 detected by the acceleration sensor 17, that is, the acceleration (the magnitude and speed of movement) of the subject is smaller than a predetermined threshold, the CPU 13 While the first color pattern 11b is caused to emit light by the light emitting unit 14, the light emission from the first color pattern 11b to the second color pattern 11c occurs when the acceleration (magnitude of movement, speed) of the subject exceeds a predetermined threshold. To switch.

  Next, in FIG. 8B, the memory 24 stores a first color pattern 24 b and a second color pattern 24 c which are set in advance as in the optical tag 10. As the first color pattern 24b, the same color pattern as the first color pattern 11b of the optical tag 10, that is, as shown in FIG. 9A, red (R) → blue (B) → green (G ) → Red (R) →. The second color pattern 24c is the same color pattern as the second color pattern 11c of the optical tag 10, that is, red (R) → green (G) → red (as shown in FIG. 9B). R) → blue (B) →.

  In the photographing apparatus 20, the CPU 27 receives the light of the first color pattern 24b (11b) whose color changes with time, thereby recognizing the optical tag 10 and taking a moving picture in the normal moving picture photographing mode. It is supposed to start. Further, the CPU 27 receives the light of the second color pattern 24c (11c) whose color changes with time, thereby switching to a moving image shooting mode different from the normal moving image shooting mode so as to continue moving image shooting. It has become. As a different operation shooting mode, a high speed moving image shooting mode is executed in which slow motion playback is performed during playback by increasing the number of frames per unit time.

  That is, in the normal moving image shooting mode, for example, when the frame rate is set to 30 fps, in the high speed moving image shooting, for example, the frame rate is increased to 60 fps, 90 fps, 120 fps,. . That is, when the acceleration (the magnitude and speed of movement) of the optical tag 10 is small, the imaging device 20 performs video shooting in the normal video shooting mode, and the acceleration (the magnitude and speed of movement) of the optical tag 10 is increased. When it is large, high-speed video recording is performed.

Next, operations of the optical tag 10 and the photographing apparatus 20 according to the second embodiment described above will be described.
FIG. 10 is a flowchart for explaining the operation of the optical tag 10 according to the second embodiment. First, the user attaches the optical tag 10 to a wrist or the like, and turns on the optical tag 10 before starting sports or the like. When the power is turned on, the CPU 13 of the optical tag 10 performs an initialization process (step S50). Next, the CPU 13 acquires the acceleration (the magnitude and speed of movement) of the optical tag 10 detected by the acceleration sensor 17, that is, the acceleration (the magnitude and speed of movement) of the subject (step S52). It is determined whether or not the acquired acceleration is equal to or greater than a predetermined threshold (step S54).

  If the acquired acceleration is not equal to or greater than the predetermined threshold (NO in step S54), the first color pattern 11b is read from the color pattern memory 11 (step S56), and the first color pattern 11b is read by the light emitting unit 14. Light is emitted (step S58). Next, the CPU 13 determines whether or not a power-off operation has been performed (step S64). If there is no power-off operation (NO in step S64), the CPU 13 returns to step S52, and the acceleration of the optical tag 10 is a predetermined value. The light emission of the first color pattern 11b is repeated as long as it is smaller than the threshold value.

  If the acquired acceleration is equal to or greater than the predetermined threshold (YES in step S54), the second color pattern 11c is read from the color pattern memory 11 (step S60), and the second color pattern 11c is read out by the light emitting unit. 14 to emit light (step S62). Next, the CPU 13 determines whether or not a power-off operation has been performed (step S64). If there is no power-off operation (NO in step S64), the CPU 13 returns to step S52, and the acceleration of the optical tag 10 is a predetermined value. While the value is equal to or greater than the threshold value, the light emission of the second color pattern 11c is repeated.

  On the other hand, if there is a power-off operation (YES in step S64), the process ends.

  As described above, in the second embodiment, the optical tag 10 causes the light emitting unit 14 to emit the first color pattern 11b while the acceleration (the magnitude and speed of movement) of the subject is smaller than the predetermined threshold. On the other hand, when the acceleration (the magnitude and speed of movement) of the subject exceeds a predetermined threshold value, the light emission is switched from the first color pattern 11b to the second color pattern 11c.

  11 and 12 are flowcharts for explaining the operation of the photographing apparatus 20 according to the second embodiment. After preparing the optical tag 10, the user hooks and fixes the handle portion 20 c on a wire mesh or the like, and turns on the power of the photographing apparatus 20 from the key input portion 26 or the like. When the power is turned on, the CPU 27 of the photographing apparatus 20 performs initialization processing (setting of the normal moving image photographing mode) (step S70), and instructs the imaging unit 22 to start live view (step S72). In response to the instruction, the imaging unit 22 starts a live view in which the image captured via the optical lens unit 21 is displayed on the display unit 25 (the image is not stored).

  Next, the CPU 27 executes subject recognition processing for recognizing a subject in the live view image by performing pattern recognition of a person or the like (step S74). Next, the optical tag 10 in the recognized subject frame is detected (step S76), and it is determined whether or not the first color pattern 24b (11b) has been detected (step S78). If the first color pattern 24b (11b) is not detected (NO in step S78), the process returns to step S76, and the detection of the optical tag 10, that is, the detection of the first color pattern 24b (11b) is repeated.

  On the other hand, when the first color pattern 24b (11b) is detected in the subject frame in the live view image (YES in step S78), the subject frame in which the first color pattern 24b (11b) is detected is displayed. Then, it is determined as a specific subject (step S80). The specific subject is a subject to be photographed with the optical tag 10 attached thereto. When the CPU 27 determines a specific subject, the CPU 27 instructs the imaging unit 22 to start moving image shooting (step S82). Thereby, the imaging unit 22 starts moving image shooting in the normal moving image shooting mode. That is, the imaging unit 22 converts an image captured via the optical lens unit 21 at a predetermined frame rate (for example, 30 fps) into an electrical frame image signal, and sequentially stores the image in the flash memory 23 as a moving image.

  Next, the CPU 27 detects the optical tag 10 within the recognized subject frame during the moving image shooting (step S84), and determines whether or not a predetermined color pattern has been detected (step S86). Here, the predetermined color pattern may be either the first color pattern 24b (11b) or the second color pattern 24c (11c).

  If a predetermined color pattern (first color pattern 24b or second color pattern 24c) is detected (YES in step S86), it is determined whether or not a moving image is being captured (step S86). S88). If a moving image is being photographed (YES in step S88), it is determined whether or not the color pattern is changed (first color pattern⇔second color pattern) (step S98 in FIG. 12). If the color pattern has not been changed (NO in step S98), the CPU 27 determines whether or not there has been a shooting stop instruction from the key input unit 26 or the like (step S94 in FIG. 11). If there is no shooting stop instruction (NO in step S94), the process returns to step S84 to detect the optical tag 10, that is, a predetermined color pattern (first color pattern 24b or second color pattern 24c). Repeat detection. Therefore, while a predetermined color pattern is detected, moving image shooting (normal moving image shooting mode or high speed moving image shooting mode) is continued.

  On the other hand, when the predetermined color pattern (the first color pattern 24b or the second color pattern 24c) is not detected during moving image shooting (NO in step S86), the CPU 27 instructs the imaging unit 22 to And instructing the suspension of moving image shooting (step S92). Thereby, the imaging unit 22 temporarily stops moving image shooting. Note that when a predetermined color pattern (first color pattern 24b or second color pattern 24c) is no longer detected, video recording is not paused immediately, but a predetermined time (for example, 20 seconds) , About 30 seconds), and if the predetermined color pattern (the first color pattern 24b or the second color pattern 24c) is not detected again even after the predetermined time has elapsed, video shooting is temporarily performed. You may make it stop.

  Next, the CPU 27 determines whether or not a shooting stop instruction is given from the key input unit 26 or the like (step S94). If there is no shooting stop instruction (NO in step S94), the process returns to step S84, and the optical tag 10 Detection, that is, detection of a predetermined color pattern (first color pattern 24b or second color pattern 24c) is repeated. Therefore, a predetermined color pattern (the first color pattern 24b or the second color) is caused for some reason (for example, when the optical tag 10 is hidden by an obstacle or when a specific subject is out of the angle of view). While the pattern 24c) is not detected, the moving image shooting is temporarily stopped.

  On the other hand, when the predetermined color pattern (first color pattern 24b or second color pattern 24c) is detected again during the pause of the movie shooting (YES in step S86), the movie is being shot. Whether or not (step S88). In this case, since the moving image shooting is paused (NO in step S88), the CPU 27 instructs the imaging unit 22 to resume moving image shooting (step S90). Thereby, the imaging unit 22 resumes moving image shooting. Next, the CPU 27 determines whether or not a shooting stop instruction is given from the key input unit 26 or the like (step S94). If there is no shooting stop instruction (NO in step S94), the process returns to step S84, and the optical tag 10 Detection, that is, detection of a predetermined color pattern (first color pattern 24b or second color pattern 24c) is repeated. Accordingly, when a predetermined color pattern (the first color pattern 24b or the second color pattern 24c) is detected again, moving image shooting is resumed.

  Further, when a predetermined color pattern (first color pattern 24b or second color pattern 24c) is detected in step S86 (YES in step S86), moving image shooting is in progress (YES in step S88). If the color pattern has been changed (YES in step S98 of FIG. 12), the CPU 27 determines whether or not the color pattern is changed to the second color pattern 24c (step S100). If it is not a change to the second color pattern 24c, that is, if it is a change from the second color pattern 24c to the first color pattern 24b (NO in step S100), the current mode is the normal moving image shooting mode. It is determined whether or not there is (step S102).

  If it is currently in the normal moving image shooting mode (YES in step S102), there is no need to change the moving image shooting mode, so the process proceeds to step S94 in FIG. 11 and if there is no shooting stop instruction (in step S94). NO), returning to step S84, the detection of the optical tag 10, that is, the detection of the predetermined color pattern (the first color pattern 24b or the second color pattern 24c) is repeated.

  On the other hand, if it is not the change to the second color pattern 24c, that is, if the change is from the second color pattern 24c to the first color pattern 24b and is currently in the high-speed moving image shooting mode (step S102). NO), since it is necessary to change the moving image shooting mode, the CPU 27 instructs the imaging unit 22 to change to the normal moving image shooting mode (step S104). Thereafter, the process proceeds to step S94 in FIG. 11. If there is no photographing stop instruction (NO in step S94), the process returns to step S84 to detect the optical tag 10, that is, a predetermined color pattern (first color pattern 24b or The detection of the second color pattern 24c) is repeated. That is, in the case of changing from the second color pattern 24c to the first color pattern 24b, the moving image shooting mode is returned from the high speed moving image shooting mode to the normal moving image shooting mode.

  If it is a change to the second color pattern 24c (YES in step S100), the CPU 27 instructs the imaging unit 22 to change to the high-speed moving image shooting mode (step S106). The change to the second color pattern 24 is a case where the acceleration detected by the acceleration sensor 17 in the optical tag 10 is equal to or greater than a predetermined threshold. That is, this is a case where a specific subject (a user wearing the optical tag 10) moves greatly or moves quickly. Therefore, in the case of changing to the second color pattern 24c, the mode is changed to the high-speed moving image shooting mode in order to capture the motion of the specific subject appropriately (that is, without blurring) (step S106). Thereafter, the process proceeds to step S94 in FIG. 11. If there is no photographing stop instruction (NO in step S94), the process returns to step S84 to detect the optical tag 10, that is, a predetermined color pattern (first color pattern 24b or The detection of the second color pattern 24c) is repeated.

  If there is a shooting stop instruction from the key input unit 26 or the like (YES in step S94), the CPU 27 instructs the imaging unit 22 to stop moving image shooting (step S96). Thereby, the imaging unit 22 stops moving image shooting. Thereafter, the CPU 27 ends the process.

  FIG. 13 is a conceptual diagram for explaining the operation of the photographing system 1 according to the second embodiment. For example, when there are a plurality of players A and B who are practicing on a tennis court, an attempt is made to photograph one player B among them. When the players A and B are not included in the angle of view of the imaging unit 22 as in the first status shown in FIG. 13A, the players A and B are not displayed on the display unit 25. The CPU 27 also does not perform subject recognition by pattern recognition at the angle of view 250.

  Next, as shown in the second status shown in FIG. 13B, when a plurality of players A and B move to the tennis court, the players A and B enter the angle of view within the angle of view of the image pickup unit 22, The players A and B are displayed in the section 25, and the CPU 27 detects a plurality of players A and B from the angle of view 250 by subject recognition by pattern recognition. Recognized subjects are indicated by frames 30 and 31. The imaging unit 22 adjusts the subject frames 30 and 31 so that automatic focus and exposure are appropriate.

  Next, as in the third status shown in FIG. 13C, when the CPU 27 of the photographing apparatus 20 detects the optical tag 10 (first color pattern) worn by the specific player B, the angle of view 250 The player B is determined as a specific subject (frame 32), and moving image shooting in the normal moving image shooting mode is started.

  Then, as shown in the fourth status shown in FIG. 13D, when the player B as a specific subject moves and the acceleration by the acceleration sensor 17 exceeds a threshold value, the optical tag 10 has the second color pattern 11c (24c). Emits light. When the CPU 27 of the photographing apparatus 20 detects that the light emission pattern of the optical tag 10 is switched to the second color pattern 11c (24c) at the angle of view 250, the image 251 is switched from the normal moving image shooting mode to the high speed moving image shooting mode. To continue video recording.

  The image capturing unit 22 stores the image captured via the optical lens unit 21 as a moving image as it is in the normal moving image shooting mode and the high speed moving image shooting mode. However, as in the first embodiment described above, the optical tag is used. The image including the subject wearing 10 may be cut out (trimmed) at a predetermined size and recorded as a moving image.

  According to the second embodiment described above, the first color pattern 11b (24b) (first command) emitted from the optical tag 10, which is the visible light communication transmission device worn by the subject, is emitted by the photographing device 20. Since the moving image shooting is started when the information) is detected, it is possible to shoot a moving image in which the subject to which the optical tag 10 is attached is focused and the exposure is appropriately adjusted. As a result, moving image shooting can be performed according to the state of the subject (moving in and out of the angle of view).

  In the optical tag 10, when the acceleration detected by the acceleration sensor 17 is equal to or greater than the threshold, the color pattern to be emitted is switched to the second color pattern 11c (24c) (second command information). Since the photographing apparatus 20 is switched to the high-speed moving image recording mode suitable for photographing a subject with large movement or fast movement, it is necessary to shoot a moving image according to the condition of the subject (fast movement, quick movement, etc.). Can do.

  In the second embodiment described above, the shooting is ended when there is a shooting stop instruction from the key input unit 26 or the like. However, the present invention is not limited to this, and the elapsed time from the start of shooting is counted and a predetermined time has elapsed. It is also possible to automatically end shooting when triggered by this.

  In the second embodiment described above, the normal moving image shooting mode and the high speed moving image shooting mode are switched to each other in accordance with the switching between the first color pattern 11b and the second color pattern 11c emitted by the optical tag 10. However, the present invention is not limited to this, and the normal moving image shooting mode and continuous shooting (still-in movie) during moving image recording may be switched between each other. As a result, a still image can be taken according to the situation of the subject (fast movement, fast movement, etc.). In other words, any combination of the moving image shooting modes in the first color pattern 11b and the second color pattern 11c may be used. In the second color pattern 11c, the state of the subject (moving in and out of the angle of view, quick movement) Any shooting mode may be used as long as it is a moving image shooting mode.

C. Third Embodiment Next, a third embodiment of the present invention will be described.
In addition, since the structure of the imaging | photography system 1, the optical tag 10, and the imaging device 20 by this 3rd Embodiment is the same as that of 2nd Embodiment (FIG. 8 (a), (b)), description is abbreviate | omitted. Further, the operation of the optical tag 10 is also the same as that of the second embodiment (FIG. 10), and the description thereof is omitted.

  In the third embodiment, in the photographing apparatus 20, the CPU 27 receives the light of the first color pattern 24 b (11 b) (first command information) whose color changes with time, thereby the optical tag. 10 is recognized, and moving image shooting in the normal moving object tracking mode is started. The normal moving body tracking mode is a method of performing AF (autofocus) and AE (automatic exposure) while detecting a change in a subject in a captured image by performing pattern recognition of a person or the like and tracking. . Therefore, in the normal moving body tracking mode, not only a specific subject wearing the optical tag 10 but also a person reflected in the angle of view becomes a tracking target.

  In addition, the CPU 27 receives light of the second color pattern 24c (11c) (first command information) whose color changes with time, so that the specific moving body tracking different from the normal moving body tracking mode is performed. Switch to mode and continue to shoot movies. The specific moving body tracking mode is a method of performing AF (autofocus) and AE (automatic exposure) while detecting and tracking a change in a specific subject wearing the optical tag 10. Therefore, in the specific moving body tracking mode, the specific subject wearing the optical tag 10 becomes the tracking target.

  Switching to the second color pattern 24c (11c) is when the acceleration detected by the acceleration sensor 17 of the optical tag 10 is equal to or greater than a predetermined threshold, as described above. That is, it is a case where a specific subject moves or moves quickly. In such a case, by applying a specific moving body tracking mode, it is possible to accurately track a specific subject that moves or moves quickly.

Next, the operation of the photographing apparatus 20 according to the third embodiment described above will be described.
14 and 15 are flowcharts for explaining the operation of the photographing apparatus 20 according to the third embodiment. After preparing the optical tag 10, the user hooks and fixes the handle portion 20 c on a wire mesh or the like, and turns on the power of the photographing apparatus 20 from the key input portion 26 or the like. When the power is turned on, the CPU 27 of the photographing apparatus 20 performs an initialization process (setting of a normal moving object tracking mode) (step S120), and instructs the imaging unit 22 to start a live view (step S122). In response to the instruction, the imaging unit 22 starts a live view in which the image captured via the optical lens unit 21 is displayed on the display unit 25 (the image is not stored).

  Next, the CPU 27 executes subject recognition processing for recognizing a subject in the live view image by performing pattern recognition of a person or the like (step S124). Next, the optical tag 10 in the recognized subject frame is detected (step S126), and it is determined whether or not the first color pattern 24b (11b) has been detected (step S128). If the first color pattern 24b (11b) is not detected (NO in step S128), the process returns to step S126, and the detection of the optical tag 10, that is, the detection of the first color pattern 24b (11b) is repeated.

  On the other hand, when the first color pattern 24b (11b) is detected in the subject frame in the live view image (YES in step S128), the subject frame in which the first color pattern 24b (11b) is detected is displayed. Then, it is determined as a specific subject (step S130). The specific subject is a subject to be photographed with the optical tag 10 attached thereto. When the CPU 27 determines a specific subject, the CPU 27 instructs the imaging unit 22 to start moving image shooting (step S132). Thereby, the imaging unit 22 starts moving image shooting in the normal moving object tracking mode. That is, the imaging unit 22 converts an image captured via the optical lens unit 21 into an electrical frame image signal, and sequentially stores it as a moving image in the flash memory 23.

  Next, the CPU 27 detects the optical tag 10 in the recognized subject frame during the moving image shooting (step S134), and determines whether or not a predetermined color pattern is detected (step S136). Here, the predetermined color pattern may be either the first color pattern 24b (11b) or the second color pattern 24c (11c).

  If a predetermined color pattern (first color pattern 24b or second color pattern 24c) is detected (YES in step S136), it is determined whether or not a moving image is being captured (step S136). S138). If a moving image is being photographed (YES in step S138), it is determined whether or not the color pattern is changed (first color pattern⇔second color pattern) (step S148 in FIG. 15). If the color pattern has not been changed (NO in step S148), the CPU 27 determines whether or not a shooting stop instruction has been issued from the key input unit 26 or the like (step S144 in FIG. 14). If there is no shooting stop instruction (NO in step S144), the process returns to step S134 to detect the optical tag 10, that is, a predetermined color pattern (first color pattern 24b or second color pattern 24c). Repeat detection. Therefore, while the predetermined color pattern is detected, moving image shooting (normal moving body tracking mode or specific moving body tracking mode) is continued.

  On the other hand, when the predetermined color pattern (first color pattern 24b or second color pattern 24c) is not detected during moving image shooting (NO in step S136), the CPU 27 instructs the imaging unit 22 to And instructing the suspension of moving image shooting (step S142). Thereby, the imaging unit 22 temporarily stops moving image shooting. Note that when a predetermined color pattern (first color pattern 24b or second color pattern 24c) is no longer detected, video recording is not paused immediately, but a predetermined time (for example, 20 seconds) , About 30 seconds), and if the predetermined color pattern (the first color pattern 24b or the second color pattern 24c) is not detected again even after the predetermined time has elapsed, video shooting is temporarily performed. You may make it stop.

  Next, the CPU 27 determines whether or not a shooting stop instruction has been given from the key input unit 26 or the like (step S144). If there is no shooting stop instruction (NO in step S144), the process returns to step S134, and the optical tag 10 Detection, that is, detection of a predetermined color pattern (first color pattern 24b or second color pattern 24c) is repeated. Therefore, a predetermined color pattern (the first color pattern 24b or the second color) is caused for some reason (for example, when the optical tag 10 is hidden by an obstacle or when a specific subject is out of the angle of view). While the pattern 24c) is not detected, the moving image shooting is temporarily stopped.

  On the other hand, when the predetermined color pattern (first color pattern 24b or second color pattern 24c) is detected again during the pause of movie shooting (YES in step S136), movie shooting is in progress. Whether or not (step S138). In this case, since moving image shooting is temporarily stopped (NO in step S138), the CPU 27 instructs the imaging unit 22 to resume moving image shooting (step S140). Thereby, the imaging unit 22 resumes moving image shooting.

  Next, the CPU 27 determines whether or not a shooting stop instruction has been given from the key input unit 26 or the like (step S144). If there is no shooting stop instruction (NO in step S144), the process returns to step S134, and the optical tag 10 Detection, that is, detection of a predetermined color pattern (first color pattern 24b or second color pattern 24c) is repeated. Therefore, when a predetermined color pattern (the first color pattern 24b or the second color pattern 24c) is detected again, moving image shooting is resumed in the moving object tracking mode at that time.

  Further, when a predetermined color pattern (first color pattern 24b or second color pattern 24c) is detected in step S136 (YES in step S136), moving image shooting is in progress (YES in step S138). If the color pattern is changed (YES in step S148 in FIG. 15), the CPU 27 determines whether or not the color pattern is changed to the second color pattern 24c (step S150). If it is not a change to the second color pattern 24c, that is, if it is a change from the second color pattern 24c to the first color pattern 24b (NO in step S150), the current moving object tracking mode is currently set. It is determined whether or not (step S152).

  If it is currently in the normal moving body tracking mode (YES in step S152), there is no need to change the moving body tracking mode, so the process proceeds to step S144 in FIG. 14, and if there is no shooting stop instruction (step S144). NO), returning to step S134, the detection of the optical tag 10, that is, the detection of the predetermined color pattern (the first color pattern 24b or the second color pattern 24c) is repeated.

  On the other hand, if the change is not the change to the second color pattern 24c, that is, the change is from the second color pattern 24c to the first color pattern 24b, and the current moving object tracking mode is in effect (step S152). NO), since it is necessary to change the moving body tracking mode, the CPU 27 instructs the imaging unit 22 to change to the normal moving body tracking mode (step S154). Thereafter, the process proceeds to step S144 in FIG. 14, and if there is no shooting stop instruction (NO in step S144), the process returns to step S134 to detect the optical tag 10, that is, a predetermined color pattern (first color pattern 24b or The detection of the second color pattern 24c) is repeated. That is, in the case of the change from the second color pattern 24c to the first color pattern 24b, the moving object tracking mode is returned from the specific moving object tracking mode to the normal moving object tracking mode.

  If it is a change to the second color pattern 24c (YES in step S150), the CPU 27 instructs the imaging unit 22 to change to a specific moving object tracking mode (step S156). The change to the second color pattern 24 is a case where the acceleration detected by the acceleration sensor 17 in the optical tag 10 is equal to or greater than a predetermined threshold. That is, this is a case where a specific subject (a user wearing the optical tag 10) moves greatly or moves quickly.

  Therefore, in the case of a change to the second color pattern 24c, in order to properly track and shoot the movement of the specific subject (that is, without focusing, the specific subject is focused and exposed). Is appropriately adjusted), the mode is changed to a specific moving body tracking mode (step S156). Thereafter, the process proceeds to step S144 in FIG. 14, and if there is no shooting stop instruction (NO in step S144), the process returns to step S134 to detect the optical tag 10, that is, a predetermined color pattern (first color pattern 24b or The detection of the second color pattern 24c) is repeated.

  If there is a shooting stop instruction from the key input unit 26 or the like (YES in step S144), the CPU 27 instructs the imaging unit 22 to stop moving image shooting (step S146). Thereby, the imaging unit 22 stops moving image shooting. Thereafter, the CPU 27 ends the process.

  FIG. 16 is a conceptual diagram for explaining the operation of the photographing system 1 according to the third embodiment. For example, when there are a plurality of players A and B who are practicing on a tennis court, an attempt is made to photograph one player B among them. When the players A and B are not included in the angle of view of the imaging unit 22 as in the first status shown in FIG. 16A, the players A and B are not displayed on the display unit 25. The CPU 27 does not perform subject recognition by pattern recognition at the angle of view 250.

  Next, as shown in the second status shown in FIG. 16B, when a plurality of players A and B move to the tennis court, the players A and B enter the angle of view within the angle of view of the imaging unit 22. The players A and B are displayed in the section 25, and the CPU 27 detects a plurality of players A and B at the angle of view 250 by subject recognition by pattern recognition. Recognized subjects are indicated by frames 30 and 31. The imaging unit 22 adjusts the subject frames 30 and 31 so that automatic focus and exposure are appropriate.

  Next, as in the third status shown in FIG. 16C, when the CPU 27 of the photographing device 20 detects the optical tag 10 (first color pattern 24b) worn by the specific player B, the player B is determined as a specific subject (frame 32), and moving image shooting in the normal moving object tracking mode is started.

  Then, as in the fourth status shown in FIG. 16D, when the player B as a specific subject moves and the acceleration by the acceleration sensor 17 becomes equal to or greater than the threshold, the optical tag 10 is in the second color pattern 11c (24c). Emits light. When the CPU 27 of the photographing apparatus 20 detects that the light emission pattern of the optical tag 10 has been switched to the second color pattern 11c (24c), the normal moving body tracking mode is switched to the specific moving body tracking mode and the moving image shooting is performed for the image 251. Continue.

  The imaging unit 22 stores the image captured through the optical lens unit 21 as a moving image as it is in the normal moving body tracking mode and the specific moving body tracking mode. However, as in the first embodiment described above, An image including a subject wearing the tag 10 may be cut out (trimmed) at a predetermined size and recorded as a moving image.

  According to the third embodiment described above, the first color pattern 11b (24b) (first command) emitted from the optical tag 10 which is the visible light communication transmission device attached to the subject itself is photographed by the photographing device 20. (Information) is detected, the video recording is started in the normal moving body tracking mode, so that the tracking target can be reliably captured, the subject to which the optical tag 10 is attached is focused, and the exposure is also You can shoot a properly adjusted video. As a result, moving image shooting can be performed in a normal moving body tracking mode according to the state of the subject (moving in and out of the angle of view).

  Further, according to the third embodiment described above, in the optical tag 10, the color pattern that emits light is triggered by the second color pattern 11c (24c) when the acceleration detected by the acceleration sensor 17 is equal to or greater than the threshold value. When switched to (second command information), the photographing apparatus 20 is switched to a specific moving body tracking mode capable of tracking a subject having a large movement or a fast movement. The subject can be tracked with high accuracy, and a moving image can be taken according to the state of the subject (fast movement, fast movement, etc.).

  In the third embodiment described above, the shooting is ended when there is a shooting stop instruction from the key input unit 26 or the like. However, the present invention is not limited to this. You may make it complete | finish photography automatically when it passes.

  In the second embodiment described above, the moving image shooting mode is changed by changing the first color pattern to the second color pattern. However, the present invention is not limited to this, and the second embodiment and the third embodiment are not limited thereto. You may make it change a video recording mode, combining a form and tracking.

  In the first to third embodiments described above, a color pattern in which different colors are arranged in time series is emitted. However, the present invention is not limited to this, and the luminance level of monochromatic light is changed, the lighting time and the lighting cycle are changed. A plurality of optical signals may be generated and used by changing them.

  In the method of externally controlling the imaging device using a wireless system such as Bluetooth (registered trademark) or infrared of the prior art, new hardware for receiving the Bluetooth (registered trademark), infrared, or the like is newly added to the imaging device. Although it is necessary to provide, in the external control system of the imaging device using visible light communication according to the present invention, the visible light on which information is superimposed is recognized and controlled from the outside by the imaging element originally provided in the imaging device, so the imaging device It has an excellent effect that external control is possible without adding any hardware.

  Further, in a wireless system such as Bluetooth (registered trademark) or infrared of the prior art, the communication distance is generally short-distance communication with a maximum of about 10 meters. However, in the visible light communication according to the present invention, the imaging device is provided. Since even one pixel in the image pickup device recognizes visible light on which information is superimposed, communication is possible, so that it has an excellent effect that external control is possible even from a place several hundred meters or more away.

As mentioned above, although several embodiment of this invention was described, this invention is not limited to these, The invention described in the claim, and its equal range are included.
Below, the invention described in the claims of the present application is appended.

(Appendix 1)
The invention described in appendix 1 is a photographing system including a light emitting unit that emits visible light including arbitrary information, and a photographing device having a moving image photographing function,
The light emitting unit is
A light emitting means for emitting visible light including the first command information;
The imaging device
Imaging means;
Visible light information obtaining means for receiving visible light emitted from the light emitting means with the imaging means and obtaining information included in the visible light;
When the information acquired by the visible light information acquisition unit is the first command information, the imaging system includes: a moving image shooting instruction unit that instructs the imaging unit to perform moving image shooting.

(Appendix 2)
In the invention described in appendix 2, the photographing apparatus is
If the information obtained by the visible light information acquisition unit is the first command information, the moving image for a predetermined time is constantly updated and recorded, and when the first command information is received, the predetermined time from when the first command information is received. The imaging system according to appendix 1, further comprising recording control means for recording as a moving image from a point in time that is traced back.

(Appendix 3)
In the invention according to attachment 3, the light emitting unit is
An acceleration sensor for detecting the acceleration of the light emitting unit;
Acceleration determining means for determining whether or not the acceleration of the light emitting unit detected by the acceleration sensor is equal to or greater than a predetermined threshold;
The light emitting means includes
When the determination result of the acceleration determination means is smaller than a predetermined threshold, visible light including the first command information is emitted, and when the determination result of the acceleration determination means is greater than or equal to a predetermined threshold, the second command Emits visible light containing information,
In the photographing apparatus,
The imaging means includes
As the moving image shooting function, a moving image is shot at a first frame rate or a second frame rate that is larger than the first frame rate,
The moving image shooting instruction means
When the information acquired by the visible light information acquisition unit is the first command information, the imaging unit is instructed to perform moving image shooting at the first frame rate, and the visible light information acquisition unit When the information acquired in (2) is the second command information, the imaging unit is instructed to perform moving image shooting at the second frame rate. is there.

(Appendix 4)
In the invention described in appendix 4, the moving image shooting instruction means includes:
When the information acquired by the visible light information acquisition unit is the first command information, the imaging unit is instructed to perform moving image shooting at the first frame rate, and the visible light information acquisition unit The imaging system according to appendix 3, characterized in that when the information acquired in step 2 is the second command information, the imaging unit is instructed to perform continuous shooting during moving image shooting.

(Appendix 5)
The invention according to appendix 5 is directed to the photographing apparatus,
The imaging means includes
As the moving image shooting function, moving image shooting is performed by either the first moving body tracking method for tracking a subject recognized by pattern recognition or the second moving body tracking method for tracking a subject to which the light unit is attached. And
The moving image shooting instruction means
When the information acquired by the visible light information acquisition means is the first command information, the imaging means is instructed to perform moving image shooting by the first moving body tracking, and the visible light information acquisition means When the information acquired in (2) is the second command information, the imaging unit is instructed to perform moving image shooting with the second moving object tracking. is there.

(Appendix 6)
In the invention according to appendix 6, the light emitting means is
The imaging system according to appendix 1, wherein the first command information is emitted with a first color pattern in which color components RGB are arranged in a predetermined order.

(Appendix 7)
In the invention according to appendix 7, the light emitting means is
The first command information is emitted with a first color pattern in which color components RGB are arranged in a predetermined order, and the second command information is different from a predetermined order corresponding to the first command information. The imaging system according to any one of appendices 3 to 5, wherein light is emitted in a second color pattern arranged in order.

(Appendix 8)
The invention described in appendix 8 is a photographing device including a photographing device having a moving image photographing function,
Imaging means;
Visible light information obtaining means for receiving visible light emitted from the light emitting means with the imaging means and obtaining information included in the visible light;
When the information acquired by the visible light information acquisition unit is the first command information, the imaging device includes: a moving image shooting instruction unit that instructs the imaging unit to perform moving image shooting.

(Appendix 9)
In the invention described in appendix 9, the imaging unit includes:
As the moving image shooting function, a moving image is shot at a first frame rate or a second frame rate that is larger than the first frame rate,
The moving image shooting instruction means
When the information acquired by the visible light information acquisition unit is the first command information, the imaging unit is instructed to perform moving image shooting at the first frame rate, and the visible light information acquisition unit When the information acquired in (2) is the second command information, the imaging unit is instructed to perform moving image shooting at the second frame rate. is there.

(Appendix 10)
In the invention described in appendix 10, the imaging unit includes:
As the moving image shooting function, moving image shooting is performed by either the first moving body tracking method for tracking a subject recognized by pattern recognition or the second moving body tracking method for tracking a subject to which the light unit is attached. And
The moving image shooting instruction means
When the information acquired by the visible light information acquisition unit is the first command information, the imaging unit is instructed to perform moving image shooting by the first moving body tracking method, and the visible light information acquisition is performed. The imaging according to appendix 8, characterized in that, when the information acquired by the means is the second command information, the imaging means is instructed to perform moving image shooting by the second moving body tracking method. Device.

(Appendix 11)
The invention described in appendix 11 is a photographing method using a photographing device having an image pickup means,
Visible light information acquisition step of receiving visible light emitted from a light emitting unit that emits visible light including arbitrary information mounted on a subject with the imaging unit, and acquiring information included in the visible light;
And a moving image shooting instruction step for instructing to perform moving image shooting by the imaging means when the acquired information is first command information.

(Appendix 12)
In the invention according to attachment 12, the moving image shooting instruction step includes:
When the acquired information is the first command information, the imaging unit is instructed to perform moving image shooting at the first frame rate, and when the acquired information is the second command information The imaging method according to appendix 11, wherein the imaging unit is instructed to perform movie shooting at a second frame rate that is higher than the first frame rate.

(Appendix 13)
In the invention according to attachment 13, the moving image shooting instruction step includes:
When the acquired information is the first command information, the imaging unit is instructed to perform moving image shooting by a first moving body tracking method for tracking a subject recognized by pattern recognition, and the acquired The imaging method according to appendix 11, wherein when the information is the second command information, the imaging unit is instructed to perform moving image shooting by the second moving object tracking method.

(Appendix 14)
The invention according to appendix 14 is provided in a computer of an imaging apparatus having an imaging means.
Visible light information acquisition function for receiving visible light emitted from a light emitting unit that emits visible light including arbitrary information attached to at least a subject and acquiring information included in the visible light,
When the acquired information is first command information, a program for executing a moving image shooting instruction function for instructing to perform moving image shooting by the imaging unit is provided.

(Appendix 15)
In the invention according to attachment 15, the moving image shooting instruction function
When the acquired information is the first command information, the imaging unit is instructed to perform moving image shooting at the first frame rate, and when the acquired information is the second command information The program according to appendix 14, wherein the imaging unit is instructed to perform moving image shooting at a second frame rate greater than the first frame rate.

(Appendix 16)
In the invention described in appendix 16, the moving image shooting instruction function includes:
When the acquired information is the first command information, the imaging unit is instructed to perform moving image shooting by a first moving body tracking method for tracking a subject recognized by pattern recognition, and the acquired 15. The program according to appendix 14, wherein when the information is the second command information, the imaging unit is instructed to perform moving image shooting by the second moving object tracking method.

DESCRIPTION OF SYMBOLS 1 Image | photographing system 10 Optical tag 11 Color pattern memory 11a Color pattern 11b 1st color pattern 11c 2nd color pattern 12 Timing generator 13 CPU
DESCRIPTION OF SYMBOLS 14 Light emission part 15 Light emission window 20 Image pick-up device 21 Optical lens part 22 Image pickup part 23 Flash memory 24 Memory 24a Color pattern 24b 1st color pattern 24c 2nd color pattern 25 Display part 26 Key input part 27 CPU

Claims (15)

An imaging system comprising a light emitting device that emits visible light including arbitrary information and an imaging device having a plurality of imaging functions,
The light emitting device
A light emitting means for emitting visible light including command information corresponding to each of the plurality of photographing functions of the photographing device;
The imaging device
Imaging means;
Visible light information obtaining means for receiving visible light emitted from the light emitting means with the imaging means and obtaining the command information included in the visible light;
Based on the command information acquired by the visible light information acquisition unit, an imaging instruction unit that instructs execution of at least one of the plurality of imaging functions;
Trimming means for cutting out a region where visible light including the command information exists at a predetermined size;
Recording control means for recording the image trimmed by the trimming means;
An imaging system comprising:   The photographing system according to claim 1, wherein the light emitting unit emits light with a color pattern in which color components RGB are arranged in a predetermined order as the command information. The imaging device
A holding unit that holds a predetermined amount of an image captured by the imaging unit while being updated;
Prepared ,
Said recording control means, imaging system according to claim 1 or 2, characterized in the Turkey be recorded by selecting the image held at a predetermined timing from the images held in said holding means. The imaging instruction means instructs the imaging means to execute moving image imaging when the command information acquired by the visible light information acquisition means is predetermined command information . The imaging system according to any one of the above. The holding means holds the moving image shot by the imaging means for a predetermined time while updating,
When the command information acquired by the visible light information acquisition unit is predetermined command information, the recording control unit traces a moving image held by the holding unit for a predetermined time from the time when the predetermined command information is received. Record from the time
The imaging system according to claim 3 .   The light emitting means emits light in a first color pattern in which color components RGB are arranged in a predetermined order as first command information, and in a predetermined order corresponding to the first command information as second command information. The imaging system according to claim 1, wherein light is emitted in a second color pattern arranged in a different order from. The light emitting device
A sensor for detecting the state of the light emitting device;
Determination means for determining whether a value detected by the sensor is equal to or greater than a preset threshold;
A light emission control means for controlling the light emission means to emit visible light including the command information according to the determination result of the determination means;
The imaging system according to claim 1 , further comprising: The sensor detects acceleration of the light emitting device;
The determination means determines whether or not an acceleration detected by the sensor is equal to or greater than a preset threshold;
The imaging system according to claim 7 . The light emission control means emits visible light including first command information when the magnitude of acceleration determined by the determination means is smaller than a predetermined threshold, and the magnitude of acceleration determined by the determination means is predetermined. The imaging system according to claim 8 , wherein the light emitting unit is controlled to emit visible light including second command information when the threshold value is equal to or greater than the threshold value. An imaging system comprising a light emitting device that emits visible light including arbitrary information and an imaging device having a plurality of imaging functions,
The light emitting device
A light emitting means for emitting visible light including command information corresponding to each of the plurality of photographing functions of the photographing device;
A sensor for detecting acceleration of the light emitting device;
Determination means for determining whether or not the acceleration detected by the sensor is equal to or greater than a preset threshold;
When the magnitude of the acceleration determined by the determining means is smaller than a predetermined threshold, visible light including the first command information is emitted, and when the magnitude of the acceleration determined by the determining means is greater than or equal to a predetermined threshold And a light emission control means for controlling the light emission means to emit visible light including second command information,
The imaging device
Imaging means for capturing a moving image at a first frame rate or a second frame rate faster than the first frame rate;
Visible light information obtaining means for receiving visible light emitted from the light emitting means with the imaging means and obtaining the command information included in the visible light;
When the command information acquired by the visible light information acquisition unit is the first command information, the imaging unit is instructed to perform moving image shooting at the first frame rate, and the visible light information When the command information acquired by the acquisition unit is the second command information, a shooting instruction unit that instructs the imaging unit to perform moving image shooting at the second frame rate;
An imaging system comprising: The imaging instruction means instructs the imaging means to perform moving image shooting at the first frame rate when the command information acquired by the visible light information acquisition means is the first command information. When the command information acquired by the visible light information acquisition unit is the second command information, the imaging unit is instructed to perform continuous shooting during moving image shooting. The imaging system according to claim 10 . In the photographing apparatus,
The imaging means includes
Movie shooting is performed using either the first moving body tracking method for tracking a subject recognized by pattern recognition or the second moving body tracking method for tracking a subject to which the light emitting device is attached,
The photographing instruction means includes
When the command information acquired by the visible light information acquisition unit is the first command information, the imaging unit is instructed to perform moving image shooting by the first moving body tracking, and the visible light information If the command information acquired by the acquisition unit is the second command information, the imaging unit is instructed to perform moving image shooting by the second moving body tracking;
The imaging system according to claim 10. An imaging method comprising a light emitting device that emits visible light including arbitrary information, and an imaging device that includes an imaging unit and has a plurality of imaging functions,
In the light emitting device,
A light emitting step of emitting visible light including command information corresponding to each of the plurality of photographing functions of the photographing device;
In the photographing apparatus,
Visible light information acquisition step of receiving visible light emitted in the light emitting step with the imaging means and acquiring the command information included in the visible light;
Based on the command information acquired in the visible light information acquisition step, a shooting instruction step for instructing execution of at least one of the plurality of shooting functions;
A trimming step of cutting out a region where visible light including the command information exists at a predetermined size;
A recording control step for recording the image trimmed by the trimming step;
A photographing method characterized by comprising: An imaging device having a plurality of imaging functions,
Imaging means;
Visible light information acquisition means for receiving visible light including command information with the imaging means and acquiring the command information included in the visible light;
Based on the command information acquired by the visible light information acquisition unit, an imaging instruction unit that instructs execution of at least one of the plurality of imaging functions;
Trimming means for cutting out a region where visible light including the command information exists at a predetermined size;
Recording control means for recording the image trimmed by the trimming means;
An imaging apparatus comprising: In a computer of a photographing apparatus having a plurality of photographing functions provided with an imaging means,
Visible light information acquisition function for receiving visible light including command information with the imaging means and acquiring the command information included in the visible light,
A shooting instruction function for instructing execution of at least one of the plurality of shooting functions based on the command information acquired by the visible light information acquisition function;
A trimming function for cutting out a region where visible light including the command information exists at a predetermined size;
A recording control function for recording an image trimmed by the trimming function;
A program characterized by having executed.

Images