JP2002290963A - Image tracking system, portable information terminal, image tracking device and photographing method for tracking image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image tracking system, with which a photographing starting point can be freely set in a photographing enable area over a wide range and photographing can be performed by exact automatic tracking. SOLUTION: An image tracking system 1 is composed of an image tracking device 8 with a built-in image recognizing means 37 and a portable telephone set 9, which incorporates a position information detecting means 19 and is mounted on a skier as an object to be photographed. Based on two-way interactive communication with the portable telephone set 9, the image tracking device 8 first photographs the shape of the skier in a form photographing area and registers shape data (first process). Next, the skier is photographed based on position information detected with an arbitrary position inside the photographing enable area as a photographing starting point and the shape data in photographed image data are locked based on image recognition(second process). Then, the skier under skiing is automatically tracked and photographed while maintaining the locked state based on the position information and the image recognition (third process).

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image tracking system for capturing an image of a moving object while automatically tracking the object.
The present invention relates to a portable information terminal and an image tracking device that are components of an image tracking system, and a method of capturing a tracking image by the image tracking system.

[0002]

2. Description of the Related Art Conventionally, in order to improve the skill level of sports, for example, skiers, a person taking a slide on a slope is photographed with a video camera, and a recorded image is reproduced. I may refer to it. This has the advantage that you can check your posture and habit when you are on the run, but on the other hand, the video camera is expensive, and you need to carry the video camera or shoot with the video camera There is a problem that a person having the above imaging technique is required.

[0003] To solve these problems, there is an image tracking system that automatically tracks and shoots the appearance of a skier at an indoor ski resort. This image tracking system is mainly configured with an image processing device. First, when a skier, which is an object to be photographed, is located at a set photographing start point, the skier's figure is photographed with a camera, and shape data serving as a tracking index is registered. Thereafter, when the skier slides in the predetermined sliding area set as the shooting area, the shape data is always present near the center of the image data by performing pattern matching between the image data shot by the camera and the registered shape data. Drive control (that is, automatic tracking) is performed so as to capture a skier's tracking image. The photographed image data is recorded, reproduced on a predetermined monitor, and can be viewed by skiers.

[0004]

However, in this image tracking system, since the skier is tracked only by the image recognition processing, the registered skier who is sliding is wearing ski wear similar to this. In the case where the image is taken at the same time as the skier of the above, or when the image is taken together with a large number of other skiers, the error rate of the pattern matching becomes high, and accurate tracking cannot be performed. For this reason, for example, a special sliding area for capturing a tracking image is set, and image recognition such as another skier, that is, a restriction that an obstacle for automatic tracking cannot enter the sliding area. Conditions had to be set.

In addition, since the shooting start point is set, the course on which the skier slides is limited, and the change in the course tends to be poor. There was also a problem that it was not possible. Therefore, the profitability of such an image tracking system for capital investment is low, and it is difficult to spread it to ski resorts in various places.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned circumstances, and accordingly, has as its object the purpose of freely setting a photographing start point in a wide photographing area, and enabling accurate automatic start-up even if there is an obstacle in the photographing area. An object of the present invention is to provide an image tracking system capable of capturing images by tracking, a portable information terminal and an image tracking device capable of constructing an image tracking system by arbitrarily combining them, and a method of capturing a tracking image by the image tracking system.

[0007]

To achieve the above object, the means described in claim 1 can be employed. According to this means, in the portable information terminal attached to the object to be photographed,
Since the current position of the object to be photographed is detected and this position information is transmitted to the image tracking device, the position of the object to be photographed can always be grasped by the image tracking device, and the starting point of the tracking image can be freely determined. Can be set.

In the image tracking device, the position information,
And, based on image recognition by pattern matching,
Since the tracking image of the photographed object is photographed, for example, even if there is an obstacle or the like in the photographing area, the photographed object can be accurately tracked. Therefore, it is not necessary to provide a dedicated photographing area as shown in the conventional example, and it is within a range in which the position information can be transmitted from the portable information terminal to the image tracking device, and within a photographable range of the object to be photographed by the photographing means. In this case (hereinafter simply referred to as a photographable area), the photographable area can be set freely. Moreover, the photographable area can be easily enlarged.

[0009] Further, by recording the image data of the captured tracking image in the image recording means, it is possible to control the reproduction and download of the recorded image data in response to a request from a portable information terminal, for example.

According to the second aspect of the present invention, in the image tracking apparatus, since the photographing direction and the photographing magnification of the photographing means with respect to the position information are recorded as the photographing parameters, the position is determined in accordance with the moving object to be photographed. Every time the information changes, it is possible to omit the arithmetic processing for calculating the photographing direction and the photographing magnification. This makes it possible to reduce the amount of arithmetic processing in the device-side control means, and also to shorten the time from when the position information is detected to when the driving of the photographing means is controlled to the predetermined photographing direction and photographing magnification.

According to the third aspect of the present invention, two-way communication between the portable information terminal and the image tracking device becomes possible. It is possible to capture a tracking image of the object to be captured while performing communication.

According to the fourth aspect of the present invention, in the image tracking device, the shape data is registered by photographing the shape of the object to be photographed, so that the shape data can be easily registered. . Also, for example, even when it is determined that the registered shape data is inappropriate for image recognition, it is possible to easily retake and re-register.

According to the fifth aspect of the present invention, in the portable information terminal, the image data sent from the image tracking device is displayed on the display means. The image data of the image can be displayed on the display means. Thus, the photographing client can easily confirm the content of the recorded tracking image only with the portable information terminal.

According to the means described in claim 6, in the portable information terminal, the identification information for identifying the photographing requester of the tracking image is registered in the information registering means. Based on this identification information, a plurality of photographing requesters can be determined. The image tracking device can also be configured to register shape data or record image data of a tracking image in association with the identification information. When these are stored, it is possible to easily manage and search them.

According to the means described in claim 7, in the portable information terminal, the information registration means is configured to be detachable.
A plurality of photographing requesters may each have only the information registering means and share the portable information terminal. As an example, it is assumed that a photographing service provider that provides a photographing client with a photographing service of a tracking image of an object to be photographed rents a portable information terminal using an image tracking system.
In this case, since the photographing client only needs to purchase the information registration means, the economic burden is reduced, and the image tracking system can be used easily.

According to the means described in claim 8, in the image tracking apparatus, when the apparatus itself is controlled in response to a request from the portable information terminal (when the photographing client uses the image tracking system). Since the use fee collecting means for collecting the use fee is provided, the photographing service provider can automatically collect the use fee from the photographing requester. On the other hand, the photographing client can save the trouble of paying the usage fee by himself.

According to the ninth and tenth aspects, the image tracking system can be constructed by arbitrarily combining the portable information terminal and the image tracking device. Thus, for example, when the portable information terminal breaks down, the image tracking system can be easily reconfigured only by replacing the portable information terminal.

According to the means described in claim 11, as a method of capturing a tracking image, in a first step, shape data is registered, and in a second step, an image to be captured is obtained based on position information and image recognition. In the third step, the shape data is locked in the image data of the photographed object, and in the third step, the locked state is maintained based on the position information and the image recognition, and the photographing is performed while tracking the photographed object. Therefore, the same effect as that of the first aspect can be obtained.

At this time, as a first step, the portable information terminal transmits a registration command of the shape data and the identification information, and in response thereto, the image tracking device associates the identification information with the identification information and transmits the registration instruction. The registration of the shape data of the photographed object may be performed.

As a second step, the portable information terminal transmits the position information, the lock command and the identification information, and in response to this, the image tracking device causes the lock generated by the image recognition to be transmitted. In this case, the portable information terminal may transmit lock confirmation information relating to correct / incorrect judgment and correction of the lock image data.

As a third step, the portable information terminal transmits position information and a shooting start command,
In response, the image tracking device captures a tracking image while tracking the object to be captured, and after a predetermined time has elapsed, transmits a capturing end command to the portable information terminal to respond to this. Then, the image tracking device may end the shooting of the tracking image (claim 14).

As described above, the photograph client can easily register the shape data of the object to be photographed only by operating the portable information terminal. In addition, it is possible to easily lock the shape data in the image data and start and end photographing of the tracking image from any place within the photographable area.

[0023]

DESCRIPTION OF THE PREFERRED EMBODIMENTS [Embodiment] Hereinafter, an embodiment in which the image tracking system of the present invention is applied to a system in which an image is taken while tracking a skier skiing in a ski resort will be described with reference to FIGS. This will be described with reference to FIG.

<Outline of Image Tracking System> First, an outline of the image tracking system 1 will be described. FIG. 2 shows an example of installation of the image tracking system 1 in a ski resort. In FIG. 2, a slope on which a skier 2 who is an object to be photographed and who is a photograph requester can slide is set in a photographable area 3 (described later). In a place where the photographable area 3 can be overlooked, a headquarters building 4 where a photographing service provider as a photographing service provider is stationed is constructed. The headquarters building 4 has a tracking image photographing device (described later,
Hereinafter, this device is simply referred to as the present device) 5. Also,
On a flat place down the slope, a shape photographing device (hereinafter, simply referred to as a sub device) 6 for photographing the shape of the skier 2 is installed. Is set for the shape photographing area 7 in which is located. The image tracking device 8 is configured by the present device 5 and the sub device 6.

The skier 2 is equipped with a portable telephone 9 (to be described later) as a portable information terminal, and the portable telephone 9 and the image tracking device 8 are configured to be capable of two-way communication via a public line network 10. ing. Then, based on the interactive two-way communication performed between the mobile phone 9 and the image tracking device 8, the tracking image of the skier 2 sliding in the shooting area 3 is captured by the image tracking device 8. Has become. Further, in the image tracking device 8, a purchase price, which is a usage fee when the skier 2 purchases image data of the captured tracking image, is collected. The image tracking system 1 is composed of the image tracking device 8 and the mobile phone 9.

<Configuration of Image Tracking System 1> Next, the configuration of the image tracking system 1 will be described. FIG. 1 shows an electric block diagram of the image tracking device 8 and the mobile phone 9.

{Configuration of Mobile Phone 9} First, the configuration of the mobile phone 9 will be described with reference to FIG. FIG. 3 shows the external appearance of the mobile phone 9. A key operation unit 12 including a plurality of operation keys, a microphone 13, and a liquid crystal display unit serving as a display unit are provided on the front of a housing 11 of the mobile phone 9. 14, a speaker 15 is provided. A telescopic rod antenna 16 is provided on the upper surface of the housing 11. Further, a SIM (Subscriber Identification Module) as information registration means is provided on the upper rear surface of the housing 11.
e) A SIM card slot (not shown) into which the card 20 (see FIG. 1) can be inserted and removed is mounted.

In FIG. 1, the mobile phone 9 operates based on electric power supplied from a secondary battery (not shown). Terminal-side control unit 17 as terminal-side control means
Is composed of an electric circuit mainly composed of a CPU,
On the basis of the terminal-side control program recorded in 8, electrical control of the entire mobile phone 9, such as voice and data communication processing, is performed. In particular, the mobile phone 9 has a multi-call connection function that enables simultaneous communication of voice and data and simultaneous communication of a plurality of different data by simultaneously connecting a plurality of lines.

The terminal control section 17 is connected to a GPS receiver 19 which is a current position detecting means for receiving a GPS signal from a GPS satellite and detecting its own current position. In the GPS receiver 19, latitude and longitude relating to the current position can be detected as position information. Further, a memory 40 for recording image data of a tracking image is connected to the terminal-side control unit 17.

Further, a SIM card 20 is connected to the terminal-side control section 17 via the slot. In the SIM card 20, a telephone number as identification information of the skier 2 is registered, and call charge data accumulated every time a call is made is rewritably recorded. And telephone company 2 with which skier 2 has contracted
In 1, a call fee is automatically collected from a financial institution (not shown) to which the skier 2 subscribes based on these telephone numbers and call fee data on a predetermined date every month.

In the mobile phone 9, control relating to voice communication processing is performed as follows. First, an audio signal input from the microphone 13 is converted into audio data by an audio processing unit 22, and the audio data is modulated by a wireless unit 23, which is a terminal-side communication unit, and transmitted to the public network 10 as a radio signal. It is transmitted to the connected mobile phone base station 24. On the other hand, the radio signal received by the rod antenna 16 is modulated by the radio unit 23, converted into an audio signal by the audio processing unit 22, and output from the speaker 15 as audio.

The control relating to the data communication processing is as follows:
For example, this is performed when interactive two-way communication with the image tracking device 8 is performed, such as when capturing a tracking image. This control
The key operation unit 12 based on the screen displayed on the display unit 14
The input data, the position information data detected by the GPS receiver 19, and the like are modulated by the radio unit 23,
The signal is transmitted to the base station 24 as a radio signal. On the other hand, the radio signal received by the rod antenna 16 is demodulated by the radio unit 23, and its text data and image data (still image and moving image) are displayed on the display unit 14.

{Configuration of Image Tracking Apparatus 8} Next, the configuration of the image tracking apparatus 8 will be described. The image tracking device 8 operates based on electric power supplied from a commercial power supply (not shown). First, as shown in FIG. 2, the auxiliary device 6 has a shape photographing camera (hereinafter simply referred to as a shape camera) made of a CCD (charge coupled device) for photographing the shape of the skier 2 on the upper surface of its housing 25. ) Is installed. A monitor 27 for displaying an instruction to the skier 2 at the time of photographing the shape and displaying the shape of the photographed skier 2 and the like is provided on the front portion of the housing 25. A sub-device-side wireless device (not shown) for wirelessly connecting to the present device 5 is mounted inside the housing 25, and the captured shape data of the skier 2 is transmitted to the present device 5. ing. The auxiliary device 6 is configured by the shape camera 26, the monitor 27, and the auxiliary device-side wireless device.

Next, on the roof of the headquarters building 4, a CCD tracking camera (hereinafter simply referred to as a tracking camera) 28 for capturing a tracking image of the skier 2 is installed. A main unit 5 is installed in a predetermined room inside the headquarters building 4, and a main unit-side radio (not shown) for wirelessly connecting to the sub-unit 6 is provided inside a casing (not shown) of the main unit 5. And a device-side control unit 29 (see FIG. 1) as device-side control means for electrically controlling the entire image tracking device 8.

As shown in FIG. 1, this device-side control unit 29
Is composed of an electric circuit mainly composed of a CPU,
In accordance with the device-side control program recorded in “0”, photographing processing of a tracking image of the skier 2 and the like are performed. The device-side control unit 29 includes device-side communication means for performing data communication with the mobile phone 9, and
A communication unit 31 is connected as position information detecting means for detecting position information transmitted from the server. The communication unit 31
Has a multi-call connection function that allows simultaneous connection of a plurality of lines.

The device-side control unit 29 stores a shape data registration unit 32 as shape registration means for recording shape data transmitted from the sub device 6, and a telephone number of the skier 2 transmitted from the mobile phone 9. A telephone number registration unit 33 for registration, a tracking camera 28, a tracking camera driving unit 34 for controlling the driving of the tracking camera 28 to adjust a shooting direction and a shooting magnification, and a tracking camera 28 for position information.
A photographing parameter recording unit 35 is connected as a photographing parameter recording unit in which the photographing direction and the photographing magnification are recorded as photographing parameters. In a ski resort, if the latitude and longitude of the skier 2 are determined, the altitude is naturally determined, and the shooting parameters are set based on the positional information and the altitude.

An image recording unit 36 as an image recording means for recording the image data of the tracking image captured by the tracking camera 28, the image data captured by the tracking camera 28 and the registration of the shape data are stored in the device-side control unit 29. An image recognition unit 3 serving as an image recognition unit for recognizing shape data (skier 2) from the image data based on performing pattern matching with the shape data registered in the unit 32.
7, and a purchase price collecting unit 38 as a usage fee collecting means for collecting a purchase price when the skier 2 purchases image data of the captured tracking image. still,
The image recognition unit 37 is configured so that pattern matching is performed at high speed by parallel operation processing using a neural network.

As described above, the shape registration means 39 is constituted by the shape camera 26 and the shape data registration section 32, and the apparatus side control section 29, the communication section 31, the shape data registration section 32,
Phone number registration unit 33, tracking camera 28, tracking camera driving unit 34, shooting parameter recording unit 35, image recording unit 36,
The image recognition unit 37 and the purchase price collection unit 38 use the device 5
Is configured.

<Description of Operation of Image Tracking System 1>
The operation of the image tracking system 1 will be described. here,
It is assumed that the skier 2 carries (wears) the mobile phone 9 into which the SIM card 20 in which his / her telephone number is registered is inserted and connected. The photographable area 3 is a range in which positional information can be transmitted from the mobile phone 9 to the image tracking device 8, and is a range in which the skier 2 can photograph with the tracking camera 28. The image tracking device 8 captures a tracking image of the skier 2 sliding on the photographable area 3 by sequentially executing the following three steps based on interactive two-way communication with the mobile phone 9. .

The first step is a step of registering the shape data of the skier 2. The skier 2 is photographed by the shape camera 26 in the shape photographing area 7, and the shape data is registered in the shape data registration unit 32.

Second step: a step of locking the shape data (skier 2) in the image data obtained by photographing the skier 2, based on the position information at the photographing start position of the tracking image in the photographable area 3. The skier 2 is photographed, and the shape data (skier 2) in the image data photographed based on the image recognition is locked.

The third step is a step of photographing the tracking image of the skier 2. The third step is a range from the photographing start position to the photographing end position of the tracking image in the photographable area 3 based on the position information and the image recognition. An image is taken while tracking the skier 2 while maintaining the locked state.

Fourth step: This step is for collecting the purchase price when the skier 2 purchases the image data of the tracking image. By adding the purchase price to the call charge data of the SIM card 20, the photographing service provider Collects the purchase price from the skier 2 via the telephone company 21.

Hereinafter, each step will be described in detail in order. These steps are performed by the terminal-side control unit 17 and the device-side control unit 29 controlling the driving of each unit.

{First Step} FIG. 4 is a signal transition diagram showing the first step. In FIG. 4, first, the skier 2 operates the key operation unit 12 of the mobile phone 9 to make a call to the image tracking device 8 while being located in the shape photographing area 7 (see FIG. 2). As a result, the line between the mobile phone 9 and the image tracking device 8 is connected, and the terminal-side controller 1
At 7, the telephone number registered in the SIM card 20 is notified to the image tracking device 8 (step S1). In response, the device-side control unit 29 checks whether the received telephone number is registered in the telephone number registration unit 33 (step S2). If it is determined that the telephone number has not been registered, the telephone number is registered in the telephone number registration unit 33 (step S3). If it is determined that the information has already been registered, step S3 is not executed and step S
Move to 4.

After step S3, the device-side control section 29 transmits a top menu screen to the mobile phone 9 (step S4). Thereby, a top menu screen as shown in FIG. 5 is displayed on the display unit 14 of the mobile phone 9.

Subsequently, since the skier 2 needs to register the shape, the skier 2 selects "1: shape registration" from the top menu screen (step S5). Thereby, the terminal-side control unit 17 transmits a registration command as a registration command of the shape data to the image tracking device 8 (Step S).
6). In response, the device-side control unit 29 transmits a shape registration menu screen to the mobile phone 9 (step S7), and the display unit 14 of the mobile phone 9 displays FIG.
A shape registration menu screen as shown in FIG.

Subsequently, the skier 2 selects "1: start shape registration" from the shape registration menu screen (step S8). Thereby, the terminal-side control unit 17 transmits a shape data registration start command to the image tracking device 8 (step S9). In response to this, the device-side control unit 29 remotely controls the sub device 6 and
6 is taken by the skier 2 (step S1).
0). This photographing is performed while causing the skier 2 to pose by displaying an instruction on the orientation and posture of the skier 2 on the monitor 27 screen of the sub device 6.
Then, the shape of the skier 2 is photographed from a plurality of different directions.

A plurality of photographed image data (still image data) are provisionally registered in the shape data registration unit 32 as shape data (step S11), and the image recognition unit 37 confirms whether the image data can be used as shape data. This is performed (Step S12). If it is determined that the shape data can be used, the temporarily registered shape data is stored in the monitor 27
It is displayed on the screen (step S13). Further, the device-side control unit 29 transmits a confirmation message for formally registering the shape data to the mobile phone 9 (step S14), and displays the bottom line of the shape registration menu on the display unit 14 of the mobile phone 9. 6B, a confirmation message as shown in FIG. 6B is displayed. This confirmation message indicates that formal registration of shape data is possible.

When the skier 2 selects "2: confirmation" (step S15), the terminal-side control unit 17
A confirmation command is transmitted to the image tracking device 8 (Step S16). In response to this, the device-side control unit 2
At 9, the formal registration of the shape data is performed (step S
17). At this time, the shape data is registered in association with the telephone number of the skier 2. Also, the mobile phone 9
, A registration completion message is transmitted (step S
18) On the display unit 14 of the mobile phone 9, a registration completion message as shown in FIG. 6C is displayed at the bottom line of the shape registration menu. Then, the line with the mobile phone 9 is disconnected (step S19).

If it is determined in step S12 that the image data cannot be used, in step S14, a confirmation message (not shown) prompting re-photographing of the format data is displayed on the display unit 14 of the mobile phone 9. Is displayed. And skier 2
Selects "3: Correction", the process shifts to step S7, and the skier 2 is re-photographed for its shape.

{Second Step} FIG. 7 is a signal transition diagram showing a second step and a third step. Skier 2 is first
After the completion of the process, the mobile phone 9 moves to the shooting start position of the tracking image in the shooting area 3 (see FIG. 2), and makes a call from the mobile phone 9 to the image tracking device 8. This allows
When the line between the mobile phone 9 and the image tracking device 8 is connected, the terminal-side control unit 17
The telephone number registered in the SIM card 20 is notified (step S30).
At 9, it is confirmed whether the received telephone number is registered in the telephone number registration section 33 (step S31). If it is determined that the shape data has already been registered, it is confirmed whether or not there is shape data registered in association with the telephone number (step S32). If it is determined that the shape data has not been registered, a message indicating that the registration of the shape data is required is transmitted, and the process proceeds to step S3 of the first process.

If it is determined in step S32 that the shape data exists, a top menu screen is transmitted to the mobile phone 9 (step S3).
3). Thereby, a top menu screen as shown in FIG. 5 is displayed on the display unit 14 of the mobile phone 9. When it is determined that there is no shape data, a message indicating that registration of shape data is required is transmitted,
The process moves to step S4 of the first process. In this case,
The skier 2 selects “4: end” from the top menu, so that the mobile phone 9 and the image tracking device 8 are selected.
The line between them is cut once and moved to the shape shooting area 7,
What is necessary is just to register a shape.

After step S33, the skier returns "2:
When "image lock" is selected (step S34), the terminal-side control unit 17 transmits a lock command, which is a command to lock image data, to the image tracking device 8 (step S35), and detects at the shooting start position. The transmitted GPS data is transmitted (step S36). In response to this, the device-side control unit 29 detects a photographing parameter (a photographing direction and a photographing magnification) according to the received GPS data, and controls the drive of the tracking camera drive unit 34 according to the photographing parameter. Then, an image of the skier 2 is taken by the tracking camera 28 (step S37).

Subsequently, the image recognition section 37 performs pattern matching between the photographed image data and the registered shape data, and performs image recognition for recognizing the shape data (skier 2) in the image data. Then, the locked image data having the rectangular frame 39 (see FIG. 8A) indicating that the locked part of the skier 2 is locked is generated (step S38). Then, the lock image data and a confirmation message for confirming the lock state are transmitted to the mobile phone 9 (step S39). Thereby, the display unit 1 of the mobile phone 9
4 displays a lock image and a confirmation message as shown in FIG.

Subsequently, the skier 2 checks whether the frame 39 in the lock image is correctly provided on the skier 2, and when it is determined that the frame 39 is correct, selects "1: check" (step S40). . Accordingly, the terminal-side control unit 17 transmits the lock confirmation command to the image tracking device 8 (Step S41). In response,
The device-side controller 8 transmits a tracking image shooting menu screen to the mobile phone 9 (step S42). As a result, the display unit 14 of the mobile phone 9 is displayed as shown in FIG.
A tracking image shooting menu screen as shown in FIG.
If the skier 2 determines in step S40 that the image is not correct, the process proceeds to step S33 by selecting "2: Correction", and the process of locking the image (the second process) is performed again. Will be

{Third Trip} Subsequently, the skier 2
In order to start shooting a tracking image, "1: Start shooting" on the tracking image shooting menu screen is selected (step S4).
3), start sliding in the slidable area 3; Accordingly, the terminal-side control unit 17 transmits a shooting start command to the image tracking device 8 (step S4).
4). Further, during the tracking image shooting period from when the shooting start command is transmitted to when the shooting end command described later is transmitted, the GPS data detected by the GPS receiver 19 is transmitted at predetermined intervals (step S45). ).

In response, the device-side control unit 29
During the tracking image shooting period, the shooting parameters (shooting direction and shooting magnification) according to the received GPS data are detected, and the tracking camera driving unit 34 according to the shooting parameters.
Is performed, and an image is taken while tracking the skier 2 by the tracking camera 28. The image data of the captured tracking image is recorded in the image recording unit 36 in association with the telephone number of the skier 2 (step S4).
6).

Subsequently, the skier 2 selects “2: end of shooting” in the tracking image shooting menu screen (see FIG. 8B) in the shooting area 3 in order to end shooting of the tracking image. (Step S47). As a result, the terminal-side control unit 17 transmits a shooting end command to the image tracking device 8 (step S48). In response to this, the device-side control unit 8 performs a process of ending the shooting of the tracking image and a process of ending the recording (step S4).
9).

{Fourth Step} FIG. 9 is a signal transition diagram showing a fourth step. The fourth process is configured to shift after the completion of the third process while maintaining the state in which the line between the mobile phone 9 and the image tracking device 8 is connected.

First, the apparatus-side control section 29 transmits a top menu screen (see FIG. 5) to the mobile phone 9 (step S60). Here, skier 2
Selects "3: high-speed tracking image playback" on the top menu screen to check the contents of the recorded tracking image (step S61). Thereby, the terminal-side control unit 17 transmits the high-speed reproduction command to the image tracking device 8 (Step S62).

In response, the device-side control unit 29
A high-speed playback process for playing back the recorded tracking image at high speed is performed (step S63). And the mobile phone 9
Then, the image data of the tracking image subjected to the high-speed reproduction processing is transmitted (step S64), and further, a purchase message of the image data is transmitted (step S65).
As a result, the tracking image is displayed at high speed and the purchase message is displayed on the display unit 14 of the mobile phone 9 as shown in FIG. 10 (step S66).

Subsequently, the skier 2 selects "1: purchase" when purchasing the tracking image data. To cancel the purchase, select "2: Cancel". Here, when "1: purchase" is selected (step S67),
The terminal-side control unit 17 transmits the purchase command and the call charge data to the image tracking device 8 (Step S).
68). In response, the device-side control unit 29 performs an addition process of adding the purchase price of the image data of the tracking image to the received call charge data (step S69). The processed call charge data is transmitted (step S70). With this, SIM
The call charge data of the card 20 is rewritten to the data to which the purchase charge has been added. In this way, the purchase price is
Payment is made from the skier 2 to the telephone company, and from the telephone company to the photography service provider. That is, the purchase price is automatically collected from the skier 2 and paid to the photographing service provider.

Subsequently, the apparatus-side control section 29 transmits a reproduction / download menu screen to the mobile phone 9 (step S71). Thereby, the mobile phone 9
A display / reproduction menu screen as shown in FIG. Here, "1:
“Reproduce” is a command for reproducing and displaying the tracking image on the display unit 14, “2: Download” is a command for recording the image data of the tracking image in the memory 40, and “3: Reproducing and downloading” Means "1: Play"
And "2: Download" at the same time by a multi-call connection.

For example, when the skier 2 selects “3: Playback & Download” (step S72), the terminal side controller 17 sends a playback & download command to the image tracking device 8 (step S73). ). In response to this, the device-side controller 8 performs a process of changing the connection with the mobile phone 9 to a multi-call connection (step S74). Subsequently, transmission processing of the image data of the tracking image for download is performed (step S75), and the image data is transmitted to the mobile phone 9 using one of the multi-call connections (step S75). Step S76). In response, the terminal-side control unit 17 starts saving the image data in the memory 40 (step S77).

Further, when the transmission of the image data is completed after the lapse of a predetermined time, the device-side control section 29 notifies the portable telephone 9 of the end of the download (step S83). In response to this, the terminal-side control unit 17 performs a process of terminating the storage of the image data in the memory 40 (step S84).
A save end command is transmitted (step S85). In response, the device-side control unit 29 performs a download completion process (step S86).

Further, the device-side control unit 29 uses the other one of the multi-call connection lines, and
, A reproduction control menu screen is transmitted (step S78). Thereby, a reproduction control menu as shown in FIG. 11B is displayed on the display unit 14 of the mobile phone 9. When the skier 2 selects one of the playback control commands from the playback control menu (step S79), the terminal-side control unit 17 sends the selected playback control command to the image tracking device 8. A command is transmitted (step S80). In response to this, the device-side control unit 29 performs a process of transmitting the image data of the tracking image in accordance with the received reproduction control command (Step S).
81), the image data is transmitted to the mobile phone 9 (step S82).

Subsequently, when the skier 2 selects “6: end of reproduction” from the reproduction control menu (step S87), the terminal side control unit 17 sends a reproduction end command to the image tracking device 8. Transmitted (step S8
8) In response to this, the device-side control unit 29 performs a reproduction control completion process (step S89).

When the reproduction and the download are completed in this way, the apparatus-side control section 29 transmits a top menu screen to the mobile phone 9 (step S9).
0). Here, when the skier 2 selects "4: end" (step S91), the terminal-side control unit 17 transmits an end command to the image tracking device 8 (step S92). In the device-side control unit 29,
A line disconnection process with the mobile phone 9 is performed (step S).
93) Further, the shape data, the tracking image data, the telephone number and the call charge data relating to the skier 2 are deleted (step S94).

As described above, according to the present embodiment,
Since the mobile phone 9 detects the current position of the skier 2 and transmits this position information to the image tracking device 8, the position of the skier 2 can be always grasped by the image tracking device 8, and the tracking image can be obtained. The shooting start position can be freely set.

Further, in the image tracking device 8, the tracking image of the skier 2 is photographed based on the position information and the image recognition. For example, even if there is an obstacle or the like in the photographable area 3, the skier 2 can be tracked accurately. Therefore, it is not necessary to provide a dedicated photographing area as shown in the conventional example, the photographable area 3 can be freely set, and the photographable area 3 can be easily enlarged.

Further, in the image tracking device 8, the image data of the captured tracking image is recorded in the image recording unit 36. Therefore, in response to a request from the mobile phone 9, the reproduction control of the recorded image data is performed. Downloading can be performed easily.

Further, since the tracking image is photographed by sequentially executing the first to third steps, the skier 2 can operate the mobile phone 9 simply by operating the mobile phone 9.
You can easily register your own shape data. Moreover, from any location within the shooting area,
Locking of shape data in image data, start and end of shooting of a tracking image, and the like can be easily performed.

Further, in the image tracking device 8, the shooting direction and the shooting magnification of the tracking camera 28 with respect to the position information are recorded as shooting parameters, so that each time the position information changes according to the movement of the skier 2, the shooting is performed. The calculation processing for calculating the direction and the photographing magnification can be omitted. As a result, the amount of arithmetic processing in the device-side control unit 29 can be reduced, and the time from when the position information is detected to when the tracking camera 28 is driven and controlled to the predetermined shooting direction and the shooting magnification can be shortened. .

Further, since the image tracking device 8 is provided with the communication section 31 to perform two-way communication between the mobile phone 9 and the image tracking device 8, the mobile phone 9 and the image tracking device 8 can interact with each other. While performing the two-way communication, the tracking image of the skier 2 can be captured.

In the image tracking device 8, the skier 2
Since the shape data is registered by photographing the shape, the shape data can be easily registered. Moreover, even when it is determined that the registered shape data is not suitable for image recognition, it is possible to easily retake and re-register.

In the portable telephone 9, the image tracking device 8
Since the image data sent from the image tracking device 8 is displayed on the display unit 14, the image data of the tracking image transmitted from the image tracking device 8 can be displayed on the display unit. Thus, the skier 2 can easily confirm the content of the recorded tracking image only with the mobile phone 9.

Further, since the mobile phone 9 registers a telephone number for identifying the skier 2 in the SIM card 20, the image tracking device 8 uses the plurality of registered skiers based on the telephone number. Can be easily determined. Further, in the image tracking device 8, since the shape data is registered and the image data of the tracking image is recorded in association with the telephone number, the shape data for a plurality of skiers and the image data of the tracking image are stored. In such a case, such management can easily perform a search or the like.

In the portable telephone 9, the SIM card 2
Since 0 is configured to be detachable, the skier 2
The mobile phone 9 may be shared by owning only the SIM card 20. As an example, it is assumed that a photographing service provider rents the mobile phone 9. in this case,
Since the skier 2 only needs to purchase the SIM card 20, the economic burden is reduced, and the image tracking system 1 can be used easily.

In the image tracking device 8, the skier 2
Is provided with a purchase price collection unit 38 for collecting the purchase price when the image data of the tracking image is purchased, so that the purchase price can be automatically collected from the skier 2.
Thereby, the skier 2 can save the trouble of paying the purchase price by himself.

The image tracking system 1 can be constructed by arbitrarily combining the mobile phone 9 and the image tracking device 8. Thus, for example, when the mobile phone 9 breaks down, the image tracking system 1 can be easily reconfigured simply by replacing the mobile phone 9.

[Other Embodiments] In this embodiment, the image tracking system 1 of the present invention is applied to a system in which a photograph is taken while tracking the skier's appearance during skiing at a ski resort, but the present invention is not limited to this. Instead, the present invention may be applied to, for example, a system in which an image is taken while tracking a running car in a car racetrack. The same parts as those in this embodiment are denoted by the same reference numerals, and the description thereof will be omitted.

FIG. 12 shows an example of installation of the image tracking system 1 in a car race track. In FIG. 12, a course 5 in which an automobile 50 as an object to be photographed travels
1 is set in the photographable area 52. And
In a place where the photographable area 52 can be overlooked, a photographing service provider is stationed and the headquarters building 5 where the apparatus 5 is installed.
Three are being built. In addition, besides the course 51, the auxiliary device 6
Is installed, and a shape photographing area 54 for photographing the shape of the automobile 50 is set in front of the sub device 6.

The vehicle 50 is equipped with a hands-free device (not shown).
Is attached to the hands-free device, so that the mobile phone 9 can be used even during traveling. still,
A SIM card 20 in which a driver's telephone number is registered is inserted and connected to the mobile phone 9.

Next, the outline of the first to fourth steps in the case of capturing a tracking image of the automobile 50 will be described. First step: a step of registering the shape data of the automobile 50. First, the driver moves the car 50 to the shape photographing area 54. Then, the first embodiment described in the present embodiment
The operation of the mobile phone 9 is performed in the same manner as in the step. Thereby, in the image tracking device 8, the shape of the automobile 50 is photographed, and the shape data is registered in the shape data registration unit 32.

Second step: a step of locking the shape data in the image data. The driver takes the car 50,
The tracking image is moved to the shooting start position in the course 51. Then, the driver performs the second operation described in this embodiment.
The operation of the mobile phone 9 is performed in the same manner as in the step. As a result, in the image tracking device 8, the car is photographed based on the position information, and the shape data (car 50) in the image data photographed based on the image recognition is locked.

The third step is a step of capturing a tracking image of the automobile 50. The driver operates the mobile phone 9 in the same manner as in the third step described in this embodiment. At this time, in step S43 (see FIG. 7), "1:
After selecting "Start Shooting", the vehicle 50 starts running, and after traveling a predetermined distance in the course 51, stops the vehicle 50. In step S47 (see FIG. 7), "2:
Select "End shooting". Thus, the image tracking device 8 performs the tracking shooting of the automobile 50 based on the position information and the image recognition while maintaining the locked state.

Fourth step: a step of collecting a purchase price for the image data of the tracking image from the driver. The driver operates the mobile phone 9 in the same manner as in the fourth process described in the present embodiment. As a result, the image tracking device 8 performs an addition process of adding the purchase price to the call charge data of the SIM card 20, and the purchase price is automatically collected from the driver via the telephone company and paid to the photographing service provider. .

The present invention is not limited to the above embodiment, and the following modifications and extensions are possible. In the embodiment of the present invention, the image tracking device is configured by providing the photographing parameter recording unit. However, the photographing parameter recording unit may be provided as needed. If the image tracking device is configured without the photographing parameter recording unit, for example, the device-side control unit performs arithmetic processing based on the position information, and calculates the photographing direction and the photographing magnification of the photographing unit. You may do so.

In the embodiment of the present invention, the two-way communication function is provided between the image tracking device and the portable information terminal. However, the two-way communication function may be provided as needed. If the image tracking system is configured without providing the two-way communication function, for example, the position information is unilaterally transmitted from the portable information terminal, and the position information is unilaterally received by the image tracking device. You may make it. In the embodiment of the present invention, the shape registration unit is configured to register the shape data by photographing the shape of the object to be photographed. However, the present invention is not limited to this. The shape data may be imported to the portable information terminal, and the shape data may be registered by transmitting the shape data from the portable information terminal to the image tracking device.

In the embodiment of the present invention, the display means for displaying the image data of the tracking image is provided to constitute the portable information terminal. However, the display means may be provided as needed. what if,
When the portable information terminal is configured without the display means, for example, the display means may be installed in an image tracking device or the like, and the photographing client may view the tracking image displayed on the display means. . In the embodiment of the present invention, the information registering means for registering the identification information for identifying the requester of the tracking image is provided to constitute the portable information terminal. However, the information registering means may be provided as needed. .

In the embodiment of the present invention, the image tracking apparatus is provided with a usage fee collecting means for collecting a usage fee generated by performing control in response to a request from the portable information terminal. The collection means may be provided as needed. In the embodiment of the present invention, the position information detecting means is configured to detect the latitude and longitude as the position information.However, the present invention is not limited to this. For example, the position information detecting means may be configured to detect the altitude and the moving direction. You may. Further, the position information detecting means is not limited to the GPS receiver, but may be any as long as it can detect the position of the object to be photographed.

In the embodiment of the present invention, the image tracking system is applied to a skiing area and a car racing area. However, the present invention is not limited to these, and can be applied to all sports and events. In the embodiment of the present invention, when registering the shape data, the object to be shot is photographed from a plurality of different directions, and the plurality of still images are used as the shape data. However, the present invention is not limited to this. Only a still image may be captured and used as shape data. In short, any shape data that can execute pattern matching may be used.

[Brief description of the drawings]

FIG. 1 is an electric block diagram of an image tracking system according to an embodiment of the present invention.

FIG. 2 is a diagram showing an example in which an image tracking system is installed at a ski resort.

FIG. 3 is an external view of a mobile phone.

FIG. 4 is a signal transition diagram showing a first step.

FIG. 5 is a diagram showing a display example of a top menu screen.

FIG. 6 is a diagram showing a display example of a shape registration menu screen.

FIG. 7 is a signal transition diagram showing a second step and a third step.

FIG. 8 is a diagram showing a display example of an image lock screen and a tracking image shooting menu screen.

FIG. 9 is a signal transition diagram showing a fourth process.

FIG. 10 is a diagram showing a display example of a playback screen of a tracking image.

FIG. 11 is a diagram showing a display example of a reproduction / download menu screen and a reproduction control menu screen.

FIG. 12 is a view showing an image tracking system according to another embodiment of the present invention installed in a car racetrack.

[Explanation of symbols]

In the drawings, 1 is an image tracking system, 2 is a skier (object to be photographed), 3 is a photographable area, 7 is a shape photographing area,
8 is an image tracking device, 9 is a mobile phone (portable information terminal),
14 is a display unit (display unit), 17 is a terminal side control unit (terminal side control unit), 19 is a GPS receiver (current position detection unit), 20 is a SIM card (information registration unit), and 23 is a wireless unit (terminal unit). , A tracking camera (imaging means), 29 is an apparatus-side control section (apparatus-side control means), 31 is a communication section (position information detecting means), and 35 is an imaging parameter recording section (imaging parameter recording means). , 36 is an image recording unit (image recording unit), 37 is an image recognition unit (image recognition unit), 38 is a purchase price collection unit (use price collection unit), 3
Reference numeral 9 denotes a shape registration unit.

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04Q 7/34 H04N 5/225 F 7/38 5/232 C H04N 5/225 H04B 7/26 106A 5 / 232 109H F term (reference) 5B057 AA19 BA02 CA12 CA16 DA07 DB02 DC33 DC39 5C022 AB63 AC01 AC69 5C054 AA01 CC02 CG06 DA07 EA01 EA03 EA05 FC11 FC13 HA31 5K067 AA21 BB04 DD20 DD52 EE02 EE10 FF23 FF23 FF23 JJ23 EA23

Claims (14)

[Claims] 1. A current position detecting means for detecting a current position of the object to be photographed by being attached to the object to be photographed, and a terminal for transmitting position information of the current position detected by the current position detecting means to the outside. Side communication means, and a portable information terminal having a terminal-side control means for performing control for detecting the current position and transmitting the position information to the outside, and a shape registration means for registering shape data of the photographed object ,
Position information detecting means for detecting the position information, photographing means for photographing the object to be photographed, and performing pattern matching between image data photographed by the photographing means and the shape data registered in the shape registering means. Image recognition means for recognizing the object to be shot from the image data based on the position information detected by the position information detection means and image recognition of the object to be shot by the image recognition means. An image tracking system, comprising: a device-side control unit that controls so as to capture a tracking image of the object to be captured; and an image tracking device that records image data of the tracking image. 2. The image tracking apparatus according to claim 1, wherein the image tracking device includes a photographing parameter recording unit in which a photographing direction and a photographing magnification of the photographing unit with respect to the position information are recorded as photographing parameters. Tracking system. 3. The apparatus according to claim 1, wherein the image tracking device includes a device-side communication unit, and the device-side communication unit and the terminal-side communication unit are configured to be capable of two-way communication.
Or the image tracking system according to 2. 4. The apparatus according to claim 1, wherein the shape registration unit is configured to register the shape data by photographing a shape of the object to be photographed. Image tracking system. 5. The image tracking system according to claim 3, wherein said portable information terminal includes display means for displaying image data sent from said image tracking device. 6. The portable information terminal according to claim 3, further comprising information registration means for registering identification information for identifying a photographer of the tracking image. Image tracking system. 7. The image tracking system according to claim 6, wherein said information registration means is configured to be detachable from said portable information terminal. 8. The image tracking apparatus according to claim 3, further comprising a usage fee collecting unit configured to collect a usage fee generated by performing control in response to a request from the portable information terminal. An image tracking system according to any one of claims 1 to 7. 9. A portable information terminal used in the image tracking system according to claim 1. Description: 10. An image tracking device used in the image tracking system according to claim 1. Description: 11. A tracking image photographing method performed in the image tracking system according to claim 3, wherein the device-side control means registers the shape data.
Based on the process and the position information and the image recognition,
A second step of locking shape data in image data obtained by capturing the image of the object; and, based on the position information and the image recognition, maintaining the locked state to track the object. And performing a third step of capturing while tracking. 12. In the first step, the terminal-side control unit transmits a registration command of shape data and the identification information to the image tracking device, and the device-side control unit transmits the registration command. 12. The tracking image capturing method according to claim 11, wherein registration of shape data of the object to be captured is performed in association with the identification information based on receiving the identification information. 13. In the second step, the terminal-side control means transmits the position information, the lock command, and the identification information to the image tracking device, and the device-side control means Information, based on receiving the lock command and the identification information, by shooting the object to be shot, by performing the pattern matching, to create image data for locking the shape data locked in the image data, Transmitting the lock image data to the portable information terminal; and the terminal-side control means determines whether the lock is correct or not and corrects the error if the lock image data is received based on the reception of the lock image data. The method according to claim 11, wherein lock confirmation information is created and the lock confirmation information is transmitted to the image tracking device. 14. In the third step, the terminal-side control means transmits the position information and a shooting start command to the image tracking device, and the device-side control means transmits the position information and the On the basis of receiving a shooting start command, the shooting of the tracking image is started, and after a predetermined time has elapsed, the terminal-side control means transmits a shooting end command to the image tracking device, 12. The tracking image capturing method according to claim 11, wherein the control unit ends the tracking image capturing based on receiving the capturing end command.