JP2020191524A - Imaging apparatus, control method, and program - Google Patents

Abstract

To provide an imaging apparatus, a control method, and a program capable of synchronizing video data and audio data for each frame even when a capturing frame rate and a reproduction frame rate at the time of capturing a moving image are different from each other.SOLUTION: An imaging apparatus includes: an acquisition means configured to acquire video data and audio data at a capturing frame rate; a conversion means configured to convert the audio data on the basis of a ratio between a capturing frame rate and a reproduction frame rate; and a recording means configured to record the audio data converted by the conversion means along with the video data. The conversion means calculates the ratio between the capturing frame rate and the reproduction frame rate for each frame, and converts the audio data corresponding to the aforementioned frame on the basis of the calculated ratio.SELECTED DRAWING: Figure 4

Description

The present invention relates to imaging devices, control methods and programs.

In recent years, an imaging device equipped with a function of setting a shooting frame rate and a playback frame rate has been used when shooting a moving image. When the shooting frame rate and the playback frame rate are set to the same value, the imaging device can record the video data and the audio data acquired at the shooting frame rate in a synchronized state at the playback frame rate. On the other hand, when the shooting frame rate and the playback frame rate are set to different values, the amount of audio data acquired at the shooting frame rate is relative to the amount of video data recorded according to the set playback frame rate. Is excessive or insufficient. For this reason, when recording video data and audio data according to the playback frame rate, a process is performed to convert the video data and audio data so that the playback times are equal, and the video data and the audio data are synchronized with each other. It is necessary to record audio data.

As a related technique, the technique of Patent Document 1 has been proposed. The technique of Patent Document 1 divides acoustic data and moving image data into a plurality of sections, and determines a parameter time series for determining the degree of compression / expansion of the acoustic data and moving image data for each divided section. Further, in the above technique, the divided acoustic data is divided into input frames at equal intervals, and the output frame length is determined based on the parameter time series. As for the acoustic data, the acoustic data before compression / expansion and the acoustic data after compression / expansion are obtained. Output the correspondence table of synchronization points between acoustic data. Then, the above technique compresses and decompresses the acoustic data based on the correspondence table, and compresses and decompresses the moving image data based on the correspondence table.

Japanese Unexamined Patent Publication No. 2006-187013

The technique of Patent Document 1 compresses and decompresses the acoustic data and the moving image data based on the above-mentioned correspondence table so that the acoustic data and the moving image data are synchronized. Therefore, in the technique of Patent Document 1, it is necessary to output the correspondence table for each division section, and the moving image data is decompressed and compressed by referring to the correspondence table for each division section, which complicates the processing. Further, in the technique of Patent Document 1, since the acoustic data and the moving image data are synchronized based on the correspondence table for each divided section, it is difficult to synchronize the audio data and the video data for each frame.

An object of the present invention is to provide an imaging device, a control method, and a program capable of synchronizing video data and audio data for each frame even when the shooting frame rate and the playback frame rate at the time of moving image shooting are different. To do.

In order to achieve the above object, the imaging device of the present invention converts the audio data based on the acquisition means for acquiring video data and audio data at the shooting frame rate and the ratio of the shooting frame rate to the playback frame rate. The conversion means includes a conversion means for recording the audio data converted by the conversion means together with the video data, and the conversion means is a ratio of the shooting frame rate to the reproduction frame rate for each frame. Is calculated, and the audio data corresponding to the frame is converted based on the calculated ratio.

According to the present invention, even when the shooting frame rate and the playback frame rate at the time of moving image shooting are different, the video data and the audio data can be synchronized for each frame.

It is a functional block diagram of the image pickup apparatus of this embodiment. It is a figure which shows an example of the video data and audio data at the time of taking a picture using the slow & fast function. It is a flowchart which shows the flow of the recording process at the time of moving image shooting. It is a figure for demonstrating the conversion process in the case of low-speed reproduction. It is a flowchart which shows the flow of the conversion process. It is a figure for demonstrating the conversion process in the case of high-speed reproduction.

Hereinafter, each embodiment of the present invention will be described in detail with reference to the drawings. However, the configurations described in each of the following embodiments are merely examples, and the scope of the present invention is not limited by the configurations described in each embodiment.

FIG. 1 is a functional block diagram of the image pickup apparatus 100 of the present embodiment. The image pickup apparatus 100 has a function of capturing a moving image, and can record the captured moving image data or the like as a file on the memory card 109. The image pickup device 100 is, for example, a digital camera, a smartphone having an image pickup function, or the like. The image pickup apparatus 100 of the present embodiment has a function (slow & fast function) of setting a shooting frame rate and a reproduction frame rate to different frame rates for shooting. As shown in FIG. 1, the image pickup device 100 includes an image pickup element 101, an image pickup element drive circuit 102, an image processing circuit 103, and a video data memory 104. Further, the image pickup apparatus 100 includes a microphone 105, a microphone drive circuit 106, a signal processing circuit 107, an audio data memory 108, a memory card 109, a write control unit 110, and a storage buffer 111. Further, the image pickup apparatus 100 includes an operation unit 112, a display unit 113, a CPU 114, a file system 115, and a memory 116.

The image sensor 101 generates and outputs an electric charge according to the amount of incident light by photoelectric conversion. The image sensor 101 is, for example, a CMOS sensor. The image sensor 101 can read signals of all pixels, and can also read charges by adding specific pixels and thinning out in a specific row or column. The image sensor drive circuit 102 drives the image sensor 101 based on the control by the CPU 114. The image processing circuit 103 A / D-converts the image signal from the image sensor 101, converts the color information, and performs predetermined image processing. The video data memory 104 stores video data of a moving image from the image processing circuit 103. The video data of the moving image may be used for display on the display unit 113, or may be used for temporary storage for recording processing.

The microphone 105 is a sound collecting means, for example, has a diaphragm that generates an electric signal according to the amount of change in air vibration, and even if the amount of change is the same, it depends on the direction of input of air vibration. It has the property that the amount of electricity generated changes. The microphone drive circuit 106 drives the microphone 105 under the control of the CPU 114. The signal processing circuit 107 A / D-converts the electric signal from the microphone 105, converts the audio information, and performs predetermined signal processing. The audio data memory 108 is used to temporarily store the audio data of the moving image from the signal processing circuit 107 for output and recording processing.

The write control unit 110 monitors the connection status of the memory card 109 and controls access to the memory card 109. The video data stored in the video data memory 104 and the audio data stored in the audio data memory 108 are subjected to a predetermined conversion process by the CPU 114. The storage buffer 111 stores the converted video data and audio data as moving image data.

The operation unit 112 receives an input from a member to which a recording button is assigned, an input device such as a touch panel, or the like by a user operation, and generates a control signal according to the operation. The display unit 113 is a component that displays a GUI screen that constitutes a GUI (Graphical User Interface) that is a screen showing a live view at the time of shooting, various setting values, and the like. The CPU 114 as a control means performs the process according to the present embodiment by executing the program stored in the memory 116. The memory 116 stores various programs for realizing the functions of the image pickup apparatus 100 and information related to shooting settings input to the operation unit 112. The CPU 114 controls the operation of the image pickup apparatus 100 according to various control signals and programs. The file system 115 handles shooting information such as the playback frame rate stored in the memory 116 as metadata, and creates a file together with video data and audio data.

As described above, the image pickup apparatus 100 of the present embodiment has a function of individually setting a shooting frame rate and a reproduction frame rate at the time of moving image shooting. The function is also referred to as a slow & fast function. Therefore, the shooting frame rate and the playback frame rate may be set to the same value, or may be set to different values. With the slow & fast function, it is possible to change the shooting frame rate at an arbitrary timing when the imaging device 100 is shooting a moving image. FIG. 2 is a diagram showing an example of video data and audio data when shooting is performed using the slow & fast function. In FIG. 2, the shooting frame rate and the playback frame rate are different.

FIG. 2A is an image diagram showing video data 303 and audio data 304 at the time of shooting. In FIG. 2A, the time t1 on the shooting time axis 302 is the shooting time corresponding to one frame of the video data 303. The time t1 can be obtained from the reciprocal of the shooting frame rate. FIG. 2B is an image diagram showing video data 308 and audio data 309 during reproduction. In FIG. 2B, the time t2 on the reproduction time axis 307 is the shooting time corresponding to one frame of the video data. The time t2 can be obtained from the reciprocal of the reproduction frame rate.

The amount of data required for one frame in the video data does not change between shooting and playback, but the displayed time does change. The required amount of data corresponding to one frame in the audio data changes depending on the frame rate setting during shooting and playback. Depending on the frame rate at the time of shooting and the frame rate at the time of reproduction, the amount of data corresponding to one frame in the audio data becomes excessive or insufficient. Therefore, in the present embodiment, the CPU 114 converts the audio data according to the frame rate. Here, a method of converting audio data during shooting in the case of low-speed playback (t1 <t2) in which the playback time t2 is longer than the shooting time t1 of one frame will be described. In the case of low-speed playback, the value of the stretch ratio (ratio of the shooting frame rate to the playback frame rate) is larger than 1.

The flow of the recording process at the time of moving image shooting will be described with reference to the flowchart of FIG. The photographer uses the operation unit 112 to individually set the shooting frame rate and the playback frame rate to be handled as shooting information. The operation unit 112 that functions as a reception means receives the setting of the shooting frame rate and the setting of the playback frame rate (S201). Further, the photographer can set various shooting information such as a shooting mode and a moving image size in the image pickup apparatus 100 by using the operation unit 112. The shooting information including the set shooting frame rate and playback frame rate is stored in the memory 116. For example, it is assumed that the photographer sets "60 fps" as a shooting frame rate and "30 fps" as a reproduction frame rate for the image pickup apparatus 100. In this case, since the image pickup apparatus 100 captures 60 images per second and reproduces 30 images, the reproduction time is doubled as compared with the imaging time. Both the shooting frame rate and the playback frame rate can be set from "1 fps", and the upper limit is not set.

The CPU 114 determines whether the operation unit 112 has been instructed to start recording while the shooting frame rate and the playback frame rate are set in the memory 116 (S202). For example, when the CPU 114 detects that the recording button of the operation unit 112 is pressed, it determines that the recording start instruction has been given. If NO is determined in S202, the flow does not proceed to the next step. If YES is determined in S202, the CPU 114 calculates the amount of audio data corresponding to the time t1 required for one frame of the preset shooting frame rate on the shooting time axis 302 (S203). As a result, the CPU 114 determines the shooting interval of the video data and the audio data during shooting. For example, when the set shooting frame rate is "60 fps", the image pickup apparatus 100 captures 60 images per second. Therefore, the time t1 per frame representing one image data is "1/60 second", and the CPU 114 calculates the amount of audio data corresponding to that time.

The CPU 114 calculates the amount of data of the time t2 required for one frame of the preset playback frame rate on the playback time axis 307 (S204). As a result, the CPU 114 sets the playback interval of the video data and the audio data during playback. decide. For example, when the set reproduction frame rate is "30 fps", the image pickup apparatus 100 captures 30 images per second. Therefore, the time t2 per frame representing one image data is "1/30 second", and the CPU 114 calculates the amount of audio data corresponding to that time.

Then, the CPU 114 starts video recording based on the shooting information set in the memory 116 with the shooting interval and the playback interval acquired (S205). As described above, the image pickup apparatus 100 can change the shooting frame rate during movie shooting (acquisition). The CPU 114 determines whether the operation unit 112 is instructed by the photographer to change the setting of the shooting frame rate (S206). If YES is determined in S206, the CPU 114 resets the shooting frame rate based on the instruction in the memory 116 based on the setting change instruction (change instruction) received by the operation unit 112 (S207). Then, the CPU 114 recalculates the amount of data per frame from the shooting frame rate (S208). If NO is determined in S206, the processes of S207 and S208 are not performed.

The image pickup apparatus 100 can change the shooting frame rate during moving image shooting, but the change in the shooting frame rate is not applied while the video data and audio data of one frame are being acquired. The change in the shooting frame rate is applied when the acquisition of the video data and the audio data of one frame is completed (frame break).

The video data and audio data acquired during moving image shooting are processed by the image processing circuit 103 and the signal processing circuit 107 for each frame interval (time t1) of the shooting frame rate, respectively. Then, the processed video data is stored in the video data memory 104, and the processed audio data is stored in the audio data memory 108 (S209). The CPU 114 determines whether or not the video data and audio data (video data and audio data for one frame) of the time t1 required for one frame of the shooting frame rate have been acquired (S210). If NO is determined in S210, the flow does not proceed to the next step, and the accumulation of video data and audio data is repeated.

If YES is determined in S210, the CPU 114 converts the audio data corresponding to the time t1 acquired in the reproduction time axis 307 into the audio data corresponding to the time t2 (S211). The CPU 114 stores the voice data 309 after the conversion process in the storage buffer 111. The amount of video data in the time t1 required for one frame of shooting of the video data stored in the storage buffer 111 is equal to the amount of data of the video data in the time t2 required for one frame of reproduction. Therefore, the CPU 114 stores the video data 308 in the memory 116 frame by frame so that the file system 115 can reproduce the file at time t2. Then, the conversion process of S211 is performed, and the CPU 114 stores the audio data 309 stored in the storage buffer 111 in the memory 116 by the amount of data corresponding to the time t2 required for one playback frame.

The CPU 114 determines whether the operation unit 112 has received an instruction to end recording from the photographer (S214). If NO is determined in S214, the flow shifts to S206, and moving image shooting is continued. If YES is determined in S214, the CPU 114 controls the file system 115 so as to file the video data and the audio data up to the timing when the recording end instruction is given. The file system 115 creates a file of a moving image file together with shooting information such as a frame rate related to the moving image data (video data and audio data) recorded by the timing when the recording end instruction is given. The filed moving image file is recorded on the memory card 109. Then, the recording process is completed.

Next, the conversion process of S211 will be described. Here, the case where the shooting frame rate is larger than the playback frame rate at the time of conversion, that is, low-speed playback in which the playback time is longer than the shooting time will be described as an example. FIG. 4 is a diagram for explaining a conversion process in the case of low-speed reproduction. FIG. 4A is an image diagram showing an example of video data and audio data at the time of shooting. In FIG. 4A, the period 505 on the shooting time axis 501 indicates the video data 502 and the audio data 503 of frames 1 to 4. Each frame 1 to 4 is stored in the storage buffer 111 at the output timing 504 as a frame break. In FIG. 4A, the output timing 504 is indicated by a broken line.

FIG. 4B is an image diagram showing a method of reproducing video data in the period 505 corresponding to frames 1 to 4 of FIG. 4A. In FIG. 4B, the time t2 of the reproduction 1 frame on the reproduction time axis 507 is longer than the time t1 of the photographing 1 frame on the photographing time axis 501. FIG. 4C is an image diagram showing a conversion process for recording audio data in the period 505 corresponding to frames 1 to 4 of FIG. 4A. Each voice data 509 of FIG. 4 (C) corresponds to each voice data 503 of FIG. 4 (A). The numbers in each voice data 509 and each voice data 503 correspond to frames 1 to 4. In FIG. 4C, a plurality of blocks 510 are cut out from the audio data 509 of one frame while being shifted by the amount of shift 511 from the head position 512 of the shooting frame in the time axis direction. The block 510 is a part of the audio data 509 in one frame and corresponds to the partial audio data. By combining the blocks 510, the converted voice data 513 can be obtained. FIG. 4D is an image diagram when the moving image taken in the period 505 corresponding to the frames 1 to 4 of FIG. 4A is reproduced. The video data and audio data corresponding to each frame match at the head position 515. In FIG. 4D, the head position 515 is indicated by a broken line.

The flow of the conversion process will be described with reference to FIGS. 4 and 5. FIG. 5 is a flowchart showing the flow of the conversion process. The CPU 114 determines whether the value of the ratio of the set shooting frame rate to the playback frame rate is 1 (S401). If YES is determined in S401, the shooting frame rate and the playback frame rate are the same (the value of the stretch ratio is 1). Since the time t1 per frame on the shooting time axis 501 and the time t2 per frame on the reproduction time axis 507 are equal, it is not necessary to convert the audio data. In this case, the CPU 114 stores the voice data 503 stored in the memory 116 as it is in the storage buffer 111 (S402). Then, the conversion process ends. The audio data 503 stored in the storage buffer 111 is filed by the file system 115 together with the video data 502 and the shooting information, and is recorded in the memory card 109. As shown in FIG. 4A, the video data and the audio data at this time have the same output timing 504 of the video data and the audio data in each frame as in the case of shooting.

If NO is determined in S401, the shooting frame rate and the playback frame rate are different. In this case, the processes of S403 to S409 are executed for each frame. The CPU 114 sets the size of the block 510 cut out from the audio data 509 based on the amount of data of the time t1 required for one frame of the shooting frame rate in order to correspond to the conversion of the audio data 509 for each frame (S403). .. The size is a cutout size. Here, as the size of the block 510 becomes smaller than the amount of data of the time t1 per frame of the shooting frame rate, the loss of audio data before and after the conversion becomes smaller. Therefore, it is preferable that the CPU 114 sets the size of the block 510 to be small within a range (predetermined range) that does not become unnatural when the converted audio data is reproduced, and performs the conversion process by cutting out a plurality of times.

The CPU 114 sets the cutout position at the start of the conversion process to the start position 512 of the shooting frame (S404). The CPU 114 calculates the shift amount 511 based on the size of the block 510 and the value of the frame rate ratio (the value of the ratio of the reproduction frame rate to the shooting frame rate). The shift amount is used in the conversion process to reset the cutout position after cutting out. For example, when the shooting frame rate is "60 fps" and the reproduction frame rate is "30 fps", the value of the frame rate ratio is "1/2". The frame rate ratio value is the reciprocal of the stretch ratio value. In this case, the CPU 114 determines the shift amount 511 as "1/2 times" the size of the block 510. The shift amount 511 corresponds to the reciprocal of the value of the stretch ratio. As a result, the amount of data in one frame of the converted audio data can be "doubled" with respect to the amount of data in one frame of audio data at the time of shooting.

The CPU 114 cuts out the voice data stored in the voice data memory 108 from the current position by the size of the block 510 and stores it in the storage buffer 111 (S406). The CPU 114 corrects the cut-out position of the block 510 cut out from the voice data 509 by the amount of the shift amount 511 (S407). As described above, when the shift amount is "1/2 times" the size of the block 510, the cutout position of the block 510 is shifted from the audio data 509 by half of the block 510. When the shooting frame rate is larger than the reproduction frame rate, the amount of data of the converted audio data 513 is larger than the amount of data of the audio data 503 before conversion. Therefore, the CPU 114 sets the correction of the cutout position so as to overlap the block 510 of the already cut out voice data 509, and cuts out the voice data. As described above, when the shift amount is half the size of the block 510, the cut out block 510 overlaps with the previous and next blocks. Although the voice data before conversion may be duplicated in the voice data after conversion, there is no effect on the matching of the voice data at the head position 515 of each frame of the voice data after conversion.

The CPU 114 determines whether the audio data after the conversion process is stored in the memory 116 by the amount of data of the time t2 required for one frame of the reproduction frame rate (S408). If NO is determined in S408, the flow shifts to S406. If YES is determined in S408, the CPU 114 sets the write position of the storage buffer 111 at the start position of the next frame in consideration of the amount of data of the time t2 required for one frame of the reproduction frame rate (S409). Then, the conversion process ends. By the processing of S409, writing can be performed from the start position of each frame of the reproduction frame rate every time the conversion processing of the audio data of one frame is performed. That is, the audio data at the beginning of each frame at the time of shooting becomes the audio data at the beginning of each frame at the time of reproduction, and the video data and the audio data that match at the beginning position of each frame at the time of shooting when reproduced together with the video. Can be matched during playback. As a result, the video data and the audio data can be synchronized.

As described above, even if a shooting frame rate larger than the reproduction frame rate is set for the image pickup apparatus 100 during movie shooting, the audio data conversion process is performed for each frame. That is, the CPU 114 can increase the size of the audio data by cutting out blocks (partial audio data) of a predetermined size from the audio data for each frame and superimposing and combining them. As a result, even if a shooting frame rate larger than the reproduction frame rate is set in the image pickup apparatus 100, the video data and the audio data can be synchronized with the reproduction frame rate for each frame.

Here, when a shooting frame rate larger than the playback frame rate is set, it is conceivable that the audio data of a plurality of frames are collectively expanded. However, if the audio data of a plurality of frames is expanded together, a gap may occur between the audio data and the video data, and in this case, the audio data and the video data cannot be synchronized. In the present embodiment, when a shooting frame rate larger than the playback frame rate is set, the audio data and the video data can be synchronized because the processing of converting the audio data is performed for each frame.

The above example is an example of low-speed playback in which the shooting frame rate is larger than the playback frame rate, but even in the case of high-speed playback (t1> t2) in which the shooting frame rate is smaller than the playback frame rate. The conversion process of FIG. 5 can be used. In the case of high-speed playback, the stretch ratio value (the ratio of the shooting frame rate to the playback frame rate) is smaller than 1. FIG. 6 is a diagram illustrating a conversion process in the case of high-speed reproduction. FIG. 6A is an image diagram of video data and audio data at the time of shooting. The image diagram of FIG. 6 (A) is the same as the image diagram of FIG. 4 (A). FIG. 6B is an image diagram showing a method of reproducing video data in the period 605 corresponding to frames 1 to 4 of FIG. 4B. FIG. 6C is an image diagram showing a recording conversion process of the audio data 609 in the period 605 corresponding to frames 1 to 4 of FIG. 6A. FIG. 6D is an image diagram when the moving image taken in the period 605 corresponding to the frames 1 to 4 of FIG. 6A is reproduced.

The conversion process in the case of high-speed reproduction differs from the conversion process in the case of low-speed reproduction in the processing content of S407. In the case of high-speed playback, since the shooting frame rate is smaller than the playback frame rate, the amount of data of the converted audio data 613 is smaller than the amount of data of the audio data 609 before conversion. Therefore, the CPU 114 corrects the cutout position by thinning out the cut out voice data and the voice data between the next cutout positions and cutting out the voice data. In the case of the example of FIG. 6C, when the block 610 is first cut out from the audio data 609 and then the next block 610 is cut out, the cutout position is corrected by a shift amount 611 larger than the size of the block 610. To. In the case of the example of FIG. 6C, the shift amount 611 is twice the size of the block 610. That is, the shift amount 611 corresponds to the value of the reciprocal of the stretch ratio. As shown in FIG. 6C, a part of the voice data before conversion may be missing in the voice data after conversion, but the voice data is at the head position 615 of each frame of the voice data after conversion. Has no effect on matching.

As described above, even if a shooting frame rate smaller than the reproduction frame rate is set for the image pickup apparatus 100 during movie shooting, the audio data conversion process is performed for each frame. That is, the CPU 114 can reduce the size of the audio data by thinning out a part of the audio data for each frame. As a result, even if a shooting frame rate smaller than the reproduction frame rate is set in the image pickup apparatus 100, the video data and the audio data can be synchronized with the reproduction frame rate for each frame.

In the above, the image pickup apparatus 100 may transmit the video data and the audio data acquired at the set shooting frame rate to the external device via the network or the like. In this case, the external device receives the video data and the audio data acquired at the set shooting frame rate. As the external device, for example, an information processing device such as a personal computer is assumed. The setting of the reproduction frame rate can be accepted, and the above-mentioned conversion process may be performed based on the set reproduction frame rate to synchronize the video data and the audio data for each frame.

Although the preferred embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various modifications and modifications can be made within the scope of the gist thereof. The present invention supplies a program that realizes one or more functions of each of the above-described embodiments to a system or device via a network or storage medium, and one or more processors of the computer of the system or device implements the program. It can also be realized by the process of reading and executing. The present invention can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

100 Image pickup device 101 Image pickup device 105 Microphone 114 CPU
116 memory

Claims (10)

An acquisition method for acquiring video data and audio data at the shooting frame rate,
A conversion means for converting the audio data based on the ratio of the shooting frame rate to the playback frame rate, and
A recording means for recording the audio data converted by the conversion means together with the video data is provided.
The conversion means is an image pickup apparatus characterized in that the ratio of the shooting frame rate to the reproduction frame rate is calculated for each frame, and the audio data corresponding to the frame is converted based on the calculated ratio. A reception means that accepts change instructions for changing the shooting frame rate while acquiring video data,
It has a changing means for changing the shooting frame rate setting at the frame boundary when an instruction to change the shooting frame rate is received during acquisition of video data.
The conversion means calculates the ratio of the shooting frame rate to the playback frame rate by using the changed shooting frame rate in response to the change in the shooting frame rate by the changing means. The imaging device according to claim 1. Claim 1 is characterized in that, when the shooting frame rate and the reproduction frame rate are the same, the conversion means does not convert audio data based on the ratio of the reproduction frame rate to the shooting frame rate. The imaging apparatus according to. When the value of the ratio is larger than 1, the conversion means cuts out a plurality of partial voice data having a size smaller than the voice data from the acquired voice data, and superimposes and combines the plurality of the partial voice data to obtain the said voice data. The imaging device according to claim 1, wherein audio data corresponding to one frame of a reproduction frame rate is generated. The fourth aspect of claim 4, wherein the conversion means, when cutting out the plurality of partial voice data from the voice data, shifts the size of the partial voice data by the reciprocal of the value of the ratio. Imaging device. When the value of the ratio is less than 1, the conversion means thins out a part of the partial audio data having a size smaller than the audio data from the acquired audio data, and the audio corresponding to one frame of the reproduction frame rate. The imaging apparatus according to claim 1, wherein data is generated. Of claims 4 to 6, the time of the generated audio data corresponding to one frame of the reproduction frame rate is the same as the time of the video data corresponding to one frame of the reproduction frame rate. The imaging device according to any one item. The conversion means is characterized in that when the shooting frame rate is changed while the video data and the audio data are being acquired, the shooting frame rate changed in the next frame is applied. The imaging apparatus according to any one of 1 to 7. The process of acquiring video data and audio data at the shooting frame rate,
The step of converting the audio data based on the ratio of the shooting frame rate to the playback frame rate, and
The process of recording the converted audio data together with the video data, and
With
The conversion step is a control method characterized in that the ratio of the shooting frame rate to the reproduction frame rate is calculated for each frame, and the audio data corresponding to the frame is converted based on the calculated ratio. .. A program for causing a computer to execute each means according to any one of claims 1 to 8.

Images