JP2006261836A - Animation photographing/reproducing system, its photographing/reproducing method and its portable device and its photographing and reproducing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an animation photographing/reproducing system capable of reproducing an animation having a feeling of attendance when the animation is photographed and reproduced. <P>SOLUTION: The animation photographing/reproducing system has an animation photographing/reproducing means (a camera 3 and an LCD 6) conducting an animation photographing/reproduction. In the system, the data of a vibration intensity in an atmosphere during the animation photographing of the animation photographing/reproducing means (3) is detected by a vibration detecting means (an acceleration sensor 2) and recorded during the animation photographing. In the system, the vibrations of the changing data of the vibration intensity are generated by a vibration generating means (a vibrator 7) when the animation of the animation photographing/reproducing means (a memory 1 and the LCD 6) is reproduced in the changing data of the recorded vibration intensity at the same time, and the animation having the feeling of attendance is reproduced. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a moving image shooting / playback system using an acceleration sensor, a shooting / playback method thereof, a portable device, and a playback device, and more particularly to a moving image shooting / playback system and a shooting / playback method thereof that enable more realistic moving image playback. .

  In moving image shooting using a conventional mobile phone, it is common to record and play back only video and audio. With advances in technology such as LCD and microphone, it is expected that more vivid video playback on mobile phones and reproduction with clearer sound quality will continue to evolve. However, it is considered that there is a limit to the ability to convey the situation at the time of moving image shooting to the user (user, operator) in moving image reproduction with a small device that can be put in the hand.

  On the other hand, in recent TV (television) games, “vibration” has attracted attention as a new means for conveying the game status to the user. In recent TV games, a user can experience a more realistic image by installing a vibrator in a controller operated by the user and vibrating the controller in accordance with the game situation.

  In connection with such moving image shooting / playback, Patent Document 1 discloses a method of transmitting a hammering (knock) vibration with a communication terminal. This communication terminal will be described with reference to the drawings. FIG. 8 is a block diagram of the communication terminal, FIG. 9 is a front view of the communication terminal, and FIG. 10 is a flowchart for explaining the processing. As shown in FIG. 8, the portable terminal 10b includes a wireless unit 11, a storage unit 14, a control unit 12, a vibration detection unit 16, a vibration reproduction unit 17, a key input unit 13, a display unit 15, and a timer 18. Yes. The mobile terminal 10b is a normal mobile terminal provided with a vibration detection unit 16 and a vibration reproduction unit 17.

  The wireless unit 11 is means for performing bidirectional wireless communication with a center (base station: not shown), and a transmission / reception antenna 11 a is connected to the wireless unit 11. The control unit 12 is a control center of the mobile terminal, and controls each unit in the mobile terminal 10b according to various control programs stored in the program memory 14a of the storage unit 14. The key input unit 13 is composed of input keys (not shown) of numbers and various characters (alphabet characters) and the like, and inputs data such as telephone numbers by operating the input keys. The storage unit 14 includes a program memory 14a and a data memory 14b. The program memory 14a is a non-volatile memory and serves as a storage means for various control programs and control information. The program memory 14 stores a processing program and the like for transmitting data output from a vibration detection unit 16 described later to the counterpart portable terminal. The data memory 14b is a rewritable memory and stores data output from the vibration detection unit 16 (details will be described later). The display unit 15 is a means for displaying characters, symbols, and the like selected by the user operating the key input unit 13, and is configured by a liquid crystal panel or the like.

  Next, the vibration detection unit 16 and the vibration reproduction unit 17 will be described with reference to FIG. FIG. 9 shows an appearance of the mobile terminal 10b. The portable terminal 10b is provided with an openable / closable flip 20 that is pivotally supported at the end of the portable terminal 10b. The flip 20 covers an operation button (not shown) in the closed position. A striking surface portion 21 is provided on the surface of the flip 20. When the user strikes (knocks) the striking surface portion 21, the striking strength is detected by the vibration detecting portion 16.

  The vibration detection unit 16 includes a pressure sensor 16a that detects the pressure applied to the striking surface portion 21, and a pressure detection circuit 16b that outputs pressure detection data based on a signal output from the pressure sensor 16a. Further, in the following description, hitting the striking surface portion 21 is referred to as knocking, and a signal output from the pressure sensor 16a by knocking is referred to as a knocking signal. Data indicating the strength of knock output from the pressure detection circuit 16b is referred to as knock data.

  Further, the pressure sensor 16 a detects only the pressure applied to the striking surface portion 21. Therefore, even when vibration is applied to the entire mobile terminal 10b (for example, when a user who puts the mobile terminal 10b in a pants pocket runs down the stairs), pressure is applied to the striking surface portion 21. Unless otherwise, a knock signal indicating a pressure change is not output from the pressure sensor 16a. As described above, since the control unit 12 of the mobile terminal 100 determines the presence or absence of the knock input from the pressure change applied to the specific surface (striking surface portion 21), the vibration applied to the entire mobile terminal 10b is mistaken as the knock input. There is no recognition.

  Next, the vibration reproducing unit 17 is a circuit that reproduces a knock in accordance with knock data or the like sent from another mobile terminal, and includes a striking mechanism (not shown) such as a piezoelectric vibrator. This striking mechanism is provided inside the mobile terminal 10b, and accurately reproduces the strength of the striking and the striking interval (time interval from hitting to next hitting), so that the entire mobile terminal 10b Transmit vibration. Therefore, even when knock playback is performed while walking with the mobile terminal 10b in the pocket, the vibration can be experienced in knock playback.

  In this way, when the vibration reproducing unit 17 performs knock reproduction based on knock data or the like transmitted from another portable terminal, vibration due to knock reproduction is transmitted to the entire portable terminal 10b. Here, the relationship between the vibration detection unit 16 and the vibration reproduction unit 17 will be described. The vibration detection unit 16 detects the hitting strength only when hitting the hitting surface portion 21. Therefore, even when the vibration reproduced by the vibration reproducing unit 17 is transmitted to the entire mobile terminal 10b, data indicating that the knocking input has been made is output from the vibration detecting unit 16 as long as no pressure is applied to the striking surface portion 21. Never happen. Therefore, the control unit 12 does not misrecognize vibration caused by knock reproduction as knock input.

  There are two types of transmission modes of this conventional example: immediate transmission mode and post-recording transmission mode. Immediate transmission mode is a transmission mode in which data related to knock input is sequentially transmitted after knock input, and post-recording transmission mode is to store data related to knock once in data memory 14b after knock input and transmit after a predetermined time has elapsed. Is the transmission mode to be used.

  Next, an operation when data is transmitted using the mobile terminal 10b will be described. In the following description, simply referring to data means data relating to knocking. FIG. 10 is a flowchart showing the operation of the control unit 12 during data transmission. Here, a case where the user selects the immediate transmission mode will be described.

  First, after the user operates the input button to input the telephone number of the transmission partner, the transmission mode is set to the immediate transmission mode. When the transmission mode is set to the immediate transmission mode, the control unit 12 reads the center address stored in the data memory 14b, establishes a call with the center (base station; see FIG. 3 of Patent Document 1), and packet Start communication. Next, the control unit 12 activates the designated immediate transmission mode processing program and enters a knock input waiting state (step S31).

  Next, it progresses to step S32 and it is determined whether there exists a knock. Whether or not there is a knock is determined based on knock data output from the pressure detection circuit 16b. When the knock data is output from the pressure detection circuit 16b while the processes of step S31 and step S32 are repeated and it is determined that there is a knock (step S32), the knock data is stored in the data memory 14b, and the process proceeds to step S33. In step S33, the control unit 12 resets the timer 18 (T = 0). Note that the timer 18 starts measuring time with the start of knocking, and the elapsed time is sent to the control unit 12 and transmitted from the radio unit 11.

  Next, the process proceeds to step S34, where it is determined whether or not the network side is ready for transmission. Here, transmission preparation means establishing a call between terminals that exchange data (between the center and the portable terminal 10b of the user who is the transmission source). If it is determined in step S34 that network transmission is ready, the process proceeds to step S35. In step S35, the control unit 12 determines whether or not the transmission mode set by the user is the post-recording transmission mode. Since the transmission mode set by the user is the immediate transmission mode, the determination result is “No”, and the process proceeds to step S36. The control unit 12 reads knock data (knock strength) from the data memory 14b, and sends the knock data to the radio unit 11 (step S36). In response to this, the wireless unit 11 transmits single knock data composed of knock data for immediate transmission to the other mobile terminal via the antenna 11a.

  And it returns to step S31 again and repeats the process of step S31-step S36. During this time, when the user performs a button operation on the portable terminal 10b and the setting mode is switched from the immediate transmission mode to the call mode or the like, the control unit 12 ends the transmission process. In the post-recording transmission mode, after the elapse of time T (S37), knocks are detected (S39) and transmitted collectively (S38), but the description is omitted.

  Next, the operation on the receiving side that receives data will be described. First, when data is sent from the center, the mobile terminal 10b on the receiving side determines whether or not the sent data is single knock data based on the header information or the like. When the control unit 12 determines that the received data is single knock data, it sequentially reproduces knocks. Specifically, a control signal is output to the vibration reproducing unit 17 in accordance with knock data (knock strength) constituting the single knock data. The striking mechanism of the vibration reproducing unit 17 performs striking according to this control signal and transmits vibration to the entire mobile terminal 10b.

  In this conventional example, in addition to the communication function by voice or text message, simpler communication can be easily performed, and even if the user has no requirement to communicate to the other party by voice, text message, etc. Can communicate lightly.

JP 2001-148725 A

  However, with this conventional technology, a simple communication can be made by the operation of directly knocking the mobile terminal, but it is difficult to obtain a sense of reality even when shooting and playing a video on a mobile phone that has been miniaturized. was there.

  On the other hand, in games and some portable game machines, a method is adopted in which a vibrator built in a controller is vibrated in accordance with the game situation to obtain a sense of presence. However, this can be vibrated only in a predetermined situation in the game, and it is difficult to reproduce the vibration in an uncertain situation such as movie shooting with a mobile phone. In the case of a TV game, since the controller is vibrated in a situation predicted in advance, such as a situation where a character operated by a user receives an impact, it is easy to realize. However, in the case of moving image shooting, it is impossible to predict what kind of video is to be shot, and it is difficult to give vibration in accordance with video playback.

  A main object of the present invention is to provide a moving image shooting / playback system, a shooting / playback method thereof, a shooting device thereof, and a playback device thereof capable of reproducing a moving image with a sense of reality when shooting and playing back a moving image. It is in.

  According to the configuration of the present invention, in a moving image shooting / playback system including a shooting unit for shooting a moving image and a playback unit for playing back a moving image, the vibration strength in the atmosphere during the moving image shooting during the shooting of the moving image by the shooting unit Vibration detecting means for detecting the data of the image, vibration generating means for generating vibration, and when reproducing the moving image by the reproducing means, the vibration generating means generates vibration by the vibration intensity data generated at the time of shooting the moving image. Moving image reproduction control means for performing reproduction.

  In the present invention, it includes storage means for storing moving image data taken by the photographing means and the vibration strength data, and the moving image reproduction control means includes the moving image data and the vibration strength stored in the storage means. Further including a communication unit that communicates with the counterpart device during the moving image shooting, and the vibration detection unit detects the vibration strength data in the atmosphere during the moving image shooting. The communication means can transmit the vibration strength data to the counterpart device. Further, when the communication means receives the vibration strength data from the counterpart device, the video reproduction control means receives the vibration strength data. This data can be generated by the vibration generating means when the reproducing means reproduces the moving image to reproduce the moving image.

  In the present invention, the vibration detecting means can be an impact sensor or an acceleration sensor, and the vibration generating means can be an actuator including a vibrator, a vibration motor or a piezoelectric element that generates vibration, In addition, a plurality of vibration generating means can be provided, and the plurality of vibration generating means can operate corresponding to different vibration strengths. It can be a moving image shooting device, the moving image shooting / playback means can be a mobile phone with a camera or a mobile terminal, and the moving image shooting / playback means can be a TV phone.

  In addition, in the moving image shooting / playback method in which the moving image is shot by the shooting unit and the moving image is played back by the playback unit, the vibration strength in the atmosphere during the shooting of the moving image is recorded during the shooting of the moving image by the shooting unit. The data is detected by vibration detection means, and when the moving image is reproduced by the reproducing means, the vibration intensity data generated at the time of moving image shooting is generated by the vibration generating means to reproduce the moving image.

  In the present invention, the moving image data and the vibration strength data photographed by the photographing means are stored in a storage means, and the moving image data and the vibration strength data stored in the storage means are controlled to be reproduced. Further, when the communication means communicates with the counterpart device during the moving image shooting and the vibration detection means detects the vibration strength data in the atmosphere during the moving image shooting, the communication means detects the vibration strength. When the communication means receives vibration strength data from the counterpart device, the moving image playback control means sends the received vibration strength data to the playback device. The moving image can be reproduced by the vibration generating means during the reproduction of the moving image.

  Further, in the present invention, during the videophone communication, the state of vibration on the transmitting side can be transmitted to the receiving side, and a plurality of vibration generating means are provided, and these vibration generating means correspond to different vibration strengths. Can work.

  The configuration of the present invention includes a vibration detection unit that detects vibration intensity data in an atmosphere during moving image shooting during the moving image shooting of the moving image shooting unit in a portable device having a shooting unit that performs moving image shooting. It is characterized by.

  In the present invention, it can include storage means for storing the data of the moving image photographed by the photographing means and the data of the vibration intensity, and further includes a communication means for communicating with the counterpart device during the moving image photographing, When the vibration strength data in the atmosphere during the moving image shooting is detected by the detection means, the communication means can transmit the vibration strength data to the counterpart device, and the vibration detection means includes an impact sensor. Alternatively, it may be an acceleration sensor, and the moving image shooting means may be a portable moving image shooting device, a video camera, a mobile phone with a camera, a mobile terminal, or a TV phone.

  The structure of the present invention is that in a moving image shooting method in which a moving image is shot by a moving image shooting means, vibration intensity data in the atmosphere during the moving image shooting is detected by the vibration detecting means during the moving image shooting of the shooting means. Features.

In the present invention, the data of the moving image taken by the photographing means and the data of the vibration strength can be stored in the storage means, and further, the communication means communicates with the counterpart device during the moving picture photographing, and the vibration detecting means When the vibration intensity data in the atmosphere during the moving image shooting is detected by the communication means, the communication means can transmit the vibration strength data to the counterpart device. It is a telephone, a portable terminal, or a TV phone, and during the communication, the vibration status in the atmosphere on the transmission side can be transmitted to the reception side.
According to another aspect of the present invention, in a portable device having a playback unit that plays back a moving image, the vibration generating unit that generates vibrations, and the vibration strength generated when the moving image is captured when the playback unit plays back the moving image. Moving image reproduction control means for reproducing a moving image by generating vibration by the vibration generating means according to data.

  In the present invention, when the communication means receives the vibration strength data from the counterpart device, the moving picture reproduction control means generates the received vibration strength data by the vibration generating means during the reproduction of the moving picture by the reproducing means to reproduce the moving picture. A plurality of vibration generating means, the vibration generating means can operate corresponding to different vibration strengths, and the moving image reproducing means is a mobile phone with a camera, a portable terminal or It is a TV phone, and during the communication, the state of vibration in the atmosphere on the transmission side can be transmitted to the reception side.

  As described above, according to the present invention, vibration information at the time of moving image shooting is recorded using the vibration detection unit, and the vibration generating unit is operated at the time of moving image reproduction in accordance with the timing at which the vibration is sensed. The vibration at the time of shooting can be reproduced. As a result, in the conventional video shooting and reproduction, only video and audio are reproduced, but by adding vibration reproduction, a more realistic video reproduction can be performed.

  Next, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram of an embodiment in which the present invention is applied to a mobile phone. Referring to FIG. 1, a mobile phone 10 according to the present embodiment includes a camera 3 serving as an imaging unit necessary for conventional moving image shooting, a microphone 4, a speaker 5 required for moving image reproduction, and a display LCD 6. And a built-in memory 1 for recording moving images and a CPU 8 for controlling them. In addition to these, the acceleration sensor 2 and the vibrator 7 which are features of the present invention are incorporated. The reproduction means for reproducing and displaying the moving image may be a display device other than the LCD 6.

  The present embodiment is a mobile phone (electronic device) having a moving image shooting function, and includes a vibration sensor (2) (actually, an acceleration sensor 2 and the like) and a vibrator (vibration generating means) 7 for shooting a moving image. The vibration applied to the electronic device body is detected by the vibration sensor (2), the vibration information is recorded, and the vibration information recorded at the time of reproduction is reproduced by the built-in vibrator 7. Note that FIG. 1 does not show a radio unit for communicating with the base station.

  In this embodiment, the camera 3 is the same as a conventional mobile phone and records a video when shooting a moving image. The microphone 4 is the same as a conventional mobile phone and records sound when a moving image is taken. The acceleration sensor 2 records information on shaking of the mobile phone, impact applied to the mobile phone at the time of shooting, and the like. Although the acceleration sensor 2 can detect the strength of vibration, a threshold value for vibration strength is determined in advance, and only when the threshold value is exceeded, a vibrator 7 described later reproduces vibration during reproduction. Can be considered.

  The memory 1 is a storage unit that records video, audio, and vibration information recorded by the camera 3, the microphone 4, and the acceleration sensor 2. Various storage media such as a memory, a hard disk, a memory chip, and a compact disk may be used as the storage means. The speaker 5 outputs sound when playing back a moving image. The LCD 6 displays an image when reproducing a moving image. The vibrator 7 operates the vibration information at the time of moving image recording recorded by the acceleration sensor 2 according to the scene where the vibration is recorded, and reproduces the vibration. The CPU 8 controls all of these. The timer 9 is synchronized when reproducing video, audio, and vibration.

  In the present embodiment, the vibration sensor (2) includes the acceleration sensor 2 and the like, and the vibration generator (vibrator 7) may be an actuator such as a piezoelectric element or a vibration motor (vibration motor). At the time of moving image shooting, the vibration applied to the main body of the electronic device is detected by the vibration sensor (2), and the vibration information (acceleration, velocity or displacement) is recorded. The vibration information recorded at the time of reproduction is reproduced by the built-in vibration generator (7). Specifically, the vibration data is faithfully reproduced by acceleration and other data using an actuator such as a piezoelectric element. May be. The vibration data may be vibration intensity, and vibration corresponding to the vibration intensity may be changed by an actuator such as a piezoelectric element to change the amplitude of a general signal such as a sine wave (which may be a triangular wave or a rectangular wave). . Alternatively, when the vibration is a predetermined intensity or more, the actuator may be operated to generate a constant vibration by applying a signal such as a constant sine wave. The vibrator motor (vibration motor) rotates the eccentric load, but may change the number of rotations of the vibration motor, or may have a plurality of vibration motors having different vibration strengths, depending on the vibration strength. A vibration motor may be selected to generate vibration. Alternatively, the vibration motor may be operated to generate vibration when the vibration is greater than a predetermined intensity.

  As described above, the mobile phone according to the present embodiment includes the photographing unit (for example, the camera 3) for capturing a moving image and the reproducing unit (for example, the LCD 6) for reproducing the moving image. Further, the mobile phone includes a vibration detecting means (for example, vibration sensor 2) for detecting vibration intensity data in the atmosphere during the moving image shooting, and a vibration generating means (for generating vibration) ( For example, it has a vibrator 7). Further, when the moving image is played back by the playback means, the CPU 8 is a moving image playback control means for playing back the moving image generated by the vibration generating means in accordance with the vibration intensity data generated at the time of shooting the moving image.

  As a result, in the present embodiment, when shooting moving images with an electronic device having a moving image shooting function, vibration information during shooting is recorded together with moving image information and audio information, and the moving image information and audio information are reproduced. In addition, at the time of shooting, the vibrator is vibrated when there is a vibration or impact exceeding a certain threshold value, thereby making it possible to reproduce a moving image with a more realistic feeling.

  Further, the present embodiment includes a communication means (a wireless unit (not shown), CPU 8) that communicates with the counterpart device during moving image shooting. When the vibration detection means detects vibration strength data in the atmosphere during moving image shooting, the communication means transmits the vibration strength data to the counterpart device.

  As a result, this embodiment acquires vibration information during shooting and transmits this vibration information when transmitting a moving image such as a TV phone in real time, instead of recording a moving image when shooting a moving image. Thus, the state of vibration on the transmission side can be transmitted to the reception side during communication.

  Next, the operation of the system shown in FIG. 1 will be described with reference to FIGS. FIG. 2 is a flow diagram describing the operation at the time of moving image shooting according to the present embodiment, centering on the vibration recording operation of the acceleration sensor 2. First, when moving image shooting starts, the timer 9 is started for the purpose of synchronizing the recorded video, audio, and vibration information (step S1 in FIG. 2). At the same time, the camera 3, the microphone 4, and the acceleration sensor 2 each start recording (step S2). Thereafter, the operation and recording method of the camera 3 and the microphone 4 are the same as those of the conventional moving image shooting until the predetermined moving image shooting time ends. The acceleration sensor 2 constantly measures the strength of vibration and impact given to the mobile phone during moving image shooting. When a certain threshold is exceeded (step S3), the count value of the timer 9 at that time is recorded, It is recorded at which point the vibration exceeding the threshold is applied (step S5 in FIG. 2).

  Details of the intensity of vibration of the acceleration sensor 2 and the timing for recording the timer count value in step S5 of FIG. 2 will be described with reference to the operation waveform diagram of FIG. The horizontal axis in FIG. 4 represents the time since the start of imaging, and the vertical axis represents the strength of vibration measured by the acceleration sensor 2. For example, when the shooting time and the vibration intensity are as shown in FIG. 4, the time at a circle that exceeds a predetermined threshold is recorded. Then, the vibrator 7 is operated only during that time in the operation at the time of moving image reproduction described later.

  Next, the operation of the present embodiment at the time of moving image reproduction will be described using the flowchart of FIG. When the moving image reproduction starts, the timer 9 is activated (step S11 in FIG. 3) first in order to perform reproduction while synchronizing the recorded video, audio, and vibration information (step S12). At the same time, the LCD 6 and the speaker 5 are activated to reproduce video and audio. Thereafter, the method of reproducing video and audio performs normal moving image reproduction. If it is determined in step S13 that the shooting time has ended, the process ends. If the shooting time continues (No), the process proceeds to step S14.

  During the image reproduction in the moving step S14, when the timing of the photographing time recorded in the step S5 in FIG. 2 is reached, the vibrator 7 is vibrated in the step S15. Then, when the timing of the photographing time recorded in step S5 in FIG. 2 has elapsed or when the vibration of the vibrator 7 has ended, the process returns to step S13. As a result, the vibration information recorded during the reproduction of the moving image can be reproduced at the same timing.

  FIG. 5 is a partial block diagram of the second embodiment of the present invention, showing a case where a plurality of vibrators are provided. FIG. 6 is a waveform diagram for explaining the operation of FIG. In this embodiment, a plurality of (two vibrators 7a and 7b are provided so that a moving image can be reproduced according to the strength of vibration. In FIG. 5, vibrator 1 (7b) and vibrator 2 ( 7c) is controlled by the vibrator control device 7a, which can select only one of the vibrators or both the vibrators 7b and 7c. The difference between the embodiment and the moving image shooting of the embodiment 1 is that two threshold values are prepared.

  For example, the case where the relationship between the intensity of vibration and the shooting time is as shown in the waveform diagram of FIG. 6 will be described. In FIG. 6, the vibration intensity over time is shown. The vibration intensity threshold 1 and threshold 2 are set as different vibration intensities, and the threshold 1 is greater than the threshold 2. The portion of the circle where the vibration intensity exceeds the threshold value 1 is a case where both the vibrator 1 (7b) and the vibrator 2 (7c) are operated. In this way, strong vibrations can be reproduced by simultaneously operating the vibrators 7b and 7c. Further, in FIG. 6, only the vibrator 1 (7b) is operated in the portion of the arrow that is below the threshold 1 but exceeds the threshold 2. This makes it possible to reproduce weak vibrations.

  If a plurality of vibrators having different vibration strengths are provided as described above, by setting a plurality of threshold values for the vibration strengths recorded by the acceleration sensor 2, vibrations having different strengths depending on the situation at the time of shooting are provided. Can be reproduced.

FIGS. 7A and 7B are flowcharts at the time of transmission and at the time of reception according to the third embodiment of the present invention. In the first and second embodiments described above, the application method when shooting and playing back a moving picture with one mobile phone has been described. However, the third embodiment is an application method in a TV phone using two mobile phones. is there. Conventional videophones only transmit video and audio, but the method described here conveys vibration information detected by an acceleration sensor mounted on a mobile phone on the transmission side to the reception side. When vibration information is received together with video and audio, the vibration is reproduced by the vibrator installed.
In this case, the vibration data may be transmitted to the counterpart mobile terminal via a base station or directly to the counterpart mobile terminal using close proximity wireless communication.

  The operation of this embodiment will be described with reference to FIGS. FIGS. 7 (a) and 7 (b) are flowcharts describing operations on the transmission side and reception side during a videophone call, mainly focusing on vibration transmission. The transmission method of video and audio during a video phone is the same as that of a normal mobile phone.

  In FIG. 7A, when the telephone call is in progress at step S21 (the video telephone is not terminated), the acceleration sensor equipped on the transmission side detects the strength of the vibration. In this case, when the acceleration sensor detects the vibration intensity exceeding the predetermined threshold value in step S22, the vibration information is transmitted to the receiving side in accordance with the vibration detection timing in step S23 (step S23 in FIG. 7). When the transmitting side finishes transmitting the vibration information to the receiving side, or when the acceleration sensor cannot detect the intensity of vibration exceeding the predetermined threshold, the process returns to step S21 to return to the vibration detection state.

  In FIG. 7B, the receiving side waits for vibration information sent from the transmitting side when the telephone call is in progress (step S24 is not finished) in step S24. Then, when the receiving side receives the vibration information from the transmitting side in step S25, in step S26, the vibrator is operated at the same timing as the vibration information from the transmitting side to reproduce the vibration. When vibration information from the transmission side is not received or when the vibration of the vibrator is finished, the process returns to step S24 and returns to standby for vibration information.

  According to the present embodiment, it is possible to transmit a realistic vibration to a communication partner in a remote place during a videophone call. Specific examples in this case include the following cases. First, 1) When a mobile phone on the transmission side collides with something during a videophone call, the impact can be transmitted to the reception side. Also, 2) If you are sending a videophone in a scene where there is constant vibration, such as in a car or train, the receiving side will experience the vibration as if you were on the phone. can do.

  In this way, the present invention can be applied not only to mobile communication terminals that can shoot moving images, but also to devices that transmit moving images in real time, such as videophones, without recording moving images.

  In these embodiments, a camera-equipped cellular phone and a TV cellular phone have been described. However, by implementing vibration detection means and vibration generation means in general video recording / playback equipment in general, it is possible to reproduce video with a sense of presence. It becomes.

  The present invention can be applied not only to portable terminals such as camera-equipped cellular phones and TV cellular phones, but also to all moving image photographing / reproducing devices including vibration detecting means and vibration generating means. Furthermore, the present invention can be applied not only to a system having a moving image shooting / playback function but also to a moving image shooting device such as a video camera provided with a vibration detecting unit and a moving image playback device such as a video deck including a vibration generating unit. .

1 is a block diagram of a moving image capturing apparatus that explains a first embodiment of the present invention. FIG. It is a flowchart explaining the process of the moving image operation | movement of FIG. It is a flowchart explaining the process of the reproduction | regeneration operation | movement of FIG. It is a graph explaining the operation example of the vibration of FIG. It is a block diagram explaining the vibrator of FIG. It is a graph explaining the operation example of the vibration of FIG. (A) (b) is a flowchart explaining the transmission and reception processing of FIG. It is a block diagram of the portable terminal explaining the vibration simulation of a prior art example. It is a front view of the portable terminal of FIG. It is a flowchart explaining the transmission operation of the portable terminal of FIG.

Explanation of symbols

1 Memory 2 Acceleration Sensor 3 Camera 4 Microphone 5 Speaker 6 LCD
7, 7b, 7c Vibrator 7a Vibrator control device 8 CPU
DESCRIPTION OF SYMBOLS 9,18 Timer 10,10a Cellular phone 10b Portable terminal 11 Radio | wireless part 11a Antenna 12 Control part 13 Key input part 14 Memory | storage part 15 Display part 16 Vibration detection part 17 Vibration reproduction part 20 Flip 21 Impact surface part

Claims (34)

In a moving image shooting / playback system including shooting means for shooting a movie and playback means for playing a movie,
Vibration detection means for detecting vibration intensity data in the atmosphere during moving image shooting during moving image shooting by the shooting means;
Vibration generating means for generating vibration;
A moving image reproduction control means for reproducing a moving image by generating vibration by the vibration generating means based on the vibration strength data generated at the time of moving image shooting at the time of moving image reproduction by the reproducing means;
A video shooting / playback system characterized by comprising: Furthermore, it includes storage means for storing moving image data and vibration strength data photographed by the photographing means, and the moving image reproduction control means includes the moving image data and the vibration strength data stored in the storage means. The moving image photographing / reproducing system according to claim 1, wherein the moving image photographing / reproducing system is controlled to reproduce the image. Further, the communication means includes communication means for communicating with the counterpart device during the moving image shooting, and when the vibration detection means detects the vibration strength data in the atmosphere during the moving image shooting, the communication means stores the vibration strength data. The moving image photographing / reproducing system according to claim 1, wherein the moving image photographing / reproducing system transmits the image to the counterpart device. Further, when the communication means receives the vibration strength data from the counterpart device, the moving picture reproduction control means generates the received vibration strength data by the vibration generating means during the moving picture reproduction of the reproducing means, and performs the moving picture reproduction. Item 4. The moving image shooting / playback system according to item 3. 4. The moving image photographing / reproducing system according to claim 1, wherein the vibration detecting means is an impact sensor or an acceleration sensor. 5. The moving image photographing / reproducing system according to claim 1, wherein the vibration generating means is a vibrator, a vibration motor for generating vibration, or an actuator comprising a piezoelectric element. 7. The moving image photographing / reproducing system according to claim 1, wherein a plurality of vibration generating means are provided. 8. The moving image photographing / reproducing system according to claim 7, wherein the plurality of vibration generating means operate in accordance with different vibration strengths. 3. The moving image photographing / reproducing system according to claim 1, wherein the moving image photographing means and the reproducing means are portable moving image photographing devices. 5. The moving image photographing / reproducing system according to claim 1, wherein the moving image photographing means and the reproducing means are a mobile phone with a camera and a portable terminal. 11. The moving image photographing / reproducing system according to claim 10, wherein the moving image photographing means and the reproducing means are videophones. In a moving image shooting / playback method in which a moving image is shot by a shooting means and a moving image is played by a playing means,
During the moving image shooting by the shooting means, the vibration detection means detects vibration strength data in the atmosphere during the moving image shooting,
When the moving image is reproduced by the reproducing means, the vibration strength data generated at the time of moving image shooting is caused to generate vibration by the vibration generating means, and the moving image is reproduced.
A video shooting and playback method characterized by this. Further, the moving image data and the vibration strength data photographed by the photographing means are stored in a storage means, and the moving image data and the vibration strength data stored in the storage means are controlled to be reproduced. Item 13. The moving image shooting / playback method according to Item 12. Further, when the communication means communicates with the counterpart device during the moving image shooting, and the vibration detecting means detects the vibration strength data in the atmosphere during the moving image shooting, the communication means sends the vibration strength data to the 14. The moving image capturing / reproducing method according to claim 12 or 13, wherein the moving image capturing / reproducing method is transmitted to a partner apparatus. Further, when the communication means receives the vibration strength data from the counterpart device, the moving picture reproduction control means generates the received vibration strength data by the vibration generating means during the moving picture reproduction of the reproducing means, and performs the moving picture reproduction. Item 15. The moving image shooting / playback method according to Item 14. The moving image shooting / playback method according to claim 15, wherein the state of vibration on the transmission side is transmitted to the reception side during videophone communication. 17. The moving image shooting / reproducing method according to claim 12, wherein a plurality of vibration generating means are provided, and the vibration generating means operate corresponding to different vibration intensities. A portable device having a photographing means for performing moving image photographing, comprising: a vibration detecting means for detecting vibration intensity data in an atmosphere during moving image photographing during photographing of the moving image by the photographing means. 19. The portable device according to claim 18, further comprising storage means for storing moving image data photographed by the photographing means and vibration intensity data. Further, the communication means includes communication means for communicating with the counterpart device during the moving image shooting, and when the vibration detection means detects the vibration strength data in the atmosphere during the moving image shooting, the communication means stores the vibration strength data. The portable device according to claim 18 or 19, wherein the portable device transmits to the counterpart device. The portable device according to claim 18 or 19, wherein the vibration detecting means is an impact sensor or an acceleration sensor. 21. The portable device according to claim 18, 19 or 20, wherein the moving image photographing means is a portable moving image photographing device, a video camera, a mobile phone with a camera, a portable terminal or a TV phone. In the moving image shooting method for shooting a moving image by the moving image shooting means, the vibration detecting means detects vibration intensity data in the atmosphere during the moving image shooting during the moving image shooting of the shooting means. . 24. The moving image shooting method according to claim 23, wherein the moving image data taken by the shooting means and the vibration intensity data are stored in a storage means. Further, when the communication means communicates with the counterpart device during the moving image shooting, and the vibration detection means detects the vibration strength data in the atmosphere during the moving image shooting, the communication means transmits the vibration strength data to the 25. The moving image shooting method according to claim 23 or 24, which is transmitted to a partner apparatus. 25. The moving image shooting method according to claim 23 or 24, wherein the moving image shooting means is a camera-equipped mobile phone, a portable terminal, or a TV phone, and transmits a vibration state in the atmosphere on the transmitting side to the receiving side during communication. In a portable device having a reproducing means for reproducing a moving image,
Vibration generating means for generating vibration;
Video playback control means for generating a video by causing the vibration generating means to generate a vibration based on the vibration strength data generated during the video shooting when the video is played by the playback means;
A portable device comprising: Furthermore, it includes a communication unit that receives vibration strength data from the counterpart device, and the moving image reproduction control unit generates the received vibration strength data by the vibration generating unit when the reproducing unit reproduces the moving image, thereby reproducing the moving image. 28. A portable device according to claim 27. 29. The portable device according to claim 27 or 28, wherein the vibration generating means is a vibrator, a vibration motor for generating vibration, or an actuator comprising a piezoelectric element. 29. The portable device according to claim 27 or 28, wherein the moving image reproducing means is a portable moving image photographing device, a mobile phone with a camera, a portable terminal, a TV phone or a video reproducing device. In a video playback method in which video playback is performed by a video playback means,
A moving image photographing method, wherein, when reproducing a moving image by the reproducing means, a vibration is generated by the vibration generating means based on the vibration intensity data generated at the time of photographing the moving image. Further, when the communication means receives the vibration strength data from the counterpart device, the moving image reproduction control means generates the received vibration strength data by the vibration generating means during the moving image reproduction of the reproducing means to perform the moving image reproduction. Item 31. The moving image shooting / playback method according to Item 31. The moving image photographing method according to claim 31 or 32, wherein a plurality of vibration generating means are provided, and the vibration generating means operate corresponding to different vibration strengths. 33. The moving image reproducing method according to claim 31 or 32, wherein the moving image reproducing means is a camera-equipped mobile phone, a portable terminal, or a TV phone, and transmits the vibration state in the atmosphere on the transmitting side to the receiving side during communication.

Images