JP2012227865A - Electronic device, synthesis method, and synthesis program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To richly express detected information.SOLUTION: The electronic device comprises: a plurality of detectors 11 and 12 which detect from an object to be detected a plurality of signals showing features of the object; an extraction part 21 which extracts, from the plurality of signals detected by the plurality of detectors 11 and 12, respective patterns of the signals which appear repeatedly; and a synthesis part 26 which synthesizes the respective patterns extracted.

Description

  The present invention relates to an electronic device, a synthesis method, and a synthesis program.

  Conventionally, a method for extracting the rhythm of a musical piece is known. For example, in Patent Document 1, a sensor unit that is attached to a human body and detects a movement of an attachment location, a tempo extraction unit that extracts a detection tempo of a detection value detected by the sensor unit, a music output unit that outputs a music, There is shown a video game apparatus comprising rhythm extracting means for extracting a rhythm of a musical piece, and evaluation means for evaluating whether the detected tempo extracted by the tempo extracting means is synchronized with the musical rhythm extracted by the rhythm extracting means. Yes.

JP 2006-192276 A

  Conventionally, an electronic device can extract a tempo from a signal detected from a sensor that detects a motion such as an acceleration sensor included in the device, and display information indicating the tempo on a display device. However, since the tempo reflects only the information of the operator's movement, there is a problem that there are few variations in expression.

  Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide a technique capable of expressing detected information richly.

  In order to solve the above problems, an electronic device according to one embodiment of the present invention is detected by a plurality of detection units that detect a plurality of signals indicating characteristics of the target from the detection target, and the plurality of detection units. In addition, an extraction unit that extracts each signal pattern that repeatedly appears from a plurality of signals, and a synthesis unit that synthesizes the extracted patterns are provided.

  Further, the synthesis method according to one aspect of the present invention includes a plurality of detection procedures for detecting a plurality of signals indicating characteristics of the target from the detection target, and a plurality of signals detected by the plurality of detection procedures. It has an extraction procedure for extracting each pattern of the signal that appears, and a synthesis procedure for synthesizing the extracted patterns.

  In addition, a synthesis program that is one embodiment of the present invention provides information indicating a plurality of signals from the storage unit to a computer including a storage unit that stores information indicating a plurality of signals detected by the plurality of detection units. A synthesis program for executing an extraction step for extracting each of the signal patterns that repeatedly appear from information indicating the plurality of read signals and a synthesis step for synthesizing the extracted patterns. .

  According to the present invention, it is possible to express the detected information richly.

It is a block block diagram of the electronic device in this embodiment. It is a figure for demonstrating the direction in which the electronic device in this embodiment is shaken. It is a figure for demonstrating the process of a pattern extraction part. It is the figure by which another example of the signal which shows the motion after the normalization input into a pattern extraction part, and the autocorrelation function calculated by a pattern extraction part. It is a figure for demonstrating the process of the normalization part. It is a figure for demonstrating the process of a synthetic | combination part. It is the flowchart which showed the flow of the process of the electronic device of 1st Embodiment. It is a structural example of the communication system 2 in 2nd Embodiment. It is a block block diagram of the electronic device in 2nd Embodiment. It is a figure for demonstrating the process of a data extraction part. It is a figure for demonstrating the process of a motion image | video synthetic | combination part. It is the figure by which an example of table T1 memorize | stored in the atmosphere data storage part was shown. It is the flowchart which showed the flow of the process of the electronic device of 2nd Embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a block diagram of an electronic device 1 according to this embodiment.
The electronic device 1 includes a detection unit 10, a control unit 20, a pattern storage unit 25, and an output unit 30.

  First, the outline | summary of the electronic device 1 of this embodiment is demonstrated. When the electronic device 1 is held and shaken by the operator, the electronic device 1 detects the movement of the own device and the pressure applied to the side surface of the own device, and the signal indicating the detected movement and the signal indicating the pressure Then, the signal patterns that repeatedly appear are extracted, and the extracted patterns are synthesized. As a result, the electronic device 1 can increase variations of the synthesized pattern by synthesizing a plurality of patterns, and informs the synthesized pattern to the outside via the output unit 30. Information detected by the apparatus can be expressed richly.

Hereinafter, processing of each unit will be described. The detection unit 10 detects a plurality of signals indicating the characteristics of the target (for example, the movement of the self device and the pressure applied to the side surface of the self device) from the detection target (for example, the self device). Here, the detection unit 10 includes a motion detection unit 11 and a pressure detection unit 12.
The motion detection unit 11 detects the motion of the own device and supplies a signal indicating the detected motion to the pattern extraction unit 23. Specifically, for example, the movement detection unit 11 detects the movement of the own apparatus when the own apparatus is being held and moved by the operator. As the motion detection unit 11, for example, an acceleration sensor is provided.

  The pressure detection unit 12 is disposed on the side surface of the electronic device 1, detects the pressure applied to the side surface, and outputs a signal indicating the detected pressure to the pattern extraction unit 23. Specifically, for example, the pressure detection unit 12 detects, in a predetermined stage (for example, 256 stages), the pressure applied to the side surface of the own apparatus when the own apparatus is being held and moved by the operator. . For example, if the pressure detection unit 12 is divided into five points, the pressure detection unit 12 can detect the pressure at five points. As the pressure detection unit 12, for example, a capacitance type pressure detection sensor is provided.

The processing of the motion detection unit 11 and the pressure detection unit 12 will be described using a specific example of FIG.
FIG. 2 is a diagram for explaining a direction in which the electronic apparatus 1 is gripped and shaken by an operator (user) of the own apparatus. In the xyz coordinate system in the figure, a direction 41 in which the electronic device 1 is swung is shown, and the electronic device 1 is swung in the z-axis direction. A pressure detector 22 is provided on the side surface of the electronic device 1.

In the example of the figure, for example, the motion detection unit 11 includes a three-dimensional acceleration sensor and detects acceleration of three axes (x, y, z axes). The motion detection unit 11 outputs a signal indicating triaxial acceleration to the pattern extraction unit 23 described later of the control unit 20.
The pressure detection unit 12 detects the pressure applied to the side surface of the device when the device is held by an operator (user), and outputs a signal indicating the detected pressure to the pattern extraction unit 23.

  Returning to FIG. 1, the control unit 20 includes an extraction unit 21 and a synthesis unit 26. The extraction unit 21 extracts the pattern of the signal repeatedly appearing from the plurality of signals detected by the plurality of detection units (in this embodiment, the motion detection unit 11 and the pressure detection unit 12). Here, the extraction unit 21 includes a pattern extraction unit 23 and a normalization unit 24.

  Next, an outline of processing by the pattern extraction unit 23 will be described. The pattern extraction unit 23 extracts a pattern that repeatedly appears as a motion pattern and a pressure pattern from a signal indicating motion and a signal indicating pressure, respectively. The pattern extraction unit 23 outputs information indicating the extracted movement pattern and information indicating the pressure pattern to the normalization unit 24.

  An example of processing of the pattern extraction unit 23 will be described with reference to FIG. FIG. 3 is a diagram for explaining the processing of the pattern extraction unit 23. Here, it is assumed that the own device is repeatedly shaken in a constant pattern in the z-axis direction by an operator (user). In the present embodiment, only the acceleration in the z-axis direction will be described for easy understanding.

On the upper side of the figure, there is shown a curve W42 representing the time change of acceleration in the z-axis direction detected by the motion detector 11. Further, the curve W42 is divided into three time regions by broken lines, and it is shown that the temporal change in acceleration after normalization in one time region is repeated.
A curve W43 indicating a pattern extracted by the pattern extraction unit 23 is shown on the lower side of FIG. In the example shown in the figure, the pattern extraction unit 23 extracts a temporal change that repeatedly appears as a motion pattern from a signal indicating motion.

  Next, details of pattern extraction processing by the pattern extraction unit 23 will be described. FIG. 4 is a diagram showing another example of the signal indicating the motion input to the pattern extraction unit 23 and the autocorrelation function calculated by the pattern extraction unit 23. FIG. 4A shows a curve W51 showing another example of the signal indicating the motion input to the pattern extraction unit 23. Here, the vertical axis represents amplitude, and the horizontal axis represents the number of samples.

  FIG. 4B shows an example of a curve W52 indicating an autocorrelation function calculated from each point constituting the curve W51 by the pattern extraction unit 23. Here, the vertical axis represents the value of the autocorrelation function, and the horizontal axis represents the number of samples. It is also shown that the peak P53, which is the maximum value of the autocorrelation function, and the period from the first sample to the sample of the peak P53 are one period τ.

  For example, input data A composed of n terms input to the pattern extraction unit 23 shown in FIG. 4A is expressed by the following equation (1).

  An array A ′ of m terms (m = n / 2), which is a part of the array of input data A shown in FIG. 4A, is expressed by the following equation (2) (n is 2). The above even numbers, m is a positive integer).

  Here, A ′ is fixed. Further, an array B of m terms obtained by shifting the array of the input data A shown in FIG. 4A by t (0 ≦ t ≦ n / 2) is expressed by the following equation (3).

  Here, B is variable.

  The pattern extraction unit 23 calculates the autocorrelation function by the array A ′ and the array B obtained by the shift width t according to the following equation (4).

Here, i is an index of an element of each array. In addition, the value approaches 1 as the waveforms of the elements of the arrays A ′ and B that are drawn at a predetermined interval are more similar.
The pattern extraction unit 23 extracts data (peak value) of an upwardly convex vertex on the autocorrelation function R (t). Then, when the extracted peak value exceeds a predetermined threshold, the pattern extraction unit 23 extracts a sample number (or time) that takes the peak value. The pattern extraction unit 23 extracts a sample interval (or time interval) that takes a peak value as the period τ.

  The pattern extraction unit 23 divides the input data A every period by the period τ obtained by the autocorrelation function. If the number of repetitions is num, the pattern extraction unit 23 calculates the one-cycle average data ave (n) according to the following equation (5).

  Here, k is an integer. The one-cycle average data ave (n) is output data of the pattern extraction unit 23 and corresponds to the curve W43 in FIG. The pattern extraction unit 23 outputs the calculated one-cycle average data ave (n) to the normalization unit 24 as information indicating a motion pattern. Similarly, the pattern extraction unit 23 also calculates the one-cycle average data ave (n) for the pressure, and outputs the calculated one-cycle average data ave (n) to the normalization unit 24 as information indicating the pressure pattern. .

  The normalizing unit 24 normalizes the information indicating the motion pattern and the information indicating the pressure pattern in parallel to a value in a predetermined range (for example, a value from −1 to 1). Information indicating the pattern and information indicating the pressure pattern after normalization are stored in the pattern storage unit 25.

An example of the processing of the normalization unit 24 will be described with reference to FIG. FIG. 5 is a diagram for explaining the processing of the normalization unit. On the upper side of the figure, a curve W43 indicating a pattern is shown. The vertical axis is the acceleration in the z-axis direction, and the horizontal axis is the time. On the lower side of the figure, there is shown a curve W44 showing the time change of the acceleration after the acceleration in the z-axis direction is normalized to a value from −1 to 1. The vertical axis represents normalized acceleration, and the horizontal axis represents time.
In the example shown in the figure, the normalization unit 24 normalizes a signal indicating acceleration in the z-axis direction to a value from −1 to 1 among signals indicating triaxial acceleration.

  In the present embodiment, the normalization unit 24 normalizes the signal indicating motion and the signal indicating pressure in parallel, but the present invention is not limited to this, and normalization may be performed in order. In that case, the normalization unit 24 may be configured only by hardware by delaying either a signal indicating motion or a signal indicating pressure by a delay element included in the normalization unit 24. Further, the normalization unit 24 converts one of the signal indicating motion and the signal indicating pressure into a digital signal, temporarily stores the converted digital signal in a buffer included in the normalization unit 24, and sequentially The stored digital signal may be read and the read digital signal may be normalized.

  The synthesizing unit 26 reads information indicating the motion pattern after normalization and information indicating the pressure pattern after normalization from the pattern storage unit 25. When the amplitude of each pattern is larger than a predetermined threshold (for example, 0.5), the synthesis unit 26 determines the amplitude of the pattern obtained by synthesis based on the amplitude of each pattern, Synthesize the pattern.

  An example of the processing of the synthesis unit 26 will be described with reference to FIG. FIG. 6 is a diagram for explaining the processing of the synthesis unit 26. In the figure, the vertical axis represents normalized amplitude, and the horizontal axis represents time. In the figure, a curve W51 indicating a motion pattern after normalization, a curve W52 indicating a pressure pattern after normalization, a motion pattern after normalization, and a pressure pattern after normalization are combined into a combining unit 26. The curve W53 which shows the synthetic | combination signal after synthesize | combining is shown.

  For example, the synthesis unit 26 adds the value 0.6 on the curve W51 of the normalized motion pattern and the value 0.8 on the curve W52 of the normalized pressure pattern, and obtains the result by addition. The value 1.12 obtained by multiplying the obtained value 1.4 by the coefficient 0.8 corresponding to the combination of amplitudes (0.6 and 0.8) of each pattern is the amplitude of the peak P54 on the curve W53 indicating the combined signal. And

Similarly, for example, the synthesis unit 26 adds the value 0.8 on the curve W51 of the normalized motion pattern and the value 0.8 on the curve W52 of the normalized pressure pattern, and adds The value 1.36 obtained by multiplying the value 1.6 obtained by the above by a coefficient 0.85 corresponding to the combination of amplitudes of each pattern (0.8 and 0.8) is a peak on the curve W53 indicating the synthesized signal. The amplitude is P55.
Similarly, for example, the synthesis unit 26 adds the value 1.0 on the curve W51 of the normalized motion pattern and the value 0.8 on the curve W52 of the normalized pressure pattern, and adds A value 1.62 obtained by multiplying the value 1.8 obtained by the above by a coefficient 0.9 corresponding to the combination (1.0 and 0.8) of the amplitude of each pattern is a peak P56 on the curve W53 indicating the combined signal. The amplitude of.

  The combining unit 26 outputs image data based on the combined pattern to the display unit 31 described later of the output unit 30. The synthesizing unit 26 generates an electric signal based on the combined pattern and outputs the electric signal to the audio output unit 32.

The output unit 30 notifies the outside of the device itself based on the pattern synthesized by the synthesis unit 26. Here, the output unit 30 includes a display unit 31 and an audio output unit 32.
The display unit 31 displays image data based on the input from the synthesis unit 26.
The audio output unit 32 outputs audio based on the electrical signal supplied from the synthesis unit 26.

  FIG. 7 is a flowchart illustrating a processing flow of the electronic device 1 according to the first embodiment. First, the detection unit 10 detects the movement of the own device and the pressure applied to the side surface of the own device (step S101). Next, the pattern extraction unit 23 extracts a motion pattern (step S102). In parallel with this, the pattern extraction unit 23 extracts a pressure pattern (step S103).

  Next, the normalization unit 24 normalizes the motion pattern (step S104). In parallel with this, the normalization unit 24 normalizes the pressure pattern (step S105). Next, the synthesis unit 26 synthesizes the motion pattern and the pressure pattern (step S106). Next, the display unit 31 displays an image based on the combined pattern (step S107). Next, the sound output unit 32 outputs sound based on the synthesized pattern (step S108). Above, the process of this flowchart is complete | finished.

  As described above, the electronic device 1 according to the present embodiment detects the movement of the own device and the pressure applied to the side surface of the own device when the own device is gripped and shaken by the operator, and indicates the detected movement. A pattern of the signal that repeatedly appears is extracted from the signal and the signal indicating the pressure. And the electronic device 1 normalizes each extracted pattern, and synthesize | combines each normalized pattern based on each amplitude.

  Thereby, the electronic apparatus 1 can increase the variation of the synthesized pattern by synthesizing a plurality of patterns, and can notify the outside by the output unit 30 based on the synthesized pattern. The detected information can be expressed richly.

<Second Embodiment>
Next, the communication system 2 in the second embodiment will be described. FIG. 8 is a configuration example of the communication system 2 in the second embodiment. The communication system 2 includes a plurality of electronic devices 100.
In FIG. 8A, as a configuration example of the communication system, a configuration example in which the electronic device 100-2 transmits information indicating a signal pattern detected by the detection unit of the own device to the electronic device 100-1. It is shown.

  In FIG. 8B, as another configuration example of the communication system, a plurality of electronic devices 100-2, 100-3, and 100-4 are detected in the electronic device 100-1 by the detection unit of the own device. A configuration example in the case of transmitting information indicating a signal pattern is shown. As illustrated in FIG. 8, the electronic device 100-1 receives information indicating the pattern of the signal detected by the detection unit of the own device from one or more other electronic devices.

FIG. 9 is a block diagram of the electronic device 100-I (I is a positive integer) in the second embodiment. Elements common to those in FIG. 1 are denoted by the same reference numerals, and detailed description thereof is omitted.
The configuration of the electronic device 100-I in FIG. 9 is different from the configuration of the electronic device 1 in FIG. 1 in that the detection unit 10 is changed to the detection unit 10b, the control unit 20 is changed to the control unit 20b, and the atmosphere data storage unit. 28 and a communication unit 40 are added.
The detection unit 10b is obtained by removing the pressure detection unit 12 and adding an image sensor 13 to the configuration of the detection unit 10 of FIG.

The image sensor 13 images a subject. Specifically, for example, assuming that one or more other electronic devices 100 are swung in a predetermined direction by one or more operators, the image sensor 13 is A plurality of other electronic devices 100-J (J is a positive integer other than I) are imaged as subjects.
The image sensor 13 supplies a video signal obtained by imaging to a data extraction unit 22 described later of the extraction unit 21b. As the image sensor 13, for example, a CCD image sensor is provided.

The control unit 20b is different from the configuration of the control unit 20 in FIG. 1 in that the extraction unit 21 is changed to the extraction unit 21b, the synthesis unit 26 is changed to the synthesis unit 26b, the motion video synthesis unit 27, the matching unit 29, Has been added.
The extraction unit 21b includes a data extraction unit 22, a normalization unit 23b, and a pattern extraction unit 24b.

  The data extraction unit 22 extracts a signal corresponding to a pixel on a diagonal line of the frame from the video signal supplied from the image sensor 13. Then, the data extraction unit 22 outputs the extracted signal (extracted video signal) to the pattern extraction unit.

  The processing of the data extraction unit 22 will be described with reference to FIG. FIG. 10 is a diagram for explaining the processing of the data extraction unit 22. On the left side of the figure, an image of the (p-1) th frame (p is an integer), an image of the pth frame, and an image of the (p + 1) th frame are shown. In each frame, pixels on the diagonal line connecting the upper left pixel and the lower right pixel are shown.

On the right side of the figure, a curve W122 indicating an extracted video signal composed of luminance values of pixels on diagonal lines in the frame extracted by the data extraction unit 22 is shown. Each point constituting this curve W122 is obtained by arranging the luminance signals of pixels on the diagonal line connecting the upper left pixel and the lower right pixel in each frame on the left side in the drawing in the order of the frames.
In the example of the figure, the data extraction unit 22 extracts the luminance value of the pixel on the diagonal line connecting the upper left pixel and the lower right pixel in each frame, and patterns the extracted luminance value data string as an extracted video signal. It outputs to the extraction part 23b.

  Returning to FIG. 9, the pattern extraction unit 23b calculates the autocorrelation function R (t) from the signal indicating the motion supplied from the motion detection unit 11, similarly to the pattern extraction unit 23 of the first embodiment. A motion pattern is calculated based on the calculated autocorrelation function R (t). Then, the pattern extraction unit 23b outputs information indicating the calculated movement pattern to the normalization unit 24b.

  The pattern extraction unit 23b calculates the autocorrelation function R (t) from the extracted video signal supplied from the data extraction unit 22 by the same method as the pattern extraction unit 23 of the first embodiment, and calculates the calculated self A video pattern is calculated based on the correlation function R (t). Then, the pattern extraction unit 23b outputs information indicating the calculated video pattern to the normalization unit 24b.

  Similar to the normalization unit 24 of the first embodiment, the normalization unit 24b normalizes information indicating the motion pattern input from the pattern extraction unit 23b to a value from −1 to 1. Then, the normalization unit 24b stores information Rm_I indicating the motion pattern after normalization in the pattern storage unit 25.

  Further, the normalization unit 24b normalizes information indicating the video pattern input from the pattern extraction unit 23b to a value from −1 to 1. Then, the normalization unit 24b causes the pattern storage unit 25 to store information Rv indicating the normalized video pattern.

  The control unit 20b reads information Rm_I indicating the motion pattern after normalization from the pattern storage unit 25, and outputs the read information Rm_I indicating the motion pattern after normalization to the communication unit 40. Then, the control unit 20b performs control to transmit information Rm_I indicating the motion pattern after normalization from the communication unit 40 to another electronic device 100-J (J is an integer other than I).

  The communication unit 40 is configured to be communicable with another electronic device 100-J in a wired or wireless manner. The communication unit 40 receives information Rm_J indicating the motion pattern after normalization of the other electronic device 100-J from the other electronic device 100-J, and receives the received information Rm_J indicating the motion pattern after normalization. The data is output to the combining unit 26b.

  The synthesizing unit 26b reads information Rm_I indicating the normalized motion pattern from the pattern storage unit 25 in the same manner as the synthesizing unit 26 of the first embodiment. In addition, the synthesizing unit 26b uses the same method as the synthesizing unit 26 in the first embodiment to read the information Rm_I indicating the read motion pattern after normalization and the motion after normalization input by the communication unit 40. The information Rm_J indicating the pattern is synthesized according to each amplitude value.

Thereby, the synthetic | combination part 26b can produce | generate the pattern which synthesize | combined the movement pattern of the own apparatus, and the movement pattern of the other electronic device 100-J.
Then, the synthesizing unit 26b outputs the pattern obtained by the synthesizing to the motion video synthesizing unit 27 as information Ra indicating the motion pattern of the set.

  The motion video composition unit 27 reads information Rv indicating the normalized video pattern from the pattern storage unit 25. The motion video synthesis unit 27 synthesizes the motion pattern of the set synthesized by the synthesis unit 26b and the extracted video pattern. Specifically, the motion video synthesizing unit 27 uses the information Ra indicating the motion pattern of the set input from the synthesizing unit 26b and the information Rv indicating the read normalized video pattern as their amplitudes. Synthesize accordingly.

  The process of the motion video composition unit 27 will be described with reference to FIG. FIG. 11 is a diagram for explaining processing of the motion video composition unit 27. In the figure, the vertical axis represents normalized amplitude, and the horizontal axis represents time. In the same figure, a curve W121 indicating the motion pattern of the set, a curve W122 indicating the normalized video pattern, and a curve W123 indicating the synthesized pattern synthesized by the motion video synthesizing unit 27 are shown.

For example, the motion video composition unit 27 adds a value 0.6 on the curve W121 indicating the motion pattern of the set and a value 0.8 on the curve W122 indicating the normalized video pattern, and obtains the result by addition. The value 1.12 obtained by multiplying the obtained value 1.4 by the coefficient 0.8 corresponding to the combination of amplitudes (0.6 and 0.8) of each pattern is the peak on the curve W123 indicating the composite pattern. The amplitude is P124.
Returning to FIG. 1, the motion video synthesis unit 27 outputs the synthesis pattern obtained by the synthesis to the matching unit 29 as information Rp indicating the field pattern.

The atmosphere data storage unit 28 stores information Rp indicating the field pattern and information A indicating the atmosphere in association with each other. FIG. 12 is a diagram showing an example of the table T1 stored in the atmosphere data storage unit 28. As shown in FIG.
In the table T1, identification information (ID) unique to the field pattern, the field pattern, and the atmosphere are associated. For example, when the ID is 1, a bright atmosphere is associated with the field pattern (0.1, 0.3,..., 0.1).

  Returning to FIG. 9, the collation unit 29 reads out information A indicating the atmosphere corresponding to the information Rp indicating the field pattern input from the motion video synthesis unit 27 from the data storage unit 28. Then, the verification unit 29 outputs information A indicating the read atmosphere to the display unit 31. Further, the collation unit 29 outputs an electrical signal based on the information A indicating the atmosphere to the audio output unit 32.

  When the information A indicating the atmosphere corresponding to the information Rp indicating the field pattern does not exist in the record of the data storage unit 28, the matching unit 29 extracts the field pattern closest to the information Rp indicating the field pattern. The information A indicating the atmosphere corresponding to the extracted field pattern may be read from the data storage unit 28.

  The display unit 31 displays information indicating the atmosphere based on the information A indicating the atmosphere input from the verification unit 29. The voice output unit 32 outputs a voice based on the electrical signal input from the verification unit 29.

FIG. 13 is a flowchart illustrating a processing flow of the electronic device 100-I according to the second embodiment. First, the detection unit 10b detects the movement of the device itself, and acquires an image having another electronic device 100-J as a subject in parallel (step S201).
Next, the pattern extraction unit 23b extracts a movement pattern from the movement of the own apparatus (step S202). The pattern extraction unit 23b extracts the acquired video pattern in parallel (step S203).

  Next, the normalizing unit 24b normalizes the extracted motion pattern (step S204). The normalizing unit 24b normalizes the extracted video pattern in parallel (step S205).

  Next, the communication unit 40 receives information indicating the movement pattern of the other electronic device after normalization from the other electronic device (step S206). Next, the synthesizing unit 26b generates a motion pattern of a set obtained by synthesizing the motion pattern of the own device after normalization and the motion pattern of another electronic device after normalization (step S207).

  Next, the motion video synthesizing unit 27 synthesizes the motion pattern of the set and the video pattern (step S208). The collation unit 29 reads out information indicating an atmosphere corresponding to the field pattern synthesized by the motion video synthesis unit 27 (step S209). Next, the display unit 31 displays information indicating the read atmosphere (step S210). Next, the sound output unit 32 outputs sound based on information indicating the atmosphere (step S211). Above, the process of this flowchart is complete | finished.

  As described above, the electronic device 100-I according to the second embodiment extracts the movement pattern from the movements of the individual electronic devices 100-I. Then, the electronic device 100-I combines the motion pattern of the own device and the motion pattern of the other electronic device 100-J to generate a set motion pattern. The electronic device 100-I further synthesizes the generated motion pattern of the set and the video pattern based on the luminance change obtained from the video obtained by imaging the other electronic device 100-J, which is the subject, so that the subject exists. Generate an in-situ pattern. Then, the electronic device 100 -I reads out information indicating the atmosphere corresponding to the pattern on the spot from the atmosphere data storage unit 28.

  Thereby, the electronic device 100-I can generate a pattern of the spot from the video signal obtained by imaging the spot and the information indicating the movement of the own apparatus and the other electronic device 100-J. As a result, the electronic device 100-I can estimate the in-situ atmosphere from the generated in-situ pattern.

  In the present embodiment, the electronic device 100-I combines the movement pattern of its own device and the movement pattern of another electronic device, but this is not a limitation. For example, the electronic device 100-I may combine the pressure pattern applied to the side surface of the device itself and the pressure pattern applied to the side surface of the other electronic device 100-J.

  In the present embodiment, the motion video composition unit 27 determines the amplitude of the pattern obtained by the synthesis based on the amplitude of each pattern when the amplitude of each pattern is greater than a predetermined threshold. It is not limited to this. The motion video synthesis unit 27 may use the average value of each pattern as the amplitude of the pattern obtained by synthesis.

  In all the embodiments, the synthesis unit (26, 26b) determines the amplitude of the pattern obtained by synthesis based on the amplitude of each pattern when the amplitude of each pattern is larger than a predetermined threshold. However, it is not limited to this. The synthesis unit (26, 26b) may use the average value of each pattern as the amplitude of the pattern obtained by synthesis.

  In all the embodiments, the output unit 30 notifies the outside using an image and sound. However, the present invention is not limited to this, and the output unit 30 may notify the outside by light or vibration.

  Further, a program for executing each process of the control unit (20, 20b) of the present embodiment is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed. By doing so, you may perform the various process mentioned above which concerns on a control part (20, 20b). In this case, it is assumed that information indicating a plurality of signals detected by a plurality of detection units is stored in the recording medium.

  Here, the “computer system” may include an OS and hardware such as peripheral devices. Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used. The “computer-readable recording medium” means a flexible disk, a magneto-optical disk, a ROM, a writable nonvolatile memory such as a flash memory, a portable medium such as a CD-ROM, a hard disk built in a computer system, etc. This is a storage device.

    Further, the “computer-readable recording medium” refers to a volatile memory (for example, DRAM (Dynamic) in a computer system serving as a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. Random Access Memory)) that holds a program for a certain period of time is also included. The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

  As mentioned above, although embodiment of this invention was explained in full detail with reference to drawings, the concrete structure is not restricted to this embodiment, The design etc. of the range which does not deviate from the summary of this invention are included.

DESCRIPTION OF SYMBOLS 1, 100-I Electronic device 2 Communication system 10, 10b Detection part 11 Motion detection part 12 Pressure detection part 13 Image sensor 21, 21b Extraction part 22 Data extraction part 23 Pattern extraction part 24 Normalization part 25 Pattern storage part 26, 26b Composition unit 27 Motion image composition unit 28 Atmosphere data storage unit 29 Verification unit 30 Output unit 31 Display unit 32 Audio output unit 40 Communication unit

Claims (9)

A plurality of detection units for detecting a plurality of signals indicating the characteristics of the target from the detection target;
An extraction unit that extracts patterns of the signal repeatedly appearing from the plurality of signals detected by the plurality of detection units;
A synthesis unit that synthesizes the extracted patterns;
An electronic device comprising: A detection unit for detecting a signal indicating the feature of the target from the target of detection;
An extraction unit for extracting a pattern of the signal repeatedly appearing from the signal detected by the detection unit;
A communication unit that receives information indicating a pattern of a signal detected by another electronic device;
A synthesis unit that synthesizes the pattern received by the communication unit and the pattern extracted by the extraction unit;
An electronic device comprising:   The synthesis unit determines the amplitude of a pattern obtained by synthesis based on the amplitude of each pattern when the amplitude of each of the patterns is larger than a predetermined threshold. The electronic device according to claim 1 or 2.   The electronic device according to claim 1, wherein the synthesis unit sets an average value of the patterns as an amplitude of a pattern obtained by synthesis.   The electronic device according to claim 1, further comprising an output unit that notifies the outside of the device based on the pattern synthesized by the synthesis unit. The detection unit detects the movement of the device itself,
The extraction unit extracts a motion pattern of the device from the detected motion,
The communication unit receives information indicating a movement pattern of another electronic device detected by the other electronic device;
The electronic device according to claim 2, wherein the synthesizing unit synthesizes a motion pattern of the own device and a motion pattern of another electronic device. The detection unit photographs a subject,
The extraction unit extracts a video pattern from a video obtained by photographing by the detection unit,
The electronic apparatus according to claim 6, further comprising a motion video synthesis unit that synthesizes the motion pattern synthesized by the synthesis unit and the extracted video pattern. A plurality of detection procedures for detecting a plurality of signals indicating the characteristics of the target from the target of detection;
An extraction procedure for extracting a pattern of the signal repeatedly appearing from the plurality of signals detected by the plurality of detection procedures;
A synthesis procedure for synthesizing the extracted patterns;
A synthesis method characterized by comprising: A computer including a storage unit storing information indicating a plurality of signals detected by a plurality of detection units,
An extraction step of reading information indicating a plurality of signals from the storage unit, and extracting each pattern of the signal repeatedly appearing from the information indicating the plurality of read signals,
A synthesis step of synthesizing the extracted patterns;
A synthesis program for running

Images