JP2013058897A - Electronic device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic device which, in a case where plural users simultaneously view an identical content, reproduces different sound data associated to different displayed matters displayed in the content, for the respective users.SOLUTION: An electronic device comprises: plural oscillators 12 for outputting modulation waves of a parametric speaker; a display 40 for displaying image data containing plural displayed matters; a recognition unit 30 for recognizing the positions of the users; and a controller 20 for controlling the oscillators 12 so as to reproduce plural pieces of sound data associated to the respective displayed matters. The controller 20 controls the oscillators 12 so as to reproduce the sound data associated with the displayed matters selected by the respective users, toward the positions of the users recognized by the recognition unit 30.

Description

  The present invention relates to an electronic device including an oscillation device.

  For example, Patent Documents 1 to 5 disclose techniques related to an electronic apparatus including an audio output unit. The technique described in Patent Document 1 measures the distance between a mobile terminal and a user, and controls display brightness and speaker volume based on the distance. The technique described in Patent Document 2 is a technique related to a directional speaker system including a directional speaker array. Specifically, a reproduction control point is installed in the main lobe direction to suppress reproduction sound deterioration. The technique described in Patent Document 3 reproduces sound suitable for both the hearing impaired and the normal hearing by a speaker control device including a highly directional speaker and a normal speaker.

  Patent Documents 4 and 5 describe techniques related to parametric speakers. The technique described in Patent Document 4 includes an ultrasonic generator that generates ultrasonic waves by expansion and contraction of a medium due to heat generated by a heating element. The technique described in Patent Document 5 relates to a portable terminal device having a plurality of superdirective speakers such as parametric speakers.

JP-A-2005-202208 JP 2008-252625 A JP 2008-197381 A JP 2004-147311 A JP 2006-67386 A

  When multiple users view the same content at the same time, each user can play different audio data associated with different display objects displayed on the content. To provide new ways to enjoy content.

  An object of the present invention is to reproduce, for each user, different audio data associated with different display objects displayed on the content when a plurality of users view the same content at the same time. is there.

According to the present invention, a plurality of oscillation devices that output a modulated wave of a parametric speaker;
A display unit for displaying first image data including a plurality of display objects;
A recognition unit for recognizing the positions of a plurality of users;
A controller that controls the oscillation device to reproduce a plurality of audio data associated with each of the plurality of display objects;
With
The control unit is an electronic device that controls the oscillation device to reproduce the audio data associated with the display object selected by each user toward the position of each user recognized by the recognition unit. Is provided.

  According to the present invention, when a plurality of users view the same content at the same time, different audio data associated with different display objects displayed on the content can be reproduced for each user. it can.

It is a schematic diagram which shows the operation | movement method of the electronic device which concerns on 1st Embodiment. It is a block diagram which shows the electronic device shown in FIG. It is a top view which shows the parametric speaker shown in FIG. It is sectional drawing which shows the oscillation apparatus shown in FIG. It is sectional drawing which shows the piezoelectric vibrator shown in FIG. It is a flowchart which shows the operating method of the electronic device shown in FIG. It is a block diagram which shows the electronic device which concerns on 2nd Embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same reference numerals are given to the same components, and the description will be omitted as appropriate.

  FIG. 1 is a schematic diagram illustrating an operation method of the electronic device 100 according to the first embodiment. FIG. 2 is a block diagram showing the electronic device 100 shown in FIG. The electronic device 100 according to the present embodiment includes a parametric speaker 10 including a plurality of oscillation devices 12, a display unit 40, a recognition unit 30, and a control unit 20. The electronic device 100 is, for example, a television, a display device for digital signage, a portable terminal device, or the like. Examples of the mobile terminal device include a mobile phone.

The oscillation device 12 outputs an ultrasonic wave 16. The ultrasonic wave 16 is a modulated wave of a parametric speaker. The display unit 40 displays image data including a plurality of display objects 80. The recognition unit 30 recognizes the positions of a plurality of users 82. The control unit 20 controls the oscillation device 12 to reproduce a plurality of audio data associated with each of the plurality of display objects 80 displayed on the display unit 40.
The control unit 20 controls the oscillation device 12 to reproduce audio data associated with the display object 80 selected by each user 82 toward the position of each user 82 recognized by the recognition unit 30. Hereinafter, the configuration of the electronic device 100 will be described in detail with reference to FIGS.

  As shown in FIG. 1, the electronic device 100 includes a housing 90. The parametric speaker 10, the display part 40, the recognition part 30, and the control part 20 are arrange | positioned, for example inside the housing | casing 90 (not shown).

The electronic device 100 receives or stores content data. The content data includes audio data and image data. Image data of the content data is displayed by the display unit 40. Also, audio data in the content data is output by the plurality of oscillation devices 12.
The image data in the content data includes a plurality of display objects 80. The plurality of display objects 80 are associated with different audio data. When the content data is a concert, the plurality of display objects 80 are each performer, for example. In this case, the plurality of display objects 80 are associated with audio data for reproducing the timbre of the musical instrument performed by each performer, for example.

As illustrated in FIG. 2, the recognition unit 30 includes an imaging unit 32 and a determination unit 34. The imaging unit 32 captures an area including a plurality of users 82 and generates image data. The determination unit 34 determines the position of each user 82 by processing the image data captured by the imaging unit 32. The determination of the position of each user 82 is performed by, for example, storing and saving a feature amount for identifying each user 82 individually in advance and collating the feature amount with image data. Examples of the feature amount include the size of the distance between both eyes or the size and shape of a triangle connecting both eyes and the nose.
The recognition unit 30 can also specify the position of the ear of the user 82, for example. Further, the recognition unit 30 may have a function of automatically following the user 82 and determining the position of the user 82 when the user 82 moves within the area captured by the imaging unit 32. Good.

As shown in FIG. 2, the electronic device 100 includes a distance calculation unit 50. The distance calculation unit 50 calculates the distance between each user 82 and the oscillation device 12.
As illustrated in FIG. 2, the distance calculation unit 50 includes, for example, a sound wave detection unit 52. In this case, the distance calculation unit 50 calculates the distance between each user 82 and the oscillation device 12 as follows, for example. First, ultrasonic waves for sensors are output from the oscillation device 12. Next, the distance calculation unit 50 detects ultrasonic waves for the sensor reflected from each user 82. The distance between each user 82 and the oscillating device 12 is calculated based on the time from when the ultrasonic waves for the sensor are output by the oscillating device 12 until they are detected by the sonic wave detecting unit 52. When the electronic device 100 is a mobile phone, the sound wave detection unit 52 can be configured by a microphone, for example.

As shown in FIG. 2, the electronic device 100 includes a selection unit 56. Each user 82 uses the selection unit 56 to select one of the plurality of display objects 80 included in the image data displayed on the display unit 40.
The selection unit 56 is incorporated in the housing 90, for example. Further, the selection unit 56 may not be incorporated in the housing 90. In this case, a plurality of selection units 56 may be provided so as to be held by each of the plurality of users 82.

As shown in FIG. 2, the control unit 20 is connected to the plurality of oscillation devices 12, the recognition unit 30, the display unit 40, the distance calculation unit 50, and the selection unit 56. The control unit 20 controls the plurality of oscillation devices 12 so as to reproduce the audio data associated with the display object 80 selected by each user 82 toward the position of each user 82. This is performed, for example, as follows.
First, for each user 82, the feature quantity of each user 82 is registered in association with the ID. Next, the display object 80 selected by each user 82 is stored in association with the ID of each user 82. Next, an ID corresponding to the specific display object 80 is selected, and a feature amount associated with the selected ID is read out. Next, the user 82 having the read feature amount is selected by image processing. Then, the audio data associated with the display object 80 is reproduced for the user 82.
Further, the control unit 20 adjusts the volume and sound quality of the audio data reproduced for each user 82 based on the distance between each user 82 and the oscillation device 12 calculated by the distance calculation unit 50.

  FIG. 3 is a plan view showing the parametric speaker 10 shown in FIG. As shown in FIG. 3, the parametric speaker 10 is configured by arranging a plurality of oscillation devices 12 in an array, for example.

  4 is a cross-sectional view showing the oscillation device 12 shown in FIG. The oscillation device 12 includes a piezoelectric vibrator 60, a vibration member 62, and a support member 64. The piezoelectric vibrator 60 is provided on one surface of the vibration member 62. The support member 64 supports the edge of the vibration member 62.

  The control unit 20 is connected to the piezoelectric vibrator 60 via the signal generation unit 22. The signal generator 22 generates an electrical signal that is input to the piezoelectric vibrator 60. The control unit 20 controls the signal generation unit 22 based on information input from the outside, thereby controlling the oscillation of the oscillation device 12. The control unit 20 inputs a modulation signal as a parametric speaker to the oscillation device 12 via the signal generation unit 22. At this time, the piezoelectric vibrator 60 uses a sound wave of 20 kHz or more, for example, 100 kHz, as a signal transport wave.

FIG. 5 is a cross-sectional view showing the piezoelectric vibrator 60 shown in FIG. As shown in FIG. 4, the piezoelectric vibrator 60 includes a piezoelectric body 70, an upper electrode 72, and a lower electrode 74. The piezoelectric vibrator 60 is, for example, circular or elliptical in plan view. The piezoelectric body 70 is sandwiched between the upper electrode 72 and the lower electrode 74. The piezoelectric body 70 is polarized in the thickness direction. The piezoelectric body 70 is made of a material having a piezoelectric effect, and is made of, for example, lead zirconate titanate (PZT) or barium titanate (BaTiO ₃ ), which is a material having high electromechanical conversion efficiency. The thickness of the piezoelectric body 70 is preferably 10 μm to 1 mm. The piezoelectric body 70 is made of a brittle material. For this reason, when the thickness is less than 10 μm, breakage or the like tends to occur during handling. On the other hand, when the thickness exceeds 1 mm, the electric field strength of the piezoelectric body 70 is reduced. For this reason, the energy conversion efficiency is reduced.

  The upper electrode 72 and the lower electrode 74 are made of a material having electrical conductivity, for example, silver or a silver / palladium alloy. Silver is a low-resistance general-purpose material and is advantageous from the viewpoint of manufacturing cost and manufacturing process. Further, the silver / palladium alloy is a low resistance material excellent in oxidation resistance and excellent in reliability. The thickness of the upper electrode 72 and the lower electrode 74 is preferably 1 μm to 50 μm. When the thickness is less than 1 μm, it becomes difficult to form the film uniformly. On the other hand, when the thickness exceeds 50 μm, the upper electrode 72 or the lower electrode 74 serves as a restraint surface with respect to the piezoelectric body 70 and causes a decrease in energy conversion efficiency.

  The vibration member 62 is made of a material having a high elastic modulus with respect to ceramic, which is a brittle material, such as metal or resin. Examples of the material constituting the vibration member 62 include general-purpose materials such as phosphor bronze and stainless steel. The thickness of the vibrating member 62 is preferably 5 μm to 500 μm. The longitudinal elastic modulus of the vibration member 62 is preferably 1 GPa to 500 GPa. If the longitudinal elastic modulus of the vibration member 62 is excessively low or high, the characteristics and reliability as a mechanical vibrator may be impaired.

  In this embodiment, sound reproduction is performed using the operation principle of a parametric speaker. The principle of operation of the parametric speaker is as follows. The principle of operation of a parametric speaker is the principle that audible sound appears due to the non-linear characteristics when ultrasonic waves that have been subjected to AM modulation, DSB modulation, SSB modulation, and FM modulation are emitted into the air and the ultrasonic waves propagate into the air. The sound reproduction is performed with Non-linear here means transition from laminar flow to turbulent flow when the Reynolds number indicated by the ratio of the inertial action and viscous action of the flow increases. That is, since the sound wave is slightly disturbed in the fluid, the sound wave propagates nonlinearly. In particular, when ultrasonic waves are radiated into the air, harmonics accompanying non-linearity are prominently generated. The sound wave is a dense state in which molecular groups in the air are mixed. If it takes time to recover rather than compressing air molecules, the air that cannot be recovered after compression collides with continuously propagating air molecules, generating shock waves and generating audible sounds. The parametric speaker can form a sound field only around the user 82, and is excellent from the viewpoint of privacy protection.

Next, the operation of the electronic device 100 according to the present embodiment will be described. FIG. 6 is a flowchart showing an operation method of the electronic apparatus 100 shown in FIG.
First, image data is displayed on the display unit 40 (S01). Next, the user 82 selects one of the plurality of display objects 80 included in the image data displayed on the display unit 40 (S02).

  Next, the recognition unit 30 recognizes the positions of a plurality of users 82 (S03). Next, the distance calculation unit 50 calculates the distance between each user 82 and the oscillation device 12 (S04). Next, based on the distance between each user 82 and the oscillating device 12, the volume and sound quality of the audio data reproduced for each user 82 are adjusted (S05).

  Next, the audio data associated with the display object 80 selected by each user 82 is reproduced toward each user 82 (S06). When the recognizing unit 30 recognizes the position of the user 82 by following, the control unit 20 determines the direction in which the oscillation device 12 reproduces the audio data based on the position of the user 82 recognized by the recognizing unit 30. It is good also as controlling at any time.

Next, the effect of this embodiment will be described. According to this embodiment, the oscillation device 12 outputs a modulated wave of a parametric speaker. In addition, the control unit 20 controls the oscillation device 12 so as to reproduce the audio data associated with the display object 80 selected by each user 82 toward the position of each user 82.
According to the above configuration, since the parametric speaker having high directivity is used, the audio data reproduced for each user does not interfere with each other. Then, using such a parametric speaker, audio data associated with the display object 80 selected by each user 82 is reproduced for each user 82. Therefore, when a plurality of users view the same content at the same time, different audio data associated with different display objects displayed on the content can be reproduced for each user.

  FIG. 7 is a block diagram showing the electronic device 102 according to the second embodiment, and corresponds to FIG. 2 according to the first embodiment. The electronic device 102 according to the present embodiment is the same as the electronic device 100 according to the first embodiment, except that the electronic device 102 includes a plurality of detection terminals 54.

The plurality of detection terminals 54 are held by each of the plurality of users 82. Then, the recognition unit 30 recognizes the position of the user 82 by recognizing the position of the detection terminal 54. Recognition of the position of the detection terminal 54 by the recognition unit 30 is performed, for example, when the recognition unit 30 receives radio waves emitted from the detection terminal 54.
Note that the recognition unit 30 may have a function of automatically following the user 82 and determining the position of the user 82 when the user 82 holding the detection terminal 54 moves. When a plurality of selection units 56 are provided so that each user 82 holds, the detection terminal 54 may be formed integrally with the selection unit 56.

  Further, the recognition unit 30 may include an imaging unit 32 and a determination unit 34. The imaging unit 32 captures an area where the user 82 is recognized by recognizing the position of the detection terminal 54 and generates image data. The determination unit 34 determines the position of the ear of the user 82 by processing the image data generated by the imaging unit 32. For this reason, the position of the user 82 can be recognized more accurately by using it together with the position detection using the detection terminal 54.

In the present embodiment, the control of the oscillation device 12 by the control unit 20 is performed as follows.
First, the ID of each detection terminal 54 is registered in advance. Next, the volume and sound quality set for each user 82 are associated with the ID of the detection terminal 54 held by each user 82. Next, an ID indicating each detection terminal 54 is transmitted from each detection terminal 54. The recognition unit 30 recognizes the position of the detection terminal 54 based on the direction in which the ID is transmitted. And the audio | voice data according to the setting are reproduced | regenerated to the user 82 holding the detection terminal 54 which has ID corresponding to the setting of a specific volume and sound quality.

  Also in this embodiment, the same effect as that of the first embodiment can be obtained.

  As mentioned above, although embodiment of this invention was described with reference to drawings, these are the illustrations of this invention, Various structures other than the above are also employable.

DESCRIPTION OF SYMBOLS 10 Parametric speaker 12 Oscillator 16 Ultrasonic wave 20 Control part 22 Signal generation part 30 Recognition part 32 Imaging part 34 Determination part 40 Display part 50 Distance calculation part 52 Sound wave detection part 54 Detection terminal 56 Selection part 60 Piezoelectric vibrator 62 Vibrating member 64 Support member 70 Piezoelectric body 72 Upper electrode 74 Lower electrode 80 Display object 82 User 90 Case 100 Electronic device 102 Electronic device

Claims (7)

A plurality of oscillation devices that output the modulated wave of the parametric speaker;
A display unit for displaying first image data including a plurality of display objects;
A recognition unit for recognizing the positions of a plurality of users;
A controller that controls the oscillation device to reproduce a plurality of audio data associated with each of the plurality of display objects;
With
The control unit is an electronic device that controls the oscillation device to reproduce the audio data associated with the display object selected by each user toward the position of each user recognized by the recognition unit. . The electronic device according to claim 1,
The recognition unit
An imaging unit that images a region including the plurality of users and generates second image data;
A determination unit that determines the positions of the plurality of users by processing the second image data;
An electronic device. The electronic device according to claim 1,
A plurality of detection terminals held by each of the plurality of users;
The recognition unit is an electronic device that recognizes the position of the user by recognizing the position of the detection terminal. The electronic device according to claim 3.
The recognition unit
An imaging unit that captures an image of an area where the user is recognized by recognizing the position of the detection terminal and generates second image data;
A determination unit that determines the position of the user's ear by processing the second image data;
An electronic device. The electronic device according to claim 1,
The recognition unit recognizes the user by following the position of the user,
The control unit is an electronic device that controls the direction in which the oscillation device reproduces the audio data as needed based on the position of the user recognized by the recognition unit. The electronic device according to claim 1,
A distance calculation unit for calculating a distance between each user and the oscillation device;
The control unit is an electronic device that adjusts a volume and a sound quality of the audio data to be reproduced for each user based on a distance between each user and the oscillation device calculated by the distance calculation unit. The electronic device according to claim 1,
The electronic device is a mobile terminal device.

Images