JP2014216962A - Electronic apparatus and system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic apparatus and a system that are improved in convenience for a user.SOLUTION: An electronic apparatus 1 comprises an imaging unit 11, a display unit 12, and a control unit 13. The imaging unit 11 acquires an image of a subject. The display unit 12 is a transmissive display unit 12. The display unit 12 makes it possible to, transmissively from one surface side, visually recognize the other surface side. The control unit 13 displays an object corresponding to at least part of the subject on the display unit 12 on the basis of the image of the subject acquired by the imaging unit 11.

Description

  The present invention relates to an electronic device including a transmissive display unit and a system including the electronic device.

  An example of the electronic device is a mobile phone. There is a type of mobile phone that can be folded by connecting two casings with a hinge portion. A type of foldable mobile phone includes a transparent display so that it can be easily operated even when two housings are closed (see Patent Document 1).

JP 2012-129964 A

  As described above, there are types of electronic devices that include a transparent display. In recent years, there has been a demand for the appearance of electronic devices that are more convenient for users by taking advantage of the transparency of transparent displays.

  It is an object of the present invention to provide an electronic device and a system that improve user convenience.

  The electronic device of the present invention includes an imaging unit, a display unit, and a control unit. The imaging unit acquires an image of a subject. The display unit is a transmissive type. The said display part can permeate | transmit from the one surface side and can visually recognize the other surface side. The control unit causes the display unit to display an object for at least a part of the subject based on the image of the subject acquired by the imaging unit.

  It is preferable that the control unit displays the object corresponding to a part of the subject visually recognized through the display unit.

  The object preferably has a color density higher than a predetermined threshold.

  It is preferable that the object has the same color as a part of the subject or a color close thereto.

  The electronic device further includes a detection unit. The detection unit is superimposed on the display unit. In this case, when the detection unit detects contact with a position corresponding to the object, the control unit controls the display unit to cancel the display of the object.

  The electronic device of the present invention includes an imaging unit, a display unit, and a control unit. The imaging unit acquires an image of a subject. The display unit is a transmissive type. The said display part can permeate | transmit from the one surface side and can visually recognize the other surface side. The control unit lowers the transmittance of the display unit at a position corresponding to at least a part of the subject based on the image of the subject acquired by the imaging unit.

  The electronic device of the present invention includes a housing, a display unit, a detection unit, and a control unit. The display unit is a transmissive type. The said display part can permeate | transmit from the one surface side and can visually recognize the other surface side. The detection unit detects acceleration and geomagnetism. The controller controls the orientation of the housing when the housing is arranged such that the first image displayed on the image display device and the second image displayed on the display portion overlap with each other. The position of the housing is set as a reference position. The control unit acquires an orientation of the housing with respect to the reference direction or a position with respect to the reference position based on the acceleration and geomagnetism detected by the detection unit.

  The electronic device of the present invention includes an interface unit, an imaging unit, a display unit, and a control unit. The interface unit is communicably connected to an image display device arranged outside. The imaging unit acquires an image. When an image based on a third image displayed on the image display device is acquired by the imaging unit, the control unit applies to at least a part of the subject based on the image acquired by the imaging unit. A fourth image is displayed on the display unit. When a predetermined operation is performed on the fourth image, the control unit outputs image data corresponding to the fifth image so that a fifth image based on the predetermined operation is displayed on the image display device. To be transmitted through the section.

  It is preferable that the display unit is a transmissive display unit that can be transmitted from one surface side and transmitted from the other surface side and the other surface side to visually recognize the one surface side.

  The system of the present invention includes an image display device and an electronic device. The electronic device includes a housing, a display unit, a detection unit, and a control unit. The display unit is a transmissive type. The said display part can permeate | transmit from the one surface side and can visually recognize the other surface side. The detection unit detects acceleration and geomagnetism. The control unit sets a direction of the housing when the first image displayed on the image display device and the second image displayed on the display unit overlap with each other in a reference direction. Set as. The control unit acquires the orientation of the housing with respect to the reference direction based on the acceleration and geomagnetism detected by the detection unit.

  The system of the present invention includes an image display device and an electronic device. The electronic device includes an interface unit, an imaging unit, a display unit, and a control unit. The interface unit is communicably connected to the image display device. The imaging unit acquires an image. The control unit recognizes an image acquired by the imaging unit when an image based on a third image displayed on the image display device is acquired by the imaging unit. The control unit causes the display unit to display a fourth image for at least a part of the subject based on the recognized image. When a predetermined operation is performed on the fourth image, the control unit outputs image data corresponding to the fifth image so that a fifth image based on the predetermined operation is displayed on the image display device. To be transmitted through the section.

  The system of the present invention includes an image display device, a control device that instructs the image display device to display, and an electronic device. The electronic device includes an interface unit, an imaging unit, a display unit, and a control unit. The interface unit is communicably connected to the image display device. The imaging unit acquires an image. The control unit recognizes an image acquired by the imaging unit when an image based on a third image displayed on the image display device is acquired by the imaging unit. The control unit causes the display unit to display a fourth image for at least a part of the subject based on the recognized image. When a predetermined operation is performed on the fourth image, the control unit outputs image data corresponding to the fifth image so that a fifth image based on the predetermined operation is displayed on the image display device. To the control device via the unit. The control device instructs the image display device to display based on image data transmitted from the electronic device.

  ADVANTAGE OF THE INVENTION According to this invention, the electronic device and system which improved the user's convenience can be provided.

It is a block diagram for demonstrating the electronic device of 1st Embodiment. It is a figure for demonstrating a 1st example. It is a figure for demonstrating the 3rd example. It is a figure for demonstrating the 4th example. It is a figure for demonstrating the case where the position of an object is adjusted. It is a block diagram for demonstrating the system of this embodiment. It is a figure for demonstrating the image displayed on an image display apparatus and the image displayed on an electronic device when calibration is performed. It is a figure for demonstrating the other example of calibration. It is a figure for demonstrating the case where a shooting game is performed. It is a figure for demonstrating the other form of an electronic device.

[First Embodiment]
The first embodiment of the present invention will be described below. FIG. 1 is a block diagram for explaining an electronic apparatus 1 according to the first embodiment.

  The electronic device 1 is, for example, a mobile phone or a tablet computer. The electronic device 1 includes an imaging unit 11, a display unit 12, a detection unit 14, a storage unit 15, and a control unit 13.

  The imaging unit 11 acquires a subject image. That is, the imaging unit 11 is a camera unit. The imaging unit 11 includes an out camera (not shown). The imaging unit 11 may include an in-camera 11a (see FIG. 5). When the electronic device 1 is held by the user in a state that can be operated by the user, the out camera as the imaging unit 11 captures an image of a subject arranged on the side opposite to the user. When the electronic device 1 is held by the user in a state where the electronic device 1 can be operated by the user, the in-camera 11a as the imaging unit 11 images a subject arranged on the user side. The in-camera 11a can capture a user. The imaging unit 11 (out camera and in camera 11a) is arranged at a position close to the display unit 12.

  The display unit 12 is a transmissive type. The display part 12 can permeate | transmit from one surface side and can visually recognize the other surface side. The display part 12 can permeate | transmit from the other surface side and can visually recognize one surface side. The display unit 12 includes, for example, a liquid crystal panel or an organic EL (electroluminescence) panel.

  The detection unit 14 is superimposed on the display unit 12. The detection unit 14 is, for example, a transparent touch panel.

  Based on the subject image acquired by the imaging unit 11, the control unit 13 causes the display unit 12 to display an object for at least a part of the subject. When the imaging unit 11 is activated, the control unit 13 performs image recognition or character recognition based on an image acquired in real time by the imaging unit 11. The recognized image is, for example, a predetermined image serving as a trigger for displaying an object. The recognized character is, for example, a predetermined character that serves as a trigger for displaying the object. The predetermined character is, for example, a keyword.

  The object is, for example, a character, a line, a figure, or an image. The object is associated with, for example, a result of recognizing an image or a result of recognizing characters. The object is stored in the storage unit 15, for example. The control unit 13 causes the display unit 12 to display an object based on the result of image recognition or the result of character recognition. As a detailed example, the control unit 13 reads an object from the storage unit 15 based on the result of image recognition or the result of character recognition, and causes the display unit 12 to display the object. Note that the image acquired by the imaging unit 11 is not displayed on the display unit 12.

The control unit 13 displays the object in correspondence with a part of the subject visually recognized via the display unit 12. The part of the subject visually recognized through the display unit 12 is an object that can be seen through the display unit 12. The object corresponds to a part of the subject included in the image acquired by the imaging unit 11.
The imaging unit 11 is disposed close to the display unit 12. For this reason, the range of the image acquired by the imaging unit 11 corresponds to the range that can be seen through the display unit 12. The control unit 13 determines the position of the object based on the image acquired by the imaging unit 11 and causes the display unit 12 to display the object. As a result, the object is arranged (displayed) near the subject that is visible through the display unit 12. When the object is for a part of the subject, the object is arranged (displayed) corresponding to a part of the subject. That is, the object is arranged (displayed) near a part of the subject.

  Thereby, since the electronic device 1 displays an object, the convenience of the user can be improved.

Here, a specific example will be described.
First, a first specific example will be described. FIG. 2 is a diagram for explaining the first specific example. FIG. 2A shows a word book 21 for memorizing English words. In the first specific example, the electronic device 1 is used when learning English words. In addition to the Japanese words and English words, the word book 21 has a predetermined graphic (not shown) indicating that English words are described. The control unit 13 performs image recognition based on the image of the word book 21 acquired by the imaging unit 11 (not shown in FIG. 2), and a predetermined figure as a predetermined image is included as a result of the image recognition. Judge that In this case, the control unit 13 displays an image that hides the English words on the display unit 12 as an object 22 based on the image acquired by the imaging unit 11 and a predetermined graphic (see FIG. 2B). The object 22 in FIG. 2B displays an image that covers a position wider than the position of the English word, but the object 22 is not limited to this, and displays the object limited to the position of the English word. May be. Further, in this figure, the object 22 has a transparency of 0 and the word is not visible at all. However, the present invention is not limited to this embodiment, and the transparency may be a neighborhood value of 0. Since the word is difficult to see, the learning efficiency is improved as in the case where the transmittance is zero.

The object 22 may have a color density higher than a predetermined threshold. By making the color density of the object 22 higher than a predetermined threshold (predetermined density), it is difficult for the user to visually recognize the English words in the word book 21 via the display unit 12. Thereby, the electronic device 1 can improve a user's learning efficiency.
Note that the control unit 13 may reduce the color density of the object 22 over time. That is, the control unit 13 may control the display unit 12 so that the English words are easy to see as time passes.

In addition, the control part 13 may perform the following control instead of the control mentioned above. In other words, the control unit 13 reduces the transmittance of the display unit 12 at a position corresponding to at least a part of the subject based on the image of the subject acquired by the imaging unit 11. For example, the control unit 13 performs image recognition based on the image of the word book 21 acquired by the imaging unit 11 (not shown in FIG. 2). As a result of the image recognition, a predetermined figure as a predetermined image is obtained. Judged to be included. In this case, the control unit 13 lowers the transmittance of the display unit 12 in the portion corresponding to the English word based on the image acquired by the imaging unit 11 and the predetermined graphic. Decreasing the transmittance means that the transmittance is set to 0% or the transmittance is set to a value in the vicinity of 0%. For example, when the display unit 12 includes a liquid crystal panel, the transmittance is reduced by adjusting application of a voltage to the liquid crystal. As a result, the Japanese word portion can be visually recognized through the display unit 12, but the English word portion is difficult to see through the display unit 12. Thereby, the electronic device 1 can improve a user's learning efficiency.
In addition, the control part 13 in this case can also improve the transmittance | permeability of the part which reduced the transmittance | permeability in the display part 12 according to progress of time. That is, the control unit 13 may control the display unit 12 so as to make it easier to read English words as time passes.

  Next, a second specific example will be described. In the second specific example, the electronic device 1 is used when learning English words. In the word book, for example, Japanese words are written in black and English words are written in red. First, an image of the word book is acquired by the imaging unit 11. The control unit 13 performs character recognition based on the image of the word book acquired by the imaging unit 11, and determines that the English word as the predetermined character described above is included as a result of character recognition. In this case, the control unit 13 performs red display on the entire display unit 12 as an object. Thereby, when a word book is visually recognized via the display part 12, a Japanese word is visually recognized and an English word is not visually recognized.

  Here, the object 22 may be the same color as a part of the subject or a color close thereto. In this case, the control unit 13 recognizes the character color of the subject from the image acquired by the imaging unit 11 and causes the display unit 12 to display the object 22 having the same color as the character color. For example, when the image of the word book is acquired by the imaging unit 11, the control unit 13 recognizes the color (red) of the character of the English word and selects the object 22 having the same color (red) as the color of the character. It is displayed on the display unit 12. Thereby, the electronic device 1 can make it difficult to visually recognize English words, and can improve learning efficiency.

  Next, a third specific example will be described. FIG. 3 is a diagram for explaining a third specific example. In the third specific example, the electronic device 1 is used when a comment or the like is left for a newspaper or a book. First, when the newspaper 23 is visually recognized by the user via the display unit 12, the display unit 12 is traced or a comment is written by the user's finger or the like so as to correspond to the article. In this case, the control unit 13 causes the display unit 12 to display a line 24 or a character corresponding to the contacted part based on the detection of the contact by the detection unit 14. Then, when the newspaper 23 is imaged by the imaging unit 11, data such as lines 24 or characters displayed on the display unit 12 is stored in the storage unit 15 together with an image of the newspaper 23. Thereafter, when the imaging unit 11 or the like detects that the display unit 12 is held over the newspaper 23 when browsing the newspaper 23 again, the control unit 13 recognizes an image of the newspaper 23 acquired by the imaging unit 11. I do. As image recognition in this case, it is determined whether or not the image of the newspaper 23 acquired by the imaging unit 11 corresponds to the image of the newspaper 23 stored in the storage unit 15. As a result of the image recognition, when the image of the newspaper 23 acquired by the imaging unit 11 corresponds to the image of the newspaper 23 stored in the storage unit 15, the control unit 13 stores data stored in the storage unit 15. , And a line or a character based on the data is displayed on the display unit 12 as an object. In this case, the control unit 13 displays the object on the display unit 12 based on the image acquired by the imaging unit 11 so that the subject visually recognized via the display unit 12 corresponds to the object.

  Next, a fourth specific example will be described. FIG. 4 is a diagram for explaining a fourth specific example. In the fourth specific example, the electronic device 1 is used as a schedule book. First, when the calendar 25 is visually recognized by the user via the display unit 12, the schedule is entered by detecting by the detection unit 14 that the user traces the display unit 12 with the user's finger or the like so as to correspond to the date. Is done. Based on the detection of contact by the detection unit 14, the control unit 13 causes the display unit 12 to display the schedule 26 corresponding to the contacted portion. Then, when the calendar 25 is imaged by the imaging unit 11, the data of the schedule 26 displayed on the display unit 12 is stored in the storage unit 15 together with the image of the calendar 25. After that, when the imaging unit 11 or the like detects that the display unit 12 is held over the calendar 25 in order to confirm the schedule, the control unit 13 performs image recognition on the image of the calendar 25 acquired by the imaging unit 11. . As image recognition in this case, for example, it is determined whether the image of the calendar 25 acquired by the imaging unit 11 corresponds to the image of the calendar 25 stored in the storage unit 15. When the image of the calendar 25 acquired by the imaging unit 11 corresponds to the image of the calendar 25 stored in the storage unit 15 as a result of image recognition, the control unit 13 stores data stored in the storage unit 15. And the schedule 26 based on the data is displayed on the display unit 12 as an object. In this case, the control unit 13 displays the object on the display unit 12 based on the image acquired by the imaging unit 11 so that the subject visually recognized via the display unit 12 corresponds to the object. The schedule can be managed separately for the company (see FIG. 4A) and private (see FIG. 4B).

  When the electronic device 1 moves in the right direction, the control unit 13 causes the part of the subject (object) that can be visually recognized via the display unit 12 to move to the left relative to the electronic device 1. Therefore, the object is moved in the left direction corresponding to the movement in the left direction. Similarly, when the electronic device 1 moves in the left direction, the control unit 13 determines that a part of the subject (object) that can be visually recognized via the display unit 12 is relatively right with respect to the electronic device 1. In order to move in the direction, the object is moved in the right direction in accordance with the movement in the right direction. Similarly, even when the electronic device 1 moves in a direction other than the right direction or the left direction, the control unit 13 determines that a part of the subject (object) that can be visually recognized via the display unit 12 is the electronic device 1. Therefore, the object is moved in the direction corresponding to the movement direction. Similarly, when the electronic apparatus 1 moves in the front-rear direction, the control unit 13 changes the size of a part (object) of a subject that can be visually recognized via the display unit 12. The size of the object is changed in response to the change of.

In addition to the specific examples described above, the electronic device 1 can be used in the following examples.
For example, when the object is of a type that hides characters or figures, the electronic device 1 is used for photo composition and the like. Photo compositing is a method of erasing an object that interferes with the subject when taking a picture, or erasing the glasses and estimating the color of the erased part from the surrounding skin color. is there.

  For example, in the case of a type in which characters or figures as objects are displayed on the display unit 12, the electronic device 1 displays a history check of a circuit diagram, a clothes change app, a transformation app, or an animal or character. Used for applications that The history check of the circuit diagram is such that the change history can be seen by holding the electronic device 1 in time series without directly entering the circuit diagram with a pen or the like. A dress-up app is a composition of clothing image data. The makeover app synthesizes hair, beard, wrinkles, glasses, and so on. The application for displaying an animal or character acquires an image of the surrounding environment with the imaging unit 11 and displays the animal or character according to the situation.

When the detection unit 14 detects contact with a position corresponding to the object, the control unit 13 controls the display unit 12 to cancel the display of the object. That is, when the detection unit 14 detects that the object displayed on the display unit 12 is touched by the user, the control unit 13 deletes the object from the display unit 12.
Since the electronic device 1 cancels the display of the object when the user no longer needs the object, the convenience of the user can be improved.

FIG. 5 is a diagram for explaining a case where the position of an object is adjusted.
When adjusting the position of the object, first, an image of the user's face (eyes) is acquired in real time by the in-camera 11a as the imaging unit 11. For example, the control unit 13 detects the pupil and corneal reflection based on the acquired image, and obtains the user's line of sight A based on the detection result. Based on the obtained user's line of sight A and the image of the subject acquired in real time by an out camera (not shown) as the imaging unit 11, the control unit 13 visually recognizes the user via the display unit 12. Identify the subject that you suspect is. When specifying the subject, the control unit 13 moves the position of the object so as to correspond to the estimated subject based on the image acquired by the out-camera.
In this way, the electronic device 1 can adjust the position of the object.

The electronic device 1 may display the object on the display unit 12 after password input, fingerprint authentication, or image authentication is performed.
Further, the electronic device 1 may display the object on the display unit 12 only within a preset time.

[Second Embodiment]
Hereinafter, a second embodiment of the present invention will be described. FIG. 6 is a block diagram for explaining the system 100 of the present embodiment.

The system 100 includes an image display device 110 and an electronic device 120.
The image display device 110 and the electronic device 120 can communicate with each other. The image display device 110 is a television, for example.

  The electronic device 120 of the second embodiment is, for example, a mobile phone or a tablet computer. The electronic device 120 includes a housing 121, a display unit 122, a detection unit 123, a detection unit 124, and a control unit 125.

The display unit 122 is a transmissive type. The display part 122 can permeate | transmit from one surface side and can visually recognize the other surface side. The display unit 122 is visible from the other surface side through the one surface side. The display unit 122 includes, for example, a liquid crystal panel or an organic EL (electroluminescence) panel.
The detection unit 123 is disposed so as to overlap the display unit 122. The detection unit 123 is a transmissive touch panel.

The casing 121 accommodates the detection unit 124 and the control unit 125.
The detection unit 124 detects acceleration and geomagnetism. The detection unit 124 includes an acceleration sensor and a geomagnetic sensor.

  FIG. 7 is a diagram for explaining an image displayed on the image display device 110 and an image displayed on the electronic device 120 when calibration is performed. FIG. 7A shows the image display device 110. FIG. 7B illustrates the electronic device 120.

  The control unit 125 performs calibration. That is, the control unit 125 of the case 121 when the case 121 is arranged so that the first image 131 displayed on the image display device 110 and the second image 132 displayed on the display unit 122 overlap each other. The direction is set as the reference direction or the position of the casing 121 as the reference position. The control unit 125 acquires the orientation of the housing 121 relative to the reference direction or the position relative to the reference position based on the acceleration and geomagnetism detected by the detection unit 124.

  Specifically, when calibration is performed, the first image 131 is displayed in the center of the image display device 110 as shown in FIG. The first image 131 is, for example, a “+” figure. In addition, a “+” figure as an example shown in FIG. 7A is also displayed at each corner of the image display device 110. When calibration is performed, the second image 132 is displayed at the center of the display unit 122 as shown in FIG. The second image 132 is, for example, a “+” figure.

  Then, when the image display device 110 can be viewed through the display unit 122 by the user, a “+” figure (first image 131) displayed in the center of the image display device 110, and the display unit When the electronic device 120 (housing 121) is moved so that the “+” figure (second image 132) displayed on 122 overlaps, the control unit 125 changes the orientation of the housing 121 at that time to the electronic device. It is set as a reference direction of 120 (housing 121). Further, the orientation of the electronic device 120 (housing 121) is changed so that the “+” graphic displayed at each corner of the image display device 110 and the “+” graphic displayed on the display unit 122 overlap. In such a case, the control unit 125 acquires the detection result of the detection unit 124 and sets the movable range based on the detection result.

Alternatively, the “+” graphic (first image 131) displayed in the center of the image display device 110 and the “+” graphic (second image 132) displayed on the display unit overlap, and When the electronic device 120 (housing 121) is moved so that the size of the first image 131 is equal to the size of the second image 132, the control unit 125 sets the position of the housing 121 at that time as a reference position. . When the size of the first image 131 is larger than the second image 132, the electronic device 120 is approaching the image display device 110. When the size of the first image 131 is smaller than the second image 132, the electronic device 120 is away from the image display device 110. If the electronic device 120 is moved so that the sizes of the first image 131 and the second image 132 are equal, the distance between the image display device 110 and the electronic device 120 becomes appropriate.
This completes the calibration.

  When the calibration is completed, the control unit 125 can acquire the orientation of the housing 121 with respect to the reference direction based on the acceleration and geomagnetism detected by the detection unit 124. That is, the control unit 125 can acquire the direction in which the electronic device 120 is facing. Further, when the calibration is completed, the control unit 125 can acquire a position with respect to the reference position based on the acceleration and the geomagnetism detected by the detection unit 124. That is, the control unit 125 can acquire the distance between the image display device 110 and the electronic device 120.

  Further, the calibration may be executed not only as in the above example but also as follows. FIG. 8 is a diagram for explaining another example of calibration. When calibration is performed, the control unit 125 causes the display unit 122 to display a predetermined graphic 133. The predetermined figure 133 is a figure for determining the position of the image display device 110 with respect to the electronic device 120. Then, when the image display device 110 can be viewed through the display unit 122 by the user, the electronic device 120 (housing 121) is moved so that the predetermined graphic 133 and the image display device 110 correspond to each other. The reference direction of the electronic device 120 (housing 121) and the movable range of the electronic device 120 can be set. In the case shown in FIG. 8, the calibration ends when the predetermined graphic 133 and the corner of the image display device 110 are made to correspond to each other and the image display device 110 is arranged inside the predetermined graphic 133. In this case, the movable range of the electronic device 120 is determined in advance.

  The system 100 can provide a user with an application in which calibration is performed by executing calibration. Therefore, the system 100 can improve user convenience.

  The system 100 and the electronic device 120 can execute an application that requires calibration as described above. An example of the application is a shooting game. FIG. 9 is a diagram for explaining a case where a shooting game is performed.

In this case, the electronic device 120 further includes an interface unit 126.
The interface unit 126 is communicably connected to the image display device 110 disposed outside. For example, the electronic device 120 and the image display device 110 are communicably connected by a cable 128 connected to the interface unit 126 and the image display device 110. Alternatively, the electronic device 120 and the image display device 110 may be connected so as to be able to communicate wirelessly.

  Then, the control unit 125 performs the following control. The control unit 125 causes the display unit 122 to display an image of the aiming 141. The image of the aiming 141 is displayed at the center of the display unit 122, for example. Since the image of the target 142 is displayed on the image display device 110, when the image display device 110 and the display unit 122 are overlapped when viewed from the user, the target 142 can be seen through the display unit 122. Based on the position of the target 142 displayed on the image display device 110 and the detection result of the detection unit 124, the control unit 125 determines whether or not the aiming target 141 is aligned with the target 142. When the control unit 125 determines that the aiming target 141 is in alignment with the target 142, when the operation with respect to the aiming target 141 is performed, image data corresponding to an image in which the target 142 is destroyed is displayed on the interface unit 126. Via the image display device 110. When receiving the image data, the image display device 110 displays an image in which the target 142 is destroyed. The operation with respect to the aiming 141 is an operation of touching the display unit 122, for example.

  Further, the control unit 125 may perform the following control. When performing the following control, the electronic device 120 further includes an imaging unit 127. The imaging unit 127 acquires an image. The imaging unit 127 can acquire an image displayed on the image display device 110 in real time.

  Then, when an image based on the third image displayed on the image display device 110 is acquired by the imaging unit 127 (out camera), the control unit 125 determines at least the subject based on the image acquired by the imaging unit 127. A fourth image for a part is displayed on the display unit 122. When a predetermined operation is performed on the fourth image, the control unit 125 displays image data corresponding to the fifth image on the interface unit 126 so that the image display device 110 displays the fifth image based on the predetermined operation. To send through.

  The third image is a target 142 of the shooting game. The fourth image is the aim 141 of the shooting game. The control unit 125 performs image recognition on the image acquired by the imaging unit 127 in real time, and moves the fourth image (aiming 141) based on the result of the image recognition. As an example, the control unit 125 performs color recognition as image recognition, and recognizes a recognized color having a specific color as the target 142. The control unit 125 moves the fourth image so that the fourth image overlaps the recognized target 142. The predetermined operation is, for example, an operation of touching the fourth image when the third image and the fourth image overlap. The fifth image is an image related to the third image. For example, the fifth image is an image in which the target 142 is destroyed.

  When the detection unit 123 detects that the fourth image has been touched when the third image (target 142) and the fourth image (sighting 141) overlap, the control unit 125 changes the target 142 to an image that is destroyed. Corresponding image data is transmitted to the image display device 110 via the interface unit 126. When receiving the image data, the image display device 110 displays an image in which the target 142 is destroyed.

  The system 100 can provide a user with an application in which calibration is utilized. Therefore, the system 100 can improve user convenience.

FIG. 10 is a diagram for explaining another embodiment of the electronic device.
In the above-described embodiment, the electronic devices 1 and 120 have been described as examples of mobile phones or tablet computers. However, the casing of the electronic device may be a glasses type as shown in FIG. In this case, in the electronic device, the display unit 201 is arranged in a portion where the lens is mounted in normal glasses. The display unit 201 corresponds to the display units 12 and 122 in the above-described embodiment. In addition, the imaging unit 11, the control unit 13, the detection unit 14, the storage unit 15, the detection unit 123, the detection unit 124, the control unit 125, the interface unit 126, the imaging unit 127 (not illustrated in FIG. 10), and the like are included in the housing. Arranged in the body (frame 202).

  The system may be configured as follows. That is, the system includes an image display device, a control device that instructs the image display device to display, and an electronic device. The electronic device includes an interface unit, an imaging unit, a display unit, and a control unit. The interface unit is communicably connected to an image display device (control device). The interface unit has the same configuration as the interface unit 126 described above. The imaging unit acquires an image. The imaging unit has the same configuration as the imaging unit 127 described above. When an image based on the third image displayed on the image display device is acquired by the imaging unit, the control unit recognizes the image acquired by the imaging unit, and determines at least a part of the subject based on the recognized image. The fourth image is displayed on the display unit. When a predetermined operation is performed on the fourth image, the control unit controls the image data corresponding to the fifth image via the interface unit so that the fifth image based on the predetermined operation is displayed on the image display device. Send to device. The control unit has the same configuration as the control unit 125 described above. The control device instructs the image display device to display based on the image data transmitted from the electronic device. The control device is, for example, a set top box. According to such a system, an application using calibration can be provided to the user. Thus, the system can improve user convenience.

DESCRIPTION OF SYMBOLS 1 Electronic device 11 Imaging part 12 Display part 13 Control part 14 Detection part 100 System 110 Image display apparatus 121 Case 122 Display part 123 Detection part 125 Control part 126 Interface part 127 Imaging part

Claims (12)

An imaging unit for acquiring an image of a subject;
A transmissive display unit that can be seen from the other side and visible from the other side;
A control unit that displays an object for at least a part of the subject on the display unit based on the image of the subject acquired by the imaging unit;
Electronic equipment comprising. The electronic device according to claim 1, wherein the control unit displays the object in correspondence with a part of a subject visually recognized through the display unit. The electronic device according to claim 1, wherein the object has a color density higher than a predetermined threshold value. The electronic device according to claim 1, wherein the object has the same color as a part of the subject or a color close thereto. A detection unit superimposed on the display unit;
The said control part controls the said display part so that the display of the said object may be cancelled | released, when the contact to the position corresponding to the said object is detected by the said detection part. The electronic device described. An imaging unit for acquiring an image of a subject;
A transmissive display unit that can be seen from the other side and visible from the other side;
A control unit that lowers the transmittance of the display unit at a position corresponding to at least a part of the subject based on the image of the subject acquired by the imaging unit;
Electronic equipment comprising. A housing,
A transmissive display unit that can be seen from the other side and visible from the other side;
A detector for detecting acceleration and geomagnetism;
The orientation of the case when the case is arranged so that the first image displayed on the image display device and the second image displayed on the display unit overlap with each other is a reference direction or the position of the case A control unit for setting the orientation of the housing with respect to the reference direction or the position with respect to the reference position based on the acceleration and geomagnetism detected by the detection unit,
Electronic equipment comprising. An interface unit communicably connected to an image display device arranged outside;
An imaging unit for acquiring an image;
A display unit;
When an image based on a third image displayed on the image display device is acquired by the imaging unit, a fourth image for at least a part of a subject is acquired based on the image acquired by the imaging unit. When the predetermined operation is performed on the fourth image by displaying on the display unit, image data corresponding to the fifth image is displayed so that the fifth image based on the predetermined operation is displayed on the image display device. A control unit for transmitting via the interface unit;
Electronic equipment comprising. The electronic device according to claim 8, wherein the display unit is a transmissive display unit that is transmissive from one surface side and is transmissive from the other surface side and the other surface side and is visible on the one surface side. A system comprising an image display device and an electronic device,
Electronic equipment
A housing,
A transmissive display unit that can be seen from the other side and visible from the other side;
A detector for detecting acceleration and geomagnetism;
Setting the direction of the case when the case is arranged so that the first image displayed on the image display device and the second image displayed on the display unit overlap as a reference direction; A control unit that acquires the orientation of the housing with respect to the reference direction based on the acceleration and geomagnetism detected by the detection unit. A system comprising an image display device and an electronic device,
The electronic device is
An interface unit communicably connected to the image display device;
An imaging unit for acquiring an image;
A display unit;
When an image based on a third image displayed on the image display device is acquired by the imaging unit, the image acquired by the imaging unit is recognized, and based on the recognized image, at least a part of the subject When the fourth image is displayed on the display unit and a predetermined operation is performed on the fourth image, the fifth image based on the predetermined operation is displayed on the image display device. A control unit that transmits image data corresponding to the above-described image data via the interface unit. A system comprising an image display device, a control device that instructs display to the image display device, and an electronic device,
The electronic device is
An interface unit communicably connected to the image display device;
An imaging unit for acquiring an image;
A display unit;
When an image based on a third image displayed on the image display device is acquired by the imaging unit, the image acquired by the imaging unit is recognized, and based on the recognized image, at least a part of the subject When the fourth image is displayed on the display unit and a predetermined operation is performed on the fourth image, the fifth image based on the predetermined operation is displayed on the image display device. A control unit that causes the control device to transmit image data corresponding to the control unit via the interface unit,
The control device instructs the image display device to display based on image data transmitted from the electronic device.

Images