JP5623238B2 - Electronic device, display control method, and display control program - Google Patents

Description

  The present invention relates to an electronic device capable of projecting an image onto a projection target such as a postcard, a display control method, and a display control program.

  In order to practice writing, the model character is displayed on the display surface, and the handwriting traced by the user using the coordinate detection plate provided on the display surface is detected. Technology is known. In this technique, the character writing is evaluated based on the similarity between the detected handwriting and a model character (see, for example, Patent Document 1).

Japanese Patent Laid-Open No. 10-63174

  However, the above-described conventional technology does not display a model on general paper or the like as an object to be handwritten. For this reason, the user cannot obtain the feeling of actually writing a character on paper using a writing tool.

  An object of the present invention is to provide an electronic device, a display control method, and a display control program that can project an image onto a projection target such as a postcard.

  In order to solve the above-described problems and achieve the object, an electronic device according to the present invention is detected by a display unit, a detection unit that detects an object placed on the display unit, and the detection unit. And a display control unit that controls the brightness of the display unit according to the object.

  Here, it is preferable that the display control unit controls the brightness of the display unit so that an image displayed on the display unit passes through the object.

  The detection unit may detect in which range of the display unit the object is placed, and the display control unit may display a portion other than the range in which the object is placed in black. preferable.

  Further, the detection unit detects in which range of the display unit the object is placed, and the display control unit determines the brightness of a portion other than the range in which the object is placed, It is preferable to set it lower than the range where the object is placed.

  Moreover, it is preferable that the said detection part detects the line drawn with respect to the said target object.

  Moreover, it is preferable that the said detection part is an optical sensor provided in the said display part.

  Moreover, it is preferable that the said detection part is an imaging device which image | photographs the said display part.

  The detection unit preferably includes a touch sensor superimposed on the display unit.

  Further, the detection unit detects a thickness of an object placed on the display unit, and the display control unit displays the display according to the thickness of the object detected by the detection unit. It is preferable to control the brightness of the part.

  In order to solve the above-described problems and achieve the object, the present invention is a display control method executed by an electronic apparatus having a display unit, and detects an object placed on the display unit. And a step of controlling the brightness of the display unit in accordance with the detected object.

  Further, in order to solve the above-described problems and achieve the object, the present invention is a display control program for detecting an object placed on the display unit in an electronic device having the display unit. And controlling the brightness of the display unit in accordance with the detected object.

  According to the electronic device, the display control method, and the display control program of the present invention, an image can be projected onto a projection target such as a postcard.

FIG. 1 is a schematic diagram illustrating a schematic configuration of a communication system including the electronic device according to the first embodiment. FIG. 2 is a diagram illustrating an external appearance of the electronic apparatus according to the first embodiment. FIG. 3 is a diagram schematically showing a cross section of the display. FIG. 4 is a diagram illustrating a display when an object is placed. FIG. 5 is a block diagram illustrating a schematic configuration of functions of the electronic device illustrated in FIG. 2. FIG. 6 is an explanatory diagram showing an example of a projected image displayed on the display. FIG. 7 is an explanatory diagram illustrating a positional shift state between the projected image and the drawn image. FIG. 8 is an explanatory diagram showing a state after correcting the projection position of the projection image. FIG. 9 is a flowchart of processing in which the processing unit of the electronic device adjusts the brightness of the display. FIG. 10 is a flowchart of processing in which the processing unit of the electronic device corrects the display position of the projection image. FIG. 11 is a flowchart of processing in which the processing unit of the electronic device deletes and corrects an overlapping portion of the projection image. FIG. 12 is an explanatory diagram showing an example of a projected image projected on the surface of the postcard. FIG. 13 is an explanatory diagram illustrating an example of a projected image projected on the back surface of the postcard. FIG. 14 is an explanatory diagram illustrating an example of a coloring picture image. FIG. 15 is a diagram illustrating an appearance of the electronic apparatus according to the second embodiment. FIG. 16 is a diagram illustrating an appearance of an electronic apparatus according to the third embodiment. 17 is a diagram schematically showing an A-A ′ cross section of the electronic apparatus shown in FIG. 16.

  Hereinafter, the present invention will be described in detail with reference to the drawings. In addition, this invention is not limited by the form (henceforth embodiment) for implementing the following invention. In addition, constituent elements in the following embodiments include those that can be easily assumed by those skilled in the art, those that are substantially the same, and those in a so-called equivalent range.

(Embodiment 1)
FIG. 1 is a schematic diagram illustrating a schematic configuration of a communication system including the electronic device according to the embodiment. The electronic device 10a of this embodiment is incorporated in the communication system 1. The communication system 1 is configured to be able to communicate between various servers provided on a network and an electronic device 10a as a communication terminal.

  A communication system 1 shown in FIG. 1 includes a server 2, an Internet communication network 3, a database 4, a server 5, a wireless communication device 6, a GPS satellite 7, and an electronic device 10a. In addition, the number of each part which comprises the communication system 1 is not specifically limited, Each part may be provided with the some apparatus. For example, a plurality of electronic devices 10a may be provided for one server 2.

  The server 2 has various data such as information (telephone number, address) specifying each communication device, and communicates with the electronic device 10a via the communication network to supply various information. The server 2 and the electronic device 10a communicate with each other through a communication network that is formed by a base station and a relay station and that wirelessly transmits and receives communication waves. The communication network can use various communication methods as long as communication can be performed between the server 2 and the electronic device 10a. For example, communication may be performed using a satellite line.

  The server 2 also receives information from the electronic device 10a, and based on the information, communicates information to other communication devices via the Internet communication network 3, and also relays information. That is, the server 2 collects and stores information sent from each communication device, and supplies (provides) the collected information to the communication device as necessary. The server 2 can also process (process) the collected information and supply it to the communication device.

  The Internet communication network (hereinafter also referred to as “Internet”) 3 includes an exchange and a wired / wireless communication line. The Internet communication network 3 performs information communication between a communication device and another communication device using a wired / wireless communication line. Specifically, the Internet 3 performs information communication between the server 2 and the server 5 and information communication between the server 2 and the database 4.

  The database 4 is a storage device and stores various data necessary for processing in the electronic device 10a such as various image information. The database 4 supplies various stored information to the server 2 or the server 5 via the Internet 3.

  The server 5 communicates with the electronic device 10a via the wireless communication device 6 to receive and supply various information. Note that the server 5 is different only in the communication method with the electronic device 10a, and other configurations are basically the same as those of the server 2.

  The wireless communication device 6 is a communication device that performs direct wireless communication with the electronic device 10a. As the wireless communication device 6, for example, a communication unit that communicates with another communication device using a short-range wireless communication technology can be used. As short-range wireless communication technologies, infrared communication (IrDA (registered trademark), IrMC (registered trademark), IrSimple (registered trademark)), visible light communication, Bluetooth (registered trademark), magnetic field communication (RFID, Radio Frequency Identification) technology can be used.

  The GPS satellite 7 is a satellite that transmits (provides) position information of the communication device to a communication device (communication terminal, communication device) having a GPS (Global Positioning System) communication function. Although only one GPS satellite 7 is shown in FIG. 1, the GPS satellites 7 are arranged in a number (mainly three or four) necessary for specifying the position of the communication device. Each of the plurality of GPS satellites 7 transmits position information to the electronic device 10a.

  The electronic device 10a is, for example, a portable communication device having a function of displaying an image on a display unit. Hereinafter, a portable communication device will be described as an example of the electronic device 10a. However, the application target of the present invention is not limited to the portable communication device. For example, the present invention is applied to a PHS (Personal Handy phone System), a personal computer, a portable game machine, and the like. The present invention can also be applied. Hereinafter, the electronic device 10a will be described in detail.

  FIG. 2 is a diagram illustrating an external appearance of the electronic apparatus according to the first embodiment. As shown in FIG. 2, the electronic device 10 a is a straight type in which each part is housed in one box-shaped housing 11. As the electronic device 10a, for example, a foldable electronic device in which two housings connected by hinges are folded so as to be opened and closed may be applied. Further, the electronic device 10a may be, for example, a sliding electronic device in which one housing and the other housing can be slid from each other in a state where two housings are overlapped, A rotary type in which one casing is rotated around an axis along the direction, or both casings connected via a biaxial hinge may be used.

  The housing 11 is provided with a touch panel display 12a. The display 12a functions as a display unit that displays various screens, and also functions as an operation unit that operates the electronic device 10a. The display 12a functioning as a display unit displays a standby image when the electronic device 10a is waiting for reception, or displays a menu image used to assist the operation of the electronic device 10a. The display 12a functioning as an operation unit is operated to input characters when creating an e-mail, etc., and is operated to select and determine a menu displayed on the display 12a, scroll the screen, and the like.

  An antenna is provided inside the housing 11. The antenna is a transmission / reception antenna used for wireless communication, and is used for transmission / reception of a radio wave (electromagnetic wave) related to an electronic mail or the like between the electronic device 10a and a base station.

  FIG. 3 is a diagram schematically showing a cross section of the display 12a, and FIG. 4 is a diagram showing the display 12a when the object T is placed thereon. As shown in FIG. 3, the display 12 a is configured by superimposing a touch sensor 101 on a display panel 102. The touch sensor 101 detects contact with the surface together with the touched position. In addition, as a method for the touch sensor 101 to detect contact, an arbitrary method such as a capacitance type or a pressure-sensitive type may be used.

  The display panel 102 is a liquid crystal display (LCD), and is configured by superimposing a liquid crystal panel 103 with an optical sensor on a backlight 104 which is a light source. For example, the backlight 104 supplies light emitted from a cold cathode fluorescent lamp or an LED (Light Emitting Diode) to the liquid crystal panel 103 with an optical sensor.

  A plurality of red pixels 105, a plurality of green pixels 106, a plurality of blue pixels 107, and a plurality of photosensors 108 are arranged on the liquid crystal panel 103 with photosensors. The red pixel 105 exposes or blocks light supplied from the backlight 104 as red light to the outside. The green pixel 106 exposes or blocks the light supplied from the backlight 104 as green light to the outside. The blue pixel 107 exposes or blocks the light supplied from the backlight 104 as blue light to the outside. The optical sensor-equipped liquid crystal panel 103 performs color display using, for example, a combination of one red pixel 105, one green pixel 106, and one blue pixel 107 as one pixel.

  The optical sensor 108 detects the intensity of external light, that is, light incident from the side opposite to the side where the backlight 104 is provided. Although FIG. 3 illustrates that one photosensor 108 is provided for each pixel, the density at which the photosensors 108 are arranged may be appropriately changed.

  Here, as shown in FIG. 4, it is assumed that an object T such as paper is placed on the display 12a. At this time, in a portion where the object T does not overlap, the optical sensor 108 receives outside light without being blocked by the object T. On the other hand, in the part where the target T overlaps, the external light that is blocked by the target T and reaches the optical sensor 108 is attenuated. In the portion where the object T overlaps, when the backlight 104 emits light, part of the light that has passed through the red pixel 105 is reflected by the object T and enters the optical sensor 108. Further, in the portion where the object T overlaps, the portion below the character L drawn with ink or the like is blocked by the character L, and the external light reaching the optical sensor 108 is greatly reduced.

  Thus, when the object T such as paper is placed on the display 12a, a difference occurs in the intensity of light detected by the respective optical sensors 108. By using this difference, various information regarding the object T can be acquired.

  For example, by stopping the light emission of the backlight 104 and comparing the intensity of light detected by each of the optical sensors 108, the portion where the optical sensor 108 detecting relatively weak light is present is the target T. It can be determined that it is a part that overlaps. In an environment where the outside light is weak, such as in a room, the backlight 104 emits light strongly, and the intensity of light detected by each of the optical sensors 108 is compared to detect light that detects relatively strong light. It can be determined that the portion where the sensor 108 exists is a portion overlapping the object T.

  Further, from the ratio of the light intensity L1 detected by the optical sensor 108 in the portion overlapping the target T and the light intensity L2 detected by the optical sensor 108 in the portion not overlapping the target T, the target The light transmittance of the object T can be acquired. The light transmittance of the object T indicates the thickness of the object T. For example, when L1 / L2 is close to 1, it indicates that the object T is a thin object with high light transmittance. Then, as L1 / L2 is further away from 1, it indicates that the object T is a thicker object with lower light transmittance.

  In addition, if there is an optical sensor 108 present in a portion determined to be overlapped with the object T that has a weaker light intensity than other optical sensors 108, the optical sensor 108 is , It can be determined that the object is located under a portion where something is drawn, such as the letter L. That is, based on the detection result of the optical sensor 108, it is possible to detect a handwriting of a character written on the object T by the user, a line drawn on the object T, or the like by the user.

  FIG. 5 is a block diagram showing a schematic configuration of functions of the electronic apparatus 10a shown in FIG. As shown in FIG. 5, the electronic device 10a includes a processing unit 22, a storage unit 24, an external storage unit 25, a transmission / reception unit 26, an operation unit 13, a display unit 32, a short-range communication unit 36, A position information acquisition unit 42. The processing unit 22 has a function of comprehensively controlling the overall operation of the electronic device 10a. That is, the processing unit 22 transmits / receives the transmission / reception unit 26 so that various processes of the electronic device 10a are executed in an appropriate procedure according to the operation of the operation unit 13 and the software stored in the storage unit 24 of the electronic device 10a. The operation of the display unit 32, the short-range communication unit 36, the position information acquisition unit 42, and the like is controlled.

  Various processes of the electronic device 10a include, for example, creation and transmission / reception of an electronic mail, browsing of a Web (World Wide Web) site on the Internet, and the like. Examples of operations of the transmission / reception unit 26 and the display unit 32 include transmission / reception of signals by the transmission / reception unit 26 and display of images by the display unit 32.

  The processing unit 22 executes processing based on a program (for example, an operating system program, application program, etc.) stored in the storage unit 24. The processing unit 22 is configured by, for example, a microprocessor unit (MPU: Micro Processing Unit), and executes various processes of the electronic device 10a described above according to procedures instructed by software. That is, the processing unit 22 sequentially reads instruction codes from an operating system program, application program, or the like stored in the storage unit 24 and executes processing.

  The processing unit 22 has a function of executing a plurality of application programs. Examples of application programs executed by the processing unit 22 include an application program that reads various image files (image information) from the storage unit 24 and decodes them, and an application program that causes the display unit 32 to display images obtained by decoding. There are multiple application programs.

  In the present embodiment, the processing unit 22 displays the determination result of the display control unit 22a that controls the operation of the display unit 32, the target determination unit 22b that determines the target placed on the display unit 32, and the target determination unit 22b. An object information acquisition unit 22c that acquires object information of an object based on the image, an attitude / position calculation unit 22d that calculates and calculates the attitude and position of an image displayed on the display unit 32, and an image that is displayed on the display unit 32 An image processing unit 22e for processing and generating the image. The functions of the display control unit 22a, the object determination unit 22b, the object information acquisition unit 22c, the posture / position calculation unit 22d, and the image processing unit 22e are hardware resources configured by the processing unit 22 and the storage unit 24, respectively. This is realized by executing a task assigned by the control unit of the processing unit 22. Here, a task is a processing unit that cannot be executed at the same time among the entire processing performed by the application software or the processing performed by the same application software.

  The storage unit 24 stores software and data used for processing in the processing unit 22, and stores the above-described task for operating the application program for reading and decoding various image files, and the image processing program. The task to be activated is stored. In addition to these tasks, the storage unit 24 includes, for example, communication, downloaded voice data, software used by the processing unit 22 to control the storage unit 24, voice files such as dial tone and ringtone, software Temporary data used in the process is stored. Further, the storage unit 24 includes an object information storage unit 24a that stores object information related to an object such as paper, an address book that describes and manages a communication partner's telephone number and mail address, and the operation unit 13. A text data storage unit 24b for storing the input sentence.

  Note that computer programs and temporary data used in the software processing process are temporarily stored in the work area assigned to the storage unit 24 by the processing unit 22. The storage unit 24 includes, for example, a nonvolatile storage device (nonvolatile semiconductor memory such as ROM: Read Only Memory, a hard disk device, etc.), and a readable / writable storage device (for example, SRAM: Static Random Access Memory, DRAM: Dynamic Random Access Memory).

  The external storage unit 25 is a storage device that includes an external memory and connection terminals, and the external memory is detachable from the housing 11. Various software and data are stored in the external memory in the same manner as the storage unit 24. The external storage unit 25 connects the external memory and the processing unit 22 via a connection terminal, and writes and reads information to and from the external memory, similarly to the storage unit 24. In addition, since the external memory is detachable from the external storage unit 25, the external memory connected to the processing unit 22 can be exchanged. As the external memory, various storage media such as an SD card (registered trademark), a memory stick (registered trademark), smart media, and a USB memory can be used.

  The transmission / reception unit 26 has an antenna 26a, establishes a radio signal line by a CDMA (Code Division Multiple Access) method or the like with the base station via a channel assigned by the base station, and makes a telephone call with the base station. Perform communication and information communication. The operation unit 13 includes the touch panel display 12a described above, and the display 12a is assigned with various functions such as a call key, a numeric key, a character key, a direction key, a determination key, and a call key. A screen is displayed. When these keys are input by a user operation on the operation screen, a signal corresponding to the operation content is generated. The generated signal is input to the processing unit 22 as a user instruction.

  The display unit 32 includes the display 12a described above, and causes the display panel 102 to display a video corresponding to the video data supplied from the processing unit 22 and an image corresponding to the image data.

  The short-range communication unit 36 is a communication unit that communicates with other communication devices using a short-range wireless communication technique. As short-range wireless communication technologies, infrared communication (IrDA (registered trademark), IrMC (registered trademark), IrSimple (registered trademark)), visible light communication, Bluetooth (registered trademark), magnetic field communication (RFID, Radio Frequency Identification) technology can be used. For example, when using the magnetic field communication, the short-range communication unit 36 includes an IC tag that identifies itself and a reading unit that reads an IC tag included in another communication device.

  The position information acquisition unit 42 is a communication unit that receives a GPS signal transmitted from the GPS satellite 7. Further, the position information acquisition unit 42 calculates the latitude and longitude of the electronic device 10 a from the received GPS signal, and sends the calculated latitude and longitude information to the processing unit 22.

  Next, an example of the operation of the electronic device 10a will be described with reference to FIGS. FIG. 6 is an explanatory diagram showing an example of a projected image displayed on the display 12a. FIG. 7 is an explanatory diagram illustrating a positional shift state between the projected image and the drawn image. FIG. 8 is an explanatory diagram showing a state after correcting the projection position of the projection image.

  First, the electronic device 10a reads the text data “Tsuzuki Ward, Yokohama City” stored in the text data storage unit 24b of the storage unit 24, and generates the read text data as the projection image P1 in the image processing unit 22e. After generating the projection image P1, the electronic device 10a displays the projection image P1 on the display 12a on which the object T is placed. The object T is, for example, paper. At this time, the electronic device 10a adjusts the brightness of the display 12a according to the light transmittance of the target T so that the projection image P1 can be seen from the outside through the target T.

  FIG. 9 is a flowchart of processing in which the processing unit of the electronic device adjusts the brightness of the display. First, the object determination unit 22b detects that the object T is placed on the display 12a (step S1). The detection that the target T is placed may be performed based on a predetermined operation performed on the operation unit 13 after the user places the target T on the display 12a, for example. Moreover, it is good also as performing based on the detection result of the touch sensor 101. FIG. Further, it may be performed based on the detection result of the optical sensor 108.

  When the detection result of the touch sensor 101 is used, for example, when a relatively weak contact is detected in a relatively wide range, it may be determined that the object T is placed on the display 12a. When the detection result of the optical sensor 108 is used, for example, an area where the intensity of light detected by the optical sensor 108 is relatively strong and an area where the intensity is relatively weak can be formed, and the shape of one area is a predetermined shape such as a rectangle. If the area is within a predetermined range, it may be determined that the object T is placed on the display 12a.

  Subsequently, the object determination unit 22b determines in which range of the display 12a the object T is placed based on the detection result of the optical sensor 108 (step S2). For example, the range in which the object T is placed can be determined by binarizing the light intensity detected by each optical sensor 108. Note that the amount of light emitted from the backlight 104 is changed stepwise so that the difference between the detection results of the optical sensor 108 between the portion where the target T is placed and the portion where the target T is not placed becomes significant. It is good also as determining using the detection result at the time of appearing large.

  Subsequently, the object determination unit 22b determines the light transmittance of the object T based on the detection result of the optical sensor 108 (step S3). The light transmittance of the object T is, for example, the intensity of light detected by the optical sensor 108 in the portion where the object T is placed and the intensity of light detected by the optical sensor 108 in the portion where the object T is not placed. It is determined based on the ratio. Note that the amount of light emitted from the backlight 104 may be changed in stages, and the determination may be performed using the detection results in each stage.

  Subsequently, the display control unit 22a changes the light emission amount of the backlight 104 in accordance with the light transmittance of the object T so that the projection image P1 can be seen from the outside through the object T. The brightness of 12a is adjusted (step S4). Normally, the brightness of the display 12a is controlled so as to change in the range of 50 to 200 cd, but here, in order to allow the projection image P1 to pass through the object T, it is at least twice the normal upper limit. The brightness may be more than 500 cd.

  In order to prevent the user from feeling dazzling, it is preferable to display black or dark gray in the display area of the display 12a where the object T is not placed. In addition, when the backlight 104 has a light source that can be partially flashed, such as an LED, it is preferable to lower the brightness of a portion where the object T is not placed by not causing the light source to emit light.

  As shown in FIG. 6, by adjusting the brightness of the display 12 a, the projection image P <b> 1 can be visually recognized by the user through the target T. In this state, the user draws a depiction image P2 using the projection image P1 as an index (see FIG. 7). That is, the user draws the text “Yokohama City Tsuzuki Ward” on the target object T, following the text “Yokohama City Tsuzuki Ward” that is the projection image P1, so that the depiction image P2 is well balanced with respect to the target object T. Can be drawn.

  At this time, as shown in FIG. 7, the depiction image P2 drawn by the user may be misaligned with respect to the projection image P1. In this case, if the user draws the depiction image P2 while using the projection image P1 as an index with the projection image P1 and the depiction image P2 being misaligned, it is difficult to draw the depiction image P2 having a good balance. For this reason, the electronic device 10a corrects the display position of the projection image P1 when the depiction image P2 is displaced from the projection image P1.

  FIG. 10 is a flowchart of processing in which the processing unit of the electronic device corrects the display position of the projection image. The electronic device 10a acquires the projection image P1 generated in the image processing unit 22e (step S10). Moreover, the electronic device 10a acquires the depiction image P2 based on the detection result of the optical sensor 108 (step S11). It should be noted that when acquiring the depiction image P2, the brightness of the display 12a is adjusted for a short period of time that is not noticed by the user so that it is easy to determine the portion where the external light is greatly diminished and incident. Also good.

  When the processing unit 22 acquires the projection image P1 in step S10 and acquires the depiction image P2 in step S11, the processing unit 22 obtains a difference in position between the projection image P1 and the description image P2, and the description image P2 is compared with the projection image P1. It is determined whether or not the position is shifted (step S12). If it is determined that the position is shifted (Yes), the processing unit 22 corrects the display position of the projection image P1 so that the difference in position disappears and the projection image P1 matches the depiction image P2 (step S13). On the other hand, when it determines with the process part 22 not having misaligned (No), it progresses to step S10 again and repeats the same flow.

  As shown in FIG. 8, when the display position of the projection image P1 is corrected, the projection image P1 matches the depiction image P2 drawn on the object T. Thereby, the user can draw the depiction image P2 using the corrected projection image P1 as an index.

  As shown in FIG. 8, the projection image P1 has an overlapping portion P1a that overlaps with the depiction image P2 drawn by the user, and a non-overlapping portion P1b that does not overlap with the description image P2. In this case, the processing unit 22 deletes and corrects the overlapping portion P1a of the projection image P1 by the image processing unit 22e. As a result, the overlapping portion P1a of the projection image P1 is not displayed on the display 12a, while the non-overlapping portion P1b of the projection image P1 remains displayed.

  FIG. 11 is a flowchart of processing in which the processing unit of the electronic device deletes and corrects an overlapping portion of the projection image. Similar to step S10, a projection image P1 is acquired (step S20). Moreover, the electronic device 10a acquires the depiction image P2 in the same manner as in step S11 (step S21).

  When the processing unit 22 acquires the projection image P1 in step S20 and acquires the depiction image P2 in step S21, the processing unit 22 obtains a difference in position between the projection image P1 and the description image P2, and the projection image P1 overlaps the description image P2. It is determined whether or not the portion P1a is present (step S22). If the processing unit 22 determines that the projection image P1 has the overlapping portion P1a (Yes), the image processing unit 22e deletes and corrects the overlapping portion P1a of the projection image P1 (step S23). On the other hand, when it determines with the projection image P1 not having the duplication part P1a (No), the process part 22 progresses to step S20 again and repeats the same flow.

  Next, another example of the operation of the electronic device 10a will be described with reference to FIGS. FIG. 12 is an explanatory diagram showing an example of a projected image projected on the surface of the postcard. FIG. 13 is an explanatory diagram illustrating an example of a projected image projected on the back surface of the postcard.

  First, the electronic device 10 a reads the address data of “Taro Yamada” projected onto the surface of the postcard H, which is the projection target, from the text data storage unit 24 b of the storage unit 24. The address data of “Taro Yamada” stores text data such as a postal code, an address, a name, a telephone number, and an e-mail address.

  Subsequently, when the electronic device 10a detects that the postcard H is placed on the display 12a, the electronic device 10a determines the range in which the postcard H is placed and the light transmittance of the postcard H. And the target object information acquisition part 22c is based on the dimension of the postcard H which the determination result of the range in which the postcard H is set | placed, and the light transmittance of the postcard H from the target object information storage part 24a Get information. As a result, the processing unit 22 recognizes that the object placed on the display 12a is a postcard.

  Thereafter, the processing unit 22 sets the address data according to the surface of the postcard H based on the acquired object information of the postcard H and the address data of “Taro Yamada”. That is, the object information on the surface of the postcard H has layout information in which an area for describing a zip code, an area for describing an address, and an area for describing a name are allocated. Then, the processing unit 22 assigns the zip code of the address data to the postal code H area, assigns the address of the address data to the postcard H address area, and assigns the address data name to the postcard H name area. Assigned to. The processing unit 22 generates post-layout address data as the projection image P1 by the image processing unit 22e. The electronic device 10a displays the projection image P1 generated by the image processing unit 22e on the display 12a after adjusting the brightness of the display 12a in accordance with the light transmittance of the postcard H, as shown in FIG. Thus, the address data of “Taro Yamada” can be projected in accordance with the layout of the surface of the postcard H.

  Whether the postcard H faces up or down may be determined based on whether the optical sensor 108 detects a stamp or postal code frame. Moreover, it is good also as determining based on a user's designation | designated. Moreover, it is good also as determining based on the image which the camera which can image | photograph the target object put on the display 12a is provided in the electronic device 10a, and the camera image | photographed.

  Subsequently, when the postcard H is turned over, the electronic device 10a reads text data to be projected on the back surface of the postcard H, which is a projection target, from the text data storage unit 24b of the storage unit 24. A predetermined sentence is stored in advance in the text data.

  Subsequently, when the electronic device 10a detects that the postcard H is placed on the display 12a, the electronic device 10a determines the range in which the postcard H is placed and the light transmittance of the postcard H. And the target object information acquisition part 22c is based on the dimension of the postcard H which the determination result of the range in which the postcard H is set | placed, and the light transmittance of the postcard H from the target object information storage part 24a Get information. As a result, the processing unit 22 recognizes that the object placed on the display 12a is a postcard. Whether the postcard H faces up is determined, for example, by the optical sensor 108 detecting a stamp or postal code frame.

  Thereafter, the processing unit 22 sets the address data according to the back surface of the postcard H based on the acquired object information of the postcard H and the text data. That is, the object information on the back side of the postcard H includes layout information divided into predetermined areas. Then, the processing unit 22 assigns the text data to a predetermined area, and the post-layout text data is generated as the projection image P1 by the image processing unit 22e. The electronic device 10a displays the projection image P1 generated by the image processing unit 22e on the display 12a after adjusting the brightness of the display 12a in accordance with the light transmittance of the postcard H, as shown in FIG. Thus, predetermined text data can be projected in accordance with the layout of the back side of the postcard H.

  Next, another example of the operation of the electronic device will be described with reference to FIG. FIG. 14 is an explanatory diagram illustrating an example of a coloring picture image. The electronic device 10a causes the display 12a to display the coloring image P1c and the color information P1d of the coloring image P1c, which are the projection images P1 stored in the storage unit 24, so as to pass through the object T. The coloring picture image P1c is a line drawing, and the color information P1d is color information corresponding to the coloring picture image P1c. The color information P1d is a character expressing a color, but a corresponding color may be displayed.

  As shown in FIG. 14, when the coloring image P1c and the color information P1d are displayed on the display 12a so as to pass through the object T, the coloring image P1c and the color information P1d are projected onto the object T. In this state, the user draws the depiction image P2 by coloring using the coloring image P1c and the color information P1d as indices.

  At this time, when the drawn depiction image P2 is displaced from the coloring image P1c, the processing unit 22 may correct the display positions of the coloring image P1c and the color information P1d as described above. In addition, the processing unit 22 may delete and correct the overlapping part P1a of the coloring picture image P1c that overlaps the depiction image P2, and project the non-overlapping part P1b of the coloring picture image P1c.

  As described above, in the present embodiment, the position of a target object such as paper placed on the display 12a, the light transmittance, and the like are determined, and the brightness of the display 12a is adjusted based on the determination result. Therefore, an arbitrary image can be displayed through paper or the like.

(Embodiment 2)
In the first embodiment, the optical sensor 108 is used to determine the position of a target object such as paper placed on the display 12a, the light transmittance, and the like. An effect can be obtained. In the second embodiment, an example in which the optical sensor 108 is not used will be described. In the following description, the same parts as those already described may be denoted by the same reference numerals, and redundant description may be omitted.

  FIG. 15 is a diagram illustrating an appearance of the electronic apparatus according to the second embodiment. As shown in FIG. 15, the electronic device 10 b is a straight type in which each part is housed in one box-shaped housing 11. The electronic device 10b may have a foldable, slidable, rotating, or biaxial rotating housing.

  The housing 11 is provided with a touch panel display 12b. The display 12b functions as a display unit that displays various screens, and also functions as an operation unit that operates the electronic device 10b. The display 12b is the same device as the display 12a described in the first embodiment, except that the optical sensor 108 is not provided.

  The housing 11 is provided with a camera 40. The camera 40 is provided at a position away from the surface of the display 12b so that an image displayed on the display 12b can be taken.

  The electronic device 10b performs control for displaying a projection image by transmitting an object such as paper placed on the display 12b based on an image captured by the camera 40. That is, the electronic device 10b detects that the object is placed on the display 12b based on the image taken by the camera 40, and detects the position and size of the object on the display 12b.

  In addition, the electronic device 10b adjusts the brightness of the display 12b based on the image captured by the camera 40 so that the projection image is displayed through the object. For example, the electronic device 10b compares the image captured by the camera 40 with the projected image displayed on the display 12b at each step while gradually increasing the brightness of the display 12b. Then, the electronic device 10b fixes the brightness of the display 12b at the stage when the camera 40 captures an image that matches the projected image.

  Further, the electronic device 10b detects where the user has drawn a character or the like on the object based on the image captured by the camera 40, and adjusts the display position of the projection image due to the positional deviation based on the detection result. Then, processing such as deletion correction is performed on the overlapped portion of the projection image.

  As described above, in this embodiment, since the camera 40 is provided, the same effect as that of the first embodiment can be obtained without using the optical sensor 108.

(Embodiment 3)
In Embodiments 1 and 2, a liquid crystal display using a backlight as a light source is used as the display unit, but the configuration of the display unit is not limited to this. For example, a self-luminous display panel such as an organic EL (Organic Electro-Luminescence) panel may be used as the display unit. A projector can also be used as the display unit. In the third embodiment, an example in which a projector is used as the display unit will be described.

  FIG. 16 is a diagram illustrating an appearance of an electronic apparatus according to the third embodiment. 17 is a diagram schematically showing an A-A ′ cross section of the electronic apparatus shown in FIG. 16. As shown in FIG. 16, the electronic device 10 c is a straight type in which each part is housed in one box-shaped housing 11. The electronic device 10c may have a foldable, slidable, rotary, or biaxial rotary housing.

  The housing 11 is provided with a touch panel display 12c. The display 12c functions as a display unit that displays various screens, and also functions as an operation unit that operates the electronic device 10c. The display 12c includes a light source and an optical system that switches whether to project the light emitted from the light source based on the image data. In the present embodiment, the display 12c includes a visible light irradiation device 110 that is a light source and a drawing device 111 that is an optical system.

  The visible light irradiation device 110 emits visible laser light. The light in the visible light region is light of 360 nm to 400 nm on the short wavelength side and light of 760 nm to 830 nm on the long wavelength side. In this embodiment, the visible light irradiation device 110 has R (Red), G (Green), B Irradiate light of three colors (Blue).

  The drawing device 111 combines the three colors of light emitted from the visible light irradiation device 110 and irradiates the image projection target. The drawing apparatus 111 includes a switching element that switches whether to transmit light emitted from a light source, and a mirror that performs raster scanning of light that has passed through the switching element. Then, the drawing device 111 changes the angle of the laser light emitted from the visible light irradiation device 110 by a mirror and causes the image projection target to scan the laser light, thereby projecting an image onto the image projection target.

  As the mirror, for example, a micro electro mechanical system (MEMS) mirror is used. A MEMS mirror drives a mirror using a piezoelectric element, scans the visible light irradiated from the visible light irradiation apparatus 110, and produces | generates a visible image and an invisible image. In this case, by changing the angle of light emitted from the light source by the mirror and scanning the light emitted from the light source over the entire surface of the image projection target, a visible image or an invisible image can be projected onto the projection target. it can. As described above, the display 12c is a scanning projector.

  In addition, the structure of the display 12c is not limited to what uses the laser mentioned above as a light source. For example, the display 12c may be a projector that uses a halogen light, an LED light source, or an LD light source as a light source and includes an LCD (Liquid Crystal Display) or DMD (Digital Micro-mirror Device) in an optical system.

  In addition, the display 12c includes a plurality of optical sensors 108 on a filter 109 on which the touch sensor 101 is superimposed. The optical sensor 108 included in the display 12c functions in the same manner as the optical sensor 108 in the first embodiment. Instead of the optical sensor 108, the electronic device 10c may be configured to include the camera 40.

  As described above, even when an apparatus other than the liquid crystal display is used as the display unit, the same effect as in the first and second embodiments can be obtained.

(Other embodiments)
In addition, the aspect of this invention shown by said each embodiment can be arbitrarily changed in the range which does not deviate from the summary of this invention, and can be combined arbitrarily. For example, in each of the embodiments described above, the display unit is capable of color display, but the display unit may be monochrome display.

  In each of the above embodiments, the character or the like written on the object by the user is detected using the optical sensor 108 or the camera 40. However, the character written by the user based on the detection result of the touch sensor 101 is used. Etc. may be detected. In addition, by using the optical sensor 108, the camera 40, and the touch sensor 101 in combination, it is possible to improve the detection accuracy of characters written by the user.

  Further, the optical sensor 108 may be able to detect the color. For example, three optical sensors 108 are used in combination, and R (Red), G (Green), and B (Blue) filters are respectively provided in the combined optical sensors 108. Thus, by allowing the optical sensor 108 to detect the color, the identification accuracy of the object can be improved. Specifically, information on the color for each type of object is stored in the object information storage unit 24a, and the color of the object detected by the optical sensor 108 is collated with the information in the object information storage unit 24a. This makes it possible to identify the object with higher accuracy. As a result, the brightness of the display unit is more appropriately controlled.

  As described above, the electronic device, the display control method, and the display control program according to the present invention are suitable for projecting an image on a projection target such as a postcard.

10a, 10b, 10c Electronic device 11 Housing 12a, 12b, 12c Display 13 Operation unit 22 Processing unit 22a Display control unit
22b Object determination unit 22c Object information acquisition unit 22d Posture / position calculation unit 22e Image processing unit 24 Storage unit 24a Object information storage unit 24b Text data storage unit 25 External storage unit 26 Transmission / reception unit 32 Display unit 36 Short-range communication unit 40 Camera 101 Touch sensor 102 Display panel 103 Liquid crystal panel with optical sensor 104 Backlight 108 Optical sensor 109 Filter 110 Visible light irradiation device 111 Drawing device

Claims (10)

A display unit;
A detection unit for detecting an object placed on the display unit;
A display control unit that controls the brightness of the display unit according to the object detected by the detection unit ;
The display controller, an electronic apparatus in which the image to be displayed on the display unit is characterized that you control the brightness of the display unit so as to transmit the object. A display unit;
A detection unit for detecting an object placed on the display unit;
A display control unit that controls the brightness of the display unit according to the object detected by the detection unit;
The detection unit detects in which range of the display unit the object is placed,
The display controller, a child device electrostatic you characterized by displaying in black the portion other than the range where the object is located. The detection unit detects in which range of the display unit the object is placed,
The electronic device according to claim 1, wherein the display control unit sets a brightness of a portion other than a range where the object is placed lower than a range where the object is placed. . A display unit;
A detection unit for detecting an object placed on the display unit;
A display control unit that controls the brightness of the display unit according to the object detected by the detection unit;
The detector shall be the characteristic electronic device to detect a line drawn relative to the object. A display unit;
A detection unit for detecting an object placed on the display unit;
A display control unit that controls the brightness of the display unit according to the object detected by the detection unit;
Wherein the detection unit, wherein the to that electronic equipment that is an imaging device for photographing the display unit. A display unit;
A detection unit for detecting an object placed on the display unit;
A display control unit that controls the brightness of the display unit according to the object detected by the detection unit;
The detection unit detects a thickness of an object placed on the display unit,
The display controller, in response to said thickness of said object detected by the detecting unit, wherein the to that electronic devices to control the brightness of the display unit. Wherein the detection unit, an electronic device according to any one of claims 1 4, characterized in that a light sensor provided on the display unit. Wherein the detection unit, the electronic device according to claim 5 or 7, characterized in that it comprises a touch sensor superimposed on the display unit. A display control method executed by an electronic device having a display unit,
Detecting an object placed on the display unit;
Controlling the brightness of the display unit so that an image displayed on the display unit is transmitted through the detected object. For electronic devices with a display
Detecting an object placed on the display unit;
And a step of controlling the brightness of the display unit so that an image displayed on the display unit is transmitted through the detected object.

Images