JP5160512B2 - Electronic device, control method of electronic device, control program, and recording medium - Google Patents

Description

  The present invention relates to an electronic device that controls a liquid crystal display element to display a display image by spatial luminance modulation, a control method for the electronic device, a control program, and a recording medium.

  Conventionally, a liquid crystal display (LCD) has been widely used as a display for portable information devices such as mobile phones and PDAs (Personal Digital Assistants). LCDs have been considered to have a narrow viewing angle compared to CRTs (Cathode Ray Tubes), plasma displays, and the like, but with the recent advances in LCD technology, viewing angles have been widened.

  However, when the portable information device is used in a crowded situation such as in a train or a bus, the content displayed on the display screen of the portable information device may be peeped by the surrounding people. In particular, when creating and browsing an electronic mail, it is not preferable in terms of privacy that the contents are peeped by people around.

  In response to this problem, an LCD capable of controlling the viewing angle has been proposed (see, for example, Patent Document 1). In such an LCD, it is possible to switch from one of a normal wide viewing angle mode (public mode) and a narrow viewing angle mode (private mode) having a narrow viewing angle to the other. The narrow viewing angle mode is a mode in which a normal display image can be visually recognized from directly in front of the display screen where the user is present, and a plain image or another image can be viewed from an oblique direction.

  In the display device described in Patent Document 1, the liquid crystal display panel has a linear data value / luminance response in a narrow viewing angle range, and a non-linear data value / luminance response in a narrow viewing angle range. Utilizing having.

  Specifically, adjacent data values in the original image are corrected (modulated) by adding one divided value and subtracting the divided value by the other. The corrected image is viewed as an image equivalent to the original image because the human eye performs spatial averaging when the display screen is viewed on an axis parallel to the normal line of the display screen. When the display screen is viewed off-axis, the element of the division value is added. When the division value changes at a rate proportional to the masking image in the corrected image, both the original image and the masking image are visible off-axis, that is, in an oblique direction with respect to the display screen. If the masking image has a disturbing pattern such as a plaid pattern or a company logo, the original image is substantially hidden from off-axis observers. Thereby, the private mode is realized, and the observer on the axis can see the original image without being looked into. In the present specification, the masking image that is viewed only by an off-axis observer is referred to as a side image. The original image is referred to as a main image with respect to the side image.

JP 2007-017988 A (published on January 25, 2007)

  As described above, the side image (masking image) is synthesized in order to prevent the main image (original image) from being looked into by an off-axis observer. Therefore, it can be said that an image having a high shielding effect and an image having a high degree of attention (conspicuous and easily noticeable) are suitable as the side image.

  Depending on the function of the mobile phone, the main image is displayed in various sizes, colors, shapes, and various objects, so it can be said that the most effective side image for peeping prevention depends on the content (object) of the main image. .

  However, the content of the main image changes immediately depending on the operating state of the mobile phone. Therefore, there is a problem that it is not possible to continuously display a side image that exhibits the effect of preventing peeping regardless of the operation state of the mobile phone (contents of the main image). This problem is not limited to the mobile phone described above, and is a problem that commonly occurs in electronic devices that are capable of displaying objects of various sizes, colors, shapes, and movements that are equipped with multiple functions.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide an appropriate side image having a high peeping prevention effect with respect to the main image being displayed, according to the operating state of the electronic device. An electronic device to be output, a control method of the electronic device, a control program, and a recording medium are realized.

  In order to solve the above problems, an electronic device of the present invention is an electronic device that controls a display control device that controls a liquid crystal display element so as to display a display image on a display screen by spatial luminance modulation. The display control device relates to the luminance from the liquid crystal display element, the non-linear correspondence between the luminance with respect to the axial direction parallel to the normal line of the display screen and the luminance with respect to the off-axis direction, and the side image supplied by the electronic device. Based on the image data, the image data of the main image obtained by operating the electronic device is modulated, and the modulated image data is used as the image data of the display image. The electronic device displays a determination means for determining an operation state of the electronic device, the operation state, and the main image off-axis. A display instruction information storage unit for storing the side image display in association with display instruction information for instructing the display control device to display the side image, and the display instruction information storage unit determined by the determination unit. Display instruction means for instructing the display control apparatus to display a side image in accordance with display instruction information associated with the operation state.

  According to the above configuration, the electronic device displays a main image for displaying the operation result of the own device on the display screen, and a side image for shielding the main image from an observer from an off-axis direction. The display control device is supplied to the control device and instructs the display control device to synthesize and display the main image and the side image. And the said electronic device is provided with the display instruction information storage part which links | relates and memorize | stores the operation state of an own machine, and the display instruction information matched with it. The display instruction information is for the electronic device to instruct the display control device to synthesize the side image so as to shield the main image from the off-axis direction.

  Specifically, the determination unit of the electronic device first determines the operation state of the own device. Subsequently, the display instruction means specifies display instruction information corresponding to the operation state of the own device determined by the determination means from the display instruction information storage unit. The display instruction means instructs the display control device to display the side image according to the display instruction information.

  Thus, the side image display instruction performed by the electronic device to the display control device is performed in accordance with the operation state of the electronic device for the purpose of shielding the main image from the observer from the off-axis direction. It is an appropriate instruction.

  In accordance with such an instruction, the display control apparatus can synthesize the side images so as to appropriately shield the main image obtained by the operation of the electronic device, and output a display image.

  As a result, it is possible to output an appropriate side image having a high peeping prevention effect with respect to the main image being displayed according to the operating state of the electronic device.

  In the display instruction information storage unit of the electronic device, an operation state of the electronic device and image designation information for designating a side image to be supplied to the display control device are stored in association with each other, and the display instruction means May include side image designating means for supplying the display control device with a side image designated by the image designating information associated with the operation state determined by the determining means.

  Thereby, the electronic device can select and display a side image appropriate for preventing peeping according to the operation state of the own device.

  The display instruction information storage unit of the electronic device stores an operation state of the electronic device and image processing method information indicating a processing method of the side image in association with each other, and the display instruction means stores the determination Image processing instruction means for controlling the display control device may be included so as to process the side image by the image processing method indicated by the image processing method information associated with the operation state determined by the means.

  Thereby, the electronic device can display a side image by an appropriate method for preventing peeping according to the operation state of the own device.

  The determination unit of the electronic device includes an application determination unit that determines an application being executed by the electronic device, and the display instruction information storage unit includes an application executable by the electronic device, the display instruction information, and Are stored in association with each other, and the display instruction means may instruct the display control device to display a side image according to display instruction information associated with the application determined by the application determination means.

  Accordingly, the electronic device can realize side image display appropriate for preventing peeping according to the application executed by the electronic device.

  The determination means of the electronic device includes display object determination means for determining the type of object included in the main image obtained by operating the electronic device, and the display instruction information storage unit includes the object And the display instruction information are stored in association with each other, and the display instruction means displays the side image according to the display instruction information associated with the object type determined by the display object determination means. May be directed to the display control device.

  As a result, the electronic device can realize an appropriate side image display for preventing peeping according to the content (object) in which the own device is displaying the operation result.

  The display instruction information storage unit of the electronic device stores display instruction information for instructing the display control device to display the side image in a moving image in association with the moving image as the object type. When the display object determining unit determines that the main image includes a moving image, the display instruction unit causes the display control device to display a side image as a moving image according to the display instruction information. You may order it.

  According to the above configuration, the display instruction information storage unit stores display instruction information “display a side image as a moving image” in association with “object type: moving image”.

  As a result of the operation of the electronic device, when a moving image object with movement is displayed in the main image, the display object determining unit determines that the object includes a moving image. In this case, the display instruction means instructs the display control apparatus to display the side image as a moving image in accordance with the display instruction information associated with “object type: moving image”. Thereby, when a moving image is displayed on the main image, the side image can be displayed as a moving image, and the main image can be effectively concealed.

  This is because when the electronic device displays a moving image object, the main image is always in a state where a moving image is displayed on the entire screen. As a side image that can be expected to have a peep prevention effect on such a main image, it is effective that a moving image is displayed on the side image. If a side image with movement that disturbs the movement of the main image (for example, a side image with movement opposite to the movement of the main image) is displayed, the main image can be effectively transferred from the off-axis observer. It is possible to hide.

  The display object determining means further acquires the size and display position of various objects included in the main image, and the display instruction means determines the object size and display position of the main image. Based on this, it is preferable to include side image editing means for editing the side image so that the side image is shielded from the off-axis direction.

  The side image editing means preferably enlarges or reduces the object of the side image in accordance with the size of the object of the main image acquired by the display object determining means.

  The degree of attention of the object in the side image increases, and the object in the main image can be substantially hidden.

  In order to solve the above-described problems, an electronic device control method according to the present invention controls an electronic device that controls a display control device that controls a liquid crystal display element to display a display image on a display screen by spatial luminance modulation. In the method, the display control device relates to the luminance from the liquid crystal display element, a non-linear correspondence between the luminance with respect to an axial direction parallel to the normal line of the display screen and the luminance with respect to an off-axis direction, and the electronic Based on the image data of the side image supplied by the device, the image data of the main image obtained by operating the electronic device is modulated, and the modulated image data is used as the image data of the display image. A main image and a side image are combined and displayed. In the electronic device, a determination step for determining an operation state of the electronic device, and the operation state And a display instruction information storage unit that stores display instruction information for instructing the display control device to display the side image so as to shield the main image from an off-axis direction. And a display instruction step for instructing the display control device to display a side image in accordance with the display instruction information associated with the operation state determined in this way.

  The electronic device may be realized by a computer. In this case, an electronic device control program that causes the electronic device to be realized by the computer by causing the computer to operate as the respective means, and the program are recorded. Computer-readable recording media are also within the scope of the present invention.

  It will be as follows when it demonstrates using a specific example how this invention mentioned above solves a subject. As described above, the most effective side image for peeping prevention varies depending on the content (object) of the main image. For example, when the electronic device displays a mail creation screen or a received mail display screen as a main image, the main image is an image in which a large number of characters are arranged. As a side image that can be expected to have a peeping prevention effect on such a main image, an image in which a picture of the size of the character such as a check pattern or a polka dot pattern is spread is conceivable. In this way, an image with a moderately fine pattern that matches the size of the object (here, a character) does not have a wide gap (non-modulation area) or a wide area that can be made into a large picture image. There is no worry of seeing characters in that area, and there is no worry of peeping. On the other hand, an image that is too fine with high uniformity (such as a halftone dot pattern) has a pattern that is too small compared to characters, and the characters under the pattern are more noticeable. Also, a side image with a low contrast color scheme is inappropriate because it is less conspicuous than the characters of the main image.

  Alternatively, when the electronic device performs the television function, the main image is always in a state where a moving image is displayed on the entire screen. As a side image that can be expected to have a peep prevention effect on such a main image, it is effective that the side image is a moving image. If a side image with movement that disturbs the movement of the main image (for example, a side image with movement opposite to the movement of the main image) is displayed, the main image can be effectively transferred from the off-axis observer. It is possible to hide.

  As described above, the most effective side image for peeping prevention varies depending on the content (object) of the main image, but the content of the main image changes busy depending on the operating state of the electronic device. For example, while composing e-mail on an electronic device, a moderately sized grid pattern side image was suitable, but if the display is switched to television broadcasting immediately thereafter, the side image is optimal. Is not limited.

  According to the configuration of the electronic apparatus of the present invention, the above inconvenience can be solved. That is, it is possible to determine the operating state of the electronic device, and display an appropriate side image in an appropriate manner in the operating state at that time. Therefore, it is possible to output a side image so that the peeping prevention effect is always exhibited even in a situation where the content of the main image changes drastically in the electronic device.

  As described above, the electronic device according to the present invention displays the side image display so as to shield the operation state and the main image from the off-axis direction. In accordance with display instruction information associated with the operation state determined by the determination means in the display instruction information storage unit, the display instruction information storage unit for associating and storing display instruction information for instructing the control device And a display instruction means for instructing the display control device to display the side image.

  Therefore, it is possible to output an appropriate side image having a high peeping prevention effect for the main image being displayed according to the operating state of the electronic device.

It is a functional block diagram which shows the principal part structure of the mobile telephone as an electronic device concerning embodiment of this invention. It is a block diagram which shows schematic structure of the mobile telephone as an electronic device concerning embodiment of this invention. It is a figure which shows the brightness | luminance of an adjacent pixel. (A) And (b) is a graph which shows the responsiveness of the brightness | luminance with respect to a gradation value. It is a graph which shows the correspondence of the gradation value of the main image in the said electronic device, and the gradation value of the image for a display. It is a figure which shows the image of the front view in the said electronic device, and the image of a side view. It is a block diagram which shows schematic structure of the display control part in the electronic device which is one Embodiment of this invention. (A) is a figure which shows the specific example of the arrangement pattern memorize | stored in the arrangement pattern memory | storage part of a display control part, (b) is a display when a side image is arrange | positioned according to an example of the said arrangement pattern. It is a figure which shows the display mode in a part. (A) is a figure which shows the specific example of the color scheme pattern memorize | stored in the color scheme pattern memory | storage part 34 of a display control part, (b) is when a side image is colored according to an example of the said color scheme pattern. It is a figure which shows the pattern of the color scheme on a display part. It is a figure which shows the specific example of the information of the rotation angle memorize | stored in the rotation / inversion information storage part of a display control part, and the information of an inversion direction. It is a figure which shows the specific example of the information of the expansion / contraction rate memorize | stored in the expansion / contraction rate memory | storage part of the display control part. It is a figure which shows the specific example of the side image memorize | stored in the side image memory | storage part of a mobile telephone. It is a figure which shows the specific example of the display instruction information memorize | stored in the display instruction information storage part of a mobile telephone. (A) And (b) is a figure which shows the image of the side view in the said electronic device, especially an appropriate side image is selected according to the operation state of a mobile telephone, or is processed appropriately, It is a figure explaining a mode that the effect of peeping prevention is exhibited. It is a figure which shows the flow of a synthetic | combination process of the side image by the mobile telephone in embodiment of this invention. It is a functional block diagram which shows the principal part structure of the mobile telephone concerning other embodiment of this invention. (A) is a figure which shows an example of the display instruction information memorize | stored in the display instruction information storage part of the mobile telephone in embodiment of this invention, (b) shows the other example of the said display instruction information. FIG. (A) is a figure which shows an example of the main image M, (b) is a figure which shows an example of the side image S edited by the side image editing part 62, (c) is a figure which shows the said main image M It is a figure which shows the image of the side view observed from the off-axis in the said electronic device when the said side image S is synthesize | combined.

Embodiment 1
Hereinafter, an embodiment of the present invention will be described with reference to FIGS. FIG. 2 shows a schematic configuration of the electronic apparatus of the present embodiment. In the present embodiment, this electronic device will be described as the mobile phone 10, but examples of the electronic device include portable electronic devices such as a PDA (Personal Digital Assistant), an electronic dictionary, and a portable communication terminal. Further, the present invention is not limited to this, and the present invention can be applied to any electronic device including an LCD (Liquid Crystal Display) unit (liquid crystal display device).

  As illustrated in FIG. 2, the mobile phone 10 includes a main control unit 11, a bus 12, a storage unit 13, a display device 14, a communication unit 15, an operation unit 16, and an imaging unit 17.

  The main control unit 11 executes various programs by executing a program stored in a storage element such as a RAM (Random Access Memory) or a flash memory, and performs overall control of various units in the mobile phone 10. Is performed via the bus 12, and is realized by, for example, a CPU. In the present embodiment, the main control unit 11 transmits image data of the main image and the side image, various instructions, and the like to the display device 14 via the bus 12. Here, the side image refers to an image superimposed on the main image in order to disturb the main image for the purpose of preventing peeping.

  The bus 12 is a common signal line for transmitting and receiving data between various components in the mobile phone 10. The storage unit 13 stores various data and programs. As an example of the storage unit 13, a ROM (Read Only Memory) that is a read-only semiconductor memory that stores fixed data such as a program necessary for the operation of the main control unit 11, data used for calculation, and calculation result For example, a RAM as a so-called working memory that temporarily stores and the like.

  The display device 14 receives image data from the main control unit 11 or the storage unit 13 via the bus 12 and displays an image based on the received image data. The display device 14 is configured to include a display unit 22 and a display control unit 21.

  The display unit 22 is a functional unit that displays images such as characters, symbols, and figures on the display element based on the image data of the display image. The display unit 22 is a matrix type LCD element (liquid crystal display) in which display pixels are arranged in a matrix. Element) and a drive circuit for driving the LCD element. The LCD element displays an image by spatial luminance modulation that spatially modulates the luminance of incident light from a light source. The image includes a still image and a moving image. In the present embodiment, the display unit 22 is realized as an LCD module having the following configuration. For example, the LCD module includes a reflection sheet for preventing light from leaking from the light source, a light guide plate for propagating light emitted from the light source, a lens sheet having a condensing effect toward the front (in the direction toward the observer's viewpoint), and The LCD panel including the LCD element and the driving circuit is laminated on a diffusion sheet for uniformly diffusing the light of the light source and removing light shading (unevenness).

  The display control unit 21 controls the display unit 22. Specifically, the display control unit 21 transmits image data of the display image to the display unit 22 and transmits a plurality of control signals for controlling the display of the display unit 22. Examples of the control signal include a vertical synchronization signal, a horizontal synchronization signal, and a transfer clock signal for transferring image data of a display image to each display pixel of the LCD element. In the present embodiment, for example, an LCD controller that controls the above-described LCD module can be employed as the display control unit 21.

  The communication unit 15 is for the mobile phone 10 to communicate with an external communication device via a communication network (such as a mobile phone network or the Internet). In the present embodiment, since the electronic device is the mobile phone 10, for example, the communication unit 15 includes an antenna unit that transmits and receives radio waves, a radio processing unit that performs format conversion between data handled by the mobile phone 10 and radio signals, and And a data processing unit for encoding / decoding data.

  The operation unit 16 creates operation data and supplies it to the main control unit 11 when a user operates an input device such as an operation button provided on the main body of the mobile phone 10. Examples of the input device include a button (such as a cross key or a numeric keypad), a switch, or a touch panel.

  The imaging unit 17 captures a subject and generates data such as an image and a moving image. Specifically, the imaging unit 17 captures the electrical signal from the imaging device such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal-oxide Semiconductor) that converts light from the subject into an electrical signal in RGB colors. And a video processing circuit for converting to digital data. For example, when making a video call using the mobile phone 10, the user's own moving image being imaged by the imaging unit 17 is transmitted to the other party of the video call via the communication unit 15.

[Principle of side image]
In the present embodiment, the observation on the axis located in the area (hereinafter referred to as “the area on the axis”) A _on existing from the display screen of the LCD element of the display unit 22 in the normal direction of the display screen. The person V _on visually recognizes the main image. On the other hand, an off-axis observer V _off located in an area where the display screen can be visually recognized and other than the area on the axis (hereinafter, this area is referred to as “ _off- axis area”) A _off . An image obtained by synthesizing the main image and the side image is visually recognized. This principle will be described below.

  In general, as the observer moves away from the display element, it becomes difficult to discriminate between adjacent pixels in the display element, and finally it becomes impossible to discriminate. At this time, the observer perceives the average value (average luminance) of luminance in the adjacent pixels.

From this, it can be said that it is shown in FIG. FIG. 3 shows the luminance of adjacent pixels. First, as shown in FIG. (A), the brightness between pixels _p 1 · _{p 2} of adjacent equal to _{I 0.} Next, as shown in FIG. 4B, one pixel p ₁ is changed to a luminance obtained by subtracting a certain luminance I ₁ from the original luminance I ₀ , and the other pixel p ₂ is changed to the original luminance I _2. The brightness is changed to a brightness obtained by adding a certain brightness I ₁ to I ₀ . In this case, the observer, when between the pixels _p 1 · _{p 2} to the adjacent can not be determined, as shown in FIG. (C), region _{p 12} of the pixel _p 1 · _{p 2} to the adjacent pixel The average luminance of the luminance of p ₁ (I ₀ −I ₁ ) and the luminance of the pixel p ₂ (I ₀ + I ₁ ), that is, the original luminance I ₀ is perceived.

  That is, if the observer moves away from the display element to such an extent that adjacent pixels cannot be distinguished even if the luminance of the adjacent pixels is changed as shown in FIG. The original luminance as in a) will be perceived.

  By the way, a normal display element does not respond proportionally to an input gradation value (for example, 0 to 255 when the image data is 8-bit data), and the output luminance is a constant power of the gradation value ( proportional response). For this reason, in a normal display unit, gamma correction is performed, and the output luminance responds in proportion to the input gradation value.

FIG. 4 is a graph showing the responsiveness of the luminance with respect to the gradation value. The gradation value and the luminance after gamma correction are proportional and have linearity as shown in FIG. In this case, assuming that the luminance corresponding to the gradation value (original value) D ₀ is I ₀ , the gradation value (D ₀ + D ₁ ) and the level obtained by adding and subtracting the divided value D ₁ from the original value D ₀ respectively. The luminance corresponding to the tone value (D ₀ -D ₁ ) is luminance (I ₀ + I ₁ ) and luminance (I ₀ -I ₁ ), respectively. Therefore, the average luminance is I ₀ , which is the same as the luminance I ₀ corresponding to the original value D ₀ .

  However, in the case of the LCD element, the light passing in the on-axis direction and the light passing in the off-axis direction not only have different optical path lengths through the liquid crystal, but also the liquid crystal molecules in the traveling direction of the light. The birefringence due to the difference in inclination is different. For this reason, with respect to the light passing in the on-axis direction, even if the gamma correction is performed so that the responsiveness of the luminance with respect to the gradation value is linear as shown in FIG. For light passing in the direction of, the response is nonlinear.

FIG. 4B shows a case where the response is nonlinear. Referring to (b) of the figure, in this case, the luminance I ₂ corresponding to the gradation value (original value) D ₀ is the gradation value (D ₀ + D _{1) obtained} by adding the divided value D ₁ from the original value D _0. ) And the luminance corresponding to the gradation value (D ₀ -D ₁ ) obtained by subtracting the divided value D ₁ from the original value D ₀ is different from the average luminance I ₃ .

Therefore, the gradation value is modulated so that _{one of} the adjacent pixels adds the divided value D ₁ from the original value D ₀ to the main image and the other subtracts the divided value D ₁ from the original value D _0. Let us consider a case in which the processed image is displayed on the LCD element. In this case, the on-axis observer views an image equivalent to the main image (average luminance I ₃ ), but the off-axis observer is modulated with respect to the main image in accordance with the division value D _1. The image (luminance I ₂ ) is visually recognized. Thus, in this embodiment, the divided value D ₁ of the said adjacent pixels of the main image, is associated with the gradation value of the corresponding pixel of the side image. Thereby, the off-axis observer visually recognizes the image in which the side image is combined with the main image.

By the way, referring to FIG. 4B, it can be understood that the difference between the luminance I ₂ and the average luminance I ₃ increases as the division value D ₁ increases. In the case of the present embodiment, if the difference between the luminance I ₂ and the average luminance I ₃ is large, the off-axis observer sees the side image more clearly, which is desirable from the viewpoint of preventing peeping of the main image. Accordingly, the divided value D ₁ is larger is preferable.

On the other hand, since the gradation value needs to be 0 or more, the gradation value (D ₀ -D ₁ ) obtained by subtracting the division value D ₁ from the original value D ₀ also needs to be 0 or more. For this reason, it is desirable to set the division value D ₁ such that the gradation value (D ₀ -D ₁ ) is 0 or a positive number close to 0. Further, the gradation value (D ₀ + D ₁ ) obtained by adding the division value D ₁ from the original value D ₀ needs to be equal to or less than the maximum value of the gradation values. For this reason, the main image needs to be compressed in the range of usable gradation values.

5, the tone value of the main image in the present embodiment, a graph showing a relationship between a gradation value of the display image is satisfying the above condition relates divided value D _1. FIG. 5 shows an example in which the side image has two gradations (0 or 255). Here, when the gradation value is 0, the side image has the highest degree of disturbance to the main image (maximum disturbance), and when the gradation value is 255, the side image does not disturb the main image (no disturbance). To do. Further, in the example of FIG. 5, the solid line and the broken line are expressed as straight lines, but in reality, they are often curved lines.

The solid line in FIG. 5 indicates the case where the gradation value of the side image is 255 (no disturbance). In this case, the gradation value of the display image is the compressed original value D ₀ ′ of the main image. Further, the broken line in FIG. 5 indicates a case where the gradation value of the side image is 0 (maximum disturbance). In this case, one of the gradation values of adjacent pixels in the display image is a gradation value (D ₀ ′ + D ₁ ) obtained by adding the division value D ₁ from the compressed original value D ₀ ′ of the main image. The other is the gradation value (D ₀ ′ −D ₁ ) obtained by subtracting the division value D ₁ from the compressed original value D ₀ ′ of the main image. When the side image has multiple gradations, a graph similar to the two broken lines in FIG. 5 is described between the solid line and the two broken lines in FIG. 5 according to the gradation value of the side image. become.

Accordingly, the display control unit 21 of the present embodiment, as shown in FIG. 5, the correspondence between the gradation value of the main image and the divided value D ₁ is stored as the partition parameter, the tone values of the main image Then, modulation is performed based on the gradation value of the side image and the division parameter, and this is transmitted to the display unit 22 as the gradation value of the display image. Accordingly, the on-axis observer visually recognizes the same image as the main image, while the off-axis observer visually recognizes an image in which the side image is combined with the main image. As a result, since the main image is disturbed by the side image and is difficult for the off-axis observer to view, the main image can be viewed only by the on-axis observer.

  FIG. 6 is a diagram illustrating a phenomenon in which the main image is disturbed by the side image when viewed from the off-axis observer. As described above, only the main image (four-leaf clover in the example of FIG. 6) is visually recognized by the on-axis observer viewing the display screen from the front. On the other hand, the off-axis observer viewing the display screen from the side views the image in which the side image (prohibition mark in the example of FIG. 6) is combined with the main image. In the example shown in FIG. 6, the colored portion of the prohibition mark is a modulation area in which the gradation value is modulated by the division value. If the side image of the prohibition mark is a main image such as a mail creation screen with a wide non-modulation area (gap) and a lot of small characters, it is determined that it is not suitable for side images from the viewpoint of peeping prevention. . However, in order to occlude a clover object as shown in FIG. 6, it is beneficial to employ a prohibition mark having the same size as the object as a side image. As described above, according to the present invention, it is possible to output an optimum side image from the viewpoint of preventing peeping according to the display content of the main image.

  Specifically, the cellular phone 10 according to the present embodiment prevents peeping under the circumstances depending on the operation state of the cellular phone 10, that is, what is displayed as the main image on the display unit 22. A side image that can be effective is selected, and the side image is supplied to the display control unit 21. Alternatively, the mobile phone 10 of the present invention instructs the display control unit 21 on the processing method of the side image so that the side image is output in a mode in which the effect of preventing peeping can be exhibited under the above situation.

[Configuration of display control unit]
First, details of the display control unit 21 that synthesizes the side image supplied from the main control unit 11 in accordance with an instruction from the main control unit 11 will be described.

  FIG. 7 is a block diagram showing a schematic configuration related to creating a display image using a main image and a side image in the display control unit 21 of the present invention. As shown in FIG. 7, the display control unit 21 includes at least a main image memory 30, a side image memory 31, a division parameter storage unit 38, and an image composition unit 39, and the display control unit 21 further includes The color arrangement pattern storage unit 34, the color switching unit 35, the enlargement / reduction ratio storage unit 36, the image enlargement / reduction unit 37, the rotation / inversion information storage unit 40, the rotation / inversion unit 41, the arrangement as an image processing unit for processing a side image The pattern storage unit 42 and the image arrangement unit 43 may be provided.

  The main image memory 30 is a frame buffer that acquires and stores the image data of the main image M from the main control unit 11 (storage unit 13). The image data of the main image M stored in the main image memory 30 is transmitted to the image composition unit 39 at a predetermined timing.

  The side image memory 31 acquires and stores image data of the side image S from the main control unit 11 (storage unit 13). In the present embodiment, in order to save memory capacity, the capacity of the side image memory 31 is set to a quarter of that of the main image memory 30, and the side image S is stored in a size of a quarter of the main image M. It is supposed to be. Therefore, when the side image S is combined with the main image M, the image enlargement / reduction unit 37 enlarges the side image S by two times in the vertical and horizontal directions. The configuration of the display control unit 21 is not limited to this.

  The arrangement pattern storage unit 42 stores a layout pattern (arrangement pattern) of the side image S. The image placement unit 43 determines the placement of the side images S according to the placement pattern stored in the placement pattern storage unit 42. In the present embodiment, the image placement unit 43 tiles the side image S to be superimposed on the main image M according to the tile placement pattern stored in the placement pattern storage unit 42 as an example.

  FIG. 8A is a diagram illustrating a specific example of the arrangement pattern stored in the arrangement pattern storage unit 42, and FIG. 8B is a display unit when the side images are arranged according to the example of the arrangement pattern. FIG. 22 is a diagram showing a display mode in FIG. As shown in FIG. 8A, the arrangement pattern storage unit 42 stores a plurality of arrangement patterns, and each arrangement pattern indicates whether or not the image arrangement unit 43 should follow the arrangement pattern. A flag is associated. This data structure is an example and does not limit the configuration of the present invention.

  As a specific example of the arrangement pattern, for example, the side image S (one image) may be arranged on the display screen (“1 * 1 (no tiled)” in FIG. 8A). According to this arrangement pattern, it is determined that one side image S is combined with the main image M. Alternatively, a pattern in which the side image S is tiled with horizontal × vertical = 2 × 2 sheets on the display screen is conceivable (“2 * 2” in FIG. 8A). In this case, as shown in FIG. 8B, the side images S (four) are respectively arranged in four regions obtained by dividing the display screen of the display unit 22 by 2 * 2. Note that the enlargement / reduction when the side image S is arranged in the divided area is performed by an enlargement / reduction ratio storage unit 36 and an image enlargement / reduction unit 37 described later.

  In the arrangement pattern storage unit 42, flags may be set for a plurality of arrangement patterns. In this case, the image arrangement unit 43 switches the arrangement pattern to be referred to at a predetermined timing among the arrangement patterns for which the flag is set, and switches the arrangement of the side image S at the timing.

  The color arrangement pattern storage unit 34 stores data of a plurality of color arrangement patterns. The color switching unit 35 uses the plurality of color arrangement patterns in the color arrangement pattern storage unit 34 to switch the color arrangement pattern of the side image at a predetermined timing. By changing the color arrangement pattern of the side image, the side image can be animated.

  FIG. 9A is a diagram illustrating a specific example of a color arrangement pattern stored in the color arrangement pattern storage unit 34. As shown in FIG. 9A, the color arrangement pattern storage unit 34 stores a plurality of color information registered in advance and a plurality of color arrangement patterns using these colors. The color information is, for example, values such as hue and gradation, and is information that specifies colors that can be reproduced by the display control unit 21. Each color arrangement pattern is associated with a flag indicating whether the color switching unit 35 should follow the color arrangement pattern. This data structure is an example and does not limit the configuration of the present invention.

  Specifically, the color switching unit 35 first selects a certain color arrangement pattern from a plurality of color arrangement patterns in the color arrangement pattern storage unit 34. Next, the color switching unit 35 changes the color information of the image data of the side image from the side image memory 31 based on the selected color arrangement pattern data, and rotates the image data of the changed side image. Transmit to the reversing unit 41. Then, at a predetermined timing, the color switching unit 35 selects a color arrangement pattern different from the certain color arrangement pattern from the plurality of color arrangement patterns in the color arrangement pattern storage unit 34, and repeats the above operation.

  FIG. 9B is a diagram showing a color arrangement pattern on the display unit 22 when the side image is colored according to an example of the color arrangement pattern. More specifically, for example, when the side image S (= object) is arranged in horizontal × vertical = 7 * 11, the color arrangement pattern “1234567” shown in FIG. 9A is selected. In this case, 7 * 11 objects displayed on the display screen of the display unit 22 are displayed in the following color scheme. That is, as shown in FIG. 9B, the seven objects in the first row are colored with each color of 1234567 in order from the left, and the subsequent rows are from the first color scheme such as 2345671,. It is colored repeatedly with a pattern shifted to the left one by one.

  When flags are set for all the color arrangement patterns shown in FIG. 9A, the color switching unit 35 switches the color of 7 * 11 objects at a predetermined timing according to each color arrangement pattern. As a result, the color arrangement pattern shown in FIG. 9B is shifted one by one to the left as a whole, so that an object of the same color moves to the left at a predetermined timing with respect to an off-axis observer. I can pretend to be.

  The rotation / inversion information storage unit 40 stores information on the rotation angle and information on the inversion direction such as left / right inversion and up / down inversion. Further, the rotation / reversal unit 41 rotates the side image at a predetermined timing based on the rotation angle information in the rotation / reversal information storage unit 40, or based on the reverse direction information in the rotation / reversal information storage unit 40. The side image is inverted at a predetermined timing. The side image can be animated by rotating or inverting the side image.

  FIG. 10 is a diagram illustrating a specific example of the rotation angle information and the reversal direction information stored in the rotation / reversal information storage unit 40. As shown in FIG. 10, the rotation / reversal information storage unit 40 stores information on a plurality of rotation angles and information on a plurality of reversal directions. Is associated with a flag indicating whether or not to follow the information. Note that the information on the rotation angle and the inversion direction shown in FIG. 10 is an example, and the configuration of the rotation / inversion information storage unit 40 is not limited.

  Specifically, the rotation / inversion unit 41 rotates the image data of the side image from the color switching unit 35 based on the rotation angle information in the rotation / inversion information storage unit 40, and the image of the rotated side image Data is transmitted to the image enlargement / reduction unit 37 and the above operation is repeated. Alternatively, the rotation / inversion unit 41 inverts the image data of the side image from the color switching unit 35 based on the information of the inversion direction in the rotation / inversion information storage unit 40, and converts the image data of the inverted side image to the image It transmits to the expansion / contraction part 37 and repeats the said operation | movement.

  For example, when all the rotation angle information is flagged, the rotation / reversing unit 41 can display the side images S by rotating them sequentially at a predetermined timing according to the information of each rotation angle. Thus, the side image S as a moving image in which one object continues to rotate can be realized.

  The enlargement / reduction ratio storage unit 36 stores a plurality of enlargement / reduction ratios which are enlargement ratios or reduction ratios of image sizes. The image enlargement / reduction unit 37 uses the plurality of enlargement / reduction rates in the enlargement / reduction rate storage unit 36 to enlarge or reduce the image size of the side image at a predetermined timing. By increasing or reducing the image size of the side image, the side image can be converted to a moving image.

  FIG. 11 is a diagram illustrating a specific example of the scaling factor information stored in the scaling factor storage unit 36. As shown in FIG. 11, the enlargement / reduction ratio storage unit 36 stores information on a plurality of enlargement / reduction ratios, and each information is associated with a flag indicating which information the image enlargement / reduction part 37 should follow. It has been. Note that the information on the enlargement / reduction ratio shown in FIG. 11 is an example, and does not limit the configuration of the enlargement / reduction ratio storage unit 36.

  Specifically, the image enlargement / reduction unit 37 first selects a certain enlargement / reduction rate (the enlargement / reduction rate specified by the flag, for example, 50%) from the plurality of enlargement / reduction rates in the enlargement / reduction rate storage unit 36. Next, the image enlargement / reduction unit 37 changes the image data of the side image from the rotation / inversion unit 41 so as to become the image data of the side image enlarged or reduced at the certain enlargement / reduction ratio, and the changed side image The image data of the image is transmitted to the image composition unit 39. When a plurality of enlargement / reduction ratios are designated by the flag, the image enlargement / reduction section 37 provides an enlargement / reduction ratio (for example, 150%) different from the certain enlargement / reduction ratio at a predetermined timing. Is selected from a plurality of enlargement / reduction ratios, and the above operation is repeated. Thereby, the side image S as a moving image in which one object becomes larger or smaller can be realized.

  The division parameter storage unit 38 stores the above-described division parameters. The image composition unit 39 modulates the image data of the main image M from the main image memory 30 based on the image data of the side image from the image enlargement / reduction unit 37 and the division parameters in the division parameter storage unit 38. Is. The image composition unit 39 transmits the modulated image data to the display unit 22 as image data of the display image.

  When the modulated image data is displayed on the display unit 22, only the main image M is viewed from the on-axis, and the side image S superimposed on the main image M is viewed from the off-axis.

  As described above, each image processing unit of the display control unit 21 processes the side image S according to the information stored in each storage unit. Therefore, the main control unit 11 of the mobile phone 10 can control the data in each storage unit of the display control unit 21 to instruct the display control unit 21 to perform image processing of the side image S.

[Main control unit configuration]
Next, the configuration of the main part of the mobile phone 10 (main control unit 11) that supplies a side image to the display control unit 21 and instructs the processing method of the side image will be described in detail.

  FIG. 1 is a block diagram showing a main configuration of a mobile phone 10 according to an embodiment of the present invention.

  As shown in FIG. 1, the main control unit 11 of the mobile phone 10 includes an application execution unit 50, an application control unit 51, an application determination unit 52, and a display instruction unit 53.

  The application execution unit 50 implements functions (such as various applications) of the mobile phone 10 by reading and executing various programs (not shown) stored in the storage unit 13. Specific examples of the application include, for example, a mail application 70 that is a function of exchanging electronic mail with an external device, a television application 71 that receives broadcast waves and displays a television broadcast program, and a website published on the Internet. A web browser application 72 that acquires and displays a spreadsheet, a spreadsheet application 73 that processes a spreadsheet document and executes a spreadsheet, and a video call application 74 that implements a video call by transmitting and receiving video and audio to and from an external communication device. In addition, a dictionary application 75 that reads out dictionary data acquired from or incorporated in the mobile phone 10 from the outside and executes a dictionary function is an example, and these are examples and limit the mobile phone 10 of the present invention. It is not a thing. The application execution unit 50 may execute a program that displays a menu screen, various setting screens, and the like for operating the mobile phone 10.

  Information on the execution result of the application execution unit 50 is formed as a main image M by a drawing unit (not shown) and output to the display control unit 21.

  The application control unit 51 controls the application execution unit 50 to execute a corresponding application using a predetermined event occurring in the mobile phone 10 as a trigger. For example, when the user operates the operation unit 16 to call a mail function, the application control unit 51 activates the mail application 70 by using a button pressed on the operation unit 16 as a trigger.

  The application determination unit 52 determines an application that is started by the application control unit 51 and is being executed by the application execution unit 50. According to the above example, when the mail application 70 is activated, the application determination unit 52 determines that the application being executed is the “mail application 70”.

  The display instruction unit 53 instructs the display control unit 21 to display the side image S in accordance with the operation state of the mobile phone 10 (the content of the main image M as the execution result of the application execution unit 50). . That is, the display instruction unit 53 instructs the image composition unit 39 of the display control unit 21 to compose the side image S with the main image M.

  Specifically, in the present embodiment, the display instruction unit 53 includes a side image specifying unit 60 and an image processing instruction unit 61. The side image designating unit 60 selects the side image S to be synthesized with the main image M and designates it to the display control unit 21. The side image specifying unit 60 refers to various types of information stored in the storage unit 13, so that an optimal side image S that is effective in preventing peeping during execution of the application determined by the application determination unit 52 is obtained. Can be selected.

  For the side image S to be combined with the main image M, the image processing instruction unit 61 performs image processing (tiling, color arrangement, rotation, inversion, enlargement, reduction, etc.) on the side image S. Is to instruct the display control unit 21 of the image processing method. The image processing instruction unit 61 instructs the display control unit 21 on an image processing method by updating the content of information stored in each storage unit of the display control unit 21 or changing a flag. The image processing instruction unit 61 refers to various types of information stored in the storage unit 13, so that an optimum side image S that can prevent peeping during execution of the application determined by the application determination unit 52 is obtained. The image processing method can be instructed to the display control unit 21.

  Each unit of the main control unit 11 described above is executed by a CPU (central processing unit) reading a program stored in a storage device such as a ROM (read only memory) (not shown) into a RAM (random access memory) or the like. Can be realized. That is, each of the units is a functional block realized by the CPU executing a program stored in the storage device and controlling peripheral circuits such as an input / output circuit (not shown).

  Next, various types of information stored in the storage unit 13 referred to by the display instruction unit 53 will be described. The storage unit 13 includes a side image storage unit 80 and a display instruction information storage unit 81.

  FIG. 12 is a diagram illustrating a specific example of the side image stored in the side image storage unit 80. One or more side images are stored in the side image storage unit 80, and one of these is read by the side image designating unit 60 and supplied to the display control unit 21. In the present embodiment, as an example, a plurality of side images including still images and moving images are stored in the side image storage unit 80. As shown in FIG. 12, each side image is associated with a side image ID for uniquely identifying the side image, and associated information for each side image. As side information, information indicating the type and file format of an image, an image size, and a length, a frame rate, and the like in the case of a moving image are stored.

  The side image designating unit 60 can select the most suitable side image for the application currently being executed by the application execution unit 50 with reference to the attached information. For example, when the television application 71 is activated, the main image M becomes a moving image such as a television broadcast program. When a moving image is displayed in this way, it is considered that it is suitable for preventing the peeping of the contents of the main image M to be blocked by the side image S with movement in the same manner. Therefore, when the application determining unit 52 determines that the application being executed is the television application 71, the side image designating unit 60 refers to the attached information in the side image storage unit 80, and the side image (img004) that is a moving image. Or img005) is acquired and supplied to the display control unit 21, and the optimum side image S can be designated according to the application being executed.

  The mobile phone 10 of the present invention not only simply supplies the selected side image S, but also determines what kind of image processing should be applied to the supplied side image S to increase the effect of preventing peeping. Then, the image processing method can be instructed to the display control unit 21.

  FIG. 13 is a diagram illustrating a specific example of display instruction information stored in the display instruction information storage unit 81. The display instruction information storage unit 81 stores display instruction information for instructing display of the side image S in the display control unit 21 in association with an application installed in the mobile phone 10. The display instruction information is information for the main control unit 11 to instruct the display control unit 21 to display a side image. In the present embodiment, as shown in FIG. 13, as the display instruction information, image designation information indicating which side image S is to be used and how the side image S designated by the image designation information is processed. Is stored.

  For example, as shown in FIG. 13, according to the display instruction information associated with “application: mail”, “the still image of img003 is arranged in the vertical and horizontal = 11 × 7 with the same magnification, and the first color "Increase the gradation value of each color from the first color to the seventh color and switch and display all color schemes". Therefore, when the application determination unit 52 determines that the mail application 70 is being executed, the image processing instruction unit 61 causes the still image of img003 to be combined with the main image M and displayed in the above display mode. Then, the display control unit 21 is instructed about the image processing method. In other words, the image processing instruction unit 61 sets a flag for the arrangement pattern “11 * 7” in the arrangement pattern storage unit 42, raises the gradation value of each color information in the color arrangement pattern storage unit 34, and sets a flag for all color arrangement patterns. Then, a process of setting a flag only for the enlargement / reduction ratio “100%” in the enlargement / reduction ratio storage unit 36 is performed.

  Then, the display control unit 21 processes the designated side image S in accordance with the display instruction from the display instruction unit 53 by the instructed method, and synthesizes the main image M (modulates the main image M). As a result, for example, a check pattern as shown in FIG. 14B is observed from the off-axis, and a screen during mail creation can be substantially hidden from the off-axis observer.

  According to the other display instruction information shown in FIG. 13, the display instruction unit 53 can output the video of img005 as the side image S while the television application 71 is being executed, and can effectively prevent peeping. For example, the moving image may be supplied to the side image memory 31 for each frame. During the execution of the web browser application 72, the moving image img004 is output as the side image S. The website displayed on the display unit 22 often displays a mixture of large and small objects such as text, images, and animations. Therefore, by making the moving image of img004 including both a large object and a finer pattern as the side image S, peeping can be effectively prevented. If the number of frames is about four, if the side image memory 31 that can store four images can be installed in the display control unit 21, the moving images of img004 are collectively supplied to the display control unit 21. It is possible. While the spreadsheet application 73 is being executed, the still image img002 is output as a side image S so as to be displayed on the full screen. In spreadsheet software, large and small objects are often displayed together, and symbolic patterns such as graphs and marks are displayed. Therefore, by displaying the img002 still image that is more easily recognized and conspicuous than the graph of the main image M as a side image S on the full screen, it is possible to effectively prevent peeping. . While the video call application 74 is being executed, the still image of img001 is output so as to be displayed with 2 * 2 tiles. In a video conference or the like, video of conference participants is displayed for several participants. Therefore, the side image S is displayed in such a display mode that it is about the same size as the object of the video and can hide the object. Thereby, for example, as shown in FIG. 14A, the object on which the participant's face is projected can be substantially hidden from the off-axis observer. As a result, peeping can be effectively prevented. While the dictionary application 75 is being executed, the still image of img003 is output so that the size and layout of the image are changed at a predetermined timing. On the dictionary application screen, a lot of characters are displayed in large and small fonts such as headwords and explanations. Therefore, by changing the size of the check pattern and displaying it as the side image S, it is possible to hide characters of various sizes from the off-axis observer and effectively prevent peeping.

  As described above, according to the configuration of the mobile phone 10 of the present invention, the application determination unit 52 determines the application being executed by the application execution unit 50, and the display instruction unit 53 determines the determined application. Accordingly, the optimum side image S is selected. Further, the display instruction unit 53 instructs the display control unit 21 to display the side image S after processing it by an optimal method according to the application. Here, the optimum side image S refers to a side image S having a pattern that is most effective in making the off-axis observer visually recognize the disturbance pattern and substantially hiding the main image M.

  From the above, it is possible to always output an appropriate side image with a high peeping prevention effect for the main image being displayed, regardless of what application is being executed, depending on the operating state of the electronic device. .

[Side image composition flow]
FIG. 15 is a diagram illustrating a flow of the synthesis process of the side image S by the mobile phone 10 according to the present embodiment.

  When any application of the mobile phone 10 is called by the user's operation of the operation unit 16 or the like (YES in S1), the application control unit 51 of the main control unit 11 executes the specified application so as to execute the specified application. The execution unit 50 is instructed. The application execution unit 50 activates the designated application and executes the application (S2).

  Subsequently, the application determination unit 52 determines the activated application (S3). Then, the display instruction unit 53 refers to the display instruction information storage unit 81 and acquires display instruction information associated with the application determined by the application determination unit 52 (S4). Specifically, if it is determined in S3 that the dictionary application 75 is being executed, the side image designating unit 60 uses the display instruction information (image designation information) shown in FIG. Is specified as the side image S to be supplied to the display control unit 21. Further, the image processing instruction unit 61 specifies image processing method information “switching with arrangement pattern: 2 * 2 to 7 * 11 / switching with enlargement / reduction ratio: 200% to 30%”.

  Subsequently, the display instruction unit 53 performs a display instruction to the display control unit 21 according to the specified display instruction information (S5). Specifically, the side image specifying unit 60 acquires the still image of img003 from the side image storage unit 80 and supplies it to the display control unit 21. The image processing instruction unit 61 updates the flag of each storage unit of the display control unit 21.

  Finally, the display control unit 21 synthesizes the side image S with the main image M according to the display instruction from the display instruction unit 53 (modulates the gradation value of the main image M), and then modulates the main image M. Is output to the display unit 22 and displayed.

  According to the above method, in S3, the application being executed in S2 is determined. In S4, an appropriate side image S is selected according to the determined application. Further, the display control unit 21 is controlled so as to display the side image S after processing it by an appropriate method (effective for preventing peeping on the current main image M) according to the application. Here, the appropriate side image S refers to the side image S having a pattern that is highly effective in causing the off-axis observer to visually recognize the disturbance pattern and substantially hiding the main image M.

  From the above, it is possible to always output an appropriate side image with a high peeping prevention effect for the main image being displayed, regardless of what application is being executed, depending on the operating state of the electronic device. .

<< Embodiment 2 >>
In the above-described embodiment, the configuration of the mobile phone 10 that determines an appropriate side image and an image processing method according to the operating state of the electronic device, in particular, the application being executed has been described. However, the mobile phone 10 of the present invention is not limited to the above-described configuration, and is appropriate depending on the contents (objects such as text, still images, and moving images) of the main image M displayed on the display unit 22 of the mobile phone 10. The structure which determines a side image and an image processing method may be sufficient.

  FIG. 16 is a block diagram showing a main configuration of a mobile phone 10 according to another embodiment of the present invention. In addition, the code | symbol attached | subjected to each component of FIG. 16 respond | corresponds to the code | symbol attached | subjected to each component of FIG. 1, and the same code | symbol has shown the same component. Therefore, the description about the component already demonstrated by each above-mentioned embodiment is not repeated.

  The cellular phone 10 shown in FIG. 16 is different from the cellular phone 10 according to the first embodiment shown in FIG. 1 in that the main control unit 11 adds (or instead of) the application determining unit 52 and the display object determining unit 54. It is a point equipped with.

  The display object determination unit 54 determines the type of object included in the main image M displayed on the display unit 22 based on information obtained as a result of the application execution unit 50 executing the program. Examples of the types of objects that are included and displayed in the main image M include text, images, animations, videos, and a mixture thereof.

  Furthermore, in this embodiment, the display object determination unit 54 can determine the size, color, and arrangement of the object based on the setting information stored in the setting information storage unit 82 included in the storage unit 13. it can. The setting information is various information that the user has set and registered in the mobile phone 10 in order to customize the basic design of the user interface screen displayed on the mobile phone 10. For example, various setting information such as a screen background color, a character color, a character font, a character size, an icon size, and an icon layout specified by the user is stored. When the display object determination unit 54 determines that the main image M includes text, the display object determination unit 54 reads the character size and character color information from the setting information storage unit 82 and supplies the information to the display instruction unit 53. To do.

According to the above configuration, the side image specifying unit 60 of the display instruction unit 53 can select an appropriate side image S according to the determined object. For example, when it is determined that the object is a moving object (moving image) such as animation or video, the side image designating unit 60 can select a side image S (such as img004 or img005) with movement. .
Alternatively, the image processing instruction unit 61 performs display control on an image processing method for making the side image S suitable for occlusion of the object according to the determined object and further according to the color and size of the object. The unit 21 can be instructed.

  FIG. 17A is a diagram illustrating an example of display instruction information stored in the display instruction information storage unit 81 in the present embodiment. FIG. 17A shows that when one side image S to be supplied to the display control unit 21 is determined (for example, the still image img003 in FIG. 12), the side image S is determined. This is an example in which image processing method information indicating how to process according to an object is stored as display instruction information. In the example shown in FIG. 17A, image processing method information is stored in association with the display object.

  For example, it is assumed that the mail application 70 is executed by the application execution unit 50, and the mail application 70 outputs an execution result to display the received mail. At this time, the display object determination unit 54 determines that the main image M includes a text object based on the execution result.

  In response to the determination that the display object determination unit 54 determines that the display object is text, the image processing instruction unit 61 refers to the display instruction information storage unit 81, and displays the display instruction information shown in FIG. “Image processing method information: displayed in tiled manner at a scaling ratio closest to the character size” associated with “object: text” is acquired. Next, the image processing instruction unit 61 acquires the set character size from the setting information in the setting information storage unit 82 according to the acquired image processing method information, and the character size and the side image S An enlargement / reduction ratio that is substantially the same as the image size of the still image img003 is selected, and the flag of the enlargement / reduction ratio storage unit 36 is updated.

  As described above, even when only one type of side image is stored in the side image storage unit 80 and the side image specifying unit 60 is not provided, the side image is prevented from being peeped according to the determined object. It is possible to instruct the display control unit 21 to process it to a suitable one. Of course, the above configuration can also be applied to the case where a plurality of side images are stored and the side image designating unit 60 is provided.

  FIG. 17B is a diagram showing another example of the display instruction information stored in the display instruction information storage unit 81 in the present embodiment. FIG. 17B shows that when a plurality of side images S are stored in the side image storage unit 80, the image designation information for determining the side image to be supplied to the display control unit 21 is a display instruction. It is an example stored as information. In the example shown in FIG. 17B, image designation information is stored in association with the display object.

  For example, it is assumed that the TV application 71 is executed by the application execution unit 50 and the mail application 70 outputs an execution result for displaying a TV broadcast program. At this time, the display object determination unit 54 determines that the main image M includes a video object based on the execution result.

  When the display object determining unit 54 determines that the display object is a video, the side image specifying unit 60 refers to the display instruction information storage unit 81, and from the display instruction information shown in FIG. Obtain “image designation information: img004 or img005” associated with “object: video”. The side image specifying unit 60 acquires the side image specified by the image specifying information from the side image storage unit 80 and supplies it to the display control unit 21.

  In addition, when a plurality of side images are associated with the determined object as in the above-described example, both of the moving images may be supplied to the display control unit 21 so as to be output alternately. Alternatively, either one may be selected at random and only one moving image may be supplied.

  According to the above configuration, when a plurality of side images are stored in the side image storage unit 80, a side image suitable for peeping prevention is selected according to the content of the displayed main image M, and display control is performed. It becomes possible to supply to the unit 21. This configuration can also be realized in combination with the image processing instruction unit 61. Thereby, after selecting an appropriate side image S according to the display content of the display unit 22, the display control unit 21 further processes the side image S so as to enhance the shielding effect according to the display content. Can be instructed.

  As a result, the display control unit 21 can continue to synthesize and output an appropriate side image S to the content displayed on the display unit 22, and even if the display content (the content of the main image M) changes. , Can always prevent peeping.

  Note that the configuration of the present embodiment can be combined with the application determination unit 52 of the first embodiment. In this case, the image designation information and / or the image processing method information is specified based on the determined application and the determined object. That is, the display instruction information storage unit 81 stores display instruction information in association with a combination of an application and an object.

[Modification]
Further, the display instruction unit 53 may include a side image editing unit 62. The side image editing unit 62 selects the side image S or the side image selected by the side image designating unit 60 so that the shielding effect of the main image M is enhanced according to the size and display position of each object of the main image M. The side image S stored in the storage unit 80 is edited.

  Hereinafter, the operation of the main control unit 11 including the side image editing unit 62 will be described with reference to specific examples of FIGS.

  FIG. 18A is a diagram illustrating an example of the main image M output as the execution result of the web browser application 72. Based on the execution result information output from the application execution unit 50, the display object determination unit 54 recognizes that the main image M includes the objects of the image 90, the image 91, and the text 92, and displays the display position of each object, Get the size of each object.

  The side image specifying unit 60 of the display instruction unit 53 acquires an image to be used for the side image S according to the display instruction information of FIG. 17B according to the information acquired by the display object determination unit 54. Specifically, the still image img003 associated with the text and the still image img001 associated with the image are acquired from the side image storage unit 80.

  In accordance with the display instruction information of FIG. 17A, the side image editing unit 62 enlarges or reduces the still image img003 for text occlusion so that the still image img003 is close to the character size, and tiles the image. To. For the still image img001 for image occlusion, the object of the prohibition mark is enlarged or reduced so that the object is close to the size of each image (90, 91), and is superimposed on each image. Layout.

  FIG. 18B is a diagram illustrating an example of the side image S obtained as a result of the side image editing unit 62 editing in combination with the still image img003 and the still image img001. In the side image S shown in FIG. 18B, the still image 93 (img003) is tiled with a size close to the character size, and the still image 94 and the still image 95 (img001) are the image 90, It is close to the size of 91 and is arranged at the position of each image object.

  FIG. 18C illustrates a case where the image composition unit 39 modulates the main image M in FIG. 18A based on the side image S in FIG. 18B generated by the side image editing unit 62. It is a figure explaining a mode when image data is observed from off-axis. Of the main image M, the text 92 is effectively occluded by the tiling of the still image 93, and the images 90 and 92 are occluded effectively by the still images 94 and 95 having higher attention. .

  In this way, the side image editing unit 62 enlarges or reduces the object of the side image according to the size of the object, or arranges another side image in combination according to the display position of the object. According to the content of the main image M, a more effective side image S can be generated from the viewpoint of peeping prevention and supplied to the display control unit 21.

  The side image editing unit 62 may edit the side image using a color that makes the object inconspicuous according to the color of the object. If the side images after color editing are superimposed, the object of the main image M becomes inconspicuous, and the main image M can be substantially hidden from the off-axis observer. Also, the side image editing unit 62 may edit the color of the side image so that the color scheme of the side image is a color scheme having a low contrast so that the color scheme has a high contrast (that is, more prominent than the main image). Good.

  The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope shown in the claims. That is, embodiments obtained by combining technical means appropriately modified within the scope of the claims are also included in the technical scope of the present invention.

  Finally, each block of the main control unit 11 and the display control unit 21 in the mobile phone 10, in particular, each unit of the application determination unit 52 and the display instruction unit 53 may be configured by hardware logic, as follows: You may implement | achieve by software using CPU.

  That is, the mobile phone 10 includes a CPU (central processing unit) that executes instructions of a control program that realizes each function, a ROM (read only memory) that stores the program, a RAM (random access memory) that expands the program, A storage device (recording medium) such as a memory for storing the program and various data is provided. An object of the present invention is a recording medium on which a program code (execution format program, intermediate code program, source program) of a control program for the mobile phone 10 which is software for realizing the above-described functions is recorded so as to be readable by a computer This can also be achieved by supplying the mobile phone 10 and reading and executing the program code recorded on the recording medium by the computer (or CPU or MPU).

  Examples of the recording medium include a tape system such as a magnetic tape and a cassette tape, a magnetic disk such as a floppy (registered trademark) disk / hard disk, and an optical disk such as a CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  The mobile phone 10 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Also, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  The present invention provides an electronic device capable of synthesizing a side image with a main image for the purpose of preventing the peeking of the main image from an off-axis observer. The output can be changed to an appropriate state according to the operating state of the electronic device. Therefore, the present invention can be applied to any electronic device including a display control device that performs display control by combining a main image and a side image by spatial luminance modulation.

10 Mobile phone (electronic equipment)
DESCRIPTION OF SYMBOLS 11 Main control part 12 Bus | bath 13 Storage | storage part 14 Display apparatus 15 Communication part 16 Operation part 17 Imaging part 21 Display control part (display control apparatus)
22 Display unit 30 Main image memory 31 Side image memory 34 Color arrangement pattern storage unit 35 Color switching unit 36 Enlargement / reduction ratio storage unit 37 Image enlargement / reduction unit 38 Division parameter storage unit 39 Image composition unit 40 Rotation / inversion information storage unit 41 Rotation / Inversion unit 42 Arrangement pattern storage unit 43 Image arrangement unit 50 Application execution unit 51 Application control unit 52 Application determination unit (determination unit / application determination unit)
53 Display instruction section (display instruction means)
54 Display object determination unit (determination means / display object determination means)
60 Side image designation unit (display instruction means / side image designation means)
61 Image processing instruction section (display instruction means / image processing instruction means)
62 Side image editing unit (display instruction means / side image editing means)
70 Mail Application 71 TV Application 72 Web Browser Application 73 Spreadsheet Application 74 Video Call Application 75 Dictionary Application 80 Side Image Storage Unit 81 Display Instruction Information Storage Unit 82 Setting Information Storage Unit 90 Image (Main Image Object)
91 images (main image objects)
92 text (main image object)
93 Still image (side image object)
94 Still image (side image object)
95 Still image (side image object)

Claims (7)

An electronic device that controls a display control device that controls a liquid crystal display element to display a display image on a display screen by spatial luminance modulation,
The display control device
Regarding the luminance from the liquid crystal display element, there is a non-linear correspondence between the luminance with respect to the axial direction parallel to the normal line of the display screen and the luminance with respect to the off-axis direction, and the image data of the side image supplied by the electronic device. Based on this, the image data of the main image obtained by the operation of the electronic device is modulated, and the modulated image data is used as the image data of the display image, so that the main image and the side image are combined and displayed. Is what
The electronic device
Determining means for determining an operating state of the electronic device;
A display instruction information storage unit for storing the operation state in association with display instruction information for instructing the display control device to display the side image so as to shield the main image from an off-axis direction;
Display instruction means for instructing the display control device to display a side image in accordance with display instruction information associated with the operation state determined by the determination means in the display instruction information storage unit ;
In the display instruction information storage unit,
The operation state of the electronic device and the image processing method information indicating the processing method of the side image are stored in association with each other,
The display instruction means is
Image processing instruction means for controlling the display control device so as to process the side image by the image processing method indicated by the image processing method information associated with the operation state determined by the determination means;
The determination means, as the operating state of the electronic device,
An electronic device that determines at least one of which application the electronic device is executing and which type of object the electronic device is displaying as a main image . In the display instruction information storage unit,
The operation state of the electronic device and image designation information for designating a side image to be supplied to the display control device are stored in association with each other,
The display instruction means further includes:
Side image image specifying information associated with has been the operating state determined by the above Symbol judging means specifies, according to claim 1, characterized in that it comprises a side image specifying means for supplying to the display control unit Electronics.   The determination means includes application determination means for determining an application being executed by the electronic device,
  In the display instruction information storage unit,
  An application executable by the electronic device and the display instruction information are stored in association with each other,
  3. The display instruction unit according to claim 1, wherein the display instruction unit instructs the display control device to display a side image according to display instruction information associated with the application determined by the application determination unit. Electronic equipment.   The determination means includes display object determination means for determining the type of object included in the main image obtained by operating the electronic device,
  In the display instruction information storage unit,
  The type of the object and the display instruction information are stored in association with each other,
  The display instruction means instructs the display control apparatus to display a side image according to display instruction information associated with the type of object determined by the display object determination means. 4. The electronic device according to any one of up to 3.   An electronic device control method for controlling a display control device that controls a liquid crystal display element so as to display a display image on a display screen by spatial luminance modulation,
  The display control device relates to the luminance from the liquid crystal display element, the non-linear correspondence between the luminance in the axial direction parallel to the normal line of the display screen and the luminance in the off-axis direction, and the side supplied by the electronic device. Based on the image data of the image, the image data of the main image obtained by the operation of the electronic device is modulated, and the modulated image data is used as the image data of the display image. Are combined and displayed,
  In the above electronic device,
  A determination step of determining an operating state of the electronic device;
  A display instruction information storage unit for storing the operation state in association with display instruction information for instructing the display control device to display the side image so as to shield the main image from an off-axis direction; A display instruction step for instructing the display control device to display a side image in accordance with the display instruction information associated with the operation state determined in the determination step,
  In the display instruction information storage unit,
  The operation state of the electronic device and the image processing method information indicating the processing method of the side image are stored in association with each other,
  The display instruction step is
    An image processing instruction step for controlling the display control device so as to process the side image by the image processing method indicated by the image processing method information associated with the operation state determined in the determination step;
  In the determination step, as an operation state of the electronic device,
  An electronic device characterized by determining at least one of which application the electronic device is executing and which type of object the electronic device is displaying as a main image Control method.   The control program for functioning a computer as each means of the electronic device of any one of Claim 1 to 4.   A computer-readable recording medium on which the control program according to claim 6 is recorded.

Images