JP2011197537A - Terminal device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To properly control whether the same content image is made to view by a plurality of persons or a different image is made to view by a part of persons.SOLUTION: A terminal device controls such that the same image is viewed from a plurality of visual field angle directions or respective images are viewed, based on whether a specific object is included in an image displayed on a display part 18. Namely, the original image is displayed on the display part 18, while the display part 18 is controlled so that the original image is viewed from first and second visual field angle directions, or the original image and processing already finished image in which specific object in the image is processed are displayed simultaneously in the display part 18, while the display part 18 is controlled so that the original image is viewed from the first visual field angle direction, also the display part 18 is controlled so that the already processed image is viewed from the second visual field angle direction.

Description

  The present invention relates to a terminal device and a program for controlling the viewing angle direction of a display unit.

  In recent years, a display unit of a terminal device such as a mobile phone has been increased in screen size, and the viewing angle direction in which an image displayed on the display unit can be visually recognized has been increased, so that a plurality of people can view the same display unit. It is becoming possible. For example, users can view many images taken with their camera phones together with colleagues in the company, but if a specific person such as a family member is included, Even people will be shown to colleagues.

Further, even when an image is viewed on a train, a specific person is shown to others by looking into the surrounding people. In this way, when a specific object (such as a specific person) is included in an image, conventionally, a technique has been known in which processing such as deleting the object or applying a mosaic to the object is performed. However, by performing such processing, the user himself / herself cannot see the object.
By the way, conventionally, a technique is known in which a parallax barrier is provided on a display unit so that each image can be viewed only from a certain direction in a state where a plurality of images are displayed on the display unit at the same time (patents). Reference 1 and 2).

JP 2009-089329 A JP 2008-276495 A

  However, in the above-described prior art (Patent Document 1), a captured image can be confirmed in a certain viewing angle direction among a plurality of viewing angle directions, and photographing information can be confirmed in other viewing angle directions. However, it had to be viewed separately by changing the viewing angle direction. Therefore, the photographed image and the photographed information cannot be viewed at the same time, and it is not assumed that a plurality of persons including the user see the same display unit at the same time. On the other hand, in the above-described prior art (Patent Document 2), even if an image and an icon for a certain viewer (user) and an image and an icon for another viewer are displayed at the same time, the viewing angle Although it is possible to check his / her own image and icon according to the viewer according to the direction, the other person's image and icon cannot be seen at the same time, and a plurality of people have to see different contents individually.

  An object of the present invention is to appropriately control whether a plurality of people can see the same image or some people can see different images without requiring a special operation.

In order to solve the above-described problem, the invention described in claim 1
A terminal device for controlling the viewing angle direction of the display unit,
The first image is displayed on the display unit, and the display unit is configured so that the first image is viewed from both the first viewing angle direction and a second viewing angle direction different from the first viewing angle direction. First control means for controlling;
The first image and a second image different from the first image are simultaneously displayed on the display unit, and the display unit is controlled so that the first image is viewed from the first viewing angle direction, and the second field of view is controlled. Second control means for controlling the display unit so that the second image is viewed from an angular direction;
Determining means for determining whether or not a specific object is included in an image to be displayed on the display unit;
Instruction means for instructing execution of control by one of the first control means and the second control means based on the determination result of the determination means;
It is characterized by providing.

As an invention dependent on claim 1,
The instruction means instructs execution of control by the second control means when it is determined that the specific object is included by the determination means;
The invention according to claim 2, which is configured as described above.

As an invention dependent on claim 2,
The image processing apparatus further includes an acquisition unit that acquires an image on which the specific object has been processed,
The second control means controls the image to be displayed on the display unit as the first image and the image acquired by the acquisition means as the second image to be displayed on the display unit at the same time.
The invention according to claim 3, which is configured as described above.

As an invention dependent on claim 3,
The acquisition means uses the image including the specific object as the first image, and performs processing on the first image, thereby processing the image processed on the specific object as the second image. get,
The invention according to claim 4, which is configured as described above.

As an invention dependent on claim 3,
The acquisition unit acquires an image obtained by processing the specific object from the outside.
The invention according to claim 5, which is configured as described above.

As an invention dependent on claim 1,
The instruction means instructs the execution of control by the first control means when it is determined that the specific object is not included by the determination means;
The invention according to claim 6 is characterized in that it is configured as described above.

As an invention dependent on claim 1,
It further comprises a photographing means for photographing an image,
The determining means determines whether or not a specific object is included in the image photographed by the photographing means;
The invention according to claim 7, characterized in that it is configured as described above.

As an invention dependent on claim 1,
A photographing unit for photographing an image including the specific object and an image not including the specific object;
The second control unit displays the image including the specific object photographed by the photographing unit as the first image, and the image not including the specific object photographed by the photographing unit as the second image. Control to display on the screen at the same time,
The invention according to claim 8, which is configured as described above.

In order to solve the above-described problem, the invention according to claim 9 is
A terminal device for controlling the viewing angle direction of the display unit,
Determining means for determining whether or not a specific object is included in an image to be displayed on the display unit;
An acquisition unit that acquires an image obtained by performing a processing on the specific object when the determination unit determines that the specific object is included;
The display unit is configured to display the image to be displayed on the display unit and the image acquired by the acquisition unit simultaneously on the display unit, and to display the image to be displayed on the display unit from the first viewing angle direction. First control means for controlling and controlling the display unit so that the acquired image is viewed from a second viewing angle direction different from the first viewing angle direction;
It is characterized by providing.

As an invention dependent on claim 9,
When it is determined by the determining means that a specific object is not included, an image to be displayed on the display unit is displayed on the display unit, and an image to be displayed on the display unit is the first viewing angle direction and the first viewing angle direction. A second control means for controlling the display unit so as to be viewed from both a second viewing angle direction different from the first viewing angle direction;
The invention according to claim 10, which is configured as described above.

In order to solve the above-described problem, the invention according to claim 11
A terminal device for controlling the viewing angle direction of the display unit,
The first image is displayed on the display unit, and the display unit is configured so that the first image is viewed from both the first viewing angle direction and a second viewing angle direction different from the first viewing angle direction. First control means for controlling;
The first image and a second image different from the first image are simultaneously displayed on the display unit, and the display unit is controlled so that the first image is viewed from the first viewing angle direction, and the second field of view is controlled. Second control means for controlling the display unit so that the second image is viewed from an angular direction;
Determining means for determining whether an image to be displayed on the display unit is associated with an image different from the image;
Instruction means for instructing execution of control by one of the first control means and the second control means based on the determination result of the determination means;
It is characterized by providing.

As an invention dependent on claim 11,
Photographing means for photographing the first image including the specific object and the second image not including the specific object;
Storage control means for associating the first image including the specific object imaged by the imaging means and the second image not including the specific object in the storage unit;
Further comprising
The determination means determines whether or not a first image including a specific object stored in the storage unit is associated with a second image not including a specific object.
The invention according to claim 12 is characterized in that it is configured as described above.

In order to solve the above-mentioned problem, the invention according to claim 13 is
Against the computer,
The first image is displayed on the display unit, and the display unit is controlled so that the first image is viewed from both the first viewing angle direction and a second viewing angle direction different from the first viewing angle direction. Function to
The first image and a second image different from the first image are simultaneously displayed on the display unit, and the display unit is controlled so that the first image is viewed from the first viewing angle direction, and the second field of view is controlled. A function of controlling the display unit so that the second image is visually recognized from an angular direction;
A function of determining whether or not a specific object is included in an image to be displayed on the display unit;
Based on the determination result, execution of control such that the first image is visually recognized from both the first viewing angle direction and the second viewing angle direction is instructed, and the first viewing angle direction from the first viewing angle direction. A function of instructing execution of control such that an image is visually recognized and the second image is visually recognized from the second viewing angle direction;
It is a program for realizing.

In order to solve the above-mentioned problem, the invention according to claim 14 is
Against the computer,
A function of determining whether or not a specific object is included in an image to be displayed on the display unit;
When it is determined that the specific object is included, a function of obtaining an image obtained by performing processing on the specific object;
The image to be displayed on the display unit and the acquired image are simultaneously displayed on the display unit, and the display unit is controlled so that the image to be displayed on the display unit is visually recognized from the first viewing angle direction, A function of controlling the display unit so that the acquired image is viewed from a second viewing angle direction different from the first viewing angle direction;
It is a program for realizing.

In order to solve the above-mentioned problem, the invention according to claim 15 is
Against the computer,
The first image is displayed on the display unit, and the display unit is controlled so that the first image is viewed from both the first viewing angle direction and a second viewing angle direction different from the first viewing angle direction. Function to
The first image and a second image different from the first image are simultaneously displayed on the display unit, and the display unit is controlled so that the first image is viewed from the first viewing angle direction, and the second field of view is controlled. A function of controlling the display unit so that the second image is visually recognized from an angular direction;
A function of determining whether or not the first image to be displayed on the display unit is associated with an image different from the image;
Based on the determination result, execution of control such that the first image is visually recognized from both the first viewing angle direction and the second viewing angle direction is instructed, and the first viewing angle direction from the first viewing angle direction. A function of instructing execution of control such that an image is visually recognized and the second image is visually recognized from the second viewing angle direction;
It is a program for realizing.

  According to the present invention, it is possible to appropriately control whether to show an image having the same content to a plurality of people or to show a different image to some people without requiring a special operation, and it is rich in practicality. Become.

The block diagram which showed the communication network system which can use the mobile telephone applied as a terminal device. FIG. 2 is a block diagram showing basic components of the mobile phone 1. The figure for demonstrating the image memory | storage part M3. The figure for demonstrating the object memory | storage part M4. In the state where the parallax barrier is generated on the surface layer of the display unit 18, when the processed image and the original image before processing are simultaneously displayed on the display unit 18, an image that can be viewed according to the viewing angle direction is obtained. The figure for demonstrating different. The main flowchart which showed the outline | summary of the whole operation | movement by the side of the mobile telephone 1 by which execution is started with power activation. 7 is a flowchart for explaining image acquisition processing (step A6 in FIG. 6) in detail. 7 is a flowchart for explaining image display processing (step A8 in FIG. 6) in detail. 9 is a flowchart following the operation of FIG. 7 is a flowchart for explaining in detail image acquisition processing (step A6 in FIG. 6) in the second embodiment. 7 is a flowchart for explaining in detail image display processing (step A8 in FIG. 6) in the second embodiment.

(First embodiment)
A first embodiment of the present invention will be described with reference to FIGS.
This embodiment exemplifies a case where the present invention is applied to a mobile phone as a terminal device, and FIG. 1 is a block diagram showing a communication network system in which the mobile phone can be used.
The mobile phone 1 is, for example, a foldable mobile phone in which two cases (an operation unit case and a display case not shown) are foldably attached, and includes a call function, an e-mail function, and an Internet connection function (Web access). Function), TV broadcast reception function, camera function, etc.

  When the cellular phone 1 is connected to the wireless communication network (mobile communication network) 2 from the nearest base station 2A and exchange 2B, the cellular phone 1 is connected to other cellular phones (not shown) via the wireless communication network 2. The phone is ready to talk. In addition, when the mobile phone 1 is connected to the Internet 3 via the wireless communication network 2, the mobile phone 1 can access and browse a Web site, and images (moving images and still images) from the image distribution device 4 can be viewed on the Internet 3. And download reception is enabled via the wireless communication network 2. The cellular phone 1 receives digital terrestrial broadcasts transmitted from the television station 5 via the transmission antenna 6, but the image distribution apparatus via the wireless communication network 2 and the Internet 3 like an Internet radio. 4 can also download and receive digital broadcasts.

FIG. 2 is a block diagram showing basic components of the mobile phone 1.
The central control unit 11 operates by supplying power from the battery unit 12 including a secondary battery, and controls the overall operation of the mobile phone 1 according to various programs in the storage unit 13 and a memory. (Not shown). The storage unit 13 is provided with a program storage unit M1, various information temporary storage units M2, an image storage unit M3, an object storage unit M4, and the like.

  The program storage unit M1 stores a program and various applications for realizing the present embodiment in accordance with the operation procedure shown in FIGS. 6 to 9, and stores information necessary for the program. Yes. Note that the storage unit 13 may include a removable portable memory (recording medium) such as an SD card or an IC card, or may be on a predetermined external server (not shown). The various information temporary storage unit M2 is a work area for temporarily storing various information necessary for the mobile phone 1 to operate, such as flag information and screen information. The image storage unit M3 and the object storage unit M4 will be described in detail later.

  The wireless communication unit 14 includes a wireless unit, a baseband unit, a demultiplexing unit, and the like. When the call function is in operation, when the signal is received from the receiving side of the baseband unit, demodulated into a received baseband signal and output to the central control unit 11, the central control unit 11 causes the audio signal processing unit 15 to Via the voice speaker SP, and the voice data input from the voice microphone MC is fetched from the voice signal processing unit 15, encoded into a transmission baseband signal, and then sent to the transmission side of the baseband unit. Transmission is output from the antenna AN1.

  The television broadcast receiving unit 16 receives terrestrial digital television broadcasts, and can receive multi-organized broadcasts in which a plurality of programs are divided and broadcast simultaneously within one channel frame. When receiving one-segment broadcasting (one-segment broadcasting) for a communication terminal device, two programs can be divided and received simultaneously within one channel frame, and high-resolution digital television broadcasting (12 When receiving (segment broadcasting), three programs can be divided and received simultaneously in one channel frame. The television broadcast receiver 16 receives a broadcast signal from the antenna AN2 (analog circuit), and demodulates the received broadcast signal by OFDM (Orthogonal Frequency Division Multiplexing) or multiplexes the broadcast signal. A digital circuit unit that separates video data, audio data, and data (character data) into decoded data, decompresses compressed data, and the like.

  The imaging unit 17 is a component that constitutes a camera function, has an imaging element (for example, a CCD or a CMOS), and can capture moving images in addition to still image shooting. The imaging unit 17 includes a photographic lens, a distance measuring sensor, a light amount sensor, an analog processing circuit, a signal processing circuit, a compression / decompression circuit, and the like, and performs adjustment control of optical zoom, drive control during autofocus, and shutter drive control. , Control exposure, white balance, etc. The imaging unit 17 has a continuous shooting function as a special shooting function, and within a predetermined time (for example, several seconds) in response to one special shooting operation (shutter operation after selecting the continuous shooting function). Thus, continuous shooting is performed a plurality of times (for example, twice).

  The display unit 18 uses high-definition liquid crystal and displays, for example, character information, a standby image, a still image, a moving image, a television image, and the like. A liquid crystal layer is provided for generating a parallax barrier having a translucent slit. The parallax barrier control unit 19 is configured such that when a plurality of different images are displayed on the display unit 18 at the same time, an image from a certain viewing angle direction can be viewed from another viewing angle direction. A parallax barrier is generated on the surface layer of the display unit 18, and the parallax barrier is generated on the surface layer of the display unit 18 or erased from the surface layer of the display unit 18 under the control of the central control unit 11.

  The operation unit 20 inputs dial input, character input, command input, and the like. The central control unit 11 executes processing according to an input operation signal from the operation unit 20. For example, power on / off processing is executed in response to a power on / off operation, and image acquisition processing is executed in response to an image acquisition operation (such as a download operation instructing image download or a shooting operation instructing shooting). Or An RTC (real time clock module) 21 constitutes a clock unit, and the central control unit 11 acquires the current date and time from the RTC 21. The notification unit 22 includes a sound speaker 22A, an LED (light-emitting diode) 22B, and a vibration motor 22C.

FIG. 3 is a diagram for explaining the image storage unit M3.
The image storage unit M3 stores various image data such as an image captured by the imaging unit 17 and an image downloaded and received from the image distribution device 4 together with information related to the image. The “image ID”, “title”, “Type”, “original image (actual data)”, “processed image (actual data)”,... Here, the “image ID” is a serial number for identifying an image. “Title” is additional information (image name) attached to the image.

  “Type” indicates whether the image type is a still image or a moving image. “Original image (actual data)” is actual data of an image, and indicates original image data before a predetermined processing is performed on a part of the image data (actual data). On the other hand, “processed image (actual data)” indicates image data after the original image is processed. The “original image” and the “processed image” are not limited to being stored in a one-to-one relationship, and the “processed image” may not be stored. "" Indicates that no processed image is stored.

  Here, the predetermined processing is to delete a specific object (person, character string, etc.) included in the image, apply a mosaic, or replace it with another image. In the process, the central control unit 11 determines whether or not a specific object is included in the image by analyzing the image when the image designated as the display target is displayed on the display unit 18. If a specific object is included, the predetermined processing described above is performed on the image. In this case, the central control unit 11 instructs the parallax barrier control unit 19 to generate a parallax barrier, and the original image before the processing (first image) and the processed image (second image) are displayed. It is made to display on the display part 18 simultaneously. Note that the range for performing the processing is not limited to a specific object, but may be an arbitrary range including the specific object, such as the entire image.

FIG. 4 is a diagram for explaining the object storage unit M4.
The object storage unit M4 stores information for specifying an object that is a target of the predetermined processing described above, and processing processing contents indicating what kind of processing is performed on the object. , “Object ID”, “title”, “actual data”, “processing content”,... The “object ID” is a serial number for identifying an object. “Title” is additional information (object name) attached to the object. “Type” indicates whether the object type is an image or text. “Real data” indicates the actual data (image data, character string data) of the object, and “Processing content” indicates the type of processing (erasure, mosaic, replacement) to be performed on the object. The contents of the object storage unit M4 can be arbitrarily set by a user operation.

  FIG. 5 shows a processed image obtained by processing a specific object in an image designated as a display target in a state where a parallax barrier is generated on the surface layer of the display unit 18 and the processing processing. In order to explain that when the original image before application is displayed on the display unit 18 at the same time, the images that can be viewed differ depending on the viewing angle direction of the user or third party facing the display unit 18. FIG.

  FIG. 5A is a diagram illustrating a user who is facing the display unit 18 from the front and a third party who is viewing from the left and right sides other than the front. In this case, a viewing angle direction when the display unit 18 is viewed from substantially the front is referred to as a first viewing angle direction, and left and right viewing angle directions that are out of the first viewing angle direction are referred to as second viewing angle directions. A parallax barrier is generated on the surface layer of the display unit 18 so that the original image is viewed from the first viewing angle direction and the processed image is viewed from the second viewing angle direction. Therefore, the user who views the display unit 18 from substantially the front can view the original image, and the third party who can view from both the left and right sides other than the front can view the processed image. It becomes like this.

  FIGS. 5B and 5C are diagrams specifically illustrating the original image and the processed image. That is, in the example shown in the figure, the image located substantially in front of the display unit 18 is the original image, and the images located on the left and right sides are the processed images. FIG. 5 (2) shows an image obtained by deleting a specific object (a person such as a family member) from the original image as a processed image obtained by processing the original image (an image obtained by photographing two persons). FIG. 5 (3) shows an image obtained by mosaicing a specific object (telephone number or address character string) in the original image (an image including an emergency contact address and an address).

  Next, the operation concept of the mobile phone 1 in the first embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. Further, it is possible to sequentially execute the operation according to the above-described program code transmitted via a transmission medium such as a network. The same applies to other embodiments described later. In addition to the recording medium, an operation peculiar to the present embodiment can be executed using a program / data supplied externally via a transmission medium.

FIG. 6 is a main flowchart showing an outline of the overall operation on the mobile phone 1 side which is started when the power is turned on.
First, when a power-on operation for turning on the power is performed (YES in Step A1), the central control unit 11 starts power supply and executes a power-on process for initializing a predetermined memory and the like, A standby process is performed in which a standby image is read and displayed, or a location registration is performed by communicating with the base station 2A (step A2). In this state, it is checked whether a setting operation has been performed (step A3), whether an image acquisition operation has been performed (step A5), whether an occurrence of an image display instruction has been detected (step A7), It is checked whether an incoming call has been detected (step A9), whether a power-off operation has been performed (step A11), and whether other operations have been performed (step A13).

  If a setting operation is performed to set arbitrary information (YES in step A3), a setting process corresponding to the operation is performed (step A4). For example, as the setting process for the object storage unit M4, a process is performed in which an image or a telephone number of a user who desires concealment is specified as an object to be processed and set in the object storage unit M4. When such setting processing ends, the process returns to step A3 described above. Further, when an image acquisition operation is performed, that is, when an image acquisition operation such as a download operation instructing image download or a shooting operation instructing shooting is performed (YES in step A5), an image acquisition process is performed. After that (step A6), the process returns to step A3 described above. This image acquisition process is a process of storing an image acquired by downloading or shooting in the image storage unit M3.

FIG. 7 is a flowchart for explaining the image acquisition process (step A6 in FIG. 6) in detail.
First, the central control unit 11 determines whether the image acquisition operation for instructing the start of the image acquisition process is a special shooting operation (step B1), a normal shooting operation (step B6), or a download operation. Or whether it is due to other operations (step B9). If the image acquisition operation is a special shooting operation (YES in step B1), the special shooting function (continuous shooting function) of the imaging unit 17 is activated to perform a plurality of continuous shootings within a predetermined time. (Steps B2, B3).

  That is, for example, after photographing an image (image A) including a certain subject (for example, a specific subject such as a family member who wants to keep secret) (step B2), the subject itself is moved out of the photographing range. Alternatively, the shooting range is moved so that the subject is not included in the shooting range, and an image (image B) not including the specific subject is shot (step B3). Then, the first captured image (image including a specific subject) A is stored as an “original image” in the image storage unit M3 (step B4), and the next captured image (image not including the specific subject) ) B is stored as “processed image” in the image storage unit M3 (step B5).

  If the image acquisition operation is a normal shooting operation (YES in step B6), after the normal image shooting that is not the special shooting as described above is performed (step B7), the shot image is displayed. It is stored in the image storage unit M3 as “original image” (step B8). If the image acquisition operation is a download operation (YES in step B9), an image (moving image or still image) is downloaded and received from the image distribution device 4 (step B10), and this image is set as the “original image”. The image is stored in the image storage unit M3 (step B8). Further, if the image acquisition operation is based on other operations other than the above-described shooting operation and download operation (NO in step B9), for example, if the operation is a copy operation instructing image copying from an external recording medium, external After executing image acquisition processing corresponding to the operation, such as acquiring an image copy from the storage medium (step B11), the image storage unit M3 stores the image as an “original image” (step B8).

  When such an image acquisition process (step A6 in FIG. 6) ends, the process returns to step A3 in FIG. Here, whether the generation of an image display instruction has been detected (step A7), that is, switching for displaying a plurality of images one after another at predetermined time intervals when an image display is instructed by a user operation or as in a slide show When the timing is detected, image display processing is performed (step A8), and then the process returns to step A3 described above. In this image display process, by causing the display unit 18 to generate a parallax barrier on the surface, the original image is viewed from the first viewing angle direction and the processed image is viewed from the second viewing angle direction. By instructing the execution of the control process (individual browsing process) or erasing the parallax barrier of the display unit 18, the original image can be obtained from both the first viewing angle direction and the second viewing angle direction. Instructing the execution of a process (common browsing process) to be controlled so as to be visually recognized.

8 and 9 are flowcharts for explaining the image display process (step A8 in FIG. 6) in detail.
First, the central control unit 11 determines whether an image display instruction is generated by a television program viewing operation (step C1 in FIG. 8) or a moving image streaming viewing operation. Whether it is due to the display operation of the image stored in M3 or the display switching (automatic display) to the next image is checked (step C18 in FIG. 9).

  If the operation is based on a TV program viewing operation (YES in step C1 in FIG. 8), the TV function is activated and a reception operation for receiving an image (TV program) from the TV broadcast receiving unit 16 is started ( Step C2) A process of displaying an image (television program) is performed, and a process corresponding to the above-described image acquisition process is also performed. First, it is checked whether the processed image is also transmitted, that is, whether multi-organized broadcasting is being performed (step C3). That is, if the TV image of the currently received program is the first image, a TV image different from the first image is broadcast as another image (processed image) in another program within the current channel frame, In other words, it is determined whether a program that does not include a specific object (for example, a miserable video portion) is broadcast, and based on the determination result, execution of the individual browsing process described above is instructed, Instructing execution of browsing processing. If such multi-organization broadcasting is being performed, that is, if a processed image (video of a TV program) that does not include a specific object is also transmitted (YES in step C3), first, In preparation for executing the individual browsing process described above, after receiving the processed image (step C4), the first image is temporarily stored in the various information temporary storage unit M2 as an “original image” (step S4). C5) Further, the second image (processed image) described above is temporarily stored in the various information temporary storage unit M2 (step C6).

  Then, the central control unit 11 drives the parallax barrier control unit 19 so that the first image (original image) is viewed from both the left and right sides other than the front when viewed from a substantially front side of the display unit 18. After the parallax barrier is generated on the surface layer of the display unit 18 so that the second image (processed image) can be viewed from the viewing angle direction in this case (step C7), the first image (original image) and the first image Two images (processed images) are simultaneously displayed on the display unit 18 (step C8). As a result, as shown in FIG. 5, the user can see the original image, and the third party can see the processed image. Thereafter, the flow of FIGS. 8 and 9 is exited.

  On the other hand, when the multi-organization broadcast as described above is not performed, that is, when the processed image is not transmitted (NO in step C3), the first image is further set as the “original image”. After being temporarily stored in the various information temporary storage unit M2 (step C9), each object included in the image is extracted by analyzing the original image (step C10). And each object memorize | stored in the object memory | storage part M4 is read (step C11), and any object is included in the original image by comparing the analysis result of the above-mentioned original image with each read object. (Step C12).

  That is, the central control unit 11 determines whether a specific object (for example, a miserable video part) is included in the received video (original image) of the television program, and based on the determination result, the above-described determination is made. The execution of the individual browsing process is instructed, or the execution of the above-described common browsing process is instructed. If no object is included in the original image (NO in step C12), the process proceeds to the next step C16 to execute the above-described common browsing process, and a parallax barrier is generated in the display unit 18. Then, after deleting it, the original image is displayed on the display unit 18 (step C17). Thereafter, the flow of FIGS. 8 and 9 is exited.

  If a specific object is included in the video (original image) of the television program (YES in step C12), first, in preparation for executing the above-described individual browsing process, the process proceeds to step C13 and is included in the original image. After reading the “processing content” corresponding to the object being processed, a processing image corresponding to this “processing content” is executed to obtain a processed image (step C14). When the image distribution device 4 performs processing on the original image (television video), the processed image is received and acquired from the image distribution device 4 or the preprocessed processed image is distributed. You may make it receive and acquire from the apparatus 4. FIG. Then, after the processed image acquired as described above is temporarily stored in the various information temporary storage unit M2 (step C15), the parallax barrier control unit 19 is driven, and the parallax barrier is formed on the surface layer of the display unit 18. After the generation (step C7), the first image (original image) and the second image (processed image) are simultaneously displayed on the display unit 18 (step C8).

  On the other hand, if the image display instruction is generated by a video streaming viewing operation (YES in step C18 in FIG. 9), the image (moving image) distributed from the image distribution device 4 is received as the original image (first image). After starting the receiving operation (step C19), the processing for displaying this image is performed, and the processing corresponding to the above-described image acquisition processing is also performed. First, it is checked whether a second image (processed image) different from the first image is distributed from the image distribution device 4 (step C20). That is, it is determined whether an image that does not include a specific object (for example, a miserable video portion) is distributed as the second image (processed image), and based on the determination result, the above-described individual browsing process is performed. Execution is instructed or execution of the above-described common browsing process is instructed.

  If the second image (processed image) has not been distributed (NO in step C20), the process proceeds to step C9 in FIG. 8, and then the above-described operation is performed to analyze the original image and identify it. It is determined whether or not the object is included, and the above-described individual browsing process is executed according to the determination result, or the above-described common browsing process is executed. If the second image (processed image) has been distributed (YES in step C20 in FIG. 9), after receiving the second image (processed image) (step C21), the step in FIG. Moving to C5, the original image and the processed image are temporarily stored (steps C5 and C6). And in order to perform the above-mentioned individual browsing process, after moving to Step C7 and generating a parallax barrier on the surface layer of the display unit 18, the first image (original image) and the second image (processed image) are displayed. Displayed on the display unit 18 at the same time (step C8).

  If the generation of the image display instruction is due to other factors (NO in step C18 in FIG. 9), for example, a display operation is performed on an image (captured image, copy image, etc.) stored in the image storage unit M3. If an automatic display of an image stored in the image storage unit M3 is instructed, the “original image” of the image instructed to be displayed is read from the image storage unit M3 (step C22). It is checked whether or not the “processed image” is stored in the image storage unit M3 corresponding to the “original image” (step C23). That is, it is determined whether an image that does not include a specific object (for example, a subject such as a family member) is stored as the second image (processed image), and the above-described individual browsing process is executed based on the determination result. Or instructing the execution of the common browsing process described above.

  If the “processed image” is not stored (NO in step C23), the process proceeds to step C9 in FIG. 8, and the above-described operation is performed to analyze the original image and a specific object is included therein. It is determined whether or not it is included, and the individual browsing process described above is executed according to the determination result, or the common browsing process described above is executed. If the “processed image” is stored in the image storage unit M3 (YES in step C23), after reading this “processed image” (step C24), the process proceeds to step C5 in FIG. Thereafter, the above-described operation is performed, and thereafter, the original image and the processed image are temporarily stored (steps C5 and C6). And in order to perform the above-mentioned individual browsing process, after moving to Step C7 and generating a parallax barrier on the surface layer of the display unit 18, the first image (original image) and the second image (processed image) are displayed. Displayed on the display unit 18 at the same time (step C8).

  On the other hand, when an incoming call is detected (YES in step A9 in FIG. 6), call processing is performed according to the response operation (step A10), and then the process returns to step A3 described above. When a power-off operation is detected (YES in step A11), after the power-off process is performed (step A12), this flow ends. However, when other operations such as a calling operation are performed (step A12) After a transmission process is performed as a process corresponding to the operation (step A14), the process returns to the above-described step A3.

  As described above, in this embodiment, the central control unit 11 allows the same image to be viewed from a plurality of viewing angle directions based on whether or not a specific object is included in the image displayed on the display unit 18. Since it is controlled so that different images are visually recognized, there is no need to require special operation to show the same content to multiple people or to show different images to some people It can be controlled appropriately. Thus, for example, when viewing images with colleagues in the company, you can prevent your colleagues from seeing only certain objects, such as family images or phone numbers, When viewing an image on the Internet, even if someone looks into it, it is possible to hide only a specific object such as a family image or a telephone number.

  When a specific object is included in the image displayed on the display unit 18, control is performed so that different images are visually recognized from a plurality of viewing angle directions. For example, from a certain viewing angle direction, It is possible to control so that an image that you do not want to be viewed by a third party can be viewed, and from the other viewing angle direction, control can be performed so that only images that have no problem even if viewed by a third party are viewed. can do.

  Since the image obtained by performing the processing on the specific object is acquired as the second image, the acquired second image can be simultaneously displayed on the display unit 8 together with the first image. Makes it possible to visually recognize an image including a specific object and to visually recognize an image obtained by processing the specific object from another viewing angle direction.

  An image including a specific object is set as a first image, and the specific object in the first image is processed to obtain an image obtained by processing the specific object as a second image. Therefore, an image different from the first image can be obtained based on the first image.

  Since an image in which a specific object has been processed is acquired from the external image distribution device 4, an image that has been processed can be easily obtained.

  As long as a specific object is not included in the image, it is controlled so that the image can be viewed from a plurality of viewing angle directions. It becomes.

  Since it is determined whether or not a specific object is included in the image captured by the imaging unit 17, the same image is viewed from a plurality of viewing angle directions based on the captured image. Control whether separate images are visible

  The imaging unit 17 captures an image including a specific object and an image not including the object, and causes the display unit 8 to simultaneously display a captured image including the specific object and a captured image not including the specific object. As a result, it is possible to control a captured image including a specific object from a certain viewing angle direction, and a captured image not including the specific object is viewed from other viewing angle directions. Can be controlled.

  When a specific object is included in an image to be displayed on the display unit 18, control is performed so that the image is visually recognized from a certain viewing angle direction, and an image after processing on the object is viewed from another viewing angle direction. Since control is performed so that the user can visually recognize the images, different images can be shown to a plurality of people, and peeping can be appropriately handled.

  In this case, when the specific object is not included, the display unit 8 is controlled so that the image is viewed from both the first viewing angle direction and the second viewing angle direction. If it is not included, the image can be displayed without problems even if viewed by a third party.

(Second Embodiment)
Hereinafter, a second embodiment of the present invention will be described with reference to FIGS.
In the first embodiment described above, the same image is viewed from a plurality of viewing angle directions based on whether or not a specific object is included in the image to be displayed on the display unit 18 or separately. In the second embodiment, based on whether or not the image displayed on the display unit 18 is associated with a different image, the second image is displayed. Whether the same image is viewed from a plurality of viewing angle directions or whether different images are viewed is controlled. Here, in the two embodiments, the same or the same name is denoted by the same reference numeral, the description thereof will be omitted, and the following description will focus on the features of the second embodiment. .

  In the second embodiment as well, since the overall operation on the mobile phone 1 side that is started when the power is turned on is the same as that in the flowchart of FIG. 6, the description thereof is omitted, but the image acquisition process (FIG. 6) is omitted. Step A6) is executed in accordance with the flowchart of FIG. 10 in place of FIG. 7 described above, and the image display process (Step A8 in FIG. 6) is executed in accordance with the flowchart of FIG. 11 in place of FIG. 8 and FIG. Yes.

FIG. 10 is a flowchart for explaining in detail the image acquisition process (step A6 in FIG. 6) in the second embodiment.
First, the central control unit 11 determines whether the image acquisition operation instructing the start of the image acquisition process is a special shooting operation (step D1), a normal shooting operation (step D6), or a download operation. Or whether it is due to other operations (step D15). If the image acquisition operation is a special shooting operation (YES in step D1), the special continuous shooting function of the imaging unit 17 is activated within a predetermined time in the same manner as steps B2 to B5 in FIG. The image A including the specific object and the image B not including the specific object are acquired by performing the continuous shooting multiple times (steps D2 and D3). Then, the first photographed image A is stored as “original image” in the image storage unit M3 (step D4), and the next photographed image B is stored as “processed image” in the image storage unit M3. (Step D5).

  If the image acquisition operation is based on a normal shooting operation (YES in step D6), after the normal image shooting is performed (step D7), the captured image is set as an “original image”. It is stored in M3 (step D8). Then, by analyzing the original image, each object included in the original image is extracted (step D9), and each object stored in the object storage unit M4 is read (step D10). By comparing the analysis result of the original image and each read object, it is checked whether any object is included in the original image (step D11). Here, if none of the objects is included (NO in step D11), the flow of FIG. 10 is exited.

  If any object is included in the original image (YES in step D11), the “processing contents” corresponding to the object included in the original image is read (step D12), and then “ The processed image is acquired by executing the processing according to “processing content” (step D13). The image distribution apparatus 4 executes image processing on the original image and receives the processed image from the image distribution apparatus 4 or receives a preprocessed processed image from the image distribution apparatus 4. You may make it acquire. Then, after the processed image acquired as described above is stored in the image storage unit M3 in association with the “original image” (step D14), the process goes out of the flow of FIG.

  If the image acquisition operation is a download operation (YES in step D15), an image (moving image or still image) is downloaded and received from the image distribution device 4 (step D16), and this image is set as an “original image”. After storing the image in the image storage unit M3 (step D8), the process proceeds to step D9 where the above-described image analysis is performed, and then the above-described operation is performed. Further, if the image acquisition operation is based on other operations other than the shooting operation and the download operation (NO in step D15), for example, if the copy operation is an instruction to copy an image from an external recording medium, the external storage medium Then, an image acquisition process corresponding to the operation is executed (step D17). Then, after the acquired image is stored as “original image” in the image storage unit M3 (step D8), the process proceeds to step D9 where the above-described image analysis is performed, and the above-described operation is performed.

FIG. 11 is a flowchart for explaining in detail the image display process (step A8 in FIG. 6) in the second embodiment.
First, the central control unit 11 instructs the automatic display of an image stored in the image storage unit M3 when a display operation is performed on an image (captured image, copy image, etc.) stored in the image storage unit M3. In this case, the “original image” of the image instructed to be displayed is read from the image storage unit M3 (step E1), and this “original image” is temporarily stored in the various information temporary storage unit M2 (step E2). Then, it is checked whether the “processed image” is stored in the image storage unit M3 corresponding to the “original image” (step E3). That is, it is determined whether or not an image that does not include a specific object (for example, a subject such as a family member) is stored as a processed image in the image storage unit M3. The execution of the individual browsing process is instructed, or the execution of the above-described common browsing process is instructed. If the “processed image” is not stored (NO in step E3), the process proceeds to the next step E8 to execute the above-described common browsing process, and a parallax barrier is generated on the display unit 18. If so, after deleting it, the original image is displayed on the display unit 18 (step E9). Thereafter, the flow of FIG. 11 is exited.

  If “processed image” corresponding to “original image” is stored in the image storage unit M3 (YES in step E3), the “processed image” is prepared as a preparation for executing the individual browsing process described above. After the “image” is read (step E4), the processed image is temporarily stored in the various information temporary storage unit M2 (step E5). Then, the parallax barrier control unit 19 is driven to generate a parallax barrier on the surface layer of the display unit 18 (step E6), and then the original image and the processed image are simultaneously displayed on the display unit 18 (step E7). Thereafter, the flow of FIG. 11 is exited.

  As described above, in the second embodiment, based on whether an image to be displayed on the display unit 18 is associated with a different image, the same image is viewed from a plurality of viewing angle directions. Or whether different images are visible, requires special operations to show multiple people the same content or some people to show different images It can be appropriately controlled without any problems, and is highly practical.

  Based on whether or not an image including a specific captured object is associated with an image that does not include a specific captured object, the same image can be viewed from a plurality of viewing angle directions, or separately. For example, as a special shooting function, after shooting an image containing a specific object, the specific object can be moved out of the shooting range. When the mobile phone has a shooting function of shooting an image that does not include the specific object, the image that includes the specific object and the image that does not include the specific object captured by the shooting function are viewed from different viewing angle directions. It can be visually recognized.

  In each of the above-described embodiments, the image displayed on the display unit 18 is not limited to a still image, a moving image, and a television program, but may be any type of image displayed on the display unit 18 such as an image including text. May be. The object is not limited to a person and a character string, and may be an arbitrary object displayed on the display unit 18 such as a part of a human body or a building.

  In each of the embodiments described above, erasure, mosaic, and replacement are shown as the processing content, but the processing content is not limited to this, and may be any processing content for a specific object. Moreover, in each embodiment mentioned above, although the processed image was taken as one, two or more may be sufficient. Further, the original image and two or more processed images are displayed on the display unit 18 at the same time, and control is performed so that the original image is visually recognized from a certain viewing angle direction, and from the other viewing angle direction, the first image is displayed. The processed image may be controlled so that the second processed image is visually recognized from another viewing angle direction.

  In each embodiment described above, control is performed so that the original image is visually recognized from the viewing angle direction substantially in front of the display unit 18, and the processed image is visually recognized from other viewing angle directions. However, the present invention is not limited to this, so that the original image can be viewed from any viewing angle direction, and the processed image can be viewed from any other viewing angle direction. May be.

  In addition, the terminal device is not limited to a mobile phone, and may be any terminal device such as a personal computer, a PDA, a digital camera, or a music player. Furthermore, it is not limited to a folding type terminal device, but may be an arbitrary housing structure such as a straight type, a slide type, or a spin top type.

  Further, the “device” and “machine” shown in each of the above-described embodiments may be separated into a plurality of housings by function, and are not limited to a single housing. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

DESCRIPTION OF SYMBOLS 1 Mobile phone 2 Wireless communication network 3 Internet 4 Image distribution apparatus 11 Central control part 13 Storage part 14 Wireless communication part 16 Television broadcast receiving part 17 Imaging part 18 Display part 19 Parallax barrier control part 20 Operation part M1 Program storage part M2 Various information Temporary storage unit M3 Image storage unit M4 Object storage unit

Claims (15)

A terminal device for controlling the viewing angle direction of the display unit,
The first image is displayed on the display unit, and the display unit is configured so that the first image is viewed from both the first viewing angle direction and a second viewing angle direction different from the first viewing angle direction. First control means for controlling;
The first image and a second image different from the first image are simultaneously displayed on the display unit, and the display unit is controlled so that the first image is viewed from the first viewing angle direction, and the second field of view is controlled. Second control means for controlling the display unit so that the second image is viewed from an angular direction;
Determining means for determining whether or not a specific object is included in an image to be displayed on the display unit;
Instruction means for instructing execution of control by one of the first control means and the second control means based on the determination result of the determination means;
A terminal device comprising: The instruction means instructs execution of control by the second control means when it is determined that the specific object is included by the determination means;
The terminal device according to claim 1, which is configured as described above. The image processing apparatus further includes an acquisition unit that acquires an image on which the specific object has been processed,
The second control means controls the image to be displayed on the display unit as the first image and the image acquired by the acquisition means as the second image to be displayed on the display unit at the same time.
The terminal device according to claim 2, which is configured as described above. The acquisition means uses the image including the specific object as the first image, and performs processing on the first image, thereby processing the image processed on the specific object as the second image. get,
The terminal device according to claim 3, which is configured as described above. The acquisition unit acquires an image obtained by processing the specific object from the outside.
The terminal device according to claim 3, which is configured as described above. The instruction means instructs the execution of control by the first control means when it is determined that the specific object is not included by the determination means;
The terminal device according to claim 1, which is configured as described above. It further comprises a photographing means for photographing an image,
The determining means determines whether or not a specific object is included in the image photographed by the photographing means;
The terminal device according to claim 1, which is configured as described above. A photographing unit for photographing an image including the specific object and an image not including the specific object;
The second control unit displays the image including the specific object photographed by the photographing unit as the first image, and the image not including the specific object photographed by the photographing unit as the second image. Control to display on the screen at the same time,
The terminal device according to claim 1, which is configured as described above. A terminal device for controlling the viewing angle direction of the display unit,
Determining means for determining whether or not a specific object is included in an image to be displayed on the display unit;
An acquisition unit that acquires an image obtained by performing a processing on the specific object when the determination unit determines that the specific object is included;
The display unit is configured to display the image to be displayed on the display unit and the image acquired by the acquisition unit simultaneously on the display unit, and to display the image to be displayed on the display unit from the first viewing angle direction. First control means for controlling and controlling the display unit so that the acquired image is viewed from a second viewing angle direction different from the first viewing angle direction;
A terminal device comprising: When it is determined by the determining means that a specific object is not included, an image to be displayed on the display unit is displayed on the display unit, and an image to be displayed on the display unit is the first viewing angle direction and the first viewing angle direction. A second control means for controlling the display unit so as to be viewed from both a second viewing angle direction different from the first viewing angle direction;
The terminal device according to claim 9, which is configured as described above. A terminal device for controlling the viewing angle direction of the display unit,
The first image is displayed on the display unit, and the display unit is configured so that the first image is viewed from both the first viewing angle direction and a second viewing angle direction different from the first viewing angle direction. First control means for controlling;
The first image and a second image different from the first image are simultaneously displayed on the display unit, and the display unit is controlled so that the first image is viewed from the first viewing angle direction, and the second field of view is controlled. Second control means for controlling the display unit so that the second image is viewed from an angular direction;
Determining means for determining whether an image to be displayed on the display unit is associated with an image different from the image;
Instruction means for instructing execution of control by one of the first control means and the second control means based on the determination result of the determination means;
A terminal device comprising: Photographing means for photographing the first image including the specific object and the second image not including the specific object;
Storage control means for associating the first image including the specific object imaged by the imaging means and the second image not including the specific object in the storage unit;
Further comprising
The determination means determines whether or not a first image including a specific object stored in the storage unit is associated with a second image not including a specific object.
The terminal device according to claim 11, which is configured as described above. Against the computer,
The first image is displayed on the display unit, and the display unit is controlled so that the first image is viewed from both the first viewing angle direction and a second viewing angle direction different from the first viewing angle direction. Function to
The first image and a second image different from the first image are simultaneously displayed on the display unit, and the display unit is controlled so that the first image is viewed from the first viewing angle direction, and the second field of view is controlled. A function of controlling the display unit so that the second image is visually recognized from an angular direction;
A function of determining whether or not a specific object is included in an image to be displayed on the display unit;
Based on the determination result, execution of control such that the first image is visually recognized from both the first viewing angle direction and the second viewing angle direction is instructed, and the first viewing angle direction from the first viewing angle direction. A function of instructing execution of control such that an image is visually recognized and the second image is visually recognized from the second viewing angle direction;
A program to realize Against the computer,
A function of determining whether or not a specific object is included in an image to be displayed on the display unit;
When it is determined that the specific object is included, a function of obtaining an image obtained by performing processing on the specific object;
The image to be displayed on the display unit and the acquired image are simultaneously displayed on the display unit, and the display unit is controlled so that the image to be displayed on the display unit is visually recognized from the first viewing angle direction, A function of controlling the display unit so that the acquired image is viewed from a second viewing angle direction different from the first viewing angle direction;
A program to realize Against the computer,
The first image is displayed on the display unit, and the display unit is controlled so that the first image is viewed from both the first viewing angle direction and a second viewing angle direction different from the first viewing angle direction. Function to
The first image and a second image different from the first image are simultaneously displayed on the display unit, and the display unit is controlled so that the first image is viewed from the first viewing angle direction, and the second field of view is controlled. A function of controlling the display unit so that the second image is visually recognized from an angular direction;
A function of determining whether or not the first image to be displayed on the display unit is associated with an image different from the image;
Based on the determination result, execution of control such that the first image is visually recognized from both the first viewing angle direction and the second viewing angle direction is instructed, and the first viewing angle direction from the first viewing angle direction. A function of instructing execution of control such that an image is visually recognized and the second image is visually recognized from the second viewing angle direction;
A program to realize

Images