DE112013007672T5 - Display controller and display control method - Google Patents

Abstract

An object of the present invention is to provide a technique for preventing a user from unintentionally serving an icon on the other side. A navigation apparatus (1) controls a split-view display (2) capable of displaying a left image visible from a left seat direction and a right image visible from a right seat direction is, on a screen. The navigation apparatus (1) includes a controller (14) which displays an area corresponding to a left icon recognizable in the right image when it is determined based on an output signal from a touch panel (3) provided on the split-view screen. Display (2) that an action has been performed or performed immediately before operating the left icon.

Description

Technical area

The present invention relates to a display control device and a display control method that control a display.

background

As a multi-image display device capable of displaying on a screen different images depending on the viewing direction of the screen, a split-view type display device (also referred to as a multi-view or dual-view (registered trademark)) is known, and in Recently, in various fields, it has been proposed to apply a split-view display device. For example, it is suggested that a split-view display device and a touch panel provided on a related screen be applied in a car navigation device. By using such a navigation device, it becomes possible to display images having a different content, viewed from a driver's seat side direction and another front passenger's seat side direction, on a screen, and operations on respective icons displayed in the images from the touch panel to recieve.

However, in such a navigation apparatus as described above, there is a case where a position of an icon in one image displayed in the direction of the driver seat side and a position of an icon in another image displayed in the direction of the front passenger seat side on the screen Split-view display device overlap each other. Even if, in such a case, operation on the icon is received from the touch panel, it can not be judged disadvantageously whether the operation is to be performed on the icon in the image displayed in the driver's seat side direction or on the icon in the image displayed in the direction of the front passenger seat side.

Then, in order to prevent the position of the icon in the image displayed in the driver's seat side direction from overlapping with the position of the icon in the image displayed in the front passenger's seat side direction, a technique for arranging is made in Patent Document 1 proposed these icons at different positions.

Prior-art documents

• Patent Document 1: WO 2006/100904

Summary of the invention

Problems to be solved by the invention

However, when a passenger seated in the front passenger seat performs operation over a relatively wide range, such as a drag operation or the like, there is a problem that the passenger unintentionally causes operation on the icon in the image displayed in the direction of the driver's seat side.

The present invention is to solve the above problem, and it is an object of the present invention to provide a technique that prevents a user from unintentionally serving an icon on the other side.

Means of solving the problems

The present invention is provided for a display control device that controls a display capable of displaying a first image that is visible from a first direction but not from a second direction, and a second image that is visible from the second direction is not from the first direction, on a screen. According to one aspect of the present invention, the display control device includes a controller that causes the display recognizable in the second image to display a first area corresponding to a display area of a first icon in the first image when it is determined that a first action has been performed or performed in advance as an action immediately before operating the first icon, based on an output from an input unit that performs an operation on the first image to perform a function of an application and another operation on the second image receive a function of another application evenly.

Effects of the invention

According to the aspect of the present invention, when it is determined that the first action has been performed or predefined as an action immediately before operating the first icon in the first image, the first area corresponding to the display area of the first icon becomes recognizable in the second picture. It is therefore possible to prevent a user who can see the second image unintentionally serving the first icon.

These and other objects, features, aspects and advantages of the present invention will become more apparent from the following detailed description of the The present invention will be more apparent when viewed in conjunction with the accompanying drawings.

Brief description of the drawings

1 FIG. 10 is a block diagram illustrating an exemplary configuration of a navigation device according to a first preferred embodiment; FIG.

2 Fig. 15 is a cross section illustrating an exemplary structure of a split-view display according to the first preferred embodiment;

3 Fig. 15 is a view showing an example of a display of the split-view display according to the first preferred embodiment;

4 FIG. 12 is a cross-sectional view illustrating another exemplary structure of the split-view display according to the first preferred embodiment; FIG.

5A and 5B Fig. 10 is views for illustrating another example of a display of the split-view display according to the first preferred embodiment;

6 Fig. 15 is a view showing an example of detection of a display means by a touch panel;

7 FIG. 10 is a flowchart for illustrating an operation of the navigation apparatus according to the first preferred embodiment; FIG.

8A and 8B FIG. 16 is views for illustrating an example of display of a left image and a right image in the navigation apparatus according to the first preferred embodiment; FIG.

9A and 9B Figs. 10 are views for illustrating another example of display of the left image and the right image in the navigation apparatus according to the first preferred embodiment, respectively;

10A and 10B Fig. 10 is views for illustrating an example of display of the left picture and the right picture in the navigation apparatus according to a first variation of the first preferred embodiment;

11A and 11B Fig. 10 is views for illustrating another example of display of the left image and the right image in the navigation apparatus according to the first variation of the first preferred embodiment;

12A and 12B Figs. 10 are views for illustrating another other example of display of the left image and the right image in the navigation apparatus according to the first variation of the first preferred embodiment;

13A and 13B Figs. 10 are views for illustrating another example of display of the left image and the right image in the navigation apparatus according to the first variation of the first preferred embodiment;

14 FIG. 10 is a flow chart showing an operation of the navigation apparatus according to a second variation of the first preferred embodiment; FIG.

15 FIG. 10 is a flow chart illustrating an operation of the navigation apparatus according to a second preferred embodiment; FIG.

16A and 16B Figs. 10 are views for illustrating an example of display of the left image and the right image in the navigation apparatus according to the second preferred embodiment, respectively;

17 FIG. 10 is a flow chart illustrating an operation of the navigation apparatus according to a third preferred embodiment; FIG.

18A and 18B FIG. 16 is views for illustrating an example of display of the left image and the right image in the navigation device according to the third preferred embodiment; FIG.

19A and 19B Figs. 10 are views for illustrating another example of display of the left image and the right image in the navigation apparatus according to the third preferred embodiment, respectively;

20A and 20B Figs. 10 are views for illustrating another another example of display of the left image and the right image in the navigation apparatus according to the third preferred embodiment, respectively;

21 FIG. 14 is a view illustrating an example of a display of the right image in the navigation apparatus according to a fourth preferred embodiment; FIG. and

22 FIG. 14 is a view illustrating another example of a display of the right image in the navigation apparatus according to the fourth preferred embodiment. FIG.

Description of embodiments

First preferred embodiment

The first preferred embodiment of the present invention will be explained by considering an exemplary case where a display control apparatus according to the present invention is applied to a navigation apparatus that can be mounted in a vehicle. 1 FIG. 10 is a block diagram illustrating an exemplary configuration of the navigation device. FIG. In the following description, a vehicle on which the in 1 shown navigation device 1 is attached, referred to as a "self-vehicle".

The navigation device 1 includes a split view display 2 , a touchpad 3 , an operation input processor 9 , an interface unit 10 , a store 11 , a left-image generator 12 , a rights image generator 13 and a controller 14 which generally controls these training elements.

The interface unit 10 is between the controller 14 and a wireless communication unit 4 , a speaker 5 , a DVD (Digital Versatile Disk) player 6 , air conditioning 7 and a vehicle LAN (Local Area Network) 8th connected. Between the controller 14 and the wireless communication unit 4 , the speaker 5 , the DVD player 6 , the air conditioning 7 and the vehicle LAN 8th Different information and different signals are bidirectionally through the interface unit 10 output. If it should be described that the item on one side has information about the one on the other side via the interface unit 10 In the following description, for the sake of simplicity, it will be described instead that the element on one side outputs information to that on the other side. The control 14 gives control information to the wireless communication unit 4 , the speaker 5 , the DVD player 6 , the air conditioner 7 and the vehicle LAN 8th to thereby control these training elements.

The split view display 2 is, for example, provided on a dashboard of the self-vehicle. The split view display 2 may include a first image (hereinafter referred to as a "left-side image" or a "left-side image") that is visible from a left-seat direction (a first direction) but is not visible from a right-seat direction, as well a second image (hereinafter referred to as an "image for right" or a "right image") that is visible from the direction of a right seat (a second direction) but is not visible from the direction of the left seat on a Show screen.

As explained later, the split view display shows 2 an icon (a first icon) in the left image, and an icon (a second icon) in the right image. The icon (the first icon) in the left image will hereinafter be referred to as an "icon for left" or a "left icon", and the icon (the second icon) in the right picture will be referred to as an "icon for right" or denotes a "right icon". In addition, although in the following description an example case is adopted in which the left seat is a driver's seat and the right seat is a front passenger seat, in another case where the left seat is the front passenger seat and the right seat the driver's seat is exchanged "left" and "right" in the following description.

For the split-view ad 2 For example, a space division display device is used. 2 is a schematic cross section of the display device. In the 2 shown display device 200 includes a display screen 201 and a parallax barrier 202 , In the display screen 201 are first pixels 201 which are used to display the left image, and second pixels 201b used to display the right image arranged alternately along a horizontal direction (left and right direction). The parallax barrier 202 transmits light of the first pixel 201 , but blocks light from the second pixel 201b with respect to the direction of the left seat, and transmits light of the second pixel 201b , but blocks light from the first pixel 201 concerning the direction of the right seat. By using this structure, a user can 101 who is sitting in the left seat, can not see the right image (visually recognize) but can see the left image and another user 101b sitting in the right seat can not see the left picture, but can see the right picture.

In the configuration in which the room partition display device 200 for the split-view ad 2 is applied, the left icon is visibly displayed when the parallax barrier 202 the light from a multitude of first pixels 201 transmitted in the direction of the left seat, and the right icon is visibly displayed when the parallax barrier 202 the light from a multitude of second pixels 201b transmitted in the direction of the right seat. An outer peripheral portion of a display area of the left icon therefore corresponds to some of the plurality of first pixels 201 used for displaying the left icon located at the outer peripheral portion and an outer peripheral portion of a display area of the right icon equals some of the multitude of second pixels 201b used to display the right icon located at the outer peripheral portion.

3 Fig. 16 is a view showing an example of a display of the space-division type split-view display 2 and shows the left picture and the right picture in a frame. For example, a WVGA (Wide VGA) display device has 800 dots in a transverse direction (x-axis) and 480 dots in a longitudinal direction (y-axis) in total. Although this depends on the performance of the display device, the space-divisional split-split display device shown in Figs 3 For example, the WVGA display device corresponding to the WVGA display device has as many as twice the number of pixels in the transverse direction in the WVGA display device in the transverse direction, and has, in other words, 1600 dots of first pixels 201 and second pixel 201b in the transversal direction and 480 dots first pixel 201 and second pixel 201b in the longitudinal direction altogether. However, for ease of illustration, explanation will be given here assuming that the split-view display device 13 is dots of first pixels 201 in the transversal direction and 4 dots first pixel 201 in the longitudinal direction, and also the same number of second pixels 201b and an icon with 4 dots of first pixels 201 or second pixel 201b in the transversal direction and a dot first pixel 201 or second pixel 201b is displayed in the longitudinal direction. A dot of deviation in the x-axis direction (left and right direction) in the icon as in FIG 3 is not recognizable from a normal viewing position by a human eye, and can be seen as being displayed at the same position.

In 3 For example, the outer peripheral portion (outer frame) of the left icon is shown by a dashed line, and this indicates that 4 first pixels 201 which are arranged in the horizontal direction can be used to display the left icon. In 3 moreover, the outer portion (outer frame) of the right icon is represented by a one-dot chain line, and this indicates that 4 second pixels 201b which are arranged in the horizontal direction can be used to display the right icon. The number of first pixels 201 used to display the left icon and the number of second pixels 201b Moreover, those used to display the right icon are not limited to four.

When in the configuration in which the room partition display device 200 for the split-view ad 2 is applied, at least one of the plurality of (4 in 3 ) first pixels 201 which are used to display the left icon, by some (in 3 , the second pixel 201b corresponding to the dot-and-dash line) of the plurality of (4, in 3 ) second pixels 201b In the following description, it will be explained that at least a part of the display area of the left icon, and at least a part of the display area of the right icon on the., are used to indicate the right icon included on the outer peripheral portion Shared view screen 2 overlap each other. Even if at least one of the plurality of (4 in 3 ) second pixels 201b which are used to display the right icon, by some (in 3 , the first pixels 201 corresponding to the dashed line) of the plurality of (4, in 3 ) first pixels 201 Further, it will be explained that at least a part of the display area of the left icon and at least a part of the display area of the right icon on the screen of the split icon are used to surround the display of the left icon located at the outer peripheral portion. View display overlap each other. On the other hand, if in this configuration, one of the second pixel 201b , used to display the right icon, and the first pixel 201 is used for displaying the left icon not included by the other pixels, it is explained that the display area of the left icon and the display area of the right icon on the screen of the split-view display 2 are separate from each other.

The above description was made on the configuration in which the room partition display device 200 for the split-view ad 2 was applied. However, this is just an example configuration. For the split-view ad 2 For example, a time division display device may be used. 4 is a schematic cross section of the display device. In the 4 shown display device 250 includes a display screen 251 and a parallax barrier 252 , The display screen 251 shows the left picture with pixels 251c in a first period and shows the right picture with pixels 251c in a second period. The parallax barrier 252 transmits light of the pixel 251c regarding the direction of the left seat, however, blocks light of the pixel 251c with respect to the direction of the right seat in the first period, and transmits light of the pixel 251c with respect to the direction of the right seat, however, blocks light of the pixel 251c with respect to the direction of the left seat in the second period. 4 shows the state in the first period.

By applying the structure described above, the user of the left seat can 101 can not see the right image, but can see the left image, and the user of the right seat 101b can not see the left image, but can see the right image. The eyes of the user of right seat 101b furthermore, do not receive the light of the pixel 251c from the Split View Ad 2 in the first period. However, since the first period is set very short, the user of the right seat 101b not realizing that his eyes are not receiving the light in the first period. Due to the afterimage effect of the light that the eyes receive in the second period, the user of the right seat recognizes 101b on the other hand, that the image displayed in the second period is also displayed in the first period. The user of the left picture 101 equally, it can not recognize that its eyes do not receive the light in the second period, and the user of the left seat 101 Because of the after-image effect of the light, it recognizes that the eyes are receiving in the first period, that the image displayed in the first period is also displayed in the second period.

In the configuration in which the time division display device 250 for the split-view ad 2 is applied, the left icon is visibly displayed in the first period when the parallax barrier 252 the light from a variety of pixels 251c transmitted in the direction of the left seat, and the right icon is visibly displayed in the second period when the parallax barrier 252 the light from the multitude of pixels 251c transmitted in the direction of the right seat. The outer peripheral portion of the display area of the left icon therefore corresponds to some of the plurality of pixels 251c which are used for displaying the left icon located at the outer peripheral portion, and the outer peripheral portion of the display area of the right icon correspond to some of the plurality of pixels 251c used to display the right icon located at the outer peripheral portion.

5A and 5B Fig. 10 are views for illustrating an example of a display of the time division-type split-view display 2 and shows the left picture and the right picture in a frame. For example, a WVGA display device has 800 dots in the transverse direction (x-axis) and 480 dots in the longitudinal direction (y-axis) in total, as explained above. Although this depends on the performance of the display device, the time division type split-split display device shown in Figs 5A and 5B corresponding to the WVGA display device, for example, 800 dots of pixels 251c in the transversal direction and 480 dots of pixels 251c in the longitudinal direction. However, for ease of illustration, explanation will be given here assuming that the split-view display device 13 is dots of pixels 251c in the transverse direction and 4 dots of pixels 251c in the longitudinal direction, and an icon becomes with 3 dots of pixels 251c in the transverse direction and 1 dot of pixels 251c in the longitudinal direction.

In 5A For example, the outer peripheral portion (outer frame) of the left icon that is displayed in the first period is represented by a broken line, and this indicates that three pixels 251c which are arranged in the horizontal direction can be used to display the left icon. In 5B For example, the outer peripheral portion (outer frame) of the right icon displayed in the second period is shown by a broken line, and this indicates that three pixels 251c , arranged in the horizontal direction, can be used to display the right icon. The number of pixels 251c used to display the left icon and the number of pixels 251c Moreover, those used to display the right icon are not limited to three, respectively.

When in the configuration in which the time division display device 250 for the split-view ad 2 is applied, at least one of the plurality of pixels 251c which are used to display the left icon in the first period with at least one of the plurality of pixels 251c In the following description, it will be explained that at least a part of the display area of the left icon and at least a part of the display area coincide with those used for displaying the right icon in the second period of the right icon on the screen of the split view display 2 overlap with each other. On the other hand, if it's not a pixel 251c On the other hand, it is explained that the display area of the left icon and the display of the right icon on the screen of the split one are explained as being used for displaying the left icon in the first period and also for displaying the right icon in the second display -view display 2 are separated from each other.

Although detailed configuration is not described, split view display 2 a combination type display device combining the space dividing type and the time dividing type may be applied. For example, if at least a portion of the pixels used to display the left icon are surrounded in the first period by some of the plurality of pixels used to display the right icon in the second period, those at the outer one peripheral portion, or when at least a part of the pixels used for displaying the right icon in the second period are surrounded by some of the plurality of pixels used for displaying the left icon in the first period are located at the outer peripheral portion, it is explained that at least a part of the display area of the left icon and at least a part of the display area of the right icon on the screen of the split-view display 2 overlap with each other. On the other hand, when one of the pixels used to display the left icon in the first period and the pixel used to display the right icon in the second period is not surrounded by the other pixels, it is described that the display area of the left icon and the display area of the right icon on the screen of the split view display 2 are separate from each other.

Further, a specific configuration of the display device using a split-view type is shown in FIG Japanese Patent Application Publication No. 2005-078080 . WO 2012/070444 and the like. Although not mentioned in the above explanation, in both the space dividing type and the time dividing type, the pixels are scanned in a very short period of time (for example, 1/30 (sec)).

Referring again to 1 is a detection surface of the touch panel 3 on the shared view screen 2 provided. The touchpad 3 (Input unit) uniformly receives an operation on the left image to perform a function of an application and another operation on the right image to perform a function of another application. As in 6 shown detects the touch pad 3 According to the first preferred embodiment, a three-dimensional position (X, Y, Z) including a position (X, Y) of a point on the detection surface at which the distance from a display means such as a user's finger (a driver or a user) Passenger seated in the front passenger seat) becomes shortest, and a distance Z between the display means and the detection surface (the point) as a position of the display means. If the distance Z between the display means (a finger 21 in 6 ) and the detection surface of the touch panel 3 Zero indicates that the display means (the finger 21 in 6 ) the detection surface of the touchpad 3 touched.

For such a touchpad 3 For example, an electrostatic touch panel is applied which detects the three-dimensional position of the display means (the three-dimensional position of the display means with respect to a reference point on the detection surface) based on the electrostatic capacitance generated between the detection surface and the display means. The touchpad 3 regularly detects the three-dimensional position of the display means, as explained above, and outputs a signal indicating the three-dimensional position to the operation input processor 9 out.

The wireless communication unit 4 performs communications with a server, such as a Dedicated Short Range Communication (DSRC) and a cellular telephone or the like. The wireless communication unit 4 gives information (for example, downloaded information) received from the server to the controller 14 out, and transmits information from the controller 14 is issued to the server. The wireless communication unit 4 In addition, it receives a radio broadcast and a television broadcast and gives information acquired from the broadcast to the controller 14 out.

The speaker (audio output unit) 5 Gives a language and sound based on one of the controls 14 output audio signal.

The DVD player 6 plays back an AV (audio-video) information recorded in a DVD and gives the AV information to the controller 14 out.

The air conditioner 7 adjusts the temperature and humidity within the self-vehicle through the control of the controller 14 ,

The vehicle LAN 8th performs communications with an electronic control unit (ECU), a global positioning system (GPS) device or the like of the self-vehicle. For example, the vehicle LAN indicates the speed of the self-vehicle detected by the ECU and the current position (for example, longitude and latitude) of the self-vehicle detected by the GPS device to the controller 14 out.

From the controller 14 is in the operation input processor 9 input an icon position information indicating the position of the icon displayed on the split view display 2 is shown. The operation input processor 9 determines whether or not an operation has been performed on the icon located on the touchpad 3 is displayed, in other words, on the split view display 2 based on the icon position information and an output signal (signal indicating the three-dimensional position of the display means) of the touch panel 3 , If here the output signal of the touchpad 3 indicates that the distance Z is zero and the operation input processor 9 determines that the position of the display means indicated by the output signal overlaps the display area of the left icon (the Display means is located within the left icon), the operation input processor determines 9 in that an operation has been performed on the left icon. If equally the output signal of the touchpad 3 indicates that the distance Z is zero and the operation input processor 9 determines that the position of the display means indicated by the output signal overlaps the display area of the right icon (the display means is located within the right icon), the operation input processor determines 9 in that an operation has been performed on the right icon. The operation input processor 9 then gives the determination result to the controller 14 out.

Therefore, although in the first preferred embodiment, a description was made on the assumption that the operation input processor 9 performs a process of determining whether or not the operation on the icon or the like displayed on the split-view display 2 is displayed, the determination process may be performed by the controller 14 be performed. Although the operation input processor 9 further separately from the touchpad 3 and the controller 14 in 1 is provided, this is just an example configuration. The operation input processor 9 can in the touchpad 3 be included as a function of the touchpad 3 , or may be in the controller 14 as a function of the controller 14 be included.

The memory 11 is a storage unit including, for example, a hard disk drive, a DVD and a drive unit therefor, a BD (Blue Ray Disc) and a drive unit therefor, a semiconductor memory or the like. The memory 11 stores in it a program that controls 14 needed in a business, as well as information provided by the controller 14 is used. The information provided by the controller 14 is used, for example, an application (application software), an image in which an icon is arranged, which is operated to perform a function of the application, a map information and the like. In the following description, the image (for example, a picture corresponding to FIG 8A or 8B ) in which an icon is arranged, which is operated to perform a function of the application, is referred to as an "icon layout picture". The "icon layout picture" also includes an image in which an icon is displayed in the map information.

The left image generator 12 generates an indication signal used to display the left image based on display information supplied by the controller 14 and outputs the indication signal to the split-view display 2 out. If the split view ad 2 the indication signal from the left image generator 12 receives, displays the split view display 2 the left image based on the indication signal.

The right-image generator 13 generates an indication signal used to display the right image based on display information provided by the controller 14 and outputs the indication signal to the split-view display 2 out. If the split view ad 2 the indication signal from the right-image generator 13 receives, displays the split view display 2 the right image based on the indication signal.

The indication signal generated by the left image generator 12 Here, pixel numbers assigned to the plurality of pixels used to display the left image are given in a respective order of, for example, (1, 1), (2, 1)..., (800, 1 ), (1, 2), ..., (800, 2), ..., (800, 480). The indication signal, by the right-image generator 13 Similarly, pixel numbers are also assigned to the plurality of pixels used to display the right image, each in an order of, for example, (1, 1), (1, 2) ..., ( 800, 480). For this reason, if the pixel number of at least one pixel used to display the left icon matches the pixel number of at least one pixel used to display the right icon, it corresponds to at least a part of the display area of the left Icons and at least part of the display area of the right icon on the screen of the split view display 2 overlap with each other. The coordinates (x, y) are here defined with the upper left side of the screen as (1, 1), and indicate a pixel position corresponding to the x, y coordinates where the x axis is positive in the right direction, and the y-axis in the downward direction is positive.

The control 14 is, for example, a CPU (central processing unit), and the CPU does this in the memory 11 stored program, thereby enabling various applications in the navigation device 1 perform and also the speaker 5 and the like in accordance with the performed application.

If the controller 14 performs an application for navigation, for example, based on the current position of the self-vehicle, the target based on the output signal from the touchpad 3 and the map information, seeks control 14 according to a route from the present position to the destination, and generates display information used to display guidance along the route, and an audio signal used to output the guidance with voice and sound. As a result of this operation For example, the above-described guidance is displayed as the left image or the right image, and the speech and sound for the above-described guidance are from the speaker 5 output.

If the controller 14 Further, an application for playing a DVD performs the control 14 For example, display information used for displaying the AV information from the DVD player 6 and an audio signal used to output the AV information with voice and sound. As a result of this operation, a video image stored in the DVD is displayed as the left image or the right image, and the speech and sound stored in the DVD are output from the speaker 5 output.

The control 14 Further, an icon arrangement image corresponding to one or more applications that can be performed on the side of a left image (which can be performed from the side of a left image) is acquired from the memory 11 and displays the detected icon arrangement image as the left image. With this operation, an icon on which an operation to perform a function of the application (s) is to be performed on the side of a left image on the split-view display 2 (as the left image). In the following description, the icon arrangement picture (for example, the picture corresponding to FIG 8A ), which may be displayed as the left image, is referred to as an "left-side icon layout picture" or a "left-side icon layout picture". The icon in the left icon layout picture displayed as the left picture is further the left icon described above.

The control 14 Similarly, an icon arrangement image corresponding to one or more applications that can be performed on the right image side (can be performed from the right image side) is acquired from the memory 11 and displays the detected icon layout image as the right image. With this operation, an icon on which to perform an operation for performing a function of the application (s) is displayed on the right-hand side of the split-view display 2 (as the right picture). In the following description, the icon arrangement picture (for example, the picture corresponding to FIG 8B ), which may be displayed as the right image, is referred to as a "right-side icon layout picture" or a "right-side icon layout picture". The icon in the right icon layout picture displayed as the right picture is further the right icon described above.

The above-described operation input processor 9 determined based on the output signal (the signal indicative of the three-dimensional position of the display means) from the touch panel 3 whether or not a first action previously defined as an action immediately before operating the left icon has been performed, and gives the determination result to the controller 14 out. The operation input processor 9 determines here that the action (first action) was performed immediately before an operation of the left icon when the operation input processor 9 determines that the distance Z caused by the output signal from the touchpad 3 is displayed, became greater than zero and not greater than a predetermined threshold ZL1 (for example, about 3 to 10cm), while the left icon is displayed, and otherwise determines the operation input processor 9 in that the action (first action) was not performed immediately prior to operating the left icon.

Then, as explained in detail below, the operation input processor 9 determined based on the output signal from the touch pad 3 in that the action has been performed or performed immediately before operation of the left icon causes the control 14 that the split-view ad 2 , recognizable in the right image, displays a first area (hereinafter referred to as "left icon corresponding area") corresponding to the display area of the left icon.

7 FIG. 10 is a flowchart for illustrating an operation of the navigation apparatus. FIG 1 according to the first preferred embodiment. The in 7 The operation shown is performed when the CPU is in memory 11 stored program executes. Referring to 7 hereinafter, the operation of the navigation device 1 explained.

First, when performing an operation used in step S1 to perform an initial operation, the controller performs 14 through the initial operation. The controller detects this as the initial operation 14 here from the store 11 the applications that are initially to be performed on the side of a left image and on the side of a right image and performs the applications.

In step S2, the controller detects 14 from the store 11 the left icon layout image corresponding to the application performed on the left image side, and detects the right icon layout image according to the application performed on the right image side.

In step S3, the controller shows 14 this detects the left icon layout picture as the left picture of the split view display 2 and the detected right icon layout picture as the right picture of the split view display 2 ,

The 8A and 8B FIG. 11 are views for illustrating an example of display of the left picture and the right picture in the navigation apparatus, respectively. FIG 1 (the split-view ad 2 ) according to the first preferred embodiment in step S3. In the left picture of 8A For example, if the left icon arrangement picture is displayed in which left icons L1, L2, L3, L4, L5 and L6 (hereinafter, these icons are sometimes collectively referred to as "left icons L1 to L6") are displayed. In the right picture of 8B For example, if the right icon arrangement picture is displayed in which right icons R1, R2, R3, R4 and R5 (hereinafter, these icons are sometimes collectively referred to as "right icons R1 to R5") are displayed.

Further, in the first preferred embodiment, a case where the display areas of the left icons L1 to L6 and the display areas of the right icons R1 to R5 are separated from each other on the screen of the split-view display will be explained 2 and in the third preferred embodiment, a case where these display areas are overlapped with each other on the screen of the split-view display will be explained 2 are arranged.

In step S4 of 7 determines the operation input processor 9 whether or not the action was performed immediately before an operation of the left icon (whether or not the distance Z became greater than zero and not greater than the threshold ZL1). If it is determined that the action has been performed immediately before an operation of the left icon, the process goes to step S5, and if it is not determined that the action has been performed, step S4 is performed again.

Further, if the display means is near the detection surface of the touch panel 3 comes, at a distance not greater than the threshold ZL1 determines the operation input processor 9 in that the action was performed immediately before an operation of the left icon, without a distinction between the action immediately before an operation of the left icon and the action immediately before an operation of the right icon. How the determination is made is not limited in this way. The control 14 For example, it may determine whether or not the action has been performed, with a distinction between the action immediately before operation of the left icon and the action immediately before operation of the right icon, not only the distance Z between the display means and Detection surface, but also the two-dimensional position (X, Y) of the display means, as in FIG 6 shown. For example, if the operation input processor 9 determines that the position (X, Y, Z) of the in 6 The display means shown is located within a hemispherical spatial area covering the left icon, the controller 14 determine that the action was performed immediately prior to operation of the left icon. The same applies to the steps S8, S24, S28 and the like which will be described later.

Further, when step S4 is performed again, when the map is displayed as the left image or the right image, and the position of the self-vehicle has changed, the control may 14 scroll the map in accordance with the change of position.

In step S5, the controller shows 14 the area corresponding to the left icon is recognizable in the right image (display such that the area corresponding to the left icon becomes recognizable).

The 9A and 9B FIG. 11 are views for illustrating another example of the display of the left image and the right image in the navigation apparatus, respectively. FIG 1 according to the first preferred embodiment in step S5.

This in 9A shown left image is equal to that of 8A , On the other hand, the controller generates 14 (as in 9B shown), the areas corresponding to the left icon LA1, LA2, LA3, LA4, LA5 and LA6 (hereinafter sometimes referred to as "left icon corresponding areas LA1 to LA6") in the right image at the same positions of the respective left icons L1, L2, L3, L4, L5 and L6. The control 14 here causes the split view display 2 recognizably displaying the areas LA1 to LA6 corresponding to the left icon by causing the split view display 2 indicates the same images as the left icons L1 to L6 in the respective left icons corresponding areas LA1 to LA6. The respective display areas of the left icons L1 to L6 in the left image and the areas corresponding to the left icon LA1 to LA6 in the right image overlap each other on the screen of the split-view display 2 ,

If here is the left picture of 8A and the right picture of 8B are displayed, it is assumed that the user of the left seat (driver) intends to perform an operation such as a touch operation, a pulling operation or the like on the left icons L1 to L6, and his finger in the vicinity of the detection surface of the touchpad 3 comes. With the operations in steps S4 and S5, the user of the left seat (driver) visibly recognizes the left image of 9A that is equal to that of 8A is. As a result, it is assumed that the driver of the left seat (driver) normally performs an operation on the left icon.

On the other hand, if the left image of 8A and the right picture of 8B are displayed, it is assumed that the user of the right seat (passenger in the front passenger seat) intends to occasionally touch an area other than the right icons R1 to R5, or an operator such as a touch operation, a pull operation or the like perform right icons R1 to R5, and his finger in the vicinity of the detection surface of the touch panel 3 and hence the distance Z between its finger and the touchpad 3 greater than zero and equal to the predetermined threshold ZL1. In this case, with the operations in steps S4 and S5, the user of the right seat (passenger in the front passenger seat) visually recognizes the right image of 9B wherein the areas corresponding to the left icon LA1 to LA6 to the right image of 8B are added. As a result, when the user of the right seat (passenger in the front passenger seat) does not intend to perform any operation on the left icons L1 to L6, it is achieved that the same pictures as the left icons L1 to L6, in areas corresponding to the left icon LA1 to LA6 are displayed, do not touch (operate) is.

In step S6 of 7 determines the operation input processor 9 whether or not an operation has been performed on the left icons L1 to L6 or the right icons R1 to R5. When it is determined that the operation has been performed on the left icons L1 to L6 or the right icons R1 to R5, the process goes to step S7 and if it is not determined that the operation has been performed, the process goes to step S8.

In step S7, the controller performs 14 the function of the application according to the operated icon. Thereafter, the process goes to step S8. In addition, if the icon layout image that is pre-associated with the operated icon is in the memory 11 is stored, there may be a case where the process goes from step S7 back to step S3, and the icon layout image on the split view display 2 is shown.

In step S8, the operation input processor performs 9 the determination in step S4 again. The operation input processor 9 Specifically, determines whether or not the action is performed immediately before the left icon is operated (whether or not the distance Z has become greater than zero and not greater than the threshold ZL1). If it is determined that the action is performed immediately before the operation of the left icon, the process goes to step S6, and if it is not determined that the action is being performed, the process goes to step S9.

The action that is determined to be performed here may be an action that continues from the action determined to be performed in step S4, or may be an action that is not continued by the action. In the latter case, i. For example, in the action not continued from the action determined to be performed in step S4, it is assumed that the display means fluctuates under the situation where the distance Z is in the vicinity of the threshold value ZL1. In this case, in order to prevent the determination result from varying depending on the detection timing, the distance Z may be corrected by performing LPF (Low Pass Filter) signal processing.

In step S9, the controller shows 14 the original right image ( 8B ) in step S3 again from the right image ( 9B ) in step S5. Thereafter, the process goes back to step S4.

effects

If through the navigation device 1 According to the above-described first preferred embodiment, it is determined that the action has been performed or performed immediately prior to operating the left icon, the area corresponding to the left icon is recognizably displayed in the right image. With this operation, it is possible to prevent the user of the right seat (passenger in the front passenger seat) from unintentionally operating the left icon. Further, since the area corresponding to the left icon can not always be displayed, an effect that the right icon is easily visible or the like is expected, and another effect that the user of the right seat (passenger in the front passenger seat) is slightly the right one Icon from the left icon, compared with a case where the left icon and the right icon are always displayed.

The above description is further made on the assumption that the "first image" is the left image, the "first action" is the action immediately before the operation of the left icon, and the "first surface" is the display area of the left icon in the right image , However, this is only an exemplary case, and it can be assumed that the "first picture" is the right picture, the "first picture" is the action immediately before the right icon is operated, and the "first picture" is the display face of the right picture right icons in the left picture is. It is thus possible to prevent the user of the right seat (passenger in the front passenger seat) from unintentionally operating the left icon.

First variation of the first preferred embodiment

In the first preferred embodiment, as in FIGS 9A and 9B shown the control 14 that the split-view ad 2 the areas LA1 to LA6 corresponding to the left icon are recognizably displayed in the right image by causing the split-view display 2 indicates the same images as the left icons L1 to L6 in the respective areas LA1 to LA6 corresponding to the left icon. The images displayed in the areas LA1 to LA6 corresponding to the left icon are not limited to the same images as the left icons L1 to L6.

The control 14 For example, it may perform predetermined processing such as processing for changing the colors or the brightness, blur processing or the like at the left icons L1 to L6, and causes the split-view display 2 the images of the icons obtained by such processing are displayed in the respective areas LA1 to LA6 corresponding to the left icons.

As in the 10A and 10B shown, the controller can 14 Further, perform predetermined processing, such as color or brightness changing processing (in FIG 10B is the difference in the color of the difference in the density of fine dots of shading), blur processing or the like on the original images (background images) displayed in the areas LA1 to LA6 corresponding to the left icon in the right image, and causes that the split-view ad 2 display the images obtained by such processing in the respective areas LA1 to LA6 corresponding to the left icon.

Further, since the areas LA1 to LA6 corresponding to the left icon can be any areas in the right image only when the areas can be distinguished from other areas, only frames can be displayed instead of characters, symbols, or the like in the left Icon corresponding areas LA1 to LA6. With respect to important icons or icons that can be operated, characters or the like indicating that these icons are important or can be operated can be added in the areas LA1 to LA6 corresponding to the left icon.

As in the 11A and 11B shown, the controller can 14 cause the split view ad 2 for example, displays composite images obtained by a combination of the original images (background images) having a transmittance of 50% in the areas LA1 to LA6 corresponding to the left icon and the images of the left icons L1 to L6 (shown crossed lines in 11B ) having a light transmittance of 50% in the respective areas LA1 to LA6 corresponding to the left icon.

As further in the 12A and 12B shown, the controller can 14 cause the split view ad 2 Displays images each representing a predetermined figure in the respective areas LA1 to LA6 corresponding to the left icon. The control 14 Additionally, this can cause the split-view ad 2 indicates, for example, composite images obtained by combining the original images (background images) having a light transmittance of 50% in the areas LA1 to LA6 corresponding to the left icon and the images each of the predetermined figure having a light transmittance of 50% in the respective areas LA1 to LA6 corresponding to the left icon.

If there are a plurality of surfaces corresponding to the left icon, as in FIGS 13A and 13B shown, the controller can 14 cause the split view ad 2 indicates an area LE1 surrounding the plurality of areas LA1 to LA6 corresponding to the left icon, instead of the areas LA1 to LA6 corresponding to the left icon in the right image. In the case where there are a plurality of left icons in a certain area or in a comparable case, with this operation, it is possible to display an area such as the area LE1 in the right image.

Also by the navigation device 1 According to the first variation of the first preferred embodiment as described above, the same effects as those in the first preferred embodiment can be produced. In the cases where the ad that is in the 9A and 9B is shown, and the ones in the 11A and 11B When the user of the left seat (driver) asks the right seat user (front passenger seat passenger) to operate the left icons L1 to L6, the user of the right seat (passenger in FIG the front passenger seat) perform the operation for the driver.

Moreover, if it is determined in the above-described description that the Action was performed immediately before operating the left icon or performed, causes the controller 14 that the split-view ad 2 recognizable all the areas corresponding to the left icon LA1 to LA6 indicates. However, this is only an exemplary case, and if it is determined that the action has been performed or performed just prior to operating the left icon, control may 14 cause the split view ad 2 identically identifies at least one of the surfaces corresponding to the left icon LA1 to LA6 (for example, an area corresponding to the left icon, which is closest to the display means). The control 14 moreover, not only can display the areas LA1 to LA6 corresponding to the left icon with respect to an arbitrary icon but also, for example, also display the areas LA1 to LA6 corresponding to the left icon, which are within a predetermined distance from the position of the display means, indicated by the coordinates (X, Y) or the like, or are within a predetermined range including the position.

Second variation of the first preferred embodiment

In the first preferred embodiment, a configuration was explained in which an electrostatic touch panel for the touch panel 3 is applied. The configuration of the navigation device 1 however, it is not limited to this case, but may have configurations which will be described below as the first to third examples.

In the first example of the configuration is for the touchpad 3 an infrared touch panel is provided for which mechanisms are provided for detecting the indication means with infrared rays and which is stacked in two layers perpendicular to the detection surface. The touchpad 3 With such a configuration, a state in which the indication means is in the vicinity of the detection surface (only the upper layer detects the indication means) detects another state in which the indication means touches the detection surface (both the upper layer and the lower layer detect the indication means), and another state other than the above-described two states, instead of the above-described distance Z.

In the first example of the configuration, the operation input processor then determines 9 in that an operation was performed on the left icon when the output signal from the touchpad 3 indicates the state where the indication means touches the detection surface, and the operation input processor 9 determines that the position of the indication means, indicated by the output signal, overlaps with the left icon. The same goes for the right icon. The operation input processor 9 further determines that the action (first action) was performed immediately prior to operating the left icon when the output signal from the touchpad 3 indicates the state where the indication means is near the detection surface while the left icon is displayed.

The above-explained first example of the configuration may further produce the same effects as those in the first preferred embodiment.

In the second example of configuration is for the touchpad 3 Further, an electrostatic touch panel capable of detecting a touch operation in which the indication means comes in light contact with the touch panel and the degree of operation on the detection surface (the operation amount) by the indication means instead of the above-mentioned distance Z ,

In the second example of the configuration, the operation input processor then determines 9 in that an operation operation on the left icon has been performed when the operation amount indicated by the output signal from the touch panel 3 , greater than a predetermined value, and the operation input processor 9 determines that the position of the indication means, indicated by the output signal, overlaps with the left icon. The same goes for the right icon. The operation input processor 9 further determines that a touch operation has been performed on the left icon when the operation amount indicated by the output signal from the touch panel 3 , is not greater than the predetermined value, and the operation input processor 9 determines that the position of the indication means, indicated by the output signal, overlaps with the left icon. The operation input processor 9 then determines that the action (first action) was taken just prior to operating the left icon when the operation input processor 9 determines that the touch operation has been performed on the left icon.

Also, the above-explained second example of the configuration can produce the same effects as those in the first preferred embodiment.

Further, in the third example of the configuration, for the touch panel 3 applied an electrostatic touch panel which is able to detect both the three-dimensional position of the indication means and the operating size of the indication means. 14 FIG. 10 is a flowchart for illustrating an operation of the navigation apparatus. FIG 1 with the electrostatic touch panel according to the second variation of the first preferred embodiment. As shown in the flow chart of 14 Step S6 in the flowchart of FIG 7 is replaced by step S11, and steps S12 and S13 between steps S11 and S7 are added, the following explanation will be made centrally for the steps S11, S12 and S13.

In step S11 after passing through step S5, the operation input processor determines 9 whether or not a touch operation has been performed on the left icon or the right icon by performing the determination explained in the second example of the configuration.

If it is determined in step S11 that the touch operation has been performed on the left icon or the right icon, the process goes to step S12, and if it is not determined that the operation has been performed, the process goes to step S8.

In step S12, the controller performs 14 a highlight display of the icon on which the touch operation was performed.

In step S13, the operation input processor determines 9 Whether or not an operation operation has been performed on the touch-operated icon by performing the determination explained in the second example of the configuration.

If it is determined in step S13 that the operation operation has been performed, the process goes to step S7, at which the operation of the application corresponding to the icon on which the operation operation was performed is performed. On the other hand, if it is not determined in step S13 that the operation operation has been performed, the process goes back to step S11. Further, when the process returns from step S13 to step S11, the emphasis display performed in step S12 may be canceled as required.

Also, the third example of the configuration explained above can produce the same effects as those of the first preferred embodiment.

Second preferred embodiment

In the first preferred embodiment, when it is determined that the action has been performed or performed immediately before the operation of the left icon, the area corresponding to the left icon is recognizably displayed in the right image. In the second preferred embodiment, a display similar to that in the left image is also performed. An education of the navigation device 1 according to the second preferred embodiment will be explained below.

As the training of the navigation device 1 Further, according to the second preferred embodiment shown by the block diagram, similar to that in the first preferred embodiment, an illustration thereof is omitted. In the navigation device 1 According to the second preferred embodiment, then, forming members that are identical or comparable to those explained in the first preferred embodiment will be represented by the same reference numerals, and the following explanation will be centered on the differences therebetween.

The operation input processor 9 according to the second preferred embodiment, based on the output signal from the touch panel 3 whether or not a second action, which is defined in advance as an action performed immediately before an operation of the right icon, and outputs the determination result to the controller 14 out. The operation input processor 9 determines here that the action (second action) was performed just before the right icon was operated when the operation input processor 9 determines that the distance Z, indicated by the output signal from the touchpad 3 , greater than zero and not greater than a predetermined threshold ZR1 (for example, about 3 to 10 cm) while the right icon is displayed and the operation input processor 9 On the other hand, determines that the action (second action) was not performed immediately before the right icon was operated.

Although the threshold ZR1 may be a value different from the threshold ZL1 described in the first preferred embodiment, it is further assumed here that the threshold ZR1 is the same value as the threshold ZL1, for easy explanation. In such a configuration, the determination as to whether or not the action was performed immediately before operating the left icon is substantially the same as determining whether or not the action was performed immediately before operating the right icon.

Then, as explained in detail below, the operation input processor 9 determined based on the output signal from the touch pad 3 in that the action has been performed or performed immediately before the right icon is operated causes the control 14 that the split-view ad 2 , recognizable in the left image, displays a second area (hereinafter referred to as a "right icon corresponding area") corresponding to the display area of the right icon.

15 FIG. 10 is a flowchart for illustrating an operation of the navigation apparatus. FIG 1 according to the second preferred embodiment. As shown in the flow chart of 15 Steps S4 to S9 in the flow chart of 7 are replaced by the respective steps S24 to S29, the following explanation is made centrally at the steps S24 to S29.

In step S3, after passing through steps S1 and S2, the controller shows 14 the detected left icon layout picture as the left picture of the split view display 2 and the detected right icon layout picture as the right picture of the split view display 2 , It is here assumed in step S3 that the left image and the right image shown in FIG 8A respectively. 8B , at the split view display 2 are displayed.

In step S24, after passing through step S3, the operation input processor determines 9 Whether or not the action was performed immediately before the left icon was operated (whether or not the distance Z became greater than zero and not greater than the threshold ZL1), and further determines whether or not the action immediately before operating of the right icon (whether or not the distance Z became greater than zero and not greater than the threshold ZR1). As mentioned above, since the threshold ZR1 is the same value as the threshold ZL1, the previous determination is substantially the same as the subsequent determination. If it is determined that the action has been performed just before operating the left icon (the action immediately before operating the right icon), the process goes to step S25, and if it has not been determined that the action has been performed, step S24 carried out again. Further, when step S24 is performed again, when the map is displayed as the left image or the right image, and the position of the self-vehicle has been changed, the controller may 14 scroll the map in accordance with the change of position.

In step S25, the controller causes 14 that the split-view ad 2 the area corresponding to the left icon is recognizable in the right image and also causes the split view display 2 the area corresponding to the right icon is recognizable in the left image.

The 16A and 16B FIG. 11 are views for illustrating an example of display of the left picture and the right picture in the navigation apparatus, respectively. FIG 1 according to the second preferred embodiment in step S25.

As in 16B shown, generates the control 14 , the areas corresponding to the left icon LA1 to LA6 in the right image at the same positions as the respective left icons L1 to L6, as in the first preferred embodiment. The control 14 here causes the split view display 2 recognizably displays the areas LA1 to LA6 corresponding to the left icon by causing the split view display 2 indicates the same images as the left icons L1 to L6 in the respective areas LA1 to LA6 corresponding to the left icons.

In the second preferred embodiment, the controller generates 14 , in addition to the above operation, as in 16A 4, the areas corresponding to the right icon RA1, RA2, RA3, RA4, and RA5 (hereinafter also sometimes referred to as the "right icon-corresponding areas RA1 to RA5") in the left image at the same positions as the right icons R1, R2, R3, R4 and R5, respectively. The control 14 here causes the split view display 2 the areas RA1 to RA5 corresponding to the right icon are recognizably displayed by causing the split view display 2 indicates the same images as the right icons R1 to R5 in the respective areas RA1 to RA5 corresponding to the right icon. The respective display areas of the right icons R1 to R5 in the right image and the right icon areas RA1 to RA5 in the left image overlap each other on the screen of the split-view display 2 ,

In step S26 of 15 as in step S6, the operation input processor determines 9 whether or not an operation has been performed on the left icons L1 to L6 or the right icons R1 to R5. When it is determined that the operation has been performed on the left icons L1 to L6 or the right icons R1 to R5, the process goes to step S27, and if it is not determined that the operation has been performed, the process goes to step S28 ,

In step S27, as in step S7, the controller performs 14 the function of the application according to the operated icon. Thereafter, the process goes to step S28. Further, if the icon layout image associated with the operated icon is stored in advance in the memory 11 is stored, there may be a case where the process returns from step S27 to step S3, and the icon layout image on the split-view display 2 is shown.

In step S28, the operation input processor performs 9 the determination in step S24 again. The operation input processor 9 Specifically, determines whether or not the action is performed immediately before the left icon is operated (whether or not the distance Z has become greater than zero and not greater than the threshold ZL1), and also determines whether or not the action is performed immediately before an operation of the right icon (whether or not the distance Z has become greater than zero and not greater than the threshold value ZR1). When it is determined that the action is performed immediately before the operation of the left icon (the action immediately before the operation of the right icon), the process goes to step S26, and if it is not determined that the action is being performed, the process proceeds to step S29. The action that is determined to be performed may further be an action that continues from the action determined as determined in step S24, or may be an action that does not continue from the action.

In step S29, the controller shows 14 the original right image ( 8B ) in step S3 again from the right image ( 16B ) in step S25. The control 14 also shows the original left image ( 8A ) in step S3 again from the left image ( 16A ) in step S25. Thereafter, the process goes to step S24.

effects

If through the navigation device 1 According to the second preferred embodiment, as explained above, it is determined that the action has been performed or performed immediately prior to operating the left icon, the area corresponding to the left icon is recognizably displayed in the right image, and it is determined that the Action has been performed or performed immediately before operating the right icon, the area corresponding to the right icon is recognizable displayed in the left image. With this operation, the same effects as those in the first preferred embodiment can be generated for the user in the right seat (front passenger front passenger) and the left seat user (driver).

When the threshold value ZL1> is the threshold value ZR1 in the left image on the driver's side, the areas RA1 to RA5 corresponding to the right icon are displayed in advance. This case provides a higher operability for the driver's side because the driver's seat side may have a longer time before operation on the icon compared to the time that the front passenger's seat side has and the driver has some extra time.

Also, in the second preferred embodiment, the same variation as the first variation of the first preferred embodiment can be further applied. Specifically, the images displayed in the areas corresponding to the right icon are not limited to the same images as the right icons, but any of the following first to sixth examples or any combination of these examples may be applied.

As a first example, the controller 14 perform predetermined processing, such as processing for changing the colors or the brightness, blur processing or the like on the right icons, and cause the split-view display 2 the images of the icons obtained by such processing are displayed in areas corresponding to the right icons. In the second example, as in the in 10B shown variation, the controller can 14 perform predetermined processing, such as processing for changing the colors or the brightness, blur processing, or the like on the original images (background images) displayed in the areas corresponding to the right icon in the left image, and causes the split-view display 2 display the images obtained by such processing in areas corresponding to the right icons.

In the third example, as in the in 11B shown variation, the controller can 14 cause the split view ad 2 for example, displays images obtained by a combination of the original images (background images) having a transmittance of 50% in the areas corresponding to the right icon and the images of the right icons with a light transmittance of 50%, in the the right icon corresponding areas. In the fourth example, as in the 12B shown variation, the controller can 14 cause the split view ad 2 Images each representing a predetermined figure are displayed in the areas corresponding to the right icons. In the fifth example, the controller 14 cause the split view ad 2 For example, composite images obtained by a combination of the original images (background images) having a light transmittance of 50% in areas corresponding to the right icons and the images of the respective predetermined figures having a light transmittance of 50% are obtained in FIG right icon displays corresponding areas.

If in the sixth example, as in the in 13B shown variation, there are a variety of surfaces corresponding to the right icon, the controller 14 cause the split view ad 2 indicates an area surrounding the plurality of areas corresponding to the right icon instead of the areas corresponding to the right icon in the left picture.

Also, the configurations described above can produce the same effects as those in the second preferred embodiment.

Further, in the above description, if it is determined that the action has been performed or performed immediately before the operation of the left icon, the control causes 14 that the split-view ad 2 recognizable all the areas corresponding to the left icon LA1 to LA6 indicates. However, this is only an exemplary case, and if it is determined that the action has been performed or performed just prior to operating the left icon, control may 14 cause the split view ad 2 recognizably indicates at least one of the areas corresponding to the left icon areas LA1 to LA6 (for example, an area corresponding to the left icon, which is closest to the indication means). Similarly, if it is determined that the action has been performed or performed immediately prior to operating the right icon, control may 14 cause the split view ad 2 recognizable the split-view display 2 indicating to indicate at least one of the areas RA1 to RA5 corresponding to the right icon (for example, an area corresponding to the right icon which is closest to the indication means). The control 14 moreover, not only can display the areas LA1 to LA6 corresponding to the left icon or the areas RA1 to RA5 corresponding to the right icon with respect to any icon, but also, for example, the area corresponding to the left icon LA1 to LA6 or the right icon indicate respective areas RA1 to RA5 which are within a predetermined distance from the position of the indication means indicated by the coordinates (X, Y) or the like, or which are within a predetermined range including the position.

Third preferred embodiment

As the training of the navigation device 1 According to the third preferred embodiment, which is represented by the block diagram, is the same as in the first preferred embodiment, a representation thereof is omitted. In the navigation device 1 According to the third preferred embodiment, then, the constituent elements which are identical or comparable to those described in the second preferred embodiment will be denoted by the same reference numerals, and the following description will be centered on the respective differences.

17 FIG. 10 is a flowchart showing an operation of the navigation apparatus according to the third preferred embodiment. FIG. As in the flowchart of 17 Step S31 between steps S24 and S25 in the flowchart of FIG 15 is added, and steps S32 to S36 are separately added to step S31 further from step S25, the following explanation will be made centrally at steps S31 to S36. Moreover, although the threshold value ZR1 may be a value different from the threshold value ZL1, it is also assumed that the threshold value ZR1 is the same value as the threshold value ZL1, for the purpose of a simple representation.

In step S24, after passing through step S3, the operation input processor determines 9 whether or not the action was performed immediately before the operation of the left icon, and also determines whether or not the action was performed immediately before the right icon was operated. When it is determined that the action has been performed immediately before the operation of the left icon (the action immediately before the operation of the right icon), the process goes to step S31, and if it is not determined that the action has been performed, the step S24 again.

In step S31, the controller determines 14 whether or not at least a part of the display area of the icon and at least a part of the area corresponding to the icon overlap with each other. In particular, the controller determines 14 whether or not at least a part of the display area of the right icon and at least a part of the area corresponding to the left icon overlap with each other, and at least a part of the display area of the left icon and at least a part of the area corresponding to the right icon overlap with each other on the screen the split-view ad 2 , If it is determined that they overlap each other, the process goes to step S32, and if it is not determined that they overlap each other, the process goes to step S25. Since the operations in steps S25 to S29 are the same as those in the second preferred embodiment, an explanation thereof will be omitted.

When the process goes from step S31 to step S32, the controller selects 14 in step S32, one of the left icon and the right icon in which the operation is to be invalidated based on an occupied area occupying the plurality of left icons and another occupied area occupying the plurality of right icons. When one of the occupied area of the left icons and the occupied area of the right icons is not smaller than a predetermined ratio (for example, 50%) with respect to the area of the screen of the split-view display, the controller makes 14 the operation on the Icon of one side valid and invalidates the operation of the icon on the other side.

In step S3, for example, the left image and the right image shown in FIG 18A respectively. 18B at the Split View Ad 2 displayed. In the left picture of 18A For example, the left icon layout picture is displayed for a list display in which left icons L11, L12, L13, L14, and L15, which are list buttons used to display a list, and a left icon L16, which are is a scroll list button used to scroll the list buttons (hereinafter, these icons are collectively referred to as "left icons L11 to L16"). Although the left icon layout image for a list display shown in FIG 18A is explained below as an exemplary image having a relatively large occupied area of a plurality of icons, this is just an exemplary image, and the same applies to, for example, an icon layout image for a menu display or an icon layout image for a keyboard display. This in 18B shown right image is the same as the right image in 8B is shown, and at least a part of the display areas of the right icons R4 and R5 and at least a part of the display areas of the left icon L15 overlap each other on the screen of the split-view display 2 ,

It is assumed here that the entire occupied area of the plurality of left icons L11 to L16 shown in FIG 18A is determined to be not smaller than the predetermined ratio with respect to the area of the screen of the split-view display 2 in step S32. It is then, if it is determined in the case that the operation was performed on the right icons R4 and R5, with the left icon L15 on the screen of the split-view display 2 overlap, among the in 18B shown right icons R1 to R5, invalidates the control 14 the company. In step S32, the controller causes 14 as well, that the split-view ad 2 the invalidation is recognizable.

The 19A and 19B FIG. 11 are views for illustrating an example of display of the left picture and the right picture in the navigation apparatus, respectively. FIG 11 according to the third preferred embodiment in step S32, and in particular, views illustrating an example of the display in the case where the controller 14 the operations or operations on the right icons R4 and R5 invalidated.

As in 19A shown, shows the controller 14 the areas corresponding to the right icon RA1 to RA5 corresponding to the right icons R1 to R5 in the left image. The control 14 preferably indicates the entire left icon R15 that is not invalidated. As a result of this operation, among the areas RA4 and RA5 corresponding to the right icon, the part overlapping with the left icon L15 is not displayed.

As in 19B shown, shows the controller 14 Further, an area LE2 surrounding the areas corresponding to the left icon corresponding to the left icons L11 to L16 in the right image as in the example of the display of 13B , The control 14 also displays the right icons R4 and R5, which have been invalidated, with a darker color than the color with which the right icons R4 and R5 (FIG. 18B ) are displayed in step S3. The control 14 Alternatively, these right icons R4 and R5 display a darker color than the color indicating the right icons R1, R2 and R3 on which the operations are not invalidated. The control 14 indicates in a further alternative, these right icons R4 and R5, these being shown by dashed lines. The control 14 thus clearly indicates the invalidation of the operations on the right icons R4 and R5.

If, as explained above, in step S32, the control 14 determines that the occupied area of the plurality of left icons is not less than the predetermined ratio invalidates the control 14 the operation on the right icon and also causes the split view display 2 the invalidation is recognizable. On the other hand, if in step S32 the control 14 determines that the occupied area of the plurality of right icons is not smaller than the predetermined ratio invalidates the control 14 the operation on the left icon also causes the split view display 2 indicates the invalidation in the same manner as explained above.

Further, in step S32, if the control 14 determines that both the occupied area of the plurality of left icons and the occupied area of the plurality of right icons are not smaller than the predetermined ratio, invalidates the control 14 the operation on a predetermined one of the left icon and the right icon (for example, the icon on the side of the front passenger seat) and also causes the split-view display 2 the invalidation is recognizable.

The 20A and 20B are further views for illustrating another example of a display of the left image and the right image in the navigation device, respectively 1 according to the third preferred embodiment in step S32. In the left picture of 20A For example, the left menu arrangement picture is displayed for a menu display with the left icons L21, L22, L23, L24, L25 and L26 arranged. The control 14 shows here as well prefers the set of left icons L23, L24, L25 and L26 that have not been invalidated. The control 14 determines, moreover, that the occupied area of the left icons L21, L22, L23, L24, L25, and L26 is large, and as a result of the determination (as in FIG 20B shown), shows the controller 14 Recognize the invalidation of the operation on all the right icons R1, R2, R3, R4 and R5.

In step S33 of FIG 17 determines the operation input processor 9 Whether or not an operation has been performed on the valid icon (the icon where the operation is invalidated). If it is determined that the operation has been performed on the valid icon, the process goes to step S34, and if it is not determined that the operation has been performed on the valid icon, the process goes to step S35.

In step S34, the controller performs 14 as in step S27, the function of the application corresponding to the operated icon. Thereafter, the process goes to step S35. Further, if the icon layout image associated with the operated icon is stored in advance in the memory 11 is stored, there may be a case in which the process returns from step S34 to step S3, and the icon layout image on the split-view display 2 is shown.

In step S35, as in step S28, the operation input processor determines 9 Whether or not the action is performed immediately before an operation of the left icon, and also determines whether or not the action is performed immediately before the right icon is operated. If it is determined that the action is performed immediately before the operation of the left icon (the action immediately before the operation of the right icon), the process goes back to step S33, and if it is not determined that the action is being performed, the process goes to Process to step S36.

In step S36, the controller shows 14 the original right image ( 18B ) in step S3 again from the right image ( 19B ) in step S32. The control 14 also shows the original left image ( 18A ) in step S3 again from the left image ( 19A ) in step S32. Thereafter, the process goes back to step S24.

effects

If through the navigation device 1 As explained above, according to the third preferred embodiment, at least a part of the display area of the right icon and at least a part of the area corresponding to the left icon overlap each other, and at least a part of the display area of the left icon and at least a part of the area corresponding to the right icon with each other on the screen of the split view display 2 overlap, the operation is invalidated at one of the left icon and the right icon, and the invalidation becomes apparent at the split view display 2 displayed. It is therefore possible to prevent the user of the left seat from unintentionally operating the right icon or to prevent the user of the right seat unintentionally operating the left icon.

Further, according to the third preferred embodiment, one of the left icon and the right icon where the operation is to be invalidated is selected on the basis of the occupied area of the plurality of left icons and the occupied area of the plurality of right icons. It is therefore possible to select the icon appropriately by invalidating the operation.

Moreover, as in the third preferred embodiment, in the case where an icon on one side and an icon on the other side (for example, the right icons R4 and R5 described above) overlap with each other, only the operation on the overlapped icon on the other side, and the operations on the remaining icons (for example, the above-described right icons R1, R2 and R3) on the other side that do not overlap the icon on one page are not invalidated. It is therefore possible to keep a limitation on the operations to a minimum.

Variation of the third preferred embodiment

In the event that only a left icon and only a right icon are displayed, or a comparable case, the controller 14 select one of the left icon and the right icon where the operation is to be invalidated based on the occupied area of the one left icon and the occupied area of the right icon. Generalizing the above explanation may be the controller 14 further select one of the left icon and the right icon on which the operation is to be invalidated based on the occupied area of a left icon or the occupied area of a plurality of left icons and the occupied area of a right icon or the occupied area of a Variety right icons.

Further, in the above description, in the case where one of the occupied areas of the left and left icons and the occupied area of the right icon (s) is not less than the predetermined ratio, the controller makes the control 14 the operation (s) on the one or more icons of the one page invalidate the operation (s) on the icon (s) on the other side. However, this is just an example case, and it may be a case give, where the controller 14 compares the occupied area of the plurality of left icons with the occupied area of the plurality of right icons, and validates the operations on the icons from one page with a larger occupied area and invalidates the operations on the icons of the other side with the smaller occupied area.

In the above description, further, in step S32, after passing through steps S31, the operation on one of the left icon and the right icon is invalidated. However, this is only an exemplary case, and steps S31 and S32 may be performed before step S24.

Fourth preferred embodiment

As the training of the navigation device 1 According to the fourth preferred embodiment, which is represented by the block diagram, is the same as that of the first preferred embodiment, a representation thereof is omitted. In the navigation device 1 According to the fourth preferred embodiment, then, the constituent elements that are identical or comparable to those described in the first preferred embodiment will be represented by the same reference numerals, and the following description will be centered on the respective differences.

The 21 and 22 are views for illustrating examples of a display of the right image in the navigation device 1 according to the fourth preferred embodiment. The in the 21 and 22 shown images are similar to those in the 8B respectively. 9B are shown.

In the fourth preferred embodiment, the controller is 14 configured to selectively perform a display control (first control) for displaying the area corresponding to the left icon recognizable in the right image, and a non-display control (second control) in which the area corresponding to the left icon is not recognizable displayed in the right image , according to the distance Z between the indication means and the detection surface of the touchpad 3 while the action is being performed just prior to operating the left icon.

If the distance Z is greater than the threshold ZL1 (Z> ZL1), the operation input processor determines 9 for example, that the action was performed just prior to operating the left icon. In this case shows how in 21 shown the control 14 According to the fourth preferred embodiment, the right image is displayed, and the area corresponding to the left icon is not recognizable, as in the first preferred embodiment.

When the distance Z is not greater than the threshold ZL1 and greater than a threshold ZL2 (ZL2 <Z ≦ ZL1), the operation input processor determines 9 in that the action was performed immediately before the left icon was operated. The control 14 According to the fourth preferred embodiment, in this case, the display control performs in accordance with the distance Z. As a result of this operation, the controller shows 14 , as in 22 11, the same images as the left icons L1 to L6 as the left icon-corresponding areas LA1 to LA6 in the left image as in the first preferred embodiment.

If the distance Z is not greater than the threshold ZL2 and greater than zero (0 <Z ≦ ZL2), the operation input processor determines 9 in that the action was performed immediately before the left icon was operated. In this case, the controller performs 14 According to the fourth preferred embodiment, the non-display control in accordance with the distance Z by. As a result of this operation, the controller shows 14 , as in 21 shown, the image, wherein the area corresponding to the left icon is not recognizable, unlike the first preferred embodiment.

effects

While through the navigation device 1 According to the fourth preferred embodiment, as explained above, the action is performed immediately before the operation of the left icon, the display control and the non-display control are selectively performed in accordance with the distance Z. With such a configuration, if the user of the right seat indication (passenger in the front passenger seat) is closer to the touch panel 3 comes from a position where there is a sufficiently low probability of unintentional operation of the left icon, it is possible not to display the area corresponding to the left icon to improve the visibility of the right image.

First variation of the fourth preferred embodiment

If the distance Z is not greater than the threshold ZL1 and greater than a threshold ZL3 (ZL2 <ZL3 <Z ≦ ZL1), as in the example of the display of 11B , the controller can 14 for example, display images obtained by combining the original images (background images) with a transmittance of 50% in the left icon corresponding areas and the images of the right icons with a light transmittance of 50%, in the areas corresponding to the left icon. Then, if the distance Z is not greater than the threshold value ZL3 and greater than the threshold value ZL2 (ZL2 <Z ≦ ZL3), as in FIG 22 shown, the controller can 14 display the same images as the left icons L1 to L6 in the areas LA1 to LA6 corresponding to the left icon.

In the case where the composite images obtained by a combination of the original images and the images of the icons displayed in the areas corresponding to the left icon, the light transmittance of the original images and the light transmittance of the images of the icons in the composite image is changed gradually in accordance with the distance Z. In such a case, in the right image, the transition from a state in which the images of the left icons are not displayed in the areas corresponding to the left icon to a state where the images of the left icons in the left Icons corresponding areas are displayed, or the reverse transition, made gradually. As a method of gradually changing the light transmittance in accordance with the distance, for example, a function (E = f1 (Z)) of the light transmittance E and the distance Z in the memory 11 saved, and the controller 14 uses the function to change the translucency.

In the above description, the controller performs 14 Further, selectively performing the display control and the non-display control in the right image in accordance with the distance Z by. However, this is just an example case and the controller 14 may selectively perform the display control and the non-display control in accordance with the distance Z also in the left image, or in both the right image and the left image, in the manner explained above. In particular, when the distance Z is not greater than the threshold ZR1 and greater than a threshold ZR2 (ZR2 <Z ≦ ZR1), as in the example of the display of 22 , the controller can 14 perform the display control on the left image, and when the distance Z is greater than zero and not greater than the threshold ZR2 (0 <Z ≦ ZR2), as in the example of the display of 21 , the controller can 14 perform the non-display control over the left image.

The threshold value ZL1 may further be the same value as the threshold value ZR1 as explained above, or may be a value different from the threshold value ZR1. The threshold ZL2 may equally be the same value as the threshold ZR2, or may be a value different from the threshold ZR2.

The control 14 may also change the threshold values ZL1 and ZL2 in accordance with the type of application performed on the side of the picture or the function to be performed when the left icon is operated. In a case where the left icon is a special icon requiring attention in the operation thereon, or in a similar case, by making the threshold value ZL1 larger, it is possible to recognize the areas corresponding to the left icon in the right picture at an earlier stage of operation display. It is therefore possible to recognize for the user of the right seat, in the earlier stage, that the special icon is displayed in the left image, and thus it becomes possible to reduce the likelihood that the user of the right seat accidentally misses the left Icon operated. The control 14 Similarly, the threshold values ZR1 and ZR2 may be changed in accordance with the application type performed on the right image side or the function to be performed when the right icon is operated.

Second variation of the fourth preferred embodiment

The above-explained configuration in which the signal indicative of the three-dimensional position of the indication means regularly from the touch panel 3 is output, the controller can 14 calculate a movement speed v of the indication means on the basis of the signal. In the configuration where the output signal from the touchpad 3 contains a signal with respect to the movement speed v of the indication means, the controller 14 thus, be configured to selectively perform the display control (first control) and the non-display control (second control) in accordance with the movement speed v while performing the action immediately before operating the left icon.

If through the navigation device 1 For example, according to the second variation of the fourth preferred embodiment, the indication means is moved at a predetermined moving speed (for example, a moving speed v1 in a case where the user is in doubt about the operation calculated from previous statistical data) it is possible to perform the display control or the non-display control.

The control 14 can perform the above-described display control as soon as determined is that the indication means is moved at the predetermined movement speed v1, or may perform the above-described display control after a certain time, which has elapsed from the time when it is determined as above. The control 14 may equally perform the above-described non-display control as soon as it is determined that the indication means is moving at the predetermined movement speed v1, or may perform the non-display control described above after a certain time elapsed from the time when it is as above is determined.

The configuration of the second variation of the fourth preferred embodiment and that of the first variation related thereto may be further combined. The control 14 For example, the light transmittance of the original image and the light transmittance of the image of the icon in the composite image may be gradually changed in accordance with the moving velocity v. As a method for gradually changing the light transmittance in accordance with the moving speed v, for example, a function (E = f2 (v)) of the light transmittance E and the moving speed v in the memory is 11 saved, and the controller 14 uses the function to change the translucency.

For the moving speed v, a moving speed may be used here with respect to any of the three coordinate axes, under the X, Y and Z coordinate axes. For example, only a moving speed in the Z coordinate axis may be used, or a moving speed in the X coordinate axis and the Y coordinate axis (a moving velocity in the XY plane) may be used. Further, there may be a case where the user sets the coordinate axes (axes) used for the moving speed among the X, Y and Z coordinate axes. It is thus possible to improve the operability.

Other variations

In the above description, consider the exemplary case where the touch panel is used as the input unit. However, the input unit is not limited only to the touch panel when the input unit can uniformly receive an operation on the left image to perform a function of an application or other operation on the right image to perform a function of another application , As an input unit, for example, a touch pad may be used that is separate from the split-view display 2 is provided. In this case, the touch pad may have a function of obtaining a three-dimensional position of the indication means, and the position of the indication means on a touch surface of the touch pad may coincide with the display area of the split-view display 2 to indicate a point or icon indicating the position of the indication means.

Variation to which a display control device is applied to devices other than a navigation device

The above-described display control device may be applied to a display control device configured as a system by combining a PND (Portal Navigation Device), a portable terminal (for example, a cellular phone, a smart phone, a tablet, or the like) Servers and the like that can be mounted on a vehicle, if necessary, as well as the navigation device 1 which is mounted in a vehicle. In this case, the functions or the training elements of the navigation device 1 as described above, are distributed in these devices which form the system.

In the above description, for example, consider the exemplary case where the display control device for the navigation apparatus 1 however, the present invention is not limited to this exemplary case. The display control device may be applied to one of a so-called display audio, which has no navigation function but a display function, a PND, a portable terminal, a stationary display device, and a server.

Further, in the above description, consider the exemplary case where the split-view display 2 which is included in the navigation device 1 is applied to a split view type display, however, the present invention is not limited to the exemplary case. For example, when the display control device is applied to a smartphone, a shared view type display including the smartphone may be applied thereto.

In the present invention, the preferred embodiments and the variations may be freely combined, or may be changed or omitted as appropriate, without departing from the scope of the invention.

While the invention has been illustrated and explained in detail, the foregoing discussion is in all aspects illustrative and not restrictive. It is therefore understood that numerous modifications and variations can be devised without departing from the scope of the invention.

Description of the reference numerals

• 1 Navigation device, 2 , Split-view display 3 , Touchpad, 14 Control, 21 Finger, L1 to L6, L11 to L16, L21 to L26 left icon, R1 to R5 right icon, LA1 to LA6 area corresponding to the left icon, RA1 to RA5 area corresponding to the right icon

Claims (12)

A display control device that controls a display capable of displaying on a screen a first image that is visible from a first direction but not a second direction, and a second image from the second direction but not the first one Direction is visible, wherein the display control device comprises: a controller that causes the display, recognizable in the second image, to display a first area corresponding to a display area of a first icon in the first image when it is determined that a first action has been taken or performed in advance as an action is defined immediately before an operation of the first icon, based on an output signal from an input unit that uniformly receives an operation on the first image to perform a function of an application and another operation on the second image to perform a function of another application. The display control apparatus according to claim 1, wherein the controller causes the display to visually display the first area in the second image by causing the display to obtain an image of the first icon, an image of an icon obtained by performing predetermined processing on the icon first icon, an image obtained by performing predetermined processing on an original image displayed in the first area in the second image, a composite image obtained by combining the original image and the image of the first icon, an image a predetermined figure or a composite image obtained by combining the original image and the predetermined image in the first area. The display control apparatus according to claim 1, wherein the controller causes the display, recognizable by the first image, to display a second area corresponding to a display area of a second icon in the second image when it is determined that a second action has been performed is defined in advance as an action immediately before an operation of the second icon based on the output from the input unit. The display control apparatus according to claim 3, wherein the controller causes the display to display the second area recognizably in the first image by causing the display to display an image of the second icon, an image of an icon obtained by performing predetermined processing the second icon, an image obtained by performing certain processing on an original image displayed in the second area in the first image, a composite image obtained by combining the original image and the image of the second icon , an image of a predetermined figure, or a composite image obtained by combining the original image and the predetermined image in the second area. The display control apparatus according to claim 3, wherein the controller invalidates operation on one of the first icon and the second icon determined to be performed based on the output from the input unit, and causes the display to visibly indicate the invalidation if at least one Part of the display area of the second icon and at least a portion of the first surface overlap each other and at least a portion of the display area of the first icon and at least a portion of the second area overlap each other on a screen of the display. The display control apparatus according to claim 5, wherein the controller selects one of the first icon and the second icon at which the operation is to be invalidated based on an occupied area of the first icon or an occupied area of a plurality of first icons and an occupied area of the second icon or an occupied area of a plurality of second icons. A display control apparatus according to claim 1, wherein the output signal from the input unit includes a signal indicating a distance between an indication means and the input unit, and the first action is defined as an action in a case where the distance did not become greater than a predetermined threshold. The display control apparatus according to claim 7, wherein the controller selectively performs a first display-visible first-surface control in the second image and a second-surface non-display-controllable control in the second image according to the distance during which the first action is performed. A display control apparatus according to claim 7, wherein the output signal from the input unit includes a signal related to a moving speed of the indication means, and the controller selectively executes a first control for displaying the first area recognizable in the second image and a second controller for not displaying the first area recognizable in the second image, according to the moving speed while the first action is being performed. The display control apparatus according to claim 1, wherein when there are a plurality of the first areas, the controller causes the display to display an area surrounding the plurality of first areas in the second image instead of the plurality of first areas. The display control apparatus according to claim 3, wherein when there are a plurality of the second areas, the controller causes the display to display an area surrounding the plurality of second areas in the first image instead of the plurality of second areas. A display control method of controlling a display capable of displaying, on one screen, a first image visible from a first direction but not from a second direction and a second image from the second direction but not from the first direction is visible wherein the display control method comprises the steps of: (a) determining whether or not a first action has been performed that is defined as an action immediately prior to operating a first icon in the first image based on an output signal from an input unit having an operation on the first one Image for performing a function of one application and receiving another operation on the second image uniformly for performing a function of another application; and (b) displaying, recognizable in the second image, a first area corresponding to a display area of the first icon when it is determined in the step (a) that the first action has been performed or performed.

Images