JP4860498B2 - Mobile terminal device and image display system - Google Patents

Description

  The present invention relates to a mobile terminal device and an image display system including a communication unit that performs wireless communication and a display unit that displays an image on a display screen.

  Recently, a camera is attached to the navigation device, and a captured image captured by the camera is held in a holding unit in the navigation device. When the driver tries to pass the same location as the shooting location, a map is displayed on the display screen. In addition, a system that can display the captured image has been proposed (see, for example, Patent Document 1). There is also a technology that allows a specific user to create a user database in a mobile terminal device using a mobile terminal device having a GPS function so that a field activity record can be easily created in a short time. It has been proposed (see, for example, Patent Document 2). Using the technologies of these Patent Documents 1 and 2, it is possible to create a unique database based on information recorded by the user himself, and whenever he likes an image based on the information on the database. You can check it on the display screen.

  However, the technique of Patent Document 2 is not a technique for displaying a captured image in real time on a display screen included in the mobile terminal device. In the technique of Patent Document 1, although an image related to position information can be displayed in real time on a display screen included in the navigation device, road structure, that is, road branch information (node information), image information, Since the database is created by associating these with each other, there is a drawback that only information along the road in the direction in which the automobile is traveling can be obtained. Furthermore, in the technique of Patent Document 1, if an image is displayed on a map in an overlapping manner, the photo information becomes small and difficult to see, and if the photo is enlarged to make the photo information easy to see, this time it becomes difficult to see the map. There is also a problem of end.

  If the user can acquire not only the information along the road along the road but also the surrounding image information including the road, and display it well on the display screen, see the image information and go to the side street You can drop in at historic sites, or at festivals held at that time.

  By the way, in the above-mentioned patent document 1, a photographed image is registered in an image server on the Internet by using a communication function included in the navigation device or by connecting a mobile phone to the navigation device so that the Internet can be accessed. In this way, the memory capacity of the navigation device is being reduced.

  If the configuration is connected to an image server on the Internet as in Patent Document 1, much of the image information with position information stored in the image server is acquired even if the storage capacity of the mobile terminal device is reduced. can do. However, if image information with position information in the image server can be acquired, the amount of image information becomes enormous and the display may become difficult to see as described above.

Therefore, it is conceivable to divide the area and display the image by area by arranging the image information for each position information of the divided area, but the direction is not understood only by arranging the images and displaying them on the display screen. There is a fear. If the direction of the displayed image information is not known, the user cannot know immediately where the image information is displayed and knows that there is a place of interest nearby.
JP 2000-304559 A JP 2004-173105 A

  An object of this invention is to provide the mobile terminal device provided with the display function of the surrounding image information which is easier to understand for a user, and the surrounding image display system provided with the mobile terminal device.

The mobile terminal device of the present invention that achieves the above object is a mobile terminal device that includes a communication unit that performs wireless communication and a display unit that displays an image on a display screen. Position information acquisition means for acquiring, movement direction acquisition means for acquiring the current movement direction of the mobile terminal device, and image information in which images with position information are accumulated, position information around the current position of the mobile terminal device is obtained. An image receiving means for wirelessly receiving a given image, and the image received by the image receiving means, based on the position information given to the image, the current position of the mobile terminal apparatus as an origin and the mobile terminal apparatus Image segmentation means for segmenting into four sections separated by a vertical axis and a horizontal axis in a two-dimensional coordinate space with the movement direction of
Image display means for displaying the image divided by the image dividing means in a section set on the display screen is provided.

  According to the mobile terminal apparatus of the present invention, the vertical axis and horizontal axis in the two-dimensional coordinate space in which the image information from the image server received by the image receiving unit by the image segmenting unit is in the upper direction of the vertical axis. Are divided into four sections, and the divided images are respectively displayed in the sections set by the image display means. For this reason, the user can immediately know in which direction there is something just by looking at the image on the display screen.

  That is, a mobile terminal device having a display function of image information that is easy for the user to understand is realized.

  Here, origin determining means for determining origin coordinates representing the current position of the mobile terminal device on the display screen according to the balance of the number of images of the four sections divided by the image sorting means, The image display means preferably displays the image divided by the image dividing means in a section on the display screen set based on the origin determined by the origin determining means.

  Then, the origin determining means determines the origin coordinates representing the current position of the mobile terminal device on the display screen in accordance with the balance of the number of images of the four sections, and the image display means determines the origin. More images are displayed in any of the sections on the display screen set based on the origin determined by the means. In other words, the display is changed so that the display range of the section with more image information among the four sections divided with the movement direction as the vertical axis is enlarged, and the image information is displayed at the greatly changed position. Will be.

  For this reason, the user can also change the advancing direction to the direction with much image information based on the display on a display screen.

  Further, the image display means displays the image divided by the image dividing means on the display screen, and the image in the section is determined from the current position and the positional information of the image based on the positional relationship between the current position and the image. It is preferable that an image near the current position is arranged near the origin, and an image away from the current position is arranged away from the origin.

  Further, the image display means displays the image sorted by the image sorting means on the display screen, and the geography when the upper direction of the display screen is set as the moving direction of the mobile terminal device on the display screen. It is even better to display the top direction.

  Then, it becomes possible to immediately grasp the direction in which the user is traveling, and the destination can be confirmed by expanding the map.

  The mobile terminal device may be a mobile phone having a telephone function and a GPS function, and the mobile terminal device is mounted on a mobile phone having a telephone function and a GPS function for acquiring current position information. It may consist of a composite with a car navigation system having

  The image display system of the present invention that achieves the above object includes a mobile terminal device including a communication unit that performs wireless communication and a display unit that displays an image on a display screen, and an image with position information stored therein An image display system comprising: an image server that transmits an image to the mobile Tanatsu device in response to a transmission request from the terminal device, wherein the mobile terminal device has current position information of the mobile terminal device Position information acquisition means for acquiring the current movement direction of the mobile terminal apparatus, and the position around the current position of the mobile terminal apparatus from the image server in which images with position information are stored. An image receiving unit that wirelessly receives an image to which information is added, and an image received by the image receiving unit based on the current position of the mobile terminal device based on position information added to the image. In the two-dimensional coordinate space in which the moving direction of the mobile terminal device is above the vertical axis, the image dividing means for dividing the mobile terminal device into four sections divided by the vertical axis and the horizontal axis, and the image dividing means Image display means for displaying an image in a section set on the display screen is provided.

  Here, origin determining means for determining origin coordinates representing the current position of the mobile terminal device on the display screen according to the balance of the number of images of the four sections divided by the image sorting means, The image display means may display the image divided by the image dividing means in a section on the display screen set based on the origin determined by the origin determining means.

  Further, the image display means displays the image divided by the image dividing means on the display screen, and the image in the section is determined from the current position and the positional information of the image based on the positional relationship between the current position and the image. And an image close to the current position is arranged near the origin, and an image away from the current position is arranged away from the origin.

  Further, the image display means displays the image divided by the image dividing means on the display screen, and the upper direction of the display screen is the moving direction of the mobile terminal device on the display screen. It would be good to display the geographical orientation.

  ADVANTAGE OF THE INVENTION According to this invention, the mobile terminal device and image display system provided with the display function of the image information easier for a user to understand are implement | achieved.

  Embodiments of the present invention will be described below.

  1, 2 and 3 are diagrams showing the configuration of a mobile terminal apparatus according to an embodiment of the present invention.

  FIG. 1 shows a mobile phone 100 as an example of a mobile terminal device as viewed from the upper right, and FIG. 2 shows an internal configuration of the mobile phone 100 shown in FIG. FIG. 3 shows a display example of an image displayed on the liquid crystal panel 101 included in the mobile phone 100.

  The mobile phone 100 shown in FIG. 1 has a photographing function for photographing a subject, a television function for browsing a television program, and the like in addition to a data communication function for transmitting and receiving voice and electronic mail to and from an external device. It is installed.

  In the mobile phone 100 shown in FIG. 1, an upper casing 100A provided with a liquid crystal panel 101 as a display screen and a lower casing 100B held by a user's hand are connected by a hinge. When the upper casing 100A or the lower casing is rotated with respect to the lower casing or the upper casing, the shape shown in FIG. 1 is obtained.

  The upper casing 100A is provided with a liquid crystal panel 101 on which a telephone number, a TV program, a photographed image, and the like are displayed, and a speaker (see FIG. 2) inside. There is an earpiece 102 for releasing, and a push button for inputting a selection button 104 used as a shutter button at the time of selecting various functions and shooting, a telephone number, etc. is provided on the lower casing 100B. A button 105 and a microphone (see FIG. 2) are provided inside, and a mouthpiece 106 is provided for transmitting voice to the microphone.

  Next, the internal configuration of the mobile phone 100 will be described with reference to FIG.

  In FIG. 2, CPU 110, ROM 111, nonvolatile memory 112, RAM 113, microphone device 121, display device 122, speaker device 123, key device 124, camera device 125, clock 126, short-range wireless device 131, long-range device 132, television A device 133, a GPS device 140, a media controller 141, and a rechargeable battery 150 are shown, and these are connected to each other via a bus.

  The CPU 110 has a function of executing various programs and controls the entire mobile phone 100. In one of the various programs, a program for achieving the function of the position information acquisition means according to the present invention, a program for achieving the function of the movement direction acquisition means according to the present invention, and the like are described. Details will be described when a flowchart showing a processing procedure of the CPU 110 after FIG. 4 is described.

  The ROM 111 stores various programs executed by the CPU 110 and various constants necessary for executing the various programs. The CPU 110 executes the programs stored in the ROM 111 using the RAM 113 as a work area.

  The nonvolatile memory 112 stores various information that can be rewritten, such as an address book and received e-mail.

  The microphone device 121 is a functional block that processes a microphone that picks up a user's voice and a voice picked up by the microphone.

  The speaker device 123 is a functional block that generates a speaker that outputs audio toward the user and an audio signal that drives the speaker.

  The camera device 125 is a block that manages the collection of image data by taking a picture, the display device 122 is a block that controls the display of an image on the liquid crystal panel 101 (see FIG. 1), and the key device 124 is a user's various keys. The operation detection block, and the clock 126 is a block for acquiring the current time. The operation of the display device 122 is controlled by the CPU 110, and the display on the liquid crystal panel 101 is switched in accordance with an instruction from the CPU 110. The display device 122 and the CPU 110 correspond to an example of the image display means according to the present invention. FIG. 3 shows a display example when the CPU 110 and the display device 122 cooperate to display an image on the liquid crystal panel 101. In the present embodiment, as shown in FIG. 3, the vertical axis (AXISY) and the horizontal axis (in the two-dimensional coordinate space in which the current position of the mobile phone 100 is the origin ORG and the moving direction of the mobile phone 100 is the vertical axis upward ( The images are divided and displayed in four sections divided by (AXISX), and the direction P is displayed by an arrow above the images.

  The GPS device 140 is a device having a function of acquiring position information from three satellites out of 24 satellites and calculating a current position. The GPS device 140 operates in accordance with an instruction from the CPU 110 and receives position information from the satellites. Accordingly, the current position is acquired and transmitted to the CPU 110. The GPS device 140 and the CPU 110 correspond to an example of a current position acquisition unit according to the present invention, and further correspond to an example of a movement direction acquisition unit.

  The media controller 141 reads data from the loaded recording medium 142 and writes image data or the like generated by the camera device 125 to the recording medium 142.

  The short-range wireless device 131 is for transmitting an image, a telephone number, or the like to an external device at a short distance by infrared communication without going through a base station (not shown).

  The long-distance device 132 is for making a call or sending / receiving an e-mail via a base station (not shown). The long-distance device 132 is a device that can also be connected to the Internet, and a large amount of image information with position information is stored in a storage medium provided in a server that distributes image information on the Internet. This will be described below. In the following description, it is assumed that image information with position information captured mainly by a camera-equipped mobile phone with a GPS function is stored in the storage medium provided in the image server of this embodiment. The image information may be described as photographic information.

  That is, the user having the mobile phone 100 of FIG. 1 can download image information corresponding to the position information acquired by the GPS device 140 via the Internet through an operation from a storage medium included in the server. The long-distance device and the CPU 110 correspond to the image receiving means referred to in the present invention. In this example, the configuration of the mobile phone 100 which is a mobile terminal device has been described. However, the image server and the mobile phone 100 connected via the Internet constitute an example of the image display system of the present invention.

  The television device 133 is a block that converts radio waves received by an antenna into digital program data using a tuner and displays a program represented by the program data on the liquid crystal panel 101 (see FIG. 1).

  The mobile phone of the present embodiment has the above configuration.

  Here, the processing of the CPU 110 relating to all the configurations of the position information acquisition means, movement direction means, image segmentation means, image reception means, image display means, and origin determination means according to the present invention will be described. As described above, the CPU 110 according to the present embodiment constitutes position information acquisition means and movement direction acquisition means in cooperation with the GPS device 140, and also functions as image reception means according to the present invention in cooperation with the long-distance device 132. The image display means is configured in cooperation with the display device 122, and the CPU itself configures image segmentation means and origin determination means.

  FIG. 4 is a flowchart showing a procedure of processing executed by the CPU 110.

  The CPU 110 repeatedly executes the process of this flowchart at predetermined intervals.

  First, in step S401, current position information (latitude and longitude information) is acquired at predetermined intervals in cooperation with the GPS device 140. In the next step S402, the position information acquired in the process of the previous step S401 is read, and in the next step S403, the distance traveled while repeatedly executing the process of this flowchart is calculated. The distance can be obtained from the difference between latitude and longitude. When the distance traveled is calculated, the process proceeds to the next step S404, and the distance calculated this time is added to the distance obtained in the previous step S403 in step S404 to obtain the cumulative distance to update the cumulative distance. It is determined whether or not the cumulative distance updated in step S404 exceeds a predetermined distance Nkm. If it is determined in this step S405 that Nkm has not yet been exceeded, the process returns to step S401 and the processing from step S401 to step S405 is repeated.

  If it is determined in step S405 that Nkm has been exceeded, the process proceeds to the Yes side, and in step S406, the cumulative distance updated in step S404 is reset to zero. In the next step S407, the current position information acquired in step S401 is transmitted to the center using the transmission function of the long-distance device, and the photo information within Nkm around the current position is transmitted to the center using the reception function of the long-distance device. Download from the image server on the side. In the next step S408, it is determined whether or not the number of pieces of photo information acquired in step S407 is 0 or more. If it is determined that the number is 0, the process proceeds to No, and the display device 122 is instructed in step S409. “No information” is displayed on the display screen and the processing of this flow is completed.

  If it is determined in step S408 that the number of photographs is one or more, the process proceeds to Yes, and it is determined in step S410 whether or not the traveling direction can be calculated. In this step S410, it is determined whether or not the traveling direction can be calculated from the current position information acquired in step S401 and the previous current position information read in step S402. If the vehicle is stopped at a certain position and the current position information is the same as the current position information one time before, the traveling direction cannot be calculated. Therefore, the process proceeds to No and the traveling direction is set to the north without calculating θ in step S412. Considering the direction, θ = 0 is set, and the process proceeds to step S413. In step S413, a photo section mapping process is executed. Further, if the latitude is the same in the current position information and the current position information one time before, it means that the current position information is moving north.

  If the travel direction can be calculated in step S410, the process proceeds to the Yes side, and in step S411, the deviation angle θ from the north direction of the travel direction is determined from the current position information (latitude / longitude information) and the previous one. It is calculated from the difference between the current position information (latitude and longitude information), and the photo section mapping process is executed in the next step S413.

  Then, in step S414, the intra-section photo position calculation process is performed, and the photo position calculation process in the section is executed so that the photograph can be displayed according to the balance of the number of image information for each section. In step S415, it is determined which position in the display screen is the current position, that is, the origin, and in step S416, the photograph information acquired from the server is displayed on the display screen, and the processing of this flow is terminated.

  When the CPU 110 executes the processing of this flow, a plurality of images divided into a vertical axis (AXISY) and a horizontal axis (AXISX) are displayed side by side on the liquid crystal panel 101 as shown in FIG.

  As shown in FIG. 3, when an image divided with respect to the traveling direction is displayed, the user can immediately know which position is interesting.

  Here, with reference to FIG. 5, the details of the photo section mapping processing in step S413 in the flow of FIG. 4 necessary for performing the display of FIG. 3 will be described. Note that the number of photographs acquired in the process of S408 is M (M> 0).

  FIG. 5 is a flowchart for explaining the details of the photo section mapping processing.

  As shown in FIG. 5, first, in step S4131, it is determined whether or not θ is zero.

  If it is determined in step S4131 that θ is 0, the process proceeds to the Yes side, and M photos are processed one by one. In step S4132, it is determined whether there are still unprocessed photos. If it is determined that there are no photos to be processed, the process proceeds to step S4135, and the number of photos included in each section is counted in step S4135. End and proceed to step S414. If it is determined in step S4132 that there is an unprocessed photo, the process proceeds to the Yes side, one photo is taken out in step S4133, and the photo information is stored in four sections by referring to the position information added to the photo in step S4134. It is determined to which of the sections it belongs. Returning to step S4132, the processing from step S4132 to step S4134 is repeated for M sheets. If it is determined in step S4132 that there are no unprocessed photos, the process proceeds to No, and the number of photos in each section is counted in step S4135. The process of this flow is terminated, and the process proceeds to step S414 in FIG.

  On the other hand, if it is determined in step S4131 that θ is not 0, the process proceeds to the No side. In step S4136, it is determined whether there are still unprocessed photographs. If it is determined that there are no more photographs, the process proceeds to step S4135. The number of photos in the section is counted and the processing of this flow is finished.

  If it is determined in step S4136 that there is an unprocessed photo, the process proceeds to Yes, one photo is taken out in step S4137, and rotation processing is performed so that θ is set to 0 in step S4138. If rotation processing is performed, it will progress to step S4139 and it will be judged whether the photography information belongs to which division of four divisions with respect to the advancing direction. Returning to step S4136, the processing from step S4136 to step S4139 is repeated for M sheets. If it is determined in step S4136 that there are no more photos to be processed, the process proceeds to No and the number of photos in each section is counted in step S4135. The process of the lever is ended and the process proceeds to step S414 in FIG. The count value of the number of photographs in each section in step S4135 in this flow is used in the origin determination process in step S415 described later.

  The processing of FIG. 5 will be described in a more easily understandable manner with reference to FIG.

  FIG. 6 is a diagram for explaining the processing contents of the flow of FIG.

  FIG. 6A shows the processing contents of steps S4132 to S4134 when the CPU 110 determines Yes in step S4131, as shown in FIG. 5, and FIG. The processing contents of steps S4136 to S4139 when it is determined No in step S4131, are shown.

  As shown in FIG. 6A, when the CPU 110 determines Yes in step S4131, that is, when it is determined that the CPU 110 is moving in the north direction, the process proceeds from step S4132 to step S4134 in FIG. 4) The case classification processing shown in FIG.

  FIG. 6A shows the current position information acquired by the CPU 110 in cooperation with the GPS device as longitude X and latitude Y, and the position information (X, Y) as the origin and the mobile phone moving direction (north direction) as vertical. Four sections (right front A, left front B, left rear C, and right rear D), which are separated by a vertical axis and a horizontal axis, are shown in the two-dimensional coordinate space as axis information. Further, FIG. 6A also shows the processing contents executed when the CPU 110 divides the photograph information acquired from the image server into four sections (right front A, left front B, left rear C, right rear D). Yes.

  For example, if the position information added to the photo information is a photo coordinate point (x, y), the CPU 110 determines that the photo information is in the A (front right) section when x ≧ X and y ≧ Y. It is determined that it belongs.

  Further, the CPU 110 determines that the photo information belongs to the B (front left) section when x ≧ X and y <Y. Further, when x <X and y ≧ Y, it is determined that the photographic information belongs to the D (right rear) section, and when x <X and y <Y, the photographic information is C (Left left) Determined to belong to the section.

  Thus, as shown in FIG. 6 (a), when the moving direction of the mobile phone is the north direction, that is, when θ is 0, the position information added to the photo information is used as it is and is divided into four sections. Segment photo information.

  On the other hand, as shown in FIG. 6B, when the moving direction of the mobile phone is deviated from the north direction, that is, when θ is not 0, the vertical axis direction does not become the north direction. It is not possible to divide the photographic information into four sections by performing the process shown in (a).

  Therefore, in this case, the angle of deviation from the north direction is set to θ, the process of rotating the entire coordinates using the rotation formula of the trigonometric function is performed, and θ is converted to 0, and then the process shown in FIG. The same processing is performed. When the CPU 110 performs the process of FIG. 6A after performing the rotation process, the photograph information is accurately classified in each section of the display screen even if the process proceeds in any direction other than the north direction. Thus, the user can see the photo information and go to the position where the photo information is located. Also, when the rotation process is performed and the display is performed, the direction of the arrow indicating the azimuth calculated from the rotation angle is changed, so check the surrounding situation by referring to the map with reference to the direction of the arrow, that is, the direction be able to.

  Next, details of the intra-section photo position calculation processing in step S414 will be described. In this process, the photos assigned to the block in step 413 are rearranged in the block based on the positional relationship between the current position and the position information of the photo, that is, the photo close to the current position is arranged near the origin ORG. This is a process of rearranging the photos so that the photos away from the current position are arranged in a place away from the origin ORG.

  FIGS. 7A, 7B, and 7C are flowcharts showing details of step S414.

  In step S4401, it is determined whether there is a photograph determined as a result of step S413, for example, within the section B (see FIG. 6). If it is determined that there is a photograph, the process proceeds to the next step S41402, and a mesh that allows the photographs in the section to enter one by one is placed in the section in step S41402. The process of step S41402 will be described with reference to FIG.

  First, in step S414021, all the latitude differences are calculated from the position information of all the photos in the section, and the smallest latitude difference larger than 0 is obtained from these, and this is set as minY. Next, in step S414022, all longitude differences are calculated from the position information of all the photos in the section, and the minimum longitude difference larger than 0 is obtained from these, and this is set as minX. Next, proceeding to step S414023, the latitude and longitude, which are the positional information of all the photos in the section, are compared, a photo having the same latitude and longitude is detected, and the number of the photos is also counted. The number of sheets obtained as a result of step S414023 is m. In step S41024, it is determined whether m is greater than or equal to 0. If it is greater than or equal to 0, the process proceeds to step S41405. The processing from step S414025 to step S4140210 is processing for shifting the coordinate points of photographs having the same coordinate point. First, in step S414025, calculation is performed by substituting the value obtained by dividing the longitude difference by m into the value Δx for shifting the coordinate point of the photograph, that is, Δx = minX / m. Then, 0 is substituted for i of the number of photographs. Subsequently, in step S41026, one sheet is taken out from the photograph having the same coordinate point detected in step S414023. I × Δx is added to the longitude of the position information of the photograph. In step S414028, 1 is added to i. In step S414029, i and m are compared. If i is smaller than m, that is, if there is still an unprocessed photograph, the process returns to step S41026 and continues until m sheets are completed. If i is greater than or equal to m in step S414029, there is no unprocessed photo, so the process proceeds to step S4140210, and a longitude difference is calculated again from the photo whose coordinates have been corrected by the processing from step S414025 to step S4140210 and the other photos. A minimum longitude difference larger than 0 is obtained from the inside, and this is defined as minX. In step S4140211, a mesh is created so that the width becomes the latitude direction minY and the longitude direction minX. In step S4140212, one photo in the section is taken out. In step S440213, the position coordinates of the photo are compared with the mesh. In step S4140214, it is determined whether or not there is a photo in the section remaining. If YES in step S4140214, the process proceeds to S140212, and this is repeated for the number of photographs in the section. In step S4140214, if there are no more photos to be processed, the process ends. If m is 0 in step S410242, the process proceeds to step S4140211 and the processing after step S4140211 is as described above. In step S41402, the value for shifting the coordinates of the photos having the same position coordinates is determined from the longitude difference. However, this value may be obtained from the latitude difference. Although not shown in the flow, the coordinates corrected in step S414027 are returned to the original when the flow ends.

  If it is determined in step S41402 that a mesh that contains one photo at a time is determined, then the operation of filling the photo in the origin ORG direction indicating the current position is performed. First, in step S41403, one photograph is moved to the mesh in the origin ORG direction on the X axis (longitude axis). The process of step S41403 will be described with reference to FIG.

  In step S414301, 0 is substituted for the number of moving sheets. In step S414032, one photo is taken out of all the photos assigned to the mesh in step S41402, and in the next step S414033, it is determined whether there is a space next to the origin ORG direction on the X axis of the photo, step S414033. If it is determined that there is no free space, the process proceeds to NO and proceeds to step S414036. If it is determined in step S414033 that there is a vacancy, the process proceeds to step S414034. In step S414034, a process of moving one mesh to a vacant mesh is executed, and the process proceeds to step S414035. In step S414035, 1 is added to the number of moving sheets, and the process proceeds to step S414036. If it is determined in step S414036 that there are still unprocessed photos, the processing from step S414032 to step S414036 is repeated.

  If it is determined in step S414036 that there is no photo, the process ends and the number of moving sheets is returned.

  Following step S41403, the process proceeds to step S41404. In step S41404, a process of moving one photograph to the mesh in the origin ORG direction on the Y axis (latitude axis) is performed. This process is performed by changing the movement direction of the process of step S41403 to the origin ORG direction on the Y axis (latitude axis). In the next step S41405, it is determined whether or not the number of movements obtained as a result of steps S41403 and S41404 is 1 or more. If it is 1 or more, the process proceeds to the “Yes” side, and it is determined that there is still room for movement, and Steps S41403 to S41405 are repeated. If the number of moved sheets is 0 in step S41405, the process proceeds to “No”, and in step S41406, it is determined whether or not to process other sections in section A, section C, and section D (see FIG. 5). If it is determined that there is a partition to be moved, the process returns to step S4401 to repeat the series of processes. If it is determined in step S41406 that there is no partition, the process proceeds to No and the process of this flow is terminated.

    When the CPU 110 executes the processing of this flow, as shown in FIG. 3, the photo information is packed and displayed as much as possible and, as shown in FIG. 8, the current location and the positional relationship between the photos are maintained as much as possible. If so, a plurality of images divided into a vertical axis (AXISY) and a horizontal axis (AXISX) representing directions can be displayed side by side on the liquid crystal panel 101.

  Here, the processing of the flow of FIG.

  FIG. 8 is a diagram for explaining the processing in step S41403.

  FIG. 8 shows a diagram for explaining a situation when photographs are arranged and arranged in the B section.

  As shown in the upper left of FIG. 8, as a result of the process of step S41402 in FIG. 7, the mesh is touched so that one photo is placed in the mesh. If 1 to 10) are arranged, a blank space is generated.

  Therefore, in the present embodiment, the processing of displaying the photographic information in the process of step S41403 is performed, and the display is performed after the photographic information is aligned as shown in the lower right of FIG. When such processing is executed, the display as shown in FIG. 3 can be performed, and the photos can be arranged while maintaining the positional relationship between the current location and the photos as much as possible.

  Furthermore, in this embodiment, in order to obtain an easy-to-view screen, the origin coordinates representing the current position of the mobile phone on the display screen are determined according to the balance of the number of images in the four sections by the processing in step S415 in FIG. Then, a process of displaying the image divided into the sections on the display screen set based on the determined origin is performed.

  FIG. 9 is a diagram for explaining a display example when the image shown in FIG. 3 is displayed and the user holding the mobile phone moves Nkm and the screen is switched. FIG. 10 is a diagram for explaining a display example when a user having a mobile phone changes the moving direction to the southwest direction, for example.

  In the process of step S415 of FIG. 4, based on the balance of the number of images of the four sections divided by using the fact that the number of photo information in each section is counted in the process of step S4135 shown in FIG. For example, when it is determined that the number of images in the B section is large compared to the previous display, the origin position is determined at the position shown on the right side of FIG. 9 so that more image information is displayed in the section B. I have to. In this way, for example, when there is no image information in the A section, a large amount of image information in the B section with a large number of images is displayed, and information is appropriately provided according to the surrounding situation of the moving place. .

  Furthermore, in this embodiment, since the azimuth is calculated in step S411, as shown in FIG. 10, a change display of the azimuth P indicating which direction the traveling direction is is performed together with the photographic information. .

  For example, when the CPU 110 detects by the calculation of θ that the user having the mobile phone 100 has changed the traveling direction from north to southwest in the process of step S411, the CPU 110 performs the rotation process and displays on the liquid crystal panel 101. The images are switched as shown in FIG. 10, and the direction of the arrow of the direction P is also changed and displayed as shown in FIG. In this way, a user having a mobile phone can immediately grasp what is in which direction.

  That is, the cellular phone 100 according to the present embodiment is configured such that the origin coordinates representing the current position of the mobile terminal device on the display screen according to the balance of the number of images of the four sections divided by the image dividing means according to the present invention. Origin determining means for determining the image, and the image display means displays the image segmented by the image segmenting means in a section on the display screen set based on the origin determined by the origin determining means. It turns out that.

  In the example of FIG. 9, the user himself / herself scrolls the image on the liquid crystal panel 101 by selecting and manually operating the portion indicated by the symbol S on the liquid crystal panel 101 to FIG. The display can be switched to b).

  As described above, a mobile terminal device having a display function of image information that is easy for the user to understand is realized.

  In this embodiment, an example of a mobile phone having a telephone function as a mobile terminal device has been described. It may consist of a combination with a car navigation system having a function.

  Various forms of the present invention will be additionally described below.

(Appendix 1)
In a mobile terminal device including a communication unit that performs wireless communication and a display unit that displays an image on a display screen,
Position information acquisition means for acquiring current position information of the mobile terminal device;
Moving direction acquisition means for acquiring the current moving direction of the mobile terminal device;
Image receiving means for transmitting the current position of the mobile terminal device to an image server in which an image with position information is stored, and wirelessly receiving an image provided with position information around the current position of the mobile terminal device from the image server When,
Based on position information given to the image, the image received by the image receiving means is in a two-dimensional coordinate space with the current position of the mobile terminal device as the origin and the moving direction of the mobile terminal device as the vertical axis. Image partitioning means for partitioning into four sections divided by a vertical axis and a horizontal axis,
A mobile terminal apparatus, comprising: an image display unit configured to display an image segmented by the image segmenting unit in a section set on the display screen.

(Appendix 2)
Origin determining means for determining an origin coordinate representing the current position of the mobile terminal device on the display screen according to the balance of the number of images of the four sections divided by the image dividing means;
The image display means displays the image divided by the image dividing means in a section on the display screen set based on the origin determined by the origin determination means. The mobile terminal device according to attachment 1.

(Appendix 3)
The image display means displays the image divided by the image dividing means on the display screen, and calculates the positional relationship between the current position and the image from the current position and the positional information of the image for the image in the section. The mobile terminal device according to appendix 1, wherein an image close to the current position is arranged near the origin, and an image away from the current position is arranged away from the origin.

(Appendix 4)
The image display means displays the image sorted by the image sorting means on the display screen, and on the display screen, the upper direction of the display screen is a movement direction of the mobile terminal device. The mobile terminal device according to Supplementary Note 1, wherein the mobile terminal device displays the azimuth.

(Appendix 5)
The mobile terminal device according to appendix 1, wherein the mobile terminal device is a mobile phone having a telephone function and a GPS function.

(Appendix 6)
The mobile terminal device according to appendix 1, wherein the mobile terminal device comprises a combination of a mobile phone having a telephone function and a car navigation system mounted on a car and having a GPS function for acquiring current position information. .

(Appendix 7)
A mobile terminal device including a communication unit that performs wireless communication and a display unit that displays an image on a display screen, and an image with position information is accumulated and directed to the mobile terminal device in response to a transmission request from the mobile terminal device An image display system including an image server for transmitting an image,
The mobile terminal device
Position information acquisition means for acquiring current position information of the mobile terminal device;
Moving direction acquisition means for acquiring the current moving direction of the mobile terminal device;
Image receiving means for wirelessly receiving an image provided with position information around the current position of the mobile terminal device from an image server in which images with position information are stored;
Based on position information given to the image, the image received by the image receiving means is in a two-dimensional coordinate space with the current position of the mobile terminal device as the origin and the moving direction of the mobile terminal device as the vertical axis. Image partitioning means for partitioning into four sections divided by a vertical axis and a horizontal axis,
An image display system comprising: an image display unit configured to display an image divided by the image dividing unit in a section set on the display screen.

(Appendix 8)
Origin determining means for determining an origin coordinate representing the current position of the mobile terminal device on the display screen according to the balance of the number of images of the four sections divided by the image dividing means;
The image display means displays the image divided by the image dividing means in a section on the display screen set based on the origin determined by the origin determination means. The image display system according to appendix 7.

(Appendix 9)
The image display means displays the image divided by the image dividing means on the display screen, and calculates the positional relationship between the current position and the image from the current position and the positional information of the image for the image in the section. The image display system according to appendix 7, wherein an image close to the current position is arranged near the origin, and an image away from the current position is arranged away from the origin.

(Appendix 10)
The image display means displays the image sorted by the image sorting means on the display screen, and on the display screen, the upper direction of the display screen is a movement direction of the mobile terminal device. 8. The image display system according to appendix 7, wherein the image display system is displayed.

It is a figure which shows the structure of the mobile telephone which is one Embodiment of this invention. It is a figure which shows the structure of the mobile telephone which is one Embodiment of this invention. It is a figure which shows the example of a display on the liquid crystal panel 101 with which the mobile telephone of FIG. 1 is provided. It is a flowchart which shows the procedure of the process which CPU110 performs. It is a flowchart explaining the detail of the photograph division mapping process of step S413. It is a figure explaining the content of the process of the flow of FIG. It is a flowchart which shows the detail of step S414. It is a flowchart which shows the detail of step S41403 of Fig.7 (a). It is a flowchart which shows the detail of step S41402 of Fig.7 (a). It is a figure explaining the process of FIG. 7 clearly. FIG. 4 is a diagram for explaining a display example when the image shown in FIG. 3 is displayed and a user having a mobile phone moves Nkm and the screen is switched. It is a figure explaining the example of a display when the user with a mobile telephone changes the moving direction to the southwest direction, for example.

Explanation of symbols

100 mobile phone 100A upper casing 100B lower casing 101 liquid crystal panel (display screen)
102 Mouthpiece 110 CPU
111 ROM
112 Nonvolatile memory 113 RAM
121 Microphone device 121
122 display device 123 speaker device 124 key device 125 camera device 126 clock 131 short-range wireless device 132 long-range device 133 television device 140 GPS device 141 media controller 150 rechargeable battery
1-9 Image information in mesh

Claims (6)

In a mobile terminal device including an image server in which images with position information are stored, a communication unit capable of wireless communication via the Internet, and a display unit that displays an image on a display screen,
Position information acquisition means for acquiring current position information of the mobile terminal device;
Transmitting means for transmitting a peripheral image transmission request including the position information to the server;
A moving direction calculating means for calculating a current moving direction of the mobile terminal device;
Image receiving means for wirelessly receiving an image to which position information around the current position of the mobile terminal device is given from the image server;
Based on position information given to the image, the image received by the image receiving means is in a two-dimensional coordinate space with the current position of the mobile terminal device as the origin and the moving direction of the mobile terminal device as the vertical axis. Image partitioning means for partitioning into four sections divided by a vertical axis and a horizontal axis,
Image display means for displaying the divided image in the image segmentation unit, the display set in the compartment on the screen,
Origin determining means for determining an origin coordinate representing the current position of the mobile terminal device on the display screen according to the balance of the number of images of the four sections divided by the image dividing means;
The image display means displays the image divided by the image dividing means in a section on the display screen set based on the origin determined by the origin determination means. Mobile terminal device. The image display means displays the image divided by the image dividing means on the display screen, and calculates the positional relationship between the current position and the image from the current position and the positional information of the image for the image in the section. The mobile terminal apparatus according to claim 1, wherein an image close to the current position is arranged near the origin, and an image far from the current position is arranged away from the origin . The image display means displays the image sorted by the image sorting means on the display screen, and on the display screen, the upper direction of the display screen is a movement direction of the mobile terminal device. The mobile terminal apparatus according to claim 1 , wherein the direction is displayed . A mobile terminal device including a communication unit that performs wireless communication and a display unit that displays an image on a display screen, and an image with position information is accumulated and directed to the mobile terminal device in response to a transmission request from the mobile terminal device An image display system in which an image server for transmitting images is connected via the Internet,
  The mobile terminal device
  Position information acquisition means for acquiring current position information of the mobile terminal device;
  Transmitting means for transmitting a peripheral image transmission request including the position information to the image server;
  Moving direction acquisition means for acquiring the current moving direction of the mobile terminal device;
  Image receiving means for wirelessly receiving an image provided with position information around the current position of the mobile terminal device from the image server;
  Based on position information given to the image, the image received by the image receiving means is in a two-dimensional coordinate space with the current position of the mobile terminal device as the origin and the moving direction of the mobile terminal device as the vertical axis. Image partitioning means for partitioning into four sections divided by a vertical axis and a horizontal axis,
  Image display means for displaying the image divided by the image dividing means in a section set on the display screen;
  Origin determining means for determining an origin coordinate representing the current position of the mobile terminal device on the display screen according to the balance of the number of images of the four sections divided by the image dividing means;
  The image display means displays the image divided by the image dividing means in a section on the display screen set based on the origin determined by the origin determination means,
  The image server
  Peripheral image storage means storing a peripheral image including the position information;
  Based on the transmission request receiving means for receiving the peripheral image transmission request from the mobile terminal device and the positional information of the mobile terminal device included in the peripheral image transmission request, position information within a predetermined range is given. Image extracting means for extracting an image;
  Image transmitting means for transmitting the image to which the extracted position information is added to the mobile terminal device;
An image display system comprising: The image display means displays the image divided by the image dividing means on the display screen, and calculates the positional relationship between the current position and the image from the current position and the positional information of the image for the image in the section. 5. The image display system according to claim 4, wherein an image close to the current position is arranged near the origin, and an image far from the current position is arranged away from the origin . The image display means displays the image sorted by the image sorting means on the display screen, and on the display screen, the upper direction of the display screen is a movement direction of the mobile terminal device. The image display system according to claim 4 , wherein the orientation of the image is displayed.

Images