WO2016092823A1 - 画像表示端末、画像表示システム、画像表示プログラム、および画像表示方法 - Google Patents

画像表示端末、画像表示システム、画像表示プログラム、および画像表示方法 Download PDF

Info

Publication number
WO2016092823A1
WO2016092823A1 PCT/JP2015/006100 JP2015006100W WO2016092823A1 WO 2016092823 A1 WO2016092823 A1 WO 2016092823A1 JP 2015006100 W JP2015006100 W JP 2015006100W WO 2016092823 A1 WO2016092823 A1 WO 2016092823A1
Authority
WO
WIPO (PCT)
Prior art keywords
viewpoint
point
image
street view
viewpoint change
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2015/006100
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
拡基 鵜飼
安保　正敏
木村　洋介
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Denso Corp
Original Assignee
Denso Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Denso Corp filed Critical Denso Corp
Publication of WO2016092823A1 publication Critical patent/WO2016092823A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the present disclosure relates to an image display terminal, an image display system, an image display program, and an image display method.
  • street view is one of the online map services.
  • a display object for example, a store
  • an image display terminal such as a multifunctional mobile phone selects point information (POI (Point Of Interest) name) of the display object.
  • POI information including the location (latitude and longitude) are transmitted to the server via the communication network.
  • the server receives the spot information from the image display terminal, the server specifies a viewpoint that is closest to the spot of the received spot information (closest to the spot). Then, the server transmits a street view image in which a direction from the identified viewpoint to the point of the point information is captured to the image display terminal via the communication network.
  • the image display terminal Upon receiving the street view image from the server, the image display terminal displays the received street view image. Thereby, the user can confirm the state around the desired display object from the viewpoint from the road.
  • Patent Document 1 discloses a technique for displaying a street view image by changing the viewpoint in an image display terminal.
  • a user performs an operation (swipe operation) of tracing the touch panel with a fingertip to change the viewpoint of the street view image and display it.
  • an operation swipe operation
  • the user performs the tracing operation with the fingertip
  • it is possible to acquire a street view image from a desired viewpoint by adjusting the tracing direction and the tracing distance (the moving direction and moving amount of the fingertip). That is, it is useful for a request to acquire a street view image from a desired viewpoint.
  • the viewpoint turns once (360 degrees) and returns to the current viewpoint, so it is necessary to watch the screen from the start to the end of the tracing operation.
  • the tracing operation may be divided into a plurality of times.
  • the change amount of the viewpoint in one tracing operation is limited to a relatively small size, so that there is a high possibility that the tracing operation needs to be divided into a plurality of times.
  • the operation is performed in response to a request to acquire a street view image from a different viewpoint different from the current viewpoint for the time being. Not enough in terms of sex.
  • This disclosure is intended to provide an image display terminal, an image display system, an image display program, and an image display method that can improve the operability when a street view image is displayed with a viewpoint changed.
  • the image display terminal shoots a spot information setting device that sets spot information of a display object, and a direction from the viewpoint toward the spot of the spot information set by the spot information setting device.
  • An image acquisition device that acquires the street view image obtained from the server, a display control device that causes the display device to display the street view image acquired by the image acquisition device, and an operation reception device that receives a touch operation of the operation device by a user .
  • the touch operation by the user is displayed on the display device while the street view image before the viewpoint change in which the direction from the viewpoint before the viewpoint change to the point before the viewpoint change is captured is displayed on the display device.
  • the display control device causes the display device to display the street view image after the viewpoint change acquired by the image acquisition device.
  • the user simply touches the operation means, and the street view image before the viewpoint change is changed from the street view image before the viewpoint change.
  • the display can be switched to a street view image.
  • just by performing a touch operation that is simpler than the tracing operation the state around the desired display object can be confirmed from a viewpoint from a viewpoint that is different from the viewpoint before the viewpoint is changed. For the time being, it is possible to improve the operability in response to a request for acquiring a street view image from a different viewpoint different from the current viewpoint.
  • an image display system includes the image display terminal described in the first aspect and a server that provides a street view image.
  • the user simply touches the operation means, and the street view image before the viewpoint change is changed from the street view image before the viewpoint change.
  • the display can be switched to a street view image.
  • just by performing a touch operation that is simpler than the tracing operation the state around the desired display object can be confirmed from a viewpoint from a viewpoint that is different from the viewpoint before the viewpoint is changed. For the time being, it is possible to improve the operability in response to a request for acquiring a street view image from a different viewpoint different from the current viewpoint.
  • the image display program includes a first procedure for setting spot information of a display object in the control device of the image display terminal, and spot information set by the first procedure from a viewpoint.
  • a second procedure for acquiring from the server a street view image in which the direction toward the point is taken, a third procedure for displaying the image acquired by the second procedure on the display device, and a viewpoint before the viewpoint change A fourth procedure for determining whether or not the user has accepted a touch operation of the operation device while displaying the street view image before the viewpoint change captured on the display device in the direction from the viewpoint to the point before the viewpoint change; If the fourth procedure determines that the touch operation has been accepted, the viewpoint after the viewpoint change is different from the viewpoint before the viewpoint change.
  • the fifth procedure for acquiring from the server the street view image after the viewpoint change in which the direction toward the point after the viewpoint change is captured, and the display of the street view image after the viewpoint change acquired through the fifth procedure is displayed.
  • a sixth procedure to be displayed on the apparatus A sixth procedure for acquiring from the server the street view image after
  • the user simply touches the operation means to perform the operation after changing the viewpoint from the street view image before changing the viewpoint.
  • the display can be switched to a street view image.
  • just by performing a touch operation that is simpler than the tracing operation the state around the desired display object can be confirmed from a viewpoint from a viewpoint that is different from the viewpoint before the viewpoint is changed. For the time being, it is possible to improve the operability in response to a request for acquiring a street view image from a different viewpoint different from the current viewpoint.
  • the image display method sets the point information of the display target and acquires a street view image in which the direction from the viewpoint toward the point of the set point information is captured from the server. And displaying the acquired image on the display device, and displaying the street view image before the viewpoint change in which the direction from the viewpoint before the viewpoint change to the point before the viewpoint change is captured on the display device If it is determined whether or not the touch operation of the controller device by the user has been accepted, and if it is determined that the touch operation by the user has been accepted, the viewpoint after the viewpoint change is changed from another viewpoint that is different from the viewpoint before the viewpoint is changed. Acquiring from the server a street view image after changing the viewpoint in which the direction to the point was taken, and Comprising a possible to display the street view image after the point change on the display device.
  • the user simply touches the operation means, and the street view image before the viewpoint change is changed from the street view image before the viewpoint change.
  • the display can be switched to a street view image.
  • just by performing a touch operation that is simpler than the tracing operation the state around the desired display object can be confirmed from a viewpoint from a viewpoint that is different from the viewpoint before the viewpoint is changed. For the time being, it is possible to improve the operability in response to a request for acquiring a street view image from a different viewpoint different from the current viewpoint.
  • FIG. 1 is a diagram illustrating an overall configuration of the image display system according to the first embodiment.
  • FIG. 2 is a diagram schematically showing viewpoints.
  • FIG. 3 is a diagram showing a map screen.
  • FIG. 4 is a diagram (part 1) showing a street view screen.
  • FIG. 5 is a flowchart (part 1) showing processing of the image display terminal and the server,
  • FIG. 6 is a diagram (part 2) showing the street view screen.
  • FIG. 7 is a diagram (part 3) showing the street view screen.
  • FIG. 8 is a diagram (part 4) showing the street view screen.
  • FIG. 9 is a diagram (part 5) showing the street view screen.
  • FIG. 5 is a diagram illustrating an overall configuration of the image display system according to the first embodiment.
  • FIG. 2 is a diagram schematically showing viewpoints.
  • FIG. 3 is a diagram showing a map screen.
  • FIG. 4 is a diagram (part 1) showing a street view screen.
  • FIG. 5 is a
  • FIG. 10 is a diagram illustrating an aspect of determining a viewpoint after a viewpoint change
  • FIG. 11 is a diagram (part 1) showing the transition of the street view screen.
  • FIG. 12 is a diagram (part 2) showing the transition of the street view screen.
  • FIG. 13 is a flowchart (part 2) illustrating the processing of the image display terminal and the server
  • FIG. 14 is a flowchart (part 3) illustrating the processing of the image display terminal and the server
  • FIG. 15 is a diagram illustrating an aspect of determining a viewpoint after a viewpoint change according to the second embodiment.
  • FIG. 16 is a flowchart (part 4) illustrating the processing of the image display terminal and the server.
  • the image display system 1 includes an image display terminal 2 and a server 3, and both are configured to be capable of data communication via a communication network (including the Internet).
  • a so-called smartphone multifunctional mobile phone
  • An unspecified number of image display terminals 2 can access the server 3.
  • the image display terminal 2 includes a control unit 21 (corresponding to a control device), a memory 22, a user interface (UI (User Interface)) unit 23, a display unit 24 (corresponding to a display device), a communication unit 25, And a camera 26.
  • the control unit 21 includes a microcomputer having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and an I / O (Input / Output).
  • the memory 22 is composed of, for example, a semiconductor storage element or the like, and stores a computer program.
  • the control unit 21 executes a computer program stored in the memory 22 and controls the overall operation of the image display terminal 2.
  • the user interface unit 23 is configured by a touch panel, a mechanical switch, or the like formed on the screen of the display unit 24.
  • an operation detection signal indicating the operation content is sent to the control unit 21.
  • the display unit 24 is configured by, for example, a liquid crystal display or the like.
  • a display command signal is input from the control unit 21, the display unit 24 displays (draws) a screen specified by the input display command signal.
  • the communication unit 25 controls data communication with the server 3 via the communication network.
  • the camera 26 includes a CCD (Charge-Coupled Device) image sensor and a CMOS (Complementary Metal-Oxide Semiconductor) image sensor, and performs an imaging operation.
  • CCD Charge-Coupled Device
  • CMOS Complementary Metal-Oxide Semiconductor
  • the image display terminal 2 has a function of inputting a voice uttered by a user as a transmitted voice, a function of outputting a voice received from a communication partner via a communication network as a received voice, a telephone directory It has various well-known functions related to the telephone such as a function for storing data.
  • the control unit 21 includes a spot information setting unit 21a (corresponding to a spot information setting device), an image acquisition unit 21b (corresponding to an image acquisition device), a display control unit 21c (corresponding to a display control device), and an operation receiving unit 21d. (Corresponding to an operation receiving device).
  • the point information setting unit 21a, the image acquisition unit 21b, the display control unit 21c, and the operation reception unit 21d are configured by a computer program (including an image display program) executed by the control unit 21, and are realized by software. .
  • the point information setting unit 21a sets the point information of the display object selected by the user.
  • the point information is POI information including a POI (Point Of Interest) name and a point (latitude and longitude).
  • the image acquisition unit 21b transmits the set spot information from the communication unit 25 to the server 3 via the communication network, and changes the viewpoint from the viewpoint to the spot of the spot information.
  • the street view image in which the direction to go is photographed is received from the server 3 by the communication unit 25 and acquired.
  • a viewpoint is a point on a road on which a vehicle (automobile) equipped with an omnidirectional camera travels.
  • the street view image is an image of a landscape along the road taken by an omnidirectional camera mounted on the vehicle.
  • the display control unit 21c causes the display unit 24 to display the street view image acquired by the image acquisition unit 21b.
  • the operation receiving unit 21d receives an operation performed on the user interface unit 23 by the user.
  • Operations that the user performs on the touch panel constituting the user interface unit 23 include touch operation (pressing (tapping) the screen once with the fingertip, consenting to the tap operation), double touch operation (pressing the screen twice with the fingertip).
  • the server 3 includes a control unit 31, a memory 32, a storage unit 33, and a communication unit 34.
  • the control unit 31 includes a microcomputer having a CPU, ROM, RAM, and I / O.
  • the memory 32 is composed of, for example, a semiconductor storage element or the like, and stores a computer program.
  • the control unit 31 executes a computer program stored in the memory 32 and controls the overall operation of the server 3.
  • the storage unit 33 includes a storage medium such as a hard disk, and includes a map database 33a that stores a map and an image database 33b that stores a street view image.
  • the map stored in the map database 33a includes viewpoint points (latitude and longitude) on the road.
  • the communication unit 34 controls data communication with the image display terminal 2 via a communication network.
  • the control unit 31 includes a direction specifying unit 31a, an image extracting unit 31b, and an image providing unit 31c.
  • the direction specifying unit 31a, the image extracting unit 31b, and the image providing unit 31c are configured by a computer program executed by the control unit 31, and are realized by software.
  • the direction identification unit 31a identifies the location of the location information, searches the map database 33a, and is closest to the identified location (from the nearest location to the nearest location). Identify the viewpoint.
  • specification part 31a determines the relative positional relationship on the map of the specified viewpoint and the point of point information, and specifies the direction which goes to the point of point information from a viewpoint.
  • the image extracting unit 31b searches the image database 33b and selects the street in the specified direction from the omnidirectional street view images corresponding to the specified viewpoint. Extract (cut out) the view image.
  • the image providing unit 31c causes the communication unit 34 to transmit the extracted street view image to the image display terminal 2 via the communication network.
  • a front road 51 is laid on the front side (front side) of the site G where the display object D (for example, a store or the like) is erected, and a back road 52 on the back side (back side) of the site G.
  • a side road 53 is laid on the side of the site G.
  • a parking space E is provided in the site G.
  • a vehicle equipped with an omnidirectional camera travels along the front road 51, the back road 52, and the side road 53, so that viewpoints 51a to 51j are set on the front road 51 and view points 52a to 52k are set on the back road 52.
  • viewpoints 53a to 53d are set.
  • viewpoints 51a to 51j, 52a to 52k, and 53a to 53d are set at substantially equal intervals.
  • the image database 33b of the server 3 stores street view images corresponding to the viewpoints 51a to 51j, 52a to 52k, and 53a to 53d of the front road 51, the back road 52, and the side road 53, respectively. Yes.
  • the image display terminal 2 activates the map application when the user performs an activation operation of the map application, and displays a map screen M1 including a map image of a region designated by the user as shown in FIG.
  • a map image display area 101 where a map image is displayed and a selection item display area 102 where a selection item is displayed are lined up and down.
  • the map image display area 101 displays a map image of the surrounding area including the point information (convenience store B in FIG. 3) currently selected by the user in the selection item display area 102, and a map button that can be touch-operated by the user 101a is formed (superimposed display) on the map image.
  • the user can switch the display from the map screen to the street view screen by touching the map button 101a.
  • the image display terminal 2 shifts from the map display mode to the street view display mode when the user touches the map button 101a.
  • the point information being selected is set, and an image request signal including the set point information is transmitted to the server 3 via the communication network.
  • the server 3 receives the image request signal from the image display terminal 2, the server 3 selects the viewpoint (closest to the point) closest to the point of the point information (point O in FIG. 2) included in the received image request signal. Identify. Then, the server 3 transmits to the image display terminal 2 via the communication network an image response signal including a street view image in which the direction from the identified viewpoint to the point of the point information is captured.
  • the image display terminal 2 When receiving the image response signal from the server 3, the image display terminal 2 displays a street view screen M2 including the street view image included in the received image response signal, as shown in FIG.
  • a street view image display area 201 in which a street view image is displayed and a selection item display area 202 in which selection items are displayed are lined up and down.
  • the street view image display area 201 displays a street view image of the surrounding area including the point information (convenience store B in FIG. 4) currently selected by the user in the selection item display area 202, and can be touched by the user.
  • a street view button 201a is formed on the street view image.
  • the point O of the point information is often set to a part of the display object D (for example, an entrance of a store). Therefore, as shown in FIG. 2, when the display object D is erected on the back road 52 side in the site G due to various circumstances such as securing a large number of parking spaces E and entering and leaving the vehicle.
  • the viewpoint closest to the point O of the point information is set as the viewpoint 52e of the back road 52.
  • a street view image in which the direction from the view point 52e toward the point O of the point information is captured, that is, a street view image on the back of the display object D is displayed, which is not preferable for the user.
  • a street view image is displayed.
  • the image display terminal 2 and the server 3 perform the operation
  • the control part 21 will start a map application (A2).
  • the control unit 21 causes the display unit 24 to display a map screen M1 including a map image of a region designated by the user (A3).
  • the user touches the map button 101a.
  • the control unit 21 determines that an operation for switching display from the map screen to the street view screen has been performed by the user touching the map button 101a (A4: YES)
  • the control unit 21 shifts from the map display mode to the street view display mode. (A5).
  • the selected point information is set (A6, first procedure), and an image request signal including the set point information is transmitted from the communication unit 25 via the communication network.
  • the server 3 is transmitted (A7).
  • the control unit 31 when the control unit 31 receives the image request signal from the image display terminal 2 through the communication unit 34 (B 1), the control unit 31 is closest to the point O of the point information included in the received image request signal (point O The nearest viewpoint is identified (B2). Then, the control unit 31 extracts a street view image in which a direction from the identified view point toward the point O of the point information is captured, and an image response signal including the extracted street view image is transmitted from the communication unit 34 to the communication network. Is transmitted to the image display terminal 2 via (B3).
  • control unit 31 sets the viewpoint 52e of the back road 52 as the viewpoint closest to the point O, and a street view image in which the direction from the viewpoint 52e of the back road 52 toward the point O is captured, that is, a display target An image response signal including a street view image on the back of the object D is transmitted.
  • the control unit 21 receives the image response signal from the server 3 via the communication unit 24 (A8, second procedure), as shown in FIG. 6, the control unit 21 is included in the received image response signal.
  • a street view screen M3 including the existing street view image is displayed on the display unit 24 (A9, third procedure).
  • the control unit 21 forms a viewpoint switching button 201b (corresponding to an operation device) that can be touch-operated by the user on the street view image in addition to the street view button 201a shown in FIG. (Overlapping display). That is, in the conventional street view screen M2 shown in FIG. 4, only the street view button 201a is formed, but in the street view screen M3 of the present disclosure shown in FIG.
  • a viewpoint switching button 201b is provided. Is formed. While the street view screen M3 is being displayed, the control unit 21 waits for a touch operation on either the street view button 201a or the viewpoint switching button 201b.
  • the control unit 21 determines that the user has performed a viewpoint change operation by touching the viewpoint switching button 201b (A10: YES, fourth procedure).
  • the control unit 21 specifies a virtual spot based on the spot O of the spot information ( A11).
  • the point O of the point information is a point before the viewpoint is changed, and the virtual point is a point after the viewpoint is changed.
  • the control unit 21 specifies the length of the line segment L0 connecting the point O of the point information and the current view point (view point before changing the viewpoint) 52e.
  • control unit 21 specifies a line segment L1 that is equal to the length of the line segment L0 and forms 90 degrees clockwise with the line segment L0, and uses the end point of the line segment L1 as a virtual point P1. Identify. And the control part 21 transmits the image request signal containing the virtual spot P1 specified in this way to the server 3 via a communication network from the communication part 25 (A12).
  • the control unit 31 when the control unit 31 receives the image request signal from the image display terminal 2 through the communication unit 34 (B4), the control unit 31 is closest to the virtual point P1 included in the received image request signal (from the virtual point P1). Identify the nearest viewpoint (B5). Then, the control unit 31 extracts a street view image in which the direction from the identified view point toward the virtual point P1 is captured, and an image response signal including the extracted street view image is transmitted from the communication unit 34 via the communication network. To be transmitted to the image display terminal 2 (B6).
  • control unit 31 specifies the viewpoint 53c of the side road 53 as the viewpoint closest to the virtual spot P1, and a street view image in which the direction from the viewpoint 53c of the side road 53 toward the virtual spot P1 is captured, that is, An image response signal including a street view image on the front right side of the display object D is transmitted.
  • the control unit 21 when the control unit 21 receives the image response signal from the server 3 via the communication unit 24 (A13, fifth procedure), the control unit 21 includes the received image response signal as shown in FIG. A street view screen M4 including the existing street view image is displayed on the display unit 24 (A14, sixth procedure). Again, the control unit 21 forms the viewpoint switching button 201b that can be touch-operated by the user on the street view image. Thereby, when the user performs an operation of switching the display from the map screen M1 to the street view screen M3, immediately after that, the street view image on the back of the display object D is displayed first, but the viewpoint switching button 201b is pressed.
  • the display By performing a touch operation, the display can be switched from the street view image on the back of the display object D to the street view image on the front right side of the display object D. That is, the user can confirm the state of the front right side of the display object D from the viewpoint from the side road 53.
  • the control unit 21 repeats the same procedure every time the user touches the viewpoint switching button 201b. That is, when the control unit 21 determines that the user has touched the viewpoint switching button 201b while the street view screen M4 illustrated in FIG. 7 is being displayed, the control unit 21 is equal to the length of the line segment L0 as illustrated in FIG. A line segment L2 that forms 180 degrees (90 degrees ⁇ 2) in the clockwise direction with the line segment L0 is specified, and an end point of the line segment L2 is specified as a virtual point P2. Then, the control unit 21 causes the image request signal including the identified virtual point P2 to be transmitted from the communication unit 25 to the server 3 via the communication network.
  • the control unit 31 specifies the viewpoint 51e of the front road 51 as the viewpoint closest to the virtual spot P2, and the direction from the viewpoint 51e of the front road 51 toward the virtual spot P2 is photographed.
  • An image response signal including a street view image that is, a street view image directly in front of the display object D is transmitted.
  • the control unit 21 displays a street view screen M5 including a street view image directly in front of the display object D as shown in FIG. 24. Accordingly, the user can switch the display to a street view image directly in front of the display object D by touching the viewpoint switching button 201b. That is, the user can confirm the state of the front of the display object D from the viewpoint from the front road 51.
  • control unit 21 determines that the user has touched the viewpoint switching button 201b while the street view screen M5 shown in FIG. 8 is being displayed, the control unit 21 is equal to the length of the line segment L0 as shown in FIG. A line segment L3 forming 270 degrees (90 degrees ⁇ 3) in the clockwise direction with the line segment L0 is specified, and an end point of the line segment L3 is specified as a virtual point P3. Then, the control unit 21 causes the image request signal including the identified virtual point P3 to be transmitted from the communication unit 25 to the server 3 via the communication network.
  • the control unit 31 specifies the viewpoint 52g of the back road 52 as the viewpoint closest to the virtual point P3, and the street view in which the direction from the view point 52g of the back road 52 toward the virtual point P3 is captured.
  • An image response signal including an image, that is, a street view image of the rear left side surface of the display object D is transmitted.
  • the control unit 21 displays a street view screen M6 including a street view image on the rear left side surface of the display object D as shown in FIG. It is displayed on the display unit 24.
  • the user can switch the display to the street view image on the left side of the back surface of the display object D by touching the viewpoint switching button 201b. That is, the user can confirm the state of the left side surface of the display object D from the viewpoint from the back road 52.
  • the street view image displayed on the street view screen M3 is the street view image before the viewpoint change
  • the street view images displayed on the street view screens M4 to M6 are the street view image after the viewpoint change. It is.
  • control unit 21 determines that the user has touched the viewpoint switching button 201b while the street view screen M6 illustrated in FIG. 9 is being displayed, the control unit 21 determines that the viewpoint has circulated, and the first street illustrated in FIG.
  • the view image that is, the street view screen M3 including the street view image on the back of the display object D is displayed again on the display unit 24 (returns to the initial display).
  • the control unit 2 performs the series of processes described above, and displays the street view image by changing the viewpoint in conjunction with the user touching the viewpoint switching button 201b.
  • the user since the user does not need to perform the operation of tracing the touch panel with the fingertip, it is not necessary to adjust the tracing direction and the tracing distance to some extent, and it is not necessary to keep an eye on the screen from the start to the end of the tracing operation. That is, the user can change the viewpoint and display the street view image only by performing a simple operation of touching the viewpoint switching button 201b with the fingertip.
  • the screens may be displayed in any order. That is, by changing the change angle from the state where the first street view screen M3 is displayed in the order of 180 degrees, 90 degrees, and 270 degrees, as shown in FIG. 12, the street view screens M3, M5, M4, You may display in order of M6.
  • the images may be displayed in a counterclockwise order such as street view screens M3, M6, M5, and M4.
  • the change angle is not limited to three, but may be one or more.
  • the change amount of the viewpoint is 180 degrees, which is the maximum. Further, if the display object D is, for example, a large store, the state around the display object D can be confirmed from more viewpoints by increasing the change angle. Further, the user may arbitrarily set the magnitude and number of change angles and the change order.
  • a street view image in which a direction from the viewpoint closest to the virtual spot to the virtual spot is displayed by using the virtual spot as the spot after the viewpoint change is displayed. May be used as the point after the viewpoint change, and a street view image in which the direction from the viewpoint closest to the virtual point toward the point before the viewpoint change is captured may be displayed.
  • a street view image in which the direction from the view point 53c of the side road 53, the view point 51e of the front road 51, and the view point 52g of the back road 52 toward the point O of the point information is displayed. good.
  • the server 3 may specify a virtual spot.
  • the viewpoint change is performed.
  • the image request signal including the point O of the point information and the current viewpoint as the operation information is transmitted from the communication unit 25 to the server 3 via the communication network (A21).
  • the control unit 31 when the control unit 31 receives an image request signal from the image display terminal 2 via the communication unit 34 (B 21), the point O of the point information and the current viewpoint included in the received image request signal are displayed. Is used to specify the virtual point P1 in the same manner as described above (B22). Then, the control unit 31 specifies the viewpoint closest to the identified virtual point P1 (closest to the virtual point P1) (B23). An image response signal including a street view image taken in the direction from the identified viewpoint to the virtual point P1 is transmitted from the communication unit 34 to the image display terminal 2 via the communication network (B24).
  • the control unit 21 when the control unit 21 receives the image response signal from the server 3 through the communication unit 24 (A22), as shown in FIG. 7, the control unit 21 displays the street view image included in the received image response signal. Including the street view screen M4 is displayed on the display unit 24 (A23).
  • the control unit 31 specifies the virtual points P2 and P3 by the same procedure.
  • the viewpoint switching button 201b is formed on the street view screens M3 to M6, and when the viewpoint switching button 201b is touched, the street view image is changed and displayed.
  • the street view image can be changed and displayed only by performing a simple operation in which the user touches the viewpoint switching button 201b. That is, the operability can be improved in response to a request for acquiring a street view image from a different viewpoint different from the current viewpoint.
  • the first embodiment is configured to change the viewpoint by specifying a virtual spot, but the second embodiment is configured to change the viewpoint by specifying a reference line.
  • the control unit 21 determines that the user has performed a viewpoint change operation by touching the viewpoint switching button 201b (A10: YES, fourth procedure)
  • the control unit 21 sets a reference line based on the point O of the point information.
  • Specify A31
  • the control unit 21 rotates clockwise between the line segment L0 connecting the point O of the point information and the current viewpoint (viewpoint before changing viewpoint) 52e.
  • a reference line L11 forming 90 degrees is specified.
  • the control unit 21 causes the communication unit 25 to transmit an image request signal including the reference line L11 thus identified and the predetermined distance r set in advance to the server 3 via the communication network (A32).
  • the control unit 31 when the control unit 31 receives the image request signal from the image display terminal 2 through the communication unit 34 (B 31), the control unit 31 specifies the predetermined distance r included in the received image request signal, and A viewpoint that is within a predetermined distance r from O and is closest to the reference line L11 is specified (B32). And the control part 31 transmits the image response signal containing the street view image by which the direction which goes to the point O of the point information from the identified viewpoint was image
  • the control unit 31 specifies the viewpoint 53c of the side road 53 as a viewpoint that is within a predetermined distance r from the point O of the point information and is closest to the reference line L11, and from the viewpoint 53c of the side road 53 An image response signal including a street view image in which the direction toward the point O of the point information is captured, that is, a street view image on the front right side of the display object D is transmitted.
  • the control unit 21 when the control unit 21 receives the image response signal from the server 3 via the communication unit 24 (A33, fifth procedure), the control unit 21 includes a street including the street view image included in the received image response signal.
  • the view screen is displayed on the display unit 24 (A34, sixth procedure).
  • the control unit 21 forms the viewpoint switching button 201b that can be touch-operated by the user on the street view image.
  • the viewpoint switching button 201b can be touch-operated by the user on the street view image.
  • the control unit 21 repeats the same procedure every time the user touches the viewpoint switching button 201b. That is, when the user touches the viewpoint switching button 201b, the control unit 21 specifies the reference line L12 that forms 180 degrees (90 degrees ⁇ 2) in the clockwise direction with the line segment L0. In this case, the control unit 21 causes the display unit 24 to display a street view screen including a street view image in which a direction from the view point 51e of the front road 51 toward the point O of the point information is captured. When the user further touches the viewpoint switching button 201b, the control unit 21 specifies a reference line L13 that forms 270 degrees (90 degrees ⁇ 3) in the clockwise direction with the line segment L0.
  • control unit 21 causes the display unit 24 to display a street view screen including a street view image in which a direction from the view point 52 i of the back road 52 toward the point O of the point information is captured.
  • the user can arbitrarily set the size and number of change angles and the change order, and can set a predetermined distance.
  • the image display terminal 2 is not limited to specifying the reference line, and the server 3 may specify the reference line.
  • the viewpoint change is performed in the image display terminal 2 when the control unit 21 determines that the user has performed a viewpoint change operation by touching the viewpoint switching button 201b (A10: YES).
  • the image request signal including the point O of the point information, the current viewpoint, and the predetermined distance r as the operation information is transmitted from the communication unit 25 to the server 3 via the communication network (A41). ).
  • the control unit 31 when the control unit 31 receives the image request signal from the image display terminal 2 by the communication unit 34 (B41), the point O of the point information included in the received image request signal, the current viewpoint, The reference line L11 is specified in the same manner as described above using the predetermined distance r (B42). And the control part 31 pinpoints the viewpoint which exists in the range of the predetermined distance r from the point O of point information, and is the nearest to the reference line L11 (B43), and changes to the point O of point information from the specified viewpoint.
  • An image response signal including a street view image taken in the direction to go is transmitted from the communication unit 34 to the image display terminal 2 via the communication network (B44).
  • the control unit 21 when the control unit 21 receives the image response signal from the server 3 through the communication unit 24 (A42), the control unit 21 displays a street view screen including the street view image included in the received image response signal. 24 (A43).
  • the control unit 31 specifies the reference lines L12 and L13 by the same procedure.
  • the same operational effects as those of the first embodiment can be obtained. That is, the user can display the street view image by changing the viewpoint only by performing a simple operation of touching the viewpoint switching button 201b. For the time being, a street view image from a different viewpoint from the current viewpoint can be displayed. The operability can be improved in response to a request for acquisition.
  • a smartphone is exemplified as the image display terminal, but a simple mobile phone having a display area smaller than the smartphone or a tablet terminal having a display area larger than the smartphone may be used.
  • the configuration in which the display of the street view image is switched by one change angle (90 degrees in FIG. 10) every time a touch operation is performed is illustrated. It may be broken. For example, when a double touch operation is performed, the display of the street view image may be switched by two change angles (180 degrees in FIG. 10). In addition, when a long touch operation is performed, the display of the street view image may be continuously switched while the fingertip is touching the screen. That is, the touch operation as used in the present disclosure may be any number of times or a period of time when the fingertip touches the screen as long as the movement of the fingertip is different from the tracing operation.
  • each section is expressed as, for example, A1. Further, each section can be divided into a plurality of subsections, while a plurality of sections can be combined into one section. Further, each section configured in this manner can be referred to as a device, module, or means.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
PCT/JP2015/006100 2014-12-12 2015-12-08 画像表示端末、画像表示システム、画像表示プログラム、および画像表示方法 Ceased WO2016092823A1 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2014252144A JP6358072B2 (ja) 2014-12-12 2014-12-12 画像表示端末、画像表示システム及び画像表示プログラム
JP2014-252144 2014-12-12

Publications (1)

Publication Number Publication Date
WO2016092823A1 true WO2016092823A1 (ja) 2016-06-16

Family

ID=56107035

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/006100 Ceased WO2016092823A1 (ja) 2014-12-12 2015-12-08 画像表示端末、画像表示システム、画像表示プログラム、および画像表示方法

Country Status (2)

Country Link
JP (1) JP6358072B2 (enExample)
WO (1) WO2016092823A1 (enExample)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USD886135S1 (en) 2016-11-23 2020-06-02 Google Inc. Display screen with animated graphical user interface
CN112487244A (zh) * 2020-12-14 2021-03-12 北京梧桐车联科技有限责任公司 街景显示方法、装置及存储介质

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10853643B2 (en) 2017-10-27 2020-12-01 Rakuten, Inc. Image extraction device, image extraction method, and image extraction program
JP7102275B2 (ja) 2018-07-30 2022-07-19 本田技研工業株式会社 表示制御装置及びプログラム

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070273712A1 (en) * 2006-05-26 2007-11-29 O'mullan Beth Ellyn Embedded navigation interface
JP2013020008A (ja) * 2011-07-08 2013-01-31 Mic Ware:Kk 地図表示装置、地図表示方法、プログラム、およびデータ構造
JP2013534656A (ja) * 2010-06-02 2013-09-05 マイクロソフト コーポレーション 適応的で革新的なモバイルデバイスのストリートビュー
US20130321402A1 (en) * 2012-06-05 2013-12-05 Apple Inc. Rotation operations in a mapping application

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070273712A1 (en) * 2006-05-26 2007-11-29 O'mullan Beth Ellyn Embedded navigation interface
JP2013534656A (ja) * 2010-06-02 2013-09-05 マイクロソフト コーポレーション 適応的で革新的なモバイルデバイスのストリートビュー
JP2013020008A (ja) * 2011-07-08 2013-01-31 Mic Ware:Kk 地図表示装置、地図表示方法、プログラム、およびデータ構造
US20130321402A1 (en) * 2012-06-05 2013-12-05 Apple Inc. Rotation operations in a mapping application

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
"3 Things Bing Maps Does Better Than Google Maps", PC MECH, Retrieved from the Internet <URL:http://www.pcmech.com/article/3-things-bing-maps-does-better-than-google-maps> [retrieved on 20160120] *
"iOS Hyojun Map Apuri ga [3D Flyover] ni Taio Tokyo no Machi ga 3D de Saigen saretazo!", APPBANK, 1 July 2014 (2014-07-01) *
"iPhone5 Powerup Guide Dai 2 Sho Map Apuri Kyoka", IPHONE PEOPLE, 29 October 2012 (2012-10-29), pages 12 - 28 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USD886135S1 (en) 2016-11-23 2020-06-02 Google Inc. Display screen with animated graphical user interface
CN112487244A (zh) * 2020-12-14 2021-03-12 北京梧桐车联科技有限责任公司 街景显示方法、装置及存储介质

Also Published As

Publication number Publication date
JP2016115067A (ja) 2016-06-23
JP6358072B2 (ja) 2018-07-18

Similar Documents

Publication Publication Date Title
JP7385052B2 (ja) 撮影方法、装置、電子機器および記憶媒体
US10530998B2 (en) Image processing device, imaging device, image processing method, and program
US10222968B2 (en) Image display control apparatus, image display apparatus, non-transitory computer readable medium, and image display control method
JP5315111B2 (ja) 端末装置、情報提示システム及び端末画面表示方法
JP6167703B2 (ja) 表示制御装置、プログラム及び記録媒体
JP6072340B1 (ja) 表示処理方法、表示処理プログラム及び表示処理システム
KR20210042621A (ko) 전자 장치 및 이를 이용한 카메라 배율 조정 방법
US20160180599A1 (en) Client terminal, server, and medium for providing a view from an indicated position
US20150109452A1 (en) Display image formation device and display image formation method
US20140092136A1 (en) Image display control apparatus, image display apparatus, non-transitory computer readable medium, and image display method
CN101778216A (zh) 放大和改变显示的图像的方法及使用该方法的摄像装置
KR20140112914A (ko) 휴대단말기의 어플리케이션 정보 처리 장치 및 방법
US20220076469A1 (en) Information display device and information display program
CN106101545A (zh) 一种图像处理方法及移动终端
KR102501713B1 (ko) 영상 표시 방법 및 그 전자장치
JP6358072B2 (ja) 画像表示端末、画像表示システム及び画像表示プログラム
CN103391396B (zh) 显示控制设备和显示控制方法
JP4757934B2 (ja) 携帯型電子機器、および携帯型電子機器の動作方法
CN112805995A (zh) 信息处理装置
CN106412432A (zh) 一种拍照方法及移动终端
US10863095B2 (en) Imaging apparatus, imaging method, and imaging program
JP7265822B2 (ja) 表示制御装置および表示制御方法、並びにプログラム
CN111010528A (zh) 视频通话方法、移动终端及计算机可读存储介质
KR20140129631A (ko) 휴대 단말기에서 이미지 데이터를 생성하는 장치 및 방법
CN104903833B (zh) 用于在屏幕上显示图像的客户端设备、监视系统、方法以及计算机程序

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15866929

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15866929

Country of ref document: EP

Kind code of ref document: A1