JP2012234355A - Virtual space display device, virtual space display system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve operability for a user in a shopping mall provided in a virtual space.SOLUTION: A virtual space display device includes: a touch panel having an input unit for receiving operation from a user and inputting an operation signal indicating the operation, and a display unit; a virtual space display control unit for displaying on the display unit an image in which an image of a commodity dealt in by a store in the shopping mall is disposed in front of the store, on the basis of shopping mall image data stereoscopically showing the shopping mall in the virtual space and commodity image data showing the commodity dealt in by each store provided in the shopping mall; and an in-virtual-space commodity management unit for changing the commodity shown in the commodity image in accordance with a scene of the shopping mall viewed from a view point of the user, on the basis of the operation signal input by the input unit and indicating the movement of the user's view point in the virtual space.

Description

  The present invention relates to a virtual space display device, a virtual space display system, and a program.

In a shopping mall on a virtual space provided on a network, there is a service in which a user performs shopping through a terminal, and this service is called online shopping.
With regard to online shopping, for example, there are those that change the representation of a store in a virtual space according to the usage status (the number of accesses and the frequency, the number of transactions and the amount thereof) of a store in a shopping mall provided on the Internet. Known (Patent Document 1).
Moreover, since the size of the display screen of a general terminal device is determined, the amount of information that can be displayed is limited. For this reason, pages for introducing stores installed in shopping malls and pages for introducing products handled in each store are often provided separately. Alternatively, either one may be reduced and displayed on the same page.

Japanese Patent Laid-Open No. 10-269049

In a real-world shopping mall, the user can walk around the shopping mall and look inside the store from the aisle side. If there is a store of interest, the user can enter the store and see the products.
However, in the shopping mall in the virtual space, the page for introducing the store provided in the shopping mall as described above and the page for introducing the products handled in each store are provided separately. , You have to switch screens every time you check the store or handling products. For this reason, the shopping mall in the virtual space cannot be used with a sense close to that of the real space, and there is a problem that the user's operability is poor. Moreover, when the store and handling goods in the shopping mall on virtual space become enormous, the problem becomes remarkable and there was a possibility that the user's willingness to use may be reduced.

  Therefore, the present invention has been made in view of the above-mentioned drawbacks of the prior art, and a virtual space display device, a virtual space display system, and a virtual space display system capable of improving user operability in a shopping mall provided in a virtual space, And to provide a program.

  The present invention has been made to solve the above-described problem, and a virtual space display device according to one aspect of the present invention includes an input unit that receives an operation from a user and inputs an operation signal indicating the operation, a display unit, Based on a touch panel comprising: shopping mall image data that displays a shopping mall that is three-dimensionally represented in virtual space; and product image data that displays products handled in each store provided in the shopping mall. A virtual space display control unit that displays on the display unit an image in which the product image is arranged at a storefront of the store in the shopping mall, and an operation that indicates movement of the user's viewpoint in the virtual space that is input from the input unit. Based on the signal, the product image according to the scene in the shopping mall in the virtual space Characterized in that it comprises a virtual space product manager to change the items displayed in.

  In addition, the virtual space display device according to one aspect of the present invention described above displays a product information display screen that displays product information related to the specified product based on an operation signal that specifies the product input from the input unit. The apparatus further includes a product information display control unit displayed on the unit.

  In addition, the virtual space display device according to one aspect of the present invention described above is a store information display screen that displays product information about products handled in the designated store based on an operation signal that designates the store input from the input unit. Is further provided with a store information display control unit for displaying the information on the display unit.

  The virtual space display device according to one aspect of the present invention described above is a stock product management that manages the designated product as a stock product based on an operation signal that designates the product input from the input unit as a purchase product candidate. It further has a section.

  This invention was made in order to solve the above-mentioned subject, and the virtual space display system by one mode of the present invention is a virtual space display system provided with the display terminal and server which are connected via a network, A touch panel including an input unit that receives an operation from a user and inputs an operation signal indicating the operation, a display unit, shopping mall image data that displays a shopping mall that is three-dimensionally represented in a virtual space, and the shopping mall Virtual space display control for displaying on the display unit an image in which an image of the product handled in the store is arranged at a storefront of the store in the shopping mall based on product image data displaying the product handled in each store provided in the store And a user's viewpoint in the virtual space input from the input unit A virtual space product management unit that changes the product displayed in the product image according to a scene of the shopping mall seen from the user's viewpoint based on an operation signal indicating movement. Spatial display system.

  The present invention has been made to solve the above-described problems, and a program according to one embodiment of the present invention provides a computer with an input unit that receives an operation from a user and inputs an operation signal indicating the operation, and a three-dimensional object in a virtual space. Based on shopping mall image data that displays a shopping mall that is expressed in a productive manner and product image data that displays products handled in each store provided in the shopping mall, the images of the products handled in the store are stored in the shopping mall. Virtual space display control means for displaying on the display unit an image arranged at the store of the store of the store, and based on an operation signal indicating movement of the user's viewpoint in the virtual space input from the input means, the visible from the viewpoint of the user In the product image according to the shopping mall scene Characterized in that it is a program for causing the virtual space merchandise management unit functions as, for changing the product to be.

  ADVANTAGE OF THE INVENTION According to this invention, the operativity of the user in the shopping mall provided in virtual space can be improved.

It is a figure showing an example of composition of virtual space display system 1 concerning one embodiment of the present invention. It is a figure which shows an example of the image of the shopping mall provided on the virtual space in the embodiment. It is a figure which shows the state which looked at the shopping mall on the virtual space in the same embodiment from upper direction. It is a figure which shows an example of each structure of the display terminal and server which concern on the embodiment. It is a figure showing an example of goods list data concerning the embodiment. It is a figure for demonstrating an example of the process which the virtual space display control part which concerns on the embodiment produces a mall image. It is a figure which shows the transition state of the screen which concerns on the same embodiment. It is a figure showing an example of mall screen S1 concerning the embodiment. It is a figure explaining a user's operation and change of a screen in mall screen S1 concerning the embodiment. It is a flowchart which shows an example of the processing flow by a user's operation in the mall screen S1 which concerns on the embodiment. It is a figure showing an example of mall store movement screen S2 concerning the embodiment. It is a figure explaining a user's operation and a change of a screen in mall store movement screen S2 concerning the embodiment. It is a figure showing an example of mall store fixed screen S3 concerning the embodiment. It is a figure explaining a user's operation and a change of a screen in mall store fixed screen S3 concerning the embodiment. It is a figure showing an example of store screen S4 concerning the embodiment. It is a figure explaining a user's operation and change of a screen in store screen S4 concerning the embodiment. It is a figure showing an example of goods detailed screen S5 concerning the embodiment. It is a figure explaining a user's operation and change of a screen in goods detailed screen S5 concerning the embodiment. It is a figure which shows an example of the stock area which concerns on the embodiment. It is a figure explaining a user's operation and change of a screen in a stock area concerning the embodiment. It is a figure which shows an example of the guidance board display area which concerns on the same embodiment. It is a figure explaining a user's operation and a change of a screen in the guidance board display area concerning the embodiment.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a diagram illustrating an example of a configuration of a virtual space display system 1 according to an embodiment of the present invention.
As shown in FIG. 1, the virtual space display system 1 includes a display terminal 100 and a server 300. The display terminal 100 and the server 300 are communicably connected via a network NW.
The virtual space display system 1 provides a service that allows the user to enjoy online shopping in a shopping mall provided in the virtual space, for example. The virtual space display system 1 displays on the display terminal 100 a shopping mall that is three-dimensionally expressed in the virtual space. The user can purchase a product by moving through the virtual space displayed on the display terminal 100 and viewing the products handled in the store provided in the shopping mall. This movement of the user is realized when the user operates the display terminal 100 to instruct the movement of the user's viewpoint, and the screen changes according to the user's viewpoint. The movement of the user viewpoint will be described in detail later.

The virtual space display system 1 according to the present embodiment displays the image of the handled product at the storefront of each store, and changes the display of the handled product displayed at the storefront of each store as the user's viewpoint moves. For example, when the user's viewpoint is looking at many stores, the number of products arranged at the storefront of each store is reduced to secure a large number of stores. On the other hand, when the user's viewpoint is looking at a small number of stores, the number of products arranged at the storefront of each store is increased to secure a large number of products that can be displayed at the storefront.
In this way, when the user moves, the image of the handled product is displayed at the storefront of each store. In addition, when the user's viewpoint changes and the user is looking at a specific store, the number of handled products displayed at the store front of the store is increased. Thereby, the user can go around the shopping mall in the virtual space with a feeling close to window shopping in the shopping mall in the real space. As a result, the operability of the user is improved, leading to customer attraction to the store.

The virtual space display system 1 provides the display terminal 100 with an image in a shopping mall provided in the virtual space as shown in FIG. 2, for example.
FIG. 2 is a diagram illustrating an example of an image of a shopping mall provided in a virtual space. The image of the shopping mall provided in this virtual space mainly transits between the mall screen S1, the mall store movement screen S2, the mall store fixed screen S3, and the store screen S4. Specifically, it is possible to transit between the mall screen S1, the mall store screen S2, and the store screen S3. The mall store movement screen S2 and the mall store fixed screen S3 can transition between each other. The mall store fixed screen S3 can transition to the store screen S4.

The mall screen S1 displays a shopping mall movement scene that can be seen from the viewpoint of the user who operates the display terminal 100, and the mall store movement screen S2 or the store screen S4 according to an operation instruction from the user or a change in the user's viewpoint. Transition to. The mall screen S1 is a screen that displays a scene in a shopping mall provided in a virtual space and storefronts of each store provided in the shopping mall.
The illustrated mall screen S1 is an image that displays a scene from the user's viewpoint that is visible when the user is facing the advancing direction of the passage. The mall screen S1 includes a shopping mall image 501 that displays the shopping mall in a perspective or three-dimensional stereoscopic image display, and an introduction product image that represents an introduction product of each store provided in the shopping mall. 502. Store 1 exhibits store 1 product A and store 1 product B. In store 2, store 2 product A and store 2 product B are displayed.
The shopping mall image 501 is a three-dimensional representation of the interior and facilities of a shopping mall such as an aisle, a fountain, an event hall, etc. It is an image that expresses automatically.
The introduction product image 502 (store 1 product A, store 1 product B, store 2 product A, store 2 product B, etc.) is stored in each store with respect to the users traveling around the shopping mall. It is an image showing the introduction product for introducing. The introduced products are a limited number of products that can be placed at the storefront of each store on the mall screen S1, and are recommended products, representative products, latest products, and the like of each store. This introduction product is determined in advance by, for example, an exhibitor of each store, an operator of a shopping mall, or the like. The introduction product image 502 is, for example, a reduced image (thumbnail) of the product. This product thumbnail is displayed at the storefront of each store in a floating state in the virtual space.

The mall store movement screen S2 is a screen that transitions from the mall screen S1 and displays a scene that can be seen by the user when the user's viewpoint is moving in the shopping mall. This mall moving screen is an image that displays a scene from the viewpoint of the user who is moving in the shopping mall and can be seen while facing the storefront of each store. That is, the mall store movement screen S2 and the mall screen S1 are screens that continuously change according to the movement of the user's viewpoint, and when the user's viewpoint moves from the traveling direction of the passage to the store side, Transition from the mall screen S1 to the mall store movement screen S2. In addition, when a user's viewpoint moves to the advancing direction of a passage from a store, it changes to the mall screen S1 from the mall store movement screen S2.
This mall store movement screen S2 displays more detailed information on the handling products than the introduction product image (product thumbnail) 502 displayed at the store front of each store on the mall screen S1. For example, the mall store movement screen S2 displays the product thumbnail 503 of the store display product having a larger number of products than the number of products of the introduction product displayed in the mall screen S1. The product thumbnail of the storefront display product is referred to as a storefront display product image 503. This storefront display product is, for example, a product obtained by adding today's limited product, cheap sale product, etc. to the introduced product. This storefront display product is also determined in advance by, for example, an exhibitor of each store, an operator of a shopping mall, or the like.

  The mall store fixed screen S3 is a screen that changes from the mall store movement screen S2, and displays a scene that can be seen by the user when the viewpoint of the user who is viewing the store is stopped. In other words, the mall store fixed screen S3 is a screen showing a pause state of the mall store movement screen S2.

The store screen S4 is a screen that transitions from the mall screen S1, the mall store movement screen S2, or the mall store fixed screen S3, and an introduction product image (thumbnail) 502 displayed on the store front of each store on the mall screen S1. This is a screen for displaying information on the handling products in more detail than the storefront display product image (thumbnail) 503 displayed at the storefront in the mall store movement screen S2 (or the mall store fixed screen S3). This store screen S4 is a screen representing the products handled in each store for each product category that is previously classified according to the product category, for example.
All screens are shared and a stock area is displayed at the bottom of the screen. This stock area functions as, for example, an area for displaying products registered as stock products (scheduled purchase products) designated as products to be purchased by the user. That is, one function of the stock area is an area for temporarily collecting products that the user plans to purchase, and is an area called “shopping basket” in online shopping. The stock products collected in the stock area are products before the user makes a settlement, and the user can purchase the products by performing a settlement process on the stock products.
In addition, the stock area is not limited to the above functions, and has the following functions, for example. For example, the stock area is not planned to be purchased by the user, but can be used simply as a “temporary storage location” for the user to keep a product for comparison or a favorite product. In addition, the stock area can be used as an area where various extended functions (services) can be used across stores and shopping malls, such as displaying “history” purchased by users and “product search results”. Is available. Icons for displaying “history” and “product search result” may be displayed in the stock area.

Next, with reference to FIG. 3, the transition conditions between the mall screen S1 and the mall store movement screen S2 will be described. FIG. 3 is a diagram illustrating a state in which the shopping mall is viewed from above. The image shown in FIG. 3 corresponds to an image in a guide board display area described later.
As shown in FIG. 3A, in the shopping mall in the virtual space, for example, a plurality of stores are provided on both sides of the passage. A user icon Iu indicating the current position and viewpoint (viewing direction) of the user is displayed in this passage. The traveling direction of this passage is the arrow X direction.
In the shopping mall in this virtual space, it is determined to display the mall screen determination area 701 determined to display the mall screen S1 and the mall store movement screen S2 or the mall store fixed screen S3 according to the positional relationship between the passage and the store. The mall store screen determination area 702 to be performed is determined in advance. In the present embodiment, the mall screen determination area 701 is within a range of ± 45 degrees from the straight line X when the straight line X that is the passage traveling direction is set to 0 degree. On the other hand, the mall store screen determination area 702 is an area in the horizontal direction other than the mall screen determination area 701.

That is, in the present embodiment, as shown in the drawing, the dividing line between the mall screen determination area 701 and the mall store screen determination area 702 indicated by a broken line is a determination threshold when the mall screen S1 and the mall store movement screen S2 transition. Or it is a determination threshold value when the mall screen S1 and the mall store fixed screen S3 transition. Note that the condition for determining whether the mall screen S1 transitions to the mall store movement screen S2 or transitions to the mall store fixed screen S3 is a predetermined user operation content.
For example, when the viewpoint of the user indicated by the user icon by the drag operation exceeds the dividing line, the screen transits from the mall screen S1 to the mall store movement screen S2 or from the mall store movement screen S2 to the mall screen S1.
When the user's viewpoint indicated by the user icon exceeds the dividing line by the weak flick operation, the screen changes from the mall screen S1 to the mall store fixed screen S3 or from the mall store fixed screen S3 to the mall screen S1.

In the present embodiment, the dividing line between the mall screen determination area 701 and the mall store screen determination area 702 indicated by a broken line is also a determination threshold when the mall screen S1 and the store screen S4 transition. Note that the condition for determining whether the mall screen S1 transitions to the mall store movement screen S2, transitions to the mall store fixed screen S3, or transitions to the store screen S4 is based on a predetermined user operation content. is there.
For example, when the user's viewpoint indicated by the user icon exceeds the dividing line by a strong flick operation, the screen changes from the mall screen S1 to the store screen S4 or from the store screen S4 to the mall screen S1.
The weak flick and the strong flick are operations in which the speed and strength of the user's flick operation are different. For example, when the user's finger movement of the flick operation is faster than a predetermined speed or a pressure stronger than a predetermined pressure is applied, the screen transition management unit 130 has accepted a strong flick. Determine.

For example, as shown in FIG. 3A, from the state where the user's viewpoint is in the mall screen determination area 701, the user's viewpoint has moved into the mall store screen determination area 702 as shown in FIG. 3B. In this case, the screen moves from the mall screen S1 to the mall store movement screen S2. At this time, the mall store movement screen S2 displays the store on the right hand side of the user.
Further, as shown in FIG. 3A, the user's viewpoint is moved into the mall store screen determination area 702 from the state where the user's viewpoint is in the mall screen determination area 701 as shown in FIG. 3C. In this case, the screen moves from the mall screen S1 to the mall store movement screen S2. At this time, the mall store movement screen displays the store on the left hand side of the user.

Next, an example of each configuration of the display terminal 100 and the server 300 will be described with reference to FIG. FIG. 4 is a diagram illustrating an example of each configuration of the display terminal 100 and the server 300 according to the present embodiment.
The server 300 includes a server communication unit 301, a server control unit 302, and a server storage unit 303. The server storage unit 303 includes a virtual space display data storage area 304 and a product list data storage area 305.
The server communication unit 301 receives information requesting display of the virtual space from the display terminal 100 and outputs the information to the server control unit 302. In addition, the server communication unit 301 transmits information output from the server control unit 302 to the display terminal 100.
The server control unit 302 extracts information from the server storage unit 302 based on information requesting display of the virtual space from the display terminal 100 and outputs the information to the server communication unit 301.

The server storage unit 303 stores virtual space display data for providing the display terminal 100 with the image of the shopping mall provided in the virtual space for online shopping and the operation screen for the user's online shopping. The virtual space display data storage area 304 is provided. The virtual space display data is data for displaying, for example, a mall screen S1, a mall store movement screen S2, a mall store fixed screen S3, a store screen S4, and a stock area on the display terminal 100.
In addition, the server storage unit 303 includes a product list data storage area 305 that stores product list data indicating products that are determined in advance as handled products to be displayed on each screen. An example of the product list data is shown in FIG.

As shown in FIG. 5, the merchandise list data includes mall screen S1 merchandise list data (see FIG. 5A), mall store screen merchandise list data (see FIG. 5B), store screen merchandise list data (FIG. 5 ( c)) and product detail screen product list data (see FIG. 5D).
The mall screen product list data shown in FIG. 5A is data for associating introduction products (products A to C) that are determined in advance as handled products to be displayed on the mall screen S1.
The mall store screen product list data shown in FIG. 5B is data that associates store display products (products A to E) that are determined in advance as handled products to be displayed on the mall store movement screen S2.
The store screen product list data shown in FIG. 5C is data that associates products A to J that are determined in advance as handled products to be displayed on the store screen S4. In the present embodiment, the store screen product list data associates all the handled products of the product.
The product detail screen product list data shown in FIG. 5D associates products A to J that are determined in advance as handled products to be displayed on a product detail screen S5 (not shown) that shows detailed information about each handled product. It is data.

  Returning to FIG. 4, the display terminal 100 includes a terminal communication unit 101, a touch panel 102, an operation display control unit 103, and a terminal storage unit 104. The display device 100 is connected to the server 300 via a network, and displays, for example, content downloaded from the server 300 on the touch panel 102. The content is, for example, a web page browsed by the user and file data that can be displayed by the display device 100. In this embodiment, the display terminal 100 downloads the application which provides the shopping mall expressed in three dimensions in the virtual space mentioned above from the server 300 beforehand, and executes this application. In this way, the display device 100 can improve the user operability by executing an application held by the display device 100 because the response is quicker and more comfortable than the method of providing a Web page via the network. .

  In this embodiment, an example in which the display device 100 displays content downloaded from the server 300 will be described below. However, the present invention is not limited to this, and the content is stored in a built-in storage unit, for example, the terminal storage unit 104. The content read out from the terminal storage unit 104 may be displayed in advance.

The terminal communication unit 101 connects to the server 300 via the network, downloads content information regarding the content from the server 300, and outputs the content information to the operation display control unit 103. In addition, the terminal communication unit 101 transmits information output from the touch panel 102 to the server 300.
The touch panel 102 includes a display unit 121 that is a liquid crystal display, for example, and an input unit 122 that receives an operation instruction from a user who operates the display screen of the display unit 121 and outputs operation information indicating the operation instruction.
The touch panel 102 displays an image from a user's viewpoint determined virtually on the display unit 121 and outputs information indicating a change in the user's viewpoint based on a user operation input from the input unit 122.

  The operation display control unit 103 includes a screen transition management unit 130, a virtual space display control unit 131, a virtual space product management unit 132, a store information display control unit 133, a product information display control unit 134, and a stock product management. Part 135.

The screen transition management unit 130 performs condition determination for transitioning the screen, and transitions the screen displayed on the display unit 121 when it is determined to transition.
The screen transition management unit 130 determines whether or not the dividing line shown in FIG. 3 has been exceeded based on information indicating a change in the viewpoint of the user input from the input unit 122 of the touch panel 102. When the user's viewpoint crosses the dividing line and enters the mall store screen determination area 702 from the mall screen determination area 701, the screen transition management unit 130 satisfies the condition for transition from the mall screen S1 to the mall store movement screen S2. Determine that. Then, the screen transition management unit 130 instructs the virtual space display control unit 131 and the product management unit 132 in the virtual space to execute the mall screen display process.
On the other hand, when the user's viewpoint crosses the dividing line and enters the mall screen determination area 701 from the mall store screen determination area 702, the screen transition management unit 130 is a condition for shifting from the mall store movement screen S2 to the mall screen S1. It is determined that Then, the screen transition management unit 130 instructs the virtual space display control unit 131 and the product management unit 132 in the virtual space to execute the mall store movement screen display process.

Further, when the operation information indicating an instruction to change the screen is input from the touch panel 102, the screen transition management unit 130 changes the screen displayed on the display unit 121 to the instructed screen.
For example, when the operation information instructing the transition from the touch panel 102 to the mall store fixed screen S3 is input, the screen transition management unit 130 sends the mall store to the virtual space display control unit 131 and the product management unit 132 in the virtual space. An instruction signal for instructing execution of the fixed screen display process is output.
Furthermore, when the operation information instructing the transition from the touch panel 102 to the store screen S4 is input, the screen transition management unit 130 performs store screen display processing on the virtual space display control unit 131 and the product management unit 132 in the virtual space. An instruction signal for instructing to execute is output.

Based on the virtual space display data and the product list data received from the server 300, the virtual space display control unit 131 generates a stereoscopic image on the virtual space representing the mall screen S1, the mall store movement screen S2, and the mall store fixed screen S3. It is displayed on the display unit 121. The virtual space display control unit 131, for example, based on a shopping mall image that displays a shopping mall that is three-dimensionally expressed in the virtual space, and a product thumbnail that represents a product handled by each store provided in the shopping mall, A screen for displaying product thumbnails of products handled in the store is displayed on the display unit 121 at the store of the store.
In the mall screen display process for displaying the mall screen S1, the virtual space display control unit 131 displays the product thumbnail of the introduced product determined by the product management unit 132 in the virtual space in a floating state at the store in the store. Further, in the mall store screen display processing for displaying the mall store movement screen S2 or the mall store fixed screen S3, the virtual space display control unit 131 displays the product thumbnail of the store display product determined by the product management unit 132 in the virtual space. It is displayed in a state pasted on the store window of the store.

The product management unit 132 in the virtual space refers to the product list data received from the server 300 on the basis of the instruction signal input from the screen transition management unit 130 and executes a target screen (for example, a mall screen) that executes the instructed display process. The product corresponding to S1 etc. is determined. Based on the determination result, the virtual space product management unit 132 outputs an instruction signal that instructs the virtual space display control unit 131 to display the product thumbnail of the product corresponding to the target screen on which the display process is executed.
For example, when an instruction signal for instructing execution of a mall screen display process is input from the screen transition management unit 130, the product management unit 132 in the virtual space is associated as the mall screen product list data from the product list data. Information indicating the introduced product (products A to C) is read. Then, the product management unit 132 in the virtual space outputs information indicating the introduced product (products A to C) to the virtual space display control unit 131.

  The store information display control unit 133, based on an operation signal for requesting display of the store detailed information input from the touch panel 102, stores handling products (products A to J) associated with the store screen product list data from the product list data. ) Is read. Then, the store information display control unit 133 causes the display unit 121 to display a store screen that displays the handled products (products A to J). Processing in which the store information display control unit 133 displays the store screen is referred to as store screen display processing.

  The merchandise information display control unit 134 reads the merchandise detailed information from the merchandise list data based on the operation signal for requesting the display of the merchandise detailed information input from the touch panel 102, and displays a merchandise detail screen for displaying the merchandise detailed information. To display. The process in which the product information display control unit 134 displays the product detail screen is referred to as a product detail screen display process.

The stock product management unit 135 displays a stock area on each screen based on the virtual space display data. The stock product management unit 135 displays the designated product in the stock area based on an operation signal designating the product input from the touch panel 102 as a purchase product candidate (stock product), and stocks the designated product. A stock product registration process for registering as a product is executed. The stock product management unit 135 writes product information (for example, product name or product number) of stock products to be registered in the stock product list data of the terminal storage unit 104, for example. The stock product management unit 135 controls the display of stock products, and the process of managing registration is referred to as stock product management processing.
In addition, when the operation information instructing to cancel the purchased product candidate (stock product) is input from the touch panel 102, the stock product management unit 135 selects the product instructed to be released based on this operation information in the stock area. In addition to deleting from the display, stock product release processing is executed to release the product instructed to be released from the stock product.
The stock product registration processing and the stock product release processing are collectively referred to as stock product management processing.

Next, an example of processing of the virtual space display control unit 131 will be described with reference to FIG. FIG. 6 is a diagram for explaining an example of processing in which the virtual space display control unit 131 creates the mall image S1.
FIG. 6A illustrates an example of a shopping mall image that displays a shopping mall that is three-dimensionally represented in a three-dimensional virtual space. As illustrated, the shopping mall image is an image that displays a shopping mall image that is three-dimensionally expressed in the virtual space. This shopping mall image represents the scene of the shopping mall that can be seen from the user's viewpoint. In the illustrated example, a straight sidewalk extends in the center of the screen. There are several stores on both sides of this sidewalk. The store 1 is on the left side of the screen of the sidewalk, and the store 3 is behind the store 1. On the other hand, the store 2 is on the right side of the sidewalk screen, and the store 4 is behind the store 2.

FIG. 6B shows a product affixed image for displaying a product image (product thumbnail) representing an introductory product of each store provided in the shopping mall in a floating state at each store in a three-dimensional virtual space. An example is shown. As shown in the drawing, the product affixed image displays product information related to products handled in the stores 1 to 4. Store 1 products A, store 1 product B, and store 1 product C displayed in the product affixed image are store 1 product A, store 1 product B, and store 1 product C. On the other hand, the products handled in the store 2 displayed in the product affixed image are the store 2 product A, the store 2 product B, and the store 2 product C. This product pasted image is an image in which a product thumbnail of an introduced product is drawn as an object arranged in a three-dimensional virtual space.
The virtual space display control unit 131 creates a product pasting image 504 shown in FIG. 6B based on information indicating the product read from the product list data input from the product management unit 132 in the virtual space. The product pasting image is an image for displaying the introduction product image (product thumbnail) 502 in a floating state at the store of the corresponding store.
Then, the virtual space display control unit 131 executes an image composition process for compositing the shopping mall image 501 (see FIG. 6A) and the product pasting image 504 (FIG. 6B) to obtain FIG. A mall screen S1 as shown in FIG. Note that the image composition processing by the virtual space display control unit 131 is a three-dimensional image in which the product thumbnails that are three-dimensionally drawn are arranged at the storefronts of each store in the shopping mall that is three-dimensionally represented in the three-dimensional virtual space. The process to create.

Next, an example of a screen that changes according to a user operation will be described.
FIG. 7 is a diagram illustrating a screen transition state. The transition of this drawing will be described below for each screen. The transition states shown in FIG. 7 are a list of transition states described below with reference to FIGS.
Here, an operation given to the screen will be described.
The tap operation is an operation in which the user removes the finger from the screen of the display 121 without moving the finger by touching the screen of the touch panel 102. This corresponds to a left click with a mouse operation. For example, the input unit 122 determines that the operation is a touch operation by detecting one detection point. The long tap operation refers to an operation in which the tap time (finger contact time) is a certain time or longer.
The drag operation is an operation in which the user moves the finger while touching the screen of the touch panel 102. The input unit 122 determines that the operation is a drag operation by detecting a detection point when the screen first touches the screen of the touch panel 102 and a detection point at the time of movement.

The flick operation is an operation in which the user moves his / her finger to quickly touch the screen of the touch panel 102 or an operation to move his / her finger so as to quickly pay the screen from a state in which the finger is in contact. This flick operation is a weak flick operation when the user pays the screen with a strength weaker than a predetermined lower limit strength (pressure), and a strength stronger than a predetermined upper limit strength (pressure). When the screen is paid with, it is classified as a strong flick operation.
The pinch-in operation / pinch-out operation is an operation for enlarging / reducing the displayed image in accordance with the distance between two points touched with two fingers of the user, for example. For example, in the pinch-in operation, the operation is performed so that the distance between the two points is not long, thereby enlarging the displayed image. On the other hand, in the pinch-out operation, an operation is performed so that the distance between the two points is not shortened, thereby reducing the displayed image.

Next, user operations and screen changes in the mall screen S1 will be described with reference to FIGS. FIG. 8 is a diagram illustrating an example of the mall screen S1. FIG. 9 is a diagram for explaining a user operation on the mall screen S1.
As shown in FIG. 8, on the mall screen S1, the thumbnails of the introduced products are displayed at the storefront of each store in a floating state in the virtual space. Note that the thumbnail of each introduction product may be displayed as an animation coming out of each store when the mall screen S1 is displayed. On the other hand, for example, when a transition is made from the mall store movement screen S2 to the mall screen S1, the thumbnail of the product displayed on the mall store movement screen S2 is an animation that returns to each store when the mall screen S1 is changed. It may be displayed.
User operations on the mall screen S1 include user operations Act11 to Act19.
The user operation Act11 is an operation in which the user drags left and right on the mall screen S1. When the touch panel 102 accepts the user operation Act11, the operation display control unit 103 rotates the scene in the shopping mall that can be seen from the user viewpoint to the left and right. When the user's viewpoint (direction facing) moves from the mall screen determination area 701 to the mall store screen determination area 702, the operation display control unit 103 transitions from the mall screen S1 to the mall store movement screen S2.
The user operation Act12 is an operation in which the user slightly flicks left and right on the mall screen S1. When the touch panel 102 accepts the user operation Act12, the operation display control unit 103 rotates the scene in the shopping mall that can be seen from the user viewpoint to the left and right, and displays an animation that gradually stops the rotation. When the user's viewpoint (direction facing) moves from the mall screen determination area 701 to the mall store screen determination area 702, the operation display control unit 103 transitions from the mall screen S1 to the mall store movement screen S2.

The user operation Act13 is an operation in which the user strongly flicks left and right on the mall screen S1. When the touch panel 102 accepts this user operation Act13, the operation display control unit 103 causes the user viewpoint to move so that the user's viewpoint (facing direction) moves from the mall screen determination area 701 to the mall store screen determination area 702. Rotate the scene inside the shopping mall that you can see from side to side. Then, the operation display control unit 103 makes a transition from the mall screen S1 to the store movement screen S3.
The user operation Act14 is an operation in which the user on the mall screen S1 drags up and down or flicks up and down. When the touch panel 102 receives the user operation Act14, the operation display control unit 103 rotates the scene in the shopping mall that can be seen from the user's viewpoint up and down. For example, when the operation of the lower flick (image of kicking the ground and walking forward) is applied in the state of the mall screen S1 shown in FIG. Is displayed on the front. At this time, the operation display control unit 103 deletes the thumbnails of the store 1, 2 and the introduction product of each store toward the front, and the store 3, 4 and the introduction product of each store display an animation that appears from the back. Execute the display process to be displayed.
The user operation Act15 is an operation in which the user taps the product thumbnail on the mall screen S1. When the touch panel 102 accepts this user operation Act15, the operation display control unit 103 transitions to a product detail screen that shows detailed information about the tapped product thumbnail.

The user operation Act16 is an operation in which the user long taps the product thumbnail on the mall screen S1. When the touch panel 102 receives this user operation Act16, the operation display control unit 103 is in a state in which a product with a long-tapped product thumbnail can be moved to the stock area. For example, the thumbnail of the product can be highlighted to indicate that it can be moved. As highlighting, a specific density or color change pattern can be given.
The user operation Act17 is an operation in which the user drags a product thumbnail that is in a movable state on the mall screen S1 into the stock area. When the touch panel 102 accepts the user operation Act17, the operation display control unit 103 moves the product with the dragged product thumbnail to the stock area. Thereby, the operation display control unit 103 manages the product moved to the stock area as the stock product.

The user operation Act18 is an operation in which the user taps the store signboard image on the mall screen S1. When the touch panel 102 accepts this user operation Act18, the operation display control unit 103 transitions to a store screen S4 indicating detailed store information of the tapped store signboard image.
The user operation Act 19 is an operation in which the user taps the advertisement signboard image on the mall screen S1. When the touch panel 102 receives this user operation Act19, the operation display control unit 103 transitions to a store screen S4 that shows detailed information of the store that is posted as an advertisement of the tapped advertisement signboard image. When a product is posted as an advertisement, the screen transitions to a product detail screen S5 showing detailed information on the product.

Next, a user operation on the mall screen S1 and a processing flow of the operation display control unit 103 will be described with reference to FIG. FIG. 10 is a flowchart illustrating an example of a processing flow by a user operation on the mall screen S1.
(Step ST101)
The virtual space display control unit 131 of the operation display control unit 103 executes a mall screen display process. For example, the virtual space display control unit 131 displays the product thumbnail of the introduced product determined by the product management unit 132 in the virtual space with reference to the mall screen product list data in a floating state in the store of the store.
(Step ST111)
The screen transition management unit 130 determines whether or not the user's viewpoint has moved from the mall screen determination area 701 to the mall store screen determination area 702 by a user operation.

(Step ST112)
When it is determined that a user operation for moving the user's viewpoint from the mall screen determination area 701 to the mall store screen determination area 702 is input, the screen transition management unit 130 determines whether the user operation is a drag or a weak flick. It is determined whether there was a flick or a strong flick.
(Step ST113)
When the user operation is a drag or a weak flick, the screen transition management unit 130 executes a mall store image display process.
When the user operation is a drag, that is, when the user operation Act11 is input, the screen transition management unit 130 displays the mall store movement screen display on the virtual space display control unit 131 and the product management unit 132 in the virtual space. An instruction signal for instructing execution of the process is output. Then, the virtual space display control unit 131 displays the product thumbnail of the storefront display product determined by the product management unit 132 in the virtual space with reference to the mall store screen product list in a state where the product thumbnail is pasted on the storefront window of the store. Displayed on the unit 121.
When the user operation is a weak flick, that is, when the user operation Act12 is input, the screen transition management unit 130 sends the mall store to the virtual space display control unit 131 and the virtual space product management unit 132. An instruction signal for instructing execution of the fixed screen display process is output. Then, the virtual space display control unit 131 displays the product thumbnail of the storefront display product determined by the product management unit 132 in the virtual space with reference to the mall store screen product list in a state where the product thumbnail is pasted on the storefront window of the store. The screen is displayed on the unit 121 and the mall store moving screen S2 is changed to the mall store fixed screen S3.

(Step ST114)
On the other hand, when the user operation is a strong flick, the screen transition management unit 130 executes a store image display process.
When the user operation is a strong flick, that is, when the user operation Act 13 is input, the screen transition management unit 130 displays the store information of the store provided in the strongly flicked direction. An instruction signal for instructing the display control unit 133 to execute the store screen display process is output.
The store information display control unit 133 reads, from the product list data, information indicating the store handling product associated as the store screen product list data of the store provided in the strongly flicked direction. Then, the store information display control unit 133 causes the display unit 121 to display a store screen that displays the read handling product.

(Step ST121)
The product information display control unit 134 determines whether an instruction to tap a product thumbnail has been received by a user operation.
(Step ST122)
When the user taps the product thumbnail on the mall screen S1, that is, when the touch panel 102 receives the user operation Act15, the product information display control unit 134 executes a product detail screen display process. In other words, the product information display control unit 134 makes a transition to the product detail screen showing the detailed information of the product with the tapped product thumbnail.

(Step ST131)
The stock product management unit 135 determines whether the user has long tapped the product thumbnail on the mall screen S1 by a user operation. When the user accepts an operation of long-tapping the product thumbnail on the mall screen S1, that is, the user operation Act16 by the touch panel 102, the stock product management unit 135 can move the product of the long-tapped product thumbnail to the stock area. State.
Next, the stock product management unit 135 determines whether or not the user has dragged a product thumbnail that is in a movable state on the mall screen S1 into the stock area.
(Step ST132)
When the user receives an operation of dragging a product thumbnail that is in a movable state on the mall screen S1 into the stock area, that is, when the touch panel 102 receives a user operation Act17, the stock product management unit 135 performs the stock product registration process. Execute. That is, the stock product management unit 135 moves the product with the dragged product thumbnail to the stock area and manages the product moved to the stock area as a stock product.

(Step ST141)
The store information display control unit 133 determines whether an instruction to tap a store signboard image has been received by a user operation.
(Step ST142)
When the user taps the store signboard image on the mall screen S1, that is, when the touch panel 102 receives a user operation Act18, the store information display control unit 133 executes a store screen display process. That is, the store information display control unit 133 makes a transition to the store screen S4 indicating the store detailed information of the tapped store signboard image.

(Step ST151)
The store information display control unit 133 determines whether or not an instruction to tap an advertisement signboard image on which a store is posted as an advertisement is received by a user operation. In addition, the product information display control unit 134 determines whether an instruction to tap an advertisement signboard image on which a product is posted as an advertisement is received by a user operation.
(Step ST152)
When the touch panel 102 receives an operation in which the user taps an advertisement signboard image in which a store is posted as an advertisement on the mall screen S1, that is, the user operation Act19, the store information display control unit 133 executes a store screen display process. . That is, the store information display control unit 133 makes a transition to the store screen S4 indicating the detailed information of the store posted on the tapped advertisement signboard image.
On the other hand, when the touch panel 102 receives an operation in which the user taps an advertising signboard image on which a product is posted as an advertisement on the mall screen S1, that is, a user operation Act19, the product information display control unit 134 performs a product detail screen display process. Execute. That is, the merchandise information display control unit 134 makes a transition to a merchandise detail screen showing the detailed information of the merchandise posted on the tapped advertisement signboard image.
In addition, description about the processing flow of the user operation on the screen described below with reference to FIGS.

Next, with reference to FIGS. 11 and 12, user operations and screen changes in the mall store movement screen S2 will be described. FIG. 11 is a diagram illustrating an example of the mall store movement screen S2. FIG. 12 is a diagram for explaining a user operation on the mall store movement screen S2.
User operations on the mall store moving screen S2 include user operations Act21 to Act23.
The user operation Act21 is a left / right drag operation of the user on the mall store movement screen S2. When the touch panel 102 receives the user operation Act21, the operation display control unit 103 rotates the scene in the shopping mall that can be seen from the user viewpoint to the left and right. When an instruction to rotate the field of view more than a predetermined angle from the user's traveling direction to the left / right direction with respect to the user's viewpoint is input as a left / right drag, the display transitions from the mall screen S1 to the mall store movement screen S2.
The user operation Act22 is an operation that occurs continuously after the user operation Act21, and is a user tap-up operation or a left and right weak flick operation on the mall store movement screen S2. When the touch panel 102 receives this user operation Act22, the operation display control unit 103 fixes the user's viewpoint. That is, in the user operation Act21, when the screen after the drag operation is the mall store movement screen S2, the user operation Act22 makes a transition from the mall store movement screen S2 to the mall store fixed screen S3. On the other hand, in the user operation Act21, when the screen after the drag operation is the mall screen S1, the user operation Act22 fixes the screen to the mall screen S1.

  The user operation Act23 is a left / right strong flick operation of the user on the mall store movement screen S2. When the touch panel 102 receives this user operation Act23, the operation display control unit 103 transitions to a screen determined in advance according to the screen content of the mall store movement screen S2. For example, as shown in the figure, when a strong flick operation is given on the left side in the mall store movement screen S2 that displays the store on the left side in the traveling direction of the user, the operation display control unit 103 changes the store screen from the mall store movement screen S2. Transition to S4. On the other hand, when a strong flick operation is given on the right side, the operation display control unit 103 transitions from the mall store movement screen S2 to the mall screen S1.

Next, with reference to FIGS. 13 and 14, user operations and screen changes in the mall store fixed screen S3 will be described. FIG. 13 is a diagram illustrating an example of the mall store fixed screen S3. FIG. 14 is a diagram for explaining a user operation on the mall store fixed screen S3.
User operations on the mall store fixed screen S3 include user operations Act31 to Act38.
The user operation Act31 is a left / right drag operation of the user on the mall store fixed screen S3. When the touch panel 102 receives the user operation Act31, the operation display control unit 103 rotates the scene in the shopping mall that can be seen from the user's viewpoint to the left and right. When an instruction to rotate the field of view more than a predetermined angle from the user's traveling direction to the left / right direction with respect to the user's viewpoint is input as a left / right drag, the mall store fixed screen S3 transitions to the mall store movement screen S2. To do.

  The user operation Act32 is a user's up / down drag operation or up / down flick operation on the mall store fixed screen S3. When the touch panel 102 receives this user operation Act32, the operation display control unit 103 moves the user viewpoint along the traveling direction (passage). That is, the adjacent store displayed on the mall store fixed screen S3 is moved in the direction of the drag operation or the flick operation. For example, an upward drag operation or flick operation moves to the front of the store next to the traveling direction. On the other hand, a downward drag operation or flick operation moves to the front of the store next to the opposite side of the traveling direction. In addition, when moving a store, you may change the scene in a shopping mall by a camera angle which returns a viewpoint to the front of the advancing direction, and faces the front of the store of a movement destination. In this case, a transition is made from the mall store fixed screen S3 to the mall screen S1, and further to the mall store fixed screen S3.

The user operation Act33 is a tap operation of the user's product thumbnail on the mall store fixed screen S3. When the touch panel 102 accepts this user operation Act33, the operation display control unit 103 transitions to a product detail screen S5 that shows detailed information on the product.
The user operation Act34 is a long tap operation of the user's product thumbnail on the mall store fixed screen S3. When the touch panel 102 receives the user operation Act 34, the operation display control unit 103 is in a state where the product can be moved to the stock area. For example, a thumbnail of the product may be highlighted so as to indicate that it can be moved.
The user operation Act35 is an operation in which the user drags a product thumbnail that is in a movable state on the mall store fixed screen S3 into the stock area. When the touch panel 102 receives the user operation Act 35, the operation display control unit 103 moves the product to the stock area. Thereby, the operation display control unit 103 manages the product moved to the stock area as the stock product.

User operation Act36 is a tap operation of the user's store signboard image on the mall store fixed screen S3. When the touch panel 102 receives this user operation Act 36, the operation display control unit 103 transitions to a store screen S4 that shows detailed information of the store.
The user operation Act 37 is an operation in which the user taps a store icon on the mall store fixed screen S3. When the touch panel 102 receives the user operation Act 37, the operation display control unit 103 transitions to the store screen S4 of the store indicated by the store icon. This store icon is an icon indicating a transition to a store screen S4 of a store that has been displayed on the mall screen S1, but has disappeared due to the transition to the mall store fixed screen S3. In the present embodiment, the store icon is an icon indicating a transition to the store 2 or the store 4, for example.
User operation Act38 is a tap operation of a user's advertising signboard image in the mall store fixed screen S3. When the touch panel 102 receives the user operation Act 38, the operation display control unit 103 transitions to a store screen S4 that shows detailed information on the store posted as the advertisement. When a product is posted as an advertisement, the screen transitions to a product detail screen S5 showing detailed information on the product.

Next, user operations and screen changes in the store screen S4 will be described with reference to FIGS. FIG. 15 is a diagram illustrating an example of the store screen S4. FIG. 16 is a diagram for explaining a user operation on the store screen S4.
As shown in FIG. 15, the store image S <b> 4 includes a store signboard area at the top, a product classification area at the center, and a stock area at the bottom. An area other than the central product classification area is referred to as an area outside the product classification area.
A store signboard image is displayed in the store signboard area, and store icons are displayed on the left and right. The store icon on the left side of the store signboard area is an icon for instructing to move to the store on the left side of the store of the store image in the shopping mall. On the other hand, the store icon on the right side of the store signboard area is an icon for instructing to move to the store on the right side of the store of the store image in the shopping mall. In the present embodiment, the store icon on the right side is an icon indicating a transition to the store 3, for example.

  The product category area has a tab for designating each product category, and displays product images (for example, product thumbnails) included in the designated product category. A store icon is displayed on the right side of the product category area. This store icon is an icon indicating a transition to the store screen S4 of a store that has been displayed on the mall screen S1, but has disappeared due to the transition to the store screen S4. In the present embodiment, the store icon is an icon indicating a transition to the store 2 or the store 4, for example.

The user operation Act41 is an operation in which the user drags or flicks the store signboard image on the store screen S4 left and right. When the touch panel 102 receives the user operation Act 41, the operation display control unit 103 moves the user viewpoint along the traveling direction (passage) next to the operation direction on the mall store fixed screen S3 before the transition to the store screen S4. Transition to the store screen S4 of the store.
The user operation Act42 is an operation in which the user drags up and down or flicks up and down in the product category area on the store screen S4. When the touch panel 102 receives this user operation Act42, the operation display control unit 103 scrolls the product classification area up and down and moves the product image arranged in the product classification area up and down.
The user operation Act43 is an operation in which the user drags or flicks left and right within the product category area on the store screen S4, or an operation for tapping the product category tab. When the touch panel 102 receives the user operation Act 43, the operation display control unit 103 changes the product category of the product displayed in the product category area. For example, when the product category 1 is specified and the user drags or flicks the product category area to the left, the product category 2 is displayed with the product tab displayed on the right side of the product category 1. The operation display control unit 103 displays the product image of the product category 2 in the product category area. Further, when the product tab of the product category 3 is tapped, the operation display control unit 103 displays the product image of the product category 3 in the product category area.

The user operation Act44 is an operation in which the user taps the product image (product thumbnail) in the product category area of the store screen S4. When the touch panel 102 receives this user operation Act 44, the operation display control unit 103 transitions to a product detail screen S5 that shows detailed information on the product of the tapped product thumbnail.
The user operation Act 45 is an operation in which the user long taps the product thumbnail on the store screen S4. When the touch panel 102 accepts this user operation Act 45, the operation display control unit 103 is in a state in which a product with a long tapped product thumbnail can be moved to the stock area. For example, a thumbnail of the product may be highlighted so as to indicate that it can be moved.
The user operation Act 46 is an operation in which the user drags a product thumbnail that is movable on the store screen S4 into the stock area. When the touch panel 102 receives the user operation Act 46, the operation display control unit 103 moves the product with the dragged product thumbnail to the stock area. Thereby, the operation display control unit 103 manages the product moved to the stock area as the stock product.

The user operation Act 47 is an operation in which the user taps the store icon on the store screen S4. When the touch panel 102 accepts this user operation Act 47, the operation display control unit 103 transitions to a store screen S4 that shows detailed store information of the tapped store icon.
The user operation Act 48 is an operation in which the user taps the exit button on the store screen S4. When the touch panel 102 receives this user operation Act 48, the operation display control unit 103 transitions to the mall screen S1.
The user operation Act 49 is an operation in which the user long taps the area outside the product category area on the store screen S4. When the touch panel 102 receives this user operation Act 49, the operation display control unit 103 transitions to the mall store movement screen S2.

Next, with reference to FIGS. 17 and 18, user operations and screen changes in the product detail screen S5 will be described. FIG. 17 is a diagram illustrating an example of the product detail screen S5. FIG. 18 is a diagram for explaining a user operation on the product detail screen S5.
The product detail screen S5 illustrated in FIG. 17 is an example when the mall screen S1 transits to the product detail screen S5. The product detail screen S5 includes an image obtained by enlarging the product thumbnail (product thumbnail enlarged area), and a detailed information area for displaying detailed information on the product thumbnail. In this detailed information area, for example, information such as the name of the store handling the product, the product name of the product, other detailed information, the price of the product, and the like are displayed.
An area other than the product detail information area (product thumbnail enlargement area and detail information area) in the product detail screen S5 is referred to as an area outside the product detail information area.
Further, the product detail screen S5 transitioned from the mall screen S1 displays a product thumbnail enlarged area and a detailed information area on the mall screen S1. In this case, the mall image below the product information image is displayed in a light color so that the display of the product information image is easy to see. Note that the lower layer mall image may not be displayed.

The user operation Act51 is an operation in which the user long taps an enlarged product thumbnail in the product thumbnail enlargement area on the product detail screen S5. When the touch panel 102 accepts this user operation Act 51, the operation display control unit 103 sets the product with the long-tapped product thumbnail to the stock area. For example, the thumbnail of the product can be highlighted to indicate that it can be moved.
The user operation Act52 is an operation in which the user drags a product thumbnail that is in a movable state on the product detail screen S5 into the stock area. When the touch panel 102 receives the user operation Act 52, the operation display control unit 103 moves the product with the dragged product thumbnail to the stock area. Thereby, the operation display control unit 103 manages the product moved to the stock area as the stock product.

The user operation Act 53 is an operation in which the user taps a store icon in the detailed information area of the product detail screen S5. When the touch panel 102 accepts this user operation Act 53, the operation display control unit 103 transitions to a store screen S1 that shows detailed store information of the tapped store icon. In addition, when changing to the store screen S1, the product classification in which the product of the product detail screen S5 is registered may be displayed.
The user operation Act 54 is an operation in which the user drags up and down or flicks up and down in the detailed information area on the product detail screen S5. When the touch panel 102 receives the user operation Act 54, the operation display control unit 103 scrolls the detailed information area up and down and moves the information displayed in the detailed information area up and down.
The user operation Act55 is an operation in which the user long taps the area outside the product detail information area on the product detail screen S5. When the touch panel 102 receives the user operation Act 55, the operation display control unit 103 returns to the previous screen. In the case of the above example, the screen returns to the mall screen S1.

Next, user operations and screen changes in the stock area will be described with reference to FIGS. FIG. 19 is a diagram illustrating an example of a stock area displayed in common on each screen. FIG. 20 is a diagram for explaining a user operation in the stock area.
This stock area includes a tab for designating a product category of stock products on the left side, and includes a guide board icon and a purchase screen movement icon on the right side. This guide board icon is an icon for instructing display of a guide board for displaying each store icon on a map in the shopping mall. Details will be described later. The purchase screen movement icon is an icon for making a transition to a web page for settlement of a product registered as a stock product.
In addition, a product image (for example, a product thumbnail) of a stock product included in the designated product category is displayed at the center of the stock area.

User operations in the stock area include user operations Act61 to Act68.
The user operation Act 61 is an operation in which the user drags or flicks left and right in the stock area. When the touch panel 102 receives this user operation Act 61, the operation display control unit 103 scrolls the stock product classification area to the left and right, and moves the product image (product thumbnail) arranged in the stock area to the left and right.
The user operation Act62 is an operation in which the user drags or flicks up and down in the stock area, or an operation of tapping a stock classification tab. When the touch panel 102 receives the user operation Act 62, the operation display control unit 103 changes the stock classification displayed in the stock area.
For example, if the user drags or flicks down in the stock area while the stock category 1 is specified, the stock category 2 is switched to the stock category 2 in which the stock category tab is displayed below the stock category 1. The operation display control unit 103 displays the product thumbnail of the stock category 2 in the stock area. When the stock category tab of the stock category 3 is tapped, the operation display control unit 103 displays the product thumbnail of the stock category 3 in the stock area.
The stock classification is a classification for distinguishing an area in which information indicating a designated product is temporarily stored in the stock area. For example, each stock category 1 can be used as an area for securing a product to be purchased, and stock categories 2 and 3 can be used as areas for storing favorite products. As a result, the user can arbitrarily switch the stock section and use the area of each stock section properly.
It should be noted that the number of stock sections may be three or more, and the function expansion can be realized by allocating the area of each stock section to history and search.

The user operation Act 63 is an operation in which the user taps the product thumbnail in the stock area. When the touch panel 102 accepts this user operation Act 63, the operation display control unit 103 transitions to a product detail screen S5 that shows detailed information of the product of the tapped product thumbnail.
The user operation Act 64 is an operation in which the user long taps the product thumbnail in the stock area. When the touch panel 102 accepts the user operation Act 64, the operation display control unit 103 is in a state in which the product with the long-tapped product thumbnail can be moved to an area outside the stock area. For example, a thumbnail of the product may be highlighted so as to indicate that it can be moved.
The user operation Act 65 is an operation in which the user drags a product thumbnail that is movable in the stock area to the outside of the stock area. When the touch panel 102 accepts this user operation Act 65, the operation display control unit 103 deletes the product with the dragged product thumbnail from the stock area and cancels the registration as the stock product.

The user operation Act 66 is an operation in which the user drags a product thumbnail that is movable in the stock area into the stock area of another stack section. When the touch panel 102 receives this user operation Act 66, the operation display control unit 103 moves the product with the dragged product thumbnail from the current stock area to the designated stock area.
The user operation Act 67 is an operation in which the user taps the guide plate icon in the stock area. When the touch panel 102 receives this user operation Act 67, the operation display control unit 103 displays a guide plate. Details will be described later.
The user operation Act 68 is an operation in which the user taps a purchase screen icon in the stock area. When the touch panel 102 receives this user operation Act 68, the operation display control unit 103 transitions to a Web page for settlement.

Next, with reference to FIGS. 21 and 22, user operations and screen changes in the guide board display area will be described. FIG. 21 is a diagram illustrating an example of a guide plate display area. FIG. 22 is a diagram for explaining a user operation in the guide board display area.
The guide board display area shown in FIG. 21 is displayed in an area other than the stock area when the guide board icon of the stock area is tapped by the user operation Act 66. This stock area is displayed on the mall screen S1, the mall store movement screen S2, the mall store fixed screen S3, the store screen S4, and the like.
In this guide board display area, a guide board including each store icon arranged according to the map in the shopping mall is displayed. In the figure, the map in the shopping mall is a part of the shopping mall and shows an area where a plurality of stores are lined up on the left and right along the passage. The user's viewpoint is at the position indicated by the user icon, indicating the current position of the user and the direction of travel with an arrow.

User operations in the guide board display area include user operations Act71 to Act73.
The user operation Act 71 is an operation in which the user drags up and down or flicks up and down in the guide board display area. When the touch panel 102 accepts the user operation Act 71, the operation display control unit 103 scrolls the guide plate display area up and down and moves the store icons arranged in the guide plate display area up and down.

The user operation Act 72 is an operation for the user to pinch in / out in the guide board display area. When the touch panel 102 receives this user operation Act 72, the operation display control unit 103 enlarges or reduces the image displayed in the guide board display area. The user operation Act 72 is not limited to pinch-in / out, and may be a double tap. If an enlargement / reduction icon is provided, the user operation Act 72 may be a tap of the icon.
The user operation Act 73 is an operation in which the user taps a store icon in the guide board display area. When the touch panel 102 accepts this user operation Act 73, the operation display control unit 103 transitions to a store screen indicating detailed store information of the tapped store icon.

  As described above, when the user moves, an image of the handled product is displayed at the storefront of each store. In addition, when the user's viewpoint changes and the user is looking at a specific store, the number of products handled at the store front of the store is increased. Thereby, it is possible to go around the shopping mall in the virtual space with a feeling close to that of window shopping in the shopping mall in the real space. As a result, the operability of the user is improved, leading to customer attraction to the store. Further, by moving between the mall screen S1 and the mall store movement screen S2 while moving in the mall, it is possible to discover new products for the user and improve purchase motivation.

In addition, the above-described virtual space image display system can improve the list of “what stores are lined up” or “what each store handles”. Therefore,
Services can be efficiently provided to users. Furthermore, it is possible to increase “ease of searching for products” and “possibility to meet new products”. Therefore, the operability for that purpose can be improved.
Furthermore, the web browser on the tablet terminal has a low operability, and there is a problem that the joy of shopping cannot be felt. In the case of a shop app, the operability can be improved, but the listability that crosses each store is insufficient.
On the other hand, the virtual space display system 1 according to the embodiment of the present application can simultaneously display stores in a plurality of shopping malls and display product thumbnails arranged at storefronts of the stores. In addition, a plurality of products in each store can be browsed / selected, and the user can receive the service of the store.
In addition, “move between stores” and “switch between mall stores” can be performed by intuitive operations such as dragging and flicking. Further, the movement to the store that is no longer displayed is realized by displaying it on the screen as an icon for instructing the movement to the store.

[Program and recording medium]
Finally, each unit included in the display terminal 100 and the server 300 of the virtual space display system 1 may be configured by hardware logic. Alternatively, it may be realized by software using a CPU as follows.
That is, the display terminal 100 and the server 300 store a CPU that executes instructions of a program that realizes each function, a RAM that stores the program and that expands the program into an executable format, and stores the program and various data. A storage device (recording medium) such as a memory is provided. With this configuration, the object of the present invention can also be achieved by a predetermined recording medium.
The recording medium only needs to record the program code (execution format program, intermediate code program, source program) of the program of the display terminal 100 and the server 300, which is software that realizes the above-described functions, so as to be readable by a computer. This recording medium is supplied to the display terminal 100 and the server 300. Thus, the computer (or CPU or MPU) may read and execute the program code recorded on the supplied recording medium.

The recording medium that supplies the program code to the display terminal 100 and the server 300 is not limited to a specific structure or type. That is, this recording medium is, for example, a tape system such as a magnetic tape or a cassette tape, a magnetic disk such as a floppy (registered trademark) disk / hard disk, or an optical disk such as CD-ROM / MO / MD / DVD / BD / CD-R. A disk system including IC, a card system such as an IC card (including a memory card) / optical card, or a semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.
Moreover, even if the display terminal 100 and the server 300 are configured to be connectable to a communication network, the object of the present invention can be achieved. In this case, the program code is supplied to the display terminal 100 and the server 300 via the communication network. The communication network only needs to be able to supply program codes to the display terminal 100 and the server 300, and is not limited to a specific type or form. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, or satellite communication network may be used.

  The transmission medium constituting the communication network may be any medium that can transmit the program code, and is not limited to a specific configuration or type. For example, infrared rays such as IrDA or a remote control, Bluetooth (registered trademark), 802.11 wireless, HDR even with a wired line such as IEEE1394, USB, power line carrier, cable TV line, telephone line, or ADSL (Asymmetric Digital Subscriber Line) line It can also be used wirelessly, such as a mobile phone network, a satellite line, or a terrestrial digital network. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  DESCRIPTION OF SYMBOLS 1 ... Virtual space display system, 100 ... Display terminal, 300 ... Server, 101 ... Terminal communication part, 102 ... Touch panel, 103 ... Operation display control part, 104 ... Terminal Storage unit 121 ... Display unit 122 ... Input unit 130 ... Screen transition management unit 131 ... Virtual space display control unit 132 132 Product management unit in virtual space 133・ Store information display control unit, 134... Product information display control unit, 135... Stock product management unit, 300... Server, 301... Server communication unit, 302. ..Server storage unit

Claims (6)

A touch panel including an input unit that receives an operation from a user and inputs an operation signal indicating the operation, and a display unit;
Based on shopping mall image data that displays a shopping mall that is three-dimensionally represented in a virtual space, and product image data that displays products that are handled in each store provided in the shopping mall, an image of the product that is handled in the store A virtual space display control unit that causes the display unit to display an image arranged at a storefront of the store in the shopping mall;
A virtual space for changing the product displayed in the product image according to a scene in the shopping mall in the virtual space based on an operation signal indicating movement of the user's viewpoint in the virtual space input from the input unit A virtual space display device comprising: an in-product management unit.   A product information display control unit that displays a product information display screen that displays product information related to the specified product based on an operation signal that specifies the product input from the input unit on the display unit. The virtual space display device according to claim 1.   And a store information display control unit that displays a store information display screen on the display unit that displays product information related to products handled in the specified store based on an operation signal that specifies the store input from the input unit. The virtual space display device according to claim 1 or 2.   4. The apparatus according to claim 1, further comprising a stock product management unit that manages the designated product as a stock product based on an operation signal that designates the product input from the input unit as a purchase product candidate. 5. The virtual space display device according to claim 1. A virtual space display system comprising a display terminal and a server connected via a network,
A touch panel including an input unit that receives an operation from a user and inputs an operation signal indicating the operation, and a display unit;
Based on shopping mall image data that displays a shopping mall that is three-dimensionally represented in a virtual space, and product image data that displays products that are handled in each store provided in the shopping mall, an image of the product that is handled in the store A virtual space display control unit that causes the display unit to display an image arranged at a storefront of the store in the shopping mall;
Based on an operation signal indicating movement of the user's viewpoint in the virtual space input from the input unit, a virtual for changing the product displayed in the product image according to a scene of the shopping mall seen from the user's viewpoint A virtual space display system comprising: an in-space product management unit. Computer
An input means for receiving an operation from the user and inputting an operation signal indicating the operation;
Based on shopping mall image data that displays a shopping mall that is three-dimensionally represented in a virtual space, and product image data that displays products that are handled in each store provided in the shopping mall, an image of the product that is handled in the store Virtual space display control means for displaying an image arranged at a storefront of the store in the shopping mall on a display unit. Based on an operation signal indicating movement of the user's viewpoint in the virtual space input from the input means, the user's viewpoint The program for functioning as a product management means in a virtual space that changes the product displayed in the product image according to the scene of the shopping mall that can be seen from.

Images