JP2015072703A - Program and server device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To achieve display of a pseudo stereoscopic image by using a general display screen, and to contribute to more variable game development by using that technology.SOLUTION: A program to be executed by a computer incorporated in a portable terminal device having an inclination sensor and a display part comprises: an image acquisition step S101 of acquiring image information in which height information is added to each pixel position; an inclination acquisition step S104 of acquiring inclination information of the portable terminal device from the inclination sensor; a stereoscopic image generation step S105 of generating a pseudo stereoscopic image on the basis of the height information of each pixel position from the acquired inclination information and the acquired image information; a display step S106 of displaying the generated pseudo stereoscopic image; and a control step S102 of allowing processing by the inclination acquisition step, the stereoscopic image generation step and the display step to be repeatedly executed in a predetermined cycle.

Description

  The present invention relates to a program and a server device suitable for an online game using a smartphone, for example.

  Conventionally, the arrangement of a plurality of pieces of identification information that cannot be recognized visually is determined in relation to the arrangement of a plurality of pieces of visual recognition information that can be recognized visually. There are technologies that have been proposed to provide. (For example, Patent Document 1)

WO2007 / 114288 republished patent

  In the technique described in the above patent document, the progress of the game is performed by reading the identification information, which is not visually recognized, described on the game card by using a dedicated optical, magnetic, or electronic reader. To be related to. Therefore, it is indispensable to use a special card in which identification information that cannot be recognized visually is described in advance and the dedicated reader.

  By the way, in recent years, instead of a conventional mobile phone called feature phone, it has a touch panel integrated with a relatively large display screen called a smartphone, which is about 4 inches diagonal, and has a data communication function. Mobile terminals with a wide range of devices are widely spread, and within the range of technologies that can be realized in this smartphone, a game technology that can enhance the game performance as well as the visual effect is being sought.

  In the field of portable game machines, products that allow stereoscopic viewing of images with the naked eye by providing a parallax slit in a liquid crystal display panel are already in widespread use.

  The present invention has been made in view of the above circumstances, and the object of the present invention is to realize display of a pseudo three-dimensional image using a general display screen, and to use the technology for more variety. Another object of the present invention is to provide a program and a server device that can contribute to various game developments.

  One aspect of the present invention is a program that is executed by a computer including a display unit, and the program includes a progress step for advancing the game and height information for displaying a partially three-dimensional image 2. When display of a stereoscopic image is set in the progress of the game in the first image acquisition step of acquiring the dimensional image data and the progress step, based on the height information corresponding to the two-dimensional image data, A stereo image generation step of generating a pseudo stereo image obtained by adding a partial stereo image to a planar image corresponding to the two-dimensional image data; and a display step of displaying the pseudo stereo image on the display unit.

  According to the present invention, it is possible to display a pseudo three-dimensional image using a general display screen, and to contribute to more various game developments using the technology.

The figure explaining an example of the environment where the online game system which concerns on one Embodiment of this invention is used. The block diagram which shows the hardware constitutions on the function of the electronic circuit of the smart phone which concerns on the embodiment. The flowchart which shows the content of the image display process performed during the online game by the portable terminal side which concerns on the embodiment. The figure explaining the principle at the time of displaying a pseudo | simulation stereo image with the image data to which the height information which concerns on the same embodiment was added. The figure which shows the application example on the game progress which concerns on the same embodiment. The figure which shows the other application example on the game progress which concerns on the same embodiment. The figure which shows the further another example of application in game progress which concerns on the same embodiment.

Hereinafter, an embodiment when the present invention is applied to an online game system will be described with reference to the drawings.
FIG. 1 is a diagram illustrating an example of an environment in which the online game system according to the embodiment is used. In the figure, web server devices 2 and 3 are connected to a network 1 such as the Internet, and portable terminals 4 and 5 serving as client devices used by the user in this system are an access point 6 (AP) 6. Alternatively, they are connected via the base station 7.

  The web server devices 2 and 3 are computers for realizing the online game system according to the present embodiment, and a plurality of web server devices 2 and 3 are installed in parallel to the network 1 in order to provide an online game service.

  On the other hand, the mobile terminals 4 and 5 on the client side include smartphones, feature phones, and the like, and are mobile phones that operate on an OS such as Android (registered trademark) and iOS (registered trademark). It may be a notebook personal computer, a mobile computer, a tablet computer, or the like. In any case, in this embodiment, it is assumed that a game program for an online game provided from the web server devices 2 and 3 is installed in the mobile terminals 4 and 5 in advance.

  FIG. 2 is a block diagram showing a functional hardware configuration of the electronic circuit when the mobile terminals 4 and 5 are smartphones. In the figure, the CPU 11 controls the entire mobile terminals 4 and 5. The CPU 11 is connected to the main memory 12, the solid state drive (SSD) 13, the 3G & 4G communication unit 14, wirelessly via the system bus SB. LAN communication unit 15, short-range wireless communication unit 16, external memory card 17, display unit 18, touch panel input unit 19, key input unit 20, voice processing unit 21, image processing unit 22, triaxial acceleration sensor 23, and vibrator 24 Is connected.

  The CPU 11 reads out an operation program (OS and application program that operates on the OS) and standard data stored in the solid state drive 13, develops and stores them in the main memory 12, and executes the program Thus, the overall operation of the portable terminals 4 and 5 is controlled in an integrated manner.

  The main memory 12 is constituted by an SRAM, for example, and functions as a work memory for the CPU 11. The solid state drive 13 is composed of a non-volatile memory such as a flash memory, and in addition to the above-described operation program and various fixed data, various contents such as image data and music data are stored as storage media of the portable terminals 4 and 5. Remember.

  The 3G & 4G communication unit 14 is based on the third generation mobile communication system compliant with the IMT-2000 standard and the fourth generation mobile communication system compliant with the IMT-Advanced standard. It is a communication unit that operates in a dual mode to transmit and receive data.

  The wireless LAN communication unit 15 transmits / receives data to / from the nearest access point 6 via the antenna 26 based on, for example, the IEEE 802.11a / b / g / n standard.

  The short-range wireless communication unit 16 transmits / receives data to / from other Bluetooth standard devices within the range of class 2 (within a radius of about 10 m), for example, via the antenna 27.

  The external memory card 17 is a medium for expanding the storage capacity of the solid state drive 13 that is detachably mounted by the user of the portable terminals 4 and 5.

  The display unit 18 includes a TFT color liquid crystal panel with a backlight and its driving unit, and displays various images.

  The touch panel input unit 19 is configured integrally with the display unit 18 using a transparent electrode, and generates and outputs two-dimensional position coordinate information corresponding to a user's touch operation.

  The key input unit 20 includes several key switches including a power key and a shutter key for a camera function provided on the outer surface of the casing of the mobile terminals 4 and 5 and a drive circuit thereof.

  The audio processing unit 21 converts the digital audio data provided via the system bus SB into an analog signal and outputs it from the speaker 28, while sampling an analog audio signal input from the microphone 29, converts it into digital data, and outputs the digital data.

  The image processing unit 22 is output from the solid-state imaging device 31 through the optical lens system 30 in accordance with an optical image focused on the imaging surface of the solid-state imaging device 31 configured by, for example, a CCD or a CMOS image sensor. The image signal is converted into digital data, and file data in which the data amount is compressed by a preset file format, for example, JPEG (Joint Photographic Experts Group) for a still image, is created and output.

Next, the operation of the above embodiment will be described.
FIG. 3 shows that during the online game executed between the web server devices 2 and 3 as servers and the mobile terminals 4 and 5 as clients, the mobile terminals 4 and 5 are distributed from the web server devices 2 and 3 in particular. The processing for displaying an image during a game is extracted and shown based on the obtained image data.

  Hereinafter, one of the web server devices 2, 3, for example, one of the mobile terminals 4, 5, for example, the mobile terminal 4 receives the distribution of the image data from the web server device 2, and the mobile terminal 4 executes it. Processing to be performed will be described.

  3 is executed as a part when the CPU 11 in the portable terminal 4 reads an application program previously installed in the solid state drive 13 and develops it in the main memory 12 for execution.

  That is, in the mobile terminal 4 during the game, the image data with the height information added is acquired from the web server device 2 (step S101).

  FIG. 4 is a diagram for explaining the principle when a pseudo stereoscopic image is displayed by image data to which height information is added. For example, it is assumed that height information as shown in FIG. 4B is added to each pixel constituting a two-dimensional (2D) image as shown in FIG.

  In this case, it is assumed that the height information is binary in order to simplify the description, and only the hexagonal range at the center of the image protrudes from the periphery in a hexagonal column shape. FIG. 4C shows a concept in which the two-dimensional image shown in FIG. 4A is mapped as a texture on the base of the shape based on the height information shown in FIG. 4B.

  When considering such a simple three-dimensional image taken by the camera C from almost the front, the position of the camera C is moved from the correct front position of the image as indicated by an arrow A1 in the figure. As a result, the center hexagonal image is displaced from the background image by the height.

  In other words, this is nothing but the difference in distance to each image position as viewed from the camera C. The closer the image is to the camera C, the greater the movement according to the movement of the camera C compared to the farther image. Due to

  Therefore, when viewing the same image, if the image is moved left and right around the same distance while maintaining the same distance, the subject closer to the front moves more to the left and right with respect to the background image as the viewpoint position moves. If such an image is generated, a three-dimensional image can be displayed although it is pseudo.

  In this case, when the image on the near side is cut out from the background image and moved on the background image, a “gap” in which no image exists on the background image side (the side surface of the hexagonal columnar image in FIG. 4C above). However, this is because, for example, by interpolating the adjacent image part of the background image as a texture with a similar texture pattern, the human eye also has the property of giving priority to moving objects. It is possible to realize and express an image that is not so uncomfortable for the user.

  In the present embodiment, instead of the movement of moving the camera C to the left and right, the change in the tilt of the mobile terminal 4 is detected by the triaxial acceleration sensor 23, and the change in the tilt is used as the change in the viewpoint position. Thus, the pseudo three-dimensional display is performed by moving the position of the image portion set by the height information when it is on the near side.

  In principle, the height information shown in FIG. 4B may be added in association with each pixel data constituting the image data shown in FIG. 4A. In order to prevent the image from becoming large, the original image data is divided into a plurality of regions so that adjacent pixels having the same height information belong to the same region, and height information is added to each divided region. It is good.

  Further, for example, in JPEG image data, a basic block is handled by being divided into 8 × 8 rectangular blocks. By adding height information in units of basic blocks, height information is provided for each pixel. The amount of height information can be reduced to 1/64 compared to the case of adding.

  In the portable terminal 4 that has acquired the image data to which the height information is added in step S101, the CPU 11 confirms that there is no new image update (step S102), and the stereoscopic image is displayed as the game progresses. It is determined whether or not it is set to ON (step S103).

  If it is determined that the display of the stereoscopic image is not set to ON, the CPU 11 develops it on the main memory 12 as it is and displays it on the display unit 18 without using the height information added to the image data. Thus, the display of the two-dimensional plane image is executed (step S107), and the process returns to step S102 again.

  On the other hand, if it is determined in step S103 that the display of the stereoscopic image is set to ON, the CPU 11 acquires the tilt information of the casing of the portable terminal 4 at that time from the triaxial acceleration sensor 23 at that time (step S103). In step S104, a viewpoint position corresponding to the acquired tilt information is set to generate a stereoscopic image based on the height information (step S105).

  Then, after the generated stereoscopic image is displayed on the display unit 18 (step S106), the process returns to step S102 again.

  For example, assuming that the CPU 11 repeatedly executes the processes of steps S102 to S106 with a period of 1/30 [second], the background image displayed on the display unit 18 by changing the tilt angle of the mobile terminal 4. It is possible to display a pseudo three-dimensional image by moving the image of the area in which the medium height is set on the background image corresponding to the degree of change in the inclination angle at a period of 1/30 [second]. Become.

  In FIG. 4, the height information of a hexagonal column shape, for example, is added to the image of FIG. 4A. However, the shape indicated by the height information is, for example, an image. The shape of a character, a symbol, or a symbol mark related to the progress of the game may be used as well as the shape of the character inside.

  FIG. 5 shows an application example in the progress of such a game. FIG. 5A is a diagram illustrating five character images and a hidden symbol mark shown in parentheses above the character image. Actually, by adding the height information of the shape of the hidden symbol mark to the original two-dimensional image and setting it, the user of the portable terminal 4 can perform the display process as shown in FIG. The shape data of each symbol mark can be found from the image displayed on the display unit 18 by changing the tilt angle of the mobile terminal 4 when viewing the display unit 18.

  Therefore, for example, by selecting characters having the same symbol mark shape as the game progresses, it is possible to perform a stronger combined attack than when each character attacks alone. More variations can be set.

  FIG. 6 shows another application example in the progress of the game. For example, when there is a two-dimensional map image as shown in FIG. 6A and an item as shown in FIG. 6B is acquired as the game progresses, the stereoscopic image display in step S103 is turned on. It can be determined that it is set.

  In this case, as shown in FIG. 6C, the user of the mobile terminal 4 changes the tilt angle of the mobile terminal 4 when viewing the display unit 18, thereby changing the map image displayed on the display unit 18 from the map image. The position of the star shape as shown in Fig. 2 can be found.

  Therefore, after moving to the place shown on the map in the game, for example, by using the item “Kagi no Hoshi” that you possessed without knowing the purpose, you can further acquire items necessary for the game progress, Or you can move to the next quest, and you can set more variations in the game progress.

  FIG. 7 shows still another application example in the progress of the game. FIG. 7A shows a game character based on a two-dimensional image, and FIG. 7B shows a character string “www.abcdefg / index.html” indicating the URL superimposed on the game character using a stereoscopic image as height information. The case is shown as an example.

  As described above, the game character is supported depending on the level of the game character, the presence / absence of a specific item, the pass / fail of the password input in response to the guide message prompting the input of the password, and the presence / absence of charging on the online game. By displaying a character string so as to emerge, for example, a URL for accessing a website for a limited time is displayed, or a message arbitrarily created by the user is embedded in the image of the game character and You can set up more variations in the progress of the game, such as exchanges.

  As described above in detail, according to the present embodiment, a pseudo two-dimensional image can be displayed using a general two-dimensional display screen, and the technology can be used to contribute to a wider variety of game development. It becomes possible.

  Further, in the above embodiment, since either one of the pseudo stereoscopic image display and the two-dimensional planar image is selected and displayed, the case where the stereoscopic image display is necessary and the case where it is not necessary are displayed. By selecting, the burden on the CPU 11 can be efficiently reduced.

  In addition, in the above embodiment, either the pseudo stereoscopic image display or the two-dimensional planar image is arbitrarily set according to the progress of the game and selectively displayed. By changing the progress of the game depending on how it is played, the game performance can be further enhanced.

  In the above-described embodiment, the case where the present invention is realized in the Web application program by the web server devices 2 and 3 and the mobile terminals 4 and 5 that are clients has been described. The present invention can be similarly applied to a native application program that is executed alone on the 5th side.

  On the other hand, in the web application program by the web server devices 2 and 3 and the mobile terminals 4 and 5 that are clients, processing from generation of pseudo stereoscopic images to distribution is performed on the server other than processing for detecting inclination. It is also conceivable that the web server device 2 on the side executes.

  Further, in the above-described embodiment, the height data is added to the image data given from the web server device 2 to the mobile terminal 4, but the height information is not necessarily added by the side that provides the image data. First, for example, by dividing the image into a plurality of regions by image analysis processing including contour extraction for a two-dimensional image on the mobile terminal 4 side, the height information for the image data is added and acquired on the mobile terminal 4 side. Is also possible.

In addition, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention in the implementation stage. Further, the functions executed in the above-described embodiments may be combined as appropriate as possible. The above-described embodiment includes various stages, and various inventions can be extracted by an appropriate combination of a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, if the effect is obtained, a configuration from which the constituent requirements are deleted can be extracted as an invention.
The invention described in the scope of the original claims of the original application of the present application will be appended below.
[1]
A program executed by a computer built in a portable terminal device including an inclination sensor and a display unit,
An image acquisition step of acquiring image information to which height information is added for each pixel position;
A tilt acquisition step of acquiring tilt information of the mobile terminal device from the tilt sensor;
A stereoscopic image generation step for generating a pseudo stereoscopic image based on the inclination information acquired in the inclination acquisition step and the height information for each pixel position from the image information acquired in the image acquisition step;
A display step of displaying the pseudo stereoscopic image generated in the stereoscopic image generating step on the display unit;
A three-dimensional image display program comprising: a tilt acquisition step, a three-dimensional image generation step, and a control step for repeatedly executing the processing by the display step at a predetermined cycle.
[2]
The three-dimensional image display program according to [1], wherein the height information is added to each of a plurality of areas into which an image is divided.
[3]
A plane image acquisition step of acquiring a plane image in which height information is excluded from the image information together with image information to which height information is added for each pixel position in the image acquisition step;
The method further comprises a selection step of selecting either one of the pseudo-stereoscopic image generated by the image generation means and the flat image acquired in the flat image acquisition step, and causing the display unit to display the display step. The stereoscopic image display program according to [1] or [2].
[4]
A plane image generation step for generating a plane image in which height information is excluded from the image information acquired in the image acquisition step;
The method further comprises a selection step of selecting either one of the pseudo-stereoscopic image generated by the image generation means and the flat image generated in the flat image generation step, and displaying on the display unit by the display step. The stereoscopic image display program according to [1] or [2].
[5]
The stereoscopic image display program is a part of a game program executed during game execution,
The selection step selects either the pseudo-stereoscopic image or the planar image corresponding to the progress of the game program and displays the selected image on the display unit by the display step [3] or [ 4] The stereoscopic image display program according to item 4.
[6]
The stereoscopic image display program according to [5], wherein the height information is added corresponding to at least one shape of a character, a symbol, and a symbol mark related to the progress of the game program.
[7]
In the selection step, the pseudo-stereoscopic image and the planar image corresponding to at least one of the presence / absence of a specific item in progress of the game, the level of the game character, the presence / absence of event information, the pass / fail of password, and the presence / absence of charge Any one of them is selected, and the stereoscopic image display program according to [4].
[8]
A server device connected via a network to a mobile terminal device including an inclination sensor and a display unit,
Image acquisition means for acquiring image information to which height information is added for each pixel position;
Inclination acquisition means for acquiring inclination information from the inclination sensor of the portable terminal device;
3D image generation means for generating a pseudo 3D image based on the inclination information acquired by the inclination acquisition means and the height information for each pixel position from the image information acquired by the image acquisition means;
Distribution means for distributing the pseudo-stereoscopic image generated by the stereoscopic image generation means to the mobile terminal device and displaying it on the display unit of the mobile terminal device;
A server apparatus comprising: a tilt acquisition unit; a stereoscopic image generation unit; and a control unit that repeatedly executes the processing by the distribution unit at a predetermined cycle.

  DESCRIPTION OF SYMBOLS 1 ... Network, 2, 3 ... Web server apparatus, 4, 5 ... Portable terminal, 6 ... Access point (AP), 7 ... Base station, 11 ... CPU, 12 ... Main memory, 13 ... Solid state drive (SSD), 14 ... 3G & 4G communication unit, 15 ... wireless LAN communication unit, 16 ... short-range wireless communication unit, 17 ... external memory card, 18 ... display unit, 19 ... touch panel input unit, 20 ... key input unit, 21 ... voice processing unit, DESCRIPTION OF SYMBOLS 22 ... Image processing part, 23 ... Triaxial acceleration sensor, 24 ... Vibrator, 25-27 ... Antenna, 28 ... Speaker, 29 ... Microphone, 30 ... Optical lens system, 31 ... Solid-state image sensor, SB ... System bus

Claims (9)

To a computer with a display,
Progress steps to advance the game,
A first image acquisition step of acquiring two-dimensional image data to which height information for partial stereoscopic display is added;
When display of a stereoscopic image is set during the progress of the game in the progression step, a partial stereoscopic image is displayed on the planar image corresponding to the two-dimensional image data based on the height information corresponding to the two-dimensional image data. A stereoscopic image generation step for generating a pseudo stereoscopic image to which the image is added;
A program for executing a display step of displaying the pseudo stereoscopic image on the display unit.   The program according to claim 1, wherein the progress step sets display of the stereoscopic image in accordance with a predetermined condition in the progress of the game.   The program according to claim 1, wherein the stereoscopic image generating step generates the pseudo stereoscopic image based on the height information added for each of a plurality of areas into which the planar image corresponding to the two-dimensional image data is divided. In the above computer,
A plane image generation step for generating a plane image corresponding to the two-dimensional image data;
A selection step of selecting either the pseudo-stereoscopic image or the planar image,
The program according to any one of claims 1 to 3, wherein the display step displays the pseudo stereoscopic image or the planar image selected in the selection step. In the above computer,
A second image acquisition step of acquiring two-dimensional image data to which the height information is not added;
The program according to claim 1, further comprising a height information acquisition step of acquiring the height information based on an image analysis on the two-dimensional image data. The computer has a tilt sensor;
The program according to claim 1, wherein the display step displays the pseudo stereoscopic image when the tilt sensor detects that the computer is tilted.   2. The program according to claim 1, wherein the height information is added corresponding to at least one shape of a character, a symbol, and a symbol mark.   The progress step sets the display of the stereoscopic image on the condition of at least one of the presence / absence of a specific item in progress of the game, the level of the game character, the presence / absence of event information, the pass / fail of a password, and the presence / absence of charging. The program according to claim 2. A server device connected via a network to a mobile terminal device having a display unit,
Progress steps to advance the game,
Image acquisition means for acquiring two-dimensional image data to which height information for displaying in a partially three-dimensional manner is added;
When display of a stereoscopic image is set during the progress of the game in the progression step, a partial stereoscopic image is displayed on the planar image corresponding to the two-dimensional image data based on the height information corresponding to the two-dimensional image data. 3D image generation means for generating a pseudo 3D image with an image added thereto;
A server device having distribution means for distributing the pseudo stereoscopic image to the mobile terminal device and displaying the pseudo stereoscopic image on a display unit of the mobile terminal device;

Images