JP7041868B2 - Display device, display method and display system - Google Patents

Description

The present invention relates to a display device, a display method, and a display system.

A technique is known in which scale information is set in an image such as a design drawing and displayed in a corresponding size.

For example, Japanese Patent Application Laid-Open No. 2013-73603 (Patent Document 1) states that "the CPU of a tablet-type terminal device displays drawing data of a digital drawing at a predetermined scale on a display screen. At this time, the CPU is a digital drawing. Refers to the attribute information of the data of, and displays the design drawing at the selected fixed scale on the display screen by comparing with the display density of the tablet type terminal device. By doing so, the display screen of the terminal device is accurate. The drawing data can be displayed at a scale that conforms to the actual size. "

Japanese Unexamined Patent Publication No. 2013-7603

With conventional technology, digital drawings can be displayed at a scale that conforms to the actual size. However, in the conventional technique, only the digital drawing is displayed on the display. Therefore, there is a problem that it is difficult to grasp the size of the article in comparison with other articles.
An object of the present invention is to provide a technique for grasping the size of an article.

A brief description of typical inventions disclosed in the present application is as follows.

One embodiment of the present invention has an imaging unit that acquires imaging information. Further, it has an image display unit for displaying an image captured image based on the image pickup information acquired by the image pickup unit on a display. Further, when the marker is read by the image pickup unit, the image display unit causes the image of the product to be superimposed and displayed on the captured image in the actual size based on the ratio of the size of the marker to the size of the product.

Further, in one embodiment of the present invention, the imaging unit has an imaging step for acquiring imaging information. Further, the image display unit has an image capture image display step of displaying an image captured image based on the image pickup information acquired by the image pickup unit on a display. Further, when the marker is read by the image pickup unit, the image display unit displays the image of the product on the captured image in the actual size based on the ratio of the size of the marker to the size of the product. It has a display step.

Further, one embodiment of the present invention is a display system including a scale information sharing server and a display device connected to the scale information sharing server via a network, wherein the scale information sharing server is described above. Provide product scale information to the display device. Further, the display device includes an image pickup unit that acquires image pickup information and an image display unit that displays an image captured image based on the image pickup information acquired by the image pickup unit on a display. When the marker is read by the imaging unit, the image of the product is superimposed and displayed on the captured image in actual size based on the ratio of the size of the marker to the size of the product specified based on the scale information.

Among the inventions disclosed in the present application, the effects obtained by representative ones are briefly described as follows.
According to one embodiment of the present invention, the size of the article can be grasped.

It is a figure which shows the outline of the structural example of the display system in one Embodiment of this invention. It is a figure which shows the outline of the structural example of the scale information stored in the shared scale information storage part and the scale information storage part in one Embodiment of this invention. It is a figure which shows the outline of the structural example of the marker information stored in the marker information storage part in one Embodiment of this invention. It is a figure which shows the outline of the structural example of the scale information setting screen in one Embodiment of this invention. It is a figure which shows the outline of the structural example of the image list display screen in one Embodiment of this invention. It is a figure which shows the outline of the structural example of the QR code reading screen in one Embodiment of this invention. It is a figure which shows the outline of the structural example of the full-scale image superimposition display screen in one Embodiment of this invention. It is a figure which shows the outline of the structural example of the full-scale image superimposition display screen in one Embodiment of this invention. It is a figure which shows the outline of the structural example of the full-scale image superimposition display screen in one Embodiment of this invention. It is a figure which shows the outline of the structural example of the full-scale image superimposition display screen in one Embodiment of this invention. It is a figure which shows the outline of the structural example of the full-scale image superimposition display screen in one Embodiment of this invention. It is a figure which shows the outline of the whole processing in one Embodiment of this invention. It is a figure which shows the outline of the product data registration process in one Embodiment of this invention. It is a figure which shows the outline of the full-scale image display processing in one Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, in all the drawings for explaining the embodiment, the same parts are in principle the same reference numerals, and the repeated description thereof will be omitted.
<System configuration>

FIG. 1 is a diagram showing an outline of a configuration example of a display system 10 according to an embodiment of the present invention. As shown in FIG. 1, the display system 10 includes a scale information sharing server 100, a display device 200 connected to the scale information sharing server 100 via a network, and a product connected to the display device 200 via a network. It has an image providing terminal 300.

The display device 200 includes an image display unit 210, a scale setting unit 220, a scale information storage unit 230, a scale designation unit 240, a QR code reading processing unit 250, an image pickup unit 260, a marker information storage unit 270, and the like. It has a registration information storage unit 280.

The display device 200 is equipped with an AR platform, and can operate AR applications and the like as well as spatial recognition. Further, the AR application is pre-installed in the display device 200.

The image display unit 210 displays an image captured image based on the image pickup information acquired by the image pickup unit 260 on the display. Further, the image display unit 210 displays a Web page on a display like general-purpose Web browser software. Further, the image display unit 210 acquires an image (product image) corresponding to the product image URL from an external server and displays it on the display.

The image display unit 210 recognizes that the marker is included in the captured image by extracting the feature points displayed on the marker. There are a plurality of feature points in the marker. For example, when a certain feature point is hidden by a hand or the like, the image display unit 210 includes the marker in the captured image by extracting the feature points that are not hidden. Recognize that it is.

When the marker is read by the image pickup unit 260, the image display unit 210 superimposes and displays the image of the product on the captured image in the actual size based on the ratio of the size of the marker to the size of the product.

The marker read by the image pickup unit 260 is in the form of a sheet and has a size of 3 cm to 100 cm in length and 3 cm to 100 in width. As a marker, a point card, which is presented at the time of shopping and in which points (used for discounting products or exchanging for benefits) are added for each fixed purchase amount, is applicable. In addition, the marker includes all stamp type, bar code type, and card reader type point cards. It also includes credit cards and loyalty cards that have the function of electronic money. The marker does not necessarily have to be in the form of a sheet, and includes any shape recognized as a marker.

The image display unit 210 displays an image of the product based on the position of the marker read by the image pickup unit 260 (coordinates of any one or more points in the marker such as the center position of the marker and the coordinates of the four corners) and the display mode. Determine the position to make. For example, when the display mode is the first display mode, the image display unit 210 determines the position of the marker in the upward direction as the position where the image of the product is displayed.

When the display mode is the second display mode, the image display unit 210 determines the position where the lower side of the product image is displayed in the upward direction of the marker position as the position where the product image is displayed. ..
When the display mode is the third display mode, the image display unit 210 determines the horizontal position of the marker position as the position where the image of the product is displayed.

When the display mode is the fourth display mode, the image display unit 210 displays a position (either the right side or the left side) of the product image in the horizontal direction of the marker position. Is determined as the position where the image of the product is displayed.
The scale setting unit 220 sets the scale information for the image provided by the image display unit 210.
The scale information storage unit 230 stores the scale information set in the image and the product image URL of the image in association with each other.

The scale designation unit 240 acquires the product image URL stored in the scale information storage unit 230 and the scale information corresponding to the product image URL. Then, the scale designation unit 240 displays the image acquired by accessing the product image URL on the display based on the scale information.

The scale designation unit 240 receives an input for designating a scale from the user, and enlarges and reduces the image included in the scale information setting screen (described later, FIG. 4) displayed on the display. Further, the scale designation unit 240 causes the scale information setting screen to display a ruler for measuring the image displayed on the scale information setting screen.

The image pickup unit 260 takes an image of the space and acquires the image pickup information in real time. Further, the image pickup unit 260 displays an image captured image (for example, an image of the space being imaged) based on the image pickup information acquired in real time on the display.
The marker information storage unit 270 stores information for specifying the size of the marker together with the image data of the marker.

The display device 200 includes a calculation device (CPU), a main storage device (RAM), an auxiliary storage device such as an HDD, SSD, and flash memory, a display device such as a liquid crystal display, an organic EL display, and electronic paper, and wired and / or. It is equipped with a means for connecting to the Internet wirelessly and an input device such as a keyboard, a mouse, and a touch panel device. This may use a dedicated terminal for realizing the display device 200, or may be used as an auxiliary storage device for a general-purpose computer device such as a personal computer, a mobile phone terminal, a smartphone terminal, or a tablet terminal. It may be realized by recording a program for realizing the function as 200 and making it an executable configuration. Further, in a computer device that can use general browser software, it may be realized by adding a plug-in program for realizing the function as the display device 200 by the browser software.

Further, in the present embodiment, the display device 200 will be described as having a touch panel device as an input device, but as described above, the input device is not limited to this.
The scale information sharing server 100 has a scale information receiving unit 110, a shared scale information storage unit 120, and a scale information distribution unit 130.

The scale information receiving unit 110 receives the scale information transmitted from the display device 200. The scale information receiving unit 110 stores the received scale information in the shared scale information storage unit 120 in association with the product image URL of the Web page. The product image URL of the Web page may be transmitted from the display device 200 together with the scale information, or may be acquired from an external server.
The scale information distribution unit 130 associates the scale information with the product image URL and transmits the scale information to the display device 200.

The scale information sharing server 100 includes a computing device (CPU), a main storage device (RAM), an auxiliary storage device such as an HDD, SSD, and flash memory, a wired and / or wireless connection means to the Internet, and various input / output means. It can be realized by recording a program for realizing each means of the scale information sharing server 100 in an auxiliary storage device of a general-purpose server device and executing it in an executable manner. Further, the scale information sharing server 100 may be realized by combining a plurality of server devices.
<Scale information storage unit>

FIG. 2 is a diagram showing an outline of a configuration example of scale information stored in the shared scale information storage unit 120 and the scale information storage unit 230 in one embodiment of the present invention. As shown in FIG. 2, the scale information is composed of data items such as [product name], [slot number], [product image URL], [scale information], and [product size information].

[Product name] indicates the name of the product. [Slot number] indicates a number for identifying the slot to which the image of the product is assigned. [Product image URL] indicates a URL for specifying an address in which the product image is stored.

[Scale information] indicates the magnification for displaying the product image in the actual size. The scale value (display magnification) corresponds to the scale information. For example, the scale value when 72 dots are displayed in 1 inch is set as the reference value "1.0", and the value multiplied by the reference value is the scale value.

[Product size information] is information for specifying the size of the product, and is the width of the product (horizontal length of the product image displayed on the display) and the height of the product (product image displayed on the display). The vertical length of). [Product size information] is either the width of the product (the horizontal length of the product image displayed on the display) or the height of the product (the vertical length of the product image displayed on the display). It may be composed of one.
<Marker information storage unit>

FIG. 3 is a diagram showing an outline of a configuration example of marker information stored in the marker information storage unit 270 according to the embodiment of the present invention. As shown in FIG. 3, the marker information is composed of data items such as [product name], [slot number], [marker image], and [marker size information]. [Marker image] is image data for displaying a marker image.

[Marker size information] is information for specifying the size of the marker, and is the width of the marker (horizontal length of the marker image displayed on the display) and the height of the marker (marker image displayed on the display). The vertical length of). [Marker size information] is either the width of the marker (the horizontal length of the marker image displayed on the display) or the height of the marker (the vertical length of the marker image displayed on the display). It may be composed of one.
<Scale information setting screen>

FIG. 4 is a diagram showing an outline of a configuration example of a scale information setting screen according to an embodiment of the present invention. As shown in FIG. 4, on the scale information setting screen, a measurement button 610 and a size input button 620 are displayed.

When the scale information setting screen accepts an operation such as pinch-in or pinch-out, the scale designation unit 240 enlarges or reduces the image 650 displayed on the scale information setting screen. For example, when the scale information setting screen receives an operation of being pinched in, the scale designation unit 240 reduces the image 650 displayed on the scale information setting screen. On the other hand, when the operation of pinching out the scale information setting screen is accepted, the scale designation unit 240 reduces the image 650 displayed on the scale information setting screen.
For example, when the target for which the scale information is set is the image 650, the image 650 is enlarged or reduced so as to fit in the area.
When the measurement button 610 is pressed, the scale designation unit 240 displays the measurement target designation figure 630 for designating the range of the measurement target on the scale information setting screen.

One end 631 of the measurement target designated figure 630 is moved to one end (upper side) of the measurement target by being dragged. Further, by dragging the other end 632 of the measurement target designated figure 630, the other end (lower side) of the measurement target is moved. As a result, one end 631 to the other end 632 of the measurement target designated figure 630 are specified as measurement targets.

When the size input button 620 is pressed, when the input of the size of the measurement target is received, the scale specification unit 240 displays the size input field 660 for receiving the input of the size of the measurement target (the interval from one end 631 to the other end 632). , Display on the scale information setting screen.

The size input field 660 accepts input of the size to be measured. This reveals the number of pixels to be measured and the actual size. When the size of the measurement target is input to the size input field 660, the scale designation unit 240 inputs the specified measurement target range (the interval from one end 631 to the other end 632 of the measurement target designation figure 630). The scale value (display magnification), which is the scale information, is calculated based on the size. Then, the scale designation unit 240 stores the calculated scale information in the scale information storage unit 230 in association with the product image URL for specifying the image. In addition to the product image URL and the scale information, the scale designation unit 240 may store additional information such as a subject or a tag that accepts input via the scale information setting screen in the scale information storage unit 230.
<Image list display screen>

FIG. 5 is a diagram showing an outline of a configuration example of an image list display screen according to an embodiment of the present invention. As shown in FIG. 5, the QR code reading button 710 and the delete button 730 are displayed on the image list display screen. Further, the registered images 720 are displayed in a list on the image list display screen. When the delete button 730 is pressed after the image 720 to be deleted is selected, the selected image 720 is deleted, and the registration information of the corresponding image 720 is deleted from the registration information storage unit 280.

When the QR code reading button 710 is pressed, the QR code reading processing unit 250 of the display device 200 displays the QR code reading screen (described later, FIG. 6) on the display.
<QR code reading screen>

FIG. 6 is a diagram showing an outline of a configuration example of a QR code reading screen according to an embodiment of the present invention. As shown in FIG. 6, the image captured image 600 captured by the image pickup unit 260 of the display device 200 is displayed on the QR code reading screen.

When the QR code (registered trademark) 820 is read by the image pickup unit 260 of the display device 200, the product image URL specified from the QR code 820 is stored in the registration information storage unit 280. As a result, a new image and an image are registered in the display device 200.
<Actual size image superimposition display screen>

7 to 11 are diagrams showing an outline of a configuration example of a full-scale image superimposed display screen according to an embodiment of the present invention. As shown in FIG. 7, on the actual size image superimposition display screen, the first mode switching button 7100, the second mode switching button 7200, the third mode switching button 7300, and the fourth mode switching button are displayed. The 7400 and the candidate image 750 to be superimposed and displayed are displayed.

First, the marker 810 is read by the image pickup unit 260 of the display device 200. When the marker 810 is read normally, the image 820 of the product is superimposed and displayed on the marker 810 as shown in FIG. In this way, by displaying the scale based on the actual size on the display device, the user can easily obtain a feeling of size and the like.

Here, if the scale information stored in the scale information storage unit 230, the dimensions of the display area of the display device 200, and the number of vertical and horizontal pixels are clear, the scale is displayed based on the actual size. be able to. For example, in an image included in a Web page, when a portion having an actual length of 5 cm is displayed at a scale of 1/1 (equal magnification), the length is 5 cm even on the display device of the display device 200. It is possible to display such as.

FIG. 8 shows an example in which the image is displayed in the first display mode. In the first display mode, the image display unit 210 is in a state where the marker 810 and the image 820 are completely or partially overlapped with each other. The image 820 is displayed at a position moved in the direction perpendicular to the marker 810.

In the first display mode, the image 820 may be displayed in the upward direction of the marker 810. Further, the image 820 may be displayed in the downward direction of the marker 810. Further, in the first display mode, the image display unit 210 has a front image (showing a state in which the product is observed from the front direction) and a plane image (showing a state in which the product is observed from the plane direction (upward direction)). , The front image may be selected and displayed on the full-scale image superimposition display screen. Further, in the first display mode, the image display unit 210 may display the lower side of the image 820 in contact with the upper end of the marker 810.

When the second mode switching button 7200 is pressed, the image display unit 210 switches the display mode to the second display mode, and the full-scale image superimposition display screen shown in FIG. 9 is displayed. As shown in FIG. 9, in the second display mode, the image display unit 210 is moved upward with respect to the marker 810 in a state where the marker 810 and the image 820 do not overlap (isolated state). Display the image 820. Further, in the second display mode, the image display unit 210 may select a front image from the front image and the plane image and display it on the full-scale image superimposition display screen.

When the third mode switching button 7300 is pressed, the image display unit 210 switches the display mode to the third display mode, and the full-scale image superimposition display screen shown in FIG. 10 is displayed. As shown in FIG. 10, in the third display mode, the image display unit 210 is in a state where all or part of the marker 810 and the image 820 are overlapped with each other in the horizontal direction (right direction or left) with respect to the marker 810. The image 820 is displayed at the position moved in the direction). Further, in the third display mode, the image display unit 210 may select a flat image from the front image and the flat image and display it on the full-scale image superimposed display screen. Further, in the third display mode, the image display unit 210 may display the image 820 in a state where the center position or the center of gravity of the marker 810 and the center position or the center of gravity of the image 820 overlap.

When the fourth mode switching button 7300 is pressed, the image display unit 210 switches the display mode to the fourth display mode, and the full-scale image superimposition display screen shown in FIG. 11 is displayed. As shown in FIG. 11, in the fourth display mode, the image display unit 210 displays the image 820 with the marker 810 and the image 820 fully or partially overlapped with each other. Further, in the fourth display mode, the image display unit 210 selects a flat image from the front image and the flat image and displays it on the full-scale image superimposed display screen. In the fourth display mode, the image display unit 210 may display a perspective image showing a state in which the product is observed from an oblique direction on the full-scale image superimposition display screen. Further, in the fourth display mode, the image display unit 210 is in a state where the marker 810 and the image 820 do not overlap (isolated state), and is horizontal to the marker 810 (either in the right direction or the left direction). The image 820 may be displayed at the position moved to.

Further, in the fourth display mode, the image display unit 210 compares the width of the marker 810 and the height of the marker 810, which constitute the marker size information, when the width of the marker 810 is larger than the height of the marker 810. , The marker 810 is determined to be a horizontal image. On the other hand, the width of the marker 810 and the height of the marker 810 that constitute the marker size information are compared, and if the height of the marker 810 is larger than the width of the marker 810, the marker 810 is determined to be a vertical image. May be. When the marker 810 is a horizontal image, the image display unit 210 displays the image 820 in a state where the measuring side of the marker 810 adjacent to each other and the measuring side of the image 820 are in contact with each other. When the marker 810 is a vertical image, the image display unit 210 displays the image 820 in a state where the measuring sides of the marker 810 and the measuring sides of the image 820 adjacent to each other are horizontally separated by the width of the marker 810. Let me.

When the marker 810 is moved on the full-scale image superimposition display screen shown in FIGS. 8 to 11, the image 820 follows the marker 810. Thereby, for example, when the image 820 is an image of a mouse, by moving the card-shaped marker 820, it is possible to confirm the image of actually operating the mouse via the full-scale image superimposition display screen.

When a plurality of images 820 are registered in the slot, an input for selecting an image 820 to be displayed on the full-size image superimposition display screen may be accepted. In this case, the image display unit 210 displays the selected image 820 on the full-scale image superimposition display screen.
<Overall processing>
FIG. 12 is a diagram showing an outline of the entire process according to the embodiment of the present invention.
First, in S1201, the product data registration process (described later, FIG. 13) is executed.
Next, in S1202, the display device 200 receives an input for selecting an image to be set in the slot via the image list screen (described above, FIG. 5).

Next, the full-scale image display process (described later, FIG. 14) is executed in S1203, and the image set in the slot in S1202 is superimposed and displayed on the marker captured by the image pickup unit 260 of the display device 200. Will be done.
<Product data registration process>
FIG. 13 is a diagram showing an outline of the product data registration process according to the embodiment of the present invention.
First, in S1301, the product image providing terminal 300 displays the product image display screen on the display.
Next, in S1302, the imaging unit 260 of the display device 200 starts imaging.

Next, in S1303, the QR code reading processing unit 250 of the display device 200 determines whether the QR code included in the product image display screen displayed on the display of the product image providing terminal 300 is captured by the image pickup unit 260. judge. When the QR code reading processing unit 250 determines that the QR code has not been imaged (S1303-No), the process returns to S1302. On the other hand, when the QR code reading processing unit 250 determines that the QR code has been imaged (S1303-Yes), the process proceeds to S1304.

Next, in S1304, the image display unit 210 of the display device 200 accesses the product image URL specified from the QR code. Then, the image display unit 210 acquires the product name, the scale information of the product, and the product image URL for acquiring the image data of the product. For example, the image display unit 210 acquires a product name, product scale information, and product image data from an external server. Further, the image display unit 210 may acquire the product name and the scale information of the product from the scale information sharing server 100. Further, the scale information storage unit 230 may be searched using the product image URL specified from the QR code as a key, and the corresponding product name, the scale information of the product, and the product size information may be acquired.

Next, in S1305, the image display unit 210 of the display device 200 associates the product name acquired in S1305 with the product image URL for acquiring the image data of the product, and the scale information of the product to reduce the scale. It is stored in the information storage unit 230.
<Actual size image display processing>

FIG. 14 is a diagram showing an outline of a full-scale image display process according to an embodiment of the present invention. The actual size image display process is started when the actual size image display application of the display device 200 is started.
First, in S1401, the display device 200 displays a full-scale image superimposition display screen on the display.
Next, in S1402, the imaging unit 260 of the display device 200 starts imaging.

Next, in S1403, the image display unit 210 of the display device 200 determines whether or not the marker is included in the full-scale image superimposition display screen. When the image display unit 210 determines that the marker is not included in the actual size image superimposition display screen (S1403-No), the image display unit 210 returns to S1401. On the other hand, when the image display unit 210 determines that the marker is included in the full-scale image superimposition display screen (S1403-Yes), the process proceeds to S1404.

Next, in S1404, the image display unit 210 of the display device 200 searches the scale information storage unit 230 using the product name corresponding to the marker included in the full-scale image superimposition display screen as a key, and searches for the corresponding product image URL. And get the scale information. Then, the product size information is calculated from the acquired scale information. For example, the image display unit 210 calculates the product size information based on the dimensions of the display area of the display device 200, the number of vertical and horizontal pixels, and the scale information.
The image display unit 210 may acquire the product size information instead of the scale information.

Next, in S1405, the image display unit 210 of the display device 200 searches the marker information storage unit 270 using the slot number as a key, and acquires the corresponding marker size information.

Next, in S1406, the image display unit 210 of the display device 200 determines the ratio between the marker size and the product size based on the product size information calculated or acquired in S1404 and the marker size information acquired in S1405. calculate.

For example, the image display unit 210 has a marker height (vertical length of the marker image displayed on the display) and a product height (vertical length of the product image displayed on the display). The ratio is calculated as the ratio between the size of the marker and the size of the product.

The image display unit 210 determines the ratio between the width of the marker (horizontal length of the marker image displayed on the display) and the width of the product (horizontal length of the product image displayed on the display). , It may be calculated as a ratio between the size of the marker and the size of the product.

Next, in S1407, the image display unit 210 of the display device 200 displays the product image specified from the product image URL on the actual size image superimposition display screen based on the ratio calculated in S1406. As a result, the image set in the slot in S1202 is superimposed and displayed.
<Effect of this embodiment>
In the present embodiment described above

Although the invention made by the present inventor has been specifically described above based on the embodiment, the present invention is not limited to the above embodiment and can be variously modified without departing from the gist thereof. Needless to say.

For example, there is also an embodiment in which the display device is a smartphone or a tablet terminal. The donor terminal / recipient terminal includes all various types of terminals such as desktop PCs (Personal Computers), notebook PUs, smartphones, and tablet terminals.

Further, the above-described embodiments have been described in detail in order to explain the present invention in an easy-to-understand manner, and are not necessarily limited to those having all the described configurations. Further, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. .. Further, a part of the configuration of each embodiment may be added, deleted, or replaced with another configuration.

Moreover, each of the above-mentioned configurations, functions, and processing units may realize a part or all of them by hardware (for example, an integrated circuit). Further, each of the above configurations, functions, and processing units may be realized by software by the processor interpreting and executing a program that realizes each function. Information such as programs, tables, and files that realize each function can be placed in a memory, a hard disk, a recording device such as an SSD (Solid State Drive), or a recording medium such as an IC card, an SD card, or a DVD.

100 ... Scale information sharing server, 110 ... Scale information receiving unit, 120 ... Shared scale information storage unit, 130 ... Scale information distribution unit,

200 ... Display device, 210 ... Image display unit, 220 ... Scale setting unit, 230 ... Scale information storage unit, 240 ... Scale designation unit, 250 ... QR code reading processing unit, 260 ... Imaging unit, 270 ... Marker information storage unit, 280 registration information storage unit.
300 ... Product image providing terminal.

Claims (6)

An imaging unit that acquires imaging information and
An image display unit that displays an image captured based on the image pickup information acquired by the image pickup unit on a display, and an image display unit.
Have,
When the marker is read by the image pickup unit, the image display unit displays the image of the product on the captured image in actual size based on the ratio of the size of the marker to the size of the product .
When the display mode is the fourth display mode, the image display unit may be used.
The width of the marker and the height of the marker, which make up the marker size information, are compared. Display the image with the measuring sides in contact,
The width of the marker and the height of the marker, which constitute the marker size information, are compared. If the height of the marker is larger than the width of the marker, the marker is judged as a vertical image and only the width of the marker is horizontally isolated. Display the image in the state of
Display device. In the display device according to claim 1 ,
When the display mode is the second display mode, the image display unit moves the image in a position perpendicular to the marker in a state where the marker and the image do not overlap with each other. On the other hand, the actual size is superimposed and displayed.
Display device. In the display device according to claim 1 ,
When the display mode is the first display mode, the upward position of the marker position is determined as the position where the image of the product is displayed, and the front image is selected from the front image and the plane image. In a state where all or part of the marker and the image are overlapped with each other, the image is superimposed and displayed on the captured image in the actual size at a position moved in the direction perpendicular to the marker.
When the display mode is the third display mode, the horizontal position of the marker position is determined as the position where the image of the product is displayed, and the plane image is selected from the front image and the plane image. Then, in a state where all or part of the marker and the image are overlapped, the image is superimposed and displayed on the captured image in the actual size at a position moved horizontally with respect to the marker.
Display device. In the display device according to claim 1,
The imaging unit reads a point card as the marker.
Display device. An imaging step in which the imaging unit acquires imaging information,
An image display step of displaying an image captured by the image display unit based on the image captured information acquired by the image pickup unit on a display, and a captured image display step.
When the marker is read by the image pickup unit, the image display unit displays an image of the product on the captured image in actual size based on the ratio of the size of the marker to the size of the product. When,
Have,
The full-scale image display step is
When the display mode is the fourth display mode, the image display unit compares the width of the marker and the height of the marker constituting the marker size information, and when the width of the marker is larger than the height of the marker. , The marker is judged as a horizontal image, and the image is displayed with the measuring sides of the adjacent markers and the measuring sides of the image in contact with each other.
The width of the marker and the height of the marker, which constitute the marker size information, are compared. If the height of the marker is larger than the width of the marker, the marker is judged to be a vertical image, and only the width of the marker is horizontally isolated. Display the image in the state of
Display method. A display system including a scale information sharing server and a display device connected to the scale information sharing server via a network.
The scale information sharing server provides the scale information of the product to the display device.
The display device is
An imaging unit that acquires imaging information and
An image display unit that displays an image captured based on the image pickup information acquired by the image pickup unit on a display, and an image display unit.
Have,
The image display unit is
When the marker is read by the imaging unit, the image of the product is superimposed and displayed on the captured image in actual size based on the ratio of the size of the marker to the size of the product specified based on the scale information .
When the display mode is the fourth display mode, the image display unit compares the width of the marker and the height of the marker constituting the marker size information, and when the width of the marker is larger than the height of the marker. , The marker is judged as a horizontal image, and the image is displayed with the measuring sides of the adjacent markers and the measuring sides of the image in contact with each other.
The width of the marker and the height of the marker, which constitute the marker size information, are compared. If the height of the marker is larger than the width of the marker, the marker is judged as a vertical image and only the width of the marker is horizontally isolated. Display the image in the state of
Display system.

Images