JP2020109548A - Display method of terminal, terminal, program for terminal - Google Patents

Abstract

To provide a method of displaying a moving image advertisement.SOLUTION: A display method of a terminal displaying a moving image advertisement in a display area comprises: detecting an object by a detection unit of the terminal; acquiring information about size of the object detected by the detection unit by an acquisition unit of the terminal; and displaying the moving image advertisement in the display area based on information about a position of the object based on the information about the size of the object; and controlling reproduction of the moving image advertisement.SELECTED DRAWING: Figure 2

Description

The present disclosure relates to a terminal display method, a terminal, and a terminal program.

In recent years, various advertisement providing methods have been taken. Patent Document 1 discloses a display method in a vehicle for presenting an advertisement/advertisement to a user in the vehicle, and a display image of the advertisement/advertisement based on advertisement/advertisement information including contents to be advertised/advertised. Has been disclosed, and a display image is displayed in the display area provided on the windshield of the vehicle based on the position of the object to be advertised/advertised. However, the display of moving images has not been sufficiently studied.

JP, 2005-70231, A

According to a first aspect of the present invention, there is provided a display method of a terminal for displaying a video advertisement in a display area, wherein an object is detected by a detection unit of the terminal, and information on the size of the object detected by the detection unit. Is acquired by the acquisition unit of the terminal, and the video advertisement is displayed in the display area based on the information about the position of the object based on the information about the size of the object, and the reproduction of the video advertisement is controlled.
According to a second aspect of the present invention, there is provided a program that is executed by a computer of a terminal that displays a video advertisement in a display area, the object detecting unit detecting the object, and the size of the object detected by the detecting unit. Based on the information about the size obtained by the acquisition unit of the terminal and the information about the size of the object, the video advertisement is displayed in the display area based on the information about the position of the object, and the control to execute the reproduction of the video advertisement is performed. Including and.
According to a third aspect of the present invention, a terminal that displays a video advertisement in a display area, a detection unit that detects an object, an acquisition unit that acquires information regarding the size of the object detected by the detection unit, And a control unit configured to display a video advertisement in a display area based on the information on the position of the object based on the information on the size of the object, and to control the reproduction of the video advertisement.

FIG. 1 is a diagram showing a configuration of a communication system according to an aspect of an embodiment. FIG. 3 is a schematic diagram for explaining the outline of the embodiment. The data conceptual diagram which shows the structural example of signboard information. The sequence diagram which shows an example of the exchange in a communication system. The flowchart which shows the operation example regarding the display of the video advertisement in a terminal. The flowchart which shows an example of the transmission operation of the signboard information in a server. The flowchart which shows the operation example which concerns on the reproduction control of the video advertisement in a terminal. FIG. 6A is a screen diagram showing a display example on a terminal. FIG. 6B is a bird's-eye view showing an arrangement example of the user and the signboard in the case of the display in FIG. (A) is a screen diagram before displaying a video advertisement. (B) is a screen view after displaying a video advertisement. (A) is a figure for demonstrating the other example of the edge which opposes. (B) is a figure for demonstrating the example of the signboard area other than a rectangle, and the edge which opposes in that case. The image figure which shows the example of exchange of the reward between the parties concerned with advertisement. The figure which shows the structure of the communication system in a modification. The flowchart which shows operation|movement of the communication system in a modification.

<Compliance with legal matters>
It should be noted that the disclosure provided herein is subject to compliance with the national jurisdictions of the implementing country necessary to practice the disclosure, including confidentiality of the communications.

An embodiment for carrying out a method of displaying a moving image advertisement by a terminal according to the present disclosure will be described with reference to the drawings.

<System configuration>
FIG. 1 shows a configuration of a communication system 1 according to an embodiment of the present disclosure. As disclosed in FIG. 1, in the communication system 1, the server 10 and the terminal 20 (terminal 20A, terminal 20B) are connected via the network 30. The server 10 provides the terminal 20 owned by the user via the network 30 with a service for transmitting and receiving a message between the terminals 20. The number of terminals 20 connected to the network 30 is not limited.

The network 30 plays a role of connecting the one or more terminals 20 and the one or more servers 10. That is, the network 30 means a communication network that provides a connection path so that the terminal 20 can transmit and receive data after connecting to the server 10.

One or more portions of network 30 may or may not be wired or wireless networks. The network 30 is, by way of example and not limitation, an ad hoc network, an intranet, an extranet, a virtual private network (VPN), a local area network (LAN), wireless. LAN (wireless LAN: WLAN), wide area network (wide area network: WAN), wireless WAN (wireless WAN: WWAN), metropolitan area network (metropolitan area network: MAN), part of the Internet, public switched telephone network (Public) Switched Telephone Network: Part of PSTN, mobile phone network, ISDN (integrated service digital networks), wireless LAN, LTE (long term evolution), CDMA (code division multiple access), Bluetooth (Bluetooth (registered trademark)), satellite Communication, etc., or a combination of two or more of these may be included. The networks 30 may include one or more networks 30.

The terminal 20 (terminal 20A, terminal 20B) may be any terminal as long as it is an information processing terminal capable of realizing the functions described in each embodiment. For example, the terminal 20 is preferably a wearable terminal (eg, glasses-type device, head-mounted display, etc.) having an imaging function and a display function, but is not limited to these, and is not limited thereto. ), a computer (such as, but not limited to, a laptop, tablet, etc.), a handheld computing device (such as, but not limited to, a PDA (personal digital assistant), email client, etc.), or other type of computer, or communication platform. including. Further, the terminal 20 may be expressed as an information processing terminal.

Since the configurations of the terminal 20A and the terminal 20B are basically the same, the terminal 20 will be described in the following description. In addition, the terminal used by the user X is referred to as a terminal 20X, and the user information in a predetermined service associated with the user X or the terminal 20X is referred to as a user information X as necessary. Note that the user information is user information associated with an account used by the user in a predetermined service. The user information is, for example and without limitation, the user's name, user's icon image, user's age, user's gender, user's address, user's hobby, which is input by the user or given by a predetermined service. The information includes information associated with the user such as the taste and the user's identifier, and may be one or a combination of these, or not.

The server 10 has a function of providing a predetermined service to the terminal 20. The server 10 may be any device as long as it is an information processing device that can realize the functions described in each embodiment. The server 10 includes, by way of example and not limitation, server devices, computers (eg, without limitation, desktops, laptops, tablets, etc.), media computer platforms (eg, without limitation, cables, satellite set top boxes, digital video recorders). ), handheld computing devices (for example and not by way of limitation, PDAs, email clients, etc.), or other types of computers, or communication platforms. Further, the server 10 may be expressed as an information processing device. When it is not necessary to distinguish between the server 10 and the terminal 20, the server 10 and the terminal 20 may or may not be represented as information processing devices.

<Hardware (HW) configuration>
The HW configuration of each device included in the communication system 1 will be described with reference to FIG.

(1) HW configuration of terminal

The terminal 20 includes a control unit 21 (CPU: central processing unit (Central Processing Unit)), a storage unit 28, a communication I/F 22 (interface), an input/output unit 23, a display unit 24, and a position information acquisition unit 25. The respective components of the HW of the terminal 20 are connected to each other via the bus B by way of example and not limitation. Note that it is not essential that the HW configuration of the terminal 20 includes all the constituent elements. By way of example, and not limitation, the terminal 20 may or may not be configured to remove individual components, or multiple components, such as the microphone 232, speaker 233, etc.

The communication I/F 22 sends and receives various data via the network 30. The communication may be performed by wire or wireless, and any communication protocol may be used as long as mutual communication can be performed. The communication I/F 22 has a function of executing communication with the server 10 via the network 30. The communication I/F 22 transmits various data to the server 10 according to an instruction from the control unit 21. Further, the communication I/F 22 receives various data transmitted from the server 10 and transfers the data to the control unit 21. In addition, the communication I/F 22 may be simply expressed as a communication unit. Further, when the communication I/F 22 is composed of a physically structured circuit, it may be expressed as a communication circuit.

The input/output unit 23 includes a device that inputs various operations on the terminal 20 and a device that outputs a processing result processed by the terminal 20. In the input/output unit 23, the input unit and the output unit may be integrated, or the input unit and the output unit may be separated or may not be separated.

The input unit is realized by any one or combination of devices of all types capable of receiving an input from the user and transmitting information related to the input to the control unit 21. The input unit is, for example, without limitation, a hardware key provided in the terminal 20, a controller 231, a touch display, a pointing device such as a mouse, a camera 234 (operation input via a moving image), a microphone 232 (operation by voice). Input) is included. The operation input through the moving image by the camera 234 is, for example and not by way of limitation, in the moving image captured by the camera 234, the movement of the hand of the user wearing the terminal 20 is performing a predetermined movement. When it can be detected, the predetermined movement is used as an operation input to execute a process associated in advance. As an example and not by way of limitation, it is conceivable that the user moves the user's finger so as to draw a predetermined trajectory or blinks a predetermined number of times as the operation input via the moving image.

The output unit is realized by any one or combination of devices of all types capable of outputting the processing result processed by the control unit 21. The output unit includes, for example and without limitation, a touch panel, a touch display, a speaker 233 (voice output), a lens (for example, without limitation, 3D (three dimensions) output, hologram output), and the like.

The display unit 24 is realized by any of all types of devices capable of displaying or a combination thereof according to the display data written in the frame buffer. The display unit 24 includes, for example and without limitation, a touch panel, a touch display, a monitor (for example, without limitation, a liquid crystal display or OELD (organic electroluminescence display)), a head mounted display (HDM: Head Mounted Display), projection mapping, a hologram. , A device capable of displaying an image, text information, etc. in the air (may or may not be in a vacuum). Note that these display units 24 may or may not be able to display the display data in 3D.

When the input/output unit 23 is a touch panel, the input/output unit 23 and the display unit 24 may be arranged to face each other with substantially the same size and shape.

The control unit 21 has a circuit physically structured to execute a function realized by a code or an instruction included in a program, and as an example and not a limitation, a data processing device incorporated in hardware. It is realized by. Therefore, the control unit 21 may or may not be expressed as a control circuit.

The control unit 21 includes, by way of example and not limitation, a central processing unit (CPU), a microprocessor, a processor core, a multiprocessor, an ASIC (application-spec I/Fic integrated circuit), and an FPGA ( field programmable gate array).

The storage unit 28 has a function of storing various programs and various data necessary for the terminal 20 to operate. The storage unit 28 includes, for example and without limitation, various storage media such as a hard disk drive (HDD), a solid state drive (SSD), a flash memory, a random access memory (RAM), and a read only memory (ROM). The storage unit 28 may or may not be expressed as a memory.

The terminal 20 stores the program P in the storage unit 28, and by executing the program P, the control unit 21 executes the processing as each unit included in the control unit 21. That is, the program P stored in the storage unit 28 causes the terminal 20 to realize each function executed by the control unit 21. The program P may or may not be expressed as a program module.

The microphone 232 is used for inputting voice data. The speaker 233 is used to output audio data. The camera 234 is used to acquire moving image data. The position information acquisition unit 25 acquires the position information of the terminal 20 and the orientation (azimuth angle) of the terminal 20, and transmits it to the control unit 21. The orientation (azimuth) of the terminal 20 refers to the front direction of the user when the user wears the terminal 20. The position information acquisition unit 25 can be realized by a positioning system such as GNSS or GPS, a 6-axis sensor, or the like, as an example without limitation, but the position information acquisition unit 25 is not limited thereto.

(2) Server HW configuration
The server 10 includes a control unit 11 (CPU), a storage unit 15, a communication I/F 14 (interface), an input/output unit 12, and a display unit 13. The components of the HW of the server 10 are connected to each other via a bus B, as an example and not a limitation. The HW of the server 10 does not have to include all the constituent elements as the configuration of the HW of the server 10. By way of example and not limitation, the HW of the server 10 may or may not be configured to remove the display unit 13.

The control unit 11 has a circuit physically structured to execute a function realized by a code or an instruction included in a program, and as an example and not a limitation, a data processing device incorporated in hardware. It is realized by.

The control unit 11 is typically a central processing unit (CPU), and may or may not be a microprocessor, processor core, multiprocessor, ASIC, or FPGA. In the present disclosure, the control unit 11 is not limited to these.

The storage unit 15 has a function of storing various programs and various data necessary for the server 10 to operate. The storage unit 15 is realized by various storage media such as HDD, SSD, and flash memory. However, in the present disclosure, the storage unit 15 is not limited to these. The storage unit 15 may or may not be expressed as a memory.

The communication I/F 14 sends and receives various data via the network 30. The communication may be performed by wire or wireless, and any communication protocol may be used as long as mutual communication can be performed. The communication I/F 14 has a function of executing communication with the terminal 20 via the network 30. The communication I/F 14 transmits various data to the terminal 20 according to an instruction from the control unit 11. Further, the communication I/F 14 receives various data transmitted from the terminal 20 and transfers the data to the control unit 11. Further, the communication I/F 14 may be simply expressed as a communication unit. Further, when the communication I/F 14 is composed of a physically structured circuit, it may be expressed as a communication circuit.

The input/output unit 12 is realized by a device that inputs various operations on the server 10. The input/output unit 12 is realized by any one or combination of devices of all types capable of receiving an input from a user and transmitting information related to the input to the control unit 11. The input/output unit 12 is typically realized by a hardware key typified by a keyboard or the like, or a pointing device such as a mouse. It should be noted that the input/output unit 12 may or may not include a touch panel, a camera (operation input via a moving image), and a microphone (operation input by voice), for example and not by way of limitation. However, in the present disclosure, the input/output unit 12 is not limited to these.

The display unit 13 is typically realized by a monitor (a liquid crystal display or an OELD (organic electroluminescence display) as an example without limitation). The display unit 13 may or may not be a head mounted display (HDM). Note that these display units 13 may or may not be able to display the display data in 3D. However, in the present disclosure, the display unit 13 is not limited to these.
The server 10 stores the program P in the storage unit 15, and by executing the program P, the control unit 11 executes the processing as each unit included in the control unit 11. That is, the program P stored in the storage unit 15 causes the server 10 to realize each function executed by the control unit 11. This program P may or may not be expressed as a program module.

In each embodiment of the present disclosure, it will be described as being realized by the CPU of the terminal 20 and/or the server 10 executing the program P.

The control unit 21 of the terminal 20 and/or the control unit 11 of the server 10 is formed not only in a CPU having a control circuit but also in an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)), or the like. Each process may or may not be implemented by a logic circuit (hardware) or a dedicated circuit that is created. Further, these circuits may be realized by one or a plurality of integrated circuits, and the plurality of processes shown in each embodiment may or may not be realized by one integrated circuit. Further, the LSI may be referred to as VLSI, super LSI, ultra LSI, or the like depending on the degree of integration. Therefore, the control unit 21 may or may not be expressed as a control circuit.

Further, the program P of each embodiment of the present disclosure (as a non-limiting example, a software program, a computer program, or a program module) may be provided in a state of being stored in a computer-readable storage medium. It does not have to be done. The storage medium can store the program P on a “non-transitory tangible medium”. The program P may or may not be a program for realizing a part of the function of each embodiment of the present disclosure. Further, it may or may not be a so-called difference file (difference program) that can realize the function of each embodiment of the present disclosure in combination with the program P already recorded in the storage medium.

The storage medium may be one or more semiconductor-based or other integrated circuits (ICs) such as, by way of example and not limitation, field programmable gate arrays (FPGAs) or application specific ICs (ASICs), hard disks. -Disk drive (HDD), hybrid hard drive (HHD), optical disk, optical disk drive (ODD), magneto-optical disk, magneto-optical drive, floppy diskette, floppy disk drive (FDD), magnetic tape, solid state It may include a drive (SSD), RAM drive, secure digital card, or drive, any other suitable storage medium, or any suitable combination of two or more thereof. Storage media may be volatile, non-volatile, or a combination of volatile and non-volatile, where appropriate. The storage medium is not limited to these examples, and may be any device or medium as long as it can store the program P. Further, the storage medium may or may not be expressed as a memory.

The server 10 and/or the terminal 20 can realize the functions of the plurality of functional units shown in each embodiment by reading the program P stored in the storage medium and executing the read program P.

Further, the program PDD of the present disclosure may or may not be provided to the server 10 and/or the terminal 20 via any transmission medium (communication network, broadcast wave, etc.) capable of transmitting the program. Good. By way of example and not limitation, the server 10 and/or the terminal 20 execute the program P downloaded via the Internet or the like to realize the functions of the plurality of functional units shown in each embodiment.

Each embodiment of the present disclosure can also be realized in the form of a data signal embedded in a carrier wave in which the program P is embodied by electronic transmission.
At least a part of the processing in the server 10 and/or the terminal 20 may or may not be realized by cloud computing configured by one or more computers.
At least a part of the processing in the terminal 20 may or may not be configured to be performed by the server 10. In this case, at least a part of the processing of each functional unit of the control unit 21 of the terminal 20 may or may not be configured to be performed by the server 10.
At least part of the processing in the server 10 may or may not be performed by the terminal 20. In this case, at least a part of the processing of each functional unit of the control unit 11 of the server 10 may or may not be configured to be performed by the terminal 20.
Unless explicitly stated, the configuration of the determination in the embodiment of the present disclosure is not essential, a predetermined process is operated when the determination condition is satisfied, or a predetermined process is performed when the determination condition is not satisfied. It may or may not be.

Note that the program of the present disclosure includes, for example and without limitation, script languages such as ActionScript and JavaScript (registered trademark), object-oriented programming languages such as Objective-C and Java (registered trademark), and markup languages such as HTML5. It is implemented using.

<Functional configuration>
<Embodiment>
<Overview>
The outline of this embodiment will be described with reference to FIG. It is assumed that the user 50 wears the terminal 20 as shown in FIG. The terminal 20 according to the present embodiment is basically assumed to be a head-mounted display or glasses-type wearable terminal worn by the user, which has an imaging function and a display function, but is not limited to these. .. FIG. 2 shows an example in which the user wears a head mounted display as the terminal 20. The terminal 20 is typically a device that provides semi-virtual reality such as AR (Augmented Reality) and MR (Mixed Reality), but is not limited to these and provides VR (Virtual Reality). May be The terminal 20 displays (reproduces) an advertisement when a region that can be recognized as a signboard (a display region for displaying a moving image advertisement) exists in the image of the display region and when a predetermined condition is satisfied. As an example, the user wears a glasses-type wearable terminal, and the glasses-type wearable terminal displays (a processed image of) the scenery while capturing the scenery of the city and allows the user to visually recognize it. Then, when there is a signboard in the visually recognized area, the video advertisement is reproduced under appropriate conditions according to the user.

To be more specific with reference to FIG. 2, it is assumed that the user 50 is moving toward the sign 200 from a distance from the sign 200, as shown at the right end of FIG. At this time, it is assumed that an image as shown in the display screen diagram 210 is displayed on the screen of the terminal 20. The display screen diagram 210 is an image (moving image) captured by the camera provided in the terminal 20. At this time, in the display screen image 210, the signboard 200 itself is present at a distant position, so that the display screen image 210 is shown as a small region with respect to the entire display region. In such a state, the terminal 20 determines that the condition is not satisfied and does not play the video advertisement.

On the other hand, as shown in the center of FIG. 2, it is assumed that the user 50 walks and approaches the signboard 200. Then, an image as shown in the display screen diagram 211 is displayed on the terminal 20. As shown in the figure, in the display screen diagram 211 of the terminal 20, the signboard 200 is displayed larger in the display area than when the user 50 is far from the signboard 200. In such a case, the terminal 20 reproduces the video advertisement at the position of the signboard 200. When the video advertisement is reproduced when the area in which the signboard 200 is displayed is wide enough to be visually recognized by the user 50, the content of the video advertisement can be easily grasped. Therefore, when the terminal 20 has an area corresponding to the signboard 200 in the display area being imaged and the user 50 is in a state where the user 50 can sufficiently and appropriately visually recognize the area, a moving image is displayed in the area corresponding to the signboard 200. Play the ad.

The terminal 20 can improve the accuracy with which the user views the advertisement by playing the video advertisement under appropriate conditions. The term "advertisement" as used herein refers to a moving image including information content (message) for which information is desired to be transmitted to predetermined people, but this is not limited to the moving image and may be a still image. By way of example, and not limitation, the advertisement may include information about the product or service that the advertiser wishes to sell, and may otherwise be an introduction to a person or entertainment. The details will be described below.

(1) Functional configuration of the terminal
As shown in FIG. 1, the control unit 21 of the terminal 20 includes an image analysis unit 211, a video advertisement acquisition unit 212, and a video advertisement reproduction unit 213.

The camera 234 of the terminal 20 images the front direction of the user while the user wears the terminal 20. The camera 234 transmits the captured image to the control unit 21. The control unit 21 displays the received image on the display unit 24.
On the other hand, the image analysis unit 211 determines whether or not the signboard area is included in the image captured by the camera 234 of the terminal 20. The signboard area is an area for reproducing a moving picture advertisement, and is, for example, an area in which an advertisement, a poster, or the like is posted in a city. As an example, the image analysis unit 211 determines whether or not there is a signboard in the image captured by the camera 234, and has a monotone region (a white region as an example, not a limitation) having a certain width or more. Whether or not it can be determined. Alternatively, or as an example, the image analysis unit 211 previously creates a learning model using deep learning or the like for determining whether or not the signboard area is included in the image, and the learning model is stored in the storage unit 28. It is possible to determine whether or not the image captured by the camera 234 includes the signboard area by storing it in the. When the image analysis unit 211 determines that the signboard area is included in the image captured by the camera 234, it notifies the moving image advertisement acquisition unit 212 of that fact.

The video advertisement acquisition unit 212 receives the position information and the orientation information of the terminal 20 acquired by the position information acquisition unit 25 when the image analysis unit 211 notifies that the captured image includes the signboard area. , To the server 10 via the communication I/F 22. Then, the moving picture advertisement acquisition unit 212 transmits, to the moving picture advertisement reproduction unit 213, via the communication I/F 22, the signboard information and the moving picture information that are assumed to be included in the image and are received from the server 10. ..

The video advertisement reproduction unit 213 reproduces the video advertisement received from the video advertisement acquisition unit 212 when the terminal 20 and the signboard indicated by the signboard information received from the video advertisement acquisition unit 212 have a predetermined relationship. To do. As an example, the video advertisement reproduction unit 213 may reproduce the video advertisement when at least one of the following conditions 1 to 5 is satisfied, and the video advertisement is not displayed until the plurality of conditions are satisfied. May be played.
(Condition 1) The distance between the terminal 20 and the signboard is a predetermined distance or less. That is, the user can see the signboard area sufficiently.
(Condition 2) With respect to the actual size (reference size) of the signboard indicated by the signboard information, the size of the signboard in the display area of the display unit 24 of the terminal 20 satisfies a predetermined standard (in a limited case, As an example, it has a size of 40% or more of the actual size). If the size of the entire display area of the display unit 24 is larger than a predetermined size with respect to the size of the original signboard itself, the user cannot recognize even if the moving image advertisement is reproduced. Therefore, when the size of the signboard itself in the screen with respect to the original size is equal to or larger than the predetermined size, the user can easily recognize the content of the video advertisement by playing the video advertisement.
(Condition 3) The viewing angle with respect to the signboard area shown in the display area of the display unit 24 is equal to or larger than a predetermined threshold. That is, the signboard area in the display area has a sufficient area as seen from the user.
(Condition 4) The width of the signboard area shown in the display area of the display unit 24 has a width of at least a predetermined number of pixels (both vertical width and/or horizontal width). Having a width equal to or larger than the predetermined number of pixels means that the video advertisement has a width sufficient for displaying the video advertisement. In other words, the perspective (perspective) seen from the user (terminal 20) in the signboard area determines whether or not the video advertisement is reproduced in the signboard area.
(Condition 5) The difference or ratio (short side to long side) of the lengths of the opposite sides of the signboard area is equal to or less than a predetermined threshold value. When there is a difference (ratio) greater than or equal to a predetermined value between one side of the signboard area and the opposite side, the angle of the signboard area with respect to the user is steep, and when the video advertisement is reproduced, the user often understands the content of the video advertisement. I can't confirm. However, conversely, if the difference between the lengths of the opposite sides of the signboard area is equal to or greater than a predetermined threshold value, the user is likely to be able to see the video advertisement well.
Therefore, by way of example and not limitation, if a plurality of conditions described here are combined, the distance between the terminal 20 and the signboard area is a predetermined distance or less, and the display area being viewed has a size of a predetermined value or more. , Perspective, that is, when the perspective of the signboard area is not tight (when viewed from the user, it looks as flat as possible), the moving image advertisement may be reproduced. Further, when the size of the signboard area has a predetermined size, the video advertisement is reproduced, and when the size of the signboard area does not have, a still image related to the video advertisement may be displayed. Good.
When the moving image advertisement is not displayed, nothing may be displayed in the signboard area, or some still image may be displayed. Also, for example, even if the signboard area is steep and it is estimated that the user cannot properly confirm the content even if the video advertisement is reproduced in the signboard area, the video advertisement is reproduced in the signboard area. It may be configured to. Even if you cannot confirm the content, if you can see that there is some movement on the screen, you can improve the possibility that the user moves to see the signboard area more appropriately to confirm the content. It is possible to improve the opportunity to view the advertisement.

Note that the conditions are not limited to these, and may be other conditions as long as the user can visually recognize the video advertisement to some extent and can determine whether or not the content of the video advertisement can be confirmed. If the condition is not satisfied, the video advertisement reproduction unit 213 may not display the video advertisement in the signboard area, but may be configured to display only the still image of the first frame of the video. May be. As a result, in the communication system 1, it is possible to allow each user to view various types of appropriate advertisements without posting advertisements or posters at the positions where the actual signboards are. In addition, since it is not necessary to post an advertisement or a poster, the labor for that can be reduced. Also, all ads can be digitized, eliminating the need for physical ads.

(2) Functional configuration of the server
As shown in FIG. 1, the server 10 includes a signboard identifying unit 111 and a moving image advertisement identifying unit 112 as functions realized by the control unit 11. The storage unit 15 also stores signboard information 300 described later.

The signboard identifying unit 111, based on the position information and the direction information transmitted from the terminal 20, within a predetermined angle range and within a predetermined distance from the position indicated by the position information about the direction indicated by the direction information. The signboard existing in 1 is specified from the signboard information 300. The signboard information specified by the signboard specifying unit 111 includes position information in which the signboard is arranged (positional information of the center of the signboard) and the direction (azimuth) in which the signboard is arranged. It may also include vertical width information and horizontal width information.

The video advertisement identifying unit 112 identifies a video advertisement to be played on the user's terminal 20. The video advertisement identification unit 112 identifies a video advertisement that matches the preference of the user of the terminal 20 by way of example and not limitation. As an example and not by way of limitation, the video advertisement identifying unit 112 receives the preference information of the user of the terminal 20 from the terminal 20, associates the video advertisement with what attribute the metadata has, and stores the preference information as the metadata. By specifying a video advertisement having a matching attribute, a video advertisement suitable for the user of the terminal 20 can be specified, but the present invention is not limited to this. The video advertisement identifying unit 112 may or may not assume that the popular video advertisement is a video advertisement to be played on the terminal 20. Alternatively, the video advertisement specifying unit 112 may randomly specify the video advertisement to be played on the terminal 20.

The control unit 11 transmits the information of one or more signboards specified by the signboard specifying unit 111 and the video advertisement specified by the video advertisement specifying unit 112 to the terminal 20 via the communication I/F 14. The server 10 may receive a new video advertisement from an advertiser who wants to deliver the advertisement, store the new video advertisement in the storage unit 15, and may deliver the newly received video advertisement to the terminal 20. You don't have to. The above is the configuration of the server 10.

<Data>
FIG. 3 is a data conceptual diagram showing a configuration example of signboard information. The signboard information 300 shown in FIG. 3 is information indicating where, in what direction, and in what size signboards are arranged in the real world (or virtual world). In the signboard information 300, it is desirable that an advertisement be present at the place where the signboard is placed, but in the present embodiment, the terminal 20 reproduces the moving picture advertisement without attaching a specific advertisement.

As shown in FIG. 3, the message information 300 is information in which the signboard ID 301 and the position information 302 are associated with each other. As shown in FIG. 3, the message information 300 may or may not be associated with a width 303, a height 304, and a direction (azimuth) 305.

The signboard ID 301 is information for the server 10 and the terminal 20 to identify the corresponding signboard.

The position information 302 is information indicating where in the real world the signboard indicated by the corresponding signboard ID is located, and includes longitude and latitude. The position information 302 may or may not further include altitude information.

The width 303 is information indicating the width of the signboard indicated by the corresponding signboard ID.

The vertical width 304 is information indicating the vertical width of the signboard indicated by the corresponding signboard ID.

The direction (azimuth angle) 305 is information indicating the azimuth angle in the front direction of the signboard indicated by the corresponding signboard ID. The terminal 20 plays the video advertisement when the user is in the front direction of the signboard, that is, when the user faces the signboard, and does not play when the user is on the back side of the signboard. Therefore, the orientation (azimuth angle) 305 is used to determine whether the user (terminal 20) is in the front direction of the signboard.

Since the signboard information 300 shown above is stored in the storage unit 15, the server 10 can identify which signboard the user (terminal 20) is near, and visually recognize the terminal 20 of the user. You can communicate information about the signs that are made.

<Operation>
FIG. 4 is a sequence diagram showing an exchange between the terminal 20 and the server 10 in the communication system 1 for reproducing a moving picture advertisement in the terminal 20.

As shown in FIG. 4, the terminal 20 executes imaging. A board is created by including the signboard area in the captured image (step S401). Then, the terminal 20 acquires the position information and the orientation information (step S402). The terminal 20 transmits the acquired position information and orientation information to the server 10 (step S403).

When the server 10 receives the position information and the direction information from the user's terminal 20, the server 10 identifies a signboard within a predetermined distance existing in the direction indicated by the direction information based on the position information (step S404). Further, the server 10 identifies the video advertisement that the user of the terminal 20 wants to view. Then, the server 10 transmits the information about the specified signboard and the video advertisement to the terminal 20 (step S405).

When the terminal 20 receives the information about the signboard and the video advertisement, the terminal 20 and the signboard in the display area satisfy a predetermined condition (as an example without limitation, the terminal 20 exists within a predetermined distance from the signboard). If so, the video advertisement is reproduced in the signboard area (step S406).

The operation of the terminal 20 for realizing the exchange shown in the sequence diagram shown in FIG. 4 will be described with reference to the flowchart shown in FIG. FIG. 5 is an example of a flowchart showing a process for reproducing a video advertisement. Here, it is assumed that the user wears the terminal 20 as a wearable terminal, captures an image of the surroundings, and displays the image on the display unit 24.

The camera 234 of the terminal 20 captures an image of the surroundings (step S501) and transmits it to the control unit 21. The control unit 21 displays the captured video on the display unit 24, and the image analysis unit 211 of the control unit 21 analyzes the captured image. That is, the image analysis unit 211 analyzes whether or not the captured image includes the signboard area (step S502).

When the image analysis unit 211 determines that the signboard area is not included in the captured image (NO in step S502), the process proceeds to step S508. When the image analysis unit 211 determines that the signboard area is included in the captured image (YES in step S502), the image analysis unit 211 causes the video advertisement acquisition unit 212 to include the signboard area in the captured image. Notify that. Then, the video advertisement acquisition unit 212 acquires the position information and the orientation information of the terminal 20 from the position information acquisition unit 25 (step S503). Then, the video advertisement acquisition unit 212 transmits the acquired position information and orientation information to the server 10 via the communication I/F 22 (step S504).

The video advertisement acquisition unit 212 determines whether the signboard information and the video advertisement have been received from the server 10 via the communication I/F 22 (step S505). It waits until the signboard information and the moving picture advertisement are received from the server 10 (NO in step S505). When the signboard information and the video advertisement are received (YES in step S505), the received signboard information and the video advertisement are stored in the storage unit 28. When the signboard information and the video advertisement are stored in the storage unit 28, the video advertisement reproduction unit 213 determines whether the signboard indicated by the signboard information satisfies a predetermined condition (step S506).

The video advertisement reproduction unit 213 acquires the position information of the terminal 20 from the position information acquisition unit 25. In addition, the video advertisement reproducing unit 213 identifies at least the position information of the signboard from the received signboard information. Then, the moving picture advertisement reproducing unit 213 determines whether or not the size or position of the signboard area satisfies at least one of the above conditions 1 to 5 (step S506). When the video advertisement reproduction unit 213 determines that any one of the above conditions 1 to 5 or a plurality of conditions is satisfied (YES in step S506), as an example, the user (terminal 20) is present within a predetermined distance from the signboard. When the determination is made, the received moving picture advertisement is reproduced in the corresponding signboard area (step S507). The terminal 20 may or may not output the sound of the video advertisement when the user wears headphones or the like as the sound output unit along with the reproduction of the video advertisement. Further, in the signboard area, a still image related to a moving image advertisement may or may not be displayed first. Here, the still image may be a still image of a content related to the video advertisement, and as an example, without limitation, information (for example, a company logo mark) that can recognize information of the company that issues the video advertisement, or the video advertisement. It may be the first frame or a still image related to the content of the video advertisement.

The control unit 21 determines whether or not there is an end input to the terminal 20 (step S508). If there is an end input (YES in step S508), the process ends. If there is no end input, the process returns to step S501. Here, the termination input may be an input for terminating an application for reproducing a moving picture advertisement on the terminal 20, or an input for turning off the power of the terminal 20. By the process shown in FIG. 5, the terminal 20 plays the video advertisement when the position and size of the signboard area are suitable for playing the video advertisement, so the video advertisement is displayed at a timing that is easy for the user to visually recognize. Can be provided. Therefore, as the user wearing the terminal 20 moves, the size of the signboard area in the display area changes, so that the video advertisement is reproduced at a timing when the size becomes appropriate or another video advertisement is reproduced. It is possible to switch to, and stop playing the video advertisement.

On the other hand, FIG. 6 is an example of a flowchart showing the operation of the server 10 in the sequence diagram of FIG. As shown in FIG. 6, the communication I/F 14 of the server 10 receives the position information and the orientation information of the terminal 20 from the terminal 20 (step S601).

When the signboard identifying unit 111 of the control unit 11 receives the position information and the orientation information of the terminal 20, the signboard identifying unit 111 can visually recognize the position from the position indicated by the position information of the terminal 20 in the direction indicated by the orientation information. Such a signboard is specified from the signboard information 300 (step S602). Specifically, the signboard existing within a predetermined distance from the position indicated by the position information of the terminal 20 and in the direction indicated by the direction information from the position indicated by the position information is specified. At this time, the signboard specifying unit 111 specifies a signboard in which the direction (azimuth) of the signboard indicates the direction of the user 50 (terminal 20) while satisfying these conditions.

The video advertisement identifying unit 112 identifies a video advertisement suitable for the user 50 corresponding to the terminal 20 (step S603). Here, a suitable video advertisement for the user 50 is a video advertisement that the user 50 is likely to watch with interest when displayed. The video advertisement suitable for the user is, for example, without limitation, transmitting the user's preference information from the terminal 20 to the server 10 and identifying the video advertisement by the server 10 using the tag information previously attached to each video advertisement. You can Further, not only the preference information but also the attribute information indicating the characteristics of the user (for example, but not limited to, sex, origin, age, past purchase history, past viewing history, etc.) is specified to identify an appropriate video advertisement. It may be that. Further, the video advertisement that is likely to be of interest to the user may be specified by the terminal 20 instead of the server 10.

The control unit 11 of the server 10 communicates the information on the signboard specified by the signboard specifying unit 111 and the video advertisement specified by the video advertisement specifying unit 112 to the terminal 20 that has transmitted the position information and the orientation information. Transmission is completed via the I/F 14 and the processing ends (step S604).
The above is the processing of the server.

FIG. 7 is an example of a flowchart showing an operation related to reproduction control of a video advertisement in the terminal 20, and is an example of processing of changing a display mode of the video advertisement in response to an input from the user. FIG. 7 is an example of a flowchart showing an example of processing executed between steps S507 and S508 of FIG.

As shown in FIG. 7, the display unit 24 of the terminal 20 displays the moving image advertisement in the signboard area (step S701).

The control unit 21 determines whether or not a predetermined time (two seconds, by way of example and not limitation) has elapsed from the reproduction of the video advertisement (step S702). When the control unit 21 determines that the predetermined time has elapsed (YES in step S702), the control unit 21 executes a charging process for the user viewing the video advertisement (step 7603). That is, the terminal 20 pays the server 10 a reward for viewing the video advertisement. If the predetermined time has not elapsed (NO in step S702), the process proceeds to step S704. If a still image is displayed instead of a moving image, the billing process may be executed at the timing when the still image is displayed.

The control unit 21 of the terminal 20 determines whether the display area has been enlarged or reduced by the user (step S704). As an example and not by way of limitation, the terminal 20 may enlarge a part of the display area by a hardware key (not shown) included in the terminal 20, a voice input, a contact input (gesture input), or the like. Receive input of reduction from the user. Alternatively, the size of the signboard area in the display area may change as the user wearing the terminal 20 moves. Due to such enlargement/reduction or change of the display area, a signboard area existing in the display area of the screen may fade out of the screen, or a signboard area outside the display area may fade in of the screen. Since it is possible, the terminal 20 needs to judge whether or not the signboard area satisfies a predetermined condition each time.

When the display area is enlarged or reduced (YES in step S704), the control unit 21 of the terminal 20 displays the signboard area in the user's field of view with a predetermined size or more by enlarging or reducing the display area. By doing so, it is determined whether or not a predetermined condition for reproducing the moving image advertisement is satisfied or is not satisfied (step S705).

When the reproduction condition of the moving image advertisement is satisfied (YES in step S705), the moving image advertisement is reproduced in the signboard area satisfying the reproduction condition of the moving image advertisement. Further, when there is a signboard area that deviates from the playback condition of the video advertisement (YES in step S705), the terminal 20 stops the playback of the video advertisement (step S706).

If there is no input for enlarging or reducing the display area (NO in step S704), or if the reproduction condition of the video advertisement is not satisfied or if the condition is not satisfied (NO in step S705), the switching input of the video advertisement is performed. It is determined whether there is any (step S707). When there is a video advertisement switching input (YES in step S707), the control unit 21 of the terminal 20 reproduces another video advertisement in the signboard area (step S708), and proceeds to the processing in step S508.

<Specific example>
FIG. 8A is an example of a captured image 800 captured by the camera 234 of the terminal 20 and also an example of a display screen 800 displayed in the display area of the display unit 24 of the terminal 20. FIG. 8B is a bird's-eye view showing an example of the arrangement relationship between the user 50 and the respective signboards 801 to 803. When in the positional relationship of FIG. 8B, the user 50 can view the display screen 800 shown in FIG. 8A. In FIG. 8B, the dotted line indicates the viewing angle of the user (the imaging viewing angle of the camera 234 of the terminal 20). In the positional relationship of FIG. 8B, the signboard 803 is on the left side, the signboard 802 is on the front side, and the signboard 803 is on the right side in the traveling direction of the user 50. Therefore, as shown in FIG. 8A, the terminal 20 displays a screen such as the display screen 800 that captures the signboard area 801 on the left side of the screen, the signboard area 802 at the center of the screen, and the signboard area 803 on the right side of the screen. To do. In addition, in FIG. 8, an example of a rectangular signboard is shown as a signboard area capable of displaying a moving image advertisement, but the signboard area is not limited to this. Any object may be used as long as it can reproduce the moving picture advertisement, and may be, for example, an elliptical object, a star-shaped object, or the like. Further, the place where the video advertisement is displayed is not limited to the inside of the signboard area, and the reproduction may be performed outside the signboard area, or may not be performed. When the perspective area other than the rectangular shape is parsed (the perspective distance between the one end and the other end of the billboard area is determined), the control unit 21 of the terminal 20 uses an axis for taking perspective (see FIG. 8 may be set to correspond to the left and right sides of the rectangular signboard area, and the perspective may be taken.

The image analysis unit 211 analyzes the captured image 800 and identifies the signboard areas 801, 802, 803. When the signboard areas 801, 802, and 803 are specified in the captured image by the analysis by the image analysis unit 211, the server 10 is inquired about information about these signboards. The signboard information and the video advertisement can be received from the server 10 by transmitting the position information and the orientation information.

The video advertisement reproducing unit 213 acquires the position information of the terminal 20 (or the user of the terminal 20), and the signboards indicated by the position indicated by the acquired position information and the signboard information received from the server 10 via the communication I/F 22. Calculate the distance between and. In the example of FIG. 8B, the distances between the user 50 and the signboards 801 to 803 are indicated by distances d1, d2, and d3, respectively. The moving image advertisement reproducing unit 213 determines whether or not the distance d1 (d2, d3) is equal to or less than a predetermined distance (5 m as an example without limitation) as an example of the condition for reproducing the moving image advertisement. Then, when determining that the predetermined distance has been reached, the video advertisement reproduction unit 213 reproduces the video advertisement received from the server 10 by superimposing it on the signboard area that satisfies the condition.

In the case of using the viewing angle of the signboard area when displaying a moving image advertisement in the signboard area, the viewing angle of the signboard area viewed from the terminal 20 is the user 50 in the case of the signboard 802 in FIG. 8B. The angle θ between the alternate long and short dash lines drawn from the (terminal 20) to both ends of the signboard 802 corresponds. In addition, as a condition for displaying a video advertisement in the signboard area, the side in the case of using the difference or the ratio with the opposite side is explained in the example of FIG. 8A. , The side d1r (an example of a first portion without limitation) and the side d1l (an example of a second portion without limitation) correspond, and in the case of the signboard area 803, the side d3r (of the first portion not limited). For example, the side d3l (an example of the second portion without limitation) is applicable.

As an example and not by way of limitation, the video advertisement reproduction unit 213 reproduces a video advertisement when the terminal 20 satisfies a predetermined condition, as shown in FIG. 9. FIG. 9A shows the display image 600 before the video advertisement is reproduced, and FIG. 9B shows the display image 600 in the state where the video advertisement is being reproduced. In FIG. 9B, the signboard areas 801 and 802 satisfy the predetermined condition and the moving picture advertisement is reproduced, and the signboard area 803 does not satisfy the predetermined condition and the moving picture advertisement is not reproduced. An example is shown. The moving picture advertisement reproducing unit 213 of the terminal 20 reproduces the moving picture advertisement by superimposing the moving picture advertisement on the display area in which the signboard area is detected to be present on the captured image captured by the camera 234. Further, as shown in the signboard area 801 in FIG. 9B, the terminal 20 may change and display the display mode of the video advertisement depending on the angle at which the signboard area is viewed from the standing position of the user 50, You don't have to. In FIG. 9B, in order to make it easy to understand that the display mode is different, a moving image advertisement to the signboard area 802 facing directly and a signboard area 801 that is oblique to the user 50 are displayed. Although the same video advertisement is displayed in the video advertisement to, the displayed video advertisement may or may not be different in each signboard area (801, 802).

The method of purging the signboard area is not limited to the above example. In the above-described example, the difference or ratio of the vertical sides of the signboard area is used, but it is also possible to specify using the upper side and the lower side of the signboard area as shown in FIG. That is, as shown in FIG. 10A, d1u and d1d may be used in the case of the signboard area 801, and d3u and d3d may be used in the case of the signboard area 803. .. If d1u and d1d of the signboard area 801 are used, the perspective may be obtained by specifying the angles formed by the respective inclinations. If the angle formed by each is less than the predetermined angle (acute angle), it is determined that the perspective is not tight, and the video advertisement is played in the signboard area. If the angle is equal to or greater than the predetermined angle, the perspective is determined to be tight. The video advertisement may not be played in the signboard area.

Furthermore, the perspective may be specified using the vertical side and the horizontal side of the signboard area. For example, it is possible to specify the perspective by using at least one of the ratio of d1l and d1u of the signboard area 801, the ratio of d1u and d1r, the ratio of d1r and d1d, and the ratio of d1d and d1l. Alternatively, the perspective may be specified using a plurality of ratios. Further, in this case, the perspective may be specified by the angle formed between the respective sides. As an example and not by way of limitation, the terminal 20 determines to play the video advertisement when the ratio of d1l to d1u exceeds a certain threshold and the angle between d1l and d1u is within a predetermined angle range. Good.

Further, when the signboard area is not rectangular and the side cannot be specified, the axis may be virtually set as shown in FIG. 10B to specify the perspective. In the example of FIG. 10B, the signboard area 1000 is an ellipse. As shown in FIG. 10B, when the signboard area is not rectangular, a rectangular area surrounding the signboard area (areas surrounded by d4l, d4u, d4r, d4d in FIG. 10b) is set and set. The perspective may be specified using the sides of the rectangular area.

<Modification 1>
In the above embodiment, the terminal 20 is supposed to acquire the signboard information from the server 10, but this is not the only option. Like the server 10, the terminal 20 may include the signboard identifying unit 111, and may be configured to identify which signboard is the signboard displayed in the display area of the display unit 24 of the terminal 20. Further, the signboard information may be configured such that the terminal 20 directly acquires from the signboard. For example, the terminal 20 may acquire a signboard information (size, position, orientation of the signboard) by reading a code typified by a two-dimensional barcode written on each signboard. Alternatively, the signboard may be provided with a memory storing signboard information and a unit having a communication function, and the terminal 20 may be configured to acquire the signboard information by communication.

Conversely, the server 10 may retain the function retained by the terminal 20. For example, the server 10 may determine whether or not the user's terminal 20 and the signboard area satisfy at least one of the above conditions 1 to 5, and in that case, the server may execute the determination. The determination result may be notified from 10 to the terminal 20.

<Modification 2>
Although not particularly described in the above-mentioned embodiment, an advertiser who wants to send any information using an advertisement, a distributor (server 10) who distributes the advertisement, a user who sees the advertisement, and an area for showing the advertisement to the user. It may be provided, that is, a reward (for example, money) may be exchanged with the owner of the sign itself. In this modification, an example of exchanging rewards between these parties will be described.

FIG. 11 is an image diagram showing an example of exchange of rewards related to video advertisement in the present embodiment. As shown in FIG. 11, when an advertisement is distributed to advertise its own product or service, the advertiser 1101 creates a moving image advertisement (may be a still image), and the advertiser 1001 holds it, for example. Using an information processing device such as a mobile terminal, the server 10 corresponding to an advertisement distribution company or the like is requested to distribute the video advertisement. The advertiser 1101 may or may not pay a reward (money, as an example, but not a limitation) to the server 10 to request distribution of the video advertisement. On the other hand, when the video advertisement of the advertiser 1101 is viewed by the user, the server 10 may or may not notify the advertiser 1101 that the video advertisement has been previewed.

The advertisement distribution company (server 10) identifies and distributes a video advertisement suitable for the user in response to a request from the user's terminal 20. At this time, since the position information is transmitted from the terminal 20 to the server 10 in order to specify the signboard area, the server 10 can specify which signboard the user of the terminal 20 is using. The user of the terminal 20 may or may not pay a reward for viewing the video advertisement, that is, an advertisement viewing fee.

On the other hand, the server 10 may or may not pay the reward associated with the use of the signboard to the signboard holder 1102 holding the signboard used by the user of the terminal 20. When paying the reward, the reward may be transmitted to the terminal held by the signboard holder 1102, or may be transferred to the account of the financial operator used by the signboard holder 1102.

Further, the bill holder 1102 may or may not be paid the reward directly from the advertiser 1101 who posted the bill. Further, the bill holder 1102 may be paid by only one of the advertiser 1101 and the advertisement distribution company 10, or may be paid by both.

In this way, exchange of rewards may be executed in the communication system 1.

<Modification 3>
As described in the above embodiment, the terminal 20 receives the video advertisement from the server 10 and visually recognizes it. The user of the terminal 20 may or may not pay the reward for viewing the video advertisement to the server 10. Further, the terminal 20 may detect whether or not the user actually viewed the video advertisement, and then charge the user of the terminal 20 a viewing fee for the video advertisement. That is, the terminal 20 may further have a line-of-sight detection function for the user who is wearing the device, determines whether or not the video advertisement is viewed based on the line-of-sight direction of the user, and determines that the video advertisement is viewed. In such a case, the terminal 20 may or may not be configured to pay the reward to the server 10. Furthermore, when it is possible to detect that the user's line of sight is not directed to the signboard area, the terminal 20 may be configured not to play the video advertisement in the signboard area. In this case, Thus, it is possible to reduce the processing load and power consumption of the terminal 20 that accompany the reproduction of a video advertisement that the user does not view.

<Modification 4>
In the above embodiment, an example in which the moving image advertisement is superimposed and displayed on the image captured by the camera 234 is displayed on the display unit 24, but this is not a limitation. The display unit 24 of the terminal 20 may be a transmissive display. When the user confirms the surroundings through the transmissive display and there is a signboard area in the display area, a video advertisement is displayed in the area. May be configured to be reproduced. Through the transmissive display, the control unit 21 of the transmissive display may control the display area of the display section 24 corresponding to the signboard area visually recognized by the user to reduce the transmittance. The control unit 21 may perform the process of reducing the transmittance and display the moving image advertisement in the display area of the display unit 24 corresponding to the signboard area. In this way, the visibility of moving image advertisements can be improved by blocking the incidence of external light on the transmissive display. As a method of reducing the transmittance, the display unit 24 of the transmissive display may be provided with a liquid crystal layer and a polarization filter for controlling the transmittance of incident light. By controlling the arrangement of the partial liquid crystals inside the liquid crystal layer by the control unit 21, it is possible to control the transmittance of light incident on the display area corresponding to the signboard area.

Further, in the above-described embodiment, the example in which the video advertisement is displayed on the display unit 24 of the wearable terminal as the terminal 20 has been shown, but the target for displaying the video advertisement is not limited to this, and the head of the vehicle It may be displayed on an up-display, or if a window of a vehicle such as a train is used as a head-up display and the signboard area exists when the user looks out from the inside of the train. , May be configured to play a video advertisement there. At this time, the terminal 20 detects the position of the user with respect to the head-up display (the position of the user's eyes). Then, when the signboard area can be detected from the captured image captured by the camera 234 that captures the opposite landscape viewed from the user of the head-up display provided in the vehicle or the like, the arrangement position of the camera 234 and the user's From the relationship with the standing position with respect to the head-up display, the position on the head-up display where the signboard area can be visually recognized by the user is specified. Then, the terminal 20 reproduces the moving picture advertisement on the head-up display, overlapping the area where the user is supposed to visually recognize that there is a signboard area.

Moreover, when reproducing a video advertisement on a head-up display of a vehicle such as a vehicle, the terminal 20 may switch the video advertisement to be reproduced according to the speed of the vehicle. That is, when the vehicle is traveling at a speed equal to or higher than a certain speed, there is a high possibility that the time during which the user can visually recognize the same signboard area is shortened. In such a case, even if a video advertisement having a long playback time is played back, the user may pass in front of the signboard area before the entire video advertisement is played back. Therefore, if the speed of the vehicle, that is, the moving speed of the terminal 20 is equal to or higher than the predetermined speed, the terminal 20 may be configured to play the moving picture advertisement having a shorter playing time than the case where the moving speed is lower than the predetermined speed. In other words, the terminal 20 plays a video advertisement having a shorter playback time as the moving speed of the terminal 20 is faster, and plays a video advertisement having a longer playing time as the moving speed of the terminal 20 is slower. May be configured.

In addition, when the vehicle has an automatic driving function, when the user is interested in the video advertisement being reproduced, the vehicle may be guided to a place related to the video advertisement. Specifically, the vehicle has an automatic driving function and a function of receiving a control signal from the terminal 20. Then, when the user is interested in the video advertisement that he/she has watched, the user performs an operation such as a touch on the video advertisement, as an example without limitation. Then, the terminal 20 transmits the location information associated with the touched video advertisement to the automatic driving function of the vehicle. The automatic driving function of the vehicle receives the location information, travels to the location indicated by the location information with the automatic driving function, and guides the user to the location related to the video advertisement. The terminal 20 may or may not have such a function.

This will be specifically described with reference to FIGS. 12 and 13. FIG. 12 is a diagram showing a configuration example of a communication system 1 using a vehicle as an example of a vehicle. As shown in FIG. 12, the communication system 1 has a configuration in which a vehicle 1200, a server 10, and a terminal 20 are connected via a network 30. Since the server 10 and the terminal 20 are substantially the same as those shown in the above-mentioned embodiment, the description of the common configuration will be omitted. In Modified Example 4, the terminal 20 is not, for example, worn by the user, and may be implemented as, for example, a navigation system installed in the vehicle 1200 or a control device installed in the vehicle 1200. May be. In this case, the camera 234 is installed in the vehicle 1200 and is configured to capture an image of the traveling direction of the vehicle 1200.

As described in the above embodiment, the terminal 20 determines whether or not there is a signboard area in the image captured by the camera 234, and when it is determined that there is a predetermined condition ( At least one of conditions 1 to 5), a video advertisement to be displayed and where on the head-up display the video advertisement should be displayed are transmitted to the communication I/F 1214 of the vehicle 22 via the communication I/F 22. To do. In addition, when the terminal 20 receives a predetermined input for the video advertisement (for example, a touch operation) while playing the video advertisement, the terminal 20 may display a place related to the video advertisement (for example, a video advertisement The vehicle 1200 is instructed to guide to the store of the advertiser to be distributed) via the communication I/F 22.

As shown in FIG. 12, vehicle 1200 includes a control unit 1211, a vehicle drive unit 1212, a display unit 1213, a communication I/F 1214, and a storage unit 1215.

The control unit 1211 includes an automatic driving control unit 1112 and has a function of controlling the vehicle 1200. The automatic driving control unit 1112 executes the automatic driving by executing the program stored in the storage unit 1215. When receiving the guidance instruction from the terminal 20, the automatic driving control unit 1112 executes the automatic driving so as to move to the place designated by the guidance instruction.

The vehicle drive unit 1212 includes a drive system such as wheels and a motor, and executes the operation of the vehicle according to an instruction from the automatic driving control unit 1112.

The display unit 1213 is realized by a head-up display provided in the vehicle 1200, and displays the specified moving image advertisement in the area specified by the terminal 20, that is, in the signboard area. Although not shown in FIG. 12, vehicle 1200 may include a speaker as an audio output unit, and the audio may or may not be output along with the reproduction of the video advertisement.

The communication I/F 1214 executes communication via the terminal 20 and the network 30. In this case, the network 30 may be a CAN (Controller Area Network) or may be another network.

FIG. 13 is an example of a flowchart showing a process in which the vehicle 1200 guides a user to a place related to a moving image advertisement in which the user is interested by automatic driving. The flowchart shown in FIG. 13 shows an example in which a vehicle 1200 equipped with the terminal 20 executes in conjunction with each other.

As shown in FIG. 13, the display unit 1213 of the vehicle 1200 reproduces the specified moving image advertisement in the signboard area specified by the terminal 20 (step S1301). The display unit 1213 of the vehicle 1200 executes the reproduction of the moving image advertisement based on the flowchart of FIG.

When the user sees the video advertisement displayed on the head-up display and becomes interested, he/she makes a predetermined input to the video advertisement. Here, the predetermined input is, for example, an operation of touching an area where a video advertisement is displayed, or a voice input from a user who is on board the vehicle 1200, for example, “Go to the current advertisement store. The input may be “”.

The control unit 21 of the terminal 20 determines whether or not there is a predetermined input for the video advertisement from the user (step S1302). If there is no predetermined input (NO in step S1302), the process ends. On the other hand, when there is a predetermined input (YES in step S1302), the control unit 21 of the terminal 20 acquires the location information corresponding to the moving image advertisement (step S1303). For example, the location information may be acquired from the metadata attached to the video advertisement, or may be acquired from the server of the advertiser who provides the video advertisement by inquiring of the server 10. it can.

The control unit 21 of the terminal 20 transmits the acquired location information to the vehicle 1200 via the communication I/F 22. The communication I/F 1214 of the vehicle 1200 transmits the received location information to the automatic driving control unit 1112 of the control unit 1211 (step S1304).

The automatic driving control unit 1112 identifies a route from the current position of the vehicle 1200 to the place indicated by the received place information. This can be specified by using a conventional navigation technique, and for example, an algorithm such as Dijkstra method or A-Star method can be used. When the route is specified, the automatic driving control unit 1112 transmits a control signal to the vehicle driving unit 1212 so that the vehicle 1200 travels along the route. Vehicle drive unit 1212 controls traveling of vehicle 1200 according to the control signal transmitted from control unit 1211. As a result, vehicle 1200 travels to a location related to the video advertisement (step S1305).

In this way, when the terminal 20 is installed in the vehicle 1200 or interlocked with the vehicle 1200, the user can be guided to a place related to the video advertisement. For example, if the video advertisement is an advertisement for a product, it can be guided to a store that sells the product. If the video advertisement is, for example, an advertisement using some character, it can be guided to a museum or a store selling character goods related to that character.

<Modification 5>
In the above-described embodiment, the terminal 20 is supposed to display the video advertisement by superimposing it on the signboard area, but this is not the limitation. The area for displaying the video advertisement does not have to be the entire signboard area, and a part thereof may be used, or the space adjacent to the signboard area may be simulated as a signboard area to display the video advertisement. It may be done. When using the adjoining space, the terminal 20 may use a part of the signboard area together with the adjoining space to reproduce the video advertisement.

That is, a part of the signboard area is a monotone area (white as an example without limitation), and an advertisement such as a normal poster is placed (or displayed) in other areas. ), the terminal 20 may be configured to display the video advertisement in the monotone area of the signboard area.

Further, when the signboard existing as the signboard area is a monitor, this monitor includes a detection device that detects whether or not the user wears the terminal 20, and when the user wears the terminal 20, Alternatively, a monotone image may be displayed, and if not mounted, some advertisement may be displayed. As the detection device, for example, a camera and an image captured by the camera are analyzed to realize the presence of a person and image analysis for analyzing whether the person wears the terminal 20. it can. Furthermore, when a plurality of users can be detected, this monitor is configured to switch the display content by multi-view display, for each detected user, depending on whether or not the terminal 20 is attached. You may

The above-described embodiment and various modifications may be combined as appropriate.

<Effect of Embodiment>
The effects of this embodiment will be described below.

According to the terminal 20 according to the above-described embodiment, the image analysis unit 211 detects whether or not an object for reproducing a moving picture advertisement, that is, a signboard area exists in the image captured by the camera 234. Then, the terminal 20 acquires the signboard information of the detected signboard area from the server 10. Further, the terminal 20 acquires a video advertisement suitable for the user. Then, from the size of the signboard area and the position where the signboard area exists, the terminal 20 reproduces the moving picture advertisement in the display area where the signboard area exists, when a predetermined condition is satisfied.

Accordingly, the terminal 20 plays the video advertisement at the timing when it is determined that the signboard area viewed by the user has a size suitable for viewing the video advertisement, and thus the user may view the video advertisement. Can be improved.

Further, the control unit 21 (video advertisement reproducing unit 213) of the terminal 20 reproduces the video advertisement in the signboard area according to the viewing angle with respect to the signboard area. That is, if the viewing angle is a certain angle or more, the user can recognize the video advertisement, and in that case, the video advertisement is reproduced.

As a result, it is possible to make the user easily recognize the video advertisement by playing the video advertisement in a state where a sufficient viewing angle with respect to the signboard area is obtained.

Further, the control unit 21 (video advertisement reproducing unit 213) of the terminal 20 has a length of one side (one axis) at one end of the signboard area and one side (one axis) facing the other end side, Based on the difference or ratio, the video advertisement is reproduced according to the perspective of the signboard area. Alternatively, or alternatively, the control unit 21 of the terminal 20 reproduces the motion advertisement based on the ratio of the lengths of one side at one end of the signboard area and one side orthogonal thereto.

As a result, the terminal 20 can specify the perspective for the user (terminal 20) in the signboard area based on the length of a part of the signboard area and the length of a different part. As a result, when there is a large difference between the sides facing each other between the length of one part of the signboard area and the length of the other part, the signboard area is tightly parsed to the user, and the video advertisement However, if there is no significant difference in the length of the sides, it can be estimated that the signboard area is sufficiently visible to the user. The unit 213 can execute the reproduction in a state in which the video advertisement is easily recognized. Further, the terminal 20 calculates the ratio of the long side to the short side when the signboard area is a rectangular area between the length of a part of the signboard area and the length of the other part, and according to the ratio. After determining whether or not to reproduce the video advertisement, the advertisement is reproduced. When the ratio of the long side to the short side is large, the signboard area is likely to be distorted, and even if the video advertisement is reproduced, the user may not be able to recognize the content of the video advertisement well. If the ratio is small, there is a high possibility that the signboard area is not distorted, and when the video advertisement is played back, the user can well recognize the content. Therefore, by specifying the perspective, the video advertisement can be reproduced in a state where the signboard area is appropriate for the user, and the accuracy with which the user recognizes the content of the video advertisement can be improved.

In addition, the terminal 20 can be configured to acquire information about the signboard area in the captured image captured by the camera 234 from, for example, a communication device included in the signboard.

With this, the terminal 20 can recognize where the signboard area existing in the captured image is, what size it is, and in which direction it is provided, and the reproduction position of the video advertisement can be determined. It can be done without control.

In addition, the terminal 20 transmits information indicating the position of the terminal 20 and the orientation of the terminal 20 acquired by the location information acquisition unit 25 to the server 10, and the server 10 exists in the orientation specified by the position of the terminal 20. The signboard area to be specified is specified using the signboard information 300. The server 10 transmits information on the specified signboard to the terminal 20.

Thereby, the terminal 20 can specify the signboard that can be visually recognized from the position where the user exists.

Further, the terminal 20 may be configured to identify the signboard area by performing image analysis on the captured image captured by the camera 234. As an example and not by way of limitation, a uniformly white area in the captured image may be detected as a signboard area, or the signboard area may be detected by detecting a two-dimensional barcode provided on the signboard. Good.

Accordingly, the terminal 20 can accurately detect the signboard area in which the video advertisement should be played back, and can play the video advertisement in the signboard area.

In addition, the terminal 20 may play back a video advertisement or display a still image related to the video advertisement depending on the size of the signboard area.

As a result, when the signboard area has a predetermined size, the user can sufficiently recognize the content of the video advertisement, and therefore, the video advertisement is reproduced, and when the signboard area does not have a sufficient size, the video advertisement is displayed. Even if the content is reproduced, the content may not be recognized. Therefore, by only displaying the still image, the processing load on the terminal 20 can be reduced. In addition, by displaying a still image, it is possible to make the user recognize that some moving image advertisement can be viewed by approaching the still image.

In addition, the terminal 20 may have a function of detecting the line of sight of the user who wears the terminal 20 (a function of acquiring information about the user's eyes), and reproduces a moving image advertisement according to the direction of the detected line of sight. You may comprise.

Accordingly, the terminal 20 can determine the reproduction of the video advertisement depending on whether the user visually recognizes the signboard area, and can suppress the reproduction of the video advertisement that the user does not visually recognize.

Further, when the size of the signboard area changes with the movement of the user, the terminal 20 has, for example, the size of the signboard area so far large enough to play the video advertisement. Although not, the user can move to approach the signboard area and start playing the video advertisement. In addition, the terminal 20 can accept the user's enlargement/reduction operation for the display area and start or stop the reproduction of the video advertisement.

As a result, the size of the signboard area included in the display area displayed by the terminal 20 changes, for example, the size of the signboard area accompanying the wearing of the terminal 20 and the user's own operation. Change the size of the signboard area by the enlargement (zoom in) or reduction (zoom out) processing in the display area, and change the playback control of the video advertisement due to fade-out/fade-in from the display area of the signboard area. Can be started or stopped, or a video advertisement different from the video advertisement that was being played can be played. And the usability can be improved.

The display unit 24 of the terminal 20 may be a transmissive display, and may be, for example, a head-up display capable of displaying an image on the windshield of the vehicle. Then, the terminal 20 specifies the position on the head-up display where the signboard area visually recognized by the user will exist, depending on the position of the user with respect to the head-up display, and plays the video advertisement in the specified display area.

Accordingly, even if a transmissive display is used, the moving picture advertisement can be accurately reproduced at a position where the user recognizes that there is a signboard area.

In addition, the terminal 20 reproduces the moving picture advertisement at a position where the terminal 20 is superimposed on the signboard area visually recognized by the user. Further, the terminal 20 superimposes and reproduces the moving picture advertisement at the position where the signboard area is detected in the captured image captured by the camera 234.

Accordingly, by superimposing and playing the video advertisement on the signboard area originally provided for the purpose of playing the video advertisement, the user can view the video advertisement without feeling uncomfortable with the surroundings. .. In addition, by combining the moving image advertisement with the captured image captured by the camera 234, it is possible to more reliably provide the moving image advertisement to the user.

Further, the terminal 20 controls the reproduction of the moving picture advertisement according to the moving speed of the terminal 20. Specifically, as an example and not limitation, if the moving speed of the terminal 20 is equal to or higher than a predetermined speed, a video advertisement having a short reproduction time is reproduced, and if it is less than the predetermined speed, a reproduction time is longer than that. Play a video ad.

As a result, it is possible to reduce the possibility that the user cannot recognize the entire content of the video advertisement depending on the moving speed of the terminal 20.

Further, when the user is in a vehicle in which the user can board, the terminal 20 may control the vehicle to move to a place related to the video advertisement in which the user is interested.

Accordingly, the terminal 20 can guide the user to a place related to the video advertisement that the user is interested in, for example, if the video advertisement is an advertisement related to product sales, the store. We can provide timely service. Further, as an advertiser who distributes video advertisements, it is possible to increase the chances of purchasing by general users.

DESCRIPTION OF SYMBOLS 1 Communication system 10 Server 11 Control part 111 Signboard specific part 112 Video advertisement specific part 12 Input/output part 13 Display part 14 Communication I/F (communication part)
20 terminal 21 control unit 211 image analysis unit 212 video advertisement acquisition unit 213 video advertisement reproduction unit 22 communication I/F
23 input/output unit 231 controller 232 microphone 233 speaker 234 camera 24 display unit (display)
25 location information acquisition unit 28 storage unit 30 network

Claims (20)

A display method of a terminal that displays a video advertisement in a display area,
Detecting an object by the detection unit of the terminal,
Acquiring information about the size of the object detected by the detection unit by the acquisition unit of the terminal,
Displaying the video advertisement in the display area based on the information on the position of the object based on the information on the size of the object, and controlling the reproduction of the video advertisement. The display method according to claim 1, wherein
The information regarding the size of the object is information regarding the viewing angle of the object from the user of the terminal. The display method according to claim 1 or 2, wherein
The acquisition unit acquires an image in which the object is captured by the detection unit,
Acquiring the length of the first portion of the object and the length of a second portion of the object different from the first portion by the acquisition unit based on the image;
Controlling the reproduction of the video advertisement based on the length of the first portion and the length of the second portion. The display method according to claim 3, wherein
The control includes executing the reproduction of the video advertisement based on a value related to a ratio of the length of the portion in the first direction and the length of the second portion. The display method according to any one of claims 1 to 4, wherein:
The detection unit detects the object based on information transmitted from a communication device included in the object. The display method according to any one of claims 1 to 5, wherein
The detection unit detects the object based on information about the position and orientation of the terminal. The display method according to any one of claims 1 to 6,
The detection unit detects the object by imaging the object. The display method according to any one of claims 1 to 7, wherein
When the information regarding the size of the object is the first size information, the moving image advertisement is displayed in the display area based on the position of the object, and the information regarding the size of the object is the second size information. , Including performing playback of the video advertisement,
The second size information is information indicating that the size of the object is larger than that of the first size information. The display method according to any one of claims 1 to 8, wherein
Obtaining information about the eyes of the user of the terminal;
Controlling the reproduction of the video advertisement based on the information about the eyes. The display method according to any one of claims 1 to 9,
Controlling the video advertisement based on a change in information about the size of the object. The display method according to claim 10, wherein
Changing the video advertisement from a first video advertisement to a second video advertisement based on a change in information about the size of the object. The display method according to any one of claims 1 to 11, wherein
The display area transmits light from the object, and allows the user of the terminal to view the object through the display area.
The information regarding the position of the object is information regarding the position where the user of the terminal visually recognizes the object on the display area,
The moving image advertisement is displayed in the display area based on information about the position where the user of the terminal visually recognizes the object on the display area. The display method according to claim 12, wherein
The moving image advertisement is displayed in the display area by being superimposed on a position where the user of the terminal visually recognizes the object on the display area. The display method according to any one of claims 1 to 11, wherein
The detection unit includes an imaging unit,
The display area displays the object imaged by the imaging unit and the video advertisement. The display method according to any one of claims 1 to 14,
Obtaining information about the speed of the terminal;
Displaying the video advertisement in the display area based on information about speed of the terminal. The display method according to claim 15, wherein
When the information on the speed of the terminal is the first information, the first moving image advertisement is displayed in the display area, and the second information indicating that the information on the speed of the terminal is faster than the first information. In this case, a second moving picture advertisement having a reproduction time shorter than that of the first moving picture advertisement is displayed in the display area. The display method according to any one of claims 1 to 16,
Transmission of information for controlling the vehicle to an electronic device provided in the vehicle based on an input by the user of the terminal with respect to the video advertisement displayed in the display area, by the communication unit of the terminal. The display method according to claim 17, wherein
The information for controlling the vehicle is information about moving by the vehicle to a position related to the video advertisement displayed in the display area. A program to be executed by a computer of a terminal that displays a video advertisement in a display area,
Detecting an object by the detection unit of the terminal,
Acquiring information about the size of the object detected by the detection unit by the acquisition unit of the terminal,
Controlling the display of the video advertisement in the display area based on the information on the position of the object based on the information on the size of the object, and the reproduction of the video advertisement. A terminal that displays video advertisements in the display area,
A detection unit for detecting an object,
An acquisition unit that acquires information about the size of the object detected by the detection unit,
And a control unit configured to display the video advertisement in the display area based on the information on the position of the object based on the information on the size of the object, and to control the reproduction of the video advertisement.

Images