JP2014134990A - Communication device, ar display system, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To simply perform AR display of a situation of an object.SOLUTION: A communication device 10 comprises: storage means that stores data; determination means that determines whether a human body has been detected; and transmission means that, when it is determined that the human body has been detected, transmits AR information for performing AR display based on the data stored in the storage means to a terminal device 20 which performs AR display.

Description

  The present invention relates to a communication device, an AR display system, and a program.

  2. Description of the Related Art Conventionally, there is known a growing environment measuring apparatus that measures a plant growing environment with a sensor and transmits measurement data to a management apparatus when a communication switch is pressed (see, for example, Patent Document 1).

  Also, AR (Augmented Reality) display technology is known. AR is a technology that literally expands the real world seen by humans by adding, deleting, emphasizing, and attenuating information in the real environment surrounding it. For example, a plurality of AR markers are stored and stored in the marker posting portable terminal, and the marker is switched and displayed every predetermined time, and the image including the marker is photographed and photographed on the display portable terminal. An augmented reality system is known in which a virtual object image as AR display information is superimposed (synthesized) on a monitor image (captured image) at a marker position to display an AR (see Patent Document 2). The AR display information is display information to be superimposed on the monitor image in the AR display.

JP 2010-75172 A JP 2005-250950 A

  When capturing a target object and displaying the AR on the terminal device, AR information is transmitted to the terminal device as information for performing AR display according to the situation when the image is captured, instead of the fixed AR display. There is a request to do. The AR information is, for example, measurement data of the growing environment of the plant measured by a sensor installed in the vicinity of the plant as the target object. The terminal device can receive the measurement data and display the AR display information related to the growing environment on the monitor image based on the measurement data.

  However, in the conventional growth environment measurement device, in order to transmit measurement data to the management device, the user has to bother to approach the growth environment measurement device and press the communication switch, which places a heavy burden on the user. In addition, the user's operation of pressing the communication switch may cause the growing environment measurement apparatus to enter the user's shadow and affect the measurement data of the plant sensor.

  An object of the present invention is to simply display the status of an object as an AR.

In order to solve the above problems, the communication device of the present invention provides:
Storage means for storing data;
A discriminating means for discriminating whether or not a human body has been detected;
Transmitting means for transmitting AR information for performing AR display based on data stored in the storage means to a terminal device for performing AR display when it is determined that the human body is detected;
Is provided.

  According to the present invention, it is possible to easily display the status of an object as an AR.

It is a figure which shows AR display system of embodiment of this invention. It is a schematic perspective view of a communication apparatus. It is a block diagram which shows the function structure of a communication apparatus. It is a block diagram which shows the function structure of a terminal device. It is a figure which shows a measurement data table. It is a figure which shows the optimal environmental condition table. It is a figure which shows a character table. It is a flowchart which shows a measurement data transmission process. It is a flowchart which shows AR display processing. It is a figure which shows the AR display system of a modification.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments and modifications according to the present invention will be described in detail with reference to the accompanying drawings. The present invention is not limited to the illustrated example.

(Embodiment)
An embodiment according to the present invention will be described with reference to FIGS. First, with reference to FIGS. 1-4, the apparatus structure of this Embodiment is demonstrated. FIG. 1 is a diagram showing an AR display system 1 according to the present embodiment. FIG. 2 is a schematic perspective view of the communication device 10. FIG. 3 is a block diagram illustrating a functional configuration of the communication device 10. FIG. 4 is a block diagram illustrating a functional configuration of the communication device 10.

  In the AR display system 1 according to the present embodiment, when the user approaches the communication device 10 and images the plant A as the observation object, the terminal device 20 displays the plant A on the monitor image (through image) including the plant A. This is a system that performs AR display by superimposing and displaying characters according to the state of.

  As shown in FIG. 1, the AR display system 1 includes a communication device 10 and a terminal device 20.

  The communication device 10 is a device that measures the growing environment of the plant A. When the communication device 10 detects that the human body of the user holding the terminal device 20 is approaching, the AR information such as measurement data of the growing environment is wirelessly transmitted to the terminal device 20. To do. The communication device 10 is embedded in the soil C in the pot B in which the plant A is planted.

  The terminal device 20 is, for example, a mobile phone, and has a voice call function, an e-mail function, an Internet connection function (Web access function), an imaging function (camera function), a near field communication function, and the like. In particular, the terminal device 20 can transmit and receive information to and from the communication device 10 using a short-range communication function.

  The terminal device 20 receives the measurement data from the communication device 10 and performs AR display by superimposing and displaying the AR display information indicating the state of the plant A according to the measurement data on the monitor image. The display of the AR display information will be described later in detail.

  Next, a configuration related to human body detection of the communication device 10 will be described with reference to FIG. The communication device 10 includes a casing unit 101, an end surface unit 102, a shielding plate 103, a filter 104, and a human sensor 12 as transmission blocking means.

  The casing 101 is formed in a tapered shape with a hollow rod, and the lower part (for example, the lower half) of the communication device 10 is embedded in the soil C of the pot B. A plurality of pores (not shown) are formed on the lower surface of the casing 101 for ventilation and water flow. Moreover, the housing | casing part 101 consists of material which shields infrared rays. In addition, it is good also as a structure by which the handle part for the user D to make it easy to insert / remove the communication apparatus 10 with respect to the soil C is provided in the housing | casing part 101. FIG.

  The end surface portion 102 is formed on the upper end surface of the housing portion 101 and has, for example, a disk shape. The end face portion 102 is made of an infrared transmitting material. As the infrared transmitting material, high-density polyethylene that transmits infrared light having a peak at 9 to 10 μm derived from human body temperature of 36 to 37 ° C. can be used.

  The shielding plate 103 is provided between the end face portion 102 and the human sensor 12 inside the housing portion 101, and has a shape with a hole for limiting the infrared detection range in the center of the cross section of the housing portion 101. Have The shielding plate 103 is made of a material that shields infrared rays.

  The filter 104 is a filter that transmits infrared light, and is provided between the shielding plate 103 and the end surface portion 102. The filter 104 is made of an infrared transmitting material.

  The human sensor 12 is a sensor that detects the location of a human body, and is, for example, a pyroelectric sensor. When the user D holding the terminal device 20 approaches the communication device 10 to photograph the plant A, infrared rays emitted from the human body of the user D pass through the holes in the end surface portion 102, the filter 104, and the shielding plate 103. The light enters the human sensor 12 in order. The human sensor 12 detects incident infrared rays, converts them into electrical signals, and outputs the electrical signals as infrared detection signals.

  By arranging the shielding plate 103, the human sensor 12 can detect only the infrared rays radiated from the human body of the user D from the upper part of the communication device 10 through the end face portion 102 and the filter 104. The detectable range can be limited.

  Further, the casing unit 101 does not detect infrared rays when the person E passes by the side of the communication device 10, and can prevent an increase in power consumption due to erroneous activation of the communication device 10. In addition, by adjusting the thickness of the end face portion 102 and the filter 104, the distance that the terminal device 20 can recognize the plant by photographing and the infrared detection distance of the communication device 10 are made equivalent to further limit the detectable range, It is possible to prevent malfunction.

  As the pyroelectric sensor of the human sensor 12, it is possible to detect a fine movement of the user D by using a plurality of pyroelectric sensors formed in an array or matrix instead of a single element. At that time, by forming a lattice member in the hole portion of the shielding plate 103, the change in the infrared density due to the movement of the user D can be further expanded, so that the human sensor 12 can detect the human body with higher sensitivity. .

  Next, the internal functional configuration of the communication apparatus 10 will be described with reference to FIG. The communication device 10 includes a microcomputer 11 as a determination unit and a storage unit, a human sensor 12 as a detection unit, a signal processing circuit 13, a sensor unit 14 as a sensor unit, a storage unit 15 as a storage unit, A distance communication unit 16, a timer unit 17, and a power supply unit 18 are provided. The microcomputer 11, the sensor unit 14, the storage unit 15, the short-range communication unit 16, the time measuring unit 17, and the power supply unit 18 are connected to each other via a bus 19. The microcomputer 11 and the short-range communication unit 16 function as a transmission unit.

  The microcomputer 11 controls each unit on the bus 19. The microcomputer 11 is a chip having a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. The microcomputer 11 reads a designated program out of various programs from the ROM, expands it in the RAM, and executes various processes in cooperation with the expanded program and the CPU.

  The microcomputer 11 has an external interrupt terminal to which an interrupt signal is input. Further, the microcomputer 11 switches between the normal mode and the sleep mode as the operation mode of the communication device 10. The normal mode is a mode in which all of the communication device 10 is activated and a normal operation is performed. The sleep mode is an operation mode in which a predetermined part of the communication device 10 is activated and the other parts are stopped to save power compared to the normal mode. The predetermined portion is a processing unit of the microcomputer 11 that determines whether or not a human body is detected when an interrupt signal is input to an external interrupt terminal. When a human body is detected, a processing unit that switches the operation mode to a normal mode; A human sensor 12, a signal processing circuit 13, and a timer unit 17.

  The microcomputer 11 measures the growing environment of the plant A as the observation object in response to the detection that the human body of the user D holding the terminal device 20 is approaching, and uses the measurement data, the object ID, etc. as AR information. It transmits to the terminal device 20.

  The signal processing circuit 13 includes an amplification / rectification circuit and the like. The input terminal of the signal processing circuit 13 is connected to the output terminal of the human sensor 12. The output terminal of the signal processing circuit 13 is connected to the external interrupt terminal of the microcomputer 11.

  The signal processing circuit 13 amplifies and rectifies the infrared detection signal output from the human sensor 12, and generates an interrupt signal and outputs it to the external interrupt terminal of the microcomputer 11 when the detection signal exceeds a predetermined threshold. . This predetermined threshold is set to a threshold at which an interrupt signal is generated when the user D moves the terminal device 20 while holding the terminal device 20 against the plant A (communication device 10) for imaging the plant A. Shall.

  The sensor unit 14 includes a plurality of sensors that measure the growing environment of the plant A, and outputs measurement data measured by each sensor to the microcomputer 11. The sensor unit 14 includes a sunshine sensor 141, an outside air temperature sensor 142, an outside air humidity sensor 143, and a soil humidity sensor 144.

  The sunshine sensor 141 measures the degree of sunlight (sunshine amount) and outputs the measurement data. The outside temperature sensor 142 measures the outside temperature and outputs the measurement data. The outside air humidity sensor 143 measures the outside air temperature and outputs the measurement data. The soil humidity sensor 144 measures the humidity of the surface of the soil C in the pot B and outputs the measurement data. Note that the sunshine sensor 141, the outside air temperature sensor 142, the outside air humidity sensor 143, and the soil humidity sensor 144 are small electronic components that are capable of measuring with high accuracy, but their configurations are well known. Detailed description thereof will be omitted.

  The storage unit 15 is a storage unit capable of reading and writing information such as a flash memory and an EEPROM (Electrically Erasable Programmable ROM). The storage unit 15 stores an object ID for identifying the type of the plant A to be measured in the growing environment.

  The short-range communication unit 16 includes a module of a wireless communication method such as Bluetooth (registered trademark). The short-range communication unit 16 performs wireless communication with the terminal device 20 when the terminal device 20 is within the communicable area (for example, within a radius of 2 m).

  The timer unit 17 includes a timer circuit, clocks the current date and time, and outputs the date and time information to the microcomputer 11.

  The power supply unit 18 includes, for example, a secondary battery, and supplies power to each unit of the communication device 10. The power supply unit 18 may be a primary battery or the like.

  Next, the internal functional configuration of the terminal device 20 will be described with reference to FIG. The terminal device 20 includes a CPU 21 as a display control unit and a display position determination unit, an operation unit 22, a RAM 23, a display unit 24 as a display unit, a storage unit 25, a short-range communication unit 26, and an imaging unit. Imaging section 28, telephone communication section 27, and power supply section 29. Each part of the terminal device 20 is connected to each other via a bus 29A. The CPU 21 and the short-range communication unit 26 function as receiving means.

  The storage unit 25, the short-range communication unit 26, and the power supply unit 29 have the same configuration as the storage unit 15, the short-range communication unit 16, and the power supply unit 18 of the communication device 10, and descriptions of these similar configurations are omitted. Mainly different parts will be described.

  The CPU 21 controls each unit of the terminal device 20. The CPU 21 reads a designated program out of the various programs from the storage unit 25 and expands it in the RAM 23, and executes various processes in cooperation with the expanded program.

  The CPU 21 receives AR information such as measurement data from the communication device 10 according to the AR display program stored in the storage unit 25, selects a character corresponding to the state of the plant A based on the AR information, and displays the AR display information. The image of the character is created, and the image of the character is superimposed on the monitor image being captured.

  The operation unit 22 has a key group such as a character input key and various function keys, receives a press input to each key from the user, and outputs operation information corresponding to the press input to the CPU 21. The operation unit 22 may include a touch panel formed on the screen of the display unit 24.

  The RAM 23 is a volatile semiconductor memory and has a work area for storing various data and various programs.

  The display unit 24 includes a display panel such as an LCD (Liquid Crystal Display) or an EL (ElectroLuminescent) display, and performs various displays on the display panel according to display information input from the CPU 21 or the like.

  The storage unit 25 stores various data and programs. The storage unit 25 stores, for example, a measurement data table 30, an optimum environment condition table 40, a character table 50, and an AR display program.

  The short-range communication unit 26 performs wireless communication with the communication device 10 using the same wireless communication method as that of the short-range communication unit 16.

  The telephone communication unit 27 is a wide area communication unit used at the time of a voice call function, an electronic mail function, and an Internet connection function. In addition, although illustration is abbreviate | omitted in FIG. 4, the terminal device 20 has a signal processing part for voice calls, a speaker, a microphone, etc.

  The imaging unit 28 constitutes a camera unit that can photograph a subject with high definition. Although not shown, the imaging unit 28 includes an optical system such as an optical lens, an imaging element such as a CCD (Charge Coupled Device), an optical system driving unit, A lighting strobe, analog processing circuit, signal processing circuit, and the like are provided. The imaging unit 28 controls optical zoom adjustment control, autofocus driving, shutter driving, exposure, white balance, and the like.

  The power supply unit 29 supplies power to each unit of the terminal device 20.

  Next, information stored in the storage unit 25 of the terminal device 20 will be described with reference to FIGS. FIG. 5 is a diagram showing the measurement data table 30. FIG. 6 is a diagram showing the optimum environmental condition table 40. FIG. 7 is a diagram showing the character table 50.

  The measurement data table 30 is a table that stores measurement data of the growing environment of the plant A measured by the communication device 10. As shown in FIG. 5, the measurement data table 30 includes an object ID 31, a type 32, a date and time 33, and measurement data 34.

  The object ID 31 is identification information of the type of the plant A as the observation object of the communication device 10. The type 32 is the type of the plant A as the observation target corresponding to the target ID 31. Note that the correspondence between the object ID and the type 32 is arbitrarily set by a user operation or the like.

  The date and time 33 is the measurement date and time of the measurement data. The measurement data 34 is measurement data corresponding to the object ID 31 (type 32) and the date 33. The measurement data 34 includes measurement data for each type of measurement. The types of measurement are the outside air temperature measured by the outside air temperature sensor 142, the outside air humidity measured by the outside air humidity sensor 143, the soil humidity measured by the soil humidity sensor 144, and the amount of sunlight measured by the sunshine sensor 141. And.

  In the measurement data table 30, for example, measurement data for a past predetermined number of days (for example, one month) is stored. In the state where the measurement data for the predetermined number of days is already stored in the measurement data table 30, when new measurement data is added, for example, the old measurement data is deleted from the first-in first-out method.

  The optimum environment condition table 40 is a table having information on the optimum growth environment state of the plant A. As shown in FIG. 6, the optimum environment condition table 40 has items of a type 41 and an optimum environment condition 42. Type 41 is the type of plant A to be measured. The optimum environment condition 42 is information on the optimum growing environment state for each type of measurement corresponding to the kind 41. For example, when the type 41 is cyclamen, the maximum temperature of the optimum outside air temperature is 25 ° C., and the cold-resistant temperature is 7 ° C., the optimum environmental condition 42 is 15 ° C. to 25 ° C. C is set. The optimum environmental condition 42 is preferably defined over time according to the January to December time cycle. Furthermore, the optimum environmental condition 42 may include optimum time information such as topdressing, stock splitting, and pot change.

  The character table 50 is a table having information on a character as AR display information expressing the state of the plant A according to the measurement data of the plant A as an observation target. As shown in FIG. 7, the character table 50 has items of a state 51 and a character 52.

  The state 51 is the type of the state of the plant A as the observation target. The state 51 includes, for example, states such as optimum, excessive amount of sunlight, and insufficient soil moisture. The optimum of the state 51 is a state in which the breeding environment according to the outside air temperature, the outside air humidity, the soil humidity, and the amount of sunlight is optimum. The excessive amount of sunshine in the state 51 is a state of a growing environment in which the amount of sunshine is excessive. The water shortage in the state 51 is a state of the growing environment where the soil humidity is insufficient. The character 52 is character image data representing the state 51.

  Next, the operation of the AR display system 1 will be described with reference to FIGS. FIG. 8 is a flowchart showing the measurement data transmission process. FIG. 9 is a flowchart showing the AR display process.

  With reference to FIG. 8, the measurement data transmission process performed by the communication apparatus 10 is demonstrated.

  The communication device 10 is assumed to be embedded in the soil C in the vicinity of the plant A in advance. In the communication device 10, for example, using the power-on as a trigger, the microcomputer 11 executes measurement data transmission processing according to a measurement data transmission program stored in the ROM in the microcomputer 11. Note that the communication device 10 is activated in the sleep mode when the power is turned on.

  As shown in FIG. 8, first, the microcomputer 11 determines whether or not a human body is detected by the human sensor 12 and the signal processing circuit 13 based on the input of an interrupt signal from the signal processing circuit 13 (step S11). When the human body is not detected (step S11; NO), the process proceeds to step S11.

  If a human body is detected (step S11; YES), the microcomputer 11 sets the operation mode of the communication device 10 to the normal mode (step S12). When a human body is detected (step S11; YES), the microcomputer 11 holds the current date and time information of the time measuring unit 17 as the date and time information of human body detection.

  And the microcomputer 11 makes the sensor part 14 measure the growing environment of the plant A, and memorize | stores the measurement data in RAM in the microcomputer 11 (step S13). The measurement data may be stored in the storage unit 15. Then, the microcomputer 11 uses the short-range communication unit 16 to obtain the measurement data stored in the RAM in the microcomputer 11 from the current date / time information obtained from the time measuring unit 17 and the object stored in the storage unit 15. It transmits to the terminal device 20 as AR information with ID (step S14). In step S14, the microcomputer 11 actually receives the search signal transmitted from the terminal device 20 by the short-range communication unit 16, and transmits a response signal to the terminal device 20 according to the search signal. After communication is established with 20, AR information such as measurement data is transmitted to the terminal device 20. At this time, the microcomputer 11 holds the current date / time information of the time measuring unit 17 as the date / time information of the measurement data transmission.

  Then, the microcomputer 11 refers to the date / time information of the time measuring unit 17 and determines whether or not a predetermined N seconds have elapsed since the immediately preceding human body detection (step S15). If N seconds have not elapsed (step S15; NO), the microcomputer 11 determines whether or not a human body has been detected by the human sensor 12 based on the input of an interrupt signal from the signal processing circuit 13 (step S16). . When the human body is not detected (step S16; NO), the process proceeds to step S15.

  When a human body is detected (step S16; YES), the microcomputer 11 refers to the date and time information of the time measuring unit 17 and determines whether or not a predetermined T seconds have elapsed since the immediately previous measurement data transmission (step S17). . When a human body is detected (step S16; YES), the microcomputer 11 holds the current date and time information of the time measuring unit 17 as the date and time information of human body detection.

  When T seconds have not elapsed (step S17; NO), the process proceeds to step S16. When T seconds have elapsed (step S17; YES), the process proceeds to step S13.

  When N seconds have elapsed (step S15; YES), the microcomputer 11 stops the measurement of the plant A growing environment by the sensor unit 14 and the transmission of AR information such as measurement data by the short-range communication unit 16 ( Step S18). At this time, the microcomputer 11 holds the current date / time information of the time measuring unit 17 as the date / time information of transmission stop.

  And the microcomputer 11 discriminate | determines whether the human body was detected by the human sensitive sensor 12 by the input of the interruption signal from the signal processing circuit 13 (step S19). When a human body is detected (step S19; YES), the process proceeds to step S13. When a human body is detected (step S19; YES), the microcomputer 11 holds the current date and time information of the time measuring unit 17 as the date and time information of human body detection.

When the human body is not detected (step S16; YES), the microcomputer 11 refers to the date and time information of the time measuring unit 17, and determines whether or not a predetermined M seconds have elapsed since the previous transmission stop (step S20). . When M seconds have not elapsed (step S20; NO), the process proceeds to step S19. When M seconds have elapsed (step S20; YES), the microcomputer 11 sets the operation mode of the communication device 10 to the sleep mode (step S21), and proceeds to step S11.
That is, when the communication device 10 detects the human body with the human sensor 12, the AR information based on the data (measurement data, object ID) stored in the storage unit (RAM in the microcomputer 11, storage unit 15). Is transmitted to the terminal device 20. Thereby, the terminal device 20 can perform AR display based on the data when performing AR display, and can perform AR display according to the situation.

  Next, an AR display process executed by the terminal device 20 will be described with reference to FIG.

  It is assumed that the communication device 10 is previously embedded in the soil C near the plant A and the measurement data transmission process is executed. The user D holds the terminal device 20 and approaches the plant A and the communication device 10 for photographing the plant A, and directs the imaging direction of the imaging unit 28 toward the plant A and the communication device 10.

  In the terminal device 20, for example, when the execution instruction of the AR display process is input from the user D through the operation unit 22, the CPU 21 reads the AR display read from the storage unit 25 and appropriately expanded in the RAM 23. The AR display process is executed in cooperation with the program.

  First, the CPU 21 activates the imaging unit 28 and displays a monitor image (through image) captured by the imaging unit 28 on the display unit 24 (step S31). And CPU21 transmits the search signal of the communication apparatus 10 by the short distance communication part 26 (step S32).

  And CPU21 discriminate | determines whether the short signal communication part 26 received the response signal of the search signal from the communication apparatus 10 (step S33). When the response signal is not received (step S33; NO), the CPU 21 ends the AR display process.

  When the response signal is received (step S33; YES), the CPU 21 receives the object ID, date / time information, and measurement data as AR information from the communication device 10 through the short-range communication unit 26 (step S34). Then, the CPU 21 associates the object ID, the date information, and the measurement data received in step S34 and stores them in the measurement data table 30 of the storage unit 15 (step S35). The object ID, date information, and measurement data received as AR information are added to the measurement data table 30 as measurement data 34 corresponding to the object ID 31, date 33.

  And CPU21 pinpoints the transmission origin position as an approximate position of the transmission origin (communication device 10) which transmitted object ID by analyzing the reception situation (electric field intensity etc.) of the radio wave of near field communication part 26 (Step S36). In addition, it is good also as specifying the transmission origin position of the communication apparatus 10 (plant A) by image-recognizing the plant of target object ID from a monitor image. For example, the plant image data for each object ID is stored in the storage unit 25 in advance, and the CPU 21 reads out the plant image data of the received object ID from the storage unit 25 and uses it. Image recognition of the plant.

  And CPU21 discriminate | determines whether the transmission origin position specified by step S36 is in the display range of the monitor image currently displayed on the display part 24 (step S37). If not within the monitor range (step S37; NO), the CPU 21 displays a monitor image including a direction guide indicating the direction of the transmission source position on the monitor image on the display unit 24 (step S38), and proceeds to step S36. .

  If within the monitor range (step S37; YES), the CPU 21 refers to the measurement data table 30 stored in step S35 and specifies the type 32 corresponding to the object ID 31 corresponding to the current (latest) measurement data 34. (Step S38).

  Then, the CPU 21 refers to the optimum environment condition table 40 in the storage unit 15 and uses the optimum environment condition 42 corresponding to the type 32 specified in step S38 to measure the measurement data from the past to the present corresponding to the specified type 32. The current state of the observation target according to the change state 34 is determined (step S40). For example, when the measurement data indicates that the state of low moisture content continues for a predetermined number of days or more compared to the optimum environmental condition of the houseplant P1, which is the observation object, it is determined that the water is insufficient. In addition, when the measurement data indicates that the state where the moisture content is continuous for a predetermined number of days or more as compared with the optimum environmental condition of the cyclamen that is the observation object, it is determined that the state is excessive. In addition, when the measurement data indicates that a state in which the amount of sunlight is large is continued for a predetermined number of days or more compared to the optimum environmental condition of the vegetable V1 that is the observation object, the state is determined to be in an excessive amount of sunlight. Moreover, when the measurement data of the foliage plant P1 is in the optimum environmental condition, it is determined as the optimum state.

  Then, the CPU 21 refers to the character table 50 of the storage unit 15, selects and reads the character 52 corresponding to the state 51 determined in step S41, and creates it as AR display information (step S41).

Then, the CPU 21 superimposes the character image created in step S41 on the transmission source position specified in step S36 in the monitor image, and displays the superimposed monitor image on the display unit 24 (step S42). And CPU21 discriminate | determines whether there exists operation of the end instruction | indication of AR display process from the user D via the operation part 22 (step S43). If there is no end instruction operation (step S43; NO), the process proceeds to step S42. If there is an end instruction operation (step S43; YES), the AR display process ends.
That is, the terminal device 20 creates AR display information based on the AR information transmitted from the communication device 10, and superimposes the created AR display information on the monitor image and displays it on the display unit 24.

  Here, a specific example of the measurement data transmission process and the AR display process will be described with reference to FIG. It is assumed that the plant A as the observation object is the foliage plant P1, and the object ID = 01 is stored in the storage unit 15 of the communication device 10. The communication device 10 executes measurement data transmission processing, and the terminal device 20 executes AR display processing. The user D approaches the plant A that is the houseplant P1 as the observation object, and directs the imaging direction of the terminal device 20 toward the plant A.

  For this reason, measurement data, object ID (= 01), and date / time data are transmitted to the terminal device 20 in S13 of the measurement data transmission process.

  On the other hand, a monitor image including the image 61 of the plant A, the pot B and the soil C and the image 61 of the communication device 10 is displayed on the display unit 24 in step S31 of the AR display process. In steps S34 and S35, the measurement data, the object ID (= 01), and the date / time data are received and stored in the terminal device 20.

  In step S39, the plant A is identified as the houseplant P1 from the object ID = 01. In step S40, it is determined that the moisture is insufficient. In step S41, the AR display information 63 of the rain dew character 52 corresponding to the moisture deficient state is created.

  In step S42, in the monitor image having the images 61 and 62, the AR display information 63 of the character of rain dew is superimposed on the transmission source position as the position of the communication device 10 and displayed on the display unit 24.

  As described above, according to the present embodiment, the communication device 10 determines whether or not the human body of the user D carrying the terminal device 20 is detected by the human sensor 12, and when the human body is detected, the AR information Is transmitted to the terminal device 20.

  For this reason, it is possible to detect that the human body is approaching and transmit the AR information to the terminal device 20, and the terminal device 20 can simply display the AR status of the object based on the AR information. At this time, since the user D does not have to operate the switch or the like of the communication device 10, the burden on the user D can be reduced and the communication device 10 is prevented from entering the shadow of the human body. The influence of the human body on the measurement data of the growing environment of the plant A can be reduced. In addition, in the imaging operation in which the user D images the plant A (communication device 10), the measurement data can be transmitted according to the operation in which the user D approaches the communication device 10 with the imaging direction of the terminal device 20 facing the communication device 10. The measurement data can be transmitted in a natural imaging operation without causing the user D to perform an extra operation.

  Then, the terminal device 20 receives the AR information from the communication device 10 and superimposes the AR display information based on the received AR information on the monitor image captured by the imaging unit 28 and displays it on the display unit 24. For this reason, the AR display information based on the AR information can be displayed, and the user D can visually recognize the AR display information based on the AR information.

  The communication device 10 sets the communication device 10 to the normal mode when the human body of the user D is detected, and sets the sleep mode when the predetermined time has elapsed without detecting the human body. For this reason, the power consumption of the communication apparatus 10 can be reduced. In particular, when the communication device 10 is battery-driven, it is possible to reduce the burden of battery charging and replacement, and the battery capacity of the power supply unit 18 may be small, so that the communication device 10 can be reduced in size and weight.

  The human sensor 12 detects infrared rays emitted from the human body. The communication device 10 includes an end face portion 102 and a filter 104 that transmit infrared rays incident on the human sensor 12 from a predetermined upper direction, and a casing that blocks infrared rays incident from a direction other than the predetermined upper direction. Part 101 and shielding plate 103. For this reason, it is possible to detect only the human body of the user D approaching the predetermined upward direction, it is possible to prevent malfunction of the communication device 10 and further reduce power consumption.

  Moreover, the communication apparatus 10 transmits AR information, when the human body of the user D is detected. For this reason, the processing burden of the communication apparatus 10 can be reduced compared with the structure which a communication apparatus produces AR display information.

  The communication device 10 includes a sensor unit 14 that measures the plant growth environment, and transmits measurement data of the plant A growth environment measured by the sensor unit 14 as AR information to the terminal device 20. For this reason, the terminal device 20 can receive the measurement data of the growing environment of the plant A as AR information, and can display a character indicating the state of the plant as AR display information corresponding to the AR information superimposed on the monitor image.

  Moreover, the communication apparatus 10 transmits object ID which identifies the kind of plant A with measurement data as AR information to the terminal device 20. FIG. For this reason, the terminal device 20 can easily recognize the type of the plant A to be observed by the communication device 10, and can accurately determine the state of the plant A according to the type of the plant A, for example.

(Modification)
A modification of the above embodiment will be described with reference to FIG. FIG. 10 is a diagram showing an AR display system 2 according to this modification.

  The AR display system 2 includes a communication device 10a and a terminal device 20a. The communication device 10a is a communication device in which the end surface portion 102 of the communication device 10 is replaced with the end surface portion 102a. An AR marker 105 is printed on the upper surface of the end surface portion 102a. The AR marker 105 is a geometry for displaying AR display information in real time at a position corresponding to the image of the AR marker 105 in the monitor image (video) captured by the terminal device 20a (matching movement). It is a study marker. For example, AR display information is superimposed and displayed at a position corresponding to the AR marker 105 in the monitor image of the terminal device 20a.

  The terminal device 20 a has the same device configuration as the terminal device 20. However, the terminal device 20a recognizes the AR marker 105 in the monitor image without performing the radio field intensity detection of the short-range communication unit 26 or the image recognition of the plant A, so that the communication device 10a corresponding to the AR marker 105 is recognized. Specify the source location of.

  The CPU 21 of the terminal device 20a performs AR display processing. In step S36 of the AR display process, the CPU 21 recognizes the image of the AR marker 105 from the monitor image, and specifies the transmission source position of the transmission source (communication device 10a) that transmitted the object ID according to the recognition result. . In step S42, the CPU 21 superimposes and superimposes the character as the AR display information selected in step S41 on the transmission source position specified in step S36 in the monitor image in real time. The image is displayed on the display unit 24.

  Here, an example of the AR display process of this modification will be described. As shown in FIG. 10, for example, in step S <b> 31, a monitor image including an image 61 of the plant A, pot B and soil C and an image 62 a of the communication device 10 is displayed on the display unit 24. The image 62a includes an AR marker image 64a. In steps S34 and S35, the measurement data, the object ID (= 01), and the date / time data are received and stored in the terminal device 20a as AR information.

  In step 36, the position of the AR marker image 64a is specified as the transmission source position. In step S39, the plant A is identified as the houseplant P1 from the object ID = 01. In step S40, it is determined that the moisture is insufficient. In step S41, the rain dew character 52 corresponding to the moisture-deficient state is selected, and the AR display information 63a is created.

  In step S42, in the monitor image having the images 61 and 62, the AR display information 63a of the character with rain dew is superimposed on the position above the position of the AR marker image 64a as the transmission source position of the communication device 10 and displayed on the display unit. 24.

  As described above, according to this modification, the communication device 10 a includes the end surface portion 102 a having the AR marker 105. For this reason, the terminal device 20a can superimpose and display AR display information corresponding to the measurement data received from the communication device 10a at a position corresponding to the AR marker 105 (AR marker image 64a) of the monitor image.

In the above description, the example in which the ROM in the microcomputer 11 is used as the computer-readable medium of the program according to the present invention is disclosed, but the present invention is not limited to this example.
As other computer-readable media, a non-volatile memory such as a flash memory and a portable recording medium such as a CD-ROM can be applied.
A carrier wave is also applied to the present invention as a medium for providing program data according to the present invention via a communication line.

  Note that the descriptions in the above-described embodiments and modifications are examples of the communication device, the AR display system, and the program according to the present invention, and the present invention is not limited thereto.

  In the said embodiment and modification, although the terminal devices 20 and 20a were the structures which display the character which shows the state of the plant as AR display information on a monitor image, it is not limited to this. It is good also as a structure which a terminal device displays the character information etc. which show the state of a plant as AR display information other than the character based on received AR information.

  Moreover, in the said embodiment and modification, it was the structure which the communication apparatuses 10 and 10a transmit the measurement data as AR information (information for AR creation) to the terminal devices 20 and 20a, However, It is limited to this. It is not a thing. For example, the communication devices 10 and 10a may be configured to create AR display information corresponding to measurement data as AR information and transmit the AR display information to the terminal devices 20 and 20a. As AR display information, it is good also as character information of a measurement data, or the character information or character etc. which determine the state of a plant in the communication apparatus side, and show the state. According to this configuration, the processing burden on the terminal devices 20 and 20a can be reduced as compared with a configuration in which the terminal device creates AR display information.

  In the embodiment and the modification described above, the communication devices 10 and 10a are configured to set the sleep mode when a predetermined time has elapsed without the human sensor 12 being detected by the human sensor 12, but the present invention is not limited thereto. It is not something. For example, when the AR display processing is terminated in the terminal devices 20 and 20a, the CPU 21 transmits the termination information to the communication devices 10 and 10a by the short-range communication unit 26, and the communication devices 10 and 10a transmit the termination information. Upon reception, the microcomputer 11 may be configured to set the sleep mode.

  The AR information (AR creation information) may be parameter information for changing the display of the AR display information.

  Moreover, in the said embodiment and modification, although it was set as the structure which the communication apparatuses 10 and 10a transmit the measurement data of the growth environment of the plant A measured by the sensor part 14 to the terminal devices 20 and 20a, it is limited to this. Is not to be done. For example, when the communication device detects that a human body is approaching, the sensor unit may measure the temperature, the amount of pollen, and the like, and transmit the measurement data to the terminal device. The terminal device can display AR display information according to the temperature of the received measurement data, the amount of pollen, and the like. For example, when the temperature is higher than a predetermined temperature, the terminal device can AR display a hot animal character, and when the amount of pollen is higher than a predetermined amount, the terminal device can AR display a human character sneezing. In addition, a communication device may be installed for each work in the museum, and when it is detected that the human body of the viewer is approaching, the description information of the corresponding work may be transmitted to the terminal device. For example, the terminal device can display AR of a human character explaining the corresponding work as AR display information corresponding to the received description information.

  Moreover, in the said embodiment and modification, the communication apparatus 10 and 10a will measure the growth environment of the plant A with the sensor part 14, and will transmit the measurement data etc. to the terminal device 20 and 20a, if a human body is detected. However, the present invention is not limited to this. For example, even if the communication devices 10 and 10a do not detect a human body, the sensor unit 14 periodically measures the growing environment of the plant A and stores measurement data or the like in the storage unit 15 to detect the human body. Then, it is good also as a structure which transmits the measurement data etc. which are memorize | stored in the memory | storage part 15 collectively to the terminal devices 20 and 20a.

  Moreover, it is good also as a structure which estimates the cause of abnormality of the measurement data value in which the terminal devices 20 and 20a may be influenced by the action (human body) of the user D, and excludes the abnormal value. For example, when the communication device 10 or 10a detects a human body and the water amount based on the measurement data increases rapidly, the user D who owns the terminal device 20 or 20a waters the plant A. I can guess. According to this estimation result, the terminal devices 20 and 20a can distinguish watering from natural factors such as rain, and can further infer whether the growing environment of the plant A is outdoor or indoors where it hits rain. Further, the terminal devices 20 and 20a may be configured to display advice in accordance with watering as the action of the user D.

  Of course, the detailed configuration and detailed operation of each component of the AR display system in the above-described embodiments and modifications can be appropriately changed without departing from the spirit of the present invention.

Although the embodiments and modifications of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments and modifications, and the scope of the invention described in the claims and equivalents thereof are described. Includes range.
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.
[Appendix]
<Claim 1>
Storage means for storing data;
A discriminating means for discriminating whether or not a human body has been detected;
Transmitting means for transmitting AR information for performing AR display based on data stored in the storage means to a terminal device for performing AR display when it is determined that the human body is detected;
A communication device comprising:
<Claim 2>
2. The communication apparatus according to claim 1, wherein when the human body is detected, the transmission unit transmits AR creation information for creating AR display information to be superimposed on a monitor image in AR display as the AR information. .
<Claim 3>
The communication device according to claim 1, wherein, when the human body is detected, the transmission unit transmits AR display information superimposed on a monitor image in AR display as the AR information.
<Claim 4>
When the human body is detected, the determination unit sets the normal mode in which all the units of the communication device are activated, and when the predetermined time has passed without the human body being detected, the determination unit of the communication device The communication apparatus according to any one of claims 1 to 3, wherein the communication apparatus is set to a sleep mode in which means other than the means are stopped.
<Claim 5>
Detection means for detecting infrared rays emitted from the human body;
Transmission blocking means for transmitting infrared light incident from a predetermined direction to the detection means, and blocking infrared light incident from a direction other than the predetermined direction,
The communication apparatus according to any one of claims 1 to 4, wherein the determination unit determines whether a human body is detected based on the detection unit.
<Claim 6>
Equipped with sensor means for measuring the growing environment of the plant,
6. The transmission device according to claim 1, wherein, when the human body is detected, the measurement data of the plant growth environment and the plant type identification information measured by the sensor device are transmitted as the AR information. The communication device according to claim 1.
<Claim 7>
The communication device according to any one of claims 1 to 6, further comprising an end surface portion having an AR marker corresponding to a position where the AR display is displayed.
<Claim 8>
A communication device according to any one of claims 1 to 7;
The terminal device,
The terminal device
An imaging means for imaging a monitor image;
Receiving means for receiving the AR information;
An AR display system comprising: a display control unit that superimposes AR display information based on the received AR information on a monitor image captured by the imaging unit and displays the superimposed information on the display unit.
<Claim 9>
The AR display system according to claim 8, wherein the terminal device includes a display position determination unit that determines a display position on which the AR display information is superimposed based on the AR information.
<Claim 10>
Computer
Storage means for storing data;
A discriminating means for discriminating whether or not a human body has been detected;
Transmitting means for transmitting AR information for performing AR display based on data stored in the storage means to a terminal device for performing AR display when it is determined that the human body is detected;
Program to function as.

DESCRIPTION OF SYMBOLS 1, 2 AR display system 10, 10a Communication apparatus 101 Case part 102, 102a End surface part 103 Screen board 104 Filter 105 AR marker 11 Microcomputer 12 Human sensor 13 Signal processing circuit 14 Sensor part 141 Sunlight sensor 142 Outside temperature sensor 143 Outside air Humidity sensor 144 Soil humidity sensor 15 Storage unit 16 Short-range communication unit 17 Timekeeping unit 18 Power supply unit 19 Bus 20, 20a Terminal device 21 CPU
22 Operation unit 23 RAM
24 Display unit 25 Storage unit 26 Short-range communication unit 27 Telephone communication unit 28 Imaging unit 29 Power supply unit 29A Bus

Claims (10)

Storage means for storing data;
A discriminating means for discriminating whether or not a human body has been detected;
Transmitting means for transmitting AR information for performing AR display based on data stored in the storage means to a terminal device for performing AR display when it is determined that the human body is detected;
A communication device comprising:   2. The communication apparatus according to claim 1, wherein when the human body is detected, the transmission unit transmits AR creation information for creating AR display information to be superimposed on a monitor image in AR display as the AR information. .   The communication device according to claim 1, wherein, when the human body is detected, the transmission unit transmits AR display information superimposed on a monitor image in AR display as the AR information.   When the human body is detected, the determination unit sets the normal mode in which all the units of the communication device are activated, and when the predetermined time has passed without the human body being detected, the determination unit of the communication device The communication apparatus according to any one of claims 1 to 3, wherein the communication apparatus is set to a sleep mode in which means other than the means are stopped. Detection means for detecting infrared rays emitted from the human body;
Transmission blocking means for transmitting infrared light incident from a predetermined direction to the detection means, and blocking infrared light incident from a direction other than the predetermined direction,
The communication apparatus according to any one of claims 1 to 4, wherein the determination unit determines whether a human body is detected based on the detection unit. Equipped with sensor means for measuring the growing environment of the plant,
6. The transmission device according to claim 1, wherein, when the human body is detected, the measurement data of the plant growth environment and the plant type identification information measured by the sensor device are transmitted as the AR information. The communication device according to claim 1.   The communication device according to any one of claims 1 to 6, further comprising an end surface portion having an AR marker corresponding to a position where the AR display is displayed. A communication device according to any one of claims 1 to 7;
The terminal device,
The terminal device
An imaging means for imaging a monitor image;
Receiving means for receiving the AR information;
An AR display system comprising: a display control unit that superimposes AR display information based on the received AR information on a monitor image captured by the imaging unit and displays the superimposed information on the display unit.   The AR display system according to claim 8, wherein the terminal device includes a display position determination unit that determines a display position on which the AR display information is superimposed based on the AR information. Computer
Storage means for storing data;
A discriminating means for discriminating whether or not a human body has been detected;
Transmitting means for transmitting AR information for performing AR display based on data stored in the storage means to a terminal device for performing AR display when it is determined that the human body is detected;
Program to function as.

Images