JP2015133994A - Observation apparatus, and observation management system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make it possible to easily check a current state of an object to be observed on the spot only by capturing an image of the object to be observed or its vicinity without performing a special operation.SOLUTION: A portable terminal device 1, when an image of an object to be observed (plant) or its vicinity is captured by an imaging part 15, receives and acquires an observation result in the object to be observed in the captured image (monitor image) from an observation apparatus 2 on a plant side, and reads out and acquires state expression information expressing a current state of the object to be observed from a character table T3 corresponding to the acquired observation result, and displays the state expression information on a display part 16 while associating the information with the object to be observed in the captured image.

Description

  The present invention relates to an observation apparatus and an observation management system.

  In general, when growing and cultivating plants, the amount of water given to the plant, how to apply sunlight, how to apply fertilizer, temperature conditions, etc. differ depending on the type and environment of the plant. There exists a technology that provides information on the user to the user. For example, a technology where the environment where plants are placed is observed and accumulated and managed, and the observed environment is compared with the optimal growth environment for the plant, and a guide for growing is displayed ( Plant growth guide system) (see Patent Document 1).

  That is, this plant growth guide system has a plant environment measurement device provided in an outdoor pot and an indoor plant growth management device (for example, a personal computer). When the switch is operated or when the measurement time is reached, the data measured by various sensors is stored. After that, when the communication switch on the measuring device side is operated, the above-described operation is performed in response to the operation. The stored data is transmitted to the plant growth management device. The management device displays guide information related to the handling instruction by referring to the database from the received data.

JP 2010-0775172 A

  However, in the above-described prior art, there is a merit that it is helpful when growing a plant by displaying the environmental measurement result of the plant, but the current state of the plant is only displayed by displaying the guide information. It is not always possible for the user to properly determine, and in order to transmit observation data from the measurement device to the management device, the communication switch must be operated each time, which places a burden on the user. Become.

  An object of the present invention is to provide a convenient observation apparatus and observation management system.

In order to solve the above-described problem, one aspect of the present invention is as follows.
The lower end portion includes a tapered rod body portion, and a handle portion formed to project laterally with respect to the rod body portion,
The handle portion is provided so that the rod body portion can be inserted into the soil while pressing the rod body portion from above with the belly portion of the thumb while the index finger is hung on the handle portion from below. An observation device characterized in that

In order to solve the above-described problem, another aspect of the present invention provides:
An observation management system in which a mobile terminal device can be connected to an observation device for observing an observation object,
The observation apparatus has a rod body portion with a tapered tip on the lower side, and a handle portion formed to project laterally with respect to the rod body portion,
The handle portion is provided so that the rod body portion can be inserted into the soil while pressing the rod body portion from above with the belly portion of the thumb while the index finger is hung on the handle portion from below. An observation management system characterized by

  According to the present invention, it is possible to provide a convenient observation apparatus and observation management system.

The block diagram which showed the observation management system which connected the portable terminal device 1 provided with the camera function, and the observation apparatus 2 which observes an observation target object by communication. The figure for demonstrating how to hold the observation apparatus 2 at the time of piercing the observation apparatus 2 in the bowl 3. FIG. FIG. 3 is a block diagram showing basic components of the mobile terminal device 1. The block diagram which showed the basic component of the observation apparatus 2. FIG. FIG. 3 is a schematic longitudinal sectional view of the observation device 2. The figure for demonstrating the observation result table T1 provided in the portable terminal device 1 side. The figure for demonstrating the optimal environment state table T2 provided in the portable terminal device 1 side. The figure for demonstrating the character table T3 provided in the portable terminal device 1 side. 7 is a flowchart that starts execution when the camera monitor mode is switched to display a through image (captured image) from the imaging unit 15 as a monitor image. The figure which showed the example of a character display when the present state of an observation target object (plant) is optimal. The figure which showed the example of a character display in case the present state of an observation target object (plant) is excessive sunshine. The figure for demonstrating the optimal cultivation state table T6 with which the memory | storage part 13 of the portable terminal device 1 is equipped in 2nd Embodiment. The figure for demonstrating the plant species table T7 with which the memory | storage part 13 of the portable terminal device 1 is equipped in 2nd Embodiment. 10 is a flowchart for starting execution when a camera monitor mode is switched in the second embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
(First embodiment)
First, a first embodiment of the present invention will be described with reference to FIGS.
FIG. 1 is a block diagram showing an observation management system in which a mobile terminal device 1 having a camera function and an observation device 2 for observing an observation target are connected by communication.
The mobile terminal device 1 is a mobile phone, and has a voice call function, an e-mail function, an Internet connection function (Web access function), an imaging function (camera function), a short-range communication function, and the like. Data can be transmitted and received by short-range communication.

  The observation device 2 is for observing the environment of the observation object (for example, the growth environment of plants such as plants and flowers in this embodiment), and the entire body of the observation device 2 forms an elongated hollow rod. . The entire hollow rod of the observation device 2 is tapered, and the lower part (for example, the lower half) of the observation device 2 is embedded in the soil of the pot 3. A plurality of pores 2a are formed on the surface for ventilation and water flow. An observation object ID (identification number “5” in the illustrated example) 2b for identifying the observation object is formed on the upper end surface of the observation device 2 by printing or stamping. Note that the user approaches the observation object and performs enlarged shooting with the camera function of the mobile terminal device 1 around the upper end surface (observation object ID portion) of the observation apparatus 2. (See FIG. 1).

Further, an arc-shaped handle 2c is formed to protrude (integral molding) on one side of the upper end portion of the observation device 2. Here, as shown in FIG. 2, when the lower part of the observation device 2 is pierced into the soil of the pot 3, the index finger is placed under the handle 2c while pressing the upper end surface of the thumb with the belly portion of the thumb. By hang-up, the observation apparatus 2 can be smoothly inserted and removed. That is, the handle 2c is formed at a position where the housing can be inserted and squeezed while pressing the upper end surface of the housing with the belly portion of the thumb while the index finger is hung from the lower side of the handle 2c.
As shown in the figure, when one planted plant or flower is planted in the pot 3, one observation device 2 is inserted into the pot 3, and a plurality of types of planted plants or flowers are placed in the pot 3. Is planted in the pot 3 as many as the number of observation devices 2 corresponding to the type.

FIG. 3 is a block diagram illustrating basic components of the mobile terminal device 1.
The CPU 11 operates by supplying power from a power supply unit 12 having a secondary battery (not shown), and controls the overall operation of the mobile terminal device 1 according to various programs in the storage unit 13. It is. The storage unit 13 stores programs and various applications for realizing the present embodiment in accordance with the operation procedure illustrated in FIG. 9, and various types of information necessary for the mobile terminal device 1 to operate. A work area for temporarily storing information is provided, and an observation result table T1, an optimum environment state table T2, a character table T3, and the like, which will be described later, are provided.

  The telephone communication unit 14 is a wide area communication unit used at the time of a voice call function, an electronic mail function, and an Internet connection function. The imaging unit 15 constitutes a camera unit capable of photographing a subject with high definition. Although not shown, in addition to an optical lens and an imaging element, an optical system driving unit, a strobe for illumination, an analog processing circuit, and a signal processing circuit Etc. are provided. The imaging unit 15 adjusts and controls the optical zoom, and controls driving during autofocus, shutter driving, exposure, white balance, and the like.

  The display unit 16 uses, for example, a high-definition liquid crystal display, an organic EL display, an electrophoretic display (electronic paper) or the like, and displays display information such as character information and a standby image, and uses a camera function. Sometimes the viewfinder screen displays a live view image (monitor image) as a captured image. A touch screen (touch screen) is configured on the surface of the display unit 15 by stacking and disposing contact operation units (transparent contact sensors) that detect finger contact. The display unit 16 is disposed on the front surface of the mobile terminal device 1, while the imaging unit 15 is disposed on the back surface of the mobile terminal device 1. Although not shown, the operation unit 17 includes a power on / off button, a button for switching to a camera monitor mode, and the like, and the CPU 11 performs processing according to the operation button.

  The short-range communication unit 18 constitutes a Bluetooth Bluetooth (registered trademark) module and communicates with the observation device 2 and is within a communicable area (for example, within a radius of 2 m). If a search signal (search signal) for searching for the observation device 2 is transmitted from the mobile terminal device 1 and there is a response to the search signal, a communication link between the mobile terminal device 1 and the observation device 2 is established, and data communication is performed mutually. It becomes possible. In this case, the mobile terminal device 1 receives and acquires the observation result transmitted from the observation device 2.

FIG. 4 is a block diagram showing basic components of the observation apparatus 2.
The CPU 21 operates by supplying power from a power supply unit 22 including a battery (a primary battery or a secondary battery), and controls the overall operation of the observation device 2 according to various programs in the storage unit 23. The storage unit 23 is provided with an observation data memory T4 and an object ID memory T5 described later. The CPU 21 also has an observation unit (various environmental sensors) as an input / output device, that is, a sunshine meter 24 for measuring the degree of sunlight, an outdoor thermometer 25 for measuring the outdoor temperature, and an outdoor air for measuring the outdoor humidity. In addition to a hygrometer 26 and a soil hygrometer 27 that measures the humidity of the soil surface in the pot 3, a short-range wireless communication (Bluetooth) is performed between the clock unit 28 that measures the current date and time and the mobile terminal device 1. A short-range communication unit 29 that performs Bluetooth (registered trademark) communication is connected. In addition,
The sunshine meter 24, the outside air thermometer 25, the outside air hygrometer 26, and the soil hygrometer 27 are small electronic components that are capable of measuring with high accuracy. Shall be omitted.

  The CPU 21 of the observation device 2 has a growth environment observed by a sunshine meter 24, an outside air thermometer 25, an outside air hygrometer 26, and a soil hygrometer 27 at predetermined time intervals (for example, every day or every two days). (Observation results) are acquired, and this growth environment (observation results) is additionally stored in the observation data memory T4 in association with the current date of the clock unit 28. Further, when the communication connection between the mobile terminal device 1 and the observation device 2 is established via the short-range communication unit 29, the CPU 21 reads the contents of the object ID memory T5 and the observation data memory T4 and performs short-range communication. The data is transmitted from the unit 29 to the mobile terminal device 1. The object ID memory T5 is a memory for storing an observation object ID (in the example of FIG. 1, an identification number “5”). The observation data memory T4 is a memory for storing observation results (observation results relating to the growth environment) observed by the sunshine meter 24, the outside air thermometer 25, the outside air hygrometer 26, and the soil hygrometer 27.

FIG. 5 is a schematic longitudinal sectional view of the observation apparatus 2.
The top plate 2d on the upper end side of the observation device 2 includes a sunshine meter 24, an outside air thermometer 25, an outside air hygrometer 26, an antenna 29a for the short-range communication unit 29, and the like as various electronic components. In addition, a battery 22a, which is a power supply unit 22, is incorporated below the electronic component. A soil hygrometer 27 is built in the central partition 2e of the observation device 2. Further, the surface of the observation device 2 on the lower end side is formed with the plurality of pores 2a for ventilation and water passage described above. In the hollow portion on the lower end side of the observation device 2, the pores 2a A plurality of valve members 2f for preventing entry of soil are formed in the formation portion. Although not shown, the upper half and the lower half of the observation device 2 can be separated from each other with the central partition plate 2e as a boundary, and the lower half of the observation device 2 can be replaced as appropriate. It is said. In addition, when the upper half part and lower half part of the observation apparatus 2 are isolate | separated, you may make it inject | pour a nutrient into soil by inserting the cassette of a nutrient ampule into the hollow of a lower half part.

FIG. 6 is a diagram for explaining an observation result table T1 provided on the mobile terminal device 1 side.
The observation result table T1 is a table that stores and manages the observation results (observation results relating to the growth environment) transmitted from the observation device 2 by observation date and by observation object ID. In the figure, the vertical direction of the table is “observation date”. And the horizontal direction is associated with “observation object ID”. In the illustrated example, “No. 1”, “No. 2”, “No. 3”, “No. 4”, “No. 5”, etc. are observation object IDs assigned to a plurality of observation devices 2. Is shown. Corresponding to this observation object ID, “Cactus” is stored in “No. 1”, “Vegetable A” in “No. 2”, “Cyclamen” in “No. 3”. “No. 4” stores “houseplant A”, “No. 5” stores “houseplant B”,. Note that the correspondence between the observation object ID and the plant type is arbitrarily set by a user operation.

  In the storage area where the “observation date” and the “observation object ID” in the observation result table T1 intersect, the observation result of the observation object received from the observation device 2 is the outside air temperature, the outside air humidity, the soil humidity, The sunshine is remembered. In this case, the observation result table T1 stores the observation result data for the past predetermined number of days (for example, for one month), but the observation result data for the predetermined number of days is already stored. Then, for example, the old observation result data is erased according to the first-in first-out method.

FIG. 7 is a diagram for explaining the optimum environment state table T2 provided on the mobile terminal device 1 side.
The optimum environment state table T2 is a table for storing and managing the optimum environment state for the growth corresponding to the type of observation object, and corresponding to the outside air temperature, the outside air humidity, the soil humidity, and the sunshine for each kind of plant. The optimum state (specific state) is stored. For example, as the optimum environment regarding the temperature of cyclamen, the maximum temperature is 25 ° C., the cold-resistant temperature is 7 ° C., and the optimum growth temperature (optimum temperature range) is set to 15 ° C. to 25 ° C. The optimum environment is defined over time according to the January-December period cycle, and the optimum environment includes optimum time information such as topdressing, stock splitting, and pot change.

FIG. 8 is a diagram for explaining a character table T3 provided on the mobile terminal device 1 side.
The character table T3 stores and manages state expression information (for example, a character as a predetermined picture) representing the current state of the observation object according to the observation result of the observation object. Used when specifying a character according to the result. That is, in the character table T3, characters having contents representing the current state of the observation object, for example, “insufficient moisture”, “excessive moisture”, “excessive sunshine”, and the like are stored. In the example shown in the figure, a character indicating that the growth environment of moisture, humidity, and sunshine is “optimum” and a character indicating that it is “excessive sunshine” are stored. Yes.

  Next, an operation concept of the mobile terminal device 1 in the first embodiment will be described with reference to a flowchart shown in FIG. Here, each function described in this flowchart is stored in the form of a readable program code, and operations according to the program code are sequentially executed. Further, it is possible to sequentially execute the operation according to the above-described program code transmitted via a transmission medium such as a network. The same applies to other embodiments described later. In addition to the recording medium, an operation peculiar to the present embodiment can be executed using a program / data supplied externally via a transmission medium. FIG. 9 is a flowchart showing an outline of the operation of the characteristic part of the present embodiment in the overall operation of the mobile terminal device 1. When the flow of FIG. Return to (not shown).

FIG. 9 is a flowchart that is started when the camera monitor mode is switched to display a through image (captured image) from the imaging unit 15 as a monitor image. In this monitor mode, the user directs the imaging unit 15 toward or near the observation object.
First, the CPU 11 obtains a through image from the imaging unit 15 and performs an imaging monitor display to be displayed on the display unit 16 as a monitor image (step A1). And the search signal (search signal) which starts the short distance communication part 18 and searches the observation apparatus 2 is transmitted (step A2).

  In this state, whether or not there is a response to the search signal from the observation device 2 is checked (step A3), and if there is no response from the observation device 2 even after a predetermined time has passed (NO in step A3), at this point in time in FIG. Although the flow exits, when a response from the observation device 2 is received (YES in step A3), communication between the mobile terminal device 1 and the observation device 2 is established. In this state, when the observation result (observation result regarding the growth environment) and the observation object ID are received and acquired from the observation device 2 (step A4), the received contents (observation object ID, observation result) are stored in the observation result table T1. Additional storage is performed (step A5).

  Then, the process of identifying the position of the current transmission source, that is, the approximate position of the transmission source (observation apparatus 2) that transmitted the observation object ID is analyzed by analyzing the reception status of radio waves (such as radio wave intensity). Processing is performed (step A6). It is checked whether the position specified by this is within the range of monitor shooting (whether the transmission source is included in the monitor image) (step A7), and when it is out of the range of monitor shooting (NO at step A7). Then, a direction guide for guiding the direction falling within the monitor photographing range is displayed on the display unit 16 (step A8). Then, while performing the imaging monitor display for displaying the through image as the monitor image (step A9), the process returns to the above-described step A7 to check whether the transmission source is included in the monitor imaging range.

  When the transmission source is included or comes to be included in the range of monitor imaging (YES in step A7), the observation result table T1 is searched based on the observation object ID, and the observation object ID is set. The type of the corresponding observation object (plant) is specified (step A10). Then, referring to the contents of the observation result table T1 and the optimum environment state table T2 corresponding to this observation object ID (or plant type), the change state from the past observation result to the current observation result is shown. The current state of the observation object is determined (step A11). For example, “the state of low moisture continues for many days (moisture shortage)” compared to the optimal environmental state of the foliage plant A, or “what is the state of high water content compared to the optimal environmental state of the cactus” “The day is continuous (excessive water)”, compared to the optimal environmental condition of vegetable A, “the sun is continuous for many days (excessive sunlight)”, or “the best environment for cactus” It is determined as the current state of the observation object (plant).

  Then, state expression information representing the current state of the observation object is acquired. That is, the character table T3 is searched based on the above-described determination results (for example, “water shortage”, “water overload”, “excessive sunlight”, etc.), and the corresponding character is selected and read out (step A12). The selected character is superimposed and displayed in association with the position of the transmission source (observation apparatus 2) in the monitor image (step A13). Thereafter, whether the above-described determination result (the current state of the observation object) is a state indicating a specific situation, that is, a dangerous state, for example, “water shortage”, “water It is determined whether or not “excessive”, “excessive sunshine”, etc. continue (step A14).

  If the current state of the observation object is not dangerous (NO in step A14), the flow of FIG. 9 is exited at this point, but if it is dangerous (YES in step A14), the monitor image is displayed. After the image portion of the observation object specified by the analysis is identified (red) and displayed (step A15), the flow of FIG. 9 is exited. Here, FIG. 10 is a diagram illustrating a character display example when the determination result is optimal. FIG. 11 is a diagram illustrating a character display example when the determination result is excessive sunshine, and is a diagram illustrating the upper end portion of the observation device 2 and the character in the monitor image. In FIGS. 10 and 11, the character, the observation object other than a part of the observation apparatus 1, the bowl 3, and the like are not shown.

  As described above, in the first embodiment, when the imaging unit 15 captures an observation target object or its vicinity, the mobile terminal device 1 acquires an observation result on the observation target object in the captured image (monitor image). In addition, after obtaining the state expression information representing the current state of the observation object according to the obtained observation result, the state expression information is displayed on the display unit 16 in association with the observation object in the captured image. As a result, the user can easily check the current state of the observation object on the spot (near the observation object) by photographing the observation object without performing any special operation. It can be made convenient.

  The mobile terminal device 1 receives and acquires the type of observation object transmitted from the observation device 2 and the observation result by short-range communication, and acquires the contents of the optimum environment state table T2 corresponding to the type of observation object and the acquisition Since the current state of the observation object is determined according to the comparison result with the observed result, the current state can be determined for each type of the observation object.

  The portable terminal device 1 uses a plant as an observation target, and observes the growth observed by environmental sensors (a sunshine meter 24, an outside air thermometer 25, an outside air hygrometer 26, and a soil hygrometer 27) provided on the plant side. Since the result is received and acquired, the current state of the plant can be appropriately determined according to the observation result.

  Since the mobile terminal device 1 transmits a search signal for searching for an observation object (observation device 2) by short-range communication, and receives and obtains an observation result transmitted from the observation device 2 side in response thereto, Observation results can be acquired simply by approaching the observation object (observation apparatus 2).

  Since the mobile terminal device 1 acquires (predetermined picture: character) as the state expression information that represents the current state of the observation object, the observation object is expressed in an intuitively understandable manner for the user. You can know the current state of things.

  Since the mobile terminal device 1 is configured to acquire state expression information representing the current state of the observation object according to the change state from the past observation result of the observation object to the current observation result, It is possible to appropriately determine the state and obtain state expression information suitable for the state.

  If the current state of the observation target object is a state indicating a specific situation (for example, a dangerous state), the mobile terminal device 1 is configured to display the specific state (for example, red display). Therefore, it is possible to reliably notify the specific state.

  Since the state expression information is superimposed and displayed on the position of the observation object in the captured image, the correspondence between the state expression information and the observation object becomes clear.

  An observation management system in which a mobile terminal device 1 and an observation device 2 are connected by communication. The observation device 2 responds to a search signal for searching for an observation object from the mobile terminal device 1 and transmits an observation result by short-range communication. The mobile terminal apparatus 1 receives and obtains the observation result of the observation object transmitted from the observation apparatus 2 in response to the search signal by the short-range communication when the observation object is photographed by the imaging unit 15. Thereafter, state expression information representing the current state of the observation object is acquired according to the observation result, and the state expression information is displayed on the display unit 16 in association with the observation object in the captured image. Therefore, the user can easily confirm the current state of the observation object on the spot (near the observation object) by photographing the observation object without performing any special operation. Can be convenient It becomes as.

  Since the observation device 2 performs the piercing of the observation device 2 while pressing the upper end surface of the housing with the abdomen of the thumb while the index finger is hung from the lower side of the handle 2c, the piercing is smoothly performed. be able to.

  In the first embodiment described above, Bluetooth Bluetooth (registered trademark) communication is performed between the mobile terminal device 1 and the observation device 2. However, the present invention is not limited to this, and infrared communication, contactless ID card communication, etc. Short-distance communication may be used. Furthermore, you may make it communicate between the portable terminal device 1 and the observation apparatus 2 via not only a near field communication but a local area communication network or a wide area communication network.

  In the first embodiment described above, the state expression information representing the current state of the observation object is read out and acquired from the character table T3. However, the server device (not shown) is connected via the local area communication network or the wide area communication network. The state expression information may be received and acquired.

(Second Embodiment)
Hereinafter, a second embodiment of the present invention will be described with reference to FIGS.
In the first embodiment described above, the mobile terminal device 1 receives and acquires the observation result from the observation device 2 together with the observation object ID by short-range communication, and corresponds to this observation object ID (plant type). Although the change state from the past to the current observation result is determined as the current state of the observation object, in this second embodiment, the mobile terminal device 1 analyzes the monitor image to determine the type of the observation object. And the observation result is acquired by image recognition, and the current state of the observation object is determined according to the comparison result between the optimum state according to the type of the observation object and the observation result. Here, in both the embodiments, the same or the same names are denoted by the same reference numerals, the description thereof will be omitted, and the following description will focus on the features of the second embodiment. .

FIG. 12 is a diagram for explaining an optimum breeding state table T6 provided in the storage unit 13 of the mobile terminal device 1 in the second embodiment.
The optimal growth state table T6 is a table that stores colors, growth, flowering conditions, etc. for each type of plant. The optimal growth state table T6 corresponds to the type of observation object (plant), and “ -"Size", "Flowing condition / number of flowers", "Size / thickness of trunk", ... are stored. In the optimum growth state table T6, for example, for each type of plant, an optimum growth state is stored for each growth process such as sowing, raising seedling period, flowering period, and for each season.

FIG. 13 is a diagram for explaining a plant species table T7 provided in the storage unit 13 of the mobile terminal device 1 in the second embodiment.
The plant species table T7 stores information indicating the characteristics of each plant type, and is used when specifying the plant type. In the example shown in the figure, for each type of plant, there are items of “leaves”, “stems”, “flowers”,... As the characteristics of each part, and each item has colors, flower shapes, etc. according to the growth process. Feature information is stored.

FIG. 14 is a flowchart that starts execution when the camera monitor mode is switched in the second embodiment.
First, the CPU 11 obtains a through image from the imaging unit 15 and performs an imaging monitor display to be displayed on the display unit 16 as a monitor image (step B1). Then, the monitor image is recognized to identify the observation object (step B2). In addition, in this 2nd Embodiment, since the known image recognition technique is used, the description is abbreviate | omitted, but also considers relations, such as a surrounding pot, besides the shape of a plant, a color, etc. The image portion of the observation object is comprehensively determined. Further, when a plurality of observation objects are shown in the monitor image, each observation object is specified.

  As a result of this image recognition, it is checked whether or not an unrecognized observation object not specified as an observation object is included in the monitor image (step B3). If there is no unrecognized object (NO in step B3), If there is another unrecognized object (YES in step B3), the type (for example, cactus, foliage plant A) is determined for each identified observation object by performing further image recognition. Etc.) is specified (step B4). In this case, referring to the contents of the plant species table T7, it is checked whether a subject (plant) similar to the feature information of each plant is included in the monitor image, and if a subject that is characteristically similar is included. , Identify its type. Further, for each observation object, the color, growth, and flowering condition of the plant are comprehensively observed by image recognition, and the observation result is acquired (step B5).

  The current state of the observation object is determined based on the contents of the optimum growth state table T6 corresponding to the type of the observation object specified thereby and the observation result (step B6). For example, “flowering is delayed by about one week compared with the optimal growing state”, “small number of flowering” or the like is determined. And this determination result is a state that indicates a specific situation, that is, a dangerous state that is far from the optimal state, for example, in a state that is dangerous for growth due to extreme lack of fertilizer or excessive sunshine, etc. Whether there is a dangerous state (NO in step B7) is checked (step B7), and the process returns to the above-described step B2 in order to check the presence or absence of the next unrecognized object.

  If the current state of the observation object is dangerous (YES in step B7), the character expressed in that state is selected (step B8), and the position of the observation object in the monitor image is selected. In addition, in the second embodiment, when the display position of the character is touch-operated, detailed information regarding the growth is displayed in a pop-up manner. Thereafter, the process returns to step B2 described above, and if there is an unrecognized object in the monitor image (YES in step B3), the above-described operation is repeated. As a result, if the current state of the observation target is a dangerous state that is far from the optimal state, a character representing the dangerous state is displayed in association with the observation target in the through image. The operation is repeated for each observation object.

  As described above, in the second embodiment, the mobile terminal device 1 analyzes the monitor image captured by the imaging unit 15 to observe the observation object in the monitor image and acquire the observation result. Therefore, even if no special device is provided on the observation object side, the current state of the observation object can be easily confirmed on the spot simply by photographing the observation object.

  In addition, after observing the observation object in the photographic image by analyzing the photographic image and acquiring the type and the observation result by image recognition, the contents of the optimum growth state table T6 corresponding to the type of the observation object And the obtained observation result are compared, and the current state of the observation object is determined according to the comparison result. Therefore, the current state can be determined for each type of the observation object.

  When multiple observation objects are photographed, the through images are analyzed to observe each observation object and acquire the observation results, as well as the observation results acquired for each observation object and optimal growth As a result of comparing with the optimum state in the state table T6, if it is a dangerous state, the state expression information representing the state is displayed in association with the observation object in the through image. Since only the observation objects in the dangerous state are selected from the observation objects and the state expression information is displayed in association with the observation object in the through image, the dangerous state for the user is displayed. Observable objects can be found easily and reliably.

  In each of the above-described embodiments, the user may be advised by using an experiential and experiential method by combining augmented reality technology (AR) with the camera function. In this case, an anthropomorphic advice presentation form by the AR character may make it feel as if the intention and personality exist in the plant that cannot express the intention. As a result, it is possible to provide the user with an emotional value that simulates the emotion of the plant through the character, and a real value that reduces the difficulty of plant management training. In this way, since the AR character is displayed in the space exactly the same as the plant (observation target), it is possible to express as if the plant has intention and personality. It should be noted that whether or not a plant (observation target) is shown in the through image is checked by image recognition, and the AR character may be displayed together with the plant while the plant is shown.

  Further, in each of the above-described embodiments, plants are shown as observation objects. However, the aquarium environment, birds such as parakeets and literary birds, and automobiles, etc. It may be a thing that cannot be easily observed. In this case, when an animal or a tropical fish as a pet is used as an observation target, the environment of the pet breeding room or the aquarium environment may be observed. Needless to say, the observation device 2 may be provided in a collar portion of a dog or a cat, or the observation device 2 may be provided in a water tank. Furthermore, the observation object is not limited to living things such as pets, but may be fresh foods such as meat and vegetables, and the storage location, the storage environment in the refrigerator, or the freshness state thereof may be observed. Good. Furthermore, you may make it observe internal environments, such as a chiffon, and an observation object is arbitrary.

  In each embodiment described above, the character is displayed as the state expression information. However, the present invention is not limited to this, and other pictorial figures such as icons may be used. Further, the state expression information may be an advice balloon. Further, in each of the above-described embodiments, when the state expression information is displayed in association with the display position of the observation object, the state expression information is superimposed on the display position of the observation object. Of course, the display is not limited to the superimposed display as long as the correspondence between the object and the state expression information is clear.

  In each of the above-described embodiments, the optimum environment information is stored in the optimum environment state table T2, and the optimum growth state is stored in the optimum growth state table T6. An inappropriate state may be stored.

  Further, in each of the above-described embodiments, the state expression information (character) in the through image may be stored as a captured image. That is, the state expression information (character) may be synthesized in the through image, and the synthesized image may be recorded and stored.

  Moreover, in each embodiment mentioned above, although the irradiometer 24, the external temperature thermometer 25, the external air hygrometer 26, and the soil hygrometer 27 were provided in the observation apparatus 2, the soil moisture measuring device (illustrated) which detects soil moisture content is further shown. (Omitted) may be provided. In this case, the water amount may be directly measured by arranging an electrode slope on the outer peripheral surface of the lower end portion of the observation device 2. Furthermore, you may make it provide the measuring device which measures the pH (acidity) and ion content of soil in the hollow of the lower half part of the observation apparatus 2. FIG.

  Moreover, in each embodiment mentioned above, although the case where it applied to the portable terminal device 1 was shown, not only the portable terminal device 1 but PDA with a camera function, a digital camera, a music player, etc., Of course, The digital camera itself may be used.

  Further, the “apparatus” and “unit” shown in each of the above-described embodiments may be separated into a plurality of cases by function, and are not limited to a single case. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

As mentioned above, although several embodiment of this invention was described, this invention is not limited to this, The invention described in the claim and its equal range are included.
Hereinafter, the invention described in the claims of the present application will be appended.
(Appendix)
(Claim 1)
The invention described in claim 1
A mobile terminal device including an imaging unit that captures an observation object or its vicinity and a display unit that displays the captured image,
First acquisition means for acquiring an observation result of observing an observation object in the captured image when the observation object or its vicinity is imaged by the imaging unit;
Second acquisition means for acquiring state expression information representing the current state of the observation object according to the observation result of the observation object acquired by the first acquisition means;
Display control means for causing the display unit to display the state expression information acquired by the second acquisition means in association with the observation object in the captured image;
It is a portable terminal device provided with.
(Claim 2)
The invention according to claim 2 is the portable terminal device according to claim 1,
For each type of observation object, further comprising a state storage means for storing a specific state of the observation object,
The first acquisition means acquires the type of the observation object together with the observation result of the observation object,
The second acquisition means refers to the contents of the state storage means, compares a specific state according to the type of observation object acquired by the first acquisition means and the acquired observation result, According to the comparison result, obtain the state expression information that represents the current state of the observation object,
The portable terminal device according to claim 1, wherein the portable terminal device is configured as described above.
(Claim 3)
The invention according to claim 3 is the portable terminal device according to claim 1 or 2,
The observation object is an organism whose observation object is an organism,
The first acquisition means receives and acquires an observation result relating to growth observed by an environmental sensor provided on the organism side,
This is a portable terminal device that is characterized as described above.
(Claim 4)
The invention according to claim 4 is the portable terminal device according to claim 1 or 2,
The first acquisition means transmits a search signal for searching for the observation object by short-range communication, and receives and acquires the observation result transmitted from the observation object side in response thereto,
A portable terminal device characterized by being configured as described above.
(Claim 5)
The invention according to claim 5 is the portable terminal device according to claim 1 or 2,
The first obtaining means observes an observation object in the photographed image by analyzing the photographed image photographed by the imaging unit and obtains the observation result by image recognition.
This is a portable terminal device that is characterized as described above.
(Claim 6)
The invention according to claim 6 is the portable terminal device according to claim 1,
For each type of observation object, further comprising a state storage means for storing a specific state of the observation object,
The first obtaining means observes an observation object in the photographed image by analyzing the photographed image photographed by the imaging unit, obtains the type and the observation result by image recognition,
The second acquisition unit refers to the contents of the state storage unit, and compares the specific state according to the type of the observation object acquired by the first acquisition unit with the acquired observation result. In response, obtain state expression information that represents the current state of the observation object.
This is a portable terminal device that is characterized as described above.
(Claim 7)
The invention according to claim 7 is the portable terminal device according to any one of claims 1 to 6,
The second acquisition means acquires a predetermined picture as state expression information expressing the current state of the observation object.
This is a portable terminal device that is characterized as described above.
(Claim 8)
The invention according to claim 8 is the portable terminal device according to any one of claims 1 to 7,
The second acquisition means acquires state expression information expressing the current state of the observation object according to a change state from the past observation result of the observation object to the current observation result.
This is a portable terminal device that is characterized as described above.
(Claim 9)
The invention according to claim 9 is the portable terminal device according to any one of claims 1 to 8,
A determination means for determining whether the current state of the observation object according to the observation result of the observation object acquired by the first acquisition means is a specific state;
The display control means, when the current state of the observation object is determined to be a specific state by the determination means, performs a display that clearly indicates the specific state,
This is a portable terminal device that is characterized as described above.
(Claim 10)
The invention according to claim 10 is the portable terminal device according to any one of claims 1 to 9,
The display control means superimposes and displays the state expression information acquired by the second acquisition means on the position of the observation object in the captured image.
A portable terminal device characterized by that.
(Claim 11)
The invention according to claim 11
A mobile terminal device including an imaging unit that images an observation object and a display unit that displays the captured image,
State storage means for storing a specific state of the observation object;
When a plurality of observation objects are photographed by the imaging unit, a first acquisition unit that observes each observation object in the photographed image by analyzing the photographed image and obtains the observation result by image recognition When,
Whether the observation result acquired for each observation object by the first acquisition means is compared with a specific state in the state storage means, and is the specific state for each observation object according to the comparison result? Determining means for determining whether or not,
Second acquisition means for acquiring state expression information expressing that the observation object is in a specific state when the determination means determines that the observation object is in a specific state;
Display control means for causing the display unit to display the state expression information acquired by the second acquisition means in association with the observation object in the captured image;
A portable terminal device comprising:
(Claim 12)
The invention according to claim 12
An observation management system in which an observation device including an observation unit for observing an observation target and a portable terminal device including an imaging unit and a display unit are connected by communication,
The observation device is
In response to a search signal for searching for an observation object from a mobile terminal device, the transmitter comprises a transmission means for transmitting observation results observed by the observation unit by short-range communication,
The portable terminal device
When the observation object is photographed by the imaging unit, a search signal for searching for the observation object is transmitted, and in response to the observation result of the observation object transmitted from the observation device on the observation object side in response thereto, Receiving means for receiving and acquiring by distance communication;
Obtaining means for obtaining state expression information representing the current state of the observation object according to the observation result of the observation object received by the receiving means;
Display control means for displaying the state expression information acquired by the acquisition means on the display unit in association with the observation object in the captured image;
Prepared,
It is an observation management system characterized by this.
(Claim 13)
The invention according to claim 13 is the observation management system according to claim 12,
The observation apparatus has a handle that is formed so that the entire casing forms a tapered rod body and protrudes from one side of the upper part,
The handle is formed at a position where the housing can be pierced while pressing the upper end surface of the housing with the belly portion of the thumb with the index finger hung from the lower side of the handle.
This is an observation management system characterized by doing so.
(Claim 14)
The invention according to claim 14
Against the computer,
A function of acquiring an observation result of the observation object in the captured image from the observation object side when the observation object or its vicinity is photographed by the imaging unit;
A function of acquiring state expression information expressing the current state of the observation object according to the observation result of the acquired observation object;
A function of displaying the acquired state expression information on a display unit in association with an observation object in the captured image;
It is a program for realizing.
(Claim 15)
The invention according to claim 15 is:
Against the computer,
When a plurality of observation objects are photographed by the imaging unit, a function of observing each observation object in the photographed image by analyzing the photographed image and acquiring the observation result by image recognition;
In a state where a specific state of the observation object is stored, the observation result acquired for each observation object is compared with the specific state of the observation object, and the observation object is determined according to the comparison result. A function to determine whether or not a specific state every time,
When it is determined that the specific state, the function of obtaining state expression information expressing that the observation target is in a specific state;
A function of displaying the acquired state expression information on the display unit in association with an observation object in the captured image;
A program to realize

1 Mobile terminal device 2 Observation device 11, 21 CPU
DESCRIPTION OF SYMBOLS 13, 23 Memory | storage part 15 Imaging part 16 Display part 17 Operation part 18, 29 Short-distance communication part 24 Sunlight meter 25 Outside air thermometer 26 Outside air humidity meter 27 Soil hygrometer 28 Clock part T1 Observation result table T2 Optimum environmental state table T3 character Table T4 Observation data memory T5 Object ID memory T6 Optimal growth state table T7 Plant species table

Claims (6)

The lower end portion includes a tapered rod body portion, and a handle portion formed to project laterally with respect to the rod body portion,
The handle portion is provided so that the rod body portion can be inserted into the soil while pressing the rod body portion from above with the belly portion of the thumb while the index finger is hung on the handle portion from below. An observation device characterized in that   The observation apparatus according to claim 1, further comprising a transmission unit that transmits the observation result to the mobile terminal apparatus by wireless communication.   The observation apparatus according to claim 1, wherein the tip portion is configured as means for measuring soil moisture.   The observation apparatus according to any one of claims 1 to 3, wherein a sunshine meter and a thermometer are provided on an upper portion of the observation apparatus. An observation management system in which a mobile terminal device can be connected to an observation device for observing an observation object,
The observation apparatus has a rod body portion with a tapered tip on the lower side, and a handle portion formed to project laterally with respect to the rod body portion,
The handle portion is provided so that the rod body portion can be inserted into the soil while pressing the rod body portion from above with the belly portion of the thumb while the index finger is hung on the handle portion from below. An observation management system characterized by   The observation management system according to claim 5, wherein the observation device includes a transmission unit that transmits an observation result to the mobile terminal device by wireless communication.

Images