JP2022161907A - Information processing system, information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system, method, and program that enable submission of an image with simple processing.

SOLUTION: The present system is an information processing system that processes an image, and comprises: acquisition means that acquires identification information for identifying one or more imaging objects; and transmission means that transmits, to a management device, images of the one or more imaging objects picked up according to predetermined imaging order in association with the identification information.

SELECTED DRAWING: Figure 6

COPYRIGHT: (C)2023,JPO&INPIT

Description

The present invention relates to an information processing system for processing images, an information processing method, and a program for causing a computer to execute information processing.

Examples of an environment including one or more imaging targets include a real estate property having one or more partitioned rooms, a work environment such as construction work having one or more work processes, and the like. In introducing this real estate property, if there are images of each room, it will be easier for people to understand what kind of property it is. In addition, by saving images in each work process, the worker can check the work status later.

In view of this, a work situation management system has been proposed in which a work scene is photographed for each work process according to a photographing plan (see, for example, Japanese Unexamined Patent Application Publication No. 2002-100003). In this system, the scene identification information generated based on the process information is sent from the PC to the digital camera, the scene identification information is added to the captured image taken by the digital camera, and sent to the PC. The images are classified and managed according to the classification system of the shooting plan.

However, in the above technique, since it is necessary to generate the scene identification information based on the process information, there is a problem that the processing for posting the image becomes complicated.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an information processing system, an information processing method, and a program capable of realizing image posting with simple processing.

In order to solve the above-described problems, in one embodiment of the invention, an information processing system for processing an image includes acquisition means for acquiring identification information for identifying one or more imaging targets; and transmission means for associating one or more images of an imaging target imaged according to the above with identification information and transmitting the images to a management device.

According to the present invention, posting of an image can be realized with a simple process.

The figure which showed the structural example of an information processing system. FIG. 2 is a diagram exemplifying the hardware configuration of an information processing device included in the information processing system; FIG. 2 is a cross-sectional view of an omnidirectional camera as an imaging device; The figure which illustrated the hardware constitutions of the omnidirectional camera. The figure which illustrated the hardware constitutions of the management apparatus. The figure which illustrated the functional structure of the information processing apparatus. FIG. 2 is a diagram exemplifying the functional configurations of an imaging device and a management device; The figure which illustrated the screen for creating user identification information displayed in a management apparatus. The figure which illustrated the login screen. 4 is a flowchart showing the flow of overall processing executed by an information processing apparatus; FIG. 4 is a diagram for explaining a first method of acquiring a property ID; The figure explaining the 2nd method of acquiring property ID. The figure explaining the 3rd method of acquiring property ID. 4 is a flowchart showing the flow of processing for acquiring an image; FIG. 10 is a view exemplifying a screen displayed on the information processing apparatus in processing for acquiring an image; The figure which illustrated the screen displayed when the image is already registered. The figure which illustrated the preview image. The figure which illustrated the confirmation screen of an image. 4 is a flow chart showing the flow of processing for acquiring an image with changes in imaging conditions. 4A and 4B are diagrams for explaining a method of changing imaging conditions; FIG. 4 is a flowchart showing the flow of processing for acquiring an image with area change. The figure which illustrated the screen displayed when upload succeeds. The figure which illustrated one screen displayed on a communication terminal. FIG. 5 is a diagram for explaining a method of editing a registered image; The figure which illustrated another screen displayed on a communication terminal. 4 is a sequence diagram of processing executed in the information processing system; FIG. The figure which illustrated the screen which an administrator edits a list.

FIG. 1 is a diagram showing a configuration example of an information processing system. The information processing system includes an information processing device 10 used by a user (user). The information processing system may include only the information processing device 10 . The information processing system may also be configured to include the information processing device 10 , the imaging device 11 , the management device 12 , and the information providing system 13 . Note that the information processing system may include the information processing device 10 and one or two of the imaging device 11 , the management device 12 and the information providing system 13 .

The information processing device 10 and the communication terminal 14 are a PC, a tablet terminal, a smart phone, a PDA (Personal Digital Assistant), or the like. The information processing device 10 and the communication terminal 14 are devices having communication functions, information input/output functions, and display functions. The imaging device 11 is a device that images an object to be imaged. The management device 12 is a device that stores and manages captured images. The information providing system 13 is a server or the like that provides information.

A network 15 connects various devices via a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, or the like. The network 15 may be a wired network or a wireless network such as Wi-Fi. Moreover, the network 15 is not limited to one network, and may be composed of two or more networks connected by relay devices such as routers and proxy servers. Note that the network 15 may be connected to devices other than various devices and information processing systems.

An information processing system can be used as a system that provides information on a real estate property as an environment including one or more imaging targets, a system that manages work processes such as construction work, and the like. Hereinafter, the information processing system will be described as a system that provides information on real estate properties.

Examples of real estate properties include new, second-hand, and rental single-family homes, condominiums, apartment complexes, stores, offices, warehouses, factories, office buildings, commercial facilities, parking lots, and the like. Here, the real estate property is assumed to be a property such as an apartment having one or more rooms as imaging targets.

The information providing system 13 stores and manages information on a plurality of properties in order to provide information on properties managed by a real estate company. Property information includes information such as sales price, rent, price including land price, address, building structure, exclusive area, number of floors, facilities, presence or absence of a parking lot, etc., and includes floor plans and exterior photographs.

For example, a case where a borrower as a user searches for a rental condominium as a real estate property will be described. The borrower operates the communication terminal 14 to input information necessary for searching for real estate properties. Information is transmitted to the communication terminal 14 by accessing the information providing system 13 via the network 15 . The information providing system 13 searches for information on a plurality of properties managed by the information providing system 13 based on the information transmitted from the communication terminal 14 . Information about the property desired by the borrower is transmitted to the communication terminal 14 via the network 15 . The communication terminal 14 receives the property information and displays it on the screen.

The borrower looks at the property information displayed on the screen of the communication terminal 14 and judges whether the property is what he wants. If it is not the desired property, the borrower changes the input information, causes the information providing system 13 to search again, and causes the communication terminal 14 to display information on another property. In this way, the borrower can search for a desired property.

By viewing the displayed information, the borrower can know in detail what kind of property the property is based on the images of each room without having to go to the site where the property is actually located. Therefore, it is desirable that the property information includes an image of the room of the property.

In order to realize this, the person in charge of the real estate company carries the imaging device 11, goes to the target property, and takes an image of each room. When the person in charge posts the captured image to the information providing system 13, the captured image is added as the property information.

However, when posting an image to the information providing system 13, since the floor plan differs for each property, it takes time and effort for the person in charge. For example, since the number of images to be captured differs for each property, it takes time and effort to associate the property with the captured images. In addition, it takes time and effort to associate the information of each room such as a living room and a bedroom with the captured image.

Furthermore, images have a larger data size than characters and figures. Therefore, if images of one or more rooms are posted for each property, the storage area of the storage device included in the information providing system 13 will run out, making posting impossible. Therefore, a new storage device must be added or replaced with a large-capacity storage device. However, in either case, the system needs to be reconstructed.

In view of this, in the information processing system, the information processing apparatus 10 is used to achieve posting of images through simple processing. In addition, by providing the management device 12 separately from the information providing system 13 and allowing the management device 12 to store and manage the captured images, the information providing system 13 does not need to be reconstructed.

Specifically, a person in charge as a user uses the information processing device 10 to access the information providing system 13 via the network 15 . Then, in order to identify the property managed by the information providing system 13, the information processing apparatus 10 acquires the property ID as identification information for identifying one or more imaging targets. The property ID is a property management number or the like assigned to each property.

The person in charge inputs the acquired property ID to the information processing apparatus 10, and also inputs the floor plan information of the property as position information indicating the position information of one or more imaging targets. The floor plan information is information representing the number and types of rooms such as 2DK, 2LDK, 3DK, and 3LDK. By the way, the number 3 in 3LDK represents the number of rooms that can be used as bedrooms, L is the living room, D is the dining room, and K is the kitchen.

The information processing apparatus 10 identifies the rooms based on the input floor plan information, and determines the order of imaging the identified rooms based on preset order information. As the ranking information, it is possible to employ information ranked from a questionnaire about rooms that ordinary people want to see first. However, since this is an example, information obtained by other methods may also be used.

The information processing apparatus 10 informs the person in charge of the room to be imaged by displaying the imaging order on the screen. Then, the information processing device 10 displays on the screen the position where the imaging device 11 is installed in the room. The person in charge moves to the room displayed on the screen and installs the imaging device 11 at the displayed position. Furthermore, the person in charge requests the information processing device 10 to take an image, and the information processing device 10 instructs the image pickup device 11 to take an image.

The information processing device 10 receives an image captured by the imaging device 11 as image data and temporarily stores the image data. Although image data is transmitted and received between devices, it will be simply described as an image below.

The information processing device 10 receives images captured from the imaging device 11 for all rooms corresponding to the floor plan information. After that, the information processing device 10 associates the image with the property ID and transmits the image to the management device 12 to post the image. For example, it is possible to generate a folder with the property ID as the folder name, store the images in the folder in the order in which they were captured, and transmit the images for each folder. Thereby, the management device 12 can save and manage the folder as it is.

The information providing system 13 acquires the information of the communication terminal 14 possessed by the borrower from the communication terminal 14 when the information on the property is requested by the borrower. The information providing system 13 then transmits the property ID of the requested property and the information of the communication terminal 14 to the management device 12 . The information providing system 13 provides the communication terminal 14 with information on the property corresponding to the property ID, and the management device 12 transmits a plurality of images associated with the property ID to the communication terminal 14 .

The communication terminal 14 receives the property information provided from the information providing system 13 and displays it on the screen. In addition, the communication terminal 14 displays a plurality of images received from the management device 12 at preset screen positions. For the plurality of images, for example, the first image in the imaging order can be set as an image of a predetermined size, and a reduced image (thumbnail image) of all the images can be superimposed on a part of the first image and displayed. . As a result, the borrower can refer to the first image, select a thumbnail image of another room, and display it enlarged to a predetermined size in order to check the state of the other room. The renter can obtain detailed information about the displayed room, such as the color of the walls, the size and position of windows, the type of light, the position of outlets, and the like.

The information processing device 10 , the management device 12 , and the information providing system 13 are connected by a network 15 and can communicate via the network 15 . The imaging device 11 may also be connected to the network 15 and communicate with the information processing device 10 via the network 15, but in FIG. 1, it communicates directly with the information processing device 10 by wireless connection.

The information processing device 10 can be possessed or moved by the person in charge, communicates with the imaging device 11, the management device 12, and the information providing system 13, receives information from the person in charge, and has a function of displaying a captured image. Any device may be used.

As the imaging device 11, a digital camera, a notebook PC with a camera, a tablet terminal with a camera, a smartphone with a camera, an omnidirectional camera, or the like can be used. Note that the omnidirectional camera is a camera that can capture an image in all directions of 360° around the camera at once. If an image of each room is to be captured from corner to corner with an ordinary camera, the angle of the camera must be changed to capture images, and the number of images increases, making management difficult. However, since the omnidirectional camera only takes one image for each room and only one image, the imaging device 11 is preferably an omnidirectional camera.

The management device 12 includes a storage device having a storage capacity sufficient to store images of all rooms of all properties managed by the information providing system 13 .

The hardware configuration of the information processing device 10 included in the information processing system will be described with reference to FIG. The information processing apparatus 10 includes, as hardware, a CPU (Central Processing Unit) 20, a ROM (Read Only Memory) 21, a RAM (Random Access Memory) 22, a flash memory 23, a connection I/F 24, an operation panel 25, a camera 26, It is configured including a communication I/F 27 . The CPU 20 , ROM 21 , RAM 22 , flash memory 23 , connection I/F 24 and communication I/F 27 are connected to a bus 28 and exchange information with each other via the bus 28 .

The CPU 20 is computing means and controls the information processing apparatus 10 as a whole. The ROM 21 is a read-only non-volatile storage medium, and stores a boot program, firmware, and the like for starting the information processing apparatus 10 . The RAM 22 is a volatile storage medium from which information can be read and written at high speed, and is used as a working area when the CPU 20 processes information. The flash memory 23 is a non-volatile storage medium from which information can be read and written, and stores an OS (Operating System), various applications, programs for executing processing, and the like. Here, the flash memory 23 is used as a non-volatile storage medium, but it is not limited to this, and an HDD (Hard Disk Drive) may be used.

The connection I/F 24 connects the operation panel 25 and the camera 26 to the bus 28 and controls input of information from the operation panel 25 , display of information on the operation panel 25 , and input of images from the camera 26 . The operation panel 25 has a touch panel, receives input of information, and displays information. Although the operation panel 25 is employed here, it is not limited to this, and may be configured to include an input device and a display device and be connected to the bus 28 via an input/output I/F. The camera 26 has a solid-state imaging device, like the imaging device 11, converts received light into electrical signals, and outputs the electrical signals as image data.

The communication I/F 27 connects to the imaging device 11, the management device 12, and the information providing system 13 via the network 15 by wire or wirelessly, and controls communication between these devices and systems. Although the communication is performed via the network 15 here, the communication is not limited to this, and direct communication may be performed. When communicating wirelessly, Wi-Fi or the like defined by the IEEE802.11 standard can be used for communication.

The information processing apparatus 10 may include other hardware, for example, an SD card slot for mounting an external storage medium such as an SD card or a USB (Universal Serial Bus) memory, or an external storage I/F such as a USB connector. be prepared. The information processing apparatus 10 can also include an imaging device such as a camera, an audio input device such as a microphone, an audio output device such as a speaker, a GPS (Global Positioning System), various sensors, and the like.

The hardware configuration of the imaging device 11 included in the information processing system will be described with reference to FIGS. 3 and 4. FIG. The imaging device 11 may be a digital camera or the like, but here, an omnidirectional camera will be described. FIG. 3 is a sectional view of the omnidirectional camera showing the main hardware configuration, and FIG. 4 shows the detailed hardware configuration.

Referring to FIG. 3 , the imaging apparatus 11 includes, as main hardware, an imaging body 30 , a housing 31 that holds the imaging body 30 and parts such as a controller and a battery, and a shutter button 32 provided in the housing 31 . and The imaging body 30 includes two imaging optical systems 33A and 33B, and two solid-state imaging devices 34A and 34B such as CCD (Charge Coupled Device) sensors and CMOS (Complementary Metal Oxide Semiconductor) sensors. Each of the two imaging optical systems 33A and 33B is configured, for example, as a 6-group 7-element fisheye lens, and the fisheye lens has an angle of view greater than 180°. Here, what is configured by combining one solid-state imaging device and one imaging optical system is called an imaging optical system.

The two imaging optical systems 33A, 33B have optical elements such as lenses, prisms, filters, aperture stops, etc., and are positioned relative to the two solid-state imaging devices 34A, 34B. Positioning is performed so that the optical axes of the optical elements of the two imaging optical systems 33A and 33B are positioned perpendicular to the centers of the light receiving areas of the corresponding two solid-state imaging devices 34A and 34B, and that the light receiving areas are , to the image plane of the corresponding fisheye lens. Each of the two solid-state imaging devices 34A and 34B is a two-dimensional solid-state imaging device with a light receiving region forming an area, and converts light collected by the two combined imaging optical systems 33A and 33B into image signals. do.

The two imaging optical systems 33A and 33B have the same specifications and are combined in opposite directions so that their optical axes are aligned. Two image signals converted by the two solid-state imaging devices 34A and 34B are output to image processing means on the controller. The image processing means joins two partial images in the two image signals to generate an image with a solid angle of 4π steradian (omnidirectional image). Here, an omnidirectional image, which is an image captured in all directions, is generated, but a panoramic image, which is an image captured horizontally at 360°, may be generated.

Since the imaging device 11 has a fisheye lens with an angle of view larger than 180°, each imaging optical system has an overlapping portion. Therefore, when generating an omnidirectional image, the overlapping portion of the two image signals is used as reference data for image stitching as reference data representing the same image. Note that the omnidirectional image may be generated by the imaging device 11 or by the information processing device 10 . For example, all the processing by the image processing means of the imaging device 11 may be performed by the imaging device 11, or all or part of the processing by the image processing means of the imaging device 11 may be performed by the information processing device 10. Signals and the like may be transferred.

The omnidirectional image can be displayed, for example, on a screen provided in the imaging device 11 or on a screen of the information processing device 10 connected to the imaging device 11, output to a printing device and printed out, or stored in an external device such as an SD card. It can be stored as data in a storage medium or the like.

Referring to FIG. 4, imaging device 11 specifically includes processor 40 , lens barrel unit 41 , and various components connected to processor 40 . The lens barrel unit 41 includes two imaging optical systems 33A, 33B and two solid-state imaging devices 34A, 34B. The two solid-state imaging devices 34A and 34B are controlled by control commands from the processor 40. FIG.

Various components include SDRAMs 42 and 43 for temporarily storing data, a memory card slot 44 for loading a memory card, a flash ROM 45, a USB connector 46, and a power switch 47. Various components include a speaker 48 as an audio output device, a microphone 49 as an audio input device, a wireless NIC (Network Interface Card) 50 used for connecting to the network 15 by wireless communication, an LCD (Liquid Crystal Display) A monitor 51, a three-axis acceleration sensor 52, and the like are included. Since these are examples, other components may be included.

The processor 40 includes ISPs (Image Signal Processors) 60 A and 60 B, a DMAC (Direct Memory Access Controller) 61 , an arbiter (ARBMEMC) 62 , a MEMC (Memory Controller) 63 and a distortion correction/image composition block 64 . The ISPs 60A and 60B perform white balance setting and gamma setting on images input through the signal processing of the solid-state imaging devices 34A and 34B. The DMAC 61 directly transfers data from the ISPs 60A and 60B and the distortion correction/image synthesis block 64 to the ARBMEMC 62 and from the ARBMEMC 62 to the distortion correction/image synthesis block 64 without going through the CPU. ARBMEMC 62 arbitrates access to memory such as SDRAM 42 . The MEMC 63 controls that memory access.

A distortion correction/image synthesizing block 64 uses information from the triaxial acceleration sensor 52 for two captured images obtained from the two imaging optical systems to perform distortion correction, top-bottom correction, and image synthesis. do. The SDRAM 42 is used to temporarily store data when the ISPs 60A, 60B and the distortion correction/image synthesizing block 64 perform processing.

Processor 40 further includes DMAC 65 , image processing block 66 , CPU 67 , image data transfer section 68 , SDRAMC (SDRAM Controller) 69 , memory card control block 70 , USB block 71 and peripheral block 72 . Processor 40 also includes audio unit 73 , serial block 74 , LCD driver 75 and bridge 76 . DMAC 65 transfers data directly from ARBMEMC 62 to image processing block 66 without going through CPU 67 .

The image processing block 66 uses a resize block 77, a JPEG (Joint Photographic Experts Group) block 78, an H.264 block 79, etc. to perform various image processing on the image. The resizing block 77 enlarges or reduces the size of the image by interpolation processing. JPEG block 78 performs JPEG compression and decompression. The H.264 block 79 compresses and decompresses moving images such as H.264. The CPU 67 controls the operation of each section of the imaging device 11 .

The image data transfer section 68 transfers the image processed by the image processing block 66 . The SDRAMC 69 controls the SDRAM 43 connected to the processor 40 and sends the image transferred from the image data transfer section 68 to the SDRAM 43 . The SDRAM 43 is used to temporarily store data when performing various processes within the processor 40 .

The memory card control block 70 controls reading and writing with respect to the memory card inserted in the memory card slot 44 and the flash ROM 45 . The USB block 71 controls USB communication with an external device such as a PC connected via the USB connector 46 . The power switch 47 is connected to the peripheral block 72 . The audio unit 73 is connected to the speaker 48 and the microphone 49 and controls input/output of audio. A serial block 74 controls serial communication with an external device such as a PC, and is connected to the wireless NIC 50 . The LCD driver 75 is a drive circuit for driving the LCD monitor 51 and converts it into signals for displaying various states on the LCD monitor 51 .

The flash ROM 45 stores a control program written in code that the CPU 67 can read and various parameters. When the user operates the power switch 47 to turn on the power, the control program stored in the flash ROM 45 is loaded into the main memory. The CPU 67 executes the control program loaded into the main memory, controls the operation of each unit of the imaging device 11, and temporarily stores data necessary for control in the SDRAM 43 and local SRAM.

Next, a hardware configuration of the management device 12 will be described with reference to FIG. Note that the hardware configuration of the information providing server that constitutes the information providing system 13 is the same as that of the management device 12, so the description of the information providing system 13 will be omitted. The management device 12 includes a CPU 80, a ROM 81, a RAM 82, a HDD (Hard Disk Drive) 83, and a communication I/F 84 as hardware. The CPU 80 , ROM 81 , RAM 82 , HDD 83 and communication I/F 84 are connected to a bus 85 and exchange information with each other via the bus 85 .

The CPU 80 is computing means and controls the entire management device 12 . The ROM 81 is a read-only non-volatile storage medium that stores a boot program, firmware, and the like for starting the management device 12 . The RAM 82 is a volatile storage medium from which information can be read and written at high speed, and is used as a work area when the CPU 80 processes information. The HDD 83 is a non-volatile storage medium from which information can be read and written, and stores an OS, various programs, and the like. Here, the HDD 83 is used as a non-volatile storage medium, but the storage medium is not limited to this, and an SSD (Solid State Drive) or the like may be used.

The communication I/F 84 is wired or wirelessly connected to the information processing device 10, the imaging device 11, and the information providing system 13 via the network 15, and controls communication between these devices and systems. Although the communication is performed via the network 15 here, the communication is not limited to this, and direct communication may be performed. When communicating wirelessly, Wi-Fi or the like defined by the IEEE802.11 standard can be used for communication.

The management device 12 may also include other hardware, for example, an SD card slot for attaching an external storage medium such as an SD card or USB (Universal Serial Bus) memory, and an external storage I/F such as a USB connector. be able to. The management device 12 can also include a voice input device such as a microphone, a voice output device such as a speaker, a GPS (Global Positioning System), and the like.

A functional configuration of the information processing apparatus 10 will be described with reference to FIG. The information processing apparatus 10 can be said to have the following functional units because the CPU 20 reads out the program stored in the flash memory 23 into the RAM 22 and executes the following functional units. Here, each functional unit is described as being generated by executing a program, but some or all of the multiple functional units may be realized by hardware such as a dedicated circuit instead of software such as a program. .

The information processing apparatus 10 includes an acquisition unit 90, a control unit 91, a reception unit 92, a transmission unit 93, a display unit 94, an input reception unit 95, and a storage unit 96 as functional units. The acquisition unit 90 acquires a property ID for identifying a property including one or more rooms to be imaged, and floor plan information, for example, from input information input by a person in charge. The acquisition unit 90 can acquire the property ID from the information providing system 13 by the information processing device 10 communicating with the information providing system 13 . The acquisition unit 90 can also capture and read printed matter printed by the person in charge with an imaging device provided in the information processing apparatus 10, and acquire the property ID from information included in the read printed matter. Alternatively, the person in charge can acquire the property ID by reading the information displayed on the screen of a terminal different from the information processing device 10 . Furthermore, the acquisition unit 90 can also acquire the property ID that the person in charge has input to the operation panel 25 of the information processing device 10 .

The control unit 91 determines the imaging order of the room specified by the floor plan information acquired by the acquisition unit 90 based on preset order information of imaging targets. In the ranking information, the information of the rooms and the ranking are associated with each other. 1st "Bed Room 2", 5th "Bed Room 3", 6th "Bed Room 4", 7th "Kitchen", 8th "Bathroom" Room)”, 9th place “Entrance”, etc. The storage unit 96 stores ranking information of imaging targets. For example, if the floor plan information is 3LDK, there are only 3 bedrooms, so the 1st to 5th places are taken in the preset order, and the 6th place "Bed Room 4" is skipped. Determine the imaging order followed by 7th to 9th and so on. The control unit 91 then instructs the display unit 94 to display the imaging order determined by the control unit 91 . The display unit 94 receives the instruction and displays the imaging order.

The person in charge sees the order of imaging displayed on the display unit 94, and moves to the room of the first order if it is the first imaging, and moves to the room of the second order if it is the second imaging.

The input accepting unit 95 accepts an acquisition request for information on the installation position of the imaging device 11 from the person in charge, and the control unit 91 instructs the display unit 94 to display the information on the installation position of the imaging device 11 . The display unit 94 receives an instruction from the control unit 91 and displays installation position information such as "Please install in the center of the living room and take a picture".

After installing the imaging device 11 according to the displayed installation position information, the person in charge touches or otherwise presses the imaging button displayed on the operation panel 25 of the information processing device 10 to request imaging. The input reception unit 95 receives the request, and the control unit 91 instructs the imaging device 11 to take an image. The input reception unit 95 can also receive changes in imaging conditions such as brightness from the person in charge. When the input reception unit 95 receives the change, the control unit 91 instructs the change of the imaging condition.

Note that the person in charge may remotely instruct the imaging device 11 from the information processing device 10 to request imaging or the like, or may directly press the shutter button 32 or the like provided in the imaging device 11 .

The receiving unit 92 receives an image captured by the imaging device 11 . The storage unit 96 temporarily stores the image received by the receiving unit 92 . The display unit 94 displays the image received by the reception unit 92 as a preview image before being transmitted to the management device 12 and registered. The person in charge looks at the preview image and determines whether the image should be sent to the management device 12 or whether the image should be retaken, and the input reception unit 95 receives the judgment result as an input.

The control unit 91 instructs the imaging device 11 to perform imaging again according to the result received by the input receiving unit 95 . In addition, the control unit 91 instructs the transmission unit 93 to transmit the captured image to the management device 12 in response to the fact that all the images have been captured. Upon receiving an image transmission instruction, the transmission unit 93 associates the property ID acquired by the acquisition unit 90 with the captured images, and transmits these images to the management device 12 .

Functional configurations of the imaging device 11 and the management device 12 will be described with reference to FIG. Similar to the information processing apparatus 10, the imaging apparatus 11 and the management apparatus 12 also include the following functional units because the CPU reads and executes programs stored in the flash ROM or HDD to generate the following functional units. It can be said that Here, each functional unit is described as being generated by executing a program, but some or all of the multiple functional units may be realized by hardware such as a dedicated circuit instead of software such as a program. .

The imaging device 11 includes, as functional units, a receiving unit 100, a control unit 101, an imaging unit 102, an image processing unit 103, and a transmitting unit 104, as shown in FIG. 7A. The receiving unit 100 receives an imaging instruction from the information processing device 10 . The receiving unit 100 receives an imaging instruction as well as an imaging condition change instruction. Upon receiving the image capturing instruction, the control unit 101 instructs the image capturing unit 102 to perform image capturing. In addition, the control unit 101 changes the brightness setting value (EV value) and the like set in the imaging unit 102 in response to changes in the imaging conditions. The EV value is a numerical value that indicates the brightness of the exposure.

In response to an instruction from the control unit 101, the imaging unit 102 images the room to be imaged according to the set setting values, and outputs two captured images. The control unit 101 instructs the image processing unit 103 to perform image processing on the two output captured images. The image processing unit 103 receives the two captured images output from the imaging unit 102, joins the two captured images, generates an omnidirectional image, and outputs it as omnidirectional image data. What is transmitted from the imaging device 11 to the information processing device 10 is omnidirectional image data, which is also simply described as an omnidirectional image.

The control unit 101 instructs the transmission unit 104 to transmit the output omnidirectional image to the information processing apparatus 10 . The transmission unit 104 receives an instruction from the control unit 101 and transmits the omnidirectional image to the information processing apparatus 10 .

The management device 12 includes a receiver 110, a controller 111, a storage 112, and a transmitter 113, as shown in FIG. 7B. The receiving unit 110 receives an image associated with a property ID from the information processing device 10 . The receiving unit 110 also receives an image transmission request, the property ID, and information on the communication terminal 14 from the information providing system 13 .

The control unit 111 stores the image received by the receiving unit 110 in the storage unit 112, and manages the image by the property ID associated with the image. In addition, upon receiving the transmission request received by the receiving unit 110, the control unit 111 searches for a corresponding image from the plurality of images stored in the storage unit 112 based on the property ID. Then, the control unit 111 instructs the information providing system 13 to transmit the searched image to the communication terminal 14 that requested the information on the property corresponding to the property ID.

Upon receiving an instruction from the control unit 111 , the transmission unit 113 transmits the image retrieved by the control unit 111 to the communication terminal 14 based on the information of the communication terminal 14 received by the reception unit 110 .

The communication terminal 14 displays the image received from the management device 12 together with the property information requested from the information providing system 13 . The lessee can refer to the property information to check the rent, management fee, floor plan, address, facilities, etc., as well as the actual wall color, door, window, outlet position, etc. by referring to the image. can be confirmed.

In order to use the information processing system safely, the system administrator issues a user ID and password as user identification information to the person in charge. The person in charge enters the issued user ID and password, and if the user authentication is successful, the system can be used.

FIG. 8 is a diagram exemplifying a screen for creating user identification information displayed on the management device 12. As shown in FIG. After logging in to the management device 12 from a PC with management authority, the administrator enters numbers, alphanumeric characters, etc. that make up the user ID in the user name field 120, and configures a password in the password field 121. Enter numbers and alphanumeric characters. The screen has an automatic generation button 122. By pressing the automatic generation button 122, a user ID and a password are generated and registered.

Alternatively, when the administrator first presses the automatic generation button 122, the management device 12 may automatically assign numbers, alphanumeric characters, etc., issue a user ID and password, and register them. Furthermore, a request for issuing a user ID and a password may be transmitted to the management device 12 by the person in charge accessing the management device 12 from the information processing device 10 .

The screen may have only fields for entering a user name and password, but it is also possible to provide a field 123 for authority for operations such as "refer", "edit", and "delete" images. If the authority of "reference" is set to "yes", the person in charge can acquire the already registered image from the management device 12 and display it on the information processing device 10 owned by him/herself.

Even if the authority "Yes" can be set to "Yes" only for the image of the property that the person in charge is in charge of, or "Yes" for all images good. Information about authority can be stored and managed in the storage unit 112 included in the management device 12 .

The administrator notifies the relevant person in charge of the user identification information created on the screen. The notification of the user identification information may be given orally, printed on paper for distribution, or sent via the network 15 by e-mail or the like. Since the user identification information is confidential information, when it is notified by e-mail or the like via the network 15, it can be transmitted after being encrypted. Any encryption method may be adopted as the encryption method, and any encryption algorithm may be used as the encryption algorithm used at that time.

Next, a method for a person in charge to log in to the management device 12 using user identification information will be described. FIG. 9 is a diagram exemplifying a login screen.

The person in charge inputs and registers the user identification information in advance in the information processing apparatus 10 that he/she uses. With this registration, the person in charge can log in by simply pressing the login button 124 on the login screen without entering user identification information each time. Note that this login is for performing processing for registering images captured by the imaging device 11 in the management device 12 .

Next, an outline of processing executed by the information processing apparatus 10 after login will be described with reference to FIG. 10 . When the person in charge presses the login button 124 and the login is successful, the process starts from step 1000 . At step 1005, the information processing apparatus 10 accesses the information providing system 13 to search for the target property. Then, the information processing device 10 acquires the property ID of the property from the information providing system 13 . Here, after acquiring the property ID, the information processing device 10 may inquire of the management device 12 whether an image with the same property ID has already been registered and captured. Furthermore, at the same time as acquiring the property ID, the information processing apparatus 10 may acquire information on the floor plan of the property. The floor plan information may be input by the person in charge, or several pieces of floor plan information may be prepared in advance and the person in charge may select the corresponding floor plan information from among them.

In step 1010, the information processing apparatus 10 determines the imaging order of the room to be imaged by the imaging device 11, and displays the imaging order. Since the person in charge performs imaging according to the imaging order, the person in charge moves to the room designated by the imaging order and installs the imaging device 11 . Communication is established between the information processing device 10 and the imaging device 11, and the person in charge requests the information processing device 10 to take an image, and the information processing device 10 instructs the imaging device 11 to take an image. Imaging is performed. Note that the person in charge may directly press the shutter button 32 or the like provided in the imaging device 11 .

At step 1015 , the information processing apparatus 10 acquires an image captured by the imaging device 11 . At step 1020 , the property ID acquired by the information processing apparatus 10 at step 1005 is associated with the image acquired by the information processing apparatus 10 at step 1015 and transmitted to the management apparatus 12 . Then, at step 1025, the process ends.

Three methods of obtaining a property ID, such as step 1005 of FIG. 10, will be described with reference to FIGS. 11-13. A first method for acquiring a property ID will be described with reference to FIG. The first method is to output the property information held by the information providing system 13 to paper or a terminal, read the target property information from the output property information by the information processing device 10, and It is a method of acquiring the property ID from inside.

FIG. 11(a) is a diagram showing an example of output property information, and FIG. 11(b) is a diagram for explaining a method of reading a code indicating information on a target property by the information processing apparatus 10. As shown in FIG. Referring to FIG. 11(a), the property information includes the property name, address, property ID, floor plan type, which is information on the floor plan, and a barcode including at least the property ID and the floor plan type. Furthermore, the camera 26 functioning as the imaging unit of the information processing device 10 captures an image of the barcode of the target property, and the acquisition unit 90 analyzes the pattern from the captured barcode image to obtain the property ID and floor plan type. can be extracted. Then, the information processing apparatus 10 displays the property ID and the floor plan type shown in FIG. 11(b) on the screen. In addition, the information processing apparatus 10 may be provided with an analysis unit separately in order to analyze the barcode. Also, the code indicating the property information is not limited to the bar code, and the property information may be read from a two-dimensional code such as a QR code (registered trademark).

The barcode may include the property ID, floor plan type, and address information. By including the address information, it is possible to confirm whether or not the property is the target property. In place of the address information, information obtained by converting the address information into latitude and longitude may be included. By converting to latitude and longitude, the amount of information can be reduced compared to address information.

By pressing the image capturing button 125 on the screen of the information processing apparatus 10 to activate the camera 26 and capture an image of the barcode, the information contained in the barcode can be read.

A smartphone that can be used as the information processing device 10 may have a GPS function. In this case, it is possible to confirm whether the property is the target by checking whether the latitude and longitude information measured by the GPS function matches the latitude and longitude information obtained from the barcode. Since it is rare for the latitude and longitude information to match perfectly, an error range is provided.

If outside the error range, a warning (alert) can be issued. The alert can be issued as a warning display on the screen of the information processing device 10, or can be issued as a warning sound. If it is out of the error range, it is often an input error, so an alert can be issued to prevent input errors.

After acquiring the property ID, the information processing device 10 inquires of the management device 12 whether an image with the same property ID has already been registered and photographed. When the information processing apparatus 10 receives a response from the management apparatus 12 that the image has been taken, the information processing apparatus 10 issues an alert such as "This is the property ID for which the image has been taken." The reply from the management device 12 may be only a reply as to whether or not the photographing has been completed, but may also include information indicating the year, month, and day as the photographing date. As a result, the information processing apparatus 10 can display as an alert, "This is a property ID that has been photographed on year, month, and day."

Further, when the information processing apparatus 10 receives a response including the shooting date from the management apparatus 12, the information processing apparatus 10 may determine whether or not a predetermined period has passed since the shooting date. You can also choose not to issue an alert if a certain period of time has passed. As a result, it is possible to reduce the trouble of canceling the alert setting. If the predetermined period has not elapsed, it is unlikely that the object to be imaged has changed.

A second method is to access the information providing system 13, search for a target property from among the properties held by the information providing system 13, and acquire information on the searched property. In the information processing apparatus 10, the icon 126 for accessing the page provided by the information providing system 13 shown in FIG. 12(a) is lightly touched (tapped) once with a finger or the like. Next, a screen for searching for properties shown in FIG. 12(b) is displayed. The person in charge searches for the target property based on the address, property name, and the like. In FIG. 12(b), two search methods are displayed, namely, "search along the line" and "search from the area".

When the target property is retrieved, a screen for implementing panoramic photography of the property can be opened as shown in FIG. 12(c). A property ID and a panorama photographing button 127 are displayed on this screen. When the person in charge presses the panorama shooting button 127, the person in charge acquires the property ID and the like, instructs the imaging of the target property, and starts a program for executing the process of posting the photographed image.

When the program is started, a screen for selecting the property ID and floor plan type shown in FIG. 12(d) is displayed. The property ID is searched on the screen shown in FIG. 12(b) and acquired on the screen shown in FIG. 12(c). Therefore, on the screen shown in FIG. 12(d), the acquired property ID is automatically entered. The person in charge selects the floor plan type of the target property from a plurality of preset floor plan types. The floor plan type can be selected by tapping, for example, “1K” on the pull-down menu 128 .

In the second method, similarly to the first method, when the information processing device 10 acquires the property ID, it inquires of the management device 12 whether or not the image of the same property ID has been captured.

A third method is a method in which the person in charge inputs the property ID and selects the floor plan type. The person in charge uses the keyboard or the like displayed on the screen of the information processing apparatus 10 to enter the property ID column 129 shown in FIG. The floor plan type can be selected by tapping the desired type in pull-down menu 128 in the same manner as in the second method.

In the third method, similarly to the first method and the second method, when the information processing device 10 acquires the property ID, the information processing device 10 notifies the management device 12 whether or not the image of the same property ID has been captured. inquire whether

The process of acquiring an image will be described in detail with reference to FIG. Processing starts at step 1400 . At step 1405, the person in charge acquires the property ID. The property ID can be obtained by the method shown in FIGS. 11-13. Also, the person in charge selects the floor plan type of the property, and the information processing apparatus 10 receives the selection of the floor plan type. In step 1410, the room is identified from the floor plan type, it is determined whether or not the floor plan has been obtained, and the process branches. If the floor plan has been acquired, the process proceeds to step 1415 to display imaging candidates and determine the imaging order. If the floor plan has not been obtained, the process advances to step 1420 to perform processing for inputting locations that are imaging candidates. The details of the process of inputting imaging candidates will be described later.

Here, the imaging order will be described with reference to FIG. 15 . First, in step 1415, the imaging order is displayed on the screen of the information processing apparatus 10 in FIG. 15(a). In FIG. 15A, the order of shooting is "Living", "Dining Room", "Bed Room 1", "Bed Room 2", "Kitchen", "Bath Room", and "Entrance". They are lined up and instructed to take pictures in order from "Living".

In FIG. 15A, since no image has been captured yet, an image representing nothing is displayed to the left of the character string representing the room such as "Living". If the image has been captured, a thumbnail of the captured image is displayed. On the right side of the character string representing the room, there are provided a shoot button 130 for requesting imaging and a view button 131 for displaying for confirmation after imaging. A post button 132 for posting a captured image, a cancel button 133, and a save button 134 for storing information such as a captured image in the information processing apparatus 10 are also provided.

The person in charge takes images of the rooms in order from "Living" at the top. The person in charge carries the imaging device 11 and moves to the room to be imaged.

Returning to FIG. 14, in step 1425, the installation position of the imaging device 11 is displayed on the screen of the information processing device 10. FIG. When the shooting button 130 is pressed, the information processing apparatus 10 displays the installation positions of the imaging devices 11 in each room according to the shooting order, as shown in FIG. 15(b). Then, the person in charge installs the imaging device 11 at the installation position. The imaging device 11 can be installed, for example, on a support leg. Note that the display of the installation position of the imaging device 11 in step 1425 may be omitted. If step 1425 is omitted, the imaging device 11 is installed at a position determined by the person in charge to be suitable for imaging in the room to be imaged.

The person in charge notifies the information processing device 10 of a response that the installation of the imaging device 11 has been completed. For example, the information processing apparatus 10 displays a screen asking the person in charge whether the installation has been completed, and the person in charge responds that the installation has been completed. Then proceed to step 1430 . At step 1430 , the person in charge takes an image using the imaging device 11 . For example, a screen such as that shown in FIG. If the information processing apparatus 10 and the imaging apparatus 11 are not connected, the person in charge connects the information processing apparatus 10 and the imaging apparatus 11 and presses the imaging button 135 to instruct imaging.

When using an omnidirectional camera as the imaging device 11, in order to prevent the person in charge from being captured in the omnidirectional image due to the omnidirectional image being captured, the person in charge must be outside the imaging target room where the omnidirectional camera cannot be seen. It is possible to instruct imaging by, for example, moving to . Moreover, the type of imaging device 11 can be selectively used for each room. For example, when it is desired to grasp an entire space such as a living room or a kitchen, an omnidirectional camera is used to image the entire space. In the case where not the whole space but one side of the space, such as an entrance or a corridor, may be captured, the image may be captured by the camera 26 of the information processing apparatus 10 or a general digital camera.

When the person in charge presses the button 130 to take a picture, but the photograph has already been taken and is already registered in the management device 12, an alert saying ``the picture has already been registered'' as shown in FIG. 16 can be displayed. The person in charge can see the alert and decide whether to take an image.

Returning to FIG. 14 , at step 1435 , the information processing device 10 acquires an image from the imaging device 11 . For example, the information processing apparatus 10 receives an image and displays a preview screen for confirming the captured image as shown in FIG. 17 . The person in charge looks at the preview screen and determines whether or not the displayed image is the image to be sent to the management device 12 . Note that when a captured image includes a person, a part of the imaging device 11, or the like, the person or the like can be automatically detected and an alert can be issued. The person in charge presses the share button 136 to proceed to the next process.

The information processing apparatus 10 displays the screen shown in FIG. 18 in response to pressing of the share button 136 . A button 137 for discarding the captured image and recapturing and a button 138 for proceeding to the next screen are displayed on the screen. The person in charge can select and press any button. A button 137 for discarding and recapturing is a button for discarding the captured image and recapturing an image of the same room. A button 138 for advancing to the next screen is a button for capturing an image of the next room. The input reception unit 95 receives as an input that any button has been pressed and selected, and the control unit 91 discards the image or instructs the display unit 94 to display the next screen. .

At step 1440, the information processing apparatus 10 determines whether or not a request for imaging again has been received from the person in charge. If accepted, the process returns to step 1430 to instruct the imaging device 11 to perform imaging again. For example, when the person in charge determines that the image is not suitable for transmission to the management device 12, the image is captured again. Therefore, the screen shown in FIG. 15(c) is displayed again. If not, go to step 1445 . For example, when the person in charge determines that the image may be transmitted to the management device 12, the imaging of the room shown in the next imaging order is performed. Then, it is determined whether an acquisition request for information on the installation position of the imaging device 11 in another room indicated in the next imaging sequence has been received. If accepted, return to step 1425 . Then, the processing from step 1425 to step 1440 is repeated.

If not, go to step 1450 . For example, there may be a case where imaging of all the rooms indicated in the imaging order is finished, or a case where imaging of a part indicated by the imaging order is finished and the person in charge decides that the imaging should be sent to the management apparatus 12 once. Then, in step 1450 , the property ID obtained in step 1405 is associated with the image and transmitted to the management device 12 . Processing ends at step 1455 .

The person in charge captures all the images and presses the post button 132 shown in FIG. 15(a) when the capturing is completed. When the post button 132 is pressed, the information processing apparatus 10 associates all the captured images with the property ID and transmits them to the management apparatus 12 . Posting of images by transmission to the management device 12 can also be performed after displaying all the captured images in order and confirming all of them. At this time, the person in charge can check whether the order of the images is correct, whether there are unnecessary images, and so on.

Here, the process of inputting a location to be an imaging candidate in step 1420 will be described. Step 1420 is a process that is executed when information about the floor plan is not acquired, and displays the screen shown in FIG. In FIG. 15(d), instead of the display in FIG. 15(a), an imaging location input field 151 and an input field addition button 152 are displayed. The person in charge can input an arbitrary imaging location in the imaging location input field 151 . Further, the person in charge can add and display an imaging location input field 151 by tapping an input field addition button 152, thereby setting a plurality of imaging locations. In FIG. 15D, the person in charge may input all imaging candidates in advance and then perform imaging at each imaging location, or may repeat inputting of imaging candidates and imaging. This makes it possible to easily customize the imaging order based on the judgment of the person in charge.

Further, in the present embodiment, after the display as shown in FIG. 15E is displayed, the imaging location may be added by the operation of the person in charge. For example, when searching for a real estate property, the room that the borrower pays attention to is often the same, so it is easy to predict the room to be imaged. Therefore, as shown in FIG. 15(e), locations such as "Living" and "Dining Room" that are predicted to be highly likely to be imaged are displayed in advance as image capturing candidates, and the person in charge selects other rooms as image capturing locations. can be added as As a result, the person in charge can reduce the trouble of inputting the imaging location.

Note that an additional input field button 152 may be provided in the display shown in FIG. 15(a). This allows the person in charge to add an imaging location other than the imaging location preset according to the floor plan (for example, in the case of a real estate property, a common area, etc.). Therefore, the person in charge can customize and set the imaging location and imaging order.

The imaging order is instructed so that each room is imaged one by one, but if it is desired to image a plurality of images, rooms can be added to the imaging order. Further, the imaging device 11 releases the shutter when capturing an image, and the imaging device 11 can transmit captured images to the information processing device 10 continuously or at regular time intervals. For this reason, the information processing apparatus 10 displays images continuously or at regular time intervals, and the person in charge can confirm the imaging position, set the imaging position again at the optimum position, and instruct imaging.

When acquiring an image, the imaging conditions can be changed. The imaging conditions may include, for example, brightness (brightness), hue, and saturation of an image. Here, it is assumed that the brightness of the image is changed (adjusted). The brightness of the image can be adjusted by changing the value (EV value) that indicates the brightness of the exposure. The EV value is a value determined by the lens aperture (F number) and the exposure time (shutter speed) of the solid-state image sensor.

The process of acquiring an image with this imaging condition change will be described with reference to FIG. 19 . Steps 1900 to 1935 are the same as steps 1400 to 1435 shown in FIG. At step 1940, the person in charge changes the EV value using the information processing device 10 to change the brightness of the displayed image. The processing after step 1945 is the same as the processing after step 1440 shown in FIG. The input reception unit 95 can receive the EV value, and the change of the EV value can be realized by the control unit 91 instructing the imaging device 11 .

The person in charge can check the captured image on the preview screen, change the imaging conditions on the preview screen, and adjust the brightness and the like of the image. Also, the brightness of the image may be adjusted in advance before instructing the image capturing.

A method of changing the imaging conditions on the preview screen will be described with reference to FIG. FIG. 20(a) is a diagram illustrating a preview screen of a captured image. The preview screen is provided with a slide bar 139 for adjusting the EV value. The left end of the slide bar 139 indicates the smallest value (darkest), and the right end indicates the largest value (brightest). show.

The person in charge can change the EV value by moving the slide bar 139 toward the left end or right end. 20B and 20C are screens displaying images when the slide bar 139 shown in FIG. 20A is moved from the position toward the right end to increase the EV value. Since the EV value increases from FIG. 20(a) to FIG. 20(c), it can be seen that the image is brighter.

When an omnidirectional camera is used as the imaging device 11, the omnidirectional image is captured using two fisheye lenses having an angle of view greater than 180°, and is generated by joining the two captured images obtained. . On the preview screen, only a partial area of one picked-up image of this omnidirectional image is displayed.

Here, when the property information and the image of the room are displayed on the communication terminal 14 of the borrower, the initial image displayed first is the image of the part of the area displayed on the preview screen. When a person in charge borrows a property from a borrower, he/she wants to make the property look as good as possible. Therefore, the person in charge can change the area to a suitable one as an initial image to be displayed to the borrower and register it in the management device 12 .

Processing for acquiring an image with this area change will be described with reference to FIG. Steps 2100 to 2135 are the same as steps 1400 to 1435 shown in FIG. 14 and steps 1900 to 1935 shown in FIG. At step 2140 , the person in charge changes the area displayed on the preview screen on the information processing device 10 . Step 2145 and subsequent steps are the same as steps 1440 and subsequent steps shown in FIG. 14 and step 1945 and subsequent steps shown in FIG. The control unit 91 can instruct the transmission unit 93 to transmit the changed image to the management device 12 for updating. Thereby, the initial image can be displayed as an image changed by the person in charge.

The area can be changed by moving (swiping or flicking) the screen of the information processing device 10 left and right or up and down while keeping the screen of the information processing device 10 in contact with the finger. By the way, the area can be reduced or enlarged by the person in charge moving the two fingers closer together or farther apart (pinch-in, pinch-out) while keeping the two fingers in contact with the screen.

When the processing of the information processing apparatus 10 shown in FIGS. 10, 14, 19, and 21 is finished, the management apparatus 12 receives the image associated with the property ID. Then, the management device 12 causes the storage unit 112 to store the image, and when the registration of the image is completed, the management device 12 transmits a registration completion notice to the information processing device 10 . The information processing apparatus 10 can display the message "upload successful" shown in FIG. 22 upon receiving the registration completion notification. In addition, the information processing apparatus 10 can also display a message inquiring whether or not to "confirm with a browser" in order to allow the person in charge to confirm the uploaded content as the registered content.

Upon receiving this message, the person in charge can select "yes" or "no", and by selecting "yes", the uploaded content can be displayed.

As an image display method, for example, as shown in FIG. 23, an initial image 140 of the first room in the imaging order is displayed in a predetermined size. Thumbnail images 141 of each room can be displayed side by side on the initial image 140 . Also, a Click to Play button 142 is provided on the initial image 140, and an omnidirectional image can be displayed while changing the area over a certain period of time.

In addition, a text (caption) describing the image can be added to the image. The caption is, for example, "Living" or "Bed Room 1" as room information. A caption can be added when the information processing apparatus 10 receives an image captured by the imaging apparatus 11 and temporarily stores the image. Room information is included in the imaging order. Therefore, the information processing apparatus 10 acquires the information of the room corresponding to the shooting button 124 when the shooting button 124 of the room to be imaged is pressed, and acquires the information of the room when the captured image is received. It can also be added as a caption.

Here, if the person in charge is given the "edit" authority by the administrator, after the image is registered in the management device 12, the person in charge can edit the image. Therefore, by associating the image with the floor plan, the person in charge can edit the image so that the imaging position and the direction in which the initial image was captured can be easily understood. Furthermore, it becomes easier for the borrower to grasp the condition of the property. 24 and 25, image editing performed by the person in charge will be described.

First, the person in charge inputs the property ID to be edited on the search screen as shown in FIG. 24(a). As a result, the image associated with the property ID is searched for in the management device 12 . Next, an edit screen shown in FIG. 24(b) is displayed. By pressing an import button 143 , the searched images can be displayed in order as thumbnail images 141 . Of course, an automatically searched image may be displayed as the thumbnail image 141 . FIG. 24B shows the thumbnail image 141 displayed.

The person in charge selects the floor plan by dragging and dropping or pressing the import button 144 . Then, the floor plan is displayed within the frame indicated by the dotted line on the editing screen. The person in charge can use the link button 145 to associate the image displayed as the thumbnail image 141 with the floor plan. For example, an image corresponding to "Living" from among the thumbnail images 141 is selected and associated with the area of "Living" in the floor plan. In such editing, the input reception unit 95 receives the contents of editing for the image associated with the property ID, and the control unit 91 instructs the transmission unit 93 to acquire the image. Alternatively, the control unit 91 can transmit the edited image to the management device 12 and instruct the management device 12 to update the image.

The edited image is shown in FIG. In FIG. 25, a floor plan 146 and an image 147 captured at the imaging position shown in the floor plan 146 are superimposed and displayed. A plurality of imaging positions 148 are shown in the floor plan 146, and the imaging position of the currently displayed image 147 is shown to be distinguished from other imaging positions. In the floor plan 146, the direction and range of the currently displayed image 147 with respect to the imaging position 148 are also shown in a substantially fan shape.

In the image 147, a symbol 149 representing the direction of an adjacent imaging position 148 is displayed, and an image captured at the imaging position 148 is displayed. A button 150 is shown to zoom out.

By providing the floor plan 146, symbols 149, and various buttons 150, the renter can feel as if he or she is actually there and looking at each room while moving.

By the way, in this embodiment, the system administrator can register a list of imaging orders. For example, in the case of real estate, the imaging order can be easily managed by associating the floor plan type with each room. That is, when the person in charge selects a floor plan on the screens shown in FIGS. 11(b), 12(d), 13, etc., a list of imaging locations corresponding to the selected floor plan is displayed as shown in FIG. 15(a). can. Here, processing for capturing and registering an image based on the list will be described. FIG. 26 is a sequence diagram of processing executed in the information processing system.

The administrator uses the administrator PC 16 to access the management device 12 to register the person in charge and edit the list. Also, the person in charge accesses the management device 12 using the information processing device 10 to acquire the list, and uploads the captured images based on the list. Details of each process will be described below.

First, at step 2600 , the administrator PC 16 with administrative authority logs into the management device 12 . Next, in step 2605 , the administrator PC 16 registers the user identification information of the person in charge of image pickup, uploading, etc. in the storage unit 112 of the management device 12 . Management device 12 issues the ID and password of the person in charge registered in storage unit 112 at step 2610 . Note that the ID and password may be issued using the method described with reference to FIG.

In step 2615, the administrator notifies each person in charge of the issued ID and password. The ID and password may be notified orally directly to the person in charge, printed on paper and distributed, or sent via the network 15 by e-mail or the like to each person in charge. It is also possible to notify the information processing apparatus 10 that

After that, the administrator PC 16 registers and edits the list in step 2620 . FIG. 27 is a diagram exemplifying a screen for the administrator to edit the list. After logging in to the management apparatus 12, the administrator PC 16 selects an item such as "edit list" from the menu, thereby transitioning to the list edit screen shown in FIG. The list edit screen includes a floor plan type setting pane and an imaging order setting pane. Each pane also includes a change order button 153 , a delete button 154 , an item name input field 155 and an add item button 156 .

In the floor plan type setting pane, the floor plan type item can be added by entering the floor plan type in the item name input field 155a and pressing the add button 156a. Also, the display order of the selected floor plan type can be changed by using the order change button 153a of the up arrow and the down arrow. The selected floor plan type item is displayed in a dark color, and the selected item can be deleted by pressing the delete button 154a during selection.

Also, in the imaging order setting pane, the imaging location and the imaging order corresponding to the item of the floor plan selected in the floor plan type setting pane are set. When the item selected in the floor plan type setting pane is changed, the display of the imaging order setting pane is switched. In the imaging order setting pane, the imaging location can be added by entering the imaging location in the item name input field 155b and pressing the add button 156b. Also, the imaging order can be changed by the order change button 153b with an up arrow or a down arrow. The item of the selected imaging location is displayed in a dark color, and the selected item can be deleted by pressing the delete button 154b during selection.

Returning the description to FIG. At step 2620 , the list created by the administrator PC 16 is held in the storage section 112 of the management device 12 . Registration of the list may be performed before registration of the person in charge in step 2605 .

Next, in step 2625, the information processing device 10 logs into the management device 12 using the notified ID and password. Login is performed using the screen shown in FIG. 9 as an example. When the management device 12 accepts the login, the control unit 111 refers to the information of the person in charge registered in the storage unit 112, and permits the login if the person in charge who has logged in is registered.

Upon receiving the login of the person in charge, management device 12 notifies information processing device 10 of the list registered in storage unit 112 in step 2630 . The information processing device 10 acquires the list notified from the management device 12 by the acquisition unit 90 .

At step 2635, the person images each imaging location based on the imaging order displayed in the list. In step 2635, the information processing apparatus 10 may receive an image captured by the receiving unit 92 from an image captured using the image capturing apparatus 11 or a general digital camera. An image may be captured using the camera 26 .

After that, the information processing device 10 uploads the captured image to the management device 12 in step 2640 . In step 2640, the transmission unit 93 of the information processing apparatus 10 associates the captured image with the property ID and transmits the associated image. The processing of steps 2635 and 2640 corresponds to the processing of steps 1430 to 1450 in FIG. 14 and the like.

The receiving unit 110 of the management device 12 receives the images uploaded in step 2640 , and in step 2645 , the images uploaded by the control unit 111 are registered in association with the imaging locations in the list, and stored in the storage unit 112 . .

By editing the list as described above, it is possible to customize the list according to the application, so that the person in charge can reduce the trouble of taking an image. In addition, by having each person in charge use the same list, the notation can be unified. For example, it is possible to eliminate variations in notation such as "Living", "LIVING", "living", etc., and improve the convenience of the person in charge and the borrower.

As described above, by providing an information processing system, an information processing apparatus 10, an information processing method executed by them, and a program for causing a computer to execute the processing, posting of an image can be realized with a simple process. can. In addition, if an image has already been captured and a registered property ID is entered, an alert can be issued, thereby preventing registration of an erroneous image. Since an alert is not issued for a property for which a predetermined period has passed since the previous registration, it is possible to reduce the trouble of confirming and canceling the alert.

Although the present invention has been described as an information processing apparatus, an information processing system, an authentication method, and a program according to the above-described embodiments, the present invention is not limited to the above-described embodiments. The present invention can be modified within the scope of those skilled in the art, such as other embodiments, additions, changes, deletions, etc., and as long as the action and effect of the present invention are exhibited in any aspect, It is included in the scope of the invention.

Therefore, the program can be installed as a file in an installable or executable format on a floppy disk, a CD (Compact Disk), a CD-R (Compact Disk Read Only Memory), a DVD (Digital Versatile Disk), or an SD memory. It can be configured to be provided by being recorded in a computer-readable recording medium such as a card (SD Memory Card) or USB memory (Universal Serial Bus Memory). Also, the above program may be configured to be provided or distributed via a network such as the Internet. Furthermore, the above program may be configured to be provided by preloading it in a ROM or the like together with other various software.

In the above embodiment, the CPU reads out and executes a program stored in an HDD or the like, thereby loading a program that realizes each functional unit onto the RAM. generated. However, the present invention is not limited to this, and for example, at least part of each functional unit may be realized by a dedicated hardware circuit (eg, semiconductor integrated circuit).

DESCRIPTION OF SYMBOLS 10... Information processing apparatus, 11... Imaging apparatus, 12... Management apparatus, 13... Information providing system, 14... Communication terminal, 15... Network, 16... Administrator PC, 20... CPU, 21... ROM, 22... RAM, 23 Flash memory 24 Connection I/F 25 Operation panel 26 Camera 27 Communication I/F 28 Bus 30 Imaging body 31 Housing 32 Shutter button 33A, 33B Imaging optical system 34A, 34B solid-state imaging device 40 processor 41 lens barrel unit 42, 43 SDRAM 44 memory card slot 45 flash ROM 46 USB connector 47 power switch 48...Speaker, 49...Microphone, 50...Wireless NIC, 51...LCD monitor, 52...Triaxial acceleration sensor, 60A, 60B...ISP, 61...DMAC, 62...Arbiter, 63...MEMC, 64...Distortion correction/image synthesis Blocks 65... DMAC 66... Image processing block 67... CPU 68... Image data transfer unit 69... SDRAMC 70... Memory card control block 71... USB block 72... Peripheral block 73... Audio unit 74 ... serial block, 75 ... LCD driver, 76 ... bridge, 77 ... resize block, 78 ... JPEG block, 79 ... H.264 block, 80 ... CPU, 81 ... ROM, 82 ... RAM, 83 ... HDD, 84 ... communication I /F, 85... bus, 90... acquisition unit, 91... control unit, 92... reception unit, 93... transmission unit, 94... display unit, 95... input reception unit, 96... storage unit, 100... reception unit, 101... Control unit 102 Imaging unit 103 Image processing unit 104 Transmission unit 110 Reception unit 111 Control unit 112 Storage unit 113 Transmission unit 120, 121 Column 122 Automatic generation button , 123 ... field, 124 ... login button, 125 ... imaging button, 126 ... icon, 127 ... panorama shooting button, 128 ... pull-down menu, 129 ... field, 130 ... shooting button, 131 ... viewing button, 132 ... posting button, 133 Cancel button 134 Save button 135 Capture button 136 Share button 137 Reshoot button 138 Go to next screen button 139 Slide bar 140 Initial image 141 Thumbnail image 142 ... Click to Play button, 143, 144 ... Import button, 145 ... Link button, 146 ... Floor plan, 147 ... Image, 148 ... Shooting Image position 149 Symbol 150 Button 151 Imaging location input field 152 Input field addition button 153 Order change button 154 Delete button 155 Item name input field 156 Add item button

JP 2015-35178 A

Claims (12)

An information processing system for processing images,
Acquisition means for acquiring identification information for identifying one or more imaging targets;
An information processing system, comprising: a transmission unit that associates the one or more images of the imaging target imaged according to a predetermined imaging order with the identification information and transmits the identification information to a management device. including imaging means for capturing an image of the code containing at least the identification information;
2. The information processing system according to claim 1, wherein said acquisition means acquires said identification information from an image of said code captured by said imaging means. 2. The information processing system according to claim 1, wherein said acquisition means requests said identification information from an external device holding said identification information and acquires said identification information from said external device. including input receiving means for receiving a request to change the imaging conditions set in the imaging device;
4. The information processing system according to any one of claims 1 to 3, wherein the imaging device is instructed to change the imaging condition based on the request. the image of the imaging target is an omnidirectional omnidirectional image, and the initial image first displayed by the display means is an image of a partial area of the omnidirectional image;
When a request to change the initial image to an image of another area is received, the initial image is changed to the image of the other area, the image changed to the initial image is transmitted, and the management device manages 5. The information processing system according to any one of claims 1 to 4, wherein the transmission means is instructed to update the image to be displayed. display means for displaying a screen for selecting whether to discard the image of the object to be imaged and image it again, or to image the next object to be imaged in the order of imaging;
6. The information processing system according to any one of claims 1 to 5, wherein the selection to image again or the selection to image the next imaging target is accepted. input receiving means for receiving input of the identification information and contents of editing of one or more images associated with the identification information managed by the management device;
instructing the transmitting means to transmit the identification information received by the input receiving means to the management device and acquire one or more images associated with the identification information; 7. The information processing system according to any one of claims 1 to 6, wherein one or more images edited according to the content of said editing are transmitted to said management device and instructed to update. The management device receives the identification information and the information of the communication terminal from an information providing system that provides information to the communication terminal, and based on the information of the communication terminal, one or more associated with the identification information 8. The information processing system according to any one of claims 1 to 7, wherein an image is transmitted to said communication terminal. An information processing method,
obtaining identification information for identifying one or more imaging targets;
and a step of associating the one or more images of the imaging target imaged in accordance with a predetermined imaging order with the identification information and transmitting the identification information to a management device. A program for causing a computer to execute each step included in the information processing method according to claim 9. An information processing system for processing images,
Acquisition means for acquiring identification information for identifying one or more imaging targets;
An information processing system, comprising a transmission unit that associates the one or more images of the imaging target imaged according to a predetermined imaging candidate with the identification information and transmits the identification information to a management device. An information processing method,
obtaining identification information for identifying one or more imaging targets;
and a step of associating the one or more images of the imaging target imaged according to predetermined imaging candidates with the identification information and transmitting the identification information to a management device.

Images