JP7367812B2 - Information processing system, information processing method and program - Google Patents

Description

The present invention relates to an information processing system for processing images, an information processing method, and a program for causing a computer to execute information processing.

Examples of environments that include one or more imaging targets include real estate properties that have one or more compartmentalized rooms, work environments such as construction sites that have one or more work processes, and the like. When introducing this real estate property, it is easier to understand what kind of property it is if there are images of each room. Furthermore, by saving images of each work process, the worker can check the work status later.

In view of this, a work situation management system has been proposed in which work scenes are photographed for each work process according to a photographing plan (for example, see Patent Document 1). In this system, scene identification information generated based on process information is sent from the PC to the digital camera, scene identification information is added to the image taken with the digital camera and sent to the PC, and the PC takes the image with the scene identification information. Images are classified and managed according to the classification system of the shooting plan.

However, with the above technique, there is a problem that scene identification information needs to be generated based on process information, which makes the process for posting an image complicated.

The present invention has been made in view of the above, and an object of the present invention is to provide an information processing system, an information processing method, and a program that can realize posting of images with simple processing.

In order to solve the above-mentioned problems, one embodiment of the invention provides an information processing system that processes images, comprising an acquisition unit for acquiring identification information for identifying one or more imaging targets, and a predetermined imaging order. An information processing system is provided, the information processing system including a transmission unit that associates one or more images of an imaging target captured according to the above with identification information and transmits the association to a management device.

According to the present invention, posting of images can be realized through simple processing.

FIG. 1 is a diagram showing a configuration example of an information processing system. FIG. 1 is a diagram illustrating a hardware configuration of an information processing device included in the information processing system. A cross-sectional view of a spherical camera as an imaging device. A diagram illustrating the hardware configuration of a spherical camera. FIG. 3 is a diagram illustrating a hardware configuration of a management device. FIG. 2 is a diagram illustrating a functional configuration of an information processing device. FIG. 2 is a diagram illustrating functional configurations of an imaging device and a management device. The figure which illustrated the screen for creating user identification information displayed on a management apparatus. A diagram illustrating a login screen. 2 is a flowchart showing the flow of the entire process executed by the information processing device. The figure explaining the 1st method of acquiring property ID. The figure explaining the 2nd method of acquiring property ID. The figure explaining the 3rd method of acquiring property ID. Flowchart showing the flow of processing for acquiring images. The figure which illustrated the screen displayed on an information processing device in the process of acquiring an image. The figure which illustrated the screen displayed when an image is already registered. The figure which illustrated the preview image. The figure which illustrated the confirmation screen of an image. 5 is a flowchart showing the flow of processing for acquiring images with changes in imaging conditions. FIG. 3 is a diagram illustrating a method of changing imaging conditions. 10 is a flowchart showing the flow of processing for acquiring an image with area change. A diagram illustrating a screen displayed when the upload is successful. The figure which illustrated one screen displayed on a communication terminal. FIG. 3 is a diagram illustrating a method for editing a registered image. The figure which illustrated another screen displayed on a communication terminal. FIG. 3 is a sequence diagram of processing executed in the information processing system. The figure which illustrated the screen which an administrator edits a list.

FIG. 1 is a diagram showing an example of the configuration of an information processing system. The information processing system includes an information processing device 10 used by a user. The information processing system may include only the information processing device 10. Further, the information processing system may include an information processing device 10, an imaging device 11, a management device 12, and an information providing system 13. Note that the information processing system may include the information processing device 10, and any one or two of the imaging device 11, the management device 12, and the information providing system 13.

The information processing device 10 and the communication terminal 14 are a PC, a tablet terminal, a smartphone, a PDA (Personal Digital Assistant), or the like. Further, the information processing device 10 and the communication terminal 14 are devices that have a communication function and a function of inputting, outputting, and displaying information. The imaging device 11 is a device that images an object to be imaged. The management device 12 is a device that stores and manages captured images. The information providing system 13 is a server or the like that provides information.

The network 15 connects various devices through a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, and the like. The network 15 may be a wired network or a wireless network such as Wi-Fi. Further, the network 15 is not limited to one network, but may be composed of two or more networks connected by a relay device such as a router or a proxy server. Note that various devices and devices other than the information processing system may be connected to the network 15.

The information processing system can be used as a system that provides information on a real estate property as an environment including one or more imaging targets, a system that manages work processes such as construction, and the like. The information processing system will be described below as a system that provides information on real estate properties.

Examples of real estate properties include newly built, used, and rental single-family houses, apartment complexes such as condominiums and apartments, stores, offices, warehouses, factories, office buildings, commercial facilities, and parking lots. Here, the real estate property is a property such as a condominium that has one or more rooms as imaging targets.

The information providing system 13 stores and manages information on a plurality of properties in order to provide information on properties managed by a real estate company. Property information includes information such as sales price, rent, land price, etc., address, building structure, exclusive area, number of floors, facilities, presence of parking lot, etc., and also includes floor plans, exterior photos, etc.

For example, a case will be described in which a renter as a user searches for a rental apartment as a real estate property. The borrower inputs information necessary to search for real estate properties by operating the communication terminal 14. Information is then transmitted to the communication terminal 14 by accessing the information providing system 13 via the network 15. The information providing system 13 searches for information on a plurality of properties managed by the information providing system 13 based on the information transmitted from the communication terminal 14. Information about the property desired by the renter is then transmitted to the communication terminal 14 via the network 15. The communication terminal 14 receives property information and displays it on the screen.

The renter looks at the property information displayed on the screen of the communication terminal 14 and determines whether the property is the property he or she desires. If the property is not the desired property, the borrower changes the input information, causes the information providing system 13 to perform a search again, and causes the communication terminal 14 to display information on another property. In this way, the renter can search for the property he/she desires.

By looking at the displayed information, the renter can learn in detail what kind of property it is based on images of each room, without having to actually go to the location where the property is located. Therefore, it is desirable that the property information includes images of rooms in the property.

In order to achieve this, a person in charge of a real estate company goes to the target property with an imaging device 11 and takes images of each room. Then, when the person in charge posts the captured image to the information providing system 13, the captured image is added as property information.

However, when posting images to the information providing system 13, the floor plan differs from property to property, which requires a lot of effort from the person in charge. For example, since the number of images to be captured differs for each property, it takes time and effort to associate properties with captured images. Furthermore, it takes time and effort to associate information about each room, such as a living room or a bedroom, with a captured image.

Furthermore, the data size of images is larger than that of characters and graphics. Therefore, if images of one or more rooms are posted for each property, the storage area of the storage device included in the information providing system 13 runs out, and posting becomes impossible. Therefore, it is necessary to add a new storage device or replace it with a large capacity storage device. However, in either case, system reconstruction is required.

In view of this, the information processing system utilizes the information processing device 10 to realize posting of images through simple processing. Further, by providing the management device 12 separately from the information providing system 13 and having the management device 12 store and manage captured images, it is not necessary to reconstruct the information providing system 13.

Specifically, a person in charge as a user accesses the information providing system 13 via the network 15 using the information processing device 10 . Then, in order to identify the properties managed by the information providing system 13, the information processing device 10 acquires a property ID as identification information for identifying one or more imaging targets. The property ID is a property management number etc. assigned to each property.

The person in charge inputs the acquired property ID into the information processing device 10, and also inputs information on the floor plan of the property as position information indicating the location of one or more imaging targets. The floor plan information is information indicating the number and type of rooms, such as 2DK, 2LDK, 3DK, and 3LDK. By the way, the number 3 in 3LDK represents the number of rooms that can be used as bedrooms, L represents the living room, D represents the dining room, and K represents the kitchen.

The information processing device 10 identifies the rooms based on the input floor plan information, and determines the order in which the identified rooms are to be imaged based on preset ranking information. As the ranking information, ranking information obtained from a questionnaire survey of the rooms that the general public would like to see first can be used. However, since this is just an example, the information may be obtained by other methods.

The information processing device 10 notifies the person in charge of the room to be imaged by displaying the imaging order on the screen. Then, the information processing device 10 displays on the screen the position where the imaging device 11 is installed in the room. The person in charge moves to the room displayed on the screen and installs the imaging device 11 at the displayed position. Further, the person in charge requests the information processing device 10 to take an image, and the information processing device 10 instructs the imaging device 11 to take an image.

The information processing device 10 receives an image captured from the imaging device 11 as image data, and temporarily stores the image data. What is transmitted and received between each device is image data, which will be explained below simply as an image.

The information processing device 10 receives images captured by the imaging device 11 for each room corresponding to the floor plan information. Thereafter, the information processing device 10 posts the image by associating the property ID with the image and transmitting it to the management device 12. For example, it is possible to create a folder with the property ID as the folder name, store images in the folder in the order in which they were taken, and send the images in each folder. Thereby, the management device 12 can save and manage the folder as it is.

When the information providing system 13 is requested to provide property information by the borrower, the information providing system 13 acquires information on the communication terminal 14 owned by the borrower from the communication terminal 14. The information providing system 13 then transmits the property ID of the requested property and the information on the communication terminal 14 to the management device 12. The information providing system 13 provides information on the property corresponding to the property ID to the communication terminal 14, and the management device 12 transmits to the communication terminal 14 a plurality of images associated with the property ID.

The communication terminal 14 receives property information provided from the information providing system 13 and displays it on the screen. Furthermore, the communication terminal 14 displays the plurality of images received from the management device 12 at a preset screen position. For multiple images, for example, the first image in the imaging order can be set to a predetermined size, and a reduced version of all the images (thumbnail images) can be displayed by superimposing a part of the first image. . Thereby, the renter can refer to the first image, select a thumbnail image of another room, enlarge it to a predetermined size, and display it in order to check the state of the other room. The renter can obtain detailed information about the displayed room, such as the color of the walls, the size and location of windows, the type of light, and the location of electrical outlets.

The information processing device 10 , the management device 12 , and the information providing system 13 are connected by a network 15 and can communicate via the network 15 . The imaging device 11 may also be connected to the network 15 and communicate with the information processing device 10 via the network 15, but in the example shown in FIG. 1, it communicates directly with the information processing device 10 through a wireless connection.

The information processing device 10 can be carried or moved by a person in charge, and has a function of communicating with an imaging device 11, a management device 12, and an information providing system 13, receiving information from the person in charge, and displaying captured images. Any device may be used.

As the imaging device 11, a digital camera, a notebook PC with a camera, a tablet terminal with a camera, a smartphone with a camera, a spherical camera, etc. can be used. Note that a spherical camera is a camera that can capture images in all directions of 360° centered on the camera at one time. If you try to take images of each room from corner to corner with a normal camera, you will have to change the angle of the camera and take pictures, and the number of images will increase, making management difficult. However, since a spherical camera only needs to take an image once for each room, and only one image is required, it is desirable that the imaging device 11 be a spherical camera.

The management device 12 includes a storage device having sufficient storage capacity to store images of all rooms of all properties managed by the information providing system 13.

Referring to FIG. 2, the hardware configuration of the information processing device 10 included in the information processing system will be described. The information processing device 10 includes, as hardware, a CPU (Central Processing Unit) 20, a ROM (Read Only Memory) 21, a RAM (Random Access Memory) 22, a flash memory 23, a connection I/F 24, an operation panel 25, a camera 26, It is configured including a communication I/F 27. The CPU 20 , ROM 21 , RAM 22 , flash memory 23 , connection I/F 24 , and communication I/F 27 are connected to a bus 28 and exchange information with each other via the bus 28 .

The CPU 20 is a calculation means and controls the entire information processing device 10. The ROM 21 is a read-only nonvolatile storage medium that stores a boot program, firmware, etc. for starting the information processing device 10. The RAM 22 is a volatile storage medium that allows information to be read and written at high speed, and is used as a work area when the CPU 20 processes information. The flash memory 23 is a nonvolatile storage medium in which information can be read and written, and stores an OS (Operating System), various applications, programs for executing processing, and the like. Here, the flash memory 23 is used as a nonvolatile storage medium, but the present invention is not limited to this, and an HDD (Hard Disk Drive) may also be used.

The connection I/F 24 connects the operation panel 25 and the camera 26 to the bus 28 and controls the input of information from the operation panel 25, the display of information on the operation panel 25, and the input of images from the camera 26. The operation panel 25 has a touch panel, receives input of information, and displays information. Although the operation panel 25 is employed here, the present invention is not limited to this, and may be configured to include an input device and a display device, and be connected to the bus 28 through an input/output I/F. Like the imaging device 11, the camera 26 includes a solid-state imaging device, converts the received light into an electrical signal, and outputs it as image data.

The communication I/F 27 connects to the imaging device 11, the management device 12, and the information providing system 13 via the network 15 by wire or wirelessly, and controls communication with these devices and systems. Although the description here assumes that communication is performed via the network 15, the present invention is not limited to this, and direct communication may be performed. When communicating wirelessly, communication can be performed using Wi-Fi, etc. defined in the IEEE802.11 standard.

The information processing device 10 may include other hardware, such as an SD card slot for installing an external storage medium such as an SD card or a USB (Universal Serial Bus) memory, or an external storage I/F such as a USB connector. You can prepare. Further, the information processing device 10 can include an imaging device such as a camera, an audio input device such as a microphone, an audio output device such as a speaker, a GPS (Global Positioning System), various sensors, and the like.

The hardware configuration of the imaging device 11 included in the information processing system will be described with reference to FIGS. 3 and 4. Although the imaging device 11 may be a digital camera or the like, it will be described here as a spherical camera. FIG. 3 is a cross-sectional view of the omnidirectional camera, showing the main hardware configuration, and FIG. 4 shows the detailed hardware configuration.

Referring to FIG. 3, the imaging device 11 includes, as main hardware, an imaging body 30, a housing 31 that holds the imaging body 30 and components such as a controller and a battery, and a shutter button 32 provided in the housing 31. Equipped with. The imaging body 30 includes two imaging optical systems 33A and 33B, and two solid-state imaging elements 34A and 34B such as a CCD (Charge Coupled Device) sensor and a CMOS (Complementary Metal Oxide Semiconductor) sensor. Each of the two imaging optical systems 33A and 33B is configured, for example, as a fisheye lens with seven lenses in six groups, and the fisheye lens has an angle of view larger than 180°. Here, a system configured by combining one solid-state imaging device and one imaging optical system is referred to as an imaging optical system.

The two imaging optical systems 33A and 33B have optical elements such as lenses, prisms, filters, and aperture stops, and have a positional relationship with respect to the two solid-state image sensors 34A and 34B. The positioning is performed so that the optical axes of the optical elements of the two imaging optical systems 33A and 33B are located perpendicular to the centers of the light receiving areas of the two corresponding solid-state image sensors 34A and 34B, and the light receiving areas are , is performed so as to form the image plane of the corresponding fisheye lens. Each of the two solid-state image sensors 34A and 34B is a two-dimensional solid-state image sensor whose light-receiving region forms an area, and the two combined imaging optical systems 33A and 33B convert the light collected into an image signal. do.

The two imaging optical systems 33A and 33B have the same specifications and are combined in opposite directions so that their optical axes coincide. Two image signals converted by the two solid-state image sensors 34A and 34B are output to image processing means on the controller. The image processing means connects two partial images of the two image signals to generate an image with a solid angle of 4π steradians (a spherical image). Here, it is assumed that a spherical image, which is an image taken in all directions, is generated, but a panoramic image, which is an image taken 360 degrees in the horizontal direction, may be generated.

In the imaging device 11, since the fisheye lens has an angle of view larger than 180°, each imaging optical system has an overlapping portion. Therefore, when generating a spherical image, the overlapping portion of two image signals is used as reference data representing the same image and is used as a reference for joining the images together. Note that the generation of the celestial sphere image may be performed by the imaging device 11 or the information processing device 10. For example, all the processing by the image processing means of the imaging device 11 may be performed by the imaging device 11, or all or part of the processing by the image processing means of the imaging device 11 may be performed by the information processing device 10. Signals etc. may also be transferred.

The spherical image can be displayed, for example, on a screen provided on the imaging device 11 or the screen of the information processing device 10 connected to the imaging device 11, outputted to a printing device for printing, or stored on an external device such as an SD card. It can be stored as data in a storage medium, etc.

Referring to FIG. 4, the imaging device 11 includes, in detail, a processor 40, a lens barrel unit 41, and various components connected to the processor 40. Lens barrel unit 41 includes two imaging optical systems 33A and 33B and two solid-state image sensors 34A and 34B. The two solid-state image sensors 34A and 34B are controlled by control commands from the processor 40.

The various components include SDRAM 42, 43 for temporarily storing data, a memory card slot 44 for installing a memory card, a flash ROM 45, a USB connector 46, and a power switch 47. In addition, various components include a speaker 48 as an audio output device, a microphone 49 as an audio input device, a wireless NIC (Network Interface Card) 50 used for connecting to the network 15 by wireless communication, and an LCD (Liquid Crystal). Display) monitor 51, 3-axis acceleration sensor 52, etc. These are just examples; other components may be included.

The processor 40 includes ISP (Image Signal Processor) 60A, 60B, DMAC (Direct Memory Access Controller) 61, arbiter (ARBMEMC) 62, MEMC (Memory Controller) 63, and distortion correction/image synthesis block 64. The ISPs 60A and 60B perform white balance setting and gamma setting on images input through signal processing of the solid-state image sensors 34A and 34B. The DMAC 61 directly transfers data from the ISPs 60A and 60B and the distortion correction/image synthesis block 64 to the ARBMEMC 62, and from the ARBMEMC 62 to the distortion correction/image synthesis block 64 without going through the CPU. ARBMEMC62 arbitrates access to memory such as SDRAM42. MEMC63 controls the memory access.

The distortion correction/image synthesis block 64 uses information from the 3-axis acceleration sensor 52 to perform distortion correction and vertical correction on the two captured images obtained from the two imaging optical systems, and performs image synthesis. do. The SDRAM 42 is used to temporarily store data when the ISPs 60A, 60B and the distortion correction/image synthesis block 64 perform processing.

The processor 40 further includes a DMAC 65, an image processing block 66, a CPU 67, an image data transfer unit 68, an SDRAMC (SDRAM Controller) 69, a memory card control block 70, a USB block 71, and a peripheral block 72. The processor 40 also includes an audio unit 73, a serial block 74, an LCD driver 75, and a bridge 76. The DMAC 65 directly transfers data from the ARBMEMC 62 to the image processing block 66 without going through the CPU 67 .

The image processing block 66 uses a resizing block 77, a JPEG (Joint Photographic Experts Group) block 78, an H.264 block 79, etc. to perform various image processing on the image. The resize block 77 enlarges or reduces the size of the image by interpolation processing. JPEG block 78 performs JPEG compression and decompression. The H.264 block 79 performs video compression and expansion using H.264 and the like. The CPU 67 controls the operation of each part of the imaging device 11.

The image data transfer unit 68 transfers the image processed by the image processing block 66. The SDRAMC 69 controls the SDRAM 43 connected to the processor 40 and sends the image transferred from the image data transfer section 68 to the SDRAM 43. The SDRAM 43 is used to temporarily store data when performing various processing within the processor 40.

The memory card control block 70 controls reading and writing to and from the memory card installed in the memory card slot 44 and the flash ROM 45 . The USB block 71 controls USB communication with an external device such as a PC connected via the USB connector 46. The power switch 47 is connected to the peripheral block 72 . The audio unit 73 is connected to the speaker 48 and the microphone 49, and controls audio input/output. The serial block 74 controls serial communication with external devices such as a PC, and is connected to the wireless NIC 50. The LCD driver 75 is a drive circuit that drives the LCD monitor 51 and converts signals for displaying various states on the LCD monitor 51.

The flash ROM 45 stores control programs written in codes that can be read by the CPU 67 and various parameters. When the user operates the power switch 47 to turn on the power, the control program stored in the flash ROM 45 is loaded into the main memory. The CPU 67 executes the control program loaded into the main memory, controls the operation of each part of the imaging device 11, and temporarily stores data necessary for control in the SDRAM 43 and local SRAM.

Next, the hardware configuration of the management device 12 will be described with reference to FIG. 5. Note that the hardware configuration of the information providing server that constitutes the information providing system 13 is the same as that of the management device 12, so a description of the information providing system 13 will be omitted. The management device 12 includes a CPU 80, ROM 81, RAM 82, HDD (Hard Disk Drive) 83, and communication I/F 84 as hardware. The CPU 80, ROM 81, RAM 82, HDD 83, and communication I/F 84 are connected to a bus 85 and exchange information with each other via the bus 85.

The CPU 80 is a calculation means and controls the entire management device 12. The ROM 81 is a read-only nonvolatile storage medium that stores a boot program, firmware, etc. for starting the management device 12. The RAM 82 is a volatile storage medium that allows information to be read and written at high speed, and is used as a work area when the CPU 80 processes information. The HDD 83 is a nonvolatile storage medium in which information can be read and written, and stores an OS, various programs, and the like. Although the HDD 83 is employed here as a nonvolatile storage medium, the present invention is not limited to this, and an SSD (Solid State Drive) or the like may be employed.

The communication I/F 84 is connected to the information processing device 10, the imaging device 11, and the information providing system 13 via the network 15 by wire or wirelessly, and controls communication with these devices and systems. Although the description here assumes that communication is performed via the network 15, the present invention is not limited to this, and direct communication may be performed. When communicating wirelessly, communication can be performed using Wi-Fi, etc. defined in the IEEE802.11 standard.

The management device 12 may also include other hardware, such as an SD card slot for attaching an external storage medium such as an SD card or a USB (Universal Serial Bus) memory, or an external storage I/F such as a USB connector. be able to. Furthermore, the management device 12 can include an audio input device such as a microphone, an audio output device such as a speaker, a GPS (Global Positioning System), and the like.

The functional configuration of the information processing device 10 will be described with reference to FIG. 6. The information processing device 10 can be said to include the following functional units because the following functional units are generated when the CPU 20 reads out a program stored in the flash memory 23 into the RAM 22 and executes it. Here, each functional unit will be explained as being generated by executing a program, but some or all of the multiple functional units may be realized not by software such as a program but by hardware such as a dedicated circuit. .

The information processing device 10 includes an acquisition section 90, a control section 91, a reception section 92, a transmission section 93, a display section 94, an input reception section 95, and a storage section 96 as functional sections. The acquisition unit 90 acquires a property ID that identifies a property including one or more rooms to be imaged, and floor plan information from input information input by a person in charge, for example. The acquisition unit 90 can acquire the property ID from the information providing system 13 by the information processing device 10 communicating with the information providing system 13 . The acquisition unit 90 can also image and read a printed matter printed by a person in charge using an imaging device included in the information processing device 10, and acquire the property ID from the information included in the read printed matter. Alternatively, the property ID can also be acquired by the person in charge reading information displayed on the screen of a terminal different from the information processing device 10. Further, the acquisition unit 90 can also acquire the property ID input by the person in charge on the operation panel 25 of the information processing device 10.

The control unit 91 determines the imaging order of the rooms specified by the floor plan information acquired by the acquisition unit 90 based on preset ranking information of imaging targets. The ranking information is associated with the room information and the ranking. For example, 1st place "Living Room", 2nd place "Dining Room", 3rd place "Bed Room 1", 4th place 1st place “Bed Room 2”, 5th place “Bed Room 3”, 6th place “Bed Room 4”, 7th place “Kitchen”, 8th place “Bathroom” 9th place ``Entrance'', etc. The storage unit 96 stores ranking information of photographic targets. For example, if the floor plan information is 3LDK, there are only three bedrooms, so the 1st to 5th places will be captured in the preset imaging order, and the 6th place "Bed Room 4" will be skipped. The order of imaging is determined, such as 7th to 9th. Then, the control unit 91 instructs the display unit 94 to display the imaging order determined by the control unit 91. The display unit 94 receives the instruction and displays the imaging order.

The person in charge looks at the imaging order displayed on the display unit 94, and if it is the first imaging, moves to the room in the first order, and if it is the second imaging, moves to the second room.

The input receiving unit 95 receives a request from a person in charge to obtain information on the installation position of the imaging device 11, and the control unit 91 instructs the display unit 94 to display information on the installation position of the imaging device 11. The display unit 94 receives an instruction from the control unit 91 and displays installation position information such as “Please install it in the center of the living room and take a picture.”

After installing the imaging device 11 according to the displayed installation position information, the person in charge touches or presses the imaging button displayed on the operation panel 25 of the information processing device 10 to request imaging. The input receiving unit 95 accepts the request, and the control unit 91 instructs the imaging device 11 to take an image. The input reception unit 95 can also receive changes in imaging conditions such as brightness from a person in charge. If the input receiving unit 95 accepts the change, the control unit 91 instructs the change of the imaging condition.

Note that the person in charge may remotely instruct the imaging device 11 from the information processing device 10 to request imaging, or may directly press the shutter button 32 or the like provided on the imaging device 11.

The receiving unit 92 receives images captured by the imaging device 11 . The storage unit 96 temporarily stores the image received by the reception unit 92. The display unit 94 displays the image received by the receiving unit 92 as a preview image before being sent to the management device 12 and registered. The person in charge looks at the preview image and determines whether to send the image to the management device 12 or to retake the image, and the input reception unit 95 receives the determined result as input.

The control unit 91 instructs the imaging device 11 to take another image according to the result received by the input reception unit 95. Further, upon completion of all imaging, the control unit 91 instructs the transmitting unit 93 to transmit the captured images to the management device 12. When receiving an instruction to transmit images, the transmitter 93 associates the property ID acquired by the acquirer 90 with the captured images, and transmits the images to the management device 12 .

With reference to FIG. 7, the functional configurations of the imaging device 11 and the management device 12 will be described. Like the information processing device 10, the imaging device 11 and the management device 12 are also equipped with the following functional sections because the following functional sections are generated when the CPU reads and executes programs stored in the flash ROM or HDD. It can be said that Here, each functional unit will be explained as being generated by executing a program, but some or all of the multiple functional units may be realized not by software such as a program but by hardware such as a dedicated circuit. .

The imaging device 11 includes a receiving section 100, a control section 101, an imaging section 102, an image processing section 103, and a transmitting section 104 as functional sections, as shown in FIG. 7(a). The receiving unit 100 receives an imaging instruction from the information processing device 10. The receiving unit 100 receives not only the imaging instruction but also an instruction to change the imaging conditions. The control unit 101 receives the imaging instruction and instructs the imaging unit 102 to perform imaging. Further, the control unit 101 changes the brightness setting value (EV value) etc. set in the imaging unit 102 in response to a change in the imaging conditions. The EV value is a numerical value that indicates the brightness of exposure.

The imaging unit 102 receives an instruction from the control unit 101, images a room to be imaged according to set values, and outputs two captured images. The control unit 101 instructs the image processing unit 103 to perform image processing on the two output captured images. The image processing unit 103 receives the two captured images output from the imaging unit 102, connects the two captured images, generates a celestial sphere image, and outputs it as spherical image data. What is transmitted from the imaging device 11 to the information processing device 10 is spherical image data, but this will also be explained simply as a spherical image.

The control unit 101 instructs the transmitting unit 104 to transmit the output spherical image to the information processing device 10. The transmitter 104 receives an instruction from the controller 101 and transmits the spherical image to the information processing device 10 .

The management device 12 includes a receiving section 110, a control section 111, a storage section 112, and a transmitting section 113, as shown in FIG. 7(b). The receiving unit 110 receives an image associated with a property ID from the information processing device 10. The receiving unit 110 also receives an image transmission request and information on the property ID and the communication terminal 14 from the information providing system 13 .

The control unit 111 stores the image received by the receiving unit 110 in the storage unit 112, and manages the image using the property ID associated with the image. Further, upon receiving the transmission request received by the receiving unit 110, the control unit 111 searches for a corresponding image from among the plurality of images stored in the storage unit 112 based on the property ID. Then, the control unit 111 instructs the information providing system 13 to transmit the searched image to the communication terminal 14 that requested the information on the property corresponding to the property ID.

The transmitter 113 receives an instruction from the controller 111 and transmits the image searched by the controller 111 to the communication terminal 14 based on the information of the communication terminal 14 received by the receiver 110 .

The communication terminal 14 displays the image received from the management device 12 along with the property information requested from the information providing system 13. Not only can renters refer to property information to check information such as rent, management fees, floor plan, address, facilities, etc., but they can also refer to images to check the actual wall color, location of doors, windows, outlets, etc. can be confirmed.

In order to use the information processing system safely, the system administrator issues a user ID and password as user identification information to the person in charge. The person in charge enters the issued user ID and password and can use the system if user authentication is successful.

FIG. 8 is a diagram illustrating a screen for creating user identification information displayed on the management device 12. After logging into the management device 12 from a PC with administrative authority, the administrator enters numbers, alphanumeric characters, etc. that make up the user ID in the user name field 120, and configures a password in the password field 121. Enter numbers, alphanumeric characters, etc. The screen has an automatic generation button 122, and by pressing the automatic generation button 122, a user ID and password are generated and registered.

Alternatively, when the administrator first presses the automatic generation button 122, the management device 12 may automatically allocate numbers, alphanumeric characters, etc., issue a user ID and password, and register. Furthermore, a person in charge may access the management device 12 from the information processing device 10 to send a user ID and password issuance request to the management device 12.

The screen may have only fields for inputting a user name and password, but it can also include a field 123 for authority for operations such as "view", "edit", and "delete" of images. If the "reference" authority is set to "enabled," the person in charge can acquire the already registered image from the management device 12 and display it on the information processing device 10 that the person owns.

The authority is "Yes" even if the person in charge can set the authority to either "Yes" only to the image of the property that the person in charge is responsible for, or "Yes" to all images. good. Information regarding authority can be stored and managed in the storage unit 112 included in the management device 12.

The administrator notifies the appropriate person in charge of the user identification information created on the screen. The user identification information may be notified orally, printed on paper and distributed, or via the network 15 by e-mail or the like. Since user identification information is confidential information, when it is notified via e-mail or the like via the network 15, it can be sent in an encrypted form. Any encryption method may be used as the encryption method, and any encryption algorithm may be used at that time.

Next, a method for a person in charge to log in to the management device 12 using user identification information will be described. FIG. 9 is a diagram illustrating a login screen.

The person in charge inputs and registers the user identification information in advance into the information processing device 10 that the person in charge uses. With this registration, the person in charge can log in by simply pressing the login button 124 on the login screen without having to input user identification information each time the person logs in. Note that this login is for performing a process of registering images captured by the imaging device 11 in the management device 12.

Next, an overview of the processing executed by the information processing apparatus 10 after login will be described with reference to FIG. 10. When the person in charge presses the login button 124 and the login is successful, the process starts from step 1000. In step 1005, the information processing device 10 accesses the information providing system 13 and searches for the target property. Then, the information processing device 10 acquires the property ID of the property from the information providing system 13. Here, after acquiring the property ID, the information processing device 10 may inquire of the management device 12 whether an image with the same property ID has already been registered and photographed. Furthermore, at the same time as acquiring the property ID, the information processing device 10 may acquire information on the floor plan of the property. Note that the floor plan information may be input by the person in charge, or the person in charge may prepare several pieces of floor plan information in advance and select the appropriate floor plan information from among them.

In step 1010, the information processing device 10 determines the order in which rooms are to be imaged by the imaging device 11, and displays the order in which the images are taken. In order to perform imaging according to the imaging order, the person in charge moves to the room designated by the imaging order and installs the imaging device 11. Communication has been established between the information processing device 10 and the imaging device 11, and the person in charge requests the information processing device 10 to take an image, and the information processing device 10 instructs the imaging device 11 to take an image. Imaging is performed. Note that the person in charge may directly press the shutter button 32 or the like provided on the imaging device 11.

In step 1015, the information processing device 10 acquires an image captured by the imaging device 11. In step 1020, the property ID acquired by the information processing apparatus 10 in step 1005 is associated with the image acquired by the information processing apparatus 10 in step 1015, and transmitted to the management apparatus 12. Then, the process ends in step 1025.

With reference to FIGS. 11 to 13, three methods for acquiring the property ID, such as step 1005 in FIG. 10, will be described. A first method for acquiring a property ID will be described with reference to FIG. 11. The first method is to output the property information held by the information providing system 13 onto paper or a terminal, read the target property information from the output property information with the information processing device 10, and read the read information. The method is to obtain the property ID from inside.

FIG. 11A is a diagram illustrating output property information, and FIG. 11B is a diagram illustrating a method for reading a code indicating information on a target property using the information processing device 10. Referring to FIG. 11A, the property information includes a property name, an address, a property ID, a floor plan type that is floor plan information, and a barcode that includes at least the property ID and the floor plan type. Furthermore, the camera 26 functioning as the imaging unit of the information processing device 10 captures the barcode of the target property, and the acquisition unit 90 analyzes the pattern from the captured barcode image to determine the property ID and floor plan type. can be extracted. The information processing device 10 then displays the property ID and floor plan type shown in FIG. 11(b) on the screen. Note that the information processing device 10 may include a separate analysis unit to analyze barcodes. Further, the code indicating property information is not limited to a barcode, and the property information may be read from a two-dimensional code such as a QR code (registered trademark).

The barcode may include address information in addition to the property ID and floor plan type. By including address information, it is possible to confirm whether the property is the desired property. Note that instead of the address information, information obtained by converting the address information into latitude and longitude may be included. By converting to latitude and longitude, the amount of information can be reduced compared to address information.

Information contained in the barcode can be read by pressing the image capture button 125 on the screen of the information processing device 10, activating the camera 26, and capturing an image of the barcode.

A smartphone that can be used as the information processing device 10 may have a GPS function. In this case, it is possible to confirm whether the property is the desired property by checking whether the latitude and longitude information measured by the GPS function matches the latitude and longitude information obtained from the barcode. Note that since it is rare for the latitude and longitude information to completely match, an error range is provided, and if it is within the error range, it can be determined that they match, and it is possible to confirm that it is the desired property.

If it is outside the error range, a warning can be issued. The alert can be issued as a warning display on the screen of the information processing device 10 or as a warning sound. If it is outside the error range, it is often an input error, so issuing an alert can prevent input errors.

After acquiring the property ID, the information processing device 10 inquires of the management device 12 whether an image with the same property ID has already been registered and photographed. When the information processing device 10 receives a response from the management device 12 that the photo has been taken, it issues an alert such as "This is the ID of the property that has been photographed." The response from the management device 12 may be only an answer as to whether or not the image has been photographed, but may also include information as to what year, month, and day the image was photographed. As a result, the information processing device 10 can display as an alert, ``This is the property ID photographed on XX year, XX month, XX''.

Further, when the information processing device 10 receives a reply including the photographing date from the management device 12, it may determine whether a predetermined period set in advance has elapsed since the photographing date. If a predetermined period of time has elapsed, the alert may not be issued. This can reduce the effort required to cancel alert settings. If the predetermined period of time has not elapsed, there is a low probability that the object to be imaged has changed, so the effort to take images again can be reduced.

The second method is to access the information providing system 13, search for a target property from among the properties held by the information providing system 13, and obtain information on the searched property. In the information processing device 10, an icon 126 for accessing a page provided by the information providing system 13 shown in FIG. 12(a) is lightly touched (tapped) once with a finger or the like. Next, a screen for searching for properties shown in FIG. 12(b) is displayed. The person in charge searches for the desired property based on the address, property name, etc. In FIG. 12(b), two search methods are displayed: "Search by lineside" and "Search by area."

When the target property is searched, a screen for performing panoramic photography of the property as shown in FIG. 12(c) can be opened. A property ID and a panoramic shooting button 127 are displayed on this screen. When the person in charge presses the panoramic shooting button 127, the person in charge acquires the property ID, etc., instructs to take an image of the target property, and starts a program for executing the process of posting the taken image.

When the program is started, a screen for selecting the property ID and floor plan type shown in FIG. 12(d) is displayed. The property ID is searched on the screen shown in FIG. 12(b) and obtained on the screen shown in FIG. 12(c). Therefore, the acquired property ID is automatically input on the screen shown in FIG. 12(d). The person in charge selects the floor plan type of the target property from among a plurality of preset floor plan types. The floor plan type can be selected by tapping, for example, "1K" on the pull-down menu 128.

In the second method, similarly to the first method, after acquiring the property ID, the information processing device 10 inquires of the management device 12 whether an image of the same property ID has been captured.

The third method is for the person in charge to input the property ID and select the floor plan type. The person in charge uses a keyboard or the like displayed on the screen of the information processing device 10 to input information in the property ID field 129 shown in FIG. The floor plan type can be selected by tapping the desired type on the pull-down menu 128, similar to the second method.

In the third method, similarly to the first method and the second method, when the information processing device 10 acquires the property ID, the information processing device 10 asks the management device 12 whether an image with the same property ID has been captured or not. Please inquire.

The process of acquiring an image will be described in detail with reference to FIG. 14. Processing begins at step 1400. In step 1405, the person in charge obtains the property ID. The property ID can be obtained by the methods shown in FIGS. 11 to 13. Further, the person in charge selects the floor plan type of the property, and the information processing device 10 receives the selection of the floor plan type. In step 1410, the room is identified from the floor plan type, it is determined whether the floor plan has been acquired, and the process branches. If the floor plan has been obtained, the process advances to step 1415, where imaging candidates are displayed and the imaging order is determined. If the floor plan has not been obtained, the process proceeds to step 1420, where a process of inputting a location as an imaging candidate is performed. Note that details regarding the process of inputting imaging candidates will be described later.

Here, the photographing order will be explained using FIG. 15. First, in step 1415, the imaging order is displayed on the screen of the information processing device 10 as shown in FIG. 15(a). In Figure 15(a), the shooting order is the room information "Living", "Dining Room", "Bed Room 1", "Bed Room 2", "Kitchen", "Bath Room", and "Entrance". They are lined up and the instructions are to take images in order starting with "Living."

In FIG. 15A, since no image has been taken yet, an image representing that there is nothing is displayed to the left of a character string representing a room such as "Living". If the image has already been captured, a thumbnail of the captured image is displayed. On the right side of the character string representing the room, there are provided a capture button 130 for requesting imaging, and a view button 131 for displaying the image for confirmation after imaging. Further, a post button 132 for posting a captured image, a cancel button 133, and a save button 134 for saving information such as the captured image in the information processing device 10 are also provided.

The person in charge takes images of each room in order, starting with "Living" at the top. The person in charge carries the imaging device 11 and moves to the room to be imaged.

Returning to FIG. 14, in step 1425, the installation position of the imaging device 11 is displayed on the screen of the information processing device 10. In response to the press of the photograph button 130, the information processing device 10 displays the installation position of the imaging device 11 in each room according to the photographing order, as shown in FIG. 15(b). Then, the person in charge installs the imaging device 11 at the installation position. The imaging device 11 can be installed, for example, on a support leg. Note that the display of the installation position of the imaging device 11 in step 1425 may be omitted. If step 1425 is omitted, the imaging device 11 is installed in the room where the image is to be taken at a position that the person in charge has determined is suitable for imaging.

The person in charge notifies the information processing device 10 of a response that the installation of the imaging device 11 has been completed. For example, the information processing device 10 displays a screen asking the person in charge whether the installation is complete, and the person in charge responds that the installation is complete. The process then proceeds to step 1430. In step 1430, the person in charge uses the imaging device 11 to capture an image. For example, a screen as shown in FIG. 15(c) is displayed, and the image capturing device 11 is instructed to take an image via the information processing device 10. The person in charge connects the information processing device 10 and the imaging device 11 if they are not connected, and presses the imaging button 135 to instruct imaging.

When using a spherical camera as the imaging device 11, in order to prevent the person in charge from being captured in the spherical image due to images taken in all directions, the person in charge must move outside the room where the spherical camera cannot be seen. You can instruct imaging by, for example, moving to . Further, different types of imaging devices 11 can be used for each room. For example, if you want to capture the entire space, such as a living room or kitchen, a spherical camera is used to image the entire space. In cases where only one side of the space is acceptable, such as an entrance or a hallway, the image may be captured using the camera 26 of the information processing device 10 or a general digital camera.

If the person in charge presses the photograph button 130, but the photograph has already been taken and is already registered in the management device 12, an alert such as "The photograph has already been registered" as shown in FIG. 16 can be displayed. The person in charge can look at the alert and decide whether to take an image.

Returning to FIG. 14, in step 1435, the information processing device 10 acquires an image from the imaging device 11. For example, the information processing device 10 receives an image and displays a preview screen for checking the captured image as shown in FIG. 17. The person in charge looks at the preview screen and determines whether the displayed image is suitable for transmission to the management device 12. Note that if the captured image includes a person, a part of the imaging device 11, etc., the person etc. can be automatically detected and an alert can be issued. The person in charge presses the share button 136 to proceed to the next process.

In response to the press of the share button 136, the information processing device 10 displays the screen shown in FIG. 18. Displayed on the screen are a button 137 for discarding the captured image and re-shooting, and a button 138 for proceeding to the next screen. The person in charge can select and press any button. The button 137 for discarding and re-imaging is a button for discarding the captured image and capturing an image of the same room again. The button 138 to proceed to the next screen is a button for capturing an image of the next room. The input reception unit 95 accepts as input that any button has been pressed and selected, and the control unit 91 discards the image or instructs the display unit 94 to display the next screen. .

In step 1440, the information processing device 10 determines whether a request for re-imaging has been received from the person in charge. If accepted, the process returns to step 1430 and instructs the imaging device 11 to take another image. For example, if the person in charge determines that the image is not suitable for transmission to the management device 12, the image is captured again. Therefore, the screen shown in FIG. 15(c) is displayed again. If not accepted, the process advances to step 1445. For example, if the person in charge determines that the image can be transmitted to the management device 12, the process proceeds to imaging the next room shown in the imaging order. Then, it is determined whether a request to obtain information on the installation position of the imaging device 11 in another room indicated in the next imaging order has been received. If accepted, the process returns to step 1425. Then, the processing from step 1425 to step 1440 is repeated.

If not accepted, the process advances to step 1450. For example, there may be a case where all the images of a room indicated in the image capturing order have been completed, or a case where a part of the images indicated in the image capturing order has been completed and the person in charge decides that they would like to temporarily transmit the images to the management device 12. Then, in step 1450, the property ID acquired in step 1405 is associated with the image and transmitted to the management device 12. The process ends in step 1455.

The person in charge takes all the images, and when the imaging is completed, presses the post button 132 shown in FIG. 15(a). In response to the press of the post button 132, the information processing device 10 associates all the captured images with the property ID and transmits them to the management device 12. Posting of images by transmission to the management device 12 can also be performed after all captured images are displayed in order and all are confirmed. At this time, the person in charge can check whether the order of the images is correct, whether there are any unnecessary images, etc.

Here, the process of inputting a location to be an imaging candidate in step 1420 will be explained. Step 1420 is a process that is executed when information regarding the floor plan has not been acquired, and the screen shown in FIG. 15(d) is displayed, and imaging candidates are input by the operator's operation. In FIG. 15(d), an imaging location input field 151 and an input field addition button 152 are displayed instead of the display in FIG. 15(a). In the imaging location input field 151, a person in charge can input an arbitrary imaging location. Furthermore, by tapping the input field addition button 152, the person in charge can add and display an imaging location input field 151, thereby allowing a plurality of imaging locations to be set. In FIG. 15D, the person in charge may input all imaging candidates in advance and then perform imaging at each imaging location, or may repeatedly input imaging candidates and perform imaging. This makes it possible to easily customize the imaging order based on the judgment of the person in charge.

Furthermore, in this embodiment, an image capturing location may be added by a person in charge after displaying as shown in FIG. 15(e). For example, when searching for a real estate property, the rooms that renters are interested in are often the same, so it is easy to predict which rooms will be imaged. Therefore, as shown in FIG. 15(e), locations predicted to have a high probability of being imaged, such as "Living" and "Dining Room", are displayed in advance as imaging candidates, and the person in charge also selects other rooms as imaging locations. You can also add it as This can reduce the effort required by the person in charge to input the imaging location.

Note that an input field addition button 152 may be provided in the display shown in FIG. 15(a). This allows the person in charge to add an imaging location (for example, a common area in the case of a real estate property) other than the imaging location preset according to the floor plan. Therefore, the person in charge can customize and set the imaging location and imaging order.

The imaging order is instructed so that each room is imaged one by one, but if multiple images are to be taken, a room can be added to the imaging order. Further, although the imaging device 11 releases the shutter when capturing an image, the imaging device 11 can transmit the captured images to the information processing device 10 continuously or at regular time intervals. Therefore, the information processing device 10 displays images continuously or at regular time intervals, and the person in charge can reinstall the device at an optimal position while checking the imaging position and instruct imaging.

When acquiring images, imaging conditions can be changed. Examples of the imaging conditions include image brightness (lightness), hue, and saturation. Here, the explanation will be given assuming that the brightness of the image is changed (adjusted). The brightness of the image can be adjusted by changing the value (EV value) indicating the brightness of exposure. The EV value is determined by the lens aperture (F number) and the exposure time of the solid-state image sensor (shutter speed).

The process of acquiring an image that involves changing the imaging conditions will be described with reference to FIG. 19. Steps 1900 to 1935 are similar to steps 1400 to 1435 shown in FIG. In step 1940, the person in charge changes the EV value using the information processing device 10 and changes the brightness of the displayed image. Step 1945 and subsequent steps are similar to steps 1440 and subsequent steps shown in FIG. 14. The input reception unit 95 can receive the EV value, and the EV value can be changed by giving an instruction to the imaging device 11 from the control unit 91.

The person in charge can check the captured image on the preview screen, change the imaging conditions on the preview screen, and adjust the brightness of the image. Further, before instructing to take an image, the brightness of the image may be adjusted in advance.

A method for changing imaging conditions on the preview screen will be described with reference to FIG. 20. FIG. 20(a) is a diagram illustrating a preview screen of a captured image. The preview screen is provided with a slide bar 139 for adjusting the EV value. The left end of the slide bar 139 indicates the smallest value (darkest), and the right end indicates the largest value (brightest). show.

The person in charge can change the EV value by moving the slide bar 139 toward the left end or right end. 20(b) and (c) are screens displaying images when the EV value is increased by moving the slide bar 139 from the position shown in FIG. 20(a) toward the right end. As the EV value increases from FIG. 20(a) to FIG. 20(c), it can be seen that the image becomes brighter.

When a spherical camera is used as the imaging device 11, the spherical image is generated by capturing an image using two fisheye lenses having an angle of view larger than 180° and joining the two obtained images. . On the preview screen, only a partial area of one of the spherical images is displayed.

Here, when displaying property information and room images on the communication terminal 14 of the renter, the initial image displayed first is an image of a part of the area displayed on the preview screen. When a person in charge asks a tenant to rent a property, they want to make the property look as good as possible. Therefore, the person in charge can change the area to a suitable area as the initial image to be displayed to the borrower and register it in the management device 12.

The process of acquiring an image with this area change will be described with reference to FIG. 21. Steps 2100 to 2135 are similar to steps 1400 to 1435 shown in FIG. 14 and steps 1900 to 1935 shown in FIG. 19. In step 2140, the person in charge changes the area displayed on the preview screen on the information processing device 10. The processing after step 2145 is the same as the processing after step 1440 shown in FIG. 14 and the processing after step 1945 shown in FIG. 19. The control unit 91 can instruct the transmitting unit 93 to transmit the changed image to the management device 12 for updating. This allows the initial image to be displayed as an image modified by the person in charge.

The area can be changed by the person in charge moving the screen of the information processing device 10 left and right or up and down (swiping or flicking) while keeping the screen in contact with the screen with a finger. By the way, the person in charge can shrink or enlarge an area by keeping two fingers in contact with the screen and moving them closer together or farther apart (pinch in, pinch out).

When the processing of the information processing device 10 shown in FIGS. 10, 14, 19, and 21 is completed, the management device 12 receives the image associated with the property ID. Then, the management device 12 stores the image in the storage unit 112, and when the registration of the image is completed, sends a registration completion notification to the information processing device 10. Upon receiving the registration completion notification, the information processing device 10 can display a message "Upload Success" shown in FIG. 22. Furthermore, the information processing device 10 can also display a message inquiring whether or not to "confirm with a browser" in order to have the person in charge confirm the uploaded content as the registered content.

Upon receiving this message, the person in charge can select "Yes" or "No", and by selecting "Yes", the uploaded content can be displayed.

As an image display method, for example, as shown in FIG. 23, an initial image 140 of a room whose imaging order is first is displayed in a predetermined size. Further, thumbnail images 141 of each room can be displayed side by side on the initial image 140. Further, a Click to Play button 142 is provided on the initial image 140, so that images in all directions can be displayed while changing areas over a certain period of time.

Further, a sentence (caption) that explains the image can be added to the image. The caption is room information such as "Living" or "Bed Room 1." A caption can be added when the information processing device 10 receives an image captured from the imaging device 11 and temporarily stores it. Room information is included in the imaging order. Therefore, when the capture button 124 of the room to be imaged is pressed, the information processing device 10 acquires the information of the room corresponding to the capture button 124, and when the captured image is received, the information processing device 10 acquires the information of the room. It can also be added as a caption.

Here, if the person in charge has been given "edit" authority by the administrator, the person in charge can edit the image after registering the image in the management device 12. Therefore, by associating the image with the floor plan, the person in charge can edit the image so that it is easy to understand the imaging position and the direction in which the initial image was taken. Furthermore, it will be easier for renters to understand the condition of the property. 24 and 25, image editing performed by a person in charge will be explained.

First, the person in charge inputs the property ID to be edited into a search screen as shown in FIG. 24(a). As a result, the management device 12 searches for images associated with the property ID. Next, an editing screen shown in FIG. 24(b) is displayed. The searched images can be displayed in order as thumbnail images 141 by pressing the import button 143. Of course, automatically searched images may be displayed as the thumbnail images 141. FIG. 24(b) shows a thumbnail image 141 displayed.

The person in charge selects a floor plan by dragging and dropping or by pressing the import button 144. Then, the floor plan is displayed within the frame indicated by the dotted line on the editing screen. The person in charge can use the link button 145 to associate the image displayed as the thumbnail image 141 with the floor plan. For example, an image corresponding to "Living" from among the thumbnail images 141 is selected and associated with the "Living" area in the floor plan. In such editing, the input receiving unit 95 receives the contents of editing for an image associated with a property ID, and the control unit 91 instructs the transmitting unit 93 to acquire the image. Further, this can be realized by the control unit 91 transmitting the edited image to the management device 12 and instructing it to be updated.

The edited image is shown in FIG. In FIG. 25, a floor plan 146 and an image 147 captured at the imaging position shown in the floor plan 146 are displayed in a superimposed manner. A plurality of imaging positions 148 are shown in the floor plan 146, and the imaging position of the currently displayed image 147 is shown to be distinguished from other imaging positions. Furthermore, in the floor plan 146, the direction and range of the currently displayed image 147 with respect to the imaging position 148 are also shown in a substantially fan shape.

The image 147 shows the direction of the neighboring imaging position 148, a symbol 149 for displaying the image taken at the imaging position 148, and a symbol 149 for displaying the upper, lower, left and right areas of the spherical image, and for enlarging and displaying the area. A button 150 for zooming out is shown.

By providing the floor plan 146, symbols 149, and various buttons 150, the renter can experience the feeling of actually being there and looking at each room while moving around.

By the way, in this embodiment, a list of imaging orders can be registered by the system administrator. For example, in the case of real estate, the order of imaging can be easily managed by associating the floor plan type with each room. That is, when the person in charge selects a floor plan on the screens shown in FIG. 11(b), FIG. 12(d), FIG. 13, etc., a list of imaging locations corresponding to the selected floor plan as shown in FIG. 15(a) is displayed. can. Here, the process of capturing and registering images based on the list will be described. FIG. 26 is a sequence diagram of processing executed in the information processing system.

The administrator uses the administrator PC 16 to access the management device 12 and performs tasks such as registering persons in charge and editing the list. Further, the person in charge uses the information processing device 10 to access the management device 12 to obtain the list, and uploads the captured image based on the list. The details of each process will be explained below.

First, in step 2600, the administrator PC 16 having management authority logs into the management device 12. Next, in step 2605, the administrator PC 16 registers the user identification information of the person in charge of taking and uploading images in the storage unit 112 of the management device 12. In step 2610, the management device 12 issues the ID and password of the person in charge registered in the storage unit 112. Note that the ID and password may be issued using the method described in FIG. 8 or the like.

In step 2615, the administrator notifies each person in charge of the issued ID and password. The notification of the ID and password may be given verbally directly to the person in charge, printed on paper and distributed, or sent via email via the network 15 to each person in charge. It is also possible to notify the information processing device 10 that is responsible.

Thereafter, the administrator PC 16 registers and edits the list in step 2620. FIG. 27 is a diagram illustrating a screen on which an administrator edits a list. After logging into the management device 12, the administrator PC 16 selects an item such as "Edit list" from the menu, thereby transitioning to the list editing screen shown in FIG. 27. The list editing screen includes a floor plan type setting pane and an imaging order setting pane. Each pane also includes a change order button 153, a delete button 154, an item name input field 155, and an add item button 156.

In the floor plan type setting pane, a floor plan type item can be added by entering the floor plan type in the item name input field 155a and pressing the add button 156a. Furthermore, the display order of the selected floor plan type can be changed using the up and down arrow order change buttons 153a. The selected floor plan type item is displayed in a dark color, and the selected item can be deleted by pressing the delete button 154a during selection.

Further, in the imaging order setting pane, the imaging location and imaging order corresponding to the floor plan item selected in the floor plan type setting pane are set. When the item selected on the floor plan type setting pane is changed, the display on the imaging order setting pane changes. In the imaging order setting pane, an imaging location can be added by entering the imaging location in the item name input field 155b and pressing the add button 156b. Furthermore, the imaging order can be changed using the up arrow or down arrow order change buttons 153b. The item of the selected imaging location is displayed in a dark color, and the selected item can be deleted by pressing the delete button 154b during selection.

The explanation returns to FIG. 26. In step 2620, the list created by the administrator PC 16 is held in the storage unit 112 of the management device 12. Note that the registration of the list may be performed before the registration of the person in charge in step 2605.

Next, in step 2625, the information processing device 10 logs into the management device 12 using the notified ID and password. Login is performed using the screen shown in FIG. 9, for example. When the management device 12 receives the login, the control unit 111 queries the information of the person in charge registered in the storage unit 112, and if the person in charge who has logged in is registered, the login is permitted.

Upon receiving the login of the person in charge, the management device 12 notifies the information processing device 10 of the list registered in the storage unit 112 in step 2630. The information processing device 10 uses the acquisition unit 90 to acquire the list notified from the management device 12 .

In step 2635, the person in charge images each imaging location based on the imaging order displayed in the list. Note that in step 2635, the information processing device 10 may receive an image captured by the receiving unit 92 using the imaging device 11 or a general digital camera, or the information processing device 10 may receive an image captured by the receiving unit 92. The image may be captured using the camera 26.

Thereafter, the information processing device 10 uploads the captured image to the management device 12 in step 2640. In step 2640, the transmitter 93 of the information processing device 10 associates the captured image with the property ID and transmits the associated image. Note that the processing in steps 2635 and 2640 corresponds to the processing in steps 1430 to 1450 in FIG. 14 and the like.

The receiving unit 110 of the management device 12 receives the uploaded image in step 2640, and in step 2645, the control unit 111 registers the uploaded image in association with the imaging location in the list, and stores it in the storage unit 112. .

By editing the list as described above, it is possible to customize the list according to the purpose, which reduces the effort required by the person in charge when taking images. Also, by having each person in charge use the same list, it is possible to standardize the notation. For example, it is possible to eliminate variations in spellings such as "Living," "LIVING," and "living," improving convenience for staff and borrowers.

From the above, by providing an information processing system, an information processing device 10, an information processing method executed by them, and a program for causing a computer to execute the processing, it is possible to realize posting of images with simple processing. can. Furthermore, if an image has already been taken and a registered property ID is entered, an alert can be issued, which prevents the registration of incorrect images. Since alerts are not issued for properties for which a predetermined period of time has passed since the previous registration, the effort of confirming and canceling alerts can be reduced.

Up to now, the present invention has been described using the above-described embodiments as an information processing device, an information processing system, an authentication method, and a program, but the present invention is not limited to the above-described embodiments. The present invention can be modified within the scope of those skilled in the art, such as other embodiments, additions, changes, deletions, etc., and as long as the functions and effects of the present invention are achieved in any embodiment. It is within the scope of the invention.

Therefore, the program can be installed on a floppy disk, CD (Compact Disk), CD-R (Compact Disk Read Only Memory), DVD (Digital Versatile Disk), or SD memory as a file in an installable or executable format. It can be configured to be recorded and provided on a computer-readable recording medium such as a card (SD Memory Card) or a USB memory (Universal Serial Bus Memory). Further, the above program may be configured to be provided or distributed via a network such as the Internet. Furthermore, the above-mentioned program may be provided in a ROM or the like in advance together with various other software.

In the above embodiment, each of the above functional units is implemented by loading a program that implements each functional unit onto the RAM by the CPU reading and executing a program stored in the HDD, etc. is being generated. However, the present invention is not limited to this, and for example, at least a portion of each functional unit may be realized by a dedicated hardware circuit (for example, a semiconductor integrated circuit).

10... Information processing device, 11... Imaging device, 12... Management device, 13... Information providing system, 14... Communication terminal, 15... Network, 16... Administrator PC, 20... CPU, 21... ROM, 22... RAM, 23 ...flash memory, 24...connection I/F, 25...operation panel, 26...camera, 27...communication I/F, 28...bus, 30...imaging body, 31...casing, 32...shutter button, 33A, 33B... Imaging optical system, 34A, 34B...solid-state image sensor, 40...processor, 41...lens barrel unit, 42, 43...SDRAM, 44...memory card slot, 45...flash ROM, 46...USB connector, 47...power switch, 48...Speaker, 49...Microphone, 50...Wireless NIC, 51...LCD monitor, 52...3-axis acceleration sensor, 60A, 60B...ISP, 61...DMAC, 62...Arbiter, 63...MEMC, 64...Distortion correction/image synthesis Block, 65...DMAC, 66...Image processing block, 67...CPU, 68...Image data transfer unit, 69...SDRAMC, 70...Memory card control block, 71...USB block, 72...Peripheral block, 73...Audio unit, 74 ...Serial block, 75...LCD driver, 76...Bridge, 77...Resize block, 78...JPEG block, 79...H.264 block, 80...CPU, 81...ROM, 82...RAM, 83...HDD, 84...Communication I /F, 85... Bus, 90... Acquisition section, 91... Control section, 92... Receiving section, 93... Transmitting section, 94... Display section, 95... Input receiving section, 96... Storage section, 100... Receiving section, 101... Control unit, 102... Imaging unit, 103... Image processing unit, 104... Transmitting unit, 110... Receiving unit, 111... Control unit, 112... Storage unit, 113... Transmitting unit, 120, 121... Column, 122... Automatic generation button , 123... Column, 124... Login button, 125... Imaging button, 126... Icon, 127... Panorama shooting button, 128... Pull-down menu, 129... Column, 130... Capture button, 131... View button, 132... Submit button, 133 ...Cancel button, 134...Save button, 135...Image capture button, 136...Share button, 137...Button to reshoot, 138...Button to proceed to next screen, 139...Slide bar, 140...Initial image, 141...Thumbnail image, 142 …Click to Play button, 143, 144…Import button, 145…Link button, 146…Floor plan, 147…Image, 148…Imaging position, 149…Symbol, 150…Button, 151…Imaging location input field, 152…Input Add column button, 153...Order change button, 154...Delete button, 155...Item name input field, 156...Add item button

JP2015-35178A

Claims (20)

A management system comprising an information processing device and a management device that manages property information for each property identification information,
The information processing device includes:
Obtain a shooting instruction specifying the shooting order for the location to be shot in the floor plan information of the property,
Notifying the specified shooting order;
transmitting an image taken based on the notification to the management device in association with floor plan information of the property;
The management device is a management system that manages the received image in association with identification information of the property. The management system according to claim 1, wherein the floor plan information is room information including the number of rooms and the type of the rooms. 3. The management system according to claim 1, wherein the information processing device displays the floor plan information and sets the photographing instruction with respect to the floor plan information. The information processing device has a receiving means for receiving the images taken by the photographing device, and upon receiving all the images photographed according to the designated photographing instruction, accepts a transmission instruction to transmit to the management device. The management system according to any one of claims 1 to 3. The information processing device adds identification information of the property to the image received by the receiving means, and transmits the image to the management device. The management system according to claim 4. The information processing apparatus according to any one of claims 1 to 5, further comprising a display means for displaying the photographing order, and the display means displays a photographing situation for the photographing instruction separately as before photographing and after photographing. The management system according to any one of the items. 7. The management system according to claim 6, wherein when the photographing status is after photographing, thumbnails of the photographed images are displayed together with the displayed photographing order. 8. The information processing device associates the image to which the identification information, which is managed by the management device, with the floor plan of the property corresponding to the identification information. management system. 9. The management system according to claim 1, wherein the information processing device acquires the floor plan information through user input or from an information providing system. The management system according to claim 1, wherein the identification information is information input by a user or information obtained from an information providing system. The management system according to claim 1, wherein the image is a spherical image or a panoramic image. Obtain a shooting instruction specifying the shooting order for the location to be shot in the floor plan information of the property,
Notifying the specified shooting order;
transmitting an image taken based on the notification to a management device that manages the image in association with floor plan information of the property and in association with identification information of the property;
Information processing device. The floor plan information is room information including the number of rooms and the type of the room, and the information processing device further displays the floor plan information and sets the photographing instruction with respect to the floor plan information. The information processing device according to claim 12. The information processing device has a receiving means for receiving the images taken by the photographing device, and upon receiving all the images photographed according to the designated photographing instruction, accepts a transmission instruction to transmit to the management device, The information processing device according to claim 12 or 13, wherein identification information of the property is added to the image received by the receiving means and the image is transmitted to the management device. to the computer,
obtaining a photographing instruction specifying a photographing order for a location to be photographed in the floor plan information of the property;
a step of notifying the designated photographing order; and
A program for causing an image taken based on the notification to be associated with floor plan information of the property and transmitted to a management device that manages the image in association with identification information of the property. The floor plan information is room information including the number of rooms and the type of the room, and the program further displays the floor plan information on the computer and sets the shooting instruction for the floor plan information. 16. The program according to claim 15. The program further causes the computer to receive the images photographed by the photographing device, and upon receiving all the images photographed according to the designated photographing instruction, accepts a transmission instruction to transmit to the management device, and receives the image. The program according to claim 15 or 16, which adds identification information of the object to the image and causes the image to be transmitted to the management device. the information processing device obtains a photographing instruction specifying a photographing order for a location to be photographed in the floor plan information of the property;
the information processing device notifying the specified imaging order;
The information processing device associates the image taken based on the notification with the floor plan information of the property, and transmits the image to a management device that manages the image in association with identification information of the property. Including, methods. The floor plan information is room information including the number of rooms and the type of the room, and the method includes:
19. The method according to claim 18, further comprising: the information processing device displaying floor plan information and setting the photographing instruction with respect to the floor plan information. the information processing device receiving the image captured by the imaging device;
When the information processing device receives all the images shot according to the specified shooting instruction, it accepts a transmission instruction to send to the management device, adds identification information of the property to the received images, and sends the images to the management device. 20. The method of claim 18 or 19, further comprising: transmitting to a device.