WO2024024099A1 - Information processing system and information processing method - Google Patents

Information processing system and information processing method Download PDF

Info

Publication number
WO2024024099A1
WO2024024099A1 PCT/JP2022/029335 JP2022029335W WO2024024099A1 WO 2024024099 A1 WO2024024099 A1 WO 2024024099A1 JP 2022029335 W JP2022029335 W JP 2022029335W WO 2024024099 A1 WO2024024099 A1 WO 2024024099A1
Authority
WO
WIPO (PCT)
Prior art keywords
model
change
information
code
information processing
Prior art date
Application number
PCT/JP2022/029335
Other languages
French (fr)
Japanese (ja)
Inventor
英弟 謝
彦鵬 張
許夢▲セン▼
雨佳 劉
道久 井口
Original Assignee
株式会社Vrc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社Vrc filed Critical 株式会社Vrc
Priority to PCT/JP2022/029335 priority Critical patent/WO2024024099A1/en
Priority to JP2022549382A priority patent/JPWO2024024099A1/ja
Publication of WO2024024099A1 publication Critical patent/WO2024024099A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device

Definitions

  • the present invention relates to a technique for embedding watermark information in three-dimensional shape data.
  • Patent Document 1 in order to embed watermark information in three-dimensional shape data, predetermined bits of parameters related to display mode are changed to numerical information obtained by converting the watermark information, and the watermark information is embedded in three-dimensional shape data.
  • the present invention aims to utilize digital watermarks for more diverse purposes in a 3D data system.
  • One aspect of the present invention includes: a receiving unit that accepts a change in information regarding a 3D model; a generating unit that generates a code that specifies the change; and an embedding unit that embeds the generated code in the 3D model as a digital watermark.
  • An information processing system is provided.
  • the generating means may generate an image code, and the embedding means may embed the image code in the 3D model.
  • the embedding means may embed the image code as a change in the geometry of the 3D model.
  • the embedding means may embed the image code as a change in the texture of the 3D model.
  • This information processing system may include a removal unit that removes the digital watermark from the 3D model, and a display unit that displays the 3D model from which the digital watermark has been removed by the removal unit.
  • Changing the information regarding the 3D model may be editing the 3D model.
  • the code may indicate a change history of the 3D model.
  • the code may indicate biological information obtained from the subject of the 3D model.
  • the biometric information is any of a plurality of predetermined types of biometric information
  • the embedding means adds an electronic watermark to the 3D model in a format corresponding to the type of information for which change is accepted by the accepting means. May be embedded.
  • Another aspect of the present invention includes the steps of accepting a change in information regarding a 3D model, generating a code that specifies the change, and embedding the generated code in the 3D model as a digital watermark. .
  • digital watermarks can be used for more diverse purposes in a 3D data system.
  • FIG. 1 is a diagram showing an overview of an information processing system according to an embodiment.
  • FIG. 1 is a diagram illustrating a functional configuration of an information processing system.
  • FIG. 3 is a diagram illustrating the hardware configuration of a server. The figure which illustrates the hardware configuration of the change terminal. The figure which illustrates the hardware configuration of the viewing terminal.
  • FIG. 3 is a sequence diagram illustrating a 3D data change process.
  • a diagram illustrating a change information database. 3 is a flowchart illustrating the operation of a viewing terminal that performs 3D data display processing.
  • a diagram illustrating a 3D data display screen. A diagram illustrating a 3D data display screen.
  • a diagram illustrating a 3D data display screen. illustrating a 3D data display screen.
  • Output unit 306... Input section, 401... Processor, 402... Memory, 403... Interface, 404... Communication section, 405... Output section, 406... Input section, 901... Watermark button, 902... Change history button, 903... Body temperature map button, 1001 ...QR code (registered trademark), 1002...QR code (registered trademark), 1003...QR code (registered trademark), 3051...display, 3061...touch panel, 4051...display, 4061...touch panel
  • FIG. 1 is a diagram showing an overview of an information processing system S according to an embodiment.
  • the information processing system S includes a server 10, a network 20, a change terminal 30, and a viewing terminal 40.
  • the network 20 is a network line network such as the Internet.
  • the change terminal 30 and the viewing terminal 40 can be connected to the network 20 by wire or wirelessly, and can communicate with the server 10 connected to the network 20 via the network 20.
  • the information processing system S is a system that generates a digital watermark based on changes in 3D model data (hereinafter referred to as 3D data) and embeds the generated digital watermark in the 3D data.
  • 3D model is a three-dimensional model in the shape of a subject that is generated using a 3D scanner, and is, for example, a person or an animal such as a pet.
  • the 3D model accurately reproduces the external features of the human body.
  • the digital watermark includes information regarding the 3D model (hereinafter referred to as model information).
  • the model information is, for example, biological information of a subject corresponding to a 3D model.
  • the biological information of the subject is, for example, heart rate, blood pressure, body temperature map, measurement data, exercise history, meal history, or medical history.
  • the model information is changed by an operation by a user (hereinafter referred to as a changer) on the change terminal 30.
  • Changing model information is, for example, editing already existing model information, adding new model information, or deleting already existing model information.
  • Information related to changes in model information (hereinafter referred to as change information) is specified by a code generated to specify the change information. That is, the code contains change information.
  • the code is, for example, a QR code (registered trademark), a body temperature map, or a contour line (hereinafter collectively referred to as an image code).
  • the code is embedded into the 3D model as a digital watermark.
  • the code embedded as a digital watermark is switched between display and non-display based on predetermined conditions.
  • various services using 3D data as a key can be realized.
  • the various services are, for example, support for telemedicine, support for health promotion, or support for purchasing decorative items.
  • a code including a history of a patient's biometric information is embedded as a digital watermark in a 3D model with the patient as the subject.
  • a doctor who examines a patient at a location different from the patient's location can check the patient's physique using a 3D model and examine the patient using the history of biometric information embedded as a digital watermark.
  • the changer is the patient and the viewer is the doctor.
  • a code containing the exercise history of a trainee at a gym is embedded as a digital watermark in a 3D model with the trainee as the subject.
  • a trainer who provides exercise guidance to a trainee can use a 3D model to check the patient's physique in detail, and use the exercise history embedded as a digital watermark to provide exercise guidance to the trainee.
  • the changer is the trainee and the viewer is the trainer.
  • a code containing measurement data of the wearer of clothing is embedded as a digital watermark in a 3D model with the wearer as the subject.
  • a clothing purchaser can select and purchase clothing that fits the wearer's body while checking the wearer's body size using a 3D model.
  • the viewing terminal 40 By using the viewing terminal 40 to virtually try on the 3D model of the clothing on the 3D model of the wearer, the purchaser can virtually try on the 3D model of the wearer.
  • the changer is the wearer and the viewer is the purchaser.
  • the server 10 is a server that embeds a digital watermark in the 3D model based on the change information obtained from the change terminal 30.
  • the server 10 generates a code that specifies the change information.
  • the server 10 embeds the generated code in the 3D model as a digital watermark, and stores the 3D model with the digital watermark embedded therein.
  • the change terminal 30 is a terminal that accepts changes to 3D data or model information according to an operation by a changer.
  • the change terminal 30 generates change information and transmits the change information to the server 10.
  • the viewing terminal 40 acquires 3D data in response to operations by the viewer.
  • the viewing terminal 40 displays the 3D data from which the digital watermark has been removed.
  • FIG. 2 is a diagram illustrating the functional configuration of the information processing system S.
  • the information processing system S includes a requesting means 201, an acquiring means 202, a transmitting means 203, an acquiring means 204, an accepting means 205, a generating means 206, a transmitting means 207, an accepting means 208, a generating means 209, an embedding means 210, a storage means 211 , transmission means 212, acquisition means 213, removal means 214, display means 215, control means 216, control means 217, and control means 218.
  • the acquisition unit 202 acquires a request for 3D data from the change terminal 30.
  • the transmitting means 203 transmits 3D data to the change terminal 30 in response to a request from the change terminal 30.
  • the accepting means 208 accepts changes to model information from the change terminal 30.
  • the generating means 209 generates a code that specifies a change in model information.
  • the embedding means 210 embeds a code in the 3D model as a digital watermark.
  • the storage means 211 stores various data including 3D data.
  • the transmitting means 212 transmits 3D data to the viewing terminal 40 in response to a request from the viewing terminal 40.
  • Control means 216 executes various controls.
  • the requesting means 201 requests the server 10 to transmit 3D data.
  • the acquisition means 204 acquires 3D data from the server 10.
  • the accepting means 205 accepts changes to the model information through the change user's operation of the change terminal 30.
  • the generating means 206 generates change information.
  • the transmitting means 207 transmits the change information to the server 10.
  • Control means 217 executes various controls.
  • the acquisition means 213 acquires 3D data from the server 10.
  • the removal unit 214 removes the digital watermark from the 3D data.
  • the display means 215 displays the 3D data from which the digital watermark has been removed.
  • Control means 218 executes various controls.
  • FIG. 3 is a diagram illustrating the hardware configuration of the server 10.
  • the server 10 is a computer device having a CPU (Central Processing Unit) 101, a memory 102, a storage 103, and a communication IF (Interface) 104.
  • the CPU 101 is a control device that executes programs, performs various calculations, and controls other hardware elements of the server 10.
  • the memory 102 is a main storage device that functions as a work area when the CPU 101 executes a program.
  • the storage 103 is a nonvolatile auxiliary storage device that stores various programs and data.
  • the communication IF 104 is a communication device that communicates with other devices according to a predetermined communication standard (eg, Ethernet (registered trademark)).
  • the storage 103 stores a program (hereinafter referred to as a "server program") for causing a computer device to function as the server 10 in the information processing system S.
  • the functions shown in FIG. 3 are implemented in the computer device by the CPU 101 executing the server program.
  • the CPU 101 executes the server program
  • at least one of the memory 102 and the storage 103 is an example of the storage means 211
  • the CPU 101 is an example of the generation means 209, the embedding means 210, and the control means 216
  • the communication IF 104 is an example of the acquisition means 202, the transmission means 203, the reception means 208, and the transmission means 212.
  • FIG. 4 is a diagram illustrating the hardware configuration of the change terminal 30.
  • the change terminal 30 is a computer device that includes a processor 301 , a memory 302 , an interface 303 , a communication section 304 , an output section 305 , and an input section 306 . These structures are communicatively connected to each other, for example by a bus.
  • the processor 301 controls each part of the change terminal 30 by reading and executing a computer program (hereinafter simply referred to as a program) stored in the memory 302.
  • the processor 301 is, for example, a CPU (Central Processing Unit).
  • the memory 302 is a storage unit that stores the OS, various programs, data, etc. that are read into the processor 301.
  • the memory 302 includes a RAM (Random Access Memory) and a ROM (Read Only Memory). Note that the memory 302 may include an auxiliary storage device such as a solid state drive or a hard disk drive.
  • the interface 303 is a communication circuit that communicably connects the processor 301 to the communication unit 304, output unit 305, and input unit 306.
  • the communication unit 304 controls communication with the server 10 via the network 20.
  • the output unit 305 includes a display unit such as a display and an audio output unit such as a speaker, and outputs images, characters, or audio.
  • the output unit 305 includes a display 3051 in this embodiment.
  • the display 3051 is configured with a flat panel display such as a liquid crystal display or an organic EL display, and outputs images or characters.
  • the input unit 306 is an operation unit configured with a keyboard, a mouse, or the like, and inputs various information according to the user's instructions.
  • the input unit 306 is configured with a touch panel 3061.
  • the touch panel 3061 is an electronic component such as a touch pad that combines the display 3051, which is a flat panel display, with a position input device, and is an input device that allows the user to operate the device by touching the display portion on the screen.
  • the programs stored in the memory 302 include a program for causing the computer to function as the change terminal 30 in the information processing system S (hereinafter referred to as the "change terminal program").
  • the functions shown in FIG. 2 are implemented in the change terminal 30 by the processor 301 executing the change terminal program.
  • the processor 301 is an example of the reception means 205, the generation means 206, and the control means 217, and the communication section 304 is an example of the request means 201, the acquisition means 204, and the transmission means 207. This is an example.
  • a tablet terminal is used as the change terminal 30, but a PC (personal computer), a smartphone, or the like may also be used.
  • FIG. 5 is a diagram illustrating the hardware configuration of the viewing terminal 40.
  • the viewing terminal 40 is a computer device having a processor 401, a memory 402, an interface 403, a communication section 404, an output section 405, and an input section 406. These structures are communicatively connected to each other, for example by a bus.
  • the processor 401 controls each part of the viewing terminal 40 by reading and executing a computer program (hereinafter simply referred to as a program) stored in the memory 402.
  • the processor 401 is, for example, a CPU (Central Processing Unit).
  • the memory 402 is a storage unit that stores the OS, various programs, data, etc. that are read into the processor 401.
  • the memory 402 includes a RAM (Random Access Memory) and a ROM (Read Only Memory). Note that the memory 402 may include a solid state drive, a hard disk drive, or the like.
  • the interface 403 is a communication circuit that communicably connects the processor 401 to the communication unit 404, output unit 405, and input unit 406.
  • the communication unit 404 controls communication with the server 10 via the network 20.
  • the output unit 405 includes a display unit such as a display and an audio output unit such as a speaker, and outputs images, characters, or audio.
  • the output unit 405 includes a display 4051 in this embodiment.
  • the display 4051 is configured with a flat panel display such as a liquid crystal display or an organic EL display, and outputs images or characters.
  • the input unit 406 is an operation unit configured with a keyboard, a mouse, or the like, and inputs various information according to the user's instruction operation.
  • the input unit 406 is configured with a touch panel 4061.
  • the touch panel 4061 is an electronic component such as a touch pad that combines the display 4051, which is a flat panel display, with a position input device, and is an input device that allows the user to operate the device by touching the display portion on the screen.
  • the programs stored in the memory 402 include a program for causing the computer to function as the viewing terminal 40 in the information processing system S (hereinafter referred to as the "viewing terminal program").
  • the functions shown in FIG. 2 are implemented in the viewing terminal 40 by the processor 401 executing the viewing terminal program.
  • the processor 401 is an example of the removal means 214 and the control means 218, the communication unit 404 is an example of the acquisition means 213, and the display 4051 is an example of the display means 215. This is an example.
  • a tablet terminal is used as the viewing terminal 40, but a PC (personal computer), a smartphone, or the like may also be used.
  • FIG. 6 is a sequence diagram illustrating a 3D data changing process in the information processing system S.
  • the modification terminal 30 starts an application for editing the 3D data through an operation by the modification person.
  • the requesting means 201 of the change terminal 30 requests the server 10 for 3D data to be displayed in the application of the change terminal 30 (step S601).
  • the acquisition means 202 of the server 10 acquires a request for 3D data from the change terminal 30.
  • step S602 the transmitting means 203 of the server 10 transmits the 3D data to the change terminal 30.
  • the acquisition means 204 of the change terminal 30 acquires the 3D data transmitted from the server 10.
  • step S603 the accepting means 205 of the change terminal 30 accepts changes to the model information through an operation by the changer.
  • step S604 the generation means 206 of the change terminal 30 generates change information.
  • the change information includes the model ID, date of change, category of change, content of change, and name of the person making the change.
  • the model ID is an ID for uniquely identifying the subject corresponding to the 3D model.
  • the categories of changes are editing, addition, or deletion. Editing is when existing model information is edited, and addition is when new model information is added to an already existing model. When information is deleted, it is deleted. For example, assume that on June 12, 2022, a person named Taro Yamada added glasses to the face of a 3D model whose model ID is xxx.
  • the change information includes "xxx” for the model name, "June 12, 2022” as the date of the change, "Add” as the change category, “Glasses” as the change content, and the person who made the change. His name includes “Taro Yamada”. If the color of the glasses originally worn by the 3D model is changed, the category of the change is “edit” and the content of the change is “glasses.”
  • step S605 the transmitting means 207 of the change terminal 30 transmits the change information to the server 10.
  • the receiving means 208 of the server 10 receives change information transmitted from the change terminal 30.
  • step S606 the generation means 209 of the server 10 generates a code for specifying the change information.
  • the types of information included in the code include, for example, information that represents the distribution of physical quantities on the 3D model surface (hereinafter referred to as distribution information), or information that does not represent the distribution of physical quantities on the 3D model surface (hereinafter referred to as non-distribution information). ).
  • the format of the code indicating the distribution information is, for example, a body temperature map or a contour line.
  • the format of the code indicating non-distribution information is, for example, a QR code (registered trademark).
  • the format of the code to be generated in step S606 is determined depending on the content of the change information. For example, if the change information is blood pressure, a QR code (registered trademark) is generated, and if the change information is a body temperature map, a body temperature map is generated.
  • the embedding means 210 of the server 10 embeds the code in the 3D model as a digital watermark.
  • a 3D model is composed of geometry and texture. Geometry is a group of data representing parameters of functions and mathematical formulas that constitute the external shape of a solid that is displayed as a 3D model. Texture is an image used to express the texture or color of a three-dimensional surface.
  • a digital watermark may be embedded as a change in the geometry of a 3D model, as a change in the texture of the 3D model, or as a change in both the geometry and texture of the 3D model.
  • a digital watermark When a digital watermark is embedded as a change in the geometry of a 3D model, a change in shape is given to the 3D model, and the digital watermark is embedded in the 3D model in such a way that the change is visible.
  • a digital watermark When a digital watermark is embedded as a change in the texture of a 3D model, a colored digital watermark is embedded in the 3D model without changing its shape.
  • a digital watermark is embedded as a change in both the geometry and texture of a 3D model, a change in shape is given to the 3D model, and the digital watermark with color etc. is embedded in the 3D model in a form that allows the change to be visually recognized. How the digital watermark is embedded is determined by, for example, the operation of the change terminal 30 by the person making the change.
  • step S608 the storage means 211 of the server 10 stores the 3D model with the digital watermark embedded in the change information database.
  • FIG. 7 is a diagram illustrating the change information database.
  • the change information database contains change information.
  • the change information database stores the date of change, category of change, content of change, and name of the person making the change in association with the model ID.
  • the change information database also stores change information stored in the past.
  • FIG. 8 is a flowchart illustrating the operation of the viewing terminal 40 that performs 3D data display processing.
  • the viewing terminal 40 starts an application for displaying 3D data through an operation by a viewer.
  • the 3D data display process is started when the viewing terminal 40 requests the server 10 to display 3D data.
  • the transmitting means 212 of the server 10 transmits 3D data.
  • the acquisition means 213 of the viewing terminal 40 acquires 3D data (step S901).
  • step S902 the removing means 214 of the viewing terminal 40 removes the electronic watermark included in the 3D data when the viewing terminal 40 has an encryption key stored in advance in association with the 3D data. do. That is, regarding the removal of the digital watermark of the 3D data acquired in step S901, if the viewing terminal 40 has been authenticated, the digital watermark is removed. Furthermore, if other predetermined conditions are met, the digital watermark is removed.
  • the predetermined condition is, for example, when the subject corresponding to the 3D data allows the viewing terminal 40 to display the subject's own 3D model, or when the viewing terminal 40 manages the information processing system S. This is a case where a 3D model is acquired using an application specified by a person or the like.
  • the digital watermark may be removed depending on the type of change information. For example, if the category of modification corresponding to the digital watermark embedded in the acquired 3D model is a specific category (eg, "add” or "delete”), the digital watermark may be removed.
  • step S903 the display means 215 of the viewing terminal 40 displays the 3D data from which the digital watermark has been removed.
  • Various types of 3D data can be displayed by the viewer selecting various buttons displayed on the viewing terminal 40.
  • FIGS. 9 to 12 are diagrams illustrating 3D data display screens.
  • a 3D model, a watermark button 901, a change history button 902, and a body temperature map button 903 are displayed.
  • the viewer can select at least one of the watermark button 901, change history button 902, and body temperature map button 903 through operation of the viewing terminal 40.
  • the button is selected in response to the viewer pressing the button on the viewing terminal 40.
  • the line surrounding the selected button is thicker than the line surrounding the unselected button, so the viewer can easily recognize which button is in the selected state.
  • FIG. 9 is a 3D data display screen displayed on the viewing terminal 40 in step S903. In the diagram shown in FIG. 9, all buttons are not selected.
  • the watermark button 901 is selected, and the change history button 902 and body temperature map button 903 are not selected.
  • a digital watermark is displayed superimposed on the 3D model.
  • QR codes registered trademark
  • 1001 to 1003 are displayed as digital watermarks. If the watermark button 901 is pressed through an operation by the viewer while the watermark button 901 is selected, the watermark button 901 becomes unselected and the digital watermark is no longer displayed on the 3D model.
  • the viewing terminal 40 used by the viewer has not been certified for digital watermark removal, a screen as shown in FIG. 10 is displayed on the viewing terminal 40. Further, even if the viewing terminal 40 has been authenticated, if the viewer presses the watermark button and the watermark button 901 becomes selected, the screen shown in FIG. 10 will be displayed on the viewing terminal. 40.
  • the change history button 902 is selected, and the watermark button 901 and body temperature map button 903 are not selected.
  • the change history button 902 is selected, the change history of the 3D model is displayed together with the 3D model.
  • the change history includes, among the change information, the date on which the change was executed, the category of the change, the content of the change, and the name of the person who made the change. For example, in the diagram shown in FIG. 11, glasses were added to the 3D model on June 12, 2022 by a changer named Taro Yamada. If the change history button 902 is pressed through an operation by the viewer while the change history button 902 is selected, the change history button 902 becomes unselected and the display 4051 of the viewing terminal 40 shows Change history is no longer displayed. By displaying the change history on the viewing terminal 40, the viewer can easily recognize the changes in the 3D model.
  • the body temperature map button 903 is selected, and the watermark button 901 and change history button 902 are not selected.
  • the body temperature map button 903 is selected, the body temperature map is displayed overlapping the 3D model.
  • the body temperature map button 903 is pressed through an operation by the viewer, the body temperature map button 903 becomes unselected, and the body temperature map is no longer displayed on the 3D model.
  • the viewer can easily recognize the body temperature distribution of the person corresponding to the 3D model. For example, if the viewer is a doctor and the person corresponding to the 3D model is a patient who is in a different location than the doctor, the doctor can determine the temperature of which part of the patient's body. You can know specifically.
  • the biological information used as model information is not limited to heart rate, blood pressure, body temperature map, measurement data, exercise history, meal history, or medical history, and may be any information related to the physical condition of the subject of the 3D model.
  • the biological information may be, for example, a history of body weight.
  • buttons displayed on the 3D data display screen are not limited to the watermark button 901, change history button 902, and body temperature map button 903.
  • the button may be, for example, a contour button for displaying contour lines.
  • the change history displayed on the 3D data display screen does not necessarily have to include all the change history. For example, a history of changes over a predetermined period such as the past six months may be displayed, or only change information whose change category is editing may be displayed.
  • the change terminal 30 and the viewing terminal 40 are not limited to being different terminals, and the changing terminal 30 and the viewing terminal 40 may be the same terminal.
  • the changing terminal program and the viewing terminal program are not limited to being different programs, and may be the same program.
  • the program has both the function of changing the 3D model and the function of displaying the 3D model.
  • the correspondence between functional elements and hardware elements in the information processing system S is not limited to that illustrated in the embodiment.
  • some of the functions described as the functions of the server 10 in the embodiment may be implemented in another server.
  • some of the functions described as the functions of the server 10 in the embodiment may be implemented in other devices on the network.
  • the server 10 may be a physical server or a virtual server (including a so-called cloud server).
  • a part or all of the functions of the change terminal 30 or the viewing terminal 40 may be implemented in the server 10.
  • the operation of the information processing system S is not limited to the example described above.
  • the order of the processing procedures of the information processing system S may be changed as long as there is no contradiction. Further, some processing procedures of the information processing system S may be omitted.
  • a reception step that receives a change in information regarding a 3D model, a generation unit that generates a code that specifies the change, and embeds the generated code in the 3D model as a digital watermark. It is sufficient that the embedding means is executed.
  • the various programs illustrated in the embodiments may be provided by downloading via a network such as the Internet, or may be provided on a computer-readable non-temporary recording medium such as a DVD-ROM (Digital Versatile Disc Read Only Memory). It may be provided in a recorded state.
  • a network such as the Internet
  • DVD-ROM Digital Versatile Disc Read Only Memory

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

This information processing system has a reception means that receives a change in information relating to a 3D model, a generation means that generates a code specifying said change, and an embedding means that embeds the generated code in the 3D model as an electronic watermark.

Description

情報処理システム及び情報処理方法Information processing system and information processing method
 本発明は、3次元形状データに透かし情報を埋め込む技術に関する。 The present invention relates to a technique for embedding watermark information in three-dimensional shape data.
 従来から、3次元形状データに透かし情報を埋め込む技術が知られている。例えば特許文献1は、3次元形状データに透かし情報を埋め込むため、表示態様に関するパラメータの所定のビットを、透かし情報を変換して得られた数値情報に変更することで、透かし情報を3次元形状モデル情報に埋め込む技術を開示している。 Conventionally, techniques for embedding watermark information in three-dimensional shape data have been known. For example, in Patent Document 1, in order to embed watermark information in three-dimensional shape data, predetermined bits of parameters related to display mode are changed to numerical information obtained by converting the watermark information, and the watermark information is embedded in three-dimensional shape data. Discloses technology for embedding in model information.
特許第4081033号公報Patent No. 4081033
 特許文献1に記載の技術では、透かし情報として用いられる電子透かしは著作権保護のためのものであり、その用途が限られていた。 In the technology described in Patent Document 1, the digital watermark used as watermark information is for copyright protection, and its uses are limited.
 本発明は、3Dデータシステムにおいて電子透かしをより多様な用途に利用することを目的とする。 The present invention aims to utilize digital watermarks for more diverse purposes in a 3D data system.
 本発明の一態様は、3Dモデルに関する情報の変更を受け付ける受付手段と、前記変更を特定するコードを生成する生成手段と、前記生成されたコードを電子透かしとして前記3Dモデルに埋め込む埋込手段とを有する情報処理システムを提供する。 One aspect of the present invention includes: a receiving unit that accepts a change in information regarding a 3D model; a generating unit that generates a code that specifies the change; and an embedding unit that embeds the generated code in the 3D model as a digital watermark. An information processing system is provided.
 前記生成手段は画像コードを生成し、前記埋込手段は前記画像コードを前記3Dモデルに埋め込んでもよい。 The generating means may generate an image code, and the embedding means may embed the image code in the 3D model.
 前記埋込手段は、前記画像コードを前記3Dモデルのジオメトリの変化として埋め込んでもよい。 The embedding means may embed the image code as a change in the geometry of the 3D model.
 前記埋込手段は、前記画像コードを前記3Dモデルのテクスチャの変化として埋め込んでもよい。 The embedding means may embed the image code as a change in the texture of the 3D model.
 この情報処理システムは、前記3Dモデルから前記電子透かしを除去する除去手段と、前記除去手段により前記電子透かしが除去された3Dモデルを表示する表示手段とを有してもよい。 This information processing system may include a removal unit that removes the digital watermark from the 3D model, and a display unit that displays the 3D model from which the digital watermark has been removed by the removal unit.
 前記3Dモデルに関する情報の変更が、前記3Dモデルの編集であってもよい。 Changing the information regarding the 3D model may be editing the 3D model.
 前記コードが、前記3Dモデルの変更履歴を示してもよい。 The code may indicate a change history of the 3D model.
 前記コードが、前記3Dモデルの被写体から得られた生体情報を示してもよい。 The code may indicate biological information obtained from the subject of the 3D model.
 前記生体情報が、あらかじめ定められた複数種類の生体情報のいずれかであり、前記埋込手段は、前記受付手段において変更が受け付けられた情報の種類に応じた形式の電子透かしを前記3Dモデルに埋め込んでもよい。 The biometric information is any of a plurality of predetermined types of biometric information, and the embedding means adds an electronic watermark to the 3D model in a format corresponding to the type of information for which change is accepted by the accepting means. May be embedded.
 本発明の別の一態様は、3Dモデルに関する情報の変更を受け付けるステップと、前記変更を特定するコードを生成するステップと、前記生成されたコードを電子透かしとして前記3Dモデルに埋め込むステップとを有する。 Another aspect of the present invention includes the steps of accepting a change in information regarding a 3D model, generating a code that specifies the change, and embedding the generated code in the 3D model as a digital watermark. .
 本発明によれば、3Dデータシステムにおいて電子透かしをより多様な用途に利用することができる。 According to the present invention, digital watermarks can be used for more diverse purposes in a 3D data system.
一実施形態に係る情報処理システムの概要を示す図。FIG. 1 is a diagram showing an overview of an information processing system according to an embodiment. 情報処理システムの機能構成を例示する図。FIG. 1 is a diagram illustrating a functional configuration of an information processing system. サーバのハードウェア構成を例示する図。FIG. 3 is a diagram illustrating the hardware configuration of a server. 変更用端末のハードウェア構成を例示する図。The figure which illustrates the hardware configuration of the change terminal. 閲覧用端末のハードウェア構成を例示する図。The figure which illustrates the hardware configuration of the viewing terminal. 3Dデータ変更処理を例示するシーケンス図。FIG. 3 is a sequence diagram illustrating a 3D data change process. 変更情報データベースを例示する図。A diagram illustrating a change information database. 3Dデータ表示処理を行う閲覧用端末の動作を例示するフローチャート。3 is a flowchart illustrating the operation of a viewing terminal that performs 3D data display processing. 3Dデータ表示画面を例示する図。A diagram illustrating a 3D data display screen. 3Dデータ表示画面を例示する図。A diagram illustrating a 3D data display screen. 3Dデータ表示画面を例示する図。A diagram illustrating a 3D data display screen. 3Dデータ表示画面を例示する図。A diagram illustrating a 3D data display screen.
10…サーバ、20…ネットワーク、30…変更用端末、40…閲覧用端末、101…CPU、102…メモリ、103…ストレージ、104…通信IF、201…要求手段、202…取得手段、203…送信手段、204…取得手段、205…受付手段、206…生成手段、207…送信手段、208…受付手段、209…生成手段、210…埋込手段、211…記憶手段、212…送信手段、213…取得手段、214…除去手段、215…表示手段、216…制御手段、217…制御手段、218…制御手段、301…プロセッサ、302…メモリ、303…インターフェース、304…通信部、305…出力部、306…入力部、401…プロセッサ、402…メモリ、403…インターフェース、404…通信部、405…出力部、406…入力部、901…透かしボタン、902…変更履歴ボタン、903…体温マップボタン、1001…QRコード(登録商標)、1002…QRコード(登録商標)、1003…QRコード(登録商標)、3051…ディスプレイ、3061…タッチパネル、4051…ディスプレイ、4061…タッチパネル DESCRIPTION OF SYMBOLS 10... Server, 20... Network, 30... Terminal for change, 40... Terminal for viewing, 101... CPU, 102... Memory, 103... Storage, 104... Communication IF, 201... Request means, 202... Acquisition means, 203... Transmission means, 204... acquisition means, 205... receiving means, 206... generating means, 207... transmitting means, 208... receiving means, 209... generating means, 210... embedding means, 211... storage means, 212... transmitting means, 213... Acquisition means, 214... Removal means, 215... Display means, 216... Control means, 217... Control means, 218... Control means, 301... Processor, 302... Memory, 303... Interface, 304... Communication unit, 305... Output unit, 306... Input section, 401... Processor, 402... Memory, 403... Interface, 404... Communication section, 405... Output section, 406... Input section, 901... Watermark button, 902... Change history button, 903... Body temperature map button, 1001 ...QR code (registered trademark), 1002...QR code (registered trademark), 1003...QR code (registered trademark), 3051...display, 3061...touch panel, 4051...display, 4061...touch panel
1.構成
 図1は、一実施形態に係る情報処理システムSの概要を示す図である。情報処理システムSは、サーバ10、ネットワーク20、変更用端末30、及び閲覧用端末40から構成される。ネットワーク20は、インターネットなどのネットワーク回線網である。変更用端末30及び閲覧用端末40は、ネットワーク20に有線又は無線で接続可能であり、ネットワーク20を介して、ネットワーク20に接続されているサーバ10との通信が可能である。
1. Configuration FIG. 1 is a diagram showing an overview of an information processing system S according to an embodiment. The information processing system S includes a server 10, a network 20, a change terminal 30, and a viewing terminal 40. The network 20 is a network line network such as the Internet. The change terminal 30 and the viewing terminal 40 can be connected to the network 20 by wire or wirelessly, and can communicate with the server 10 connected to the network 20 via the network 20.
 情報処理システムSは、3Dモデルのデータ(以下、3Dデータという)の変更に基づいて電子透かしを生成し、生成された電子透かしを3Dデータに埋め込むシステムである。3Dモデルは、3Dスキャナを用いて生成される、被写体の形状をした立体的なモデルであって、例えば人、又はペットなどの動物である。3Dモデルは、人体の外観の特徴を細かく再現している。電子透かしは、3Dモデルに関する情報(以下、モデル情報という)を含んでいる。モデル情報は、例えば、3Dモデルに対応する被写体の生体情報である。被写体の生体情報とは、例えば、心拍数、血圧、体温マップ、採寸データ、運動履歴、食事履歴、又は病歴である。モデル情報は、変更用端末30におけるユーザ(以下、変更者という)による操作によって、変更される。モデル情報の変更とは、例えば、既に存在するモデル情報の編集、新たなモデル情報の追加、又は既に存在するモデル情報の削除である。モデル情報の変更に係る情報(以下、変更情報という)は、変更情報を特定するために生成されたコードによって特定される。すなわち、コードは変更情報を含んでいる。コードは、例えば、QRコード(登録商標)、体温マップ、又は等高線(以下、総称して画像コードという)である。コードは、電子透かしとして3Dモデルに埋め込まれる。電子透かしとして埋め込まれたコードは、所定の条件に基づいて、表示と非表示とが切り替わる。 The information processing system S is a system that generates a digital watermark based on changes in 3D model data (hereinafter referred to as 3D data) and embeds the generated digital watermark in the 3D data. A 3D model is a three-dimensional model in the shape of a subject that is generated using a 3D scanner, and is, for example, a person or an animal such as a pet. The 3D model accurately reproduces the external features of the human body. The digital watermark includes information regarding the 3D model (hereinafter referred to as model information). The model information is, for example, biological information of a subject corresponding to a 3D model. The biological information of the subject is, for example, heart rate, blood pressure, body temperature map, measurement data, exercise history, meal history, or medical history. The model information is changed by an operation by a user (hereinafter referred to as a changer) on the change terminal 30. Changing model information is, for example, editing already existing model information, adding new model information, or deleting already existing model information. Information related to changes in model information (hereinafter referred to as change information) is specified by a code generated to specify the change information. That is, the code contains change information. The code is, for example, a QR code (registered trademark), a body temperature map, or a contour line (hereinafter collectively referred to as an image code). The code is embedded into the 3D model as a digital watermark. The code embedded as a digital watermark is switched between display and non-display based on predetermined conditions.
 変更情報を含んだコードが3Dデータとともに記録され、そのような3Dデータが閲覧用端末40に表示されることによって、3Dデータをキーとした種々のサービスが実現可能となる。種々のサービスとは、例えば、遠隔医療の支援、健康増進の支援、又は装飾品購入の支援である。具体的には、一例として、患者の生体情報の履歴を含んだコードが、患者を被写体とした3Dモデルに電子透かしとして埋め込まれる場合が想定される。患者の所在地とは異なる場所において患者を診察する医師は、3Dモデルを用いて患者の体格を確認しながら、電子透かしとして埋め込まれている生体情報の履歴を用いて、患者を診察することができる。この場合、変更者は患者であって、閲覧者は医師である。 By recording a code containing change information together with 3D data and displaying such 3D data on the viewing terminal 40, various services using 3D data as a key can be realized. The various services are, for example, support for telemedicine, support for health promotion, or support for purchasing decorative items. Specifically, as an example, it is assumed that a code including a history of a patient's biometric information is embedded as a digital watermark in a 3D model with the patient as the subject. A doctor who examines a patient at a location different from the patient's location can check the patient's physique using a 3D model and examine the patient using the history of biometric information embedded as a digital watermark. . In this case, the changer is the patient and the viewer is the doctor.
 また、他の例として、スポーツジムのトレーニーの運動履歴を含んだコードが、トレーニーを被写体とした3Dモデルに電子透かしとして埋め込まれる場合が想定される。トレーニーに運動指導を行うトレーナーは、3Dモデルを用いて患者の体格を詳細に確認しながら、電子透かしとして埋め込まれている運動履歴を用いて、トレーニーに運動指導をすることができる。この場合、変更者はトレーニーであって、閲覧者はトレーナーである。 As another example, it is assumed that a code containing the exercise history of a trainee at a gym is embedded as a digital watermark in a 3D model with the trainee as the subject. A trainer who provides exercise guidance to a trainee can use a 3D model to check the patient's physique in detail, and use the exercise history embedded as a digital watermark to provide exercise guidance to the trainee. In this case, the changer is the trainee and the viewer is the trainer.
 さらに、ほかの例として、衣服の着用者の採寸データを含んだコードが、着用者を被写体とした3Dモデルに電子透かしとして埋め込まれる場合が想定される。衣服の購入者は、3Dモデルを用いて着用者の体のサイズを確認しながら、着用者の体に合った衣服を選択し、購入することができる。閲覧用端末40を用いて、着用者の3Dモデルに衣類の3Dモデルを仮想的に着させることによって、購入者は着用者の3Dモデルにおいて仮想的な試着をすることができる。この場合、変更者は着用者であって、閲覧者は購入者である。 Furthermore, as another example, it is assumed that a code containing measurement data of the wearer of clothing is embedded as a digital watermark in a 3D model with the wearer as the subject. A clothing purchaser can select and purchase clothing that fits the wearer's body while checking the wearer's body size using a 3D model. By using the viewing terminal 40 to virtually try on the 3D model of the clothing on the 3D model of the wearer, the purchaser can virtually try on the 3D model of the wearer. In this case, the changer is the wearer and the viewer is the purchaser.
 サーバ10は、変更用端末30から取得された変更情報に基づいて、3Dモデルに電子透かしを埋め込むサーバである。サーバ10は、変更情報を特定するコードを生成する。サーバ10は、生成されたコードを電子透かしとして3Dモデルに埋め込み、電子透かしが埋め込まれた状態の3Dモデルを記憶する。 The server 10 is a server that embeds a digital watermark in the 3D model based on the change information obtained from the change terminal 30. The server 10 generates a code that specifies the change information. The server 10 embeds the generated code in the 3D model as a digital watermark, and stores the 3D model with the digital watermark embedded therein.
 変更用端末30は、変更者による操作に応じて、3Dデータ又はモデル情報の変更を受け付ける端末である。変更用端末30は、変更情報を生成し、サーバ10に変更情報を送信する。閲覧用端末40は、閲覧者による操作に応じて、3Dデータを取得する。閲覧用端末40は、電子透かしが除去された3Dデータを表示する。 The change terminal 30 is a terminal that accepts changes to 3D data or model information according to an operation by a changer. The change terminal 30 generates change information and transmits the change information to the server 10. The viewing terminal 40 acquires 3D data in response to operations by the viewer. The viewing terminal 40 displays the 3D data from which the digital watermark has been removed.
 図2は、情報処理システムSの機能構成を例示する図である。情報処理システムSは、要求手段201、取得手段202、送信手段203、取得手段204、受付手段205、生成手段206、送信手段207、受付手段208、生成手段209、埋込手段210、記憶手段211、送信手段212、取得手段213、除去手段214、表示手段215、制御手段216、制御手段217、及び制御手段218を有する。 FIG. 2 is a diagram illustrating the functional configuration of the information processing system S. The information processing system S includes a requesting means 201, an acquiring means 202, a transmitting means 203, an acquiring means 204, an accepting means 205, a generating means 206, a transmitting means 207, an accepting means 208, a generating means 209, an embedding means 210, a storage means 211 , transmission means 212, acquisition means 213, removal means 214, display means 215, control means 216, control means 217, and control means 218.
 サーバ10における機能を説明する。取得手段202は、変更用端末30から、3Dデータの要求を取得する。送信手段203は、変更用端末30からの要求に応じて、変更用端末30に3Dデータを送信する。受付手段208は、変更用端末30から、モデル情報の変更を受け付ける。生成手段209は、モデル情報の変更を特定するコードを生成する。埋込手段210は、3Dモデルにコードを電子透かしとして埋め込む。記憶手段211は、3Dデータを含む、各種のデータを記憶する。送信手段212は、閲覧用端末40からの要求に応じて、閲覧用端末40に3Dデータを送信する。制御手段216は、各種の制御を実行する。 The functions of the server 10 will be explained. The acquisition unit 202 acquires a request for 3D data from the change terminal 30. The transmitting means 203 transmits 3D data to the change terminal 30 in response to a request from the change terminal 30. The accepting means 208 accepts changes to model information from the change terminal 30. The generating means 209 generates a code that specifies a change in model information. The embedding means 210 embeds a code in the 3D model as a digital watermark. The storage means 211 stores various data including 3D data. The transmitting means 212 transmits 3D data to the viewing terminal 40 in response to a request from the viewing terminal 40. Control means 216 executes various controls.
 変更用端末30における機能を説明する。要求手段201は、サーバ10に、3Dデータの送信を要求する。取得手段204は、サーバ10から3Dデータを取得する。受付手段205は、変更者による変更用端末30の操作を介して、モデル情報の変更を受け付ける。生成手段206は、変更情報を生成する。送信手段207は、サーバ10に、変更情報を送信する。制御手段217は、各種の制御を実行する。 The functions of the change terminal 30 will be explained. The requesting means 201 requests the server 10 to transmit 3D data. The acquisition means 204 acquires 3D data from the server 10. The accepting means 205 accepts changes to the model information through the change user's operation of the change terminal 30. The generating means 206 generates change information. The transmitting means 207 transmits the change information to the server 10. Control means 217 executes various controls.
 閲覧用端末40における機能を説明する。取得手段213は、サーバ10から3Dデータを取得する。除去手段214は、3Dデータから電子透かしを除去する。表示手段215は、電子透かしが除去された3Dデータを表示する。制御手段218は、各種の制御を実行する。 The functions of the viewing terminal 40 will be explained. The acquisition means 213 acquires 3D data from the server 10. The removal unit 214 removes the digital watermark from the 3D data. The display means 215 displays the 3D data from which the digital watermark has been removed. Control means 218 executes various controls.
 図3は、サーバ10のハードウェア構成を例示する図である。サーバ10は、CPU(Central Processing Unit)101、メモリ102、ストレージ103、及び通信IF(Interface)104を有するコンピュータ装置である。CPU101は、プログラムを実行して各種の演算を行い、サーバ10の他のハードウェア要素を制御する制御装置である。メモリ102は、CPU101がプログラムを実行する際のワークエリアとして機能する主記憶装置である。ストレージ103は、各種のプログラム及びデータを記憶する不揮発性の補助記憶装置である。通信IF104は、所定の通信規格(例えばイーサネット(登録商標))に従って他の装置と通信する通信装置である。 FIG. 3 is a diagram illustrating the hardware configuration of the server 10. The server 10 is a computer device having a CPU (Central Processing Unit) 101, a memory 102, a storage 103, and a communication IF (Interface) 104. The CPU 101 is a control device that executes programs, performs various calculations, and controls other hardware elements of the server 10. The memory 102 is a main storage device that functions as a work area when the CPU 101 executes a program. The storage 103 is a nonvolatile auxiliary storage device that stores various programs and data. The communication IF 104 is a communication device that communicates with other devices according to a predetermined communication standard (eg, Ethernet (registered trademark)).
 この例において、ストレージ103は、コンピュータ装置を情報処理システムSにおけるサーバ10として機能させるためのプログラム(以下「サーバプログラム」という)を記憶する。CPU101がサーバプログラムを実行することにより、コンピュータ装置に図3の機能が実装される。CPU101がサーバプログラムを実行している状態において、メモリ102及びストレージ103の少なくとも一方が記憶手段211の一例であり、CPU101が、生成手段209、埋込手段210、及び制御手段216の一例であり、通信IF104が、取得手段202、送信手段203、受付手段208、及び送信手段212の一例である。 In this example, the storage 103 stores a program (hereinafter referred to as a "server program") for causing a computer device to function as the server 10 in the information processing system S. The functions shown in FIG. 3 are implemented in the computer device by the CPU 101 executing the server program. In a state where the CPU 101 is executing the server program, at least one of the memory 102 and the storage 103 is an example of the storage means 211, and the CPU 101 is an example of the generation means 209, the embedding means 210, and the control means 216, The communication IF 104 is an example of the acquisition means 202, the transmission means 203, the reception means 208, and the transmission means 212.
 図4は、変更用端末30のハードウェア構成を例示する図である。変更用端末30は、プロセッサ301、メモリ302、インターフェース303、通信部304、出力部305、及び入力部306を有するコンピュータ装置である。これらの構成は、例えばバスで、互いに通信可能に接続されている。 FIG. 4 is a diagram illustrating the hardware configuration of the change terminal 30. The change terminal 30 is a computer device that includes a processor 301 , a memory 302 , an interface 303 , a communication section 304 , an output section 305 , and an input section 306 . These structures are communicatively connected to each other, for example by a bus.
 プロセッサ301は、メモリ302に記憶されているコンピュータプログラム(以下、単にプログラムという)を読み出して実行することにより変更用端末30の各部を制御する。プロセッサ301は、例えばCPU(Central Processing Unit)である。メモリ302は、プロセッサ301に読み込まれるOS、各種のプログラム、データ等を記憶する記憶手段である。メモリ302は、RAM(Random Access Memory)及びROM(Read Only Memory)を有する。なお、メモリ302は、ソリッドステートドライブ、ハードディスクドライブ等の補助記憶装置を有してもよい。インターフェース303は、プロセッサ301と通信部304、出力部305、及び入力部306とを通信可能に接続する通信回路である。通信部304は、ネットワーク20を介してサーバ10との間で行う通信を制御する。出力部305は、ディスプレイ等の表示部及びスピーカ等の音声出力部で構成され、画像、文字、又は音声を出力する。具体的には、出力部305は、本実施形態ではディスプレイ3051で構成される。ディスプレイ3051は、液晶ディスプレイ、有機ELディスプレイ等のフラットパネルディスプレイで構成され、画像又は文字を出力する。入力部306は、キーボード又はマウス等で構成される操作部であり、ユーザの指示操作に応じて各種情報を入力する。本実施形態では、入力部306はタッチパネル3061で構成される。タッチパネル3061は、フラットパネルディスプレイであるディスプレイ3051に位置入力装置を組み合わせたタッチパッドのような電子部品であり、ユーザが画面上の表示部分に触れることで機器を操作可能な入力装置である。 The processor 301 controls each part of the change terminal 30 by reading and executing a computer program (hereinafter simply referred to as a program) stored in the memory 302. The processor 301 is, for example, a CPU (Central Processing Unit). The memory 302 is a storage unit that stores the OS, various programs, data, etc. that are read into the processor 301. The memory 302 includes a RAM (Random Access Memory) and a ROM (Read Only Memory). Note that the memory 302 may include an auxiliary storage device such as a solid state drive or a hard disk drive. The interface 303 is a communication circuit that communicably connects the processor 301 to the communication unit 304, output unit 305, and input unit 306. The communication unit 304 controls communication with the server 10 via the network 20. The output unit 305 includes a display unit such as a display and an audio output unit such as a speaker, and outputs images, characters, or audio. Specifically, the output unit 305 includes a display 3051 in this embodiment. The display 3051 is configured with a flat panel display such as a liquid crystal display or an organic EL display, and outputs images or characters. The input unit 306 is an operation unit configured with a keyboard, a mouse, or the like, and inputs various information according to the user's instructions. In this embodiment, the input unit 306 is configured with a touch panel 3061. The touch panel 3061 is an electronic component such as a touch pad that combines the display 3051, which is a flat panel display, with a position input device, and is an input device that allows the user to operate the device by touching the display portion on the screen.
 この例において、メモリ302が記憶するプログラムには、コンピュータを情報処理システムSにおける変更用端末30として機能させるためのプログラム(以下「変更用端末プログラム」という)が含まれる。プロセッサ301が変更用端末プログラムを実行することにより、変更用端末30に図2の機能が実装される。プロセッサ301がプログラムを実行している状態において、プロセッサ301が、受付手段205、生成手段206、及び制御手段217の一例であり、通信部304が、要求手段201、取得手段204、及び送信手段207の一例である。 In this example, the programs stored in the memory 302 include a program for causing the computer to function as the change terminal 30 in the information processing system S (hereinafter referred to as the "change terminal program"). The functions shown in FIG. 2 are implemented in the change terminal 30 by the processor 301 executing the change terminal program. In a state where the processor 301 is executing a program, the processor 301 is an example of the reception means 205, the generation means 206, and the control means 217, and the communication section 304 is an example of the request means 201, the acquisition means 204, and the transmission means 207. This is an example.
 変更用端末30としては、本実施形態では、タブレット端末が用いられるが、PC(パーソナルコンピュータ)あるいは、スマートフォンなどを用いてもよい。 In this embodiment, a tablet terminal is used as the change terminal 30, but a PC (personal computer), a smartphone, or the like may also be used.
 図5は、閲覧用端末40のハードウェア構成を例示する図である。閲覧用端末40は、プロセッサ401、メモリ402、インターフェース403、通信部404、出力部405、及び入力部406を有するコンピュータ装置である。これらの構成は、例えばバスで、互いに通信可能に接続されている。 FIG. 5 is a diagram illustrating the hardware configuration of the viewing terminal 40. The viewing terminal 40 is a computer device having a processor 401, a memory 402, an interface 403, a communication section 404, an output section 405, and an input section 406. These structures are communicatively connected to each other, for example by a bus.
 プロセッサ401は、メモリ402に記憶されているコンピュータプログラム(以下、単にプログラムという)を読み出して実行することにより閲覧用端末40の各部を制御する。プロセッサ401は、例えばCPU(Central Processing Unit)である。メモリ402は、プロセッサ401に読み込まれるOS、各種のプログラム、データ等を記憶する記憶手段である。メモリ402は、RAM(Random Access Memory)及びROM(Read Only Memory)を有する。なお、メモリ402は、ソリッドステートドライブ、ハードディスクドライブ等を有してもよい。インターフェース403は、プロセッサ401と通信部404、出力部405、及び入力部406とを通信可能に接続する通信回路である。通信部404は、ネットワーク20を介してサーバ10との間で行う通信を制御する。出力部405は、ディスプレイ等の表示部及びスピーカ等の音声出力部で構成され、画像、文字、又は音声を出力する。具体的には、出力部405は、本実施形態ではディスプレイ4051で構成される。ディスプレイ4051は、液晶ディスプレイ、有機ELディスプレイ等のフラットパネルディスプレイで構成され、画像又は文字を出力する。入力部406は、キーボード又はマウス等で構成される操作部であり、ユーザの指示操作に応じて各種情報を入力する。本実施形態では、入力部406はタッチパネル4061で構成される。タッチパネル4061は、フラットパネルディスプレイであるディスプレイ4051に位置入力装置を組み合わせたタッチパッドのような電子部品であり、ユーザが画面上の表示部分に触れることで機器を操作可能な入力装置である。 The processor 401 controls each part of the viewing terminal 40 by reading and executing a computer program (hereinafter simply referred to as a program) stored in the memory 402. The processor 401 is, for example, a CPU (Central Processing Unit). The memory 402 is a storage unit that stores the OS, various programs, data, etc. that are read into the processor 401. The memory 402 includes a RAM (Random Access Memory) and a ROM (Read Only Memory). Note that the memory 402 may include a solid state drive, a hard disk drive, or the like. The interface 403 is a communication circuit that communicably connects the processor 401 to the communication unit 404, output unit 405, and input unit 406. The communication unit 404 controls communication with the server 10 via the network 20. The output unit 405 includes a display unit such as a display and an audio output unit such as a speaker, and outputs images, characters, or audio. Specifically, the output unit 405 includes a display 4051 in this embodiment. The display 4051 is configured with a flat panel display such as a liquid crystal display or an organic EL display, and outputs images or characters. The input unit 406 is an operation unit configured with a keyboard, a mouse, or the like, and inputs various information according to the user's instruction operation. In this embodiment, the input unit 406 is configured with a touch panel 4061. The touch panel 4061 is an electronic component such as a touch pad that combines the display 4051, which is a flat panel display, with a position input device, and is an input device that allows the user to operate the device by touching the display portion on the screen.
 この例において、メモリ402が記憶するプログラムには、コンピュータを情報処理システムSにおける閲覧用端末40として機能させるためのプログラム(以下「閲覧用端末プログラム」という)が含まれる。プロセッサ401が閲覧用端末プログラムを実行することにより、閲覧用端末40に図2の機能が実装される。プロセッサ401がプログラムを実行している状態において、プロセッサ401が、除去手段214、及び制御手段218の一例であり、通信部404が、取得手段213の一例であり、ディスプレイ4051が、表示手段215の一例である。 In this example, the programs stored in the memory 402 include a program for causing the computer to function as the viewing terminal 40 in the information processing system S (hereinafter referred to as the "viewing terminal program"). The functions shown in FIG. 2 are implemented in the viewing terminal 40 by the processor 401 executing the viewing terminal program. In a state where the processor 401 is executing a program, the processor 401 is an example of the removal means 214 and the control means 218, the communication unit 404 is an example of the acquisition means 213, and the display 4051 is an example of the display means 215. This is an example.
 閲覧用端末40としては、本実施形態では、タブレット端末が用いられるが、PC(パーソナルコンピュータ)あるいは、スマートフォンなどを用いてもよい。 In this embodiment, a tablet terminal is used as the viewing terminal 40, but a PC (personal computer), a smartphone, or the like may also be used.
2.動作
2.1 3Dデータの変更
 図6は、情報処理システムSにおいて3Dデータ変更処理を例示するシーケンス図である。変更用端末30は、変更者による操作を介して、3Dデータの編集を実行するためのアプリケーションを起動する。変更用端末30の要求手段201は、サーバ10に、変更用端末30のアプリケーションにおいて表示するための3Dデータを要求する(ステップS601)。サーバ10の取得手段202は、変更用端末30から3Dデータの要求を取得する。
2. Operation 2.1 Changing 3D Data FIG. 6 is a sequence diagram illustrating a 3D data changing process in the information processing system S. The modification terminal 30 starts an application for editing the 3D data through an operation by the modification person. The requesting means 201 of the change terminal 30 requests the server 10 for 3D data to be displayed in the application of the change terminal 30 (step S601). The acquisition means 202 of the server 10 acquires a request for 3D data from the change terminal 30.
 ステップS602において、サーバ10の送信手段203は、変更用端末30に、3Dデータを送信する。変更用端末30の取得手段204は、サーバ10から送信された3Dデータを取得する。 In step S602, the transmitting means 203 of the server 10 transmits the 3D data to the change terminal 30. The acquisition means 204 of the change terminal 30 acquires the 3D data transmitted from the server 10.
 ステップS603において、変更用端末30の受付手段205は、変更者による操作を介して、モデル情報の変更を受け付ける。 In step S603, the accepting means 205 of the change terminal 30 accepts changes to the model information through an operation by the changer.
 ステップS604において、変更用端末30の生成手段206は、変更情報を生成する。変更情報は、モデルID、変更日、変更のカテゴリ、変更内容、及び変更者の氏名を含んでいる。モデルIDは、3Dモデルに対応する被写体を一意に特定するためのIDである。変更のカテゴリは、編集、追加、又は削除であって、既に存在するモデル情報が編集される場合は編集であって、新たにモデル情報が追加される場合は追加であって、既に存在するモデル情報が削除される場合は削除である。例えば、2022年6月12日に、山田太郎という人物が、モデルIDがxxxである3Dモデルの顔に、メガネを追加したと想定する。この場合、変更情報は、モデル名を「xxx」、変更を実行した日付として「2022年6月12日」を、変更のカテゴリとして「追加」を、変更内容として「メガネ」を、変更者の氏名として「山田太郎」を含んでいる。3Dモデルがもともとかけていたメガネの色を変更した場合は、変更のカテゴリは「編集」であって、変更内容は「メガネ」である。 In step S604, the generation means 206 of the change terminal 30 generates change information. The change information includes the model ID, date of change, category of change, content of change, and name of the person making the change. The model ID is an ID for uniquely identifying the subject corresponding to the 3D model. The categories of changes are editing, addition, or deletion. Editing is when existing model information is edited, and addition is when new model information is added to an already existing model. When information is deleted, it is deleted. For example, assume that on June 12, 2022, a person named Taro Yamada added glasses to the face of a 3D model whose model ID is xxx. In this case, the change information includes "xxx" for the model name, "June 12, 2022" as the date of the change, "Add" as the change category, "Glasses" as the change content, and the person who made the change. His name includes "Taro Yamada". If the color of the glasses originally worn by the 3D model is changed, the category of the change is "edit" and the content of the change is "glasses."
 ステップS605において、変更用端末30の送信手段207は、サーバ10に変更情報を送信する。サーバ10の受付手段208は、変更用端末30から送信された変更情報を受け付ける。 In step S605, the transmitting means 207 of the change terminal 30 transmits the change information to the server 10. The receiving means 208 of the server 10 receives change information transmitted from the change terminal 30.
 ステップS606において、サーバ10の生成手段209は、変更情報を特定するためのコードを生成する。コードの形式は複数あり、例えば、コードに含まれる情報の種類によって異なる。コードに含まれる情報の種類とは、例えば、3Dモデル表面における物理量の分布を表す情報(以下、分布情報という)、又は3Dモデル表面における物理量の分布を表さない情報(以下、非分布情報という)である。分布情報を示すコードの形式は、例えば、体温マップ、又は等高線である。非分布情報を示すコードの形式は、例えば、QRコード(登録商標)である。ステップS606においてどの形式のコードを生成するかは、変更情報の内容に応じて決定される。例えば、変更情報が血圧である場合は、QRコード(登録商標)が生成され、変更情報が体温マップである場合は、体温マップが生成される。 In step S606, the generation means 209 of the server 10 generates a code for specifying the change information. There are multiple code formats, which differ depending on the type of information included in the code, for example. The types of information included in the code include, for example, information that represents the distribution of physical quantities on the 3D model surface (hereinafter referred to as distribution information), or information that does not represent the distribution of physical quantities on the 3D model surface (hereinafter referred to as non-distribution information). ). The format of the code indicating the distribution information is, for example, a body temperature map or a contour line. The format of the code indicating non-distribution information is, for example, a QR code (registered trademark). The format of the code to be generated in step S606 is determined depending on the content of the change information. For example, if the change information is blood pressure, a QR code (registered trademark) is generated, and if the change information is a body temperature map, a body temperature map is generated.
 ステップS607において、サーバ10の埋込手段210は、コードを電子透かしとして3Dモデルに埋め込む。3Dモデルは、ジオメトリ及びテクスチャで構成される。ジオメトリは、3Dモデルとして表示される立体の外形を構成する、関数や数式のパラメータなどを表すデータ群のことである。テクスチャは、立体の表面の質感又は色を表現するために用いられる画像のことである。電子透かしは、3Dモデルのジオメトリの変化として埋め込まれる場合と、3Dモデルのテクスチャの変化として埋め込まれる場合と、3Dモデルのジオメトリ及びテクスチャの両方の変化として埋め込まれる場合とがある。電子透かしが3Dモデルのジオメトリの変化として埋め込まれる場合、3Dモデルに形状の変化が与えられ、その変化を視認できる形で、電子透かしが3Dモデルに埋め込まれる。電子透かしが3Dモデルのテクスチャの変化として埋め込まれる場合、3Dモデルに形状の変化は与えられない状態で、色などがついた電子透かしが3Dモデルに埋め込まれる。電子透かしが3Dモデルのジオメトリ及びテクスチャの両方の変化として埋め込まれる場合、3Dモデルに形状の変化が与えられ、その変化を視認できる形で、色などがついた電子透かしが3Dモデルに埋め込まれる。電子透かしがどのように埋め込まれるかは、例えば、変更者を介した変更用端末30の操作などによって、決定される。 In step S607, the embedding means 210 of the server 10 embeds the code in the 3D model as a digital watermark. A 3D model is composed of geometry and texture. Geometry is a group of data representing parameters of functions and mathematical formulas that constitute the external shape of a solid that is displayed as a 3D model. Texture is an image used to express the texture or color of a three-dimensional surface. A digital watermark may be embedded as a change in the geometry of a 3D model, as a change in the texture of the 3D model, or as a change in both the geometry and texture of the 3D model. When a digital watermark is embedded as a change in the geometry of a 3D model, a change in shape is given to the 3D model, and the digital watermark is embedded in the 3D model in such a way that the change is visible. When a digital watermark is embedded as a change in the texture of a 3D model, a colored digital watermark is embedded in the 3D model without changing its shape. When a digital watermark is embedded as a change in both the geometry and texture of a 3D model, a change in shape is given to the 3D model, and the digital watermark with color etc. is embedded in the 3D model in a form that allows the change to be visually recognized. How the digital watermark is embedded is determined by, for example, the operation of the change terminal 30 by the person making the change.
 ステップS608において、サーバ10の記憶手段211は、電子透かしが埋め込まれた3Dモデルを変更情報データベースに記憶する。 In step S608, the storage means 211 of the server 10 stores the 3D model with the digital watermark embedded in the change information database.
 図7は、変更情報データベースを例示する図である。変更情報データベースは、変更情報を含んでいる。例えば、変更情報データベースは、モデルIDに紐づけて、変更日、変更のカテゴリ、変更内容、及び変更者の氏名を記憶している。変更情報データベースは、過去に記憶された変更情報も記憶している。 FIG. 7 is a diagram illustrating the change information database. The change information database contains change information. For example, the change information database stores the date of change, category of change, content of change, and name of the person making the change in association with the model ID. The change information database also stores change information stored in the past.
2.2 3Dデータの表示
 図8は、3Dデータ表示処理を行う閲覧用端末40の動作を例示するフローチャートである。閲覧用端末40は、閲覧者による操作を介して、3Dデータの表示を実行するためのアプリケーションを起動する。3Dデータ表示処理は、閲覧用端末40がサーバ10に3Dデータの表示を要求することをトリガーとして開始される。サーバ10の送信手段212は、3Dデータを送信する。閲覧用端末40の取得手段213は、3Dデータを取得する(ステップS901)。
2.2 Display of 3D Data FIG. 8 is a flowchart illustrating the operation of the viewing terminal 40 that performs 3D data display processing. The viewing terminal 40 starts an application for displaying 3D data through an operation by a viewer. The 3D data display process is started when the viewing terminal 40 requests the server 10 to display 3D data. The transmitting means 212 of the server 10 transmits 3D data. The acquisition means 213 of the viewing terminal 40 acquires 3D data (step S901).
 ステップS902において、閲覧用端末40の除去手段214は、閲覧用端末40が、3Dデータにあらかじめ対応付けて記憶されている暗号キーを有している場合に、3Dデータに含まれる電子透かしを除去する。すなわち、ステップS901において取得された3Dデータの電子透かしを除去することに関して、閲覧用端末40が認証を受けている場合に、電子透かしが除去される。また、他の所定の条件を満たしている場合、電子透かしは除去される。所定の条件とは、例えば、3Dデータに対応する被写体が閲覧用端末40に対して被写体自身の3Dモデルの表示を許可している場合、又は、閲覧用端末40が、情報処理システムSの管理者などから指定されているアプリケーションを用いて3Dモデルを取得している場合である。さらに、変更情報の種類に応じて、電子透かしが除去されてもよい。例えば、取得された3Dモデルに埋め込まれている電子透かしに対応する変更のカテゴリが、特定のカテゴリ(例えば「追加」又は「削除」)である場合、電子透かしが除去されてもよい。 In step S902, the removing means 214 of the viewing terminal 40 removes the electronic watermark included in the 3D data when the viewing terminal 40 has an encryption key stored in advance in association with the 3D data. do. That is, regarding the removal of the digital watermark of the 3D data acquired in step S901, if the viewing terminal 40 has been authenticated, the digital watermark is removed. Furthermore, if other predetermined conditions are met, the digital watermark is removed. The predetermined condition is, for example, when the subject corresponding to the 3D data allows the viewing terminal 40 to display the subject's own 3D model, or when the viewing terminal 40 manages the information processing system S. This is a case where a 3D model is acquired using an application specified by a person or the like. Furthermore, the digital watermark may be removed depending on the type of change information. For example, if the category of modification corresponding to the digital watermark embedded in the acquired 3D model is a specific category (eg, "add" or "delete"), the digital watermark may be removed.
 ステップS903において、閲覧用端末40の表示手段215は、電子透かしが除去された3Dデータを表示する。閲覧用端末40に表示された各種ボタンが閲覧者によって選択されることによって、3Dデータは各種のデータを表示可能である。 In step S903, the display means 215 of the viewing terminal 40 displays the 3D data from which the digital watermark has been removed. Various types of 3D data can be displayed by the viewer selecting various buttons displayed on the viewing terminal 40.
 図9~図12は、3Dデータ表示画面を例示する図である。図8に示す図においては、3Dモデル、透かしボタン901、変更履歴ボタン902、及び体温マップボタン903(総称してボタンという)が表示されている。閲覧者は、閲覧用端末40の操作を介して、透かしボタン901、変更履歴ボタン902、及び体温マップボタン903の少なくとも1つを選択可能である。ボタンは、閲覧者による閲覧用端末40におけるボタンの押下に応じて、選択される。選択されているボタンを囲う線は、選択されていないボタンを囲う線よりも太いため、閲覧者はどのボタンが選択状態にあるかを容易に認識できる。 9 to 12 are diagrams illustrating 3D data display screens. In the diagram shown in FIG. 8, a 3D model, a watermark button 901, a change history button 902, and a body temperature map button 903 (collectively referred to as buttons) are displayed. The viewer can select at least one of the watermark button 901, change history button 902, and body temperature map button 903 through operation of the viewing terminal 40. The button is selected in response to the viewer pressing the button on the viewing terminal 40. The line surrounding the selected button is thicker than the line surrounding the unselected button, so the viewer can easily recognize which button is in the selected state.
 図9は、ステップS903において閲覧用端末40に表示される3Dデータ表示画面である。図9に示す図においては、ボタンのすべてが選択されていない状態である。 FIG. 9 is a 3D data display screen displayed on the viewing terminal 40 in step S903. In the diagram shown in FIG. 9, all buttons are not selected.
 図10に示す図においては、透かしボタン901が選択されている状態であって、変更履歴ボタン902及び体温マップボタン903が選択されていない状態である。透かしボタン901が選択されていると、電子透かしが3Dモデルに重なって表示される。図10に示す図においては、電子透かしとして、QRコード(登録商標)1001~1003が表示されている。透かしボタン901が選択されている状態において、透かしボタン901が閲覧者による操作を介して押下されると、透かしボタン901は選択されていない状態となり、3Dモデルには電子透かしが表示されなくなる。閲覧者が使用している閲覧用端末40が電子透かしの除去に関する認証を受けていない場合、図10に示すような画面が、閲覧用端末40に表示される。また、閲覧用端末40が認証を受けている場合であっても、閲覧者が透かしボタンを押下したことによって透かしボタン901が選択状態となった場合、図10に示すような画面が閲覧用端末40に表示される。 In the diagram shown in FIG. 10, the watermark button 901 is selected, and the change history button 902 and body temperature map button 903 are not selected. When the watermark button 901 is selected, a digital watermark is displayed superimposed on the 3D model. In the diagram shown in FIG. 10, QR codes (registered trademark) 1001 to 1003 are displayed as digital watermarks. If the watermark button 901 is pressed through an operation by the viewer while the watermark button 901 is selected, the watermark button 901 becomes unselected and the digital watermark is no longer displayed on the 3D model. If the viewing terminal 40 used by the viewer has not been certified for digital watermark removal, a screen as shown in FIG. 10 is displayed on the viewing terminal 40. Further, even if the viewing terminal 40 has been authenticated, if the viewer presses the watermark button and the watermark button 901 becomes selected, the screen shown in FIG. 10 will be displayed on the viewing terminal. 40.
 図11に示す図においては、変更履歴ボタン902が選択されている状態であって、透かしボタン901及び体温マップボタン903が選択されていない状態である。変更履歴ボタン902が選択されていると、3Dモデルの変更履歴が3Dモデルとともに表示される。変更履歴は、変更情報のうち、変更を実行した日付、変更のカテゴリ、変更内容、及び変更者の氏名を含んでいる。例えば、図11に示す図においては、2022年6月12日に、山田太郎という変更者によって、3Dモデルにメガネが追加されている。変更履歴ボタン902が選択されている状態において、変更履歴ボタン902が閲覧者による操作を介して押下されると、変更履歴ボタン902は選択されていない状態となり、閲覧用端末40のディスプレイ4051には変更履歴が表示されなくなる。閲覧用端末40に変更履歴が表示されることによって、閲覧者は、3Dモデルの変更の変遷を容易に認識することができる。 In the diagram shown in FIG. 11, the change history button 902 is selected, and the watermark button 901 and body temperature map button 903 are not selected. When the change history button 902 is selected, the change history of the 3D model is displayed together with the 3D model. The change history includes, among the change information, the date on which the change was executed, the category of the change, the content of the change, and the name of the person who made the change. For example, in the diagram shown in FIG. 11, glasses were added to the 3D model on June 12, 2022 by a changer named Taro Yamada. If the change history button 902 is pressed through an operation by the viewer while the change history button 902 is selected, the change history button 902 becomes unselected and the display 4051 of the viewing terminal 40 shows Change history is no longer displayed. By displaying the change history on the viewing terminal 40, the viewer can easily recognize the changes in the 3D model.
 図12に示す図においては、体温マップボタン903が選択されている状態であって、透かしボタン901及び変更履歴ボタン902が選択されていない状態である。体温マップボタン903が選択されていると、体温マップが3Dモデルに重なって表示される。体温マップボタン903が閲覧者による操作を介して押下されると、体温マップボタン903は選択されていない状態となり、3Dモデルには体温マップが表示されなくなる。閲覧用端末40に体温マップが表示されることによって、閲覧者は、3Dモデルに対応する人物の体温分布を容易に認識することができる。例えば、閲覧者が医師であって、3Dモデルに対応する人物が、医師のいる場所とは異なる場所にいる患者である場合、医師は、患者の体のどの部分がどの程度の温度であるのかを具体的に知ることができる。 In the diagram shown in FIG. 12, the body temperature map button 903 is selected, and the watermark button 901 and change history button 902 are not selected. When the body temperature map button 903 is selected, the body temperature map is displayed overlapping the 3D model. When the body temperature map button 903 is pressed through an operation by the viewer, the body temperature map button 903 becomes unselected, and the body temperature map is no longer displayed on the 3D model. By displaying the body temperature map on the viewing terminal 40, the viewer can easily recognize the body temperature distribution of the person corresponding to the 3D model. For example, if the viewer is a doctor and the person corresponding to the 3D model is a patient who is in a different location than the doctor, the doctor can determine the temperature of which part of the patient's body. You can know specifically.
3.変形例
 本発明は上述の実施形態に限定されるものではなく、種々の変形実施が可能である。以下、変形例をいくつか説明する。以下の変形例に記載した事項のうち2つ以上のものが組み合わせて用いられてもよい。
3. Modifications The present invention is not limited to the above-described embodiments, and various modifications are possible. Some modified examples will be explained below. Two or more of the items described in the following modified examples may be used in combination.
 モデル情報として用いられる生体情報は、心拍数、血圧、体温マップ、採寸データ、運動履歴、食事履歴、又は病歴に限定されず、3Dモデルの被写体の体の状態に係る情報であればよい。生体情報は、例えば、体重の履歴であってもよい。 The biological information used as model information is not limited to heart rate, blood pressure, body temperature map, measurement data, exercise history, meal history, or medical history, and may be any information related to the physical condition of the subject of the 3D model. The biological information may be, for example, a history of body weight.
 3Dデータ表示画面に表示されるボタンは、透かしボタン901、変更履歴ボタン902、及び体温マップボタン903に限定されない。ボタンは、例えば、等高線を表示させるための等高線ボタンであってもよい。 The buttons displayed on the 3D data display screen are not limited to the watermark button 901, change history button 902, and body temperature map button 903. The button may be, for example, a contour button for displaying contour lines.
 3Dデータ表示画面に表示される変更履歴は、必ずしも全ての変更履歴が表示されなくてもよい。例えば、過去半年間など所定の期間における変更履歴が表示されても良いし、変更のカテゴリが編集である変更情報のみが表示されてもよい。 The change history displayed on the 3D data display screen does not necessarily have to include all the change history. For example, a history of changes over a predetermined period such as the past six months may be displayed, or only change information whose change category is editing may be displayed.
 変更用端末30及び閲覧用端末40は、互いに異なる端末であることに限定されず、変更用端末30及び閲覧用端末40は同じ端末であってもよい。 The change terminal 30 and the viewing terminal 40 are not limited to being different terminals, and the changing terminal 30 and the viewing terminal 40 may be the same terminal.
 変更用端末プログラム及び閲覧用端末プログラムは、互いに異なるプログラムであることに限定されず、同一のプログラムであってもよい。変更用端末プログラムと閲覧用端末プログラムとが同一のプログラムである場合、そのプログラムは、3Dモデルを変更する機能及び3Dモデルを表示する機能の両方を備える。 The changing terminal program and the viewing terminal program are not limited to being different programs, and may be the same program. When the changing terminal program and the viewing terminal program are the same program, the program has both the function of changing the 3D model and the function of displaying the 3D model.
 情報処理システムSにおける機能要素とハードウェア要素との対応関係は実施形態において例示したものに限定されない。例えば、実施形態においてサーバ10の機能として説明したものの一部が、別のサーバに実装してもよい。あるいは、実施形態においてサーバ10の機能として説明したものの一部を、ネットワーク上の他の装置に実装してもよい。サーバ10は物理サーバであってもよいし、仮想サーバ(いわゆるクラウドを含む)であってもよい。変更用端末30又は閲覧用端末40の機能の一部または全部がサーバ10に実装されてもよい。 The correspondence between functional elements and hardware elements in the information processing system S is not limited to that illustrated in the embodiment. For example, some of the functions described as the functions of the server 10 in the embodiment may be implemented in another server. Alternatively, some of the functions described as the functions of the server 10 in the embodiment may be implemented in other devices on the network. The server 10 may be a physical server or a virtual server (including a so-called cloud server). A part or all of the functions of the change terminal 30 or the viewing terminal 40 may be implemented in the server 10.
 情報処理システムSの動作は上述した例に限定されない。情報処理システムSの処理手順は、矛盾の無い限り、順序が入れ替えられてもよい。また、情報処理システムSの一部の処理手順が省略されてもよい。 The operation of the information processing system S is not limited to the example described above. The order of the processing procedures of the information processing system S may be changed as long as there is no contradiction. Further, some processing procedures of the information processing system S may be omitted.
 要するに、本発明に係る情報処理システムにおいて、3Dモデルに関する情報の変更を受け付ける受付ステップと、前記変更を特定するコードを生成する生成手段と、前記生成されたコードを電子透かしとして前記3Dモデルに埋め込む埋込手段とが実行されていればよい。 In short, in the information processing system according to the present invention, there is provided a reception step that receives a change in information regarding a 3D model, a generation unit that generates a code that specifies the change, and embeds the generated code in the 3D model as a digital watermark. It is sufficient that the embedding means is executed.
 実施形態において例示した各種のプログラムは、それぞれ、インターネット等のネットワークを介したダウンロードにより提供されてもよいし、DVD-ROM(Digital Versatile Disc Read Only Memory)等のコンピュータ読み取り可能な非一時的記録媒体に記録された状態で提供されてもよい。 The various programs illustrated in the embodiments may be provided by downloading via a network such as the Internet, or may be provided on a computer-readable non-temporary recording medium such as a DVD-ROM (Digital Versatile Disc Read Only Memory). It may be provided in a recorded state.

Claims (10)

  1.  3Dモデルに関する情報の変更を受け付ける受付手段と、
     前記変更を特定するコードを生成する生成手段と、
     前記生成されたコードを電子透かしとして前記3Dモデルに埋め込む埋込手段と
     を有する情報処理システム。
    a reception means for accepting changes to information regarding the 3D model;
    generating means for generating a code specifying the change;
    and embedding means for embedding the generated code in the 3D model as a digital watermark.
  2.  前記生成手段は画像コードを生成し、
     前記埋込手段は前記画像コードを前記3Dモデルに埋め込む
     請求項1に記載の情報処理システム。
    The generating means generates an image code,
    The information processing system according to claim 1, wherein the embedding means embeds the image code in the 3D model.
  3.  前記埋込手段は、前記画像コードを前記3Dモデルのジオメトリの変化として埋め込む
     請求項2に記載の情報処理システム。
    The information processing system according to claim 2, wherein the embedding means embeds the image code as a change in geometry of the 3D model.
  4.  前記埋込手段は、前記画像コードを前記3Dモデルのテクスチャの変化として埋め込む
     請求項2に記載の情報処理システム。
    The information processing system according to claim 2, wherein the embedding means embeds the image code as a change in texture of the 3D model.
  5.  前記3Dモデルから前記電子透かしを除去する除去手段と、
     前記除去手段により前記電子透かしが除去された3Dモデルを表示する表示手段と
     を有する請求項1に記載の情報処理システム。
    removing means for removing the digital watermark from the 3D model;
    The information processing system according to claim 1, further comprising: a display unit for displaying a 3D model from which the digital watermark has been removed by the removal unit.
  6.  前記3Dモデルに関する情報の変更が、前記3Dモデルの編集である
     請求項1に記載の情報処理システム。
    The information processing system according to claim 1, wherein changing the information regarding the 3D model is editing the 3D model.
  7.  前記コードが、前記3Dモデルの変更履歴を示す
     請求項1に記載の情報処理システム。
    The information processing system according to claim 1, wherein the code indicates a change history of the 3D model.
  8.  前記コードが、前記3Dモデルの被写体から得られた生体情報を示す
     請求項1に記載の情報処理システム。
    The information processing system according to claim 1, wherein the code indicates biological information obtained from the subject of the 3D model.
  9.  前記生体情報が、あらかじめ定められた複数種類の生体情報のいずれかであり、
     前記埋込手段は、前記受付手段において変更が受け付けられた情報の種類に応じた形式の電子透かしを前記3Dモデルに埋め込む
     請求項8に記載の情報処理システム。
    The biometric information is any of a plurality of predetermined types of biometric information,
    The information processing system according to claim 8, wherein the embedding unit embeds, in the 3D model, a digital watermark in a format according to the type of information whose change is accepted by the accepting unit.
  10.  3Dモデルに関する情報の変更を受け付けるステップと、
     前記変更を特定するコードを生成するステップと、
     前記生成されたコードを電子透かしとして前記3Dモデルに埋め込むステップと
     を有する情報処理方法。
    accepting changes to information regarding the 3D model;
    generating code identifying the change;
    embedding the generated code in the 3D model as a digital watermark.
PCT/JP2022/029335 2022-07-29 2022-07-29 Information processing system and information processing method WO2024024099A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/JP2022/029335 WO2024024099A1 (en) 2022-07-29 2022-07-29 Information processing system and information processing method
JP2022549382A JPWO2024024099A1 (en) 2022-07-29 2022-07-29

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/029335 WO2024024099A1 (en) 2022-07-29 2022-07-29 Information processing system and information processing method

Publications (1)

Publication Number Publication Date
WO2024024099A1 true WO2024024099A1 (en) 2024-02-01

Family

ID=89705916

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/029335 WO2024024099A1 (en) 2022-07-29 2022-07-29 Information processing system and information processing method

Country Status (2)

Country Link
JP (1) JPWO2024024099A1 (en)
WO (1) WO2024024099A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002279295A (en) * 2001-03-21 2002-09-27 Minolta Co Ltd Method of providing processing data
JP2016085746A (en) * 2014-10-27 2016-05-19 トムソン ライセンシングThomson Licensing Method for watermarking three-dimensional object
US20190306385A1 (en) * 2014-01-31 2019-10-03 Digimarc Corporation Concerning digital marking and reading of plastic items, useful in recycling
JP2020088649A (en) * 2018-11-27 2020-06-04 株式会社リコー Image formation device, image formation system, and image formation method
US20210118087A1 (en) * 2018-10-15 2021-04-22 Huawei Technologies Co., Ltd. Watermark embedding method and apparatus, terminal, and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002279295A (en) * 2001-03-21 2002-09-27 Minolta Co Ltd Method of providing processing data
US20190306385A1 (en) * 2014-01-31 2019-10-03 Digimarc Corporation Concerning digital marking and reading of plastic items, useful in recycling
JP2016085746A (en) * 2014-10-27 2016-05-19 トムソン ライセンシングThomson Licensing Method for watermarking three-dimensional object
US20210118087A1 (en) * 2018-10-15 2021-04-22 Huawei Technologies Co., Ltd. Watermark embedding method and apparatus, terminal, and storage medium
JP2020088649A (en) * 2018-11-27 2020-06-04 株式会社リコー Image formation device, image formation system, and image formation method

Also Published As

Publication number Publication date
JPWO2024024099A1 (en) 2024-02-01

Similar Documents

Publication Publication Date Title
US8843852B2 (en) Medical interface, annotation and communication systems
US20060021024A1 (en) User certification apparatus and user certification method
US11627944B2 (en) Ultrasound case builder system and method
JP7422362B2 (en) Content provision system and content provision method
US20170270324A1 (en) Associating consumer-provided assets with physical objects using nfc tags
WO2012020906A1 (en) Apparatus and method for generating a cognitive training application program using brain waves, and medium for recording same
US20090146948A1 (en) Apparatus for Providing Sensing Information
WO2024024099A1 (en) Information processing system and information processing method
JP2024018931A (en) Information processing system and information processing method
JP2008299760A (en) Image presentation device and method
CN111164665B (en) Information processing device, information system, information processing method, and program
JP2024006871A (en) Treatment plan creation system and treatment plan creation method
JP2002051991A (en) User information setting method of portable medical instrument and portable medical instrument
WO2021132052A1 (en) Server and sales method
Liu et al. The application of 3D dense face alignment in esthetic rehabilitation
CN104065846B (en) Communication system, communication means and information processor
KR102152940B1 (en) Medical practice contents cps(contents sercice platform) interworking interface
KR100454440B1 (en) System and method of making 3D body model
JP2022041660A (en) Lesion information display program, information output program, and information output system
JP2003528386A (en) Devices in a computer system
JP7386584B1 (en) Program, information processing device and information processing method
KR20030031945A (en) Real Rate Body Size Information System
JP7382111B1 (en) Information processing device and information processing method
WO2023210187A1 (en) Information processing device, information processing method, and program
WO2023149562A1 (en) Operation system and operation method for virtual space or online meeting system

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 2022549382

Country of ref document: JP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22953187

Country of ref document: EP

Kind code of ref document: A1