WO2023053356A1 - Device including communication control object, communication control method, and communication control program - Google Patents

Device including communication control object, communication control method, and communication control program Download PDF

Info

Publication number
WO2023053356A1
WO2023053356A1 PCT/JP2021/036171 JP2021036171W WO2023053356A1 WO 2023053356 A1 WO2023053356 A1 WO 2023053356A1 JP 2021036171 W JP2021036171 W JP 2021036171W WO 2023053356 A1 WO2023053356 A1 WO 2023053356A1
Authority
WO
WIPO (PCT)
Prior art keywords
communication control
control object
ips
communication
connection
Prior art date
Application number
PCT/JP2021/036171
Other languages
French (fr)
Japanese (ja)
Inventor
英作 大西
泰伯 山崎
弘賢 尾野
Original Assignee
株式会社アイ・エル・シー
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社アイ・エル・シー filed Critical 株式会社アイ・エル・シー
Priority to PCT/JP2021/036171 priority Critical patent/WO2023053356A1/en
Publication of WO2023053356A1 publication Critical patent/WO2023053356A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]

Definitions

  • the present invention relates to a device having a communication control object, a communication control method, and a communication control program.
  • IPs intelligent properties
  • a camera performs image processing for each IP.
  • a cell switch is arranged between a CPU and a subordinate device, and control communication is performed between the CPU and subordinate device or subordinate devices via the cell switch.
  • IP In recent years, due to the diversification of IP such as AI and cloud, there are cases where IP is connected in series or in parallel. In the conventional technology, IPs are connected and data processing is performed only within one device (camera). For this reason, it has not been possible to respond to requests such as sharing data processing among different devices and performing data processing via the Internet or the like.
  • an object of the present invention is to enable easy switching of connections between IP functions provided in a device.
  • the device of the present invention is arranged between a plurality of functional IPs (intellectual properties) possessed by the device, and has a communication interface for switchably connecting the data and instructions of the IP with other IPs. It is characterized by having a communication control object objectified by a class structure.
  • a plurality of communication control objects are provided, and one IP is connected to a plurality of different IPs.
  • the communication control object is characterized in that a plurality of said IPs are provided and each of said plurality of IPs is connected to one said IP.
  • the communication control object is characterized by combining the functions of a communication unit that performs communication between the IPs and a switching unit that performs connection switching by combining hardware and/or software.
  • the communication control object is characterized by performing settings and data transfer control related to connection with the IP through a unified interface.
  • the communication control object is characterized in that it can be reused by inheriting a class of the communication control object similar to the desired function during development.
  • the communication control object or the IP is characterized by having a function of mutual connection propriety.
  • the communication control object is characterized in that the connection state between the IPs can be replaced with another communication control object.
  • the communication control object is characterized by being connectable with the IP of an external device.
  • the external device is characterized by including a cloud.
  • the communication control method of the present invention uses a communication control object in which a communication interface is objectified in a class structure, and transfers data and commands of the IP to other IPs between a plurality of IPs (intellectual properties) for each function of a device.
  • the computer executes the process of switchably connecting with the .
  • the communication control program of the present invention uses a communication control object, which is a communication interface objectified in a class structure, to transfer data and instructions of the IP to other IPs (intellectual properties) among a plurality of IPs (intellectual properties) for each function of the device. It is characterized by having a computer execute processing by being switchably connected to the .
  • the communication control object can arbitrarily switch between multiple IPs provided in the device. Also, during development, connections between multiple IPs can be configured with a simple description.
  • FIG. 1 is an explanatory diagram of a communication control object according to an embodiment.
  • FIG. 2 is a diagram showing an example of functions of a communication control object.
  • Part 1 FIG. 3 is a diagram showing an example of functions of a communication control object.
  • Part 2 FIG. 4 is a diagram showing an example of functions of a communication control object.
  • Part 3 FIG. 5 is a diagram showing an example of functions of a communication control object.
  • FIG. 6 is a diagram showing an example of functions of a communication control object.
  • FIG. 7 is a diagram showing an example of functions of a communication control object.
  • Part 6) FIG. 8 is a diagram showing an example of functions of a communication control object.
  • Part 7 FIG.
  • FIG. 9 is a block diagram showing a configuration example of a communication system including communication control objects.
  • FIG. 10 is a block diagram showing an example of communication connection of communication control objects.
  • 11 is a diagram illustrating an example of a hardware configuration of an apparatus according to an embodiment;
  • FIG. 12 is a chart showing communication control functions of a communication control object.
  • FIG. 13 is a sequence diagram showing initial processing of inter-IP connection by a communication control object.
  • FIG. 14 is a sequence diagram showing inter-IP connection processing by a communication control object.
  • FIG. 15 is a diagram illustrating an example of image processing for image data.
  • FIG. 16A is an explanatory diagram showing IP-to-IP connection for conventional image processing.
  • FIG. 16B is an explanatory diagram of an inter-IP connection for image processing according to the embodiment;
  • FIG. 16C is an explanatory diagram of an inter-IP connection including an image processing cloud according to the embodiment;
  • FIG. 1 is an explanatory diagram of a communication control object according to the embodiment.
  • a communication control object (Object) 100 controls communication connections between a plurality of functions (IPs 150) inside or outside the device, and enables sharing of data and instructions between IPs 150 connected to each other.
  • the communication control object 100 is an object made from the functions of the communication interface (IF) of the IP 150, and actually consists of a class structure.
  • the communication control object 10 is called from the software 101 that uses the IP of the equipment and controls the communication connection between the IPs 150 of the equipment.
  • the communication control object 100 has the following 1.
  • ⁇ 10. has the function of
  • the communication control object 100 has one or more output terminals 100a and zero or more input terminals 100b.
  • An output-side terminal is a terminal connected to the output side of the IP 150, and an input-side terminal is a terminal connected to the input side of the IP.
  • the output terminal 100a of the communication control object 100 can receive various data from the IP 150, as well as commands and continuous (stream) data.
  • the IP 150 on the side of the output terminal 100a of the communication control object 100 can connect multiple communication control objects at the same time.
  • the input terminal 100b of the communication control object 100 can be connected to one IP150.
  • the communication control object 100 itself can be composed of hardware (HW) such as Ethernet (registered trademark) and serial communication, and switches (SW) to be controlled. Further, the communication control object 100 can also be configured with HW and setting SW (data transfer is performed only by HW and SW does not intervene). Furthermore, the communication control object 100 can also be composed only of HW.
  • HW hardware
  • SW switches
  • the communication control object 100 has a unified interface (setting, start/end of transfer, etc.) regardless of mechanisms such as HW and SW. 7.
  • Communication control objects 100 having similar properties can reuse similar communication control objects 100 (class inheritance). As a result, the number of man-hours required for developing the device can be reduced.
  • IP 150 uses communication control object 100, IP 150 and input terminal 100b of communication control object 100 can confirm whether connection is possible before use.
  • the IP 150 can dynamically change the communication control object 100 to change the connection destination and the like.
  • the communication control object 100 can be applied not only between IPs 150 but also for Ethernet, serial communication, memory sharing, and the like. Therefore, it is possible to output from the IP 150 via Ethernet, cooperate with the IP 150 in the cloud, transfer processed data (images, etc.) to an external device such as a smartphone, and display the data.
  • FIG. 2 to 8 are diagrams showing functional examples of communication control objects.
  • FIG. 2 shows the above 1.
  • the communication control object 100 has one or more output terminals 100a and zero or more input terminals 100b.
  • the communication control object 100A has the output side terminal 100a connected to IP1 (150A) and the input side terminal 100b connected to IP2 (150B). Also, another communication control object 100B can be provided, and the output side terminal 100a of the communication control object 100B can be connected to IP1 (150A), and the input side terminal 100b can be connected to IP3 (150C).
  • one IP1 (150A) can be communicatively connected to two different IP2, 3 (150B, 150C).
  • Fig. 3 shows the above 4.
  • the input side terminals 100b of a plurality of communication control objects 100 can be connected to one IP150.
  • the communication control object 100A has the output side terminal 100a connected to IP1 (150A) and the input side terminal 100b connected to IP3 (150C).
  • the output side terminal 100a of another communication control object 100B can be connected to IP2 (150B), and the input side terminal 100b can be connected to IP3 (150C).
  • IP1, 2 150A, 150B
  • IP3 150C
  • the communication control object 100 has a unified interface (setting, start/end of transfer, etc.) regardless of mechanisms such as HW and SW.
  • the communication control object 100A shown in FIG. 4A has common IF401, SW402, and HW403, and communication settings for common IF401 are set in SW402 and HW403.
  • the communication control object 100A transfers to the SW 402 and HW 403 a start (transfer start) control command to the common IF 401 .
  • the communication control object 100A causes the SW 402 and HW 403 to control transfer (data transfer) to the common IF 401 .
  • the communication control object 100B is configured to have a common IF 401 and HW 403. In this case, communication settings for the common IF 401 are set in the HW 403. Similarly, the communication control object 100B transfers to the HW 403 a control command to start (transfer start) to the common IF 401 . The communication control object 100B causes the HW 403 to automatically control transfer (data transfer) to the common IF 401 .
  • the communication control object 100 can reduce development man-hours by reusing (inheriting) communication control objects with similar properties (behavior/mechanism). can. As shown in FIG. 5, regarding the functions necessary for the development of the communication control object 100B, if the communication control object 100B has functions similar to those of the already created communication control object 100A, the communication control functions (programs) already created as the communication control object 100A etc.) can be reused in the communication control object 100B.
  • Fig. 6 shows the above 8.
  • the communication control object 100A has the output side terminal 100a connected to IP1 (150A) and the input side terminal 100b connected to IP2 (150B).
  • the output side terminal 100a of the communication control object 100B is connected to IP1 (150A), and the input side terminal 100b is connected to IP2 (150B).
  • IP2 (150B) uses communication control objects A and B (150A and 150B), whether own IP2 (150B) can communicate with input terminals 100b of communication control objects A and B (150A and 150B) After confirmation, own IP2 (150B) selects communication control objects A and B to which communication connection is possible and performs data communication.
  • Fig. 7 shows the above 9.
  • the communication control object 100 can be dynamically changed to change the connection destination and the like.
  • IP1 and IP2 150A, 150B
  • communication control object A 100A
  • FIG. 7B the communication connection between IP1 and IP2 (150A, 150B) is changed from communication control object A (100A) to another communication control object B (100B). can be connected.
  • Fig. 8 shows the above 10.
  • the communication control object 100 can be applied not only between IPs 150 but also for Ethernet, serial communication, memory sharing, and the like.
  • IP1 and IP2 (150A, 150B) are connected by communication control object A (100A)
  • IP2 (150B) and external device 800 are connected by communication control object B (100B). etc.) are connected.
  • the IP2 (150B) can output to an external device via Ethernet
  • the IP2 (150B) can cooperate with the cloud 801, and the data such as processed images can be displayed on the smart phone 802 or the like.
  • FIG. 9 is a block diagram showing a configuration example of a communication system including communication control objects.
  • a plurality of communication control objects 100, a plurality of IPs 150, and IP-using software 101A and 101B are arranged in a camera 900 and an external cloud 910, respectively.
  • the communication control object 100 exists between the IPs 150 to be connected, and is called from the software 101A, 101B using the IPs 150.
  • FIG. 9 is a block diagram showing a configuration example of a communication system including communication control objects.
  • a plurality of communication control objects 100, a plurality of IPs 150, and IP-using software 101A and 101B are arranged in a camera 900 and an external cloud 910, respectively.
  • the communication control object 100 exists between the IPs 150 to be connected, and is called from the software 101A, 101B using the IPs 150.
  • FIG. 9 is a block diagram showing a configuration example of a communication system including communication control objects.
  • a plurality of IPs 150 is a configuration example of each function for image processing an image captured by the camera 900.
  • On the camera 900 side there are software 101A that indirectly uses IPs using a communication control object, and a plurality of IPs 150. , and a plurality of communication control objects 100 for communication connection between IPs 150 .
  • the cloud 910 side includes software 101B that uses IP, IP 150, and a plurality of communication control objects 100 that connect and communicate between IPs.
  • the plurality of IPs 150 on the camera 900 side include an image memory IP 150A, a white balance IP 150B for white balance adjustment, a brightness and saturation IP 150C for brightness and saturation adjustment, an erection IP 150D for image data erection, and an image for obtaining an image recognition result. It has the recognition result IP150E.
  • the IP 150 on the cloud 910 side has a cloud AI IP 150F that performs various AI processing on image data.
  • a plurality of communication control objects 100A to 100E on the camera 900 side and a plurality of communication control objects 100F and 100G on the cloud 910 side connect arbitrary IPs 150A to 150F for communication.
  • FIG. 10 is a block diagram showing an example of communication connection of communication control objects.
  • 9 shows an example of communication connection of the IPs 150A to 150G shown in FIG.
  • black arrows indicate process calls
  • white arrows indicate data flow.
  • a process of processing image data captured by the camera 900 by the plurality of IPs 150 inside the camera 900 and then returning the image data after AI processing such as image recognition in the cloud 910 to the camera 900 will be described.
  • communication IPs 150G to 150I for performing communication processing are provided.
  • the IP-using software 101A instructs the communication control object 100 to perform communication connection processing between the plurality of IPs 150 .
  • the IP-using software 101B instructs the communication control object 100 to perform communication connection processing between the plurality of IPs 150 .
  • the communication control object 100A on the camera 900 side connects between the image memory 150A and the white balance IP 150B.
  • Communication control object 100B connects between white balance IP 150B and brightness/saturation IP 150C.
  • the communication control object 100C connects between the brightness/saturation IP 150C and the erection IP 150D.
  • Communication control object 100D connects between erect IP 150D and communication IP 150G.
  • the communication control object 100E connects between the communication IP 150G and the image recognition result IP 150E.
  • the communication control object 100F on the cloud 910 side connects the communication IP 150H and the cloud AI IP 150F.
  • the communication control object 100G connects between the cloud AI IP 150F and the communication IP 150I.
  • the communication IP 150G on the camera 900 side transmits and receives data to and from the communication IPs 150H and 150I on the cloud 910 side via the Internet using, for example, the HTTP (Hyper Text Transfer Protocol) protocol.
  • HTTP Hyper Text Transfer Protocol
  • the communication control object 100E on the camera 900 side connects the communication IP 150G to the communication IP 150H on the cloud 910 side, so that the image data after the upright adjustment can be sent to the cloud AI IP 150F. Further, the communication control object 100G on the cloud 910 side can send the AI-processed image data to the image recognition result IP 150E by connecting the communication IP 150I to the communication IP 150G on the camera 900 side.
  • the image data read out from the image memory 150A is adjusted in white balance by white balance IP150B, and then adjusted in brightness and saturation by brightness/saturation IP150C.
  • the image data after the erection adjustment by the erection IP 150D is sent to the communication IP 150H on the cloud 910 side by the communication IP 150G.
  • the communication IP 150H receives image data from the camera 900 side, and the cloud AI IP 150F performs predetermined AI processing (for example, image recognition of image data) on the image data.
  • predetermined AI processing for example, image recognition of image data
  • the image data after AI processing is returned to the communication IP 150G on the camera 900 side via the communication IP 150I.
  • the image recognition result IP 150E on the camera 900 side can output the image recognition result AI-processed on the cloud 910 side.
  • FIG. 11 is a diagram illustrating a hardware configuration example of the device according to the embodiment.
  • the communication control object 100, the IP 150, and the software 101A using the IP, which constitute the functions of the camera 900, can be realized by the hardware shown in FIG. 11, a camera 900 includes a control unit (CPU) 1101, a read-only memory (ROM) 1102, a random access memory (RAM) 1103, an auxiliary storage unit 1104 such as a semiconductor memory or disk drive, and a communication interface. (I/F) 1105 and an input/output I/F 1110 are included. These CPU 1101 to input/output I/F 1110 are connected by a bus 1106, respectively.
  • CPU control unit
  • ROM read-only memory
  • RAM random access memory
  • I/F input/output I/F 1110
  • the camera 900 is not limited to a single embedded device, but may be a part of a PC, a smartphone, or the like, and may have a display, keyboard, mouse, scanner, or printer according to the configuration of the device. can be connected via the input/output I/F 1110 .
  • a touch panel that integrates the functions of a display, keyboard, and mouse.
  • the CPU 1101 is an arithmetic processing unit that controls the camera 900 and mainly connects the IPs 150 for communication in the embodiment.
  • a ROM 1102 is a non-volatile memory that stores programs for the camera 900 and the like.
  • a RAM 1103 is a volatile memory used as a work area when the CPU 1101 executes arithmetic processing of a program.
  • the communication I/F 1105 serves as an internal interface with the network NW, and performs data input/output with other devices. Specifically, the communication I/F 1105 communicates with an external device such as the cloud 910 via various networks NW such as LAN (Local Area Network), CAN, and ECHONET (registered trademark).
  • NW Local Area Network
  • CAN Controller Area Network
  • ECHONET registered trademark
  • the network NW includes WiFi (registered trademark), Bluetooth (registered trademark), infrared communication (IrDA), etc., and is capable of wireless/wired communication with external devices.
  • WiFi registered trademark
  • Bluetooth registered trademark
  • IrDA infrared communication
  • Fig. 12 is a chart showing the communication control functions of the communication control object.
  • the substance of the communication control object 100 is a class structure, and the interface for controlling communication connections between IPs 150 has methods shown in FIG. 12(a) and member variables shown in FIG. 12(b).
  • the method in FIG. 12(a) controls the IP 150 by name (command). For example, config configures the device (IP150). start starts data transmission/reception, and stop stops data transmission/reception.
  • the name indicates the name of the communication control object 100, and is reference information to the SepObject to which this communication control object 100 is bound (see FIG. 5).
  • FIG. 13 is a sequence diagram showing initial processing of IP-to-IP connection by a communication control object.
  • the IP 150 executes initialization processing triggered by the power on (step S1302), and executes device initialization (step S1303).
  • the IP 150 executes a device addition process (step S1304).
  • the device performs software initialization (step S1305), initializes the IP-using software 101A (step S1306), and configures the communication control object 100 (step S1307).
  • Examples of various settings for the communication control object 100 include IP 150 device selection settings (step S 1308 ), IP 150 initial settings (step S 1309 ), IP 150 operation settings (step S 1310 ), IP 150 settings acquisition (step S 1311 ), setting restoration (step S1312).
  • FIG. 14 is a sequence diagram showing inter-IP connection processing by a communication control object.
  • the IP-using software 101A issues a connection instruction to the communication control object 100 (step S1402). ).
  • the communication control object 100 performs connection control with the corresponding IP 150 in response to the connection instruction (step S1404).
  • the communication control object 100 may check the connectivity with the IP 150 (step S1403) and then control the connection.
  • the IP-using software 101A instructs the communication control object 100 to prepare for transmission/reception (step S1405), and the communication control object 100 prepares for transmission/reception with the corresponding IP 150 (step S1406).
  • the IP-using software 101A instructs the communication control object 100 to transmit and receive (step S1407), and the communication control object 100 performs transmission and reception with the corresponding IP 150 (step S1408).
  • the communication control object 100 checks the communication compatibility of the IP 150 (step S1408), exchanges setting information from the connection destination IP 150 to which the IP 150 is connected, and then starts data transmission/reception (step S1409).
  • FIG. 15 is a diagram explaining an example of image processing for image data.
  • An image 1500 such as a scene taken by an imaging device through a lens 920 of a broadcasting camera 900 is stored as digitized image data 1500a in an image memory 150A.
  • This image data 1500a connects a plurality of IPs 150 such as white balance, and is displayed as an image file or through a finder.
  • the image data 1500a is subjected to white balance adjustment processing 1500b, brightness/saturation adjustment processing 1500c, and erection adjustment processing 1500d, and then finder display processing 1501 and image file processing 1502, respectively.
  • FIG. 16A is an explanatory diagram showing IP-to-IP connections for conventional image processing.
  • the IPs 150 corresponding to the image processing for the image data 1500a shown in FIG. 15 are fixedly connected in order.
  • IPs 150A to 150D corresponding to white balance adjustment processing 1500b to finder display processing 1501 and image file processing 1502 are fixedly connected in order. Therefore, even if the communication control between the IPs 150 is similar, the communication control between the IPs 150 must be described one by one for each IP 150, which is complicated. there was no
  • FIG. 16B is an explanatory diagram showing inter-IP connections for image processing according to the embodiment.
  • a plurality of IPs 150 are selected by the communication control object 100 inside the camera 900 to connect the processes.
  • the communication control object 100 switches and connects arbitrary IPs 150 for each of the IPs 150A to 150D corresponding to the white balance adjustment processing 1500b to the finder display processing 1501 and the image file processing 1502 shown in FIG. can do.
  • the communication control object 100A connects the image memory 150A and the white balance IP 150B.
  • the communication control object 100A can switch the image data in the image memory 150A not only to the white balance IP150B but also to IP150Ba of other image processing functions.
  • the communication control object 100B connects between the white balance IP 150B and the brightness/saturation IP 150C.
  • the communication control object 100B can connect between the white balance IP150B and other image processing functions IP150Ba, and the brightness/saturation IP150C and other image processing functions IP150Ca.
  • the communication control object 100C connects the lightness/saturation IP 150C and the erection IP 150D.
  • the communication control object 100C can connect between the brightness/saturation IP150C and IP150Ca of other image processing functions, and the IP150Da of erect IP150D and other image processing functions.
  • the erect IP 150D is connected to the finder image IP 1601 through the communication control object 100D, and is connected to the image file IP 1602 through the communication control object 100E.
  • the communication control object 100D can connect the erect IP150D or the IP150Da of other image processing functions with the finder image IP1601.
  • the communication control object 100E can connect the erect IP150D or the IP150Da of another image processing function with the image file IP1602.
  • the communication control object 100 connects the plurality of IPs 150 in a switchable manner. Thereby, the order of image processing by a plurality of IPs 150 can be arbitrarily executed. In addition, image processing can be performed by adding functions of other IPs, and the flexibility of image processing can be improved. In addition, the communication control object 100 can be described by reusing communication control between certain IPs 150, can be easily connected, and can improve the degree of freedom such as changing the procedure of image processing.
  • FIG. 16C is an explanatory diagram showing an inter-IP connection including an image processing cloud according to the embodiment.
  • the IPs 150 inside the camera 900 are arbitrarily connected by the communication control object 100 as in the description of FIG. 16B. Also, between the camera 900 and the cloud 910 , the communication control object 100 can be used to connect to any IP 150 .
  • the upright IP 150D is connected to the cloud AI IP 150F of the cloud 910 by the communication control object 100D, and the image recognition result IP 150E is connected by the communication control object 100E.
  • image processing is performed by combining IP image processing on the camera 900 side and IP image processing (AI processing) on the cloud 910 side.
  • communication control is performed by objectifying a communication interface arranged between a plurality of function-specific IPs 150 possessed by a device and connecting data and instructions of the IPs 150 switchably with other IPs 150 in a class structure. It has an object 100 . This enables switching connection between arbitrary IPs 150 .
  • a plurality of communication control objects are provided, and one IP can be connected to a plurality of different IPs. Also, a plurality of communication control objects are provided, and a plurality of IPs can be connected to one IP. As a result, it is possible to dynamically change the connection between IPs and replace the IPs in the required order of processing for data processing.
  • the communication control object can configure the functions of a communication unit that performs communication between IPs and a switching unit that performs connection switching by combining hardware and/or software.
  • Communication control objects including IP and software using IP, can be easily configured by arbitrarily combining functions such as communication control and switches with software and hardware.
  • the communication control object performs settings related to IP connection and data transfer control through a unified interface. This makes it possible to easily connect IPs without depending on mechanisms such as hardware and switches.
  • the communication control object can be reused by inheriting the class of the communication control object similar to the desired function during development. Reusing some or all of the functions that are similar to already created communication control objects in the new communication control object can reduce development man-hours. become able to.
  • the communication control object or IP has a function of mutual connection propriety. As a result, it is possible to perform data transmission/reception between IPs only when connection between IPs is possible.
  • the communication control object can replace the connection state between IPs with another communication control object. By replacing the IP being connected in an existing communication control object with another communication control object, the IP of the connection destination can be easily changed.
  • the communication control object can be connected to the IP of an external device.
  • external equipment includes the cloud.
  • the device in addition to switching IP-to-IP connections within a single device, the device can be connected to a cloud or the like.
  • the communication control object is applicable not only to connections between IPs, but also to Ethernet, serial communication, memory sharing, and the like.
  • AI processing that cannot be performed by the device alone can be processed on the cloud side, and the processing result can be returned to the device.
  • the communication control object can dynamically change the connection between IPs, which has been fixed until now, to an external device within the device or via the Internet. It can flexibly respond to requests for changing connections between them. As a result, in addition to sharing data processing among different devices and distributing the load, it will be possible to respond to requests for data processing on external devices such as the cloud via the Internet. As for development, as the number of IPs used in the device increases, the number of man-hours for developing connections between individual IPs also increases.
  • the communication control object can configure the connection between IPs with a simple description, and can switch the connection between IPs freely, thereby suppressing an increase in development man-hours.
  • the present invention can be used for devices that arbitrarily connect the IP connection state for each function and the connection state with the IP of the external device, and is particularly useful for devices that have multiple functions.

Abstract

The present invention includes a communication control object (100) that is disposed between multiple IPs (150) provided for respective functions of a device and is generated by converting a communication interface, which connects data and an instruction of an IP (150) to another IP (150) in a switchable manner, into an object on the basis of a class structure. Multiple communication control objects (100) may be provided to connect one IP (150) to multiple different IPs (150) and to connect multiple IPs (150) to one IP (150).

Description

通信制御オブジェクトを有する機器、通信制御方法および通信制御プログラムDevice having communication control object, communication control method and communication control program
　この発明は、通信制御オブジェクトを有する機器、通信制御方法および通信制御プログラムに関する。 The present invention relates to a device having a communication control object, a communication control method, and a communication control program.
　機器は、ＩＰ（ｉｎｔｅｌｌｅｃｔｕａｌ　ｐｒｏｐｅｒｔｙ）と呼ばれる複数の機能（Ｈａｒｄｗａｒｅ）を連結してデータを入出力し、複数のＩＰによるデータ処理を行っている。例えば、カメラはＩＰ別の画像処理を行っている。 Devices connect multiple functions (hardware) called IPs (intellectual properties) to input and output data, and perform data processing using multiple IPs. For example, a camera performs image processing for each IP.
　従来、機器内の機能間の通信接続に関連する技術として、例えば、ＣＰＵと配下装置の間にセルスイッチを配置し、セルスイッチを介してＣＰＵと配下装置、または配下装置間の制御通信を行うものがある。 Conventionally, as a technology related to communication connection between functions in a device, for example, a cell switch is arranged between a CPU and a subordinate device, and control communication is performed between the CPU and subordinate device or subordinate devices via the cell switch. there is something
特開平１０－１７１７５３号公報JP-A-10-171753
　近年、ＡＩやクラウドなどＩＰの多様化により、ＩＰを直列または並列に接続する場合が生じている。従来技術では、一つの機器（カメラ）内だけでＩＰを連結し、データ処理を行っている。このため、異なる機器間でのデータ処理の分担や、インターネットなどを介してデータ処理を行う等の要求に対応できなかった。 In recent years, due to the diversification of IP such as AI and cloud, there are cases where IP is connected in series or in parallel. In the conventional technology, IPs are connected and data processing is performed only within one device (camera). For this reason, it has not been possible to respond to requests such as sharing data processing among different devices and performing data processing via the Internet or the like.
　また、近年、装置内に使用するＩＰの数が増加し、個々のＩＰ間の接続を開発する工数も増大してきている。従来、ＩＰ間の接続は固定的であるため、インターネット経由で画像を転送するなど、動的にＩＰ間の接続を変化させねばならない要求に対応できない。 Also, in recent years, the number of IPs used in devices has increased, and the number of man-hours to develop connections between individual IPs has also increased. Conventionally, the connection between IPs is fixed, so it is not possible to respond to requests that dynamically change the connection between IPs, such as transferring images via the Internet.
　また、従来技術では、開発時にＩＰ間の接続を簡単に使用（記述）したいという要求、ＩＰ間の接続を自由に切り替えたいという要求、に対応することができなかった。 In addition, the conventional technology was unable to respond to requests for easy use (description) of connections between IPs during development and requests for free switching of connections between IPs.
　本発明は、上記課題に鑑み、装置が備えるＩＰの機能間の接続を簡単に切り替えできることを目的とする。 In view of the above problems, an object of the present invention is to enable easy switching of connections between IP functions provided in a device.
　上記目的を達成するため、本発明の機器は、機器が有する複数の機能別のＩＰ（ｉｎｔｅｌｌｅｃｔｕａｌ　ｐｒｏｐｅｒｔｙ）間に配置され、前記ＩＰのデータおよび命令を他のＩＰと切り替え可能に接続する通信インタフェースをクラス構造でオブジェクト化した通信制御オブジェクト、を有することを特徴とする。 In order to achieve the above object, the device of the present invention is arranged between a plurality of functional IPs (intellectual properties) possessed by the device, and has a communication interface for switchably connecting the data and instructions of the IP with other IPs. It is characterized by having a communication control object objectified by a class structure.
　また、前記通信制御オブジェクトは、複数設けられ、一つの前記ＩＰを異なる複数の前記ＩＰにそれぞれ接続することを特徴とする。 A plurality of communication control objects are provided, and one IP is connected to a plurality of different IPs.
　また、前記通信制御オブジェクトは、複数設けられ、複数の前記ＩＰを一つの前記ＩＰにそれぞれ接続することを特徴とする。 Also, the communication control object is characterized in that a plurality of said IPs are provided and each of said plurality of IPs is connected to one said IP.
　また、前記通信制御オブジェクトは、前記ＩＰ間の通信を行う通信部および接続切り替えを行う切替部の機能をハードウェアおよび／またはソフトウェアの組み合わせによりなることを特徴とする。 Also, the communication control object is characterized by combining the functions of a communication unit that performs communication between the IPs and a switching unit that performs connection switching by combining hardware and/or software.
　また、前記通信制御オブジェクトは、統一インタフェースにより、前記ＩＰとの接続にかかる設定およびデータ転送制御を行うことを特徴とする。 Also, the communication control object is characterized by performing settings and data transfer control related to connection with the IP through a unified interface.
　また、前記通信制御オブジェクトは、開発時に所望する機能に類似する通信制御オブジェクトのクラス継承により再利用可能なことを特徴とする。 Also, the communication control object is characterized in that it can be reused by inheriting a class of the communication control object similar to the desired function during development.
　また、前記通信制御オブジェクトあるいは前記ＩＰは、互いの接続可否の機能を有することを特徴とする。 Also, the communication control object or the IP is characterized by having a function of mutual connection propriety.
　また、前記通信制御オブジェクトは、前記ＩＰ間の接続状態を他の通信制御オブジェクトに入れ替え可能なことを特徴とする。 Also, the communication control object is characterized in that the connection state between the IPs can be replaced with another communication control object.
　また、前記通信制御オブジェクトは、外部の機器が有する前記ＩＰと接続可能なことを特徴とする。 Also, the communication control object is characterized by being connectable with the IP of an external device.
　また、前記外部の機器は、クラウドを含むことを特徴とする。 Also, the external device is characterized by including a cloud.
　また、本発明の通信制御方法は、通信インタフェースをクラス構造でオブジェクト化した通信制御オブジェクトにより、機器が有する複数の機能別のＩＰ（ｉｎｔｅｌｌｅｃｔｕａｌ　ｐｒｏｐｅｒｔｙ）間で、前記ＩＰのデータおよび命令を他のＩＰと切り替え可能に接続する、処理をコンピュータが実行することを特徴とする。 In addition, the communication control method of the present invention uses a communication control object in which a communication interface is objectified in a class structure, and transfers data and commands of the IP to other IPs between a plurality of IPs (intellectual properties) for each function of a device. The computer executes the process of switchably connecting with the .
　また、本発明の通信制御プログラムは、通信インタフェースをクラス構造でオブジェクト化した通信制御オブジェクトにより、機器が有する複数の機能別のＩＰ（ｉｎｔｅｌｌｅｃｔｕａｌ　ｐｒｏｐｅｒｔｙ）間で、前記ＩＰのデータおよび命令を他のＩＰと切り替え可能に接続する、処理をコンピュータに実行させることを特徴とする。 In addition, the communication control program of the present invention uses a communication control object, which is a communication interface objectified in a class structure, to transfer data and instructions of the IP to other IPs (intellectual properties) among a plurality of IPs (intellectual properties) for each function of the device. It is characterized by having a computer execute processing by being switchably connected to the .
　上記構成によれば、通信制御オブジェクトは、装置が備える複数のＩＰ間を任意に切り替えることができる。また、開発時、複数のＩＰ間の接続を簡単な記述で構成できるようになる。 According to the above configuration, the communication control object can arbitrarily switch between multiple IPs provided in the device. Also, during development, connections between multiple IPs can be configured with a simple description.
　本発明によれば、装置が備えるＩＰの機能間の接続を簡単に切り替えできるという効果を奏する。 According to the present invention, it is possible to easily switch the connection between the IP functions provided in the device.
図１は、実施の形態にかかる通信制御オブジェクトの説明図である。FIG. 1 is an explanatory diagram of a communication control object according to an embodiment. 図２は、通信制御オブジェクトの機能例を示す図である。（その１）FIG. 2 is a diagram showing an example of functions of a communication control object. (Part 1) 図３は、通信制御オブジェクトの機能例を示す図である。（その２）FIG. 3 is a diagram showing an example of functions of a communication control object. (Part 2) 図４は、通信制御オブジェクトの機能例を示す図である。（その３）FIG. 4 is a diagram showing an example of functions of a communication control object. (Part 3) 図５は、通信制御オブジェクトの機能例を示す図である。（その４）FIG. 5 is a diagram showing an example of functions of a communication control object. (Part 4) 図６は、通信制御オブジェクトの機能例を示す図である。（その５）FIG. 6 is a diagram showing an example of functions of a communication control object. (Part 5) 図７は、通信制御オブジェクトの機能例を示す図である。（その６）FIG. 7 is a diagram showing an example of functions of a communication control object. (Part 6) 図８は、通信制御オブジェクトの機能例を示す図である。（その７）FIG. 8 is a diagram showing an example of functions of a communication control object. (Part 7) 図９は、通信制御オブジェクトを含む通信システムの構成例を示すブロック図である。FIG. 9 is a block diagram showing a configuration example of a communication system including communication control objects. 図１０は、通信制御オブジェクトの通信接続例を示すブロック図である。FIG. 10 is a block diagram showing an example of communication connection of communication control objects. 図１１は、実施の形態にかかる装置のハードウェア構成例を示す図である。11 is a diagram illustrating an example of a hardware configuration of an apparatus according to an embodiment; FIG. 図１２は、通信制御オブジェクトの通信制御機能を示す図表である。FIG. 12 is a chart showing communication control functions of a communication control object. 図１３は、通信制御オブジェクトによるＩＰ間接続の初期処理を示すシーケンス図である。FIG. 13 is a sequence diagram showing initial processing of inter-IP connection by a communication control object. 図１４は、通信制御オブジェクトによるＩＰ間接続処理を示すシーケンス図である。FIG. 14 is a sequence diagram showing inter-IP connection processing by a communication control object. 図１５は、画像データに対する画像処理例を説明する図である。FIG. 15 is a diagram illustrating an example of image processing for image data. 図１６Ａは、従来の画像処理のＩＰ間接続を示す説明図である。FIG. 16A is an explanatory diagram showing IP-to-IP connection for conventional image processing. 図１６Ｂは、実施の形態にかかる画像処理のＩＰ間接続を示す説明図である。FIG. 16B is an explanatory diagram of an inter-IP connection for image processing according to the embodiment; 図１６Ｃは、実施の形態にかかる画像処理のクラウドを含めたＩＰ間接続を示す説明図である。FIG. 16C is an explanatory diagram of an inter-IP connection including an image processing cloud according to the embodiment;
(実施の形態）
　以下に添付図面を参照して、この発明にかかる通信制御オブジェクト、通信制御方法および通信制御プログラムの好適な実施の形態を詳細に説明する。 (Embodiment)
Preferred embodiments of a communication control object, a communication control method, and a communication control program according to the present invention will be described in detail below with reference to the accompanying drawings.
　図１は、実施の形態にかかる通信制御オブジェクトの説明図である。通信制御オブジェクト（Ｏｂｊｅｃｔ）１００は、機器内部あるいは外部の複数の機能（ＩＰ１５０）間の通信接続を制御し、互いに接続したＩＰ１５０間でのデータおよび命令の共有を可能にする。通信制御オブジェクト１００は、ＩＰ１５０の通信インタフェース（ＩＦ）の機能をオブジェクト化したものであり、実態はクラス構造からなる。通信制御オブジェクト１０は、機器のＩＰを使用するソフトウェア１０１から呼び出され、機器のＩＰ１５０間の通信接続を制御する。通信制御オブジェクト１００は、以下の１．～１０．の機能を有する。 FIG. 1 is an explanatory diagram of a communication control object according to the embodiment. A communication control object (Object) 100 controls communication connections between a plurality of functions (IPs 150) inside or outside the device, and enables sharing of data and instructions between IPs 150 connected to each other. The communication control object 100 is an object made from the functions of the communication interface (IF) of the IP 150, and actually consists of a class structure. The communication control object 10 is called from the software 101 that uses the IP of the equipment and controls the communication connection between the IPs 150 of the equipment. The communication control object 100 has the following 1. ~ 10. has the function of
１．通信制御オブジェクト１００は、１個以上の出力側端子１００ａと、０個以上の入力側端子１００ｂを持つ。出力側端子とはＩＰ１５０の出力側に接続する端子、入力側端子とはＩＰの入力側に接続する端子である。
２．通信制御オブジェクト１００の出力側端子１００ａには、ＩＰ１５０からの各種データのほか、命令や連続（ストリーム）データなどを与えることができる。
３．通信制御オブジェクト１００の出力側端子１００ａ側にあるＩＰ１５０は、同時に複数の通信制御オブジェクトを接続できる。
４．通信制御オブジェクト１００の入力側端子１００ｂは、一つのＩＰ１５０に接続できる。 1. The communication control object 100 has one or more output terminals 100a and zero or more input terminals 100b. An output-side terminal is a terminal connected to the output side of the IP 150, and an input-side terminal is a terminal connected to the input side of the IP.
2. The output terminal 100a of the communication control object 100 can receive various data from the IP 150, as well as commands and continuous (stream) data.
3. The IP 150 on the side of the output terminal 100a of the communication control object 100 can connect multiple communication control objects at the same time.
4. The input terminal 100b of the communication control object 100 can be connected to one IP150.
５．通信制御オブジェクト１００は、自身がＥｔｈｅｒｎｅｔ（登録商標）や、シリアル通信などのハードウェア（ＨＷ）と、制御するスイッチ（ＳＷ）により構成することができる。また、通信制御オブジェクト１００は、ＨＷと、設定用ＳＷ（データ転送はＨＷのみでＳＷは介在しない）構成とすることもできる。さらには、通信制御オブジェクト１００は、ＨＷだけで構成することもできる。 5. The communication control object 100 itself can be composed of hardware (HW) such as Ethernet (registered trademark) and serial communication, and switches (SW) to be controlled. Further, the communication control object 100 can also be configured with HW and setting SW (data transfer is performed only by HW and SW does not intervene). Furthermore, the communication control object 100 can also be composed only of HW.
６．通信制御オブジェクト１００は、ＨＷやＳＷなどの機構に依らず統一したインタフェース（設定、転送開始・終了など）を持つ。
７．類似した性質（ふるまい・機構）を持つ通信制御オブジェクト１００は、類似した通信制御オブジェクト１００を再利用（クラス継承）できる。これにより、装置の開発工数を削減することができる。
８．ＩＰ１５０が通信制御オブジェクト１００を利用する場合、ＩＰ１５０と通信制御オブジェクト１００の入力側端子１００ｂとが、利用前に接続が可能であるか否かを確認することができる。
９．ＩＰ１５０は、通信制御オブジェクト１００を動的に変更して接続先などを変更することができる。
１０．通信制御オブジェクト１００は、ＩＰ１５０間だけでなくＥｔｈｅｒｎｅｔや、シリアル通信、メモリ共有などにも適用できる。従って、ＩＰ１５０からＥｔｈｅｒｎｅｔで出力したり、ＩＰ１５０とクラウド連携したり、スマホなどの外部機器にも処理したデータ（画像等）を転送し、表示等が可能になる。 6. The communication control object 100 has a unified interface (setting, start/end of transfer, etc.) regardless of mechanisms such as HW and SW.
7. Communication control objects 100 having similar properties (behavior/mechanism) can reuse similar communication control objects 100 (class inheritance). As a result, the number of man-hours required for developing the device can be reduced.
8. When IP 150 uses communication control object 100, IP 150 and input terminal 100b of communication control object 100 can confirm whether connection is possible before use.
9. The IP 150 can dynamically change the communication control object 100 to change the connection destination and the like.
10. The communication control object 100 can be applied not only between IPs 150 but also for Ethernet, serial communication, memory sharing, and the like. Therefore, it is possible to output from the IP 150 via Ethernet, cooperate with the IP 150 in the cloud, transfer processed data (images, etc.) to an external device such as a smartphone, and display the data.
　図２～図８は、通信制御オブジェクトの機能例を示す図である。図２は、上記１．の機能を示すものであり、通信制御オブジェクト１００は、１個以上の出力側端子１００ａと、０個以上の入力側端子１００ｂを持つ。 2 to 8 are diagrams showing functional examples of communication control objects. FIG. 2 shows the above 1. The communication control object 100 has one or more output terminals 100a and zero or more input terminals 100b.
　図２の構成例では、通信制御オブジェクト１００Ａは出力側端子１００ａがＩＰ１（１５０Ａ）に接続され、入力側端子１００ｂがＩＰ２（１５０Ｂ）に接続される。また、他の通信制御オブジェクト１００Ｂを設け、通信制御オブジェクト１００Ｂの出力側端子１００ａをＩＰ１（１５０Ａ）に接続し、入力側端子１００ｂをＩＰ３（１５０Ｃ）に接続できる。 In the configuration example of FIG. 2, the communication control object 100A has the output side terminal 100a connected to IP1 (150A) and the input side terminal 100b connected to IP2 (150B). Also, another communication control object 100B can be provided, and the output side terminal 100a of the communication control object 100B can be connected to IP1 (150A), and the input side terminal 100b can be connected to IP3 (150C).
　これにより、一つのＩＰ１（１５０Ａ）を異なる二つのＩＰ２，３（１５０Ｂ，１５０Ｃ）にそれぞれ通信接続することができる。 As a result, one IP1 (150A) can be communicatively connected to two different IP2, 3 (150B, 150C).
　図３は、上記４．の機能を示すものであり、複数の通信制御オブジェクト１００の入力側端子１００ｂは、一つのＩＰ１５０に接続できる。図３の構成例では、通信制御オブジェクト１００Ａは出力側端子１００ａがＩＰ１（１５０Ａ）に接続され、入力側端子１００ｂがＩＰ３（１５０Ｃ）に接続される。また、他の通信制御オブジェクト１００Ｂの出力側端子１００ａはＩＰ２（１５０Ｂ）に接続し、入力側端子１００ｂをＩＰ３（１５０Ｃ）に接続できる。 Fig. 3 shows the above 4. The input side terminals 100b of a plurality of communication control objects 100 can be connected to one IP150. In the configuration example of FIG. 3, the communication control object 100A has the output side terminal 100a connected to IP1 (150A) and the input side terminal 100b connected to IP3 (150C). Also, the output side terminal 100a of another communication control object 100B can be connected to IP2 (150B), and the input side terminal 100b can be connected to IP3 (150C).
　これにより、異なる二つのＩＰ１，２（１５０Ａ，１５０Ｂ）を一つのＩＰ３（１５０Ｃ）に通信接続することができる。 As a result, two different IP1, 2 (150A, 150B) can be communicatively connected to one IP3 (150C).
　図４は、上記６．の機能を示すものであり、通信制御オブジェクト１００は、ＨＷやＳＷなどの機構に依らず統一したインタフェース（設定、転送開始・終了など）を持つ。例えば、図４（ａ）に示す通信制御オブジェクト１００Ａは、共通ＩＦ４０１、ＳＷ４０２、ＨＷ４０３を有し、共通ＩＦ４０１への通信設定がＳＷ４０２およびＨＷ４０３に設定される。同様に、通信制御オブジェクト１００Ａは，共通ＩＦ４０１への開始（転送開始）の制御指令をＳＷ４０２およびＨＷ４０３に転送する。そして、通信制御オブジェクト１００Ａは，共通ＩＦ４０１への転送（データ転送）の制御をＳＷ４０２およびＨＷ４０３で実行させる。 Fig. 4 shows the above 6. The communication control object 100 has a unified interface (setting, start/end of transfer, etc.) regardless of mechanisms such as HW and SW. For example, the communication control object 100A shown in FIG. 4A has common IF401, SW402, and HW403, and communication settings for common IF401 are set in SW402 and HW403. Similarly, the communication control object 100A transfers to the SW 402 and HW 403 a start (transfer start) control command to the common IF 401 . The communication control object 100A causes the SW 402 and HW 403 to control transfer (data transfer) to the common IF 401 .
　また、図４（ｂ）に示すように、通信制御オブジェクト１００Ｂは、共通ＩＦ４０１、ＨＷ４０３を有する構成であり、この場合、共通ＩＦ４０１への通信設定がＨＷ４０３に設定される。同様に、通信制御オブジェクト１００Ｂは，共通ＩＦ４０１への開始（転送開始）の制御指令をＨＷ４０３に転送する。そして、通信制御オブジェクト１００Ｂは、共通ＩＦ４０１への転送（データ転送）の制御をＨＷ４０３で自動実行させる。 Also, as shown in FIG. 4(b), the communication control object 100B is configured to have a common IF 401 and HW 403. In this case, communication settings for the common IF 401 are set in the HW 403. Similarly, the communication control object 100B transfers to the HW 403 a control command to start (transfer start) to the common IF 401 . The communication control object 100B causes the HW 403 to automatically control transfer (data transfer) to the common IF 401 .
　図５は、上記７．の機能を示すものであり、通信制御オブジェクト１００は、類似した性質（ふるまい・機構）を持つ通信制御オブジェクトは、類似した通信制御オブジェクトを再利用（継承）することにより開発工数を削減することができる。図５に示すように、通信制御オブジェクト１００Ｂの開発の際に必要な機能について、既に作成した通信制御オブジェクト１００Ａに類似した機能を有する場合、通信制御オブジェクト１００Ａとして作成済みの通信制御の機能（プログラム等）のうち類似する機能の一部あるいは全部を通信制御オブジェクト１００Ｂに再利用することができる。 Fig. 5 shows the above 7. The communication control object 100 can reduce development man-hours by reusing (inheriting) communication control objects with similar properties (behavior/mechanism). can. As shown in FIG. 5, regarding the functions necessary for the development of the communication control object 100B, if the communication control object 100B has functions similar to those of the already created communication control object 100A, the communication control functions (programs) already created as the communication control object 100A etc.) can be reused in the communication control object 100B.
　図６は、上記８．の機能を示すものであり、ＩＰ１５０が通信制御オブジェクト１００を利用する場合、ＩＰ１５０と通信制御オブジェクト１００の入力側端子１００ｂが、使用する前に接続できるかどうか確認する。 Fig. 6 shows the above 8. When the IP 150 uses the communication control object 100, it is confirmed whether the IP 150 and the input terminal 100b of the communication control object 100 can be connected before use.
　図６の構成例では、通信制御オブジェクト１００Ａは出力側端子１００ａがＩＰ１（１５０Ａ）に接続され、入力側端子１００ｂがＩＰ２（１５０Ｂ）に接続される。また、他の通信制御オブジェクト１００Ｂは、通信制御オブジェクト１００Ｂの出力側端子１００ａがＩＰ１（１５０Ａ）に接続され、入力側端子１００ｂがＩＰ２（１５０Ｂ）に接続されている。ＩＰ２（１５０Ｂ）が通信制御オブジェクトＡ，Ｂ（１５０Ａ，１５０Ｂ）を利用する場合、自ＩＰ２（１５０Ｂ）は、通信制御オブジェクトＡ，Ｂ（１５０Ａ，１５０Ｂ）の入力側端子１００ｂと通信接続できるかそれぞれ確認し、自ＩＰ２（１５０Ｂ）は、通信接続可能な通信制御オブジェクトＡ，Ｂを選択してデータ通信を行う。 In the configuration example of FIG. 6, the communication control object 100A has the output side terminal 100a connected to IP1 (150A) and the input side terminal 100b connected to IP2 (150B). In another communication control object 100B, the output side terminal 100a of the communication control object 100B is connected to IP1 (150A), and the input side terminal 100b is connected to IP2 (150B). When IP2 (150B) uses communication control objects A and B (150A and 150B), whether own IP2 (150B) can communicate with input terminals 100b of communication control objects A and B (150A and 150B) After confirmation, own IP2 (150B) selects communication control objects A and B to which communication connection is possible and performs data communication.
　図７は、上記９．の機能を示すものであり、ＩＰ１５０によっては、通信制御オブジェクト１００を動的に他に変更して接続先などを変更することができる。図７（ａ）に示すように、ＩＰ１，２（１５０Ａ，１５０Ｂ）間を通信制御オブジェクトＡ（１００Ａ）で接続していたとする。この後、図７（ｂ）に示すように、これらＩＰ１，２（１５０Ａ，１５０Ｂ）間の通信接続を通信制御オブジェクトＡ（１００Ａ）から他の通信制御オブジェクトＢ（１００Ｂ）に入れ替える変更を行い通信接続することができる。 Fig. 7 shows the above 9. Depending on the IP 150, the communication control object 100 can be dynamically changed to change the connection destination and the like. As shown in FIG. 7(a), it is assumed that IP1 and IP2 (150A, 150B) are connected by communication control object A (100A). After that, as shown in FIG. 7B, the communication connection between IP1 and IP2 (150A, 150B) is changed from communication control object A (100A) to another communication control object B (100B). can be connected.
　図８は、上記１０．の機能を示すものであり、通信制御オブジェクト１００は、ＩＰ１５０間だけでなくＥｔｈｅｒｎｅｔやシリアル通信、メモリ共有などにも適用できる。図８に示す例では、通信制御オブジェクトＡ（１００Ａ）によりＩＰ１，２（１５０Ａ，１５０Ｂ）を通信接続し、通信制御オブジェクトＢ（１００Ｂ）によりＩＰ２（１５０Ｂ）と外部機器８００（クラウド８０１，スマートフォン８０２等）を通信接続している。これにより、ＩＰ２（１５０Ｂ）から外部機器にＥｔｈｅｒｎｅｔで出力したり、ＩＰ２（１５０Ｂ）がクラウド８０１と連携したり、スマートフォン８０２などに処理した画像等のデータを表示することができる。 Fig. 8 shows the above 10. The communication control object 100 can be applied not only between IPs 150 but also for Ethernet, serial communication, memory sharing, and the like. In the example shown in FIG. 8, IP1 and IP2 (150A, 150B) are connected by communication control object A (100A), and IP2 (150B) and external device 800 (cloud 801, smartphone 802) are connected by communication control object B (100B). etc.) are connected. As a result, the IP2 (150B) can output to an external device via Ethernet, the IP2 (150B) can cooperate with the cloud 801, and the data such as processed images can be displayed on the smart phone 802 or the like.
　図９は、通信制御オブジェクトを含む通信システムの構成例を示すブロック図である。図９に示す構成例では、カメラ９００と、外部のクラウド９１０にそれぞれ複数の通信制御オブジェクト１００、複数のＩＰ１５０、ＩＰを使用するソフトウェア１０１Ａ，１０１Ｂを配置している。通信制御オブジェクト１００は、接続するＩＰ１５０間ごとに存在し、ＩＰ１５０を使用するソフトウェア１０１Ａ，１０１Ｂから呼び出す。 FIG. 9 is a block diagram showing a configuration example of a communication system including communication control objects. In the configuration example shown in FIG. 9, a plurality of communication control objects 100, a plurality of IPs 150, and IP-using software 101A and 101B are arranged in a camera 900 and an external cloud 910, respectively. The communication control object 100 exists between the IPs 150 to be connected, and is called from the software 101A, 101B using the IPs 150. FIG.
　複数のＩＰ１５０は、カメラ９００が撮像した画像を画像処理する各機能別の構成例であり、カメラ９００側には、通信制御オブジェクトを使い間接的にＩＰを使用するソフトウェア１０１Ａと、複数のＩＰ１５０と、ＩＰ１５０間を通信接続する複数の通信制御オブジェクト１００とを含み構成される。また、クラウド９１０側には、ＩＰを使用するソフトウェア１０１Ｂと、ＩＰ１５０と、ＩＰ間を通信接続する複数の通信制御オブジェクト１００とを含み構成される。 A plurality of IPs 150 is a configuration example of each function for image processing an image captured by the camera 900. On the camera 900 side, there are software 101A that indirectly uses IPs using a communication control object, and a plurality of IPs 150. , and a plurality of communication control objects 100 for communication connection between IPs 150 . The cloud 910 side includes software 101B that uses IP, IP 150, and a plurality of communication control objects 100 that connect and communicate between IPs.
　カメラ９００側の複数のＩＰ１５０は、画像メモリのＩＰ１５０Ａ、ホワイトバランス調整用のホワイトバランスＩＰ１５０Ｂ、明度彩度調整用の明度彩度ＩＰ１５０Ｃ、画像データ正立用の正立ＩＰ１５０Ｄ、画像認識結果を得る画像認識結果ＩＰ１５０Ｅを有する。クラウド９１０側のＩＰ１５０は、画像データに対し各種のＡＩ処理を行うクラウドＡＩ　ＩＰ１５０Ｆを有する。 The plurality of IPs 150 on the camera 900 side include an image memory IP 150A, a white balance IP 150B for white balance adjustment, a brightness and saturation IP 150C for brightness and saturation adjustment, an erection IP 150D for image data erection, and an image for obtaining an image recognition result. It has the recognition result IP150E. The IP 150 on the cloud 910 side has a cloud AI IP 150F that performs various AI processing on image data.
　カメラ９００側の複数の通信制御オブジェクト１００Ａ～１００Ｅ、およびクラウド９１０側の複数の通信制御オブジェクト１００Ｆ，１００Ｇは、任意のＩＰ１５０Ａ～１５０Ｆ間を通信接続する。 A plurality of communication control objects 100A to 100E on the camera 900 side and a plurality of communication control objects 100F and 100G on the cloud 910 side connect arbitrary IPs 150A to 150F for communication.
　図１０は、通信制御オブジェクトの通信接続例を示すブロック図である。図９に示した複数のＩＰ１５０Ａ～１５０Ｇの通信接続例を示す。図中、黒の矢印は処理呼び出し、白の矢印はデータの流れである。カメラ９００で撮影した画像データをカメラ９００内部の複数のＩＰ１５０で画像処理した後、クラウド９１０で画像認識等のＡＩ処理後の画像データをカメラ９００に戻す処理について説明する。図１０には、通信処理を行う通信ＩＰ１５０Ｇ～１５０Ｉを設けている。 FIG. 10 is a block diagram showing an example of communication connection of communication control objects. 9 shows an example of communication connection of the IPs 150A to 150G shown in FIG. In the figure, black arrows indicate process calls, and white arrows indicate data flow. A process of processing image data captured by the camera 900 by the plurality of IPs 150 inside the camera 900 and then returning the image data after AI processing such as image recognition in the cloud 910 to the camera 900 will be described. In FIG. 10, communication IPs 150G to 150I for performing communication processing are provided.
　カメラ９００側では、ＩＰを使用するソフトウェア１０１Ａは、通信制御オブジェクト１００に対し、複数のＩＰ１５０間を通信接続する処理を指示する。クラウド９１０側においても、ＩＰを使用するソフトウェア１０１Ｂは、通信制御オブジェクト１００に対し、複数のＩＰ１５０間を通信接続する処理を指示する。 On the camera 900 side, the IP-using software 101A instructs the communication control object 100 to perform communication connection processing between the plurality of IPs 150 . On the cloud 910 side as well, the IP-using software 101B instructs the communication control object 100 to perform communication connection processing between the plurality of IPs 150 .
　カメラ９００側の通信制御オブジェクト１００Ａは、画像メモリ１５０ＡとホワイトバランスＩＰ１５０Ｂ間を接続する。通信制御オブジェクト１００Ｂは、ホワイトバランスＩＰ１５０Ｂと明度彩度ＩＰ１５０Ｃ間を接続する。通信制御オブジェクト１００Ｃは、明度彩度ＩＰ１５０Ｃと正立ＩＰ１５０Ｄ間を接続する。通信制御オブジェクト１００Ｄは、正立ＩＰ１５０Ｄと通信ＩＰ１５０Ｇ間を接続する。通信制御オブジェクト１００Ｅは、通信ＩＰ１５０Ｇと画像認識結果ＩＰ１５０Ｅ間を接続する。 The communication control object 100A on the camera 900 side connects between the image memory 150A and the white balance IP 150B. Communication control object 100B connects between white balance IP 150B and brightness/saturation IP 150C. The communication control object 100C connects between the brightness/saturation IP 150C and the erection IP 150D. Communication control object 100D connects between erect IP 150D and communication IP 150G. The communication control object 100E connects between the communication IP 150G and the image recognition result IP 150E.
　また、クラウド９１０側の通信制御オブジェクト１００Ｆは、通信ＩＰ１５０Ｈと、クラウドＡＩ　ＩＰ１５０Ｆ間を接続する。通信制御オブジェクト１００Ｇは、クラウドＡＩ　ＩＰ１５０Ｆと、通信ＩＰ１５０Ｉ間を接続する。 Also, the communication control object 100F on the cloud 910 side connects the communication IP 150H and the cloud AI IP 150F. The communication control object 100G connects between the cloud AI IP 150F and the communication IP 150I.
　カメラ９００側の通信ＩＰ１５０Ｇは、クラウド９１０側の通信ＩＰ１５０Ｈ，１５０Ｉと、例えば、ＨＴＴＰ（Ｈｙｐｅｒ　Ｔｅｘｔ　Ｔｒａｎｓｆｅｒ　Ｐｒｏｔｏｃｏｌ）プロトコルによりインターネットを介してデータを送受信する。 The communication IP 150G on the camera 900 side transmits and receives data to and from the communication IPs 150H and 150I on the cloud 910 side via the Internet using, for example, the HTTP (Hyper Text Transfer Protocol) protocol.
　ここで、カメラ９００側の通信制御オブジェクト１００Ｅは、通信ＩＰ１５０Ｇをクラウド９１０側の通信ＩＰ１５０Ｈに接続することで、正立調整後の画像データをクラウドＡＩ　ＩＰ１５０Ｆに送出可能である。また、クラウド９１０側の通信制御オブジェクト１００Ｇは、通信ＩＰ１５０Ｉをカメラ９００側の通信ＩＰ１５０Ｇに接続することで、ＡＩ処理後の画像データを画像認識結果ＩＰ１５０Ｅに送出可能である。 Here, the communication control object 100E on the camera 900 side connects the communication IP 150G to the communication IP 150H on the cloud 910 side, so that the image data after the upright adjustment can be sent to the cloud AI IP 150F. Further, the communication control object 100G on the cloud 910 side can send the AI-processed image data to the image recognition result IP 150E by connecting the communication IP 150I to the communication IP 150G on the camera 900 side.
　図１０に示す画像データの流れは、カメラ９００側では、画像メモリ１５０Ａから読み出した画像データは、ホワイトバランスＩＰ１５０Ｂでホワイトバランス調整された後、明度彩度ＩＰ１５０Ｃで明度と彩度が調整される。正立ＩＰ１５０Ｄで正立調整された後の画像データは、通信ＩＰ１５０Ｇによりクラウド９１０側の通信ＩＰ１５０Ｈに送出される。 In the image data flow shown in FIG. 10, on the camera 900 side, the image data read out from the image memory 150A is adjusted in white balance by white balance IP150B, and then adjusted in brightness and saturation by brightness/saturation IP150C. The image data after the erection adjustment by the erection IP 150D is sent to the communication IP 150H on the cloud 910 side by the communication IP 150G.
　クラウド９１０側では、通信ＩＰ１５０Ｈがカメラ９００側から画像データを受信し、クラウドＡＩ　ＩＰ１５０Ｆで画像データに対し所定のＡＩ処理（例えば画像データの画像認識）を行う。ＡＩ処理後の画像データは、通信ＩＰ１５０Ｉを介してカメラ９００側の通信ＩＰ１５０Ｇに戻される。これにより、カメラ９００側の画像認識結果ＩＰ１５０Ｅでは、クラウド９１０側でＡＩ処理した画像認識結果を出力することができる。 On the cloud 910 side, the communication IP 150H receives image data from the camera 900 side, and the cloud AI IP 150F performs predetermined AI processing (for example, image recognition of image data) on the image data. The image data after AI processing is returned to the communication IP 150G on the camera 900 side via the communication IP 150I. As a result, the image recognition result IP 150E on the camera 900 side can output the image recognition result AI-processed on the cloud 910 side.
　図１１は、実施の形態にかかる装置のハードウェア構成例を示す図である。上記カメラ９００の機能を構成する通信制御オブジェクト１００、ＩＰ１５０、ＩＰを使用するソフトウェア１０１Ａは、図１１に示すハードウェアで機能実現できる。図１１において、カメラ９００は、制御部（ＣＰＵ）１１０１と、Ｒｅａｄ－Ｏｎｌｙ　Ｍｅｍｏｒｙ（ＲＯＭ）１１０２と、Ｒａｎｄｏｍ　Ａｃｃｅｓｓ　Ｍｅｍｏｒｙ（ＲＡＭ）１１０３と、半導体メモリやディスクドライブ等の補助記憶部１１０４と、通信インタフェース（Ｉ／Ｆ）１１０５と、入出力Ｉ／Ｆ１１１０と、を含む。これらＣＰＵ１１０１～入出力Ｉ／Ｆ１１１０は、バス１１０６によってそれぞれ接続されている。 FIG. 11 is a diagram illustrating a hardware configuration example of the device according to the embodiment. The communication control object 100, the IP 150, and the software 101A using the IP, which constitute the functions of the camera 900, can be realized by the hardware shown in FIG. 11, a camera 900 includes a control unit (CPU) 1101, a read-only memory (ROM) 1102, a random access memory (RAM) 1103, an auxiliary storage unit 1104 such as a semiconductor memory or disk drive, and a communication interface. (I/F) 1105 and an input/output I/F 1110 are included. These CPU 1101 to input/output I/F 1110 are connected by a bus 1106, respectively.
　カメラ９００は、単体の組込み機器に限らず、ＰＣやスマートフォン等の一部機能とすることもでき、装置構成に対応して、ディスプレイ、キーボード、マウス、スキャナ、プリンタを有してもよく、これらは入出力Ｉ／Ｆ１１１０を介して接続することができる。なお、スマートフォンやタブレット等では、ディスプレイ、キーボード、マウスの機能を集約したタッチパネルを用いることもできる。 The camera 900 is not limited to a single embedded device, but may be a part of a PC, a smartphone, or the like, and may have a display, keyboard, mouse, scanner, or printer according to the configuration of the device. can be connected via the input/output I/F 1110 . For smartphones, tablets, etc., it is also possible to use a touch panel that integrates the functions of a display, keyboard, and mouse.
　ＣＰＵ１１０１は、カメラ９００を統括制御し、実施の形態では、主にＩＰ１５０間を通信接続する演算処理装置である。ＲＯＭ１１０２は、カメラ９００のプログラム等を記憶する不揮発性メモリである。ＲＡＭ１１０３は、ＣＰＵ１１０１によるプログラムの演算処理実行時のワークエリアとして使用される揮発性メモリである。 The CPU 1101 is an arithmetic processing unit that controls the camera 900 and mainly connects the IPs 150 for communication in the embodiment. A ROM 1102 is a non-volatile memory that stores programs for the camera 900 and the like. A RAM 1103 is a volatile memory used as a work area when the CPU 1101 executes arithmetic processing of a program.
　通信Ｉ／Ｆ１１０５は、ネットワークＮＷと内部のインタフェースを司り、他の機器との間のデータの入出力を行う。具体的に、通信Ｉ／Ｆ１１０５は、ＬＡＮ（Ｌｏｃａｌ　Ａｒｅａ　Ｎｅｔｗｏｒｋ）、ＣＡＮ、ＥＣＨＯＮＥＴ（登録商標）等の各種ネットワークＮＷを介して外部の機器、例えばクラウド９１０との間の通信を行う。 The communication I/F 1105 serves as an internal interface with the network NW, and performs data input/output with other devices. Specifically, the communication I/F 1105 communicates with an external device such as the cloud 910 via various networks NW such as LAN (Local Area Network), CAN, and ECHONET (registered trademark).
　ネットワークＮＷは、上記のほかに、ＷｉＦｉ（登録商標）、Ｂｌｕｅｔｏｏｔｈ（登録商標）、赤外線通信（ＩｒＤＡ）等を含み、外部の機器と無線／有線通信することができる。 In addition to the above, the network NW includes WiFi (registered trademark), Bluetooth (registered trademark), infrared communication (IrDA), etc., and is capable of wireless/wired communication with external devices.
　図１０に示したクラウド９１０においても、実態のＰＣやサーバ群は、図１１に示したハードウェアで構成することができる。 In the cloud 910 shown in FIG. 10 as well, the actual PCs and server groups can be configured with the hardware shown in FIG.
　図１２は、通信制御オブジェクトの通信制御機能を示す図表である。通信制御オブジェクト１００の実態はクラス構造であり、ＩＰ１５０間の通信接続を制御するインタフェースは、図１２（ａ）のメソッドと、図１２（ｂ）のメンバ変数を有する。 　Fig. 12 is a chart showing the communication control functions of the communication control object. The substance of the communication control object 100 is a class structure, and the interface for controlling communication connections between IPs 150 has methods shown in FIG. 12(a) and member variables shown in FIG. 12(b).
　図１２（ａ）のメソッドは、名前（コマンド）別にＩＰ１５０を制御する。例えば、ｃｏｎｆｉｇはデバイス（ＩＰ１５０）のコンフィグ設定を行う。ｓｔａｒｔはデータ送受信を開始し、ｓｔｏｐはデータ送受信を停止する。図１２（ｂ）のメンバ変数は、名前（ｎａｍｅ）が通信制御オブジェクト１００の名前を示し、この通信制御オブジェクト１００がｂｉｎｄしているＳｅｐＯｂｊｅｃｔへの参照情報である（図５参照）。 The method in FIG. 12(a) controls the IP 150 by name (command). For example, config configures the device (IP150). start starts data transmission/reception, and stop stops data transmission/reception. In the member variables in FIG. 12(b), the name indicates the name of the communication control object 100, and is reference information to the SepObject to which this communication control object 100 is bound (see FIG. 5).
　図１３は、通信制御オブジェクトによるＩＰ間接続の初期処理を示すシーケンス図である。はじめにユーザが装置（例えば、カメラ９００）の電源をＯＮにすると（ステップＳ１３０１）、ＩＰ１５０は電源ＯＮをトリガとして初期化処理を実行し（ステップＳ１３０２）、デバイス初期化を実行する（ステップＳ１３０３）。この際、ＩＰ１５０の追加時等は、ＩＰ１５０がデバイス追加時処理を実行する（ステップＳ１３０４）。 FIG. 13 is a sequence diagram showing initial processing of IP-to-IP connection by a communication control object. First, when the user turns on the power of the device (for example, the camera 900) (step S1301), the IP 150 executes initialization processing triggered by the power on (step S1302), and executes device initialization (step S1303). At this time, when the IP 150 is added, the IP 150 executes a device addition process (step S1304).
　この後、装置はソフトウェア初期化を実施し（ステップＳ１３０５）、ＩＰを使用するソフトウェア１０１Ａの初期化（ステップＳ１３０６）、および通信制御オブジェクト１００に対するコンフィグ設定を行う（ステップＳ１３０７）。 After that, the device performs software initialization (step S1305), initializes the IP-using software 101A (step S1306), and configures the communication control object 100 (step S1307).
　通信制御オブジェクト１００に対する各種設定例としては、ＩＰ１５０のデバイス選択設定（ステップＳ１３０８）、ＩＰ１５０の初期設定（ステップＳ１３０９）、ＩＰ１５０の動作設定（ステップＳ１３１０）、ＩＰ１５０の設定取得（ステップＳ１３１１）、ＩＰ１５０内の設定復元（ステップＳ１３１２）等がある。 Examples of various settings for the communication control object 100 include IP 150 device selection settings (step S 1308 ), IP 150 initial settings (step S 1309 ), IP 150 operation settings (step S 1310 ), IP 150 settings acquisition (step S 1311 ), setting restoration (step S1312).
　図１４は、通信制御オブジェクトによるＩＰ間接続処理を示すシーケンス図である。はじめにユーザが装置（カメラ９００）のＩＰを使用するソフトウェア１０１ＡにＩＰ間接続を実行指示すると（ステップＳ１４０１）、ＩＰを使用するソフトウェア１０１Ａは、通信制御オブジェクト１００に対し、接続指示を行う（ステップＳ１４０２）。通信制御オブジェクト１００は、接続指示に対応して該当するＩＰ１５０との間の接続制御を行う（ステップＳ１４０４）。この際、通信制御オブジェクト１００は、ＩＰ１５０との接続性チェックを行い（ステップＳ１４０３）、その後接続制御してもよい。 FIG. 14 is a sequence diagram showing inter-IP connection processing by a communication control object. First, when the user instructs the IP-using software 101A of the device (camera 900) to execute IP-to-IP connection (step S1401), the IP-using software 101A issues a connection instruction to the communication control object 100 (step S1402). ). The communication control object 100 performs connection control with the corresponding IP 150 in response to the connection instruction (step S1404). At this time, the communication control object 100 may check the connectivity with the IP 150 (step S1403) and then control the connection.
　この後、ＩＰを使用するソフトウェア１０１Ａは、通信制御オブジェクト１００に送受信の準備を指示し（ステップＳ１４０５）、通信制御オブジェクト１００は、該当するＩＰ１５０との送受信の準備を行う（ステップＳ１４０６）。 After that, the IP-using software 101A instructs the communication control object 100 to prepare for transmission/reception (step S1405), and the communication control object 100 prepares for transmission/reception with the corresponding IP 150 (step S1406).
　この後、ＩＰを使用するソフトウェア１０１Ａは、通信制御オブジェクト１００に送受信を指示し（ステップＳ１４０７）、通信制御オブジェクト１００は、該当するＩＰ１５０との送受信を行う（ステップＳ１４０８）。この際、通信制御オブジェクト１００は、ＩＰ１５０の通信互換性のチェック（ステップＳ１４０８）を行うほか、ＩＰ１５０が接続する接続先のＩＰ１５０から設定情報を交換した後、データの送受信を開始（ステップＳ１４０９）してもよい。 After that, the IP-using software 101A instructs the communication control object 100 to transmit and receive (step S1407), and the communication control object 100 performs transmission and reception with the corresponding IP 150 (step S1408). At this time, the communication control object 100 checks the communication compatibility of the IP 150 (step S1408), exchanges setting information from the connection destination IP 150 to which the IP 150 is connected, and then starts data transmission/reception (step S1409). may
　図１５は、画像データに対する画像処理例を説明する図である。放送用のカメラ９００は、レンズ９２０から撮像素子で撮像した景色等の画像１５００は、画像メモリ１５０Ａにデジタル化した画像データ１５００ａとして格納される。この画像データ１５００ａは、ホワイトバランスなどの複数のＩＰ１５０を繋いで画像ファイルやファインダ表示などしている。 FIG. 15 is a diagram explaining an example of image processing for image data. An image 1500 such as a scene taken by an imaging device through a lens 920 of a broadcasting camera 900 is stored as digitized image data 1500a in an image memory 150A. This image data 1500a connects a plurality of IPs 150 such as white balance, and is displayed as an image file or through a finder.
　図１５の例では、画像データ１５００ａは、ホワイトバランス調整処理１５００ｂ、明度彩度調整処理１５００ｃ、正立調整処理１５００ｄを行った後、ファインダ表示処理１５０１、および画像ファイル処理１５０２がそれぞれ行われる。 In the example of FIG. 15, the image data 1500a is subjected to white balance adjustment processing 1500b, brightness/saturation adjustment processing 1500c, and erection adjustment processing 1500d, and then finder display processing 1501 and image file processing 1502, respectively.
　図１６Ａは、従来の画像処理のＩＰ間接続を示す説明図である。従来、図１５に示した画像データ１５００ａに対する画像処理に対応するＩＰ１５０を順番に固定的に接続していた。従来の機器（カメラ９００）内では、ホワイトバランス調整処理１５００ｂ～ファインダ表示処理１５０１、および画像ファイル処理１５０２に対応する各ＩＰ１５０Ａ～１５０Ｄは順番に固定的に接続されている。このため、ＩＰ１５０間の通信制御が類似していても、個々のＩＰ１５０間の通信制御をＩＰ１５０ごとに１つ１つ記述しなければならず煩雑となるとともに、画像処理の手順変更等の自由度がなかった。 FIG. 16A is an explanatory diagram showing IP-to-IP connections for conventional image processing. Conventionally, the IPs 150 corresponding to the image processing for the image data 1500a shown in FIG. 15 are fixedly connected in order. In the conventional device (camera 900), IPs 150A to 150D corresponding to white balance adjustment processing 1500b to finder display processing 1501 and image file processing 1502 are fixedly connected in order. Therefore, even if the communication control between the IPs 150 is similar, the communication control between the IPs 150 must be described one by one for each IP 150, which is complicated. there was no
　図１６Ｂは、実施の形態にかかる画像処理のＩＰ間接続を示す説明図である。実施の形態によれば、カメラ９００内部において複数のＩＰ１５０は、通信制御オブジェクト１００で選択して処理を繋いでいく。実施の形態によれば、図１５に示したホワイトバランス調整処理１５００ｂ～ファインダ表示処理１５０１、および画像ファイル処理１５０２に対応する各ＩＰ１５０Ａ～１５０Ｄについて、通信制御オブジェクト１００は、任意のＩＰ１５０同士を切り替え接続することができる。 FIG. 16B is an explanatory diagram showing inter-IP connections for image processing according to the embodiment. According to the embodiment, a plurality of IPs 150 are selected by the communication control object 100 inside the camera 900 to connect the processes. According to the embodiment, the communication control object 100 switches and connects arbitrary IPs 150 for each of the IPs 150A to 150D corresponding to the white balance adjustment processing 1500b to the finder display processing 1501 and the image file processing 1502 shown in FIG. can do.
　図１６Ｂの例では、画像メモリ１５０ＡとホワイトバランスＩＰ１５０Ｂとの間を通信制御オブジェクト１００Ａで接続する。通信制御オブジェクト１００Ａは、画像メモリ１５０Ａの画像データを、ホワイトバランスＩＰ１５０Ｂに限らず、他の画像処理の機能のＩＰ１５０Ｂａに切り替えて接続可能である。 In the example of FIG. 16B, the communication control object 100A connects the image memory 150A and the white balance IP 150B. The communication control object 100A can switch the image data in the image memory 150A not only to the white balance IP150B but also to IP150Ba of other image processing functions.
　また、ホワイトバランスＩＰ１５０Ｂと明度彩度ＩＰ１５０Ｃとの間を通信制御オブジェクト１００Ｂで接続する。通信制御オブジェクト１００Ｂは、ホワイトバランスＩＰ１５０Ｂおよび他の画像処理機能のＩＰ１５０Ｂａと、明度彩度ＩＰ１５０Ｃおよび他の画像処理の機能のＩＰ１５０Ｃａとの間を接続可能である。 Also, the communication control object 100B connects between the white balance IP 150B and the brightness/saturation IP 150C. The communication control object 100B can connect between the white balance IP150B and other image processing functions IP150Ba, and the brightness/saturation IP150C and other image processing functions IP150Ca.
　また、明度彩度ＩＰ１５０Ｃと正立ＩＰ１５０Ｄとの間を通信制御オブジェクト１００Ｃで接続する。通信制御オブジェクト１００Ｃは、明度彩度ＩＰ１５０Ｃおよび他の画像処理機能のＩＰ１５０Ｃａと、正立ＩＰ１５０Ｄおよび他の画像処理の機能のＩＰ１５０Ｄａとの間を接続可能である。 In addition, the communication control object 100C connects the lightness/saturation IP 150C and the erection IP 150D. The communication control object 100C can connect between the brightness/saturation IP150C and IP150Ca of other image processing functions, and the IP150Da of erect IP150D and other image processing functions.
　また、正立ＩＰ１５０Ｄは、通信制御オブジェクト１００Ｄでファインダ画像ＩＰ１６０１に接続され、通信制御オブジェクト１００Ｅで画像ファイルＩＰ１６０２に接続される。通信制御オブジェクト１００Ｄは、正立ＩＰ１５０Ｄあるいは他の画像処理機能のＩＰ１５０Ｄａとファインダ画像ＩＰ１６０１とを接続可能である。また、通信制御オブジェクト１００Ｅは、正立ＩＰ１５０Ｄあるいは他の画像処理機能のＩＰ１５０Ｄａと画像ファイルＩＰ１６０２とを接続可能である。 Also, the erect IP 150D is connected to the finder image IP 1601 through the communication control object 100D, and is connected to the image file IP 1602 through the communication control object 100E. The communication control object 100D can connect the erect IP150D or the IP150Da of other image processing functions with the finder image IP1601. Also, the communication control object 100E can connect the erect IP150D or the IP150Da of another image processing function with the image file IP1602.
　このように、実施の形態によれば、通信制御オブジェクト１００は、複数のＩＰ１５０同士を切り替え可能に接続する。これにより、複数のＩＰ１５０による画像処理の順番を任意に実行できる。また、他のＩＰの機能を追加して画像処理でき、画像処理の自由度を向上できるようになる。また、通信制御オブジェクト１００はあるＩＰ１５０間の通信制御を再利用して記述でき、簡単に接続でき、画像処理の手順変更等の自由度を向上できるようになる。 Thus, according to the embodiment, the communication control object 100 connects the plurality of IPs 150 in a switchable manner. Thereby, the order of image processing by a plurality of IPs 150 can be arbitrarily executed. In addition, image processing can be performed by adding functions of other IPs, and the flexibility of image processing can be improved. In addition, the communication control object 100 can be described by reusing communication control between certain IPs 150, can be easily connected, and can improve the degree of freedom such as changing the procedure of image processing.
　図１６Ｃは、実施の形態にかかる画像処理のクラウドを含めたＩＰ間接続を示す説明図である。カメラ９００内部におけるＩＰ１５０間は、図１６Ｂの説明同様に通信制御オブジェクト１００により任意に接続される。また、カメラ９００とクラウド９１０間においても通信制御オブジェクト１００により任意のＩＰ１５０と接続することができる。 FIG. 16C is an explanatory diagram showing an inter-IP connection including an image processing cloud according to the embodiment. The IPs 150 inside the camera 900 are arbitrarily connected by the communication control object 100 as in the description of FIG. 16B. Also, between the camera 900 and the cloud 910 , the communication control object 100 can be used to connect to any IP 150 .
　図１６Ｃの例では、カメラ９００内部のＩＰ１５０（１５０Ａ～１５０Ｄ）のうち、正立ＩＰ１５０Ｄを通信制御オブジェクト１００Ｄによりクラウド９１０のクラウドＡＩ　ＩＰ１５０Ｆに接続し、また、画像認識結果ＩＰ１５０Ｅを通信制御オブジェクト１００Ｅによりクラウド９１０のクラウドＡＩ　ＩＰ１５０Ｆに接続する。これにより、例えば、図１０Ｂに示した画像データの流れのように、カメラ９００側でのＩＰによる画像処理と、クラウド９１０側でのＩＰによる画像処理（ＡＩ処理）とを組み合わせた画像処理を行うことができるようになる。 In the example of FIG. 16C, of the IPs 150 (150A to 150D) inside the camera 900, the upright IP 150D is connected to the cloud AI IP 150F of the cloud 910 by the communication control object 100D, and the image recognition result IP 150E is connected by the communication control object 100E. Connect to cloud AI IP 150F of cloud 910. As a result, for example, like the flow of image data shown in FIG. 10B, image processing is performed by combining IP image processing on the camera 900 side and IP image processing (AI processing) on the cloud 910 side. be able to
　以上説明した実施の形態によれば、機器が有する複数の機能別のＩＰ１５０間に配置され、ＩＰ１５０のデータおよび命令を他のＩＰ１５０と切り替え可能に接続する通信インタフェースをクラス構造でオブジェクト化した通信制御オブジェクト１００を有する。これにより、任意のＩＰ１５０間を切り替え接続できるようになる。 According to the embodiment described above, communication control is performed by objectifying a communication interface arranged between a plurality of function-specific IPs 150 possessed by a device and connecting data and instructions of the IPs 150 switchably with other IPs 150 in a class structure. It has an object 100 . This enables switching connection between arbitrary IPs 150 .
　また、通信制御オブジェクトは、複数設けられ、一つのＩＰを異なる複数のＩＰにそれぞれ接続することができる。また、通信制御オブジェクトは、複数設けられ、複数のＩＰを一つのＩＰにそれぞれ接続することができる。これにより、動的にＩＰ間の接続を変化させ、必要な処理順にＩＰを入れ替えてデータ処理できるようになる。 Also, a plurality of communication control objects are provided, and one IP can be connected to a plurality of different IPs. Also, a plurality of communication control objects are provided, and a plurality of IPs can be connected to one IP. As a result, it is possible to dynamically change the connection between IPs and replace the IPs in the required order of processing for data processing.
　また、通信制御オブジェクトは、ＩＰ間の通信を行う通信部および接続切り替えを行う切替部の機能をハードウェアおよび／またはソフトウェアの組み合わせにより構成できる。ＩＰおよびＩＰを使用するソフトウェアを含め通信制御オブジェクトは、通信制御やスイッチ等の機能をソフトウェアとハードウェアを任意に組み合わせて簡単に構成できる。 Also, the communication control object can configure the functions of a communication unit that performs communication between IPs and a switching unit that performs connection switching by combining hardware and/or software. Communication control objects, including IP and software using IP, can be easily configured by arbitrarily combining functions such as communication control and switches with software and hardware.
　また、通信制御オブジェクトは、統一インタフェースにより、ＩＰとの接続にかかる設定およびデータ転送制御を行う。これにより、ハードウェアやスイッチ等の機構によらず、ＩＰ間を簡単に接続できるようになる。 In addition, the communication control object performs settings related to IP connection and data transfer control through a unified interface. This makes it possible to easily connect IPs without depending on mechanisms such as hardware and switches.
　また、通信制御オブジェクトは、開発時に所望する機能に類似する通信制御オブジェクトのクラス継承により再利用可能である。新たな通信制御オブジェクトの開発の際に必要な機能について、既に作成した通信制御オブジェクトに類似した機能の一部あるいは全部を新たな通信制御オブジェクトに再利用することで、開発工数を削減することができるようになる。 Also, the communication control object can be reused by inheriting the class of the communication control object similar to the desired function during development. Reusing some or all of the functions that are similar to already created communication control objects in the new communication control object can reduce development man-hours. become able to.
　また、通信制御オブジェクトあるいはＩＰは、互いの接続可否の機能を有する。これにより、ＩＰ間での接続可否を行い接続可能な場合にのみＩＰ間でデータを送受信できるようになる。 In addition, the communication control object or IP has a function of mutual connection propriety. As a result, it is possible to perform data transmission/reception between IPs only when connection between IPs is possible.
　また、通信制御オブジェクトは、ＩＰ間の接続状態を他の通信制御オブジェクトに入れ替え可能である。既にある通信制御オブジェクトで接続中のＩＰを他の通信制御オブジェクトに入れ替えることで、接続先のＩＰなどを簡単に変更することができる。 Also, the communication control object can replace the connection state between IPs with another communication control object. By replacing the IP being connected in an existing communication control object with another communication control object, the IP of the connection destination can be easily changed.
　また、通信制御オブジェクトは、外部の機器が有するＩＰと接続可能である。例えば、外部の機器は、クラウドを含む。これにより、単一の機器内でのＩＰ間接続の切り替えに加えて、機器をクラウド等に接続できるようになる。通信制御オブジェクトは、ＩＰ間だけの接続に限らず、Ｅｔｈｅｒｎｅｔやシリアル通信、メモリ共有などにも適用できる。これにより、例えば、機器のみで実行できないＡＩ処理等をクラウド側で処理し、処理結果を再び機器に戻すことなどもできるようになる。 Also, the communication control object can be connected to the IP of an external device. For example, external equipment includes the cloud. As a result, in addition to switching IP-to-IP connections within a single device, the device can be connected to a cloud or the like. The communication control object is applicable not only to connections between IPs, but also to Ethernet, serial communication, memory sharing, and the like. As a result, for example, AI processing that cannot be performed by the device alone can be processed on the cloud side, and the processing result can be returned to the device.
　これらのことから、実施の形態によれば、通信制御オブジェクトは、今までＩＰ間の接続が固定的であったものを、機器内およびインターネット経由で外部の機器に転送するなど、動的にＩＰ間の接続を変化させる要求に柔軟に対応できる。これにより、異なる機器間でデータ処理を分担して負荷分散させるほか、インターネットなどを介してクラウドなどの外部の機器でデータ処理を行う要求に対応できるようになる。また、開発についても、装置内に使用するＩＰの数の増加に伴い個々のＩＰ間の接続を開発する工数の増大に対応する。通信制御オブジェクトは、ＩＰ間の接続を簡単な記述で構成でき、ＩＰ間の接続を自由に切り替えることができるため、開発工数の増大を抑えることができる。 From these facts, according to the embodiment, the communication control object can dynamically change the connection between IPs, which has been fixed until now, to an external device within the device or via the Internet. It can flexibly respond to requests for changing connections between them. As a result, in addition to sharing data processing among different devices and distributing the load, it will be possible to respond to requests for data processing on external devices such as the cloud via the Internet. As for development, as the number of IPs used in the device increases, the number of man-hours for developing connections between individual IPs also increases. The communication control object can configure the connection between IPs with a simple description, and can switch the connection between IPs freely, thereby suppressing an increase in development man-hours.
　以上のように、本発明は、機能ごとのＩＰ接続状態および外部機器のＩＰとの接続状態を任意に接続する機器に用いることができ、特に、多数の機能を有する機器に有用である。 As described above, the present invention can be used for devices that arbitrarily connect the IP connection state for each function and the connection state with the IP of the external device, and is particularly useful for devices that have multiple functions.
　１００（１００Ａ～１００Ｇ）　通信制御オブジェクト
　１０１Ａ，１０１Ｂ　ＩＰを使用するソフトウェア
　１５０　通信制御オブジェクト
　１５０Ａ　画像メモリ
　１５０Ｂ　ホワイトバランスＩＰ
　１５０Ｃ　明度彩度ＩＰ
　１５０Ｄ　正立ＩＰ
　１５０Ｅ　画像認識結果ＩＰ
　１５０Ｆ　クラウドＡＩ　ＩＰ
　９００　カメラ
　９１０　クラウド
　１１０１　制御部（ＣＰＵ）
　１１０２　ＲＯＭ
　１１０３　ＲＡＭ
　１１０４　補助記憶部
　１１０５　通信インタフェース
　１１０６　バス
　ＮＷ　ネットワーク 100 (100A to 100G) Communication control object 101A, 101B Software using IP 150 Communication control object 150A Image memory 150B White balance IP
150C Brightness Saturation IP
150D upright IP
150E Image recognition result IP
150F Cloud AI IP
900 Camera 910 Cloud 1101 Control Unit (CPU)
1102 ROMs
1103 RAM
1104 auxiliary storage unit 1105 communication interface 1106 bus NW network

Claims (12)

  1. 　機器が有する複数の機能別のＩＰ（ｉｎｔｅｌｌｅｃｔｕａｌ　ｐｒｏｐｅｒｔｙ）間に配置され、前記ＩＰのデータおよび命令を他のＩＰと切り替え可能に接続する通信インタフェースをクラス構造でオブジェクト化した通信制御オブジェクト、
    　を有することを特徴とする機器。     A communication control object that is placed between a plurality of functional IPs (intellectual properties) possessed by a device and converts a communication interface that connects the data and instructions of the IP switchably to other IPs into objects in a class structure;
    A device characterized by having
  2. 　前記通信制御オブジェクトは、複数設けられ、一つの前記ＩＰを異なる複数の前記ＩＰにそれぞれ接続することを特徴とする請求項１に記載の機器。 The device according to claim 1, wherein a plurality of said communication control objects are provided, and each of said one IP is connected to a plurality of different said IPs.
  3. 　前記通信制御オブジェクトは、複数設けられ、複数の前記ＩＰを一つの前記ＩＰにそれぞれ接続することを特徴とする請求項１に記載の機器。 The device according to claim 1, wherein a plurality of said communication control objects are provided, and each of a plurality of said IPs is connected to one said IP.
  4. 　前記通信制御オブジェクトは、前記ＩＰ間の通信を行う通信部および接続切り替えを行う切替部の機能をハードウェアおよび／またはソフトウェアの組み合わせによりなることを特徴とする請求項１に記載の機器。 　The apparatus according to claim 1, wherein the communication control object comprises a combination of hardware and/or software for the functions of a communication unit that performs communication between the IPs and a switching unit that performs connection switching.
  5. 　前記通信制御オブジェクトは、統一インタフェースにより、前記ＩＰとの接続にかかる設定およびデータ転送制御を行うことを特徴とする請求項１に記載の機器。 　The equipment according to claim 1, wherein the communication control object performs settings and data transfer control related to connection with the IP using a unified interface.
  6. 　前記通信制御オブジェクトは、開発時に所望する機能に類似する通信制御オブジェクトのクラス継承により再利用可能なことを特徴とする請求項１に記載の機器。 　The equipment according to claim 1, characterized in that the communication control object can be reused by inheriting a class of a communication control object similar to a desired function during development.
  7. 　前記通信制御オブジェクトあるいは前記ＩＰは、互いの接続可否の機能を有することを特徴とする請求項１に記載の機器。 　The equipment according to claim 1, wherein the communication control object or the IP has a function of allowing/disabling mutual connection.
  8. 　前記通信制御オブジェクトは、前記ＩＰ間の接続状態を他の通信制御オブジェクトに入れ替え可能なことを特徴とする請求項１に記載の機器。 The device according to claim 1, wherein the communication control object can replace the connection state between the IPs with another communication control object.
  9. 　前記通信制御オブジェクトは、外部の機器が有する前記ＩＰと接続可能なことを特徴とする請求項１に記載の機器。 The device according to claim 1, characterized in that said communication control object can be connected to said IP possessed by an external device.
  10. 　前記外部の機器は、クラウドを含むことを特徴とする請求項９に記載の機器。 The device according to claim 9, wherein the external device includes a cloud.
  11. 　通信インタフェースをクラス構造でオブジェクト化した通信制御オブジェクトにより、機器が有する複数の機能別のＩＰ（ｉｎｔｅｌｌｅｃｔｕａｌ　ｐｒｏｐｅｒｔｙ）間で、前記ＩＰのデータおよび命令を他のＩＰと切り替え可能に接続する、
    　処理をコンピュータが実行することを特徴とする通信制御方法。     Between a plurality of function-specific IPs (intellectual properties) possessed by a device, data and instructions of the IPs are switchably connected to other IPs by means of a communication control object, which is an object of a communication interface in a class structure.
    A communication control method characterized in that a computer executes processing.
  12. 　通信インタフェースをクラス構造でオブジェクト化した通信制御オブジェクトにより、機器が有する複数の機能別のＩＰ（ｉｎｔｅｌｌｅｃｔｕａｌ　ｐｒｏｐｅｒｔｙ）間で、前記ＩＰのデータおよび命令を他のＩＰと切り替え可能に接続する、
    　処理をコンピュータに実行させることを特徴とする通信制御プログラム。     Between a plurality of function-specific IPs (intellectual properties) possessed by a device, data and instructions of the IPs are switchably connected to other IPs by means of a communication control object, which is an object of a communication interface in a class structure.
    A communication control program that causes a computer to execute processing.
PCT/JP2021/036171 2021-09-30 2021-09-30 Device including communication control object, communication control method, and communication control program WO2023053356A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/036171 WO2023053356A1 (en) 2021-09-30 2021-09-30 Device including communication control object, communication control method, and communication control program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/036171 WO2023053356A1 (en) 2021-09-30 2021-09-30 Device including communication control object, communication control method, and communication control program

Publications (1)

Publication Number Publication Date
WO2023053356A1 true WO2023053356A1 (en) 2023-04-06

Family

ID=85781788

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/036171 WO2023053356A1 (en) 2021-09-30 2021-09-30 Device including communication control object, communication control method, and communication control program

Country Status (1)

Country Link
WO (1) WO2023053356A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006172244A (en) * 2004-12-17 2006-06-29 Fuji Xerox Co Ltd Image processing device
JP2009037574A (en) * 2007-08-04 2009-02-19 Ricoh Co Ltd Semiconductor integrated circuit
JP2013020425A (en) * 2011-07-11 2013-01-31 Hitachi Solutions Ltd Hardware and software cooperative verification method using open source software
JP2013092883A (en) * 2011-10-25 2013-05-16 Kddi Corp Communication device
WO2017149591A1 (en) * 2016-02-29 2017-09-08 オリンパス株式会社 Image processing device
JP2021124896A (en) * 2020-02-04 2021-08-30 キヤノン株式会社 Information processing device and method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006172244A (en) * 2004-12-17 2006-06-29 Fuji Xerox Co Ltd Image processing device
JP2009037574A (en) * 2007-08-04 2009-02-19 Ricoh Co Ltd Semiconductor integrated circuit
JP2013020425A (en) * 2011-07-11 2013-01-31 Hitachi Solutions Ltd Hardware and software cooperative verification method using open source software
JP2013092883A (en) * 2011-10-25 2013-05-16 Kddi Corp Communication device
WO2017149591A1 (en) * 2016-02-29 2017-09-08 オリンパス株式会社 Image processing device
JP2021124896A (en) * 2020-02-04 2021-08-30 キヤノン株式会社 Information processing device and method

Similar Documents

Publication Publication Date Title
US10719200B2 (en) Architecture for remote control of IOT (internet of things) devices
US8040384B2 (en) Image transmission apparatus
US20220078351A1 (en) Data transmission systems and data transmission methods
CN105807617B (en) The control method and device of smart home device
CN104735279B (en) The control method of image forming apparatus, system and image forming apparatus and system
US9369752B2 (en) System and method for controlling a plurality of media devices
CN110879769A (en) Embedded system test environment construction method based on dynamically configurable framework
CN109587536A (en) A kind of long-distance remote-control method, equipment, server and system
WO2023053356A1 (en) Device including communication control object, communication control method, and communication control program
JP2007228177A (en) Photographing system and device
CN105472197B (en) Image processing system, method and apparatus
JP6881072B2 (en) Image processing equipment and programs
US10218816B2 (en) Information processing system, information processing method, server, and control method and control program of server
JP2022511543A (en) Load control methods, mobile platforms, and computer-readable storage media
CA2712528A1 (en) Camera installation device
US9395941B2 (en) Information processing apparatus, portable terminal, and control method therefor
US20200036763A1 (en) Information processing apparatus and control method
KR101874475B1 (en) Demonstration video providing system for display apparatus and demonstration video providing apparatus for display apparatus
JP6922336B2 (en) Information processing equipment, information processing methods, information processing programs and information processing systems
TWI465915B (en) Kvm switch system and signal process method thereof
CN106657219B (en) File based on smart machine uploads and method for down loading
CN109451444A (en) A kind of stabilizer communication system and its method
JP2014017642A (en) Image communication apparatus and image communication system using the same
US20210185218A1 (en) Managing multiple image devices
JP5070598B2 (en) IP telephone operation system, IP telephone operation method, IP telephone operation program, and recording medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21959394

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023550922

Country of ref document: JP