JP2020135572A - Information processing system - Google Patents

Abstract

To provide information as a method for handling an error in detail and a display method customized for each individual.SOLUTION: An information processing apparatus has an operation part 301, a display part 302, a storage part 303, a control part 304, and a visible light transmission part 305. An information processing terminal has an imaging part 351, a visible light reception part 352, an information processing part 353, and a processing display part 354. The information processing apparatus takes information, associated with operation information on a user's operation on the operation part 301 or control information on control by the control part 304, out of the storage part 303, and also converts it into visible light and transmits it as visible light information by a visible light transmission part 305. On the side of the information processing terminal 350, on the other hand, the visible light reception part 352 reads visible light out of an image photographed by the imaging part 351, the information processing part 353 performs analytic processing on related information, and the processing display part 354 displays the related information.SELECTED DRAWING: Figure 3

Description

In the present disclosure, a visible light signal is read from an information processing device that transmits a visible light signal (optical ID, etc.) corresponding to the visible light format through an image taken by a camera provided in the information processing terminal. Information processing terminal control method and information display that can display information related to the operation or control of the information processing device on the display on the information processing terminal according to the signal transmission position and the recognition position of the information processing device. Regarding the system.

Examples of white goods include microwave ovens, refrigerators, and washing machines. In these generally popular home appliances, the user performs setting operations and device control using operation panel buttons, touch panel keys, etc., and confirms information on the display screen on the operation panel. During such an operation, an error may occur or an information notification prompting maintenance work may be made in each home electric appliance.

Japanese Unexamined Patent Publication No. 2004-240915

However, in such generally popular home appliances, even if an error (fault) occurs, only the error number is often displayed because the display area of the home appliance is small. In addition, it is difficult to grasp what kind of error is occurring from the error number alone, so it is necessary to check and deal with it in the operation manual one by one. In addition, since the display area of home appliances is limited even for defects and maintenance work, it is necessary to press the button many times to handle the problem, which imposes a burden on the operator and the service person. It will be.

The present invention has been made in view of the above problems, and when an error occurs or maintenance work is performed, the present invention is held over a home electric appliance by using a camera in an information terminal owned by the operator himself / herself. By simply acquiring the visible light information transmitted from the home appliance itself and analyzing the visible light information, it is possible to easily acquire the details of error information and maintenance information occurring in the home appliance. Furthermore, it is an object of the present invention to provide an information processing system capable of notifying a customer who is an operator of useful information.

In order to solve the above-mentioned conventional problems, the information processing system of the present invention has the following configuration. That is, an operation unit that can be set and input by the user, a display unit that displays output contents according to the user's settings, a storage unit that stores information and control information set by the user, and the user described above. An information processing device including a control unit that controls a device according to information set by an operation unit, and a visible light transmission unit that converts control information controlled by the control unit into visible light information and transmits it as visible light. An imaging unit that detects visible light transmitted from the information processing device, a visible light receiving unit that receives visible light detected by the imaging unit as visible light information, and visible light received by the visible light receiving unit. It is characterized by including an information processing terminal that includes an information processing unit that processes information as information for analysis, and a processing display unit that outputs information based on the information processed by the information processing unit.

According to such a configuration, when the user operates the information processing device, even if some measures such as error handling and maintenance are required, the information required from the home appliance to the user's information terminal is required. It is possible to obtain an information processing system that can be provided as a method for dealing with more detailed errors and a display method customized for each individual simply by transmitting and receiving as visible light communication information.

FIG. 1 is a diagram showing the appearance of the information processing apparatus and the information processing terminal according to the first embodiment. FIG. 2 is a diagram showing an example of an operation panel of the information processing apparatus according to the first embodiment. FIG. 3 is a block diagram showing a functional configuration of the information processing apparatus and the information processing terminal according to the first embodiment. FIG. 4 is a diagram showing an example of a display after operation on the operation panel of the information processing apparatus according to the first embodiment. FIG. 5 is a diagram showing an example of a table relating to the processing content after the operation in the information processing apparatus of the first embodiment. FIG. 6 is a diagram showing an example of a table relating to the association between the processing content in the information processing apparatus of the first embodiment and the display content in the information processing terminal. FIG. 7 is a diagram showing an example of display in the information processing terminal of the first embodiment. FIG. 8 is a diagram showing the appearance of the information processing apparatus and the information processing terminal according to the second embodiment. FIG. 9 is a block diagram showing a functional configuration of the information processing apparatus and the information processing terminal according to the second embodiment. FIG. 10 is a diagram showing an example of an operation panel of the information processing apparatus according to the second embodiment. FIG. 11 is a diagram showing an example of display in the information processing terminal of the second embodiment. FIG. 12 is a diagram showing an example of display in the information processing terminal of the second embodiment. FIG. 13 is a diagram showing an example of display in the information processing terminal of the second embodiment.

The information processing system according to an example of the embodiment of the present disclosure includes an operation unit that can be set and input by the user, a display unit that displays output contents according to the user's settings, and information and control set by the user. A storage unit that stores information, a control unit that controls the device according to the information set by the user in the operation unit, and control information controlled by the control unit are converted into visible light information and transmitted as visible light. An information processing device including a visible light transmitting unit, an imaging unit that detects visible light transmitted from the information processing device, and a visible light receiving unit that receives visible light detected by the imaging unit as visible light information. An information processing terminal including an information processing unit that processes visible light information received by the visible light receiving unit as information for analysis, and a processing display unit that outputs information based on the information processed by the information processing unit. , It is characterized in that.

With such a configuration, when the user operates the information processing device, even if a predetermined response such as error handling or maintenance is required, based on the operation information or control information operated by the operator. By simply transmitting the necessary information as visible light information, it is possible to obtain an information processing system that can be provided as a more detailed coping method or a display method customized for each individual in the information processing terminal of the user. it can.

In the information processing system according to the example of the embodiment of the present disclosure, when the information processing apparatus performs control processing in the control unit and a control error occurs, the control error information is converted into visible light information. It may be configured to be characterized in that it is transmitted to an information processing terminal as visible light.

With such a configuration, even when it is necessary to deal with an error when the user operates the information processing device, the necessary information is provided as visible light information based on the operation information and control information operated by the operator. It is possible to obtain an information processing system capable of providing a more detailed error handling method in a display method customized for each individual in the information processing terminal of the user simply by transmitting as.

In the information processing system according to the example of the embodiment of the present disclosure, the information processing device has a square frame for identifying a relative position in the information processing device, and the image pickup unit of the information processing terminal is the information processing device. It may be configured to include a frame position recognition unit capable of recognizing the position of the square frame when the image is taken.

With such a configuration, when the user operates the information processing device, even if a predetermined response such as error handling or maintenance is required, based on the operation information and control information operated by the operator, A display method that displays more detailed information in or around the square frame in the information processing device that is imaged through the camera of the user's information processing terminal by simply transmitting the necessary information as visible light communication information. It is possible to obtain an information processing system that can be provided.

In the information processing system according to the example of the embodiment of the present disclosure, the information processing unit calculates relative position information from the position of the square frame recognized by the frame position recognition unit, and the image captured by the imaging unit. It may be configured to include an image synthesizing unit capable of synthesizing and displaying processing information at a relative position.

With such a configuration, when the user operates the information processing device, even if a predetermined response such as error handling or maintenance is required, based on the operation information and control information operated by the operator, A display method that displays more detailed information in or around the square frame in the information processing device that is imaged through the camera of the user's information processing terminal by simply transmitting the necessary information as visible light communication information. It is possible to obtain an information processing system that can be provided.

In the information processing terminal according to the example of the embodiment of the present disclosure, the information processing terminal has an information storage unit in which personal information and preference information of the user are stored, and the information storage unit is the personal information and the information storage unit. It may be configured to display the recommended content for an individual on the processing display unit based on the preference information and the information analyzed from the visible light information received by the visible light receiving unit.

With such a configuration, when the user operates the information processing device, even if a predetermined response such as error handling or maintenance is required, based on the operation information and control information operated by the operator, By simply transmitting the necessary information as visible light information, it is customized for more detailed coping methods and individuals within or around the square frame in the information processing device that is imaged through the camera of the user's information processing terminal. It is possible to obtain an information processing system that can be provided as a display method.

Further, in the information transmission system according to the example of the embodiment of the present disclosure, the information processing device may be configured to have a cooking function.

With such a configuration, even when a user needs to take predetermined measures such as error handling and maintenance when operating the cooking cooker, based on the operation information and control information operated by the operator, By simply transmitting the necessary information as visible light information, it is possible to obtain a cooking cooker that can be provided as a more detailed coping method or a display method customized for each individual in the information processing terminal of the user. ..

Hereinafter, examples of the embodiments of the present disclosure will be described with reference to the drawings. The present disclosure is not limited by the following embodiments.

(Embodiment 1)
FIG. 1 is a diagram showing the appearance of the information processing apparatus and the information processing terminal according to the first embodiment of the present disclosure.

As shown in FIG. 1, the information processing apparatus 100 includes an operation panel 200 for the user to operate and display, and the user operates the operation panel 200 in the information processing apparatus 100. The information processing terminal 101 can be used to display and confirm the contents and related contents from a remote location.

FIG. 2 is a diagram showing an operation panel 200 as an example of the information processing device 100 of the first embodiment of the present disclosure. The operation panel 200 is composed of an operation unit 201 for performing various menu settings and special operations, an operation display unit 202 using LEDs for displaying control information and operation information, and the like.

FIG. 3 is a block diagram showing a functional configuration of the information processing apparatus and the information processing terminal according to the first embodiment of the present disclosure.

As shown in FIG. 3, the information processing device 300 includes an operation unit 301, a display unit 302, a storage unit 303, a control unit 304, and a visible light transmission unit 305, and further includes an information processing terminal 350. Has an imaging unit 351, a visible light receiving unit 352, an information processing unit 353, and a processing display unit 354.

The information processing device 300 has a control function in specific home appliances such as a refrigerator, a cooking device having a cooking function including a microwave oven, a washing machine, and a vacuum cleaner, and is operated by a user from an operation panel of each device. Predetermined control is performed based on the contents. Although the information processing device 300 is described by taking a home appliance at home as an example, the information processing device 300 is not limited to this, and may be a device having an LED display unit or LED lighting and capable of visible light communication. For example, any device may be used.

The operation unit 301 has, for example, a touch panel, a plurality of keys, and the like, and can be input when the user performs various setting operations, operation start, and the like.

The display unit 302 has, for example, an LED or the like, and displays output contents such as operation information when the user performs a setting operation and control information when the user performs control.

The storage unit 303 is composed of a non-volatile memory such as a flash memory, and stores the setting operation information when the user performs the setting operation, the control information when the control is performed, or the upper side related thereto. .. In addition, error information and device status information associated with setting operation information and control information are also accumulated.

When the control unit 304 performs control such as heating control, freezing control, cleaning, etc. of the device based on the information set and operated by the operation unit 301, or performs control based on the information stored in the storage unit 303. Notify the status of.

The visible light transmission unit 305 converts the information controlled by the control unit 304 and the information related thereto into visible light information and transmits it as visible light. Regarding the method of transmitting visible light, the LED of the display unit 302 installed on the operation panel 200 may be used, or the LED of the interior lighting installed in the refrigerator may be used. .. Next, the information processing terminal 350 that receives and displays the visible light will be described.

The information processing terminal 350 is a terminal that can be carried by a user, such as a smartphone or tablet, with a camera attached. Anything may be used as long as it has a camera function and a display function for receiving visible light, and may be a notebook type PC.

The imaging unit 351 is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) image sensor, a CCD (Charge Coupled Device) image sensor, or the like, and the visible light transmitted by the visible light transmitting unit 305 of the information processing apparatus 300 is information. It is detected by the imaging unit 351 of the processing terminal 350 and can be captured as an captured image.

The visible light receiving unit 352 receives visible light from the image captured by the imaging unit 351 and analyzes it as visible light information. Visible light information is recognized as information in which a format such as an optical ID is determined.

The information processing unit 353 processes information related to operations and controls in the information processing device 300 based on the visible light information analyzed by the visible light receiving unit 352. More specifically, the information processing unit processes and analyzes the control error information generated in the information processing apparatus 300 and the processing method thereof.

The processing display unit 354 displays the processing content to the operator on the information processing terminal 350 based on the information processed by the information processing unit 353.

In the example shown in FIG. 4, when a control error occurs as a result of performing heating control, operation setting, or the like in the information processing apparatus 300, an error number is displayed on the display unit 402 of the operation panel 400. On the display unit 402, the error number of "U33" when the dirt in the refrigerator is detected is displayed.

FIG. 5 is a diagram showing an example of a table relating to processing contents after operation in the information processing apparatus according to the first embodiment of the present disclosure.

When the error code is "U01", it means "initialization error", and it is necessary to prompt processing such as resetting the power supply of the information processing apparatus. Further, when the error code is "U33", it means "dirt detection error in the refrigerator", and it is necessary to wipe off the dirt in the refrigerator of the information processing apparatus. Further, when the error code is "U50", it means "high temperature error in the refrigerator", and it is necessary to confirm whether or not the inside of the information processing apparatus is emptied.

Next, in the information processing terminal 350, a display method when an error occurs in the information processing device 300 will be described.

FIG. 6 is an example of a table relating to an error code and its association with the error content when an error occurs when the user performs an operation or control in the information processing apparatus according to the first embodiment of the present disclosure.

In FIG. 6, there is product number information as an ID for identifying the device of the information processing apparatus, and the product number of "NE-1000" is described as an example. In this table, when an error occurs in the product of "NE-1000", the error code and the information on the countermeasures are associated with each other.

For example, for the error code "U01" of "NE-1000", information on the error processing content is described on the Internet (Web), and for the error processing content in Japanese, "http: // www". The detailed contents are described in ".xxx.com/NE1000/Error/U01_jp.html", and the error handling contents in English are described in "http://www.xxx.com/NE1000/Error/U01_eng.http". The details are described in.

Similarly, regarding the error code "U33" of "NE-1000", the details of the error processing contents in Japanese can be found in "http://www.xxx.com/NE1000/Error/U33_jp.html". The details of the error processing contents in English are described in "http://www.xxx.com/NE1000/Error/U33_eng.html".

The same applies to the error code "U50" of "NE-1000" and other error codes, so they are omitted here.

In addition, although Japanese and English are shown as examples, the same applies to examples of other languages such as Chinese and French as long as there is a corresponding language. In addition to the language, the error processing content may change depending on the user's private information / state such as age and gender, and even if the error processing content changes depending on the state of the information processing device and environmental information. Good.

FIG. 7 is a diagram showing an example of display on the information processing terminal 350 according to the first embodiment of the present disclosure. Specifically, FIG. 7 is based on the table information shown in FIGS. 5 and 6 when an error of “U33” occurs in the product of the product number “NE-1000” which is the information processing apparatus 300. It is a figure which shows the example which receives the visible light information transmitted from the information processing apparatus 300, and displays the error detail content of "U33" on the processing display unit 354 of an information processing terminal 350.

FIG. 7A is an example in which the detailed contents of the processing method for the error of “U33” are specifically displayed on the processing display unit 701 of the information processing terminal 700. As the detailed contents of the processing for the "U33" error, the error information (URL site) of the "Japanese" of the "U33" in the table of FIG. 6 is displayed. More specifically, it not only explains the processing method in Japanese, "The bottom of the refrigerator is dirty. Please remove the dirt in the refrigerator with a cloth, etc.", but also includes a diagram of the information processing device. It is easy to understand and explained.

By using the information processing terminal 700, the user can easily solve the content that the user did not know what error and how to deal with the error of "U33" displayed on the display unit 402 of the operation panel 400. You can enjoy the contents and coping methods in an easy-to-understand manner. Here, an example of how to deal with error handling is shown, but in particular, the displayed content may be any content or any format, information related to the food stored in the refrigerator, recommended information, or an image. Not only voice guidance, video guidance, and guidance to sites on the Internet may be used.

Further, also in FIG. 7B, as in FIG. 7A, the processing display unit 751 of the information processing terminal 750 specifically displays the detailed contents of the processing method for the error of “U33”. Is. As the detailed contents of the processing for the "U33" error, the error information (URL site) of the "English" of the "U33" in the table of FIG. 6 is displayed. More specifically, not only the processing method is explained in English as "The bottom of cabinet is Dirty. Please removed dirt in the cabinet with a close etc." Has been made. The difference from the case of FIG. 7 (A) is that the description content of the error processing is not Japanese but English, and it is displayed appropriately even according to the user's private information and status. be able to.

(Embodiment 2)
FIG. 8 is a diagram showing the appearance of the information processing apparatus and the information processing terminal according to the second embodiment of the present disclosure.

As shown in FIG. 8, the information processing device 800 has an operation panel 200 for the user to operate and display, and a square frame 802 or a square frame 803 for identifying the relative positions of the information processing device 800. The information processing device 800 is provided, and the user has a real-time image taken by the camera (imaging unit 951) of the information processing terminal 801 regarding the contents operated by the operation panel 200 in the information processing device 800 and the contents related thereto. It is possible to easily display and confirm the contents related to more detailed processing method, operation information, control information, etc. from the captured image of.

In the second embodiment of the present disclosure, the description of the same structure, functional configuration or control method as that of the first embodiment will be omitted.

FIG. 9 is a block diagram showing a functional configuration of the information processing apparatus and the information processing terminal according to the second embodiment of the present disclosure.

The information processing terminal 950 of the second embodiment of the present disclosure differs from the information processing terminal 350 of the first embodiment in that the frame position recognition unit 952 recognizes the position of the square frame from the image captured by the image pickup unit 951. Personal information such as language information used by the user, preference information, terminal setting information, or other environmental information stored in the information storage unit 955 when processing is performed by the information processing unit 954. Information processing is performed based on the above, and after processing is performed by the information processing unit 954, necessary information is added to the frame position recognized by the frame position recognition unit 952 or a relative position from the frame position to create an image. The point is that the compositing unit 956 synthesizes the necessary information with the captured image, and the processing display unit 957 performs display processing. Therefore, in the present embodiment, this point will be mainly described.

As shown in FIG. 9, the information processing device 900 includes an operation unit 901, a display unit 902, a storage unit 903, a control unit 904, and a visible light transmission unit 905, and further includes an information processing terminal 950. Has an image pickup unit 951, a frame position recognition unit 952, a visible light reception unit 953, an information processing unit 954, an information storage unit 955, an image synthesis unit 956, and a processing display unit 957.

The frame position recognition unit 952 recognizes the square frame of the information processing device 900 (in the example of FIG. 8, the square frame 802 or the square frame 803) from the image taken by the image pickup unit 951. Regarding the square frame, it may be a white paper or plastic square frame so that it can be easily recognized in the image, or it may be a square frame of a color / material that matches the design of the information processing device, and it can be distinguished in the image. Anything is fine as long as it is. Further, the position, size, and shape of the square frame are not particularly limited, and may be a square or a rhombus, a broken frame enclosure, or another mark shape, which is specific in the information processing apparatus. Any shape and material that can recognize the area will do.

Further, the visible light information received by the visible light receiving unit 953 is processed as necessary processing information by the information processing unit 954, and then inside the square frame 802 or 803 recognized by the frame position recognition unit 952, or. The processing information required for the position relative to the position of the square frame 802 or 803 is added to the captured image, the required processing information is combined with the captured image by the image synthesis unit 956, and the display processing is performed by the processing display unit 957. Do. Next, an example of processing for synthesizing images will be described with reference to figures.

The example shown in FIG. 10 is an example for a case where the information processing apparatus 800 needs to be displayed in English because the operator cannot understand it in Japanese when performing heating control, operation setting, and the like. In this example, the operation unit 1001 and the display unit 1002 of the operation panel 1000 are displayed in numbers or English notation instead of numbers or Japanese notation.

FIG. 11 is a diagram showing an example of display in the information processing terminal according to the second embodiment of the present disclosure. In FIG. 11, when the operator is a foreigner who can understand only English notation, it is difficult to understand the operation method of the information processing apparatus 800 without explanation. In the present embodiment, the information processing terminal 801 owned by each individual simply holds the information processing terminal 801 owned by each individual over the information processing device 800, and the information on the display panel surrounded by the square frame 802 is processed by the information processing device. By transmitting as visible light information from 800, it is possible to change only the operation panel portion to the operation panel 1000 written in English in the information processing terminal 801.

The processing contents will be described more specifically. The storage unit 903 in the information processing device 900 stores information on the character information of the operation panel of the information processing device 900 or the operation panel image corresponding to each language. The control unit 904 processes the operation panel information, and the visible light transmission unit 905 transmits the visible light information as visible light information. Information transmitted as visible light from the information processing device 900 is received by the visible light receiving unit 953 of the information processing terminal 950 of the operator. Further, the image pickup unit 951 of the information processing terminal 950 receives visible light, and the frame position recognition unit 952 recognizes the frame of the square frame 802 from the captured image.

The visible light is analyzed by the visible light receiving unit 953 and processed by the information processing unit 954 as visible light information. At that time, the display language information stored in the information storage unit 955 in the information processing terminal 950 is used. The processing is performed so that the operation panel information that has been analyzed and extracted as visible light information is processed as English notation. The operation panel information written in English is processed by the image composition unit 956 and displayed by the processing display unit 957 so as to be displayed at the position recognized by the frame position recognition unit 952.

In this way, as the number of operators has diversified, it has become difficult to deal with individual character notation alone, but there is a need for a display method that is customized for each operator and individual without incurring the cost of the information processing device itself. Has been done. This time, I explained the case where the operator can read only English notation, but it is not limited to this, any language notation can be used, and not only the notation of a specific language but also figures, symbols, and plurals. It may be expressed by the characters of.

FIG. 12 is a diagram showing an example of display in the information processing terminal according to the second embodiment of the present disclosure. In the first embodiment of the present disclosure, when the information processing apparatus 900 displays a "U33" error (dirt detection in the refrigerator), the user moves to the site where the error information is described regarding the error handling method. An example showing the processing method for each procedure is shown. In this case, the location where the error occurs is difficult to understand depending on the corresponding case, and the operation must be performed while alternately looking at both the information processing device 900 and the information processing terminal 950, which imposes a burden on the operator.

In the present embodiment, the information processing terminal 801 owned by each individual simply holds the information processing terminal 801 owned by each individual over the information processing device 800, and the information on the display panel surrounded by the square frame 803 is processed by the information processing device. By transmitting as visible light information from the 800, the information processing terminal 801 can directly guide and display the operation to the part where the operation is required in the information processing device 800 being imaged for the part where the error occurs. It becomes possible to do.

The processing contents will be described more specifically. The information processing device side is the same as the examples of FIGS. 7 (A), 7 (B), and 11 and therefore will be omitted. The information transmitted from the information processing device 900 as visible light is received by the information processing terminal 950 of the operator. Visible light is received by the image pickup unit 951 of the information processing terminal 950, and the frame position recognition unit 952 recognizes the frame of the square frame 803 from the captured image. Visible light is analyzed by the visible light receiving unit 953 and processed by the information processing unit 954 as visible light information. At that time, the information processing terminal 950 analyzes the processing information of the "U33" error and visible light. Processing related to the display method of the processing procedure of the "U33" error extracted as information is performed.

The error processing procedure information of "U33" is processed by the image composition unit 956 and displayed by the processing display unit 957 so as to be displayed in the frame position or relative position of the position recognized by the frame position recognition unit 952. Processing will be performed. In this case, the notations "1. Please open the door" and "2. Please remove the dirt in the refrigerator" will be combined and displayed on the screen as the processing procedure outside the frame position. ..

FIG. 13 is a diagram showing an example of display in the information processing terminal according to the second embodiment of the present disclosure. In this example, an example is shown in which information related to information that is or has been controlled by the information processing apparatus 900 is displayed on a real eye.

In the present embodiment, the information processing terminal 801 owned by each individual is simply held over the information processing device 800, and the information on the display panel surrounded by the square frame 803 is converted into visible light information from the information processing device 800. Send to. In the information processing terminal 801, for example, when the heating of lunch boxes and noodles is controlled in a refrigerator such as a microwave oven, these information are stored in the information storage unit 955 as preference information, and foods such as lunch boxes and noodles are stored. It is possible to display the recommended products accompanying the above in the square frame 803 in the information processing apparatus 800 that has been imaged. The details of the processing are the same as those in FIGS. 7 (A), 7 (B), 11 and 12, and will be omitted, but the portion surrounded by the square frame 803 in the information processing terminal 950. In addition, as related information accumulated in the information storage unit 955, information on "rice balls" (various types of rice balls from 100 yen to 3/31), which is a recommended product, and information valuable to the operator are provided. Can be provided.

As described above, the present disclosure is made when the user needs some special processing when operating the target device or performing specific control, or when he / she wants to know the state of the device at that time. Information processing devices and information that can easily and easily display and present the status and processing method of the device on the information terminal by simply holding the information terminal over the target device. A control method by a processing terminal and an information display system are provided. Therefore, the information processing device in the present disclosure includes not only white goods such as refrigerators, washing machines and microwave ovens, but also black goods such as DVD recorders, videos and printers that do not have a large display device. , It is also widely applicable to commercial equipment.

100,300,800,900 Information processing device 101,350,700,750,801,950 Information processing terminal 200,400,1000 Operation panel 201,301,401,901,1001 Operation unit 202,302,402,902 1002 Display unit 303,903 Storage unit 304,904 Control unit 305,905 Visible light transmission unit 351,951 Imaging unit 352,953 Visible light receiver 353,954 Information processing unit 354,701,751,957 Processing display unit 802 803 Square frame 952 Frame position recognition unit 955 Information storage unit 956 Image composition unit

Claims (6)

An operation unit that can be set and input by the user,
A display unit that displays the output contents according to the user's settings,
A storage unit that stores information and control information set by the user,
A control unit that controls the device according to the information set by the user in the operation unit,
A visible light transmission unit that converts control information controlled by the control unit into visible light information and transmits it as visible light.
Information processing device equipped with
An imaging unit that detects visible light transmitted from the information processing device,
A visible light receiving unit that receives visible light detected by the imaging unit as visible light information, and a visible light receiving unit.
An information processing unit that processes visible light information received by the visible light receiving unit as information for analysis, and
A processing display unit that outputs information based on the information processed by the information processing unit, and
Information processing terminal equipped with
An information processing system characterized by being equipped with. The information processing device is characterized in that, when a control error occurs as a result of performing control processing in the control unit, the control error information is converted into visible light information and transmitted as visible light to an information processing terminal. The information processing system according to claim 1. The information processing device has a square frame for identifying a relative position in the information processing device, and when the imaging unit of the information processing terminal takes a picture of the information processing device, the position of the square frame is recognized. The information processing system according to claim 1 or 2, further comprising a frame position recognizing unit capable of capable. The information processing unit can calculate relative position information from the position of the square frame recognized by the frame position recognition unit, and can synthesize and display the processing information at the relative position of the image captured by the imaging unit. The information processing system according to claim 3, further comprising an image compositing unit. The information processing terminal has an information storage unit in which personal information and preference information of the user are stored, and the information storage unit includes the personal information and preference information and visible light information received by the visible light receiving unit. The information processing system according to claim 4, wherein the recommended content for an individual is displayed on the processing display unit based on the information analyzed from the above. The information processing system according to any one of claims 1 to 5, wherein the information processing device has a cooking function.