KR20220083985A - multi-processor - Google Patents

Abstract

The present invention relates to a processor (control unit, control unit) of a device.
The present invention also relates to a method and a control system for operating a multi-processor.

Description

multi-processor {multi-processor}

The present invention relates to a processor (control unit, control unit) of a device.

The present invention also relates to a method and a control system for operating a multi-processor.

In general, in order to speed up program processing in a system using a microprocessor, programs for each function have been separately processed by a multiprocessor (two or more CPUs) composed of a plurality of microprocessors (hereinafter referred to as "CPU").

In the system using the multiplexed multi-processor, when the currently operating master processor (system) is down or when the currently operating task is transferred to the local processor, an interrupt is applied to the waiting local processor to process when the local processor is recognized as active , and the original master processor enters the standby state.

1, the output port of the master processor (M CPU) when it is necessary to use the local processor (S CPU) in the master processor (M CPU) while executing any operation P12) is transferred to the local processor (S CPU), and the local processor (S CPU) performs a necessary operation. The completion of operation is notified from the output port P22 of the local processor (S CPU) to the input port (P11) of the master processor (M CPU).

With the same principle as above, if the master processor (M CPU) is called for any reason from the local processor (S CPU), an interrupt (INT) is sent to the master processor (M CPU) from the output port (P21) of the local processor (S CPU). ) to hang In this case, it goes to the controlling master processor (M CPU), and after performing the necessary operation, the output port (P13) of the master processor (M CPU) goes to the input port (P23) of the local processor (S CPU) It indicates that the operation has been completed.

In both cases described above, after receiving a signal that the interrupt service is over from the output port of the other processor, the signal is sent back to the output port to cancel the interrupt state.

When the interrupt is performed in the conventional manner, the software continues during the above operation because the interrupt signal must be released by sending a signal to the output port again after receiving a signal indicating that the other processor has completed the interrupt execution. have to wait Due to this, there was a problem in that the processing time was long in the overall processing because there was a lot of time wasted.

Domestic Registered Utility Model No. 20-0060266 (January 4, 1991) Domestic Registered Patent No. 10-0145925 (1998.005.06) Domestic Registered Patent No. 10-0390403 (June 25, 2003) Domestic Registered Patent No. 10-0097307 (1996.03.22) Domestic Patent Publication No. 10-2000-0020328 (April 15, 2000) Domestic Patent Publication No. 10-2000-0044392 (July 15, 2000) Domestic Patent Publication No. 10-1988-0008188 (08.08.30) Domestic Patent Publication No. 10-2003-0089734 (2003.11.28) Domestic Patent Publication No. 10-1999-0047715 (July 5, 1999)

An embodiment of the present invention provides an operating method and control system of a multi-processor.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the description below. will be able

The present invention proposes a method for operating a multi-processor and a control system.

An embodiment of the present invention, a control device including a multi-processor (multi-processor) including a plurality of processors and a processor manager for controlling the plurality of processors; including, wherein the processor management unit: collects state information on the plurality of processors, generates reset information or sets a multi-processor mode based on the state information on the plurality of processors, and sets the reset information or the multi-processor mode The plurality of processors may be controlled according to a processor mode.

The processor manager may: collect state information on the plurality of processors at every predetermined period, and the predetermined period may be reset based on the state information on the plurality of processors.

The processor management unit: generates the reset information based on the state information on the plurality of processors, sets the multi-processor mode based on the state information on the plurality of processors, the reset information and the multi-processor mode Accordingly, on/off of each of the plurality of processors may be controlled.

The processor manager further collects second state information for the plurality of processors after controlling ON/OFF of each of the plurality of processors according to the reset information and the multi-processor mode, Generates second reset information for the plurality of processors based on second state information about the processors, sets a second multi-processor mode based on the second state information on the plurality of processors, and the second reset On/off of each of the plurality of processors may be further controlled according to information and the second multi-processor mode.

The system includes: a user terminal; or management server; and at least one of the following, wherein the control device may share state information on the plurality of processors to at least one of the user terminal and the management server.

An embodiment of the present invention may provide an improved (enhanced) multi-processor operating method and control system.

An embodiment of the present invention may enable generation of configuration information and/or mode determination adaptively in consideration of the state of each of a plurality of processors.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those of ordinary skill in the art to which the present invention belongs from the following description. will be.

Other aspects, features and benefits as set forth above of certain preferred embodiments of the invention will become more apparent from the following description taken in conjunction with the accompanying drawings.
1 is a diagram illustrating a conventional multi-processor.
2 is a diagram illustrating a multi-processor control system according to an embodiment of the present invention.
3 is a block diagram illustrating a control device according to an embodiment of the present invention.
4 is a flowchart illustrating a method of controlling a multi-processor according to an embodiment of the present invention.
5 is a flowchart illustrating a method of controlling a multi-processor according to an embodiment of the present invention.
6 to 8 are block diagrams illustrating an electronic device according to an embodiment of the present invention.
9 is a flowchart illustrating a method for controlling a multi-processor according to an embodiment of the present invention.
10 is a flowchart illustrating a method of controlling a multi-processor according to an embodiment of the present invention.
It should be noted that throughout the drawings, like reference numerals are used to denote the same or similar elements, features, and structures.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

In describing the embodiments, descriptions of technical contents that are well known in the technical field to which the present invention pertains and are not directly related to the present invention will be omitted. This is to more clearly convey the gist of the present invention without obscuring the gist of the present invention by omitting unnecessary description.

For the same reason, some components are exaggerated, omitted, or schematically illustrated in the accompanying drawings. In addition, the size of each component does not fully reflect the actual size. In each figure, the same or corresponding elements are assigned the same reference numerals.

Advantages and features of the present invention, and a method for achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only these embodiments allow the disclosure of the present invention to be complete, and common knowledge in the technical field to which the present invention belongs It is provided to fully inform the possessor of the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout.

At this time, it will be understood that each block of the flowchart diagrams and combinations of the flowchart diagrams may be performed by computer program instructions. These computer program instructions may be embodied in a processor of a general purpose computer, special purpose computer, or other programmable data processing equipment, such that the instructions performed by the processor of the computer or other programmable data processing equipment are not described in the flowchart block(s). It creates a means to perform functions. These computer program instructions may also be stored in a computer-usable or computer-readable memory that may direct a computer or other programmable data processing equipment to implement a function in a particular manner, and thus the computer-usable or computer-readable memory. It is also possible that the instructions stored in the flow chart block(s) produce an article of manufacture containing instruction means for performing the function described in the flowchart block(s). The computer program instructions may also be mounted on a computer or other programmable data processing equipment, such that a series of operational steps are performed on the computer or other programmable data processing equipment to create a computer-executed process to create a computer or other programmable data processing equipment. It is also possible that instructions for performing the processing equipment provide steps for performing the functions described in the flowchart block(s).

Additionally, each block may represent a module, segment, or portion of code that includes one or more executable instructions for executing specified logical function(s). It should also be noted that in some alternative implementations it is also possible for the functions recited in blocks to occur out of order. For example, two blocks shown one after another may be performed substantially simultaneously, or the blocks may sometimes be performed in the reverse order according to a corresponding function.

In this case, the term '~ unit' used in this embodiment means software or hardware components such as field-programmable gate array (FPGA) or ASIC (Application Specific Integrated Circuit), and '~ unit' refers to what role carry out the However, '-part' is not limited to software or hardware. '~' may be configured to reside on an addressable storage medium or may be configured to refresh one or more processors. Accordingly, as an example, '~' indicates components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, and procedures. , subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables. The functions provided in the components and '~ units' may be combined into a smaller number of components and '~ units' or further separated into additional components and '~ units'. In addition, components and '~ units' may be implemented to play one or more CPUs in a device or secure multimedia card.

In describing embodiments of the present invention in detail, an example of a specific system will be the main subject, but the main subject matter of the present specification is to extend the scope disclosed herein to other communication systems and services having a similar technical background. It can be applied within a range that does not deviate significantly, and this will be possible at the discretion of a person with technical knowledge skilled in the art.

2 is a diagram illustrating a multi-processor control system according to an embodiment of the present invention, and FIG. 3 is a diagram illustrating a control apparatus according to an embodiment of the present invention.

Referring to FIG. 2 , an embodiment of the present invention includes a first terminal 120 and/or a second terminal 130 including a control device 110 , and optionally a management server 140 and/or We propose a multi-processor control system 100 that further includes an external server 150 .

Meanwhile, the first terminal 120 and/or the second terminal 130 may be replaced with an electronic device, and the electronic device is, for example, a smart phone, a tablet PC, a mobile phone, a video phone, and an e-book. It may include at least one of a reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a PDA, a portable multimedia player (PMP), an MP3 player, a medical device, a camera, and a wearable device. A wearable device may be an accessory (e.g., watch, ring, bracelet, anklet, necklace, eyewear, contact lens, or head-mounted-device (HMD)), a textile or clothing integral (e.g. electronic garment); It may include at least one of a body mountable (eg skin pad or tattoo) or bioimplantable circuit In some embodiments, the electronic device may include, for example, a television, a digital video disk (DVD) player; Audio, refrigerator, air conditioner, vacuum cleaner, oven, microwave oven, washing machine, air purifier, set-top box, home automation control panel, security control panel, media box (eg Samsung HomeSyncTM, Apple TVTM, or Google TVTM), game console (eg, XboxTM, PlayStationTM), an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame.

Referring to FIG. 3 , the control device 110 according to an embodiment of the present invention includes a multi-processor 200 , a monitoring unit 250 , and/or a processor control unit 260 .

The multi-processor 200 may include a first processor 210 , a second processor 220 , a third processor 230 , and/or a fourth processor 240 , and a processor included in the multi-processor 200 . The number of is not limited to the example shown in FIG. 3 . For example, the multi-processor 200 may include N processors (not shown), and N may be a natural number such as 4, 8, 16, 32, 64, 128, or the like. For example, when the multi-processor 200 includes eight processors, that is, the first to eighth processors, the multi-processor 200 may correspond to an octa-core or 8 cores, The state information about the processor 200 may include first to eighth processor state information. For example, when the multi-processor 200 includes 16 processors, that is, the first to sixteenth processors, the multi-processor 200 may correspond to 16 cores, and state information on the multi-processor 200 . may include first processor state information to sixteenth processor state information. In addition, features described on the assumption that the first processor 210 to the fourth processor 240 in the present invention may be applied to N processors.

Each of the first processor 210 , the second processor 220 , the third processor 230 and/or the fourth processor 240 is at least one central processing unit (CPU) and/or at least one It may include a graphic processing unit (GPU).

In addition, the control device 110 according to an embodiment of the present invention, the multi-processor 200 may further include a control device manager 250 . The control device manager 250 collects status information about the first processor 210 , the second processor 220 , the third processor 230 , and/or the fourth processor 240 (eg, a monitoring role); It is possible to generate control information for controlling the first processor 210 , the second processor 220 , the third processor 230 , and/or the fourth processor 240 (eg, management role, ON/OFF control). , mode setting).

2 and 3 , the terminals 120 and 130 according to an embodiment of the present invention include a transceiver, an input interface, and an output interface as well as the control device 110 . , and/or memory.

In addition, the servers 140 and 150 may include a processor, a transceiver, an input interface, an output interface, and/or a memory.

Meanwhile, even in the case of the servers 140 and 150 according to an embodiment, the control device 110 described above may be included instead of a general processor.

The control device 110 and/or the processor directly/indirectly controls the terminals 120 and 130 and/or the servers 140 and 150 of the present invention to implement the operations/steps/processes according to an embodiment of the present invention. can be controlled

The transceiver may transmit/receive various data, signals, and information to and from the terminals 120 and 130 and/or the servers 140 and 150 of the present invention. In addition, the transceiver may be a wireless communication module (eg, a cellular communication module, a near field communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (eg, a local area network (LAN) communication module, or a power line communication module). ) may be included. In addition, the transceiver may be connected to a first network (eg, a short-range communication network such as Bluetooth, WiFi direct, or infrared data association (IrDA)) or a second network (eg, a cellular network, the Internet, or a computer network such as a LAN or WAN). It can communicate with an external electronic device through a telecommunication network). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other.

The input interface transmits commands or data to the terminals 120 and 130 of the present invention and/or components of the servers 140 and 150 (eg, the control device 110 and/or the processor, etc.) to the terminal 120 of the present invention. , 130 ) and/or from a user of the servers 140 , 150 . In addition, the input interface may include a touch recognition capable display, a touch pad, a button type recognition module, a voice recognition sensor, a microphone, a mouse, or a keyboard. Here, the touch recognition capable display, touch pad, and button type recognition module may recognize a touch through the user's body (eg, finger) through a pressure-sensitive and/or capacitive method.

The output interface is a signal (eg, voice signal), information, generated by the controller 110 and/or the processor of the terminals 120 and 130 and/or the servers 140 and 150 of the present invention or acquired through a transceiver; A module that displays data, images, and/or various objects. Also, the output interface may include a display, a screen, a displaying unit, a speaker, and/or a light emitting device (eg, an LED lamp).

The memory stores data such as basic programs, application programs, and setting information for the operation of the terminals 120 and 130 and/or the servers 140 and 150 of the present invention. In addition, the storage module is a flash memory type (Flash Memory Type), a hard disk type (Hard Disk Type), a multimedia card micro type (Multimedia Card Micro Type), a card type memory (eg, SD or XD memory, etc.), Magnetic Memory, Magnetic Disk, Optical Disk, Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory, ROM, Programmable Read-Only Memory (PROM), Electrically Erasable Programmable Read (EEPROM) -Only Memory) may include at least one storage medium.

In addition, the storage module may include personal information of a user who uses the terminals 120 and 130 and/or the servers 140 and 150 of the present invention. Here, the personal information may include a name, ID (identifier), password, resident registration number, street name address, phone number, mobile phone number, and/or e-mail address. In addition, the control device 110 and/or the processor may perform various operations using various programs, contents, data, etc. stored in the storage module.

4 is a flowchart illustrating a method of controlling a multi-processor according to an embodiment of the present invention.

Referring to FIG. 4 , the method according to an embodiment of the present invention may include collecting state information on a plurality of processors ( S310 ).

For example, the processor manager 250 may generate state information for the multi-processor 200 . For example, the processor management unit 250 may be configured for at least one of the first processor 210 , the second processor 220 , the third processor 230 , and the fourth processor 240 included in the multi-processor 200 . State information may be measured, generated, and/or collected. At this time, the state information on the multi-processor 200 includes the first processor state information on the first processor 210 , the second processor state information on the second processor 220 , and the third processor on the third processor 230 . It may include state information and fourth processor state information for the fourth processor 240 .

For example, each processor state information represents a sound [dB], temperature [°C, °F], frequency [Hz], etc. in each of the processors of the multi-processor 200 . may contain information. To this end, a sound sensor, a microphone, a temperature sensor, an infrared sensor, a vibration sensor, etc. may be built-in or installed in each of the processors of the multi-processor 200 . In this case, the sound sensor and the microphone may be for measuring noise and sound generated by each of the processors, and the temperature sensor and the infrared sensor may be for measuring the temperature of each of the processors and heat generated from each of the processors.

In addition, the processor manager 250 may generate state information (ie, processor state information) for the multi-processor 200 every predetermined period. For example, the predetermined period may be set by the processor management unit 250 , the management server 140 , and/or the external server 150 . For example, the predetermined cycle is performed by the processor management unit 250 , the management server 140 , and/or the external server 150 for the first processor state information, the second processor state information, the third processor state information, and the fourth It may be set based on at least one of processor state information.

For example, the state information, each processor state information, statistics about the temperature, frequency, etc., during a predetermined period of each of the processors of the multi-processor 200, the multi-processor 200 Information indicating an average temperature, an average frequency, a highest temperature, a highest frequency, a lowest temperature, a lowest frequency, and the like for a predetermined period of each of the processors.

Also, the method according to an embodiment of the present invention may further include generating reconfiguration information based on the state information on the plurality of processors ( S320 ).

For example, the processor manager 250 may generate reset information based on at least one of first processor state information, second processor state information, third processor state information, and fourth processor state information.

For example, the reset information may include a command for requesting modification and/or change of settings (eg, settings, setting values, options, and modes) for the multi-processor 200 . For example, the reset information may include a setting (eg, setting, setting value) for at least one of the first processor 210 , the second processor 220 , the third processor 230 , and the fourth processor 240 . , an option (option), mode (mode)) may include a command to request a modification and / or change.

In addition, the method according to an embodiment of the present invention may further include determining a multi-processor mode based on state information on a plurality of processors ( S330 ).

For example, the processor manager 250 may determine the multi-processor mode based on at least one of the first processor state information, the second processor state information, the third processor state information, and the fourth processor state information.

In addition, the method according to an embodiment of the present invention may further include controlling the plurality of processors based on the reset information and the multi-processor mode ( S340 ).

For example, the processor manager 250 may control the multi-processor according to the reset information determined (and/or set, and generated) as described above and/or the multi-processor mode. For example, the processor management unit 250 controls the multi-processor 200 based on the reset information determined (and/or set, and generated) as described above and/or the first processor 210, the second processor ( 220 ), the third processor 230 , and the fourth processor 240 may be controlled. For example, the processor management unit 250 controls the multi-processor 200 based on the multi-processor mode determined (and/or set, and generated) as described above and/or the first processor 210 and the second processor. At least one of 220 , the third processor 230 , and the fourth processor 240 may be controlled.

The method according to an embodiment of the present invention may include only a part of S310 to S340 according to an example, and the order of S310 to S340 may be changed according to another example.

For example, the processor management unit 250 may i) generate reset information based on at least one of the first processor state information, the second processor state information, the third processor state information, and the fourth processor state information, or ii) It is possible to determine the multi-processor mode (that is, only one operation of S320 and S330 may be implemented).

In addition, an embodiment of the present invention may further include the following features.

For example, the processor manager 250 determines whether information to be processed to be processed through the multi-processor 200 includes a video, whether an image is included, and / or based on whether text is included, i) generate reset information, and/or ii) determine a multi-processor mode.

For example, the processor management unit 250 may include the number (number, amount), capacity (　volume), based on the resolution and/or number of images, capacity, resolution and/or number, capacity of text i) generate reset information, and/or ii) determine a multi-processor mode; have.

For example, in the processor management unit 250 , processing the processing target information through the multi-processor 200 is to be processed while the control device 110 and/or the multi-processor 200 is in an ON state. Depending on whether or not it is possible to proceed in an unattended mode, it is possible to i) generate reset information, and/or ii) determine a multi-processor mode.

In this case, the unmanned mode may correspond to a state in which the user does not control the control device 110 and turns it on overnight. In addition, the unattended mode may be a mode set for a predetermined period, or may be a mode set differently according to each processing target information.

For example, the processor manager 250 may estimate the repeatability and/or calculate a value for inferring the repeatability. In addition, the processor management unit 250 processes the processing target information through the multi-processor 200 based on the repeatability while the control device 110 and/or the multi-processor 200 is in an ON state. It can be determined whether it should be, or whether it is possible to proceed in an unattended mode.

As an example, the processor management unit 250 estimates the repeatability in consideration of an account logged into programs/software, etc. executed in the terminals 120 and 130 including the control device 110 , and a history of use, and/or the A value for inferring repeatability can be calculated.

In addition, an embodiment of the present invention may further include the following features.

The processor manager 250 may calculate a processor rating index (PRI) for each of the processors included in the multi-processor 200 using the following equations.

[Equation 1]

Equation 1 may be calculated based on the time required for the processor to process the test data (Time) [sec, min] and the capacity of the processor to process the test data (Volume) [kb, mb].

[Equation 2]

Equation 2 is the average noise (PSound, Processing Sound) [dB] generated when the processor processes the test data, and the average noise measured when the power of the control device, the terminal, and/or the server is turned off. (USound, Usual Sound) [dB], it can be calculated by further considering the average vibration (Vib, Vibration) [Hz] generated when the processor processes the test data. The remaining parameters may be the same as in Equation 1.

[Equation 3]

At this time, PTemp (Processing Temperature) represents the average temperature while the processor processes the test data, and UTemp (Usual Temperature) is the average temperature measured when the power of the controller, terminal and/or server is turned off. indicates The remaining parameters may be applied in the same way as Equations 1 and 2.

[Equation 3]

The parameters of Equation 3 may be applied in the same way as Equations 1 to 3.

In addition, values of parameters utilized in Equations 1 to 4 may be confirmed (and/or identified) from processor state information for a corresponding processor.

The processor management unit 250 utilizes Equation 1 described above, the 1-1 processor determination index (PRI _1-1 ) using the test image included in the test data, and the second-second using the test image included in the test data. 1 processor determination index (PRI _2-1 ), a 3-1 processor determination index (PRI _3-1 ) using the test text included in the test data can be calculated for each of the processors included in the multi-processor 200 have.

The processor management unit 250 utilizes Equation 2 above, the 1-2 processor determination index (PRI _1-2 ) using the test image included in the test data, and the second-second using the test image included in the test data. 2 processor determination index (PRI _2-2 ), a 3-2 processor determination index (PRI _3-2 ) using the test text included in the test data can be calculated for each of the processors included in the multi-processor 200 have.

The processor management unit 250 utilizes Equation 3 described above, the 1-3 processor determination index (PRI _1-3 ) using the test image included in the test data, and the second-second using the test image included in the test data. 3 processor determination index (PRI _2-3 ), a 3-3 processor determination index (PRI _3-3 ) using the test text included in the test data can be calculated for each of the processors included in the multi-processor 200 . have.

The processor management unit 250 utilizes Equation 4 described above, the 1-4 processor determination index (PRI _1-4 ) using the test image included in the test data, and the second-second using the test image included in the test data. 4 The processor determination index (PRI _2-4 ), the 3-4th processor determination index (PRI _3-4 ) using the test text included in the test data can be calculated for each of the processors included in the multi-processor 200 . have.

In addition, the processor management unit 250 for each of the processors included in the multi-processor 200 1-1 processor determination index (PRI _1-1 ), 1-2 processor determination index (PRI _1-2 ), the first The first processor determination index (PRI ₁ ) may be calculated based on the average of the -3 processor determination index (PRI _1-3 ) and the 1-4 processor determination index (PRI _1-4 ). In this case, the first processor determination index may be treated as a value related to the test image.

In addition, the processor management unit 250 for each of the processors included in the multi-processor 200 2-1 processor determination index (PRI _2-1 ), 2-2 processor determination index (PRI _2-2 ), the second The second processor determination index (PRI ₂ ) may be calculated based on the average of the -3 processor determination index (PRI _2-3 ) and the 2-4 processor determination index (PRI _2-4 ). In this case, the second processor determination index may be treated as a value related to the test image.

In addition, the processor management unit 250 is a 3-1 processor determination index (PRI _3-1 ), a 3-2 processor determination index (PRI _3-2 ), the third for each of the processors included in the multi-processor 200. The third processor determination index (PRI ₃ ) may be calculated based on the average of the -3 processor determination index (PRI _3-3 ) and the 3-4th processor determination index (PRI _3-4 ). In this case, the third processor determination index may be treated as a value related to the test text.

In addition, the processor management unit 250 for each of the processors included in the multi-processor 200 1-1 processor determination index (PRI _1-1 ), 2-1 processor determination index (PRI _2-1 ), the third Based on the average of the -1 processor determination index (PRI _3-1 ), the fourth processor determination index (PRI ₄ ) may be calculated. In this case, the fourth processor determination index may be treated as a value related to Equation 1 described above.

In addition, the processor management unit 250 for each of the processors included in the multi-processor 200, the second processor determination index (PRI _1-2 ), 2-2 processor determination index (PRI _2-2 ), the third Based on the average of the -2 processor determination index (PRI _3-2 ), the fifth processor determination index (PRI ₅ ) may be calculated. In this case, the fifth processor determination index may be treated as a value related to Equation 2 described above.

In addition, the processor management unit 250 for each of the processors included in the multi-processor 200 1-3 processor determination index (PRI _1-3 ), 2-3 processor determination index (PRI _2-3 ), the third Based on the average of the -3 processor determination index (PRI _3-3 ), the sixth processor determination index (PRI ₆ ) may be calculated. In this case, the sixth processor determination index may be treated as a value related to Equation 3 above.

In addition, the processor management unit 250 for each of the processors included in the multi-processor 200 1-4 processor determination index (PRI _1-4 ), 2-4 processor determination index (PRI _2-4 ), the third Based on the average of the -4 processor determination index (PRI _3-4 ), the seventh processor determination index (PRI ₇ ) may be calculated. In this case, the seventh processor determination index may be treated as a value related to Equation 4 described above.

The processor management unit 250 considers at least any one of the above-described first processor determination index (PRI ₁ ) to the seventh processor determination index (PRI ₇ ), and includes the processors (eg; th Each of the first to Nth processors or the first to 16th processors) may be assigned (and/or classified) to at least one of the first to fourth processor groups. Meanwhile, one processor may belong to a plurality of processor groups.

In addition, the processor management unit 250, in consideration of at least any one of the above-described first processor determination index (PRI ₁ ) to the seventh processor determination index (PRI ₇ ), processing target information in video viewing mode, normal mode or unattended mode At least one of processors (eg, first to Nth processors or first to 16th processors) included in the multi-processor 200 may be selected as a processor to be used for processing.

In addition, the processor manager 250 determines whether information to be processed through the multi-processor 200 includes a video, whether an image is included, and/or Based on whether text is included, it is possible to i) generate reset information, and/or ii) determine a multiprocessor mode.

In addition, the processor management unit 250 determines whether a video is included in the information to be processed, the number and capacity of the image, whether an image is included, the number and capacity of the image, A predetermined determination index may be calculated in consideration of whether text is included, the number and capacity of text, and the multiprocessor mode may be determined using the calculated predetermined determination index.

For example, the processor manager 250 may set a combination of processors included in the multi-processor 200 . For example, the processor manager 250 may set the first processor group, the second processor group, the third processor group, and the fourth processor group by various combinations of processors.

For example, the processor management unit 250 multiprocesses at least one of a test video, a test image, and a test text arbitrarily set for a test for a predetermined period of time. Matching any one of a plurality of processor groups in consideration of the time required for selecting and processing at least one of the processors included in can do it For example, a test video may be a predetermined image among a plurality of images stored in the memory (and/or storage unit) of the control device 110 (and/or the terminals 120 and 130 and the servers 140 and 150). It may be any one of a standard or a pre-determined image. As an example, the test image may be selected from among a plurality of images stored in the memory (and/or storage unit) of the control device 110 (and/or the terminals 120 and 130 and the servers 140 and 150). It may be any one of a standard or a pre-determined image. For example, the test text may be a predetermined text among a plurality of texts stored in the memory (and/or storage unit) of the control device 110 (and/or the terminals 120 and 130 and the servers 140 and 150). It may be any one of pre-determined text or a standard.

In addition, the test image may be selected (and/or set) from at least one image that has been processed through the multi-processor 200 and/or at least one of the processors included in the multi-processor 200, , the test image may be selected (and/or set) from at least one image that has been processed through the multi-processor 200 and/or at least one of the processors included in the multi-processor 200, , the test text may be selected (and/or set) from among at least one image that has been processed through the multi-processor 200 and/or at least one of the processors included in the multi-processor 200. .

In addition, in the present invention, an image includes video files with extensions such as avi and mp4, images include image files with extensions such as jpg and gif, and text includes txt, doc, docx, xls, xlsx, ppt, A document file having an extension such as pptx may be included.

In addition, in the present invention, that the image, image, and text are processed means that the screen corresponding to the image, image, and text is loaded with the multi-processor 200 (and/or built-in, installed) terminals 120 and 130 and/or may indicate that a process (and/or process) to be displayed in the electronic device has been completed.

The aforementioned multi-processor mode may include a video viewing mode, a normal mode, and an unmanned mode, a manless mode. A first processor group, a second processor group, a third processor group, and a fourth processor group to process the corresponding processing target information according to whether the set multi-processor mode is a video viewing mode, a normal mode, or an unattended mode These may be chosen differently. Meanwhile, at least one of the processes belonging to each of the first processor group, the second processor group, the third processor group, and the fourth processor group may be duplicated.

When the set multi-processor mode is the video viewing mode, at least one of the first processor group and the second processor group may be used for processing target information, and when the set multi-processor mode is the video viewing mode, processing At least one of the second processor group and the third processor group may be used for processing target information, and when the set multi-processor mode is a video viewing mode, a third processor group is used for processing target information and at least one of the fourth processor group.

In the present invention, the video viewing mode corresponds to a mode that requires processing for an image having a time length exceeding a predetermined time length and/or a capacity exceeding a predetermined capacity, and the unattended mode is a predetermined time ( Example: This mode corresponds to a case in which the conditions of the video viewing mode are not satisfied while corresponding to the sleep time set by the user, the average sleep time of the user identified through the user's wearable device, the time arbitrarily set by the user), The normal mode may indicate a case in which neither the conditions of the video viewing mode nor the conditions of the unattended mode are satisfied. The processor manager 250 may determine whether to select a video viewing mode, a normal mode, or an unattended mode by determining whether the above-described condition is satisfied.

The processor management unit 250, among a plurality of processors included in the multi-processor 200, the above-described first processor determination index (PRI ₁ ) exceeds a predetermined first reference value, the above-described sixth processor determination index (PRI) ₆ ) exceeds a predetermined sixth reference value and the above-described seventh processor determination index PRI ₇ may set at least one processor exceeding a predetermined seventh reference value as the first processor group. In addition, the processor management unit 250, among a plurality of processors included in the multi-processor 200, the above-described first processor determination index (PRI ₁ ) exceeds a predetermined first reference value, the second processor determination index (PRI ₂ ) ) exceeds a second predetermined reference value and the third processor determination index PRI ₁ may set at least one processor exceeding the predetermined third reference value as the second processor group. In addition, the processor management unit 250, among the plurality of processors included in the multi-processor 200, the above-described fourth processor determination index (PRI ₄ ) exceeds a predetermined fourth reference value, the above-described fifth processor determination index ( PRI ₅ ) exceeds a predetermined fifth reference value, the above-described sixth processor determination index (PRI ₆ ) exceeds a predetermined sixth reference value, and the aforementioned seventh processor determination index (PRI ₇ ) exceeds a predetermined seventh reference value At least one processor exceeding the reference value may be set as the third processor group. In addition, the processor management unit 250 selects at least one processor whose fourth processor determination index (PRI ₄ ) exceeds a predetermined fourth reference value from among the plurality of processors included in the multi-processor 200 to the fourth processor group. can be set to

5 is a flowchart illustrating a method for controlling a multi-processor according to an embodiment of the present invention.

Referring to FIG. 5 , the method according to an embodiment of the present invention may include controlling ON/OFF of at least one of a plurality of processors based on reset information and a multi-processor mode ( S410 ).

For example, the processor manager 250 may control ON/OFF of the multi-processor 200 according to the reset information and/or the multi-processor mode determined (and/or set, and generated) as described above. can For example, the processor manager 250 controls the on/off of the multi-processor 200 based on the reset information determined (and/or set, and generated) as described above and/or the first processor 210 , the second processor 220 , the third processor 230 , and the fourth processor 240 may control ON/OFF of at least one of the plurality of processors. For example, the processor manager 250 controls the on/off of the multi-processor 200 based on the multi-processor mode determined (and/or set, and generated) as described above and/or and/or the first It is possible to control ON/OFF of at least one of the processor 210 , the second processor 220 , the third processor 230 , and the fourth processor 240 .

The method according to an embodiment of the present invention may further include a step (S420) of further collecting state information for a plurality of processors.

For example, the processor manager 250 may generate additional state information (or may be referred to as “second state information”) for the multi-processor 200 . For example, the processor management unit 250 may be configured for at least one of the first processor 210 , the second processor 220 , the third processor 230 , and the fourth processor 240 included in the multi-processor 200 . Additional state information (or may be referred to as “second state information”) may be measured, generated, and/or collected. In this case, the additional state information for the multi-processor 200 (or may be referred to as “second state information”) includes the 1-2 processor state information for the first processor 210 and the second processor state information for the second processor 220 . 2-2 processor state information, 3-2 processor state information on the third processor 230, and 4-2 processor state information on the fourth processor 240 may be included. On the other hand, the state information (or may be referred to as "first state information") on the multi-processor 200 generated before the step S410 or steps S320, S330, and S340 is the 1-1 processor for the first processor 210 . State information, 2-1 processor state information on the second processor 220, 3-1 processor state information on the third processor 230, and 4-1 processor state information on the fourth processor 240 may include

In addition, the processor manager 250 may generate additional state information for the multi-processor 200 every predetermined period. For example, the predetermined period may be set by the processor management unit 250 , the management server 140 , and/or the external server 150 . As an example, the predetermined cycle is performed by the processor management unit 250 , the management server 140 , and/or the external server 150 for 1-1 processor state information, 1-2 processor state information, and 2-1 Based on at least one of the processor state information, the 2-2 processor state information, the 3-1 processor state information, the 3-2 processor state information, the 4-1 processor state information, and the 4-2 processor state information can be set.

The method according to an embodiment of the present invention may further include resetting the multi-processor mode based on the collected state information on the plurality of processors ( S430 ).

For example, the processor manager 250 may generate second reset information and/or determine (and/or set) the second multi-processor mode. For example, generating second reset information based on at least one of 1-2 processor state information, 2-2 processor state information, 3-2 processor state information, and 4-2 processor state information, and/or Alternatively, the second multi-processor mode may be determined (and/or set). For example, 1-1 processor state information, 1-2 processor state information, 2-1 processor state information, 2-2 processor state information, 3-1 processor state information, 3-2 processor state information , may generate second reset information and/or determine (and/or set) a second multi-processor mode based on at least one of 4-1 processor state information and 4-2 processor state information.

For example, the second reset information may include a command for requesting to modify and/or change settings (eg, settings, setting values, options, and modes) for the multi-processor 200 . For example, the second reset information may include a setting (eg, setting, setting value, options and modes) may include a command to request modification and/or change.

For example, the processor manager 250 may control the multi-processor 200 according to the second reset information and/or the second multi-processor mode determined (and/or set, and generated) as described above. For example, the processor manager 250 controls the multi-processor 200 and/or the first processor 210 and the second based on the second reset information determined (and/or set, and generated) as described above. At least one of the processor 220 , the third processor 230 , and the fourth processor 240 may be controlled. For example, the processor management unit 250 controls the multi-processor 200 based on the second multi-processor mode determined (and/or set, and generated) as described above and/or the first processor 210, the second At least one of the second processor 220 , the third processor 230 , and the fourth processor 240 may be controlled.

For example, the processor manager 250 turns on/off the multi-processor 200 according to the second reset information and/or the second multi-processor mode determined (and/or set, and generated) as described above. ) can be controlled. As an example, the processor management unit 250 controls the on/off (ON/OFF) of the multi-processor 200 based on the second reset information determined (and/or set, generated) as described above and/or ON/OFF of at least one of the first processor 210 , the second processor 220 , the third processor 230 , and the fourth processor 240 may be controlled. For example, the processor manager 250 controls the on/off of the multi-processor 200 based on the second multi-processor mode determined (and/or set, and generated) as described above and/or The ON/OFF of at least one of the first processor 210 , the second processor 220 , the third processor 230 , and the fourth processor 240 may be controlled.

The method according to an embodiment of the present invention may include only some of S410 to S430 according to an example, and the order of S410 to S430 may be changed according to another example.

In addition, an embodiment of the present invention may further include the following features.

For example, the processor manager 250 may set at least one processor among the multi-processors 200 as an 'independent processor' and set the remaining at least one processor as a 'dependent processor'. have.

For example, the processor management unit 250 may be configured based on the state information on at least one of the first processor 210 , the second processor 220 , the third processor 230 , and the fourth processor 240 . At least one of the first processor 210 , the second processor 220 , the third processor 230 , and the fourth processor 240 may be set as an independent processor, and the rest may be set as a subordinate processor. For example, the processor management unit 250 may include 1-1 state information and/or 1-2 state information on the first processor 210 , 2-1 state information on the second processor 220 and/or 2-2 status information, 3-1 status information and/or 3-2 status information for the third processor 230, 4-1 status information and/or 4th status information for the fourth processor 240 -2 The first processor 210, the second processor 220, the third processor 230, and the fourth processor ( 240), at least one may be set as an independent processor, and the rest may be set as a subordinate processor.

For example, the processor manager 250 may set two or more independent processors and two or more subordinate processors among a plurality of processors included in the multi-processor 200 . In this case, each of the plurality of processors may be configured as either an independent processor or a subordinate processor.

Also, the processor manager 250 may match each of the two or more independent processors to each of the two or more subordinate processors.

In addition, the processor management unit 250 performs an arithmetic operation on the allocated first data unit among the plurality of data units divided from the multimedia data; A calculation operation performed on at least one second data unit among the plurality of data units by at least one preset processor among the plurality of processors independently of whether the operation of the allocated first data unit is completed obtain information about the completion of the task; Control to store the job completion information obtained from each of the at least one processor in the memory of the terminals 120 and 130 and/or the servers 140 and 150 in which the control device 110 is included (and/or built-in) can do.

In addition, the processor management unit 250 may determine whether the computational task on the multimedia data is completed based on the stored task completion information obtained from the at least one processor and the computational task on the allocated first data unit. .

In addition, the processor manager 250 transmits a request for executing an application (APP, application) in the control device 110 and/or the multi-processor 200 externally (eg, the terminals 120 and 130 and/or the server 140, 150); identify a property (property) associated with the application (the property is a processor (eg, the first processor 210 to the fourth processor) to be used to execute the application in the multi-processor 200 (identifying a minimum power requirement to achieve an acceptable performance level of the application rather than directly specifying at least any one of 240); scheduling the application for execution on a processor determined based on the identified attribute and; control to execute the application using the determined processor.

In addition, the processor manager 250 receives a request for execution of an application in the control device 110 and/or the multi-processor 200 from the outside (eg, the terminals 120 and 130 and/or the servers 140 and 150 ). For example, the processor manager 250 may receive a command to execute an application through a system call or the like.

Also, the processor manager 250 may identify an application-related attribute. In this case, the application-related attribute provides information used to determine which processor in the control device 110 will execute the application. For example, an application-related attribute is determined (and/or determined) by a component of the control device 110 .

In addition, the processor management unit 250 controls application scheduling for execution through at least one of the designated processor, that is, the first processor 210 to the fourth processor 240 based on the determination (and/or determination) attribute. can For example, processor manager 250 may determine whether a specified (and/or designated) processor is currently operating in acceptable usage to support execution of an application. For example, the processor manager 250 creates a procedure (process) for executing an application, and then schedules the corresponding process for execution in a specified (and/or designated) processor.

In addition, the processor manager 250 may perform (and/or control) application loading in response to application scheduling. For example, in response to a scheduler that schedules an application to be loaded, the application from the memory of the terminals 120 and 130 and/or the servers 140 and 150 in which the control device 110 is included (and/or built-in) It can output (and/or load) it.

In addition, the processor manager 250 executes an application using a specified (and/or designated) processor.

6 to 8 are block diagrams illustrating an electronic device according to an embodiment of the present invention.

The electronic device according to various embodiments of the present disclosure may include, for example, a smartphone, a tablet PC, a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a PDA, and a PMP. It may include at least one of a portable multimedia player, an MP3 player, a medical device, a camera, and a wearable device. A wearable device may be an accessory (e.g., watch, ring, bracelet, anklet, necklace, eyewear, contact lens, or head-mounted-device (HMD)), a textile or clothing integral (e.g. electronic garment); It may include at least one of a body mountable (eg skin pad or tattoo) or bioimplantable circuit In some embodiments, the electronic device may include, for example, a television, a digital video disk (DVD) player; Audio, refrigerator, air conditioner, vacuum cleaner, oven, microwave oven, washing machine, air purifier, set-top box, home automation control panel, security control panel, media box (eg Samsung HomeSyncTM, Apple TVTM, or Google TVTM), game console (eg, XboxTM, PlayStationTM), an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame.

In another embodiment, the electronic device may include various medical devices (eg, various portable medical measuring devices (eg, a blood glucose monitor, a heart rate monitor, a blood pressure monitor, or a body temperature monitor), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), CT (computed tomography), imager, or ultrasound machine, etc.), navigation device, global navigation satellite system (GNSS), event data recorder (EDR), flight data recorder (FDR), automotive infotainment device, marine electronic equipment (e.g. navigation devices for ships, gyro compasses, etc.), avionics, security devices, head units for vehicles, industrial or household robots, drones, ATMs in financial institutions, point of sale (POS) in stores of sales) or IoT devices (eg, light bulbs, various sensors, sprinkler devices, fire alarms, thermostats, street lights, toasters, exercise equipment, hot water tanks, heaters, boilers, etc.). According to some embodiments, the electronic device is a piece of furniture, building/structure or automobile, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (eg, water, electricity, gas, or a radio wave measuring device). In various embodiments, the electronic device may be flexible or a combination of two or more of the various devices described above. The electronic device according to the embodiment of the present document is not limited to the above-described devices. In this document, the term user may refer to a person who uses an electronic device or a device (eg, an artificial intelligence electronic device) using the electronic device.

In addition, the electronic device may include a bus, a processor, a memory, an input/output interface, a display, and a communication interface. In some embodiments, the electronic device may omit at least one of the components or may additionally include other components. A bus may include circuitry that connects components to each other and transmits communications (eg, control messages or data) between components. The processor may include one or more of a central processing unit, an application processor, and a communication processor (CP). The processor may, for example, execute an operation or data processing related to control and/or communication of at least one other component of the electronic device.

Memory may include volatile and/or non-volatile memory. The memory may store, for example, commands or data related to at least one other component of the electronic device. According to one embodiment, the memory may store software and/or programs. A program may include, for example, a kernel, middleware, an application programming interface (API), and/or an application program (or "application"), and the like. At least a portion of the kernel, middleware, or API may be referred to as an operating system. The kernel controls or controls system resources (eg, bus, processor, or memory, etc.) used to execute an operation or function implemented in, for example, other programs (eg, middleware, API, or application program). can manage In addition, the kernel may provide an interface capable of controlling or managing system resources by accessing individual components of the electronic device from middleware, API, or application programs.

The middleware may, for example, play an intermediary role so that an API or an application program can communicate with the kernel to send and receive data. In addition, the middleware may process one or more work requests received from the application program according to priority. For example, the middleware may give priority to at least one of the application programs to use a system resource (eg, a bus, a processor, a memory, etc.) of the electronic device, and process the one or more work requests. API is an interface for an application to control functions provided by the kernel or middleware, and includes at least one interface or function (eg, command) for, for example, file control, window control, image processing, or character control. can do. The input/output interface, for example, transmits commands or data input from a user or other external device to other component(s) of the electronic device, or receives commands or data received from other component(s) of the electronic device It can be output to the user or other external device.

The display may include, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, or a microelectromechanical system (MEMS) display, or an electronic paper display. have. The display may, for example, present various content (eg, text, images, video, icons, and/or symbols, etc.) to the user. The display may include a touch screen, and may receive, for example, a touch input using an electronic pen or a part of the user's body, a gesture, a proximity, or a hovering input. The communication interface, for example, may establish communication between the electronic device and an external device (eg, a first external electronic device, a second external electronic device, or a server). For example, the communication interface may be connected to a network through wireless communication or wired communication to communicate with an external device (eg, a second external electronic device or a server).

Wireless communication is, for example, LTE, LTE Advance (LTE-A), CDMA (code division multiple access), WCDMA (wideband CDMA), UMTS (universal mobile telecommunications system), WiBro (Wireless Broadband), or GSM (Global System for Mobile Communications) and the like may include cellular communication using at least one. According to one embodiment, wireless communication is, for example, wireless fidelity (WiFi), Bluetooth, Bluetooth low energy (BLE), Zigbee (Zigbee), near field communication (NFC), magnetic secure transmission (Magnetic Secure Transmission), radio It may include at least one of a frequency (RF) or a body area network (BAN). According to one embodiment, the wireless communication may include GNSS. The GNSS may be, for example, a Global Positioning System (GPS), a Global Navigation Satellite System (Glonass), a Beidou Navigation Satellite System (hereinafter, “Beidou”) or Galileo, the European global satellite-based navigation system. Hereinafter, in this document, "GPS" may be used interchangeably with "GNSS". Wired communication may include, for example, at least one of universal serial bus (USB), high definition multimedia interface (HDMI), recommended standard232 (RS-232), power line communication, or plain old telephone service (POTS). have. The network may include at least one of a telecommunications network, for example, a computer network (eg, a LAN or WAN), the Internet, or a telephone network.

Each of the first and second external electronic devices may be the same or a different type of electronic device. According to various embodiments, all or a part of operations executed by the electronic device may be executed by one or a plurality of other electronic devices (eg, electronic devices or servers. According to one embodiment, the electronic device may perform a certain function or service to be performed automatically or upon request, the electronic device may request from another device (eg, an electronic device or a server) for at least some functions related thereto, instead of or in addition to executing the function or service itself. Another electronic device (eg, an electronic device or a server) may execute the requested function or additional function and transmit the result to the electronic device The electronic device may process the received result as it is or additionally to perform the requested function For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

The electronic device includes one or more processors (eg, AP), communication modules, (subscriber identification module, memory, sensor module, input device, display, interface, audio module, camera module, power management module, battery, indicator, and motor) The processor may, for example, run an operating system or an application program to control a plurality of hardware or software components connected to the processor, and may perform various data processing and operations. For example, it may be implemented as a system on chip (SoC). According to an embodiment, the processor may further include a graphic processing unit (GPU) and/or an image signal processor. The processor may include other components (eg, : A command or data received from at least one of the non-volatile memory) may be loaded into the volatile memory for processing, and the result data may be stored in the non-volatile memory.

It may have the same or similar configuration to a communication module (eg, a communication interface). The communication module may include, for example, a cellular module, a WiFi module, a Bluetooth module, a GNSS module, an NFC module, and an RF module. The cellular module may provide, for example, a voice call, a video call, a text service, or an Internet service through a communication network. According to an embodiment, the cellular module may perform identification and authentication of an electronic device within a communication network using a subscriber identification module (eg, a SIM card). According to an embodiment, the cellular module may perform at least some of the functions that the processor may provide. According to one embodiment, the cellular module may include a communication processor (CP). According to some embodiments, at least some (eg, two or more) of a cellular module, a WiFi module, a Bluetooth module, a GNSS module, or an NFC module may be included in one integrated chip (IC) or an IC package. The RF module may, for example, transmit/receive a communication signal (eg, an RF signal). The RF module may include, for example, a transceiver, a power amp module (PAM), a frequency filter, a low noise amplifier (LNA), or an antenna. According to another embodiment, at least one of a cellular module, a WiFi module, a Bluetooth module, a GNSS module, or an NFC module may transmit/receive an RF signal through a separate RF module. The subscriber identification module may include, for example, a card including a subscriber identification module or an embedded SIM, and may include unique identification information (eg, integrated circuit card identifier (ICCID)) or subscriber information (eg, international mobile (IMSI)). subscriber identity)).

The memory (eg, memory) may include, for example, an internal memory or an external memory. Built-in memory includes, for example, volatile memory (such as DRAM, SRAM, or SDRAM), non-volatile memory (such as one time programmable ROM (OTPROM), PROM, EPROM, EEPROM, mask ROM, flash ROM, flash memory). , a hard drive, or a solid state drive (SSD), the external memory may include a flash drive, for example, a compact flash (CF), secure digital (SD), Micro-SD, It may include a Mini-SD, extreme digital (xD), a multi-media card (MMC), a memory stick, etc. The external memory may be functionally or physically connected to an electronic device through various interfaces.

The sensor module, for example, may measure a physical quantity or sense an operating state of an electronic device, and may convert the measured or sensed information into an electrical signal. The sensor module may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor (eg, an RGB (red, green, blue) sensor), a biometric sensor , it may include at least one of a temperature/humidity sensor, an illuminance sensor, and an ultra violet (UV) sensor. Additionally or alternatively, the sensor module may include, for example, an olfactory (e-nose) sensor, an electromyography (EMG) sensor, an electroencephalogram (EEG) sensor, an electrocardiogram (ECG) sensor, an infrared (IR) sensor. ) sensor, an iris sensor and/or a fingerprint sensor. The sensor module may further include a control circuit for controlling at least one or more sensors included therein. In some embodiments, the electronic device may further include a processor configured to control the sensor module, as part of the processor or separately, to control the sensor module while the processor is in a sleep state.

The input device may include, for example, a touch panel, a (digital) pen sensor, a key, or an ultrasonic input device. The touch panel may use, for example, at least one of a capacitive type, a pressure-sensitive type, an infrared type, and an ultrasonic type. In addition, the touch panel may further include a control circuit. The touch panel may further include a tactile layer to provide a tactile response to the user. The (digital) pen sensor may be, for example, a part of a touch panel or may include a separate recognition sheet. The key may include, for example, a hardware button, an optical key, or a keypad. The ultrasound input device may detect the ultrasound generated by the input tool through the microphone, and check data corresponding to the sensed ultrasound.

The display may include a panel, a holographic device, a projector, and/or control circuitry for controlling them. The panel may be implemented, for example, to be flexible, transparent, or wearable. The panel may be composed of a touch panel and one or more modules. According to an embodiment, the panel may include a pressure sensor (or a force sensor) capable of measuring the intensity of the user's touch. The pressure sensor may be implemented integrally with the touch panel, or may be implemented as one or more sensors separate from the touch panel. The holographic device may display a three-dimensional image in the air using interference of light. A projector can display an image by projecting light onto a screen. The screen may be located inside or outside the electronic device, for example. The interface may include, for example, HDMI, USB, an optical interface, or a D-subminiature (D-sub) 278 . Additionally or alternatively, the interface may include, for example, a mobile high-definition link (MHL) interface, an SD card/multi-media card (MMC) interface, or an infrared data association (IrDA) standard interface.

The audio module may, for example, convert a sound and an electrical signal interactively. The audio module may process sound information input or output through, for example, a speaker, a receiver, an earphone, or a microphone. The camera module is, for example, a device capable of capturing still images and moving pictures, and according to one embodiment, one or more image sensors (eg, a front sensor or a rear sensor), a lens, an image signal processor (ISP), or a flash (eg, LED or xenon lamp, etc.). The power management module may manage power of the electronic device, for example. According to one embodiment, the power management module may include a power management integrated circuit (PMIC), a charger IC, or a battery or fuel gauge. The PMIC may have a wired and/or wireless charging method. The wireless charging method includes, for example, a magnetic resonance method, a magnetic induction method or an electromagnetic wave method, and may further include an additional circuit for wireless charging, for example, a coil loop, a resonance circuit, or a rectifier. have. The battery gauge may measure, for example, the remaining amount of the battery, voltage, current, or temperature during charging. Batteries may include, for example, rechargeable cells and/or solar cells.

The indicator may display a specific state of the electronic device or a part thereof (eg, a processor), for example, a booting state, a message state, or a charging state. The motor may convert an electrical signal into mechanical vibration, and may generate vibration, a haptic effect, or the like. The electronic device includes, for example, a mobile TV support device (eg, GPU) capable of processing media data according to standards such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or mediaFloTM. may include Each of the components described in this document may be composed of one or more components, and the name of the component may vary depending on the type of the electronic device. In various embodiments, an electronic device (eg, an electronic device) has some components omitted, additional components are further included, or some of the components are combined to form a single entity, but the corresponding components before the combination The functions of the components may be performed identically.

In various embodiments of the present disclosure, the electronic device (or electronic device) may include a housing including a front surface, a rear surface, and side surfaces surrounding a space between the front surface and the rear surface. A touch screen display (eg, a display) may be disposed in the housing and exposed through the front surface. A microphone is disposed within the housing and may be exposed through a portion of the housing. At least one speaker is disposed in the housing and may be exposed through another portion of the housing. A hardware button (eg, a key) may be disposed on another part of the housing or configured to be displayed on the touchscreen display. A wireless communication circuit (eg, a communication module) may be located in the housing. The processor (or processor) may be located in the housing and may be electrically connected to the touch screen display, the microphone, the speaker, and the wireless communication circuit. The memory (or memory) may be located in the housing and may be electrically connected to the processor.

In various embodiments of the present disclosure, the memory is configured to store a first application program including a first user interface for receiving a text input, and the memory, when executed, causes the processor to perform a first operation and instructions for causing a second operation to be performed, wherein the first operation comprises: receiving a first type of user input through the button while the first user interface is not displayed on the touch screen display; , after receiving the first type of user input, receive a first user utterance through the microphone, and send to an external server including an automatic speech recognition (ASR) and an intelligence system. at least one providing first data for a first user utterance, and after providing the first data, performing a task generated by the intelligent system in response to the first user utterance from the external server Receiving a command, the second operation is performed after receiving the first user input through the button while the first user interface is displayed on the touch screen display and receiving the first type of user input , receive a second user's utterance through the microphone, provide second data for the second user's utterance to the external server, and after providing the second data, from the server, the second user receiving data about the text generated by the automatic speech recognition from an utterance, but not receiving a command generated by the intelligent system, and inputting the text into the first user interface.

In various embodiments of the present disclosure, the button may include a physical key located on the side surface of the housing.

In various embodiments of the present disclosure, the first type of user input may be performed after pressing the button once, pressing the button twice, pressing the button 3 times, and pressing the button once. It can be one of a press and hold, or a double press and hold down on the button.

In various embodiments of the present disclosure, the instructions may further cause the processor to display the first user interface together with a virtual keyboard. The button may not be a part of the virtual keyboard.

In various embodiments of the present disclosure, the instructions may further cause the processor to receive, from the external server, data for text generated by an ASR from the first user utterance within the first operation. have.

In various embodiments of the present disclosure, the first application program may include at least one of a note application program, an email application program, a web browser application program, and a calendar application program.

In various embodiments of the present disclosure, the first application program includes a message application, and the instructions are automatically executed via the wireless communication circuit when the processor, by the processor, exceeds a selected time period after inputting the text. may further cause the inputted text to be transmitted.

In various embodiments of the present disclosure, the instructions further cause the processor to perform a third operation, wherein the third operation includes: while displaying the first user interface on the touch screen display, the button Receives a second type of user input through , and after receiving the second type of user input, receives a third user utterance through the microphone, and sends a third response to the third user utterance to the external server After providing data and providing the third data, at least one command for performing a task generated by the intelligent system in response to the third user utterance may be received from the external server.

In various embodiments of the present disclosure, the instructions further cause the processor to perform a fourth operation, wherein the fourth operation is performed while the first user interface is not displayed on the touch screen display. Receives the second type of user input through a button, and after receiving the second type of user input, receives a fourth user utterance through the microphone, and receives fourth data for the fourth user utterance After providing to the external server and providing the fourth data, in response to the fourth user utterance, receiving at least one command for performing a task generated by the intelligent system from the external server, receiving a fifth user utterance through the microphone, providing fifth data on the fifth user utterance to the external server, and after providing the fifth data, in response to the fifth user utterance At least one command for performing the task generated by the intelligent system may be received from the external server.

In various embodiments of the present invention, the first type of user input and the second type of user input are different from each other, and a single press of the button, two presses of the button, three presses of the button , one of pressing and holding the button after pressing it once, or pressing and holding the press twice on the button.

In various embodiments of the present disclosure, the memory is further configured to store a second application program including a second user interface for receiving a text input, wherein the instructions, when executed, cause the processor to: further cause to perform an operation, wherein the third operation includes: receiving the first type of user input through the button while displaying the second user interface; After the first type of user input is received, a third user utterance is received through the microphone, and third data for the third user utterance is provided to the external server, and the third data is provided. After receiving the data for the text generated by the ASR from the third user utterance from the external server, the command generated by the intelligent system is not received, and the text is displayed on the second user interface. input, and input the text, and automatically transmit the entered text through the wireless communication circuit when the selected time period is exceeded.

In various embodiments of the present disclosure, the memory is configured to store a first application program including a first user interface for receiving a text input, and the memory, when executed, causes the processor to perform a first operation and instructions for causing to perform a second operation, wherein the first operation receives a first type of user input through the button, and after receiving the first type of user input, the microphone is Receive a first user utterance through an external server including automatic speech recognition (ASR) and an intelligence system, and provide first data for the first user utterance, and After providing 1 data, at least one command for performing a task generated by the intelligent system in response to the first user utterance is received from the external server, and the second operation is performed through the button Receives a second type of user input, and after receiving the second type of user input, receives a second user utterance through the microphone, and transmits second data for the second user utterance to the external server and after providing the second data, receiving from the server data for the text generated by the ASR from the second user utterance, but not receiving the command generated by the intelligent system, The text may be entered into the first user interface.

In various embodiments of the present disclosure, the instructions may further cause the processor to display the first user interface together with a virtual keyboard, wherein the button may not be part of the virtual keyboard.

In various embodiments of the present disclosure, the instructions may further cause the processor to receive, from the external server, data for the text generated by the ASR from the first user utterance within the first operation. .

In various embodiments of the present disclosure, the first application program may include at least one of a note application program, an email application program, a web browser application program, and a calendar application program.

In various embodiments of the present disclosure, the first application program includes a message application, and the instructions are automatically executed via the wireless communication circuit when the processor, by the processor, exceeds a selected time period after inputting the text. may further cause the inputted text to be transmitted.

In various embodiments of the present disclosure, the instructions may further cause the processor to perform the first operation independently of displaying on the display of the first user interface.

In various embodiments of the present disclosure, the instructions further cause the processor to perform the second operation when at least one of the electronic device is in a locked state or the touchscreen display is turned off can do.

In various embodiments of the present disclosure, the instructions may further cause the processor to perform the second operation while displaying the first user interface on the touch screen display.

In various embodiments of the present invention, the memory, when executed, causes the processor to receive a user utterance through the microphone, and perform automatic speech recognition (ASR) or natural language understanding (NLU) To an external server that performs at least one of, transmits information related to whether to perform the natural language understanding on the text obtained by performing the ASR on the data on the user utterance together with the data on the user utterance, , receive the text for data about the user utterance from the external server if the information indicates not to perform the natural language understanding, and if the information indicates to perform the natural language understanding, the text from the external server An instruction for causing to receive a command obtained as a result of performing the natural language understanding may be stored.

According to an embodiment, a program module (eg, a program) may include an operating system that controls resources related to an electronic device (eg, electronic device) and/or various applications (eg, application programs) running on the operating system. have. The operating system may include, for example, Android™, iOS™, Windows™, Symbian™, Tizen™, or Bada™. A program module may include a kernel (eg, a kernel), middleware (eg, middleware), an API (eg, an API), and/or an application (eg, an application program). At least a part of the program module is located on the electronic device. It can be preloaded on the computer or downloaded from an external electronic device (eg, electronic device, server, etc.).

The kernel may include, for example, a system resource manager and/or device driver. The system resource manager may control, allocate, or reclaim system resources. According to an embodiment, the system resource manager may include a process manager, a memory manager, or a file system manager. The device driver may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a WiFi driver, an audio driver, or an inter-process communication (IPC) driver. For example, the middleware may provide functions commonly required by applications or provide various functions to applications through APIs so that applications can use limited system resources inside the electronic device. According to an embodiment, the middleware is one of a runtime library, an application manager, a window manager, a multimedia manager, a resource manager, a power manager, a database manager, a package manager, a connectivity manager, a notification manager, a location manager, a graphics manager, or a security manager. It may include at least one.

The runtime library may include, for example, a library module used by the compiler to add a new function through a programming language while an application is running. The runtime library may perform I/O management, memory management, or arithmetic function processing. The application manager may, for example, manage the life cycle of the application. The window manager can manage GUI resources used in the screen. The multimedia manager may identify a format required to reproduce the media files, and may encode or decode the media files using a codec suitable for the format. The resource manager may manage the space of an application's source code or memory. The power manager may, for example, manage a capacity or power of a battery and provide power information required for an operation of an electronic device. According to an embodiment, the power manager may interwork with a basic input/output system (BIOS). The database manager may, for example, create, retrieve, or change a database to be used in an application. The package manager may manage installation or update of an application distributed in the form of a package file.

The connectivity manager may, for example, manage wireless connections. The notification manager may provide, for example, an event such as an arrival message, an appointment, and a proximity notification to the user. The location manager may manage location information of the electronic device, for example. The graphic manager may manage a graphic effect to be provided to a user or a user interface related thereto, for example. A security manager may provide, for example, system security or user authentication. According to an embodiment, the middleware may include a telephony manager for managing a voice or video call function of the electronic device or a middleware module capable of forming a combination of functions of the aforementioned components. According to an embodiment, the middleware may provide a specialized module for each type of operating system. Middleware can dynamically delete some existing components or add new ones. The API may be provided in a different configuration depending on the operating system, for example, as a set of API programming functions. For example, in the case of Android or iOS, one API set may be provided for each platform, and in the case of Tizen, two or more API sets may be provided for each platform.

Applications can be, for example, home, dialer, SMS/MMS, instant message (IM), browser, camera, alarm, contacts, voice dial, email, calendar, media player, album, watch, health care (eg exercise or measuring blood sugar) or environment information (eg, barometric pressure, humidity, or temperature information) providing application. According to an embodiment, the application may include an information exchange application capable of supporting information exchange between the electronic device and the external electronic device. The information exchange application may include, for example, a notification relay application for transmitting specific information to an external electronic device, or a device management application for managing the external electronic device. For example, the notification delivery application may transmit notification information generated by another application of the electronic device to the external electronic device or may receive notification information from the external electronic device and provide it to the user. The device management application may be, for example, a function of the external electronic device communicating with the electronic device (eg, turning on/off the external electronic device itself (or some component) or the brightness (or resolution) of the display. adjustment), or an application running in an external electronic device may be installed, deleted, or updated. According to an embodiment, the application may include an application designated according to a property of the external electronic device (eg, a health management application of a mobile medical device). According to an embodiment, the application may include an application received from an external electronic device. At least some of the program modules may be implemented (eg, executed) in software, firmware, hardware (eg, a processor), or a combination of at least two or more thereof, and a module, program, routine, set of instructions for performing one or more functions. or processes.

9 is a flowchart illustrating a method for controlling a multi-processor according to an embodiment of the present invention.

Referring to FIG. 9 , the method for controlling a multi-processor according to an embodiment of the present invention may include collecting information on the multi-processor ( S910 ).

In addition, the method of controlling a multiprocessor according to an embodiment of the present invention may include selecting the first heat dissipation mode or the second heat dissipation mode based on information on the multiprocessor ( S920 ).

Also, the method of controlling a multiprocessor according to an embodiment of the present invention may include executing the first heat dissipation mode ( S930 ).

Also, the method of controlling a multiprocessor according to an embodiment of the present invention may include executing the second heat dissipation mode ( S940 ).

Also, the method of controlling a multiprocessor according to an embodiment of the present invention may include executing an emergency stop mode ( S950 ).

The method according to an embodiment of the present invention may include only a part of S910 to S950, and according to another example, the order of S910 to S950 may be changed.

10 is a flowchart illustrating a method of controlling a multi-processor according to an embodiment of the present invention.

Referring to FIG. 10 , the method of controlling a multi-processor according to an embodiment of the present invention may include collecting information on the multi-processor ( S1010 ).

Also, the method for controlling a multi-processor according to an embodiment of the present invention may include selecting a single mode or a shared mode based on information about the multi-processor ( S1020 ).

Also, the method of controlling a multiprocessor according to an embodiment of the present invention may include transmitting an external request message to the terminal or the server based on selection of the sharing mode (S1030).

Also, the method of controlling a multiprocessor according to an embodiment of the present invention may include receiving external processing information from a terminal or a server (S1040).

In addition, the method of controlling a multi-processor according to an embodiment of the present invention may include combining external processing information with internal processing information ( S1050 ).

The method according to an embodiment of the present invention may include only a part of S1010 to S1050, and according to another example, the order of S1010 to S1050 may be changed.

The embodiments of the present invention disclosed in the present specification and drawings are merely provided for specific examples in order to easily explain the technical contents of the present invention and help the understanding of the present invention, and are not intended to limit the scope of the present invention. That is, it will be apparent to those of ordinary skill in the art to which the present invention pertains that other modifications can be implemented based on the technical idea of the present invention. In addition, each of the above embodiments may be operated in combination with each other as needed. For example, all embodiments of the present invention may be implemented by the system 100 , the terminals 120 , 130 and/or the servers 140 , 150 of the present invention in parts in combination with each other.

In addition, the method of controlling the system 100, the terminals 120, 130, and/or the servers 140, 150 of the present invention is implemented in the form of a program command that can be executed through various computer means and is stored in a computer-readable medium. can be recorded.

As such, various embodiments of the present invention may be embodied as computer readable code on a computer readable recording medium in a particular aspect. A computer readable recording medium is any data storage device capable of storing data that can be read by a computer system. Examples of computer readable recording media include read only memory (ROM), random access memory (RAM), and compact disk-read only memory (CD-ROM). ), magnetic tapes, floppy disks, optical data storage devices, and carrier waves (such as data transmission over the Internet). The computer readable recording medium may also be distributed over network coupled computer systems, so that the computer readable code is stored and executed in a distributed fashion. In addition, functional programs, codes, and code segments for achieving various embodiments of the present invention may be easily interpreted by programmers skilled in the field to which the present invention is applied.

In addition, it will be appreciated that the apparatus and method according to various embodiments of the present invention can be realized in the form of hardware, software, or a combination of hardware and software. Such software may include, for example, a volatile or non-volatile storage device, such as a ROM, or a memory, such as, for example, RAM, a memory chip, device or integrated circuit, whether erasable or rewritable, or For example, the storage medium may be stored in an optically or magnetically recordable storage medium such as a compact disk (CD), a DVD, a magnetic disk, or a magnetic tape, and a machine (eg, computer) readable storage medium. The method according to various embodiments of the present invention may be implemented by a computer or portable terminal including a control device, a control unit and/or a memory, and the memory is a program including instructions for implementing the embodiments of the present invention or It will be appreciated that this is an example of a machine-readable storage medium suitable for storing programs.

Accordingly, the present invention includes a program including code for implementing the apparatus or method described in the claims of the present specification, and a machine (computer, etc.) readable storage medium storing such a program. Also, such a program may be transmitted electronically through any medium such as a communication signal transmitted through a wired or wireless connection, and the present invention suitably includes the equivalent thereof.

The embodiments of the present invention disclosed in the present specification and drawings are merely provided for specific examples to easily explain the technical content of the present invention and help the understanding of the present invention, and are not intended to limit the scope of the present invention. In addition, the above-described embodiments according to the present invention are merely exemplary, and it will be understood by those skilled in the art that various modifications and equivalent ranges of embodiments are possible therefrom. Accordingly, the true technical protection scope of the present invention should be defined by the following claims.

Claims (1)

multiprocessor system.

Images