KR20060044081A - Personal computer system suitable to integration and representation five senses - Google Patents

Abstract

The present invention is equipped with an evolving hardware platform and software platform for the next generation personal computer, and an input / output device for a user interface, in order to achieve miniaturization and light weight suitable for a wearable form, and to achieve a loss of essential performance. Essential functions were implemented on the wearable computer, and additional functions and supplements of instincts were implemented on the smart gate, which is a belt type wearing form.

Five senses, computer, watch computer, belt gateway

Description

Personal Computer System Suitable To Integration and Representation Five Senses             

1 is a functional block diagram of a next-generation personal computer capable of fusing and reproducing five senses information according to the present invention.

2 is a diagram showing an example of a central processing unit that can be employed in the next generation personal computer that can fuse and reproduce the five senses information according to the present invention.

3 is a flowchart of visual information recognition in a next-generation personal computer capable of fusing and reproducing five senses information according to the present invention.

4 is a flow diagram of auditory information recognition in a next-generation personal computer capable of fusing and reproducing the five senses information according to the present invention.

5 is a flow chart of recognition of rear / taste information in a next-generation personal computer capable of fusing and reproducing five senses information according to the present invention.

6 is a flow chart of tactile information recognition in a next generation personal computer capable of fusing and reproducing the five senses information according to the present invention.

7 is a configuration diagram of a distributed environment recognition system using a next-generation personal computer capable of fusing and reproducing five senses information according to the present invention.

8 is an overall configuration diagram including a smart gate for the practical use of the next generation personal computer fusion and reproduction of the five senses information according to the present invention.

<Explanation of symbols for the main parts of the drawings>

100: central processing unit 110: internal connection

120: external connection 130: expansion connection

140: memory interface 150: multimedia accelerator

160: system control unit 170: standard system input and output unit

180: user interface 190: multimedia interface

710: next generation personal computer 720: distributed recognition server

730: after / beauty / touch / sight / hearing device

The present invention relates to a wearable next-generation personal computer, and more particularly, to a next-generation personal computer system capable of expressing and recognizing five senses information and reconciling and reproducing wearable five senses information.

Recently, digital devices have been pursuing miniaturization and lightening of each component with the goal of wearable and portable form in order to pursue the convenience of the user, and various models have been developed. There is no system that adopts a platform structure that can express perceptions and feelings.

In addition, in the case of a portable computer that is developed as a wearable type, it is a situation where omission of essential functions and loss of performance are required for miniaturization and light weight.

Accordingly, there is a demand for development of a next-generation personal computer system that adopts a platform structure capable of recognizing and expressing the five senses information as a wearable form without exhibiting essential functions.

Accordingly, the present invention has been developed to meet the above-described demands of the prior art, and has an object of providing a next-generation personal computer system capable of recognizing and expressing the five senses information and wearing and reproducing the five senses information. .

Wearable personal computer according to the present invention for achieving the object, an internal connection for providing a bus for the connection between the respective internal components, and an external connection for providing a connection for connecting to external devices, systems Expansion connector for function expansion, central processing unit that manages the whole system such as operation and control, and functions such as memory allocation, memory control and storage area used for program operation and control on the system. A memory interface unit, a multimedia accelerator unit for smoothly performing multimedia functions on the system, a system control unit for managing the clock, debugging, and booting of the system, a standard system input / output unit for managing the standard input / output of the system, User interface that controls the input / output function of user commands Comprising a multimedia interface for providing an interface, and the five senses information through the interworking between the external connection, the expansion connection, the user interface and the multimedia interface, and the five senses recognition devices of the sense of sight / hearing / taste / smell / tactile It is configured to enable efficient recognition and expression of.

The computer further comprises a Bluetooth module for wireless communication with the outside, and complements the function and collects the five sense information collected by the five sense recognition apparatuses by using a server disposed at a position accessible for communication through the Bluetooth module. Distributed perception.

Here, as an algorithm for recognizing the collected image information from the visual apparatus, after extracting the outline of the necessary portion for recognition, only the extracted data of the image information is transmitted to the server to perform distributed recognition.

In addition, when performing the recognition function of the after / taste information, can be encoded by the predetermined after / taste element code, it is possible to add or delete the after / taste element code according to the user's purpose, the addition of the after / taste element code Alternatively, the addition / deletion and rearrangement of the after / taste sensor for efficient decomposition of odor information according to the deletion may be varied, and the type and number of the after / taste elements may be arbitrarily set through software setting.

In addition, the post-taste coded element code may be represented by a type and a combination of appropriate elements through the computer presenter.                         

In addition, a signal of a user's finger shape, hand gesture, etc. input to the haptic device is converted into a predefined command set on the computer, and the computer can express everything from simple manipulation to complex text input.

In addition, encoding is performed according to a user's purpose of the information input to the haptic device, and the encoded information can be reproduced by using the tactile expression device.

Preferably, the wearable personal computer is a wrist watch type computer, and the server is a belt wearable smart gate.

Wearable personal computer system according to the present invention for achieving the above object, an internal connection for providing a bus for connection between each of the internal components, an external connection for providing a connection for connecting to external devices, Expansion unit for expanding the function of the system, the central processing unit responsible for managing the entire system such as operation and control, and functions such as memory allocation, memory control and storage area used for program operation and control on the system. A memory interface unit in charge, a multimedia accelerator unit for smoothly executing multimedia functions on the system, a system control unit for managing the clock, debugging, and booting of the system, a standard system input / output unit for managing the standard input / output of the system, User interface unit that manages input / output function of user command, camera It further comprises a multimedia interface for providing an interface of the Bluetooth module for wireless communication with the outside, the external connection, expansion connection, the user interface and the multimedia interface, and visual / audio / taste / olfactory A wearable personal computer configured to enable efficient recognition and expression of the five senses information through interworking between the tactile sense sense devices; The server is disposed at a position where communication can be connected through the Bluetooth module, and includes a server that complements the function of the wearable personal computer and performs distributed recognition on the five sense information collected by the five sense recognition devices.

Hereinafter, with reference to the accompanying drawings will be described in detail with respect to the next generation personal computer system fusion and reproduction of the five senses information according to the present invention.

1 is a functional block diagram of a next generation personal computer (Wearable Personal Station (hereinafter abbreviated as " WPS ")) capable of fusion and reproducing of the five senses information according to the present invention.

In the figure, the central processing unit 100 is responsible for managing the entire system, such as operation and control of the next-generation personal computer (WPS) proposed in the present invention. According to an embodiment of the present invention, a Motorola i.MX1 or i.MX21 chip (see FIG. 2) using an ARM 9 series core processor is used as a central processing unit.

In addition, the internal connection unit 110 is responsible for providing a bus for connection of audio mux, I ² C, SSI, CSPI, and the like. In addition, the external connection unit 120 is responsible for providing a connection to the UART, USB / Host / OTG, IrDA and the like for connecting to the external devices.

In addition, the expansion connection unit 130 is responsible for providing a function such as MMC / SD, PCMCIA / CF to expand the function of the WPS. In addition, the memory interface 150 is responsible for functions such as memory allocation, control, and storage area, which are used for program operation and control on the WPS.

In addition, the multimedia accelerator 150 provides a video processing accelerator, a preprocessor, a post processor, and the like to facilitate providing multimedia functions on the WPS. In addition, the system controller 160 manages the clock, debugging, booting, and the like of the system.

In addition, the standard system input / output unit 170 is responsible for system standard input / output such as GPIO, RTC, and the like. In addition, the user interface 180 manages an input / output function of a user command by providing a display means such as an LCD and an input means such as a keypad.

In addition, the multimedia interface 190 serves as an input / output function of an image by providing an interface between a WPS and a camera proposed in the present invention.

In addition, although not shown in FIG. 1, interlocking of the tactile device for input / output of the user by using the internal connector 110 and the external connector 120 on the WPS, and interworking of the rear / taste recognition / expression apparatus for the expression and recognition The connection of the head mounted display (HMD) and the visual recognition device through the multimedia interface 190 are also possible.

When the HMD is connected to the user interface 180, for example, the WPS interface shown in FIG. 1 may be used, or it may be via an interface via the smart gate shown in FIG. When using the interface via the smart gate as described above, the image information transmission between the WPS and the smart gate uses Bluetooth, and the interface between the smart gate and the HMD is connected using USB, IEEE1394 and wireless LAN, Bluetooth, etc. This is possible.

Next, the flow of visual information recognition in the WPS according to the preferred embodiment of the present invention will be described in detail with reference to FIG. 3.

First, image information is acquired by, for example, a CMOS image sensor (camera) connected through the multimedia interface unit 190 (step S11), and the obtained image information is input to FIG. 1 for real-time image recognition. The multimedia accelerator 150 is shown (step S12). In the case of a general video signal, the amount of data and the computational power for processing the data are high, so the visual recognition function in the WPS of the present invention utilizes a dispersion function. In addition, in order to perform distributed recognition, data transmission to a distributed recognition server (refer to 720 of FIG. 7) installed at a remote location is essential, and in case of image information, a large amount of data is required, and a large amount of time is required for data transmission. do. Therefore, in order to minimize the data transmission time, the present invention uses an algorithm for transmitting only the extracted data after extracting only the data necessary for recognition.

The multimedia accelerator 150 extracts only a portion (that is, a contour portion necessary for recognition) from the transmitted input information (that is, a contour portion necessary for recognition) (step S13), and then extracts the image information extracted by the recognition server for recognition from the external connection unit 120. In step S14, the distributed recognition server (see 720 of FIG. 7) performs recognition using only some information of the received original image (step S15). Thereafter, the distributed recognition server transmits the recognition result to the external connection unit 120 of the WPS (step S16).

On the other hand, distributed recognition of the new concept proposed in the present invention can also be implemented using a smart gate of the belt wearing form shown in FIG. In general distributed recognition, it is customary to take the performance degradation of the client in order to reduce the size and weight of the client side, and to perform a calculation using the communication with the server by setting up a separate server. have. In the case of the server for distributed recognition proposed in the present invention, not only the client end but also the server may be implemented in a worn form to prevent the problem of distributed recognition / reproduction according to the communication problem between the server and the client.

Next, the flow of auditory information recognition in the WPS according to a preferred embodiment of the present invention will be described in detail with reference to FIG. 4.

Auditory information (voice information) is collected through a microphone connected to the user interface unit 180 (step S21), and the collected voice information is transmitted to the multimedia accelerator 150 through the user interface unit 180 (step S22). ).

The next generation portable computer, WPS, performs a voice information recognition function and provides a user interface. The recognition function of the voice information proposed in the present invention performs recognition in a distributed environment in order to perform a real time recognition function, and the multimedia accelerator 150 requires voice information (that is, energy and average of input voice information) for recognition. After extracting only the voice section in consideration of noise (step S23), the extracted voice information is transmitted to the distributed recognition server (720 of FIG. 7) for recognition through the external connection unit 120 (step S24). The distributed recognition server (see 720 of FIG. 7) performs recognition using only some information of the received original voice (step S25). Thereafter, the distributed recognition server transmits the recognition result to the external connection unit 120 of the WPS (step S26).

Next, with reference to Figure 5 will be described in detail with respect to the after / taste information recognition flow in the WPS according to an embodiment of the present invention.

The rear / taste sensor is connected through the external connection unit 120 shown in FIG. 1, and the rear / taste sensor performs a rear / taste recognition function according to the control of the proposed WPS (step S31). The user requests the post / taste function using the microphone connected through the user interface unit 180, and the WPS operates according to the result of the auditory recognition function using the distributed function.

The post / taste recognition function proposed in the present embodiment may classify the input odor signal into a odor element similar to a basic element form, which is predefined, and encode the odor element. Type and number can be added or deleted according to user purpose. In addition, it is possible to select the type and number of odors to be recognized through the replacement of the after / taste sensor and the S / W setting according to the user needs, so as to facilitate the extraction of the odor element input to the after / taste sensor. In addition, the kinds of smells and tastes encoded by the after / taste elements can be expressed by the after / the taste expressor by the kind of the odor elements and the appropriate concentration combination of each element (step S32).

The central processing unit 100 of the WPS collects the after / taste information through the after / taste sensor connected through the external connection unit 120 (step S33), perform the recognition in a distributed environment for the purpose of performing a real-time recognition function In order to transmit the taste information to the distributed recognition server (720 of Fig. 7) through the external connection unit 120 (step S34), the distributed recognition server (see 720 of Fig. 7) is transferred to After receiving / recognition using the taste information (step S35). Thereafter, the distributed recognition server transmits the recognition result to the external connection unit 120 of the WPS, so that the WPS central processing unit 100 receives the recognition result (step S36).

Next, the tactile information recognition flow in the WPS according to the preferred embodiment of the present invention will be described in detail with reference to FIG. 6.

The external connection part 120 shown in FIG. 1 enables interworking with a haptic device, such as a glove device, which performs a tactile recognition function under the control of the proposed WPS. The user can perform a user input function according to his or her intention by naturally moving the worn tactile device (bending a finger, moving a hand, etc.) (step S42). In addition, the input user's hand gestures perform a function of inputting a character such as a keyboard of a computer according to a predetermined encoding method from a simple operation of a portable computer through a series of encoding processes. Recognition function of the tactile information is performed by the central processing unit 100 of the proposed WPS (step S43). In addition, the user's input signal has a tactile basic property such as intensity, direction, and texture according to the user's intention by using a function of an external haptic device such as an armored device, and by using the tactile basic property, Perform encoding according to The coded tactile information is capable of expressing tactile basic properties such as texture using a tactile expression device.

In this way, the recognition result of the tactile sense recognized by the central processing unit 100 is transmitted to the system control unit 160 (step S44), and the system control unit 160 performs the control of the device according to the tactile recognition result ( Step S45).

In order to construct a distributed system recognition system, the preferred embodiment of the present invention implements a wireless communication system using Bluetooth as shown in FIG. 7. The Bluetooth RF module interworked through the external connection unit 120 or the expansion connection unit 130 is a server for the distributed environment according to the instructions of the central processing unit 100 and the system control unit 160 of the proposed next-generation portable computer WPS ( 720) and a communication function.

On the other hand, the central processing unit 100 shown in FIG. 1 is capable of directly interworking with the internal and external devices shown in FIG. 2, and each of the devices is an external device (representation and recognition device of five sense information) as needed. Can be linked with

In addition, the detailed specifications of the software and hardware of the WPS proposed in the present invention are as follows.

In addition, this invention is not limited to the above-mentioned specific Example, It can variously deform and modify in the range which does not deviate from the summary of this invention, and can be implemented.

According to the present invention, the sensory expression and recognition of the five senses information can be realized through the WPS, and various types of user interfaces for user convenience can be provided.

Claims (19)

It manages the whole system such as internal connection which provides a bus for connection between each internal component, external connection which provides connection for connection with external devices, expansion connection to expand the function of the system, operation and control, etc. A central processing unit that plays a role of a controller, a memory interface unit that performs functions such as memory allocation, memory control, and storage area used for program operation and control on a system, and a multimedia for smoothly performing a multimedia function on a system. Provides the accelerator unit, the system control unit that manages the clock, debugging and booting of the system, the standard system input / output unit that manages the standard input / output of the system, the user interface unit that manages the input / output function of the user command, and the interface with the camera. Configured to include a multimedia interface for Become, Wearing, characterized in that configured to enable efficient recognition and expression of the five senses information through the interworking between the external connection, the expansion connection, the user interface and the multimedia interface, and the five senses of the sense / sense / sense / olfactory / tactile device Expression personal computer. The method of claim 1, The central processing unit is a wearable personal computer, characterized in that using an ARM series core processor, I.MX21 or I.MX1 chip. The method of claim 1, It is configured to further include a Bluetooth module for wireless communication with the outside, Wearable personal computer, characterized in that for supplementing the function and distributed recognition of the five senses information collected by the five senses recognition device using a server disposed in a position that can be connected to the communication via the Bluetooth module. The method of claim 3, wherein Wearable individual characterized in that the algorithm for recognizing the collected image information from the visual device, after extracting the contour of the necessary portion for recognition, and transmitting only the data of the extracted image information to the server to perform distributed recognition computer. The method of claim 3, wherein When performing the recognition function of the after / taste information, it is possible to encode the predetermined after / taste element code, the addition or deletion of the after / taste element code according to the user's purpose, the addition or deletion of the after / taste element code Wearable personal computer, characterized in that the addition / deletion of the after / taste sensor for the efficient decomposition of odor information according to the, and the arrangement can be changed, and the type and number of the after / taste elements can be arbitrarily set through the setting of the software . In 5, The wearable personal computer of the post-taste coded element code may be represented by a type and a combination of appropriate elements through a presenter on the computer. The method of claim 3, wherein The wearable individual, which converts a signal of a user's finger shape, hand gesture, etc. inputted into the haptic device into a predefined command set on the computer, and can express a simple character input to a complex text input. computer. The method of claim 3, wherein Wearing personal computer characterized in that for performing the encoding according to the user purpose of the information input to the haptic device, the encoded information can be reproduced by using the tactile expression device. The method according to any one of claims 3 to 8, The wearable personal computer is a wrist watch type computer, and the server for distributed recognition and representation is a wearable personal computer, characterized in that the belt wear smart gate. It manages the whole system such as internal connection which provides a bus for connection between each internal component, external connection which provides connection for connection with external devices, expansion connection to expand the function of the system, operation and control, etc. A central processing unit that plays a role of a controller, a memory interface unit that performs functions such as memory allocation, memory control, and storage area used for program operation and control on a system, and a multimedia for smoothly performing a multimedia function on a system. Provides the accelerator unit, the system control unit that manages the clock, debugging and booting of the system, the standard system input / output unit that manages the standard input / output of the system, the user interface unit that manages the input / output function of the user command, and the interface with the camera. Multimedia interface part to do, and nothing with the outside It is further comprising: a Bluetooth module for communication, Wearable personal computer configured to enable efficient recognition and expression of the five senses information through the interworking between the external connection, expansion connection, the user interface unit and the multimedia interface unit, visual, auditory, taste, olfactory / tactile sense devices; ; The server is disposed at a position where communication can be connected through the Bluetooth module, and includes a server that supplements a function of the wearable personal computer and performs distributed recognition on the five sense information collected by the five sense recognition devices. Wearable personal computer system. The method of claim 10, The central processing unit is a wearable personal computer system, characterized in that using the ARM series core processor, I.MX21 or I.MX1 chip. The method of claim 10, Wearable individual characterized in that the algorithm for recognizing the collected image information from the visual device, after extracting the contour of the necessary portion for recognition, and transmitting only the data of the extracted image information to the server to perform distributed recognition Computer system. The method of claim 10, When performing the recognition function of the after / taste information, it is possible to encode the predetermined after / taste element code, the addition or deletion of the after / taste element code according to the user's purpose, the addition or deletion of the after / taste element code Wearable personal computer, characterized in that the addition / deletion of the after / taste sensor for the efficient decomposition of odor information according to the, and the arrangement can be changed, and the type and number of the after / taste elements can be arbitrarily set through the setting of the software system. The method of claim 13, Wearable personal computer system, characterized in that for the post / taste coded element code can be represented through the type and combination of the appropriate element through the presenter on the computer. The method of claim 10, The wearable individual, which converts a signal of a user's finger shape, hand gesture, etc. inputted into the haptic device into a predefined command set on the computer, and can express a simple character input to a complex text input. Computer system. The method of claim 10, And performs encoding according to a user purpose of the information input to the haptic device, wherein the encoded information can be reproduced using a tactile expression device. The method according to any one of claims 10 to 16, The wearable personal computer is a wrist watch type computer, and the server for distributed recognition and representation is a belt wearable smart gate. The method of claim 17, The smart gate is a wearable personal computer system that transmits a user command to the wrist watch-type computer through wireless communication after performing a user input / output control and interface function. The method of claim 17, The smart gate decodes the encoded information, and transmits the result to the wrist watch type computer.

Images