JPH11110125A - Device and method for remote control - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a remote control operation, which does not require not only a power source but also a bulky component such as the main body of remote controller, by adopting a detecting means for detecting a change caused by temporally or spatially and making its operation correspondent to the operation of a switch, continuous manipulator or intermittent manipulator, etc. SOLUTION: In the connection or disconnection of a pair of, or a plurality of objects such as both hands or plural independent objects, a detecting means is adopted for detecting the change caused by the temporal or spatial factor or their combination and making its operation correspondent to the operation of the switch, continuous manipulator or intermittent manipulator. Namely, this device is composed of a dynamic, static or combined index and a detecting means. In this case, equipment for receiving information can send the information to the index by displaying it or can adjust the condition of detection by changing illumination as well. In this case, the frame work of index detection is composed of an information element, information arrangement 3 composed of that element, information support arrangement 4, information block 2 and index detection block 1.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus and a method for easily operating a remote controller such as operating a machine or inputting information.

[0002]

2. Description of the Related Art There is a remote controller for changing a channel of a television.

[0003]

SUMMARY OF THE INVENTION In a conventional remote control,
The remote control body is large, the operation is difficult to understand, and the information transmission means in sign language or the like occurs as communication between humans unrelated to the computer, so that there is a problem that it is difficult to recognize the machine.

[0004]

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and an object of the present invention is to make it easier for machines to recognize sign language between conventional human beings, regardless of age and gender. It is an object of the present invention to provide a remote control device and a remote control device that can recognize and communicate with a simple machine more reliably and more easily.

[0005]

The remote control device of the present invention employs the following technical means. According to the first aspect of the present invention, the remote control device according to the first aspect of the present invention is capable of detecting a change caused by time or space or a combination thereof in a state of connection or disengagement between a pair or a plurality of independent objects such as both hands. Detecting means is employed for detecting the operation and corresponding to an operation of a switch, a continuous operation device, an intermittent operation device, or the like.

According to a second aspect of the present invention, there is provided a remote controller according to the second aspect, wherein an open end of an object having at least one open end, such as a finger, is connected or disengaged in time or space or a combination thereof. In this case, a detection means for responding to the operation of a switch, a continuous operation device, an intermittent operation device, or the like is employed.

[0007] A remote control device according to a third aspect employs a detecting means for detecting a geometric change of the wrinkle due to the visibility of the wrinkle set on the object or the expansion and contraction of the wrinkle.

[0008] The remote control device of the present invention employs a detecting means for detecting a geometric change, an electromagnetic wave change, a trajectory, or any combination thereof of an object.

According to a fifth aspect of the present invention, in the remote control method according to the fifth aspect, when a pair or a plurality of independent objects such as both hands are connected or separated from each other, the time or space or a combination thereof is used. The resulting change, or at least one of the open ends of an object having an open end, such as a finger, is subjected to a coupling state or a disengagement state caused by time, space, or a combination thereof, or a wrinkle set on the object. Any number, shape, length, etc., such as by the geometric change of wrinkles due to the appearance or disappearance, expansion or contraction, etc., or the geometric change of an object, electromagnetic change, trajectory or any combination thereof, etc. A method of performing remote control by size, angle, or a combination thereof is adopted.

[Sixth Aspect] The index detecting device according to the sixth aspect employs a correlation function as a part of the detecting means for detecting the index.

[Seventh Aspect] The index detecting device according to the seventh aspect employs a spatial frequency analyzing means as a part of the detecting means for detecting the index.

[Eighth Aspect] The index detecting apparatus according to the eighth aspect employs a geometric extraction means such as a line segment as a part of the detection means for detecting the index.

[0013]

Effects of the Invention and Effects of the Invention

[Action and Effect of Claim 1] The remote control device according to claim 1 is produced by a temporal or spatial or combination thereof in a state of connection or disengagement between a pair or a plurality of independent objects such as both hands. Detects changes and uses detection means to respond to the operation of switches, continuous actuators, or intermittent actuators, etc., so remote control operations that do not require a bulky object such as the power supply as well as the remote control body are required. It becomes possible. In addition, it can be easily operated regardless of age or gender.

According to a second aspect of the present invention, there is provided a remote control device according to the second aspect, wherein an open end of an object having at least one open end, such as a finger, is connected to a connection state generated by time, space, or a combination thereof. By separating the switch, detection means such as switching, continuous operation, or intermittent operation are adopted, so that remote control operation that does not require a bulky object such as the power supply as well as the remote control body is possible. Become. In addition, it can be easily operated regardless of age or gender. Operation is also possible with one hand.

[Action and Effect of Claim 3] The remote control device of claim 3 employs a detecting means for detecting a visible change of wrinkles set on an object or a geometric change of wrinkles due to expansion and contraction. If the wrinkles of the fingers are used, the remote control body is unnecessary, and information can be transmitted according to the number, shape, length, size, and angle of the wrinkles due to the bending. When an artificial object such as a bellows is used manually or automatically, accurate information can be standardized and transmitted.

[Function and Effect of Claim 4] According to the remote control device of claim 4, a geometric change of an object, an electromagnetic change,
Since a detection means for detecting a trajectory or any combination thereof is employed, even a complicated pattern can be detected, so that an eyelid, a mouth, a beard, a bite, a finger, a wrinkle, a nail, a palm, a blood vessel, a tooth, a tongue, etc. The remote control operation may be performed by detecting various inherent characteristics such as the shape of the object or their movement, and the amount of information is large because various types of indices can be used.

According to the fifth aspect of the present invention, the remote control method according to the fifth aspect of the present invention provides a remote control method in which a pair or a plurality of independent objects such as both hands are connected or separated from each other in terms of time, space, or the like. A change caused by a combination, or an open end of an object having at least one open end, such as a finger, is temporally or spatially, or a combination state or a disengagement state caused by a combination thereof is set or set on an object. Wrinkling of the wrinkles or by the geometric change of the wrinkles due to expansion or contraction, or the geometric change of the object, electromagnetic change, trajectory or,
Since the method of remote control by any number, shape, length, size, angle, or any combination thereof, such as any combination thereof, is adopted, the computer language is changed from machine language to high-level language. Although evolving towards sign, sign language has emerged as communication between humans unrelated to computers. This method is a method for inputting or remotely controlling information on a machine such as a computer.It has a machine language element in a computer language, so it is easy for the machine to recognize it. Communication with machines is simpler, more reliable and easier.

[Function and Effect of Claim 6] The index detecting device according to claim 6 employs a correlation function as a part of the detecting means for detecting the index, so that a complicated index can be easily detected.

[Function and Effect of Claim 7] In the index detecting device of the present invention, the spatial frequency analysis means is used as a part of the detecting means for detecting the index, so that dynamic load such as light spot tracking is used. In some cases, it is not necessary to worry about such processing and spatial positioning.

[Effects and Effects of Claim 8] The index detecting device of claim 8 employs geometric extraction means such as a line segment as a part of the detection means for detecting the index.
Information such as shape, length, size, angle, or a combination thereof can be transmitted.

[0021]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, a remote control device and method according to the present invention will be described based on the embodiment shown in FIGS.

[Configuration of Embodiment] First, a remote control device and method will be disclosed by listing detection means, listing index operation means, and combining them in a timely manner. FIG. 1 is a typical block diagram. It is composed of a dynamic or static index or a combination thereof, and a detecting means. Here, the device that receives the information may put information on the index by displaying or the like, or may adjust the detection condition by changing the illumination. This is the portion indicated by the dotted line. 2 and 3 show the framework of the index detecting means. Although there is a detecting means which can detect the index without using this, it is basically preferable to use it. Here, the framework for index detection includes an information element 6, an information array 3 including the information element 6, an information support array 4 (not necessarily required), an information block 2, and an index detection block 1.

Here, the information element is an image pickup device such as a CCD camera for detecting an index such as a finger as an information element, a memory in which image data is stored, or a signal element on a transmission line. The aggregate is an information array, an information support array into which the information can be inserted, an information block 2 for determining a range of scanning and searching for an index in the information array, and an index detection block 1 for extracting the index. The detection means will be disclosed below focusing on these. Here, each block or each array may be singly or plurally changed in shape, size and number by the control means of FIG.

FIG. 4 shows a method based on a light spot tracking method using a plurality of blocks. The light spot includes not only self light emission but also reflected light emission. The information block and the index detection block have the same range.

The information element is a pixel of an image pickup device (here, a CCD) or a memory corresponding to the pixel, as an information element.
An information array having the elements as an element, that is, a CCD array or a memory array corresponding thereto, and an information block which is a predetermined collection of information elements in the array or including the array is represented by three or more information blocks. Disclosed is a technology that is configured as a block and applies a technology of calculating a light intensity equal to or higher than a reference for each block and tracking a light spot. The index is detected by applying this technique.

That is, as an example, here, four blocks are used.
Light spots were tracked using a circular block (see FIGS. 4 and 2-3) as a segmentation. At this time, in the present invention, a block including all the pixels of the measurement camera and having an area larger than the initial value is initialized, and x is the intensity of each block with respect to the light point equal to or larger than the reference value of the initial image, and the movement to each block is performed The coefficient is expressed as X = {(b + d)-(a + c)} K / (a
+ B + c + d), Y = {(c + d)-(a + b)} K
The light spot is tracked using / (a + b + c + d). Here, K may be an appropriate constant and may be increased or decreased as needed with respect to focusing.
Then, the size of the block is reduced while focusing on the light spot in the second image. Here, the size of the block is set to about 0 to several times the total number of pixels to be calculated. This time it was about 4 times. In addition, a threshold value is provided in the block, and only pixels having the threshold value or more can be calculated. This is CC
Based on the pixel clock generated by the D timing controller and the start pulse or the timing pulse such as the reference clock, horizontal and vertical signals, only the pixel data that is equal to or larger than the threshold value is calculated and stored together with the coordinate values in the image, or both processes. Execute. Here, this operation may be executed completely by software.

Here, as shown in FIG. 4, the rate of change of the size of the block may be any rate as long as the light spot can be followed, and may be large or small if the size can be followed. The circle block in FIG. 4 may be formed into an ellipse by pattern matching. Each block may be discrete having a convergence point outside. A block having three independent blocks having information elements linearly and having independent convergence points may be used. Further, three or more independent blocks may be radially provided. It may be developed at an acute angle. Here, vectors V1 and V2 that define the convergence point
May be fixed or may change dynamically.

Then, a spatial position with six degrees of freedom is detected based on the shape and size of the information element in the optical block, which is an information block whose intensity is greater than or equal to the reference value. Here, the shape such as the star shape or the square shape may be detected by the information element shape in the light block formed by the light intensity higher than the reference value. Alternatively, first, a square, polygon, or star block may be defined and the light spot may be traced, and then the shape may be recognized by rotational alignment with six axes. Here, other techniques such as pattern matching and analytical techniques may be used. The shape may be translated as a language by an OCR-like mechanism. Also, approximation and matching may be performed using various expressions such as an N-th order expression (N is an integer of 1 or more), a Taylor series, a McLaughlin series, a Taylor series, and a Fourier series.

8 to 14, a circular index on the back of the hand or an index based on natural characteristics, and a circular index shown in FIG. 4 is an index painted at the center with ink that specifically absorbs or reflects the detected wavelength. The light spot tracking means converges on the basis of a known method. Here, since the index is divided into four wavelengths, each wavelength-corresponding index is rotated with one to three degrees of freedom so that each wavelength-corresponding pixel of the three- or four-divided optical block is maximized, and the sum of the block intensities is obtained. Stop at the position where is the maximum. Of course, if the hand moves, a series of operations will start again.

In the center, the light spot tracking means converges on an index painted with ink that specifically absorbs or reflects the detected wavelength based on a known method. Here, the line divided into four is scanned outward from the center point to measure the interval and the number of intersecting lines. That is, a circular pattern is provided toward the outer periphery, and this number is simply a transmitted number (code). Here, in this pattern, scanning is completed by the scanning line, and “5” is transmitted. This 5 corresponds to a specific control code on the computer, and its function is exhibited.
At this time, the convergence point is set as the scanning start point, but this may be independent.

Here, even if the interval and the number of stripes are given as a code such that the interval of the line segment is binarized in comparison with a preset reference interval, even larger information can be transmitted. Of course, the barcode may be printed in a circular shape like these stripes. In general, barcodes are linear and are effective only for plane-approximate objects in principle. However, a curved surface may be used if the following method is used, and since the present invention is a general-purpose computer input device, a barcode reader or the like is used. No special equipment is needed. In particular, a scanning mechanism using a semiconductor laser is widely used in barcodes, but is unnecessary in the present invention. Here, a method of reading an information transmission factor or code or a method of correcting the information transmitted will be described.
For detecting these line segment intervals, etc., information is extracted by correcting or utilizing deformation due to position. As a method of this extraction and correction;

The outer peripheral shape of the pixel formed by the light having the index located at the center of the spiral scanning method or more than the reference value is obtained. Based on this shape, a line with a value above a certain threshold value and a line with a value below it are scanned in a circular or spiral shape.
The periodic pattern is detected as a binary code. Here, when scanning in a circular shape, the scanning is performed concentrically at intervals with a shape similar to the outer shape of the center index. This interval (various graphic distortions such as the radius of each scanning circle, etc.) is also calculated from the shape change of the center index. The code is scanned by scanning according to the spiral shape.

Reference grating or fringe method By making the carrier a known one with a modulation waveform using fringes denoting a carrier as an index, a change in the index shape due to a change in the position of the indexing object is canceled and the modulation as the index. Information corresponding to the modulation wavelength of the wave may be obtained. It is also good to draw the sine wave of the reference wavelength and the sine wave of the index wavelength, detect the wavelength of the index stripe based on the imaging wave of the reference wave, correct the wavelength change due to the change in position, and obtain the index information. . Here, the reference fringe or the measurement fringe may be located at any position with respect to the index, and the shape may be any geometrical pattern such as a lattice shape or a radial shape. Further, it may be binarized or multi-valued. The measurement fringes may take a beat, generate a new fringe, and measure it. At this time, it may be possible to correct even if the index is inclined by scanning on two lines facing each other. Here, the phase between the indices is changed, and the amount of the phase is used for information transmission. For example, the background noise may be removed by using the fringe scanning method, or the fringe may be shifted by 90 degrees. Is also good. These stripes may be observed through a reference grating.

Method Using Radius-Like Line In a photographed image of the length of a straight line or a group of straight lines corresponding to the radius of a circle drawn from the center point of the circle to the circumference, COS, SIN are determined based on the rotation axis for the deformation. Since the component changes in a separate manner, the changed component may be separated and used as an index as an information transfer factor. Also, in this case, this factor may be used to correct and correct the deformation due to the position of the circle.
After this operation, spiral scanning may be used in combination, or another method may be used.

Method Based on Deformation of Circle The image is taken, the shape of the outer periphery of the circle (often an ellipse) is measured at least at three or more points, and the degree of deformation is observed. Thereby, the code interval is corrected. Alternatively, information is transmitted according to the size and degree of deformation. Also, the long axis and the short axis (anywhere in the case of a circle) are obtained based on the center point of the circle (ellipse), the length and the angle with respect to each axis in the reference coordinate system are obtained, and the spatial position is obtained. Alternatively, the spatial position may be obtained by matching based on the degree of deformation of the circle.

Multiple circle method The center of gravity of two or more circles having the same center is detected by light spot tracking. Thereafter, the intervals between a number of circles are measured radially. Information may be transmitted at this interval, or the circle may be corrected depending on how the interval changes.
This interval may be used for the ID number or the like. Here, a circle whose center is not the same, a circle with a different wavelength, a circle multiplexed with a different wavelength, or the like may be used, or a combination thereof. In this case, the geometric position and dimensions here may be known or unknown, a circle may be given a gradation, or a gradation may be given in multiple steps to further reduce the amount of information.

Here, a button or the like used for the touch panel may be displayed on the display, and the operation may be performed in a non-contact manner.

[Effects of the Embodiment] Use of the present invention as an ID number and a password is further facilitated, and a large amount of information can be drawn in a small area in a multiplex manner, and can be realized by a very simple mechanism. , It is possible to easily transmit complicated information. In addition, by using an index on the surgical glove or skin and using the index, information can be transmitted to non-contact devices such as diagnosis, treatment, and repair devices. In-hospital infection through the information communication device can be prevented. Then, at the depth left, right, up and down positions of the index, it is orthogonal 3
Since the three degrees of freedom of movement or position on the axis and the three degrees of freedom by rotation around the three axes can be easily transmitted, the operability is low, the operability is good, the size is small, and the weight is smaller than that of a conventional three-dimensional mouse. Therefore, it is particularly useful for positioning of a three-dimensional diagnostic image from a tomograph or virtual reality.
It is also possible to transmit sign language to a computer, such as by forming a sign language via a computer, and it is even better to add a vocalization function to a control device such as a computer for these transmission methods. Conventionally, such a device was complicated, expensive and difficult to use, but by using this system in the near future a general-purpose computer will be able to input various information using a conventional keyboard, 2D or 3D mouse, joystick, etc. It is possible without it, and the personal computer becomes more compact accordingly. Further, a device utilizing stripes or the like is advantageous in parallel processing as compared with the scanning method, and can be processed at high speed.

[Second Detecting Means] FIG. 5 shows an information block of the method using the index array detecting method and the vicinity of the index detecting block.

In FIG. 5, the image information 5 of the index is obtained by photographing a self-luminous light spot with a CCD camera, and in the image information, one pixel has an information element 6, the entire screen has an information array 3, and an information block has two information blocks. The range in which the captured image does not exist but has the ability to have the image element is defined as the information support array 1 which is the index detection block. Here, a reflection-type non-light-emitting index may be used. At this time, it is preferable to use index separating means. These are realized by a CCD array and / or a memory array. FIG. 5 is an enlarged view of the periphery of the index, where the information blocks may or may not overlap the information support arrangement. Also, an information support arrangement is not necessary.

Here, the information block 2 is generated in the initial information array to the same size as the CCD screen by the information array generating means. Here, FIGS. 3 and 5 show only one example, and the size position of the information block is an example, and does not represent the initial setting here. Then, scanning is sequentially started from the upper left information element. Here, the information value (threshold) of the index previously measured by the index information array detecting means
Five or more consecutive larger information elements are detected.
5 in FIG. 5 becomes an index information array, and an index is detected.

Here, the index is a circle, but the image is elliptical because it freely moves spatially. In addition, five or more consecutive information elements larger than the information value (threshold) of the previously measured index are set as the detection values, but the number may be at least two or more. Then, the operator may determine the threshold while watching the screen.

[Effect 1 of Embodiment] The index (light spot) tracking apparatus of this embodiment can easily detect an index. Further, there is no detection error due to background noise observed in point detection, and there is no positional variation due to a change in the peak point in the spatial position of the point light source distribution. In addition, the index shape can be detected.

At this point, only detection is performed. Then, the coordinate position detecting means uses the detected coordinate value of the index information array as the center coordinate of the array, and based on the coordinate value, the information block moving means sets the center coordinate of the next information block to move the block. The detection coordinate value is determined by the operator as to how to take the index information array, outside, inside, or a combination thereof, and may be linked to a coordinate value other than the center of the information block. Further, the positional relationship and the position may be freely changed, or may be a fixed relationship and a value.

[Effect 2 of Embodiment] The index (light spot) tracking apparatus of this embodiment can easily and quickly track an index.

Here, the information blocks are changed by ± Xn in the x direction, y
± Ym in the direction. Here, the operator can freely determine Xn and Yn, so that the scanning range becomes smaller and the tracking can be performed at high speed. In this case, Xn and Ym were eight pixels. This number may be weighted by the speed and the acceleration coefficient.

[Effect 3 of Embodiment] The index (light spot) tracking apparatus of the present embodiment can track the index even faster than the effect 2.

[Third Detecting Means] FIG. 6 shows an index detecting block of the method using the correlation function. The case where the detection index is a circular stripe or a multiple circle is disclosed. The multi-circle in FIG. 6 is used as an index to get into an object such as a nail or a finger or to perform ink. Then, data of the same shape is inserted into a memory or the like, and this is used as an index detection block. At this time, the binary code indicated by 7 may be set, or a code such as an analog stripe in which a value is inserted in the portion of 8 may be used. In addition, objects such as eyes, eyelids, wrinkles, palms, blood vessels, and teeth may be used. Then, it comprises an information block generation means for generating an information block and an index detection block for detecting an index. Of course, these may be generated in the information array or the information support array, and may consequently constitute a circuit equivalent to that generated in the information array or the information support array. In the case of parallel approximation with the imaging screen, the index detection block is generated in the information array in consideration of the index and the camera magnification. At this time, information blocks for determining the scanning range are set for all the image data. Then, the index detection block is moved in the information block, and the image data in the index detection block is multiplied by the registered data of the index detection block. At this time, any calculation may be used as long as the calculation specification conforms to the correlation, such as giving or removing an appropriate weight. The number and size of each block such as the index detection block may be any, and the registration data of the index detection block may be fixed or variable. In addition, any combination may be used as long as the correlation between the indices is obtained, such as setting a circular shape as an index and setting a linear code in an index detection block.

Here, when the index detection block matches the index position (in some cases, the index detection block completely matches or incompletely matches due to the spatial displacement of the index), the above calculation result of the index detection block is obtained. Brings the highest value. It is assumed that the coordinates of the index are detected with this maximum value.

At this time, the size of the index detection block may be changed as appropriate by the index detection block changing means,
One or both of the size and the shape of the information block may be changed by the information block changing means. If these are set to be large at the beginning and reduced when the index is found, the speed may be increased.

When moving spatially In many cases, it is possible to separate from the background as a plane approximation. Here, in the index detection block, the index is detected by the above means. Then, the index detection block is changed in six axes and the magnification is changed by the index detection block changing means to maximize the output value of the index detection block. The change pattern at this time is
Any settings may be used as long as the desired detection can be performed. The index detection block data at the time of convergence expresses the position and shape of the index in the image or in the virtual space.
The axis data and the magnification data are data for calculating the spatial position in the real space. Using this data, the location of the metric,
The trajectory may be measured. Various controls may be performed using the position and the trajectory as information.

The index detecting block changing means can be used as a single element or a single element in orthogonal movement, rotation axis, magnification, and the like.
It may consist of any of the composite elements.

Here, the index may be a unique pattern such as a geometric pattern from nails, wrinkles, etc. (a unique pattern on the screen may be used, and even if the pattern is the same, an identification signal such as color is superimposed. It is sufficient if there is an index having the following.

[Effects of Embodiment] Even complex indices can be easily detected. High noise resistance. In addition, since information such as eyelids, mouth, beard, bite, fingers, wrinkles, nails, palms, blood vessels, teeth, tongues, and their movements can be handled, much information can be transmitted.

[Fourth Detecting Means] A method based on contour extraction. The contour is extracted using a differential filter such as Laplacian or Del filter which is a known edge find. As an example, the CC projected on the frame memory
The filter function matrix is executed on the D camera image by the CPU. At this time, if the image data subjected to the edge fineness is further used by another detecting means, the accurate position and shape of the index can be determined.

[Effects of the Embodiment] By using the known contour extraction together with another detecting means of the present invention, the accurate position and shape of the index can be determined.

[Fifth Detecting Means] A method based on frequency analysis. As an example, a method of extracting wrinkles or line segment indicators is disclosed. First, wrinkles or line segments are extracted on the binarized screen. At this time, the threshold value of the binary screen may be manually adjusted, or may be adjusted via feedback means so as to have the largest number of harmonics. The data in the memory in which the image data is stored is two-dimensionally or
Perform a dimensional FFT. At this time, when a line segment exists in the binary image, there are many harmonics and a specific spectrum is often exhibited. Here, an appropriate threshold may be set and inverse Fourier transform may be performed to determine the position of the line segment by screen scanning, or the position may be determined by scanning an initial binary image.

It is also possible to detect a specific frequency, a spectrum, or a combination thereof having a large or small number of harmonic components. Such specific information becomes remote control information. At this time, a multi-valued image may be used if it can be used.

[Effects of Embodiment] Information can be obtained even when an index such as a finger is freely positioned in space. Also, no dynamic and machine-intensive tracking means such as light spot tracking are used.

[Sixth Detecting Means] Line segment method. Detects joint wrinkles as line segments, and their number, shape,
Length, size, angle, etc. are used as indices. Draw a line,
You may use it. As an example, in FIG. 8, the position of the nail is detected using the index attached to the nail or the nail itself as an index. It is preferable to use any one of the first to third detection means. Thereafter, scanning is performed in the direction of wrinkles based on the index, and the number of wrinkles is counted. Alternatively, detection may be performed using a binary image.

[Effects of the Embodiment] The number, shape, length, size, and angle of wrinkles, ie, lines, can be easily changed and the lines can be easily erased because the inherent characteristics can be used. It becomes unnecessary. Also, the amount of information is large. This may be realized using an artificial object such as a bellows.
In this case, accurate information can be standardized and transmitted.

[Index Separation Means] For an index whose wavelength information is slightly different from the others, it may be preferable to use an index separation means from a background or another index due to a difference in wavelength.

Information separated into each wavelength from the left side of FIG. 7 is input. Here, Red, Gre from CCD camera
It is wavelength information of en and Blue. This wavelength range does not need to be particularly R, G, and B, and may be freely set by the user at the time of use.

Here, R is a temporary holding means, and the left is an input, the right is an output, and the output may be singular or plural. Circle +
Is an adder with inputs on the left and outputs on the right. There may be three or more inputs. The triangle / is a division means, where the input at the vertex is the numerator and the input at the base is the denominator. This is sometimes a subtraction. The right side is the output. ＾ n in a square
Is n-th or factorial means, generally | n |> 0, where the left is the input and the right is the output. At times, n may be set to 0 to be used as a reference array for calibration or the like. Further, the outputs of all the arithmetic means can be branched.

First, the amplitude, intensity, size, and the like of the input wavelength-specific information are input to temporary holding means such as a register indicated by R. Paying attention to the flow in the uppermost stage, an information element of a specific wavelength and wavelength range is input to R in the uppermost stage. Then, the adding means adds the amplitude, intensity, and magnitude of the wavelength information other than the information element. The addition information and the information of this information element are divided by a triangle / divider. This output is factored.

Here, if there are m pieces of wavelength information, the number of inputs may be m and the addition may be m−1, or an optimal addition combination may be selected at an appropriate time from the wavelength characteristic of the index. Also, an appropriate amplifying means (× K) or the like may be performed in each of these stages. K may be selected within the range of all real numbers.

Here, needless to say, in combination with the first embodiment, a non-light-emitting index may be detected, and at this time, an information block may or may not be used. However, needless to say, it is possible to extract an index only for a necessary portion at high speed if used.

In addition to wavelength separation such as R, G, and B separation, calculation may be performed for each wavelength to facilitate the detection of the index position. As an example, if the intensity array of a two-dimensional image at each wavelength is RD, GD, and BD, RD / GD + BD
(Similarly for other wavelengths) or RD- (RG + RB) (similarly for other wavelengths). Here, each variable may be multiplied by an appropriate constant. Furthermore, here, before the operation of the information array,
After or during the calculation, the array element may be raised to the nth power to increase the S / N ratio or the like. As an example: 1 W1-W2 2 W1 / W2 3 (W1 * K1) / (W2 * K2 + W3 * K3), 4 (W1 * K11)-(W2 * K22 + W3 * K33) 5 D ^ n W is , Strength, etc. (Voltage, current value, bit,
D represents the calculation result of 1-4, intensity, etc. | N |
> 0 These may be freely combined. {(R * Kr)-(B * Kb + G * Kg)} ^ n {(G * Kg)-(R * Kr + B * Kb)} ^ n {(B * Kb)-(G * Kg + R * Kr)} ^ n {(R * Kr) / (B * Kb + G * Kg)} ^ n {(G * Kg) / (R * Kr + B * Kb)} ^ n {(B * Kb ) / (G * Kg + R * Kr)} ^ n.

The means for facilitating the index detection is an example, and any method may be used as long as the index to be sought is clearly detected. That is, a filter with four or more wavelengths is provided,
Also, a plurality of filters having a narrow band or a wide band may be used, or weights may be given to the filters. In that case, not all calculations for facilitating contrast enhancement or index separation and index detection for all the bands are listed, but any calculation may be used as long as index detection is facilitated. That is, depending on the index, as an example: {(RG) × (RB) × K1-K2 * R｝ ＾ n} (GR) × K3- (BR) × K4｝ ＾ n (B -R * K5) ＾ n In some cases, an index in the angular wavelength range may be obtained, for example, the wavelength characteristics of the index, the background, etc. are taken into account. It is. R, G, and B are information arrays in a predetermined wavelength range such as red, green, and blue. | N |> 0 K1 to K5 are arbitrary constants. Set for each device. Often unnecessary. Here, the above-mentioned index separating means performs the predetermined subtraction or division or both of the information in part or all of at least one or more other information arrays from the information array in part or all of the predetermined wavelength band. A predetermined index may be extracted by performing an operation and raising the resulting value to the nth power (| n |> 0). The nth power is
It may be a factorial. [Effects of Embodiment] The index extraction device of this embodiment can easily detect and track an index that cannot be normally tracked or detected.
It can also be treated as a high S / N and high contrast index similar to a self-luminous light spot. Therefore, the characteristics of an object can be easily tracked and detected without a special device such as a self-luminous light source, a fiber light source, and a reflector.

The above detection means may be used alone or in combination. Using these detecting means, the following remote control operation is supported. The remote control
It is a finger, a stick, or the like, or an index on them, and an active element such as a conventional remote control is often unnecessary.

As an example of the remote control operation shown in FIG. 9, it is preferable to use it to switch channels of a television or the like. That is, the number of fingers corresponds to the number of channels and the like. By operating as shown in the figure, 3 is displayed, and the television or the like displays 3ch. Here, the decimal system may be used, but another n-base system may be used. (N> = 1). Using quinary as an example, one hand places one digit and the other a 2 digit
When used as digits, numbers up to 31 can be entered.
It goes without saying that the number of functions that can be switched increases when the foot is also used.

As an example of the remote control operation in FIG. 10 or FIG. 11, it is preferable to turn on / off the power supply of the electric appliance, but any operation and information input may be used. Merge independent objects, such as both hands. At this time, FIG. 10 or FIG. 11 may be used. Any finger may be combined with any finger. An operation such as On / Off is associated with an operation such as coupling / separation. Here, the coupling and disengagement conditions may be made to correspond to any function and how, for example, if the disengagement condition is performed continuously or intermittently, it can be used for operation of a volume, a slider or the like.

As an example of the remote control operation shown in FIG. 12, there is an example in which a difference in finger angle is made to correspond to functions such as a volume and a slider. Here, the change due to the angle change or the presence or absence of wrinkles may be applied to the operation of the switch. Also, as shown in the figure, the wrinkles of the fingers can be shown and hidden with one finger and information can be transmitted, and the shape, number, length, size,
Information may be transmitted using the change in the angle as an index.

As an example of the remote control operation in FIG. 13, the thumb and the index finger may be formed in a ring shape, and the internal shape thereof may be extracted and used as an index. Alternatively, the degree of coupling and dissociation between fingers may be used. Here, another finger may be used instead of the index finger. This preferably corresponds to an OK button in a dialog box or the like, but may be used for other operations.

As an example of the remote control operation shown in FIG.
This is a case where arms and fingers are crossed to make a cross, which is used as an index. This preferably corresponds to a cancel button such as a dialog box, but may be used for other operations.

[Effects of the Embodiment] The remote control device and method of the present embodiment can easily, simply, and reliably transmit information to a machine. These remote controls are for young and old,
Easy for anyone, regardless of nationality. In addition, if a global standard is adopted, there is no need to create a remote control for each country.

[Modification] In the above embodiment, the pattern by the human finger was used as an index.
Grass or the like may be used as an index. A similar effect may be obtained by using a finger fin of an animal. Further, the processing may be performed in time series. As an example, after 3 is output as shown in the figure, if 5 is output, it means 35. At this time, if the screen shows 3, 5-> 35,
Even better.

In the above embodiment, the machine to be recognized is a computer. However, the machine to be recognized, such as an NC machine or a medical device, is not limited to any operator's freedom.

The sign language patterns are not limited to those presented in the embodiments and modified examples. All sign languages produced according to the machine language sign language guidelines that are easily recognized by machines, which are the guidelines of the present invention, are the same as those of the present invention. It is up to the operator to determine which sign language is associated with which information, but sign language according to the above guidelines is within the scope of the present invention.

Information such as opening / closing of eyelids, arms, feet, mouths, and the like, as well as fingers, triangles, polygons, and polygons may be used alone or in any combination to input information.

Force feedback may be applied.

The S / N ratio improving means by the n-th power or the factorial means may be used anywhere in the signal system.

Generally, the quantization of the amplitude of an image pickup device such as a CCD camera is 8 bits or less.
It may be used to enhance contrast by making it or more, or to provide linear polarization between the index and the camera to facilitate index detection, or by installing a diffraction grating and detecting its diffraction pattern, The index may be easily captured.

Although a CCD is used for the camera, another image pickup device may be used, and at least one camera may be used. It may be set near or far.

A sticker may be attached to the nail to use it as an index. Further, the shape of the nail or the shape of the small nail in the nail may be used as an index and used as a cursor or information input means for character input. A similar effect may be obtained by applying a coating material. The nail may be printed. In addition, the seal here refers to the material or material, from those with adhesive applied to the sheet or from artificial nails, to those that can be temporarily temporarily fixed like a ring, or those to be embedded in the human body like an implant. Any fixing method, temporary fixing method, etc. may be used. In addition, it may be something that is simply written on the skin or glove with ink or a mechanical temporary fixing such as a ring. Furthermore, the information amount may be increased by multiple drawing, printing, and giving the index for each wavelength within a range in which the index can be detected with respect to electromagnetic waves such as ultraviolet, visible, infrared, and radio waves. At this time, five chords can be transmitted by inserting five codes into the nail and designating the layer with the other hand or finger. The same applies to other codes such as alphabets, and may correspond to other information such as operation of an opportunity. Individual recognition may be performed using these codes.

The right forefinger may be used as a position index, the left forefinger or nail or the like may be used as a left mouse button, and the left middle finger may be used as a right mouse button for mouse operation. The operator is free to determine which function of the device that transmits information to which finger or how to operate it on the screen or without display, and there is no particular limitation. In the case of a multi-button mouse, the number of fingers used may be increased by the number of buttons, or all fingers may be used as indices for inputting characters. Alternatively, the mouse button alone may be used as a conventional switch, and the cursor may be moved in the present method.

Here, the characters may be transmitted in the same manner by using finger recognition indices in which the number of lines on the finger and the number of circles are changed without color-coding the individual indices. Hiragana and katakana may also be transmitted, regardless of what function each indicator corresponds to.In addition, all the indicators, such as using all the left and right hands or using only one, may be used. Or may be partially used. Also, an index may be provided on the clothes as shown in FIG. 9. In this case, if this index is discarded for each patient as a seal, hospital-acquired infection can be prevented.

It may correspond to a switch state such that the finger is concealed, or may correspond to a scroll bar or the like which continuously changes the change of the projected area or the shape on the image sensor having the shape. In this case, a feature may be extracted from the image using various differential application filters, FFT, wavelet transform, or the like, and the change may be used as a control signal.
In this case, a change in the spectrum may be used as an index. For example, in the case of a straight line on the image forming plane, a waveform having a value such as 0 (DC or offset value) other than a portion projected on the orthogonal direction is defined as a reference axis. I do. Here, when the straight line described on the skin rotates, the harmonics decrease in the frequency space, so that the angle can be determined by observing the degree. In addition, it is preferable to perform a phase change and a prediction on a time series in the counterclockwise and counterclockwise directions. Alternatively, a two-dimensional Fourier transform may be performed to set a calculation window at at least one or more predetermined points or straight lines or polygons of three or more triangles, and observe an increase or decrease in their harmonics. Or by changing the coordinate values.

Characters or the like may be input corresponding to a predetermined character code or the like by using a change in the position or shape of the index on each finger or both of them. Alternatively, a virtual keyboard may be defined in the space and the correspondence to the position may be measured. In that case, in the above embodiment, one camera was used, but two or more cameras were used as a stereo camera, and the character code corresponding to the virtual key corresponding to the predetermined spatial position was captured by capturing the spatial position of the index. You may. In this case, problems such as arthritis caused by the key load in the conventional keyboard are unlikely to occur. In spatial recognition, approximation values, prediction values, or limiting conditions may be set to simply set an expression at a higher speed, or an exact solution may be used to obtain an accurate spatial position, or may be adjusted to the motion characteristics of the fingers. It may be appropriately selected according to the purpose of use, for example, correction may be given.

In the case of the above embodiment, the photographed image
Although stored as a two-dimensional memory image and the image is provided to the position detecting means, it may be omitted if the processing system does not particularly require a memory such as high speed or parallel processing. If a memory is used, the memory image may be updated momentarily or may be frozen at appropriate times. The light spot tracking method may be a known block forming method or a method using a counter with a threshold. In the case of the counter method, analog processing or digital processing may be used. Further, the light spot tracking block may be of any shape, may be dynamically changed in the number and shape of the blocks, and may be realized by software, hardware, or both. Further, an index may be set for each vertex of the n-gon (n> = 3) to obtain spatial data, or a straight line connecting the center of gravity of the triangle and each vertex may be divided into three straight lines by wavelength. By matching and tracking the blocks, the change in the linear block length and the angle of each linear block may be detected and used as a space transfer factor. The rate of change of the size, angle, and shape of the block may be any change rate as long as the light spot can be followed, and may be any value that is large or small as long as the size, angle, and shape can be followed. Alternatively, it may be matched to the object and changed.

Information such as a detection code may be a binarized periodic pattern or multi-valued. In addition, the period may be read, the intensity may be read, or a specific wavelength such as absorption, reflection, transmission, or resonance of an electromagnetic wave, or a combination thereof.

In transmitting information by at least one area of at least separable color such as RGB, the pixel may be counted by a color (wavelength) counter with a threshold and information may be transmitted by the absolute number or relative number. good. For example, for a joystick in four directions, four divided color blocks are set as shown in FIG. Here, 4 colors are a area A
(Reflection, absorption or transmission at λ1 wavelength), B
(Reflection, absorption or transmission at λ2 wavelength), C (λ3
Wavelength (reflection or absorption or transmission at wavelength) and D (reflection or absorption or transmission at λ4 wavelength). Here, the color is not only a visible color. Then, a predetermined threshold value is set to a value which is not affected by noise and can count each color. Then, these colors are counted, and joystick information in four directions is obtained based on the ratio. That is, if the color having the largest color or the total amplitude is the color A, the joystick information corresponding to A is set. On the other hand, in the case of the joystick of the vector synthesis instruction type, the transmission information is obtained by synthesizing the ratio of four colors. The representation of this information is up to the operator. As an example, the number of information elements of A, B, C, and D or their amplitude values are CA, CB, CC, and CD, and X of CX is A, B,
If C and D, each ratio is CX / (CA + CB + CC + C
D) or the like, and this may be used as joystick information. This formula is merely an example, and a weighting factor, a change coefficient based on speed and acceleration, or a feedback coefficient based on various data such as game contents may be used. As a result, operability exceeding that of a joystick-like input device can be performed without contact and easily.

In order to facilitate image detection, the index may be provided with more contrast by using illumination such as auxiliary light, or a background color such as an auxiliary color, an opposite color, or a similar color with respect to the index background. Alternatively, the background illumination may be controlled to make it easier to detect the index. In this case, the background color may be similar to the hand or the glove, or may be similar to the index attachment portion. In this case, since a simple composition of the index and the background is obtained, it is easy to catch only the index by a simple operation. Also, colors similar to the index, opposite colors, black, white, and the like may be used. In this case, a large contrast is generated between the mounting position of the index and the living body index and the background, and this can be used as an auxiliary for the position detection of the index. In this case, the index and index type,
Furthermore, since the contrast differs greatly in the background, it is easy to recognize the pattern. Alternatively, the image may be inverted to make the image negative so that the index can be easily detected.

Generally, the quantization in the amplitude of an image pickup device such as a CCD camera is 8 bits or less.
It may be used to enhance contrast by making it or more, or to provide linear polarization between the index and the camera to facilitate index detection, or by installing a diffraction grating and detecting its diffraction pattern, The index may be easily captured.

The shape of the index may be a characteristic geometric shape or pattern such as a sphere, a circle, or an N-gon for facilitating image detection or detecting a spatial position and characteristic change. One or more sharp linear designs may be formed on the index, or a suitable icon-like pattern may be applied. When decoding the code, the detection code may be a binarized periodic pattern or multi-valued.
The period may be read, the intensity may be read, or a combination of both may be read. Alternatively, the index may be extracted by using a feature detection unit such as a differentiating filter.

The indicator may emit light such as an LED or a self-luminous substance such as fluorescent light or phosphorescent light. It may also be used with lighting.
Further, in the example in which the virtual keyboard is defined in the space, the position of the key of the key code may be distinguished by projecting an image of the virtual keyboard by linear projection with visible light or the like into the space to assist the key operation, and this may be used as a computer. The keyboard may be clearly shown by projecting it on the lid or desk. The projection may be generated by irradiating a slide, a screen, a diffraction grating, or a hologram with various light sources such as a laser and natural light.

A ring-shaped mechanical holder, a pen-shaped object, a surgical glove, a seal, paint, or the like may be used.
Any object such as a shell-shaped covering made by measuring the ecology of fingers and nails in three dimensions and applied to the living body may be used, and is not limited to medical uses such as surgery.
The index on the globe may be any geometric pattern such as a straight line, a curve, a circle, a square, a triangle, and a polygon, and the color or reflection characteristics of the radiated electromagnetic wave may correspond to any wavelength. Is also good.

In the case of a shell, a living body such as a nail or a finger is taken as an impression, a model is produced, and a shell is produced on the model using wax, resin, etc., and a mold is made based on the model to form a metal, resin, ceramic, or the like. A shell may be prepared by performing casting, polymerization, and firing treatments using a material or the like as a raw material, and this may be used as an index. The resin may be polymerized on the nail and used as an index.
In these cases, wavelength selectivity such as color is provided to react to electromagnetic waves of a specific wavelength during the process, or specific information is formed by a linear, circular, polygonal, or geometrical pattern of a combination thereof. It may be manufactured to correspond.

The illumination to be used may be any illumination as long as the index can be recognized by the imaging means, such as a radio wave of several Hz such as a long wave band to an electromagnetic wave of any wavelength such as X-rays or a medium wave such as a sound wave. May be used.

A small LC chip may be attached and the position may be detected by a plurality of antennas.

A magnetic resonance substance may be attached and the position may be detected by MRI or the like.

The information blocks may be separated, in contact with each other, or may overlap. The convergence point and the scanning point at which the scanning is started may be set at an appropriate position vector from each element or each block, or may be changed every moment. The convergence point of each wavelength and the use information block may be the same, may be independent, or may be partially shared.

For detecting the spatial position of the index, an example of matching by pattern matching may be used, or an analytical method may be used. As an example of matching by pattern matching, first, each side of an n-sided (n> 2) index and the value of each angle are set in a reference space, and the deviation of the spatial position from the imaging value of the index at the top, each side, etc. Matching is possible by using a suitable combination of points such as the intersection of the bisectors, the center of gravity, etc., the length of each side, their angle, etc., and straight lines, straight line groups, curves, curve groups, etc. Since there are infinite matching methods such as combinations, they will not be described here one by one, but any method may be used as long as the same effect can be obtained. Similarly, the spatial position can be determined by detecting the length of the n-side of the imaging index, the length to a feature point such as the center of gravity, or the angle formed by these line segments as an analytical method,
Similar to pattern matching, detection by various geometries is also possible. Similarly, all combinations are infinite, so we will not describe them all individually here, but the same effect can be obtained using any method. I hope I can get it. If the above correction, prediction, approximation, and restriction conditions are added to these calculation methods, the degree of freedom is further increased,
Similarly, any operation may be used as long as the effect is obtained.

The shape of the index, such as a circle, a circle, an ellipse, and a polygon, is not particularly limited by the operator's freedom. The operator can freely determine what to put or write the index on, and may detect and track the inherent characteristics.

A block such as an information block may have any shape such as a circle, an ellipse, and a polygon. In addition, the size may be deformed according to an index such as a light spot, or may be fixed. When deforming, it may be deformed similar to the index form. In this case, since the outer shape of the block indicates the index shape, a specific index may be separated from many indexes using this information.

A plurality of blocks such as information blocks may be used. Also, two or more pixels may be used as one information element, or a plurality or 1 / n (n> 0)
The pixel and the number of information elements may be any combination, such as hitting the pixel. The coordinates of the information element may be any part of the pixel, or the coordinates of the peak may be obtained by estimating from the envelope.

The initial setting of a block such as an information block does not need to be the entire information array as long as the index start position is known. When a large amount of time is required for convergence such as when a large information block is used, whether or not initial convergence has been achieved may be displayed. As an example, when used for a mouse cursor, the color of the cursor is changed between convergence and non-convergence. It is up to the operator to display, hide, or make the information block translucent.

The scanning pattern may be of a raster type, may be any scanning pattern such as spiral, oblique scanning, circular scanning, random scanning, polygon scanning, etc., and its scanning start point may be anywhere in the information block. However, there may be a plurality of starting points.

In the above embodiment, the index information array is linear, but may be used as a free curve or a combination thereof. Also, whether the index information array is continuous or intermittent, *
Any shape may be used as long as an index is detected, such as a type, a + type, and a discrete geometry type. At this time, the index form may be detected based on the form of the index information array. As an example, the degree of deformation of a circle is detected on the vertical axis and the horizontal axis of the + type index information array. Alternatively, the + index information array may be rotated so that the ratio between the major axis and the minor axis is maximized, and the spatial rotation of the index may be detected in accordance with the index. In this way, a specific index may be extracted from many indexes, or the three-dimensional object may be moved in accordance with the movement of the index. This index tracking device may be used as a 2D or 3D mouse, keyboard, touch panel, joystick, or pointer. Further, it may be employed in another index detection block.

Position of the predetermined characteristic of the index or its shape,
An information input device or a method for transmitting information by detecting a change in a number, a size, an angle, a characteristic change due to a change in length or visibility, or a combination thereof may be formed.

Here, an ID code, password information, and the like are registered around the index as at least one or more geometrical codes such as a circle, an ellipse, a triangle, a square, a polygon, and a polygon. It may be detected by scanning.

The index information array detecting means adds, averages, or binarizes (combines) the respective values of the information values such as the information amplitude, intensity, and size of the index information array for index detection. , May be detected. At this time, if the minimum value, the maximum value, the average value, and the like are measured and stored in advance, index detection becomes easier. Further, it may be employed in another index detection block.

The index information array may be at least two, such as two. If the number is small, the processing speed is high. If the number is large, noise is high, the detection error of the index is low, and the recognition rate for the index shape and the spatial position of the index is extremely high. Here, the number of index information arrays may be constant, or the number or shape thereof may be variable. As an example, the convergence condition may be that seven continuous products satisfying a certain threshold or more are satisfied, or the addition value or average value of the index information array may be set by the operator or the convergence condition may be equal to or more than the average value of the information array. good. On the other hand, when the number and the shape of the index information arrays change, the number and length of the arrays exceeding the threshold may be used as the convergence condition, or the length and the number of values exceeding the threshold may be used as the convergence conditions and the number and length may be used as the convergence conditions. It may change. Further, it may be employed in another index detection block.

Although electromagnetic waves in the visible light range such as light spots are used, electromagnetic waves of any wavelength may be used as long as similar processing is possible. Although a CCD is used for the sensor, a coil array, an antenna array, or the like may be used. Alternatively, a plurality of these sensors may be used, or the spatial position of the index may be detected or its shape may be detected using a single camera having a lens with a non-zero angle of view. When detecting the shape, the index may be drawn or attached to the measurement object, or stripes or points from the light source may be projected.

An indicator may be attached to a treatment device such as a handpiece to observe the movement. A supplement or an implant may be manufactured by CAM technology based on such information.

Each unit may be realized by an analog circuit or a digital circuit. Or DSP, C
A circuit in a virtual space by a PU, a coprocessor, or the like may be used. When a frame memory is used, a plurality of planes may be secured and the processing may be performed at high speed by time division. C
A plurality of sensors such as a CD camera may be used, or a plurality of sensors may be used for each wavelength.

The light spot includes not only an object that emits light by itself but also reflected light from a normal substance or the like such that a normal substance that cannot be seen without illumination becomes a light spot. . This is apparent from various calculations based on the point light source distribution in the optical field. A simple example is that an image in which a white marker is placed on a black background and an image in which a luminous body is placed in a dark room have almost the same effect.

The electromagnetic waves used for the index extracting means are ultraviolet rays,
Any wavelength, wavelength range, or combination thereof, such as infrared, visible, and radio waves may be used.

The circuit using the index extracting or separating means is as follows: Ix / (ΣIn−Ix) n = 1 to k I is the information value such as amplitude and intensity n is the number of separation wavelengths Ix is the amplitude and intensity of the index to be separated Information value of. (Here, only one information element portion of the same part is shown, and an appropriate coefficient may be multiplied.) Or {(RG) × (RB) × K1-K2 * R}. ! {(GR) × K3- (BR) × K4}! (BR-K5)! R, G, and B have respective intensities K1 to K5, and an arbitrary coefficient n is an S / N ratio and a contrast improvement number, and in some cases such as | n |> 0, it is adjusted according to the spectrum distribution of the index. The extraction formulas are infinite and do not enumerate everything. In particular, as the factor, the number of separation wavelengths may be provided as many as can clearly detect the characteristics of the spectrum. However, in many cases, the number of separation wavelengths is not so large. Here, the spectrum of the index may be adjusted. Of course, the constant represented by K or the like may be fixed or variable.

The factorial means may change the S / N, contrast, and the like as indices. Instead of the factorial, the nth power may be adopted. Each factor of the factorial may be weighted, and x! / Y! In the case of, if xy> 0, any operation method may be adopted as long as a similar effect is obtained, such as omitting the operation below y. These calculations may be performed by hardware or may be performed by software. As an example, two planes are set as an information array in a frame memory, pixels are used as information elements, and a captured image is first held in one plane by pixels having the same coordinates (FIG. 4).
R). Then, a predetermined addition is performed on the other planes (+ mechanism in FIG. 4) by the memory operation function of the CPU.
After this, the CPU performs a predetermined operation on the two pieces of plane information (/-in FIG. 3) and stores the result in one of the planes. Based on this result, index extraction or screen display is performed. At this time, if the information block is used, it goes without saying that high-speed processing can be performed.

Using such information, a 2D or 3D mouse may be realized, virtual reality objects may be freely moved in a virtual space, or used as a joystick, touch panel, or keyboard. good.

The above embodiments or modifications may be implemented alone or in combination.

[0123]

[Brief description of the drawings]

FIG. 1 is a block diagram of a remote control device.

FIG. 2 is an example of a framework for index extraction.

FIG. 3 is an example of a detection unit.

FIG. 4 is an example of a detection unit.

FIG. 5 shows an example of a detecting means.

FIG. 6 shows an example of a detecting unit.

FIG. 7 shows an example of an index separating or extracting means.

FIG. 8 is an example of an index.

FIG. 9 is an example of an index.

FIG. 10 shows an example of an index.

FIG. 11 shows an example of an index.

FIG. 12 shows an example of an index.

FIG. 13 shows an example of an index.

FIG. 14 is an example of an index.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Index detection block 2 Information block 3 Information array 4 Information support array 5 Example of index 6 Information element 7 Code or information for correlation 8 Mark for explaining continuous value

Claims (8)

[Claims] In a combined state or a separated state of a pair or a plurality of independent objects such as both hands, a change caused by its temporal or spatial or combination thereof is detected, and its operation is determined by a switch, Continuous actuator or
A remote control device including detection means for responding to operations of an intermittent operation device and the like. 2. The method according to claim 1, wherein at least one of the objects has an open end, such as a finger.
A remote control device including detection means for responding to operations of a switch, a continuous operation device, an intermittent operation device, and the like by performing a connection state or a separation state generated by the combination. 3. The appearance or hiding of wrinkles set on an object, or
A remote control device including a detection unit that detects a geometric change of wrinkles due to expansion and contraction. 4. A remote control device comprising a detection means for detecting a geometric change, an electromagnetic change, a trajectory, or any combination thereof of an object. 5. A change caused by time or space or a combination thereof in a coupled state or a separated state between a pair or a plurality of independent objects such as both hands, or at least one of fingers or the like is an open end. The open end of an object with
By performing the combined state or the disengagement state caused by the combination, or by the appearance or disappearance of wrinkles set on the object, by the geometric change of wrinkles due to expansion and contraction, or
Any number, such as a geometric change of an object, an electromagnetic change, a trajectory, or any combination thereof;
Remote control by shape, length, size, angle, or a combination. 6. An index detecting apparatus having a correlation function as a part of detecting means for detecting an index. 7. An index detecting apparatus comprising a spatial frequency analyzing means as a part of detecting means for detecting an index. 8. An index detection device comprising a part of a detection means for detecting an index, which is provided with a geometric extraction means such as a line segment.