[go: up one dir, main page]

CN103327317B - Optical communication transmitting and receiving apparatus and method, and optical communication system and method - Google Patents

Optical communication transmitting and receiving apparatus and method, and optical communication system and method Download PDF

Info

Publication number
CN103327317B
CN103327317B CN201210561820.9A CN201210561820A CN103327317B CN 103327317 B CN103327317 B CN 103327317B CN 201210561820 A CN201210561820 A CN 201210561820A CN 103327317 B CN103327317 B CN 103327317B
Authority
CN
China
Prior art keywords
patterns
light
roi
optical communication
measurements
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201210561820.9A
Other languages
Chinese (zh)
Other versions
CN103327317A (en
Inventor
陈佳蘋
萧昌龙
陈仁智
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial Technology Research Institute ITRI
Original Assignee
Industrial Technology Research Institute ITRI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/671,085 external-priority patent/US9450671B2/en
Application filed by Industrial Technology Research Institute ITRI filed Critical Industrial Technology Research Institute ITRI
Publication of CN103327317A publication Critical patent/CN103327317A/en
Application granted granted Critical
Publication of CN103327317B publication Critical patent/CN103327317B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Optical Communication System (AREA)

Abstract

本发明提供了一种光通信传送和接收装置和方法及光通信系统和方法。根据一实施例,一光通信系统包含一传送装置及一接收装置。此传送装置产生光的一或多个图样来决定至少一参考区域,并且通过此一或多个图样所决定的此至少一参考区域中发射光来传送信号。此接收装置采取比一感测图像中一像素总量较少量的测量来侦测光的此一或多个图样,并且根据一或多个侦测到的图样来决定至少一兴趣区域,然后使用此至少一兴趣区域中光的所有信号来处理光通信,并且采取比至少一追踪区域中一像素总量较少量的测量来追踪由此传送装置发射的光的此一或多个图样。

The present invention provides an optical communication transmission and receiving device and method and an optical communication system and method. According to one embodiment, an optical communication system includes a transmitting device and a receiving device. The transmitting device generates one or more patterns of light to determine at least one reference area, and transmits a signal by emitting light in the at least one reference area determined by the one or more patterns. The receiving device takes a smaller number of measurements than the total amount of a pixel in a sensing image to detect the one or more patterns of light, and determines at least one region of interest based on the one or more detected patterns, and then uses all signals of light in the at least one region of interest to process optical communications, and takes a smaller number of measurements than the total amount of a pixel in at least one tracking area to track the one or more patterns of light emitted by the transmitting device.

Description

光通信传送和接收装置和方法及光通信系统和方法Optical communication transmission and reception device and method, and optical communication system and method

技术领域technical field

本发明是关于一种光通信传送和接收装置与方法及光通信系统与方法。The invention relates to an optical communication transmission and reception device and method, and an optical communication system and method.

背景技术Background technique

光通信是一种使用光来完成通信的无线通信技术,其中光可以是由一或多个光二极管(photo diode)、或一图像传感器来感测。例如,光可以是,但不限于,X-射线、紫外光(ultra-violet light)、可见光(visible light)、或从109Hz至1019Hz的频率范围内的红外线(infrared)。无线电波(RF)的带宽是一种珍贵的资源。所以,光通信可以提供一种满足强劲需求的无线通信的替代技术。例如,从一或多个发光二极管(LED)发出的可见光在家庭和办公室中被广泛使用,因此它使得从一或多个LEDs发出的可见光足以适用于无处不在的数据传送器(data transmitter)。相机已经普遍使用于手机、笔记本计算机、以及许多手持式电子设备。因此图像传感器不仅可作为一输入图像侦测器(incoming image detector),也可以作为可见光通信(Visible Light Communication,VLC)系统中的接收器。图1是使用一LED阵列112和一图像传感器122如高速相机,的光通信系统的一范例示意图。如图1所示,在一传送器110的一编码器114可以执行物理层处理(physical layer processing),例如错误修正编码(error-correctionencoding)、调制(modulation)、正交频分复用调制(OFDM)等。在一接收器120的一译码器124可以执行编码器114的逆信号处理(inversesignalprocessing)。图2是使用一单一LED 212和一图像传感器222如高速相机,的光通信系统的一范例示意图。Optical communication is a wireless communication technology that uses light to communicate, where the light can be sensed by one or more photo diodes, or an image sensor. For example, the light may be, but not limited to, X-rays, ultra-violet light, visible light, or infrared in the frequency range from 10 9 Hz to 10 19 Hz. Radio wave (RF) bandwidth is a precious resource. Therefore, optical communication can provide an alternative technology to wireless communication that meets strong demand. For example, visible light emitted from one or more light-emitting diodes (LEDs) is widely used in homes and offices, so it makes visible light emitted from one or more LEDs sufficient for ubiquitous data transmitters . Cameras are already commonly used in cell phones, notebook computers, and many handheld electronic devices. Therefore, the image sensor can be used not only as an incoming image detector, but also as a receiver in a visible light communication (Visible Light Communication, VLC) system. FIG. 1 is a schematic diagram of an example of an optical communication system using an LED array 112 and an image sensor 122 such as a high-speed camera. As shown in FIG. 1 , an encoder 114 in a transmitter 110 can perform physical layer processing, such as error-correction encoding, modulation, OFDM modulation ( OFDM) and so on. A decoder 124 at a receiver 120 may perform inverse signal processing of the encoder 114 . FIG. 2 is a schematic diagram of an example of an optical communication system using a single LED 212 and an image sensor 222 such as a high-speed camera.

一图像传感器可以由一阵列的感光单元(photosensite)组成。电荷耦合元件(Charge Coupled Device,CCD)和互补金属氧化物半导体(Complementary Metal-OxideSemiconductor,CMOS)是两种基本类型的数字传感器。一CCD传感器阵列的第一行感光单元被读入于一输出缓存器,再被输送至一放大器(amplifier)和一模拟-数字转换器(ADC)。在第一行被读出之后,它从读出的缓存器被倾倒出来,并且此阵列的下一行感光单元被读入于此缓存器。在CMOS传感器中的每一感光单元有至少三个的晶体管(transistor)。这些晶体管被允许在感光单元做感光处理,并且每一像素/感光单元可以分别被单独存取。在一些现有的光通信技术中,在此两种类型的任一种图像传感器中,只有一或少数几个共享的ADCs被用于感测图像中的所有像素。An image sensor may consist of an array of photosensites. Charge Coupled Device (CCD) and Complementary Metal-Oxide Semiconductor (CMOS) are two basic types of digital sensors. The photosensitive cells of the first row of a CCD sensor array are read into an output buffer, and then sent to an amplifier (amplifier) and an analog-to-digital converter (ADC). After the first row is read, it is dumped from the read buffer, and the next row of photosensitive cells of the array is read into the buffer. Each photosensitive unit in a CMOS sensor has at least three transistors. These transistors are allowed to do photosensitive processing in the photosensitive unit, and each pixel/photosensitive unit can be accessed individually. In some existing optical communication technologies, only one or a few shared ADCs are used to sense all pixels in an image in either of these two types of image sensors.

图3是一可见光通信技术的一范例示意图。在图3中,一感测图像(sensed image)中非兴趣区域(non-interested region)的像素在一接收器320中的图像传感器也由共享ADC取样,然后被接收器320中的一接收器(Rx)-基频处理单元(baseband processinguint)326丢弃。换句话说,此技术从图像传感器322采取拍摄的所有像素,并且使用一亮度变化侦测(luminance change detection)来侦测兴趣区域(Region Of Interest,ROI)。采取图像中所有像素可能会限制最高可达每秒几百张画面的画面速率(frame rate)。然而,通常用于无线通信的数据速率(data rate)要求是每秒10M至1G位。FIG. 3 is a schematic diagram of an example of a visible light communication technology. In FIG. 3 , the pixels of the non-interested region in a sensed image (sensed image) are also sampled by the shared ADC in the image sensor in a receiver 320, and are then sampled by a receiver in the receiver 320 (Rx) - baseband processing unit (baseband processing unit) 326 discards. In other words, this technique takes all the captured pixels from the image sensor 322 and uses a luminance change detection to detect the Region Of Interest (ROI). Taking all the pixels in an image may limit frame rates up to a few hundred frames per second. However, the typical data rate requirement for wireless communication is 10M to 1G bits per second.

图4是一可见光通信技术的另一范例示意图。在图4的可见光通信系统中,一传送器400有一调制电路(modulation circuit)410以及一光发射驱动电路(light-emittingdrive circuit)420。调制电路410产生不同的调制信号412。光发射驱动电路420根据从调制电路410输出的调制信号412并作为一驱动信号421,来驱动一发光元件422。当驱动信号421保持在一高电平时,光发射驱动电路420使得发光元件422发出与信号402迭加的可见光440。当驱动信号421保持在一低电平时,光发射驱动电路420使得发光元件422不发光。FIG. 4 is another schematic diagram of a visible light communication technology. In the VLC system shown in FIG. 4 , a transmitter 400 has a modulation circuit 410 and a light-emitting drive circuit 420 . The modulation circuit 410 generates a different modulation signal 412 . The light emission driving circuit 420 drives a light emitting element 422 according to the modulation signal 412 output from the modulation circuit 410 as a driving signal 421 . When the driving signal 421 is kept at a high level, the light emitting driving circuit 420 makes the light emitting element 422 emit visible light 440 superimposed on the signal 402 . When the driving signal 421 is kept at a low level, the light emission driving circuit 420 makes the light emitting element 422 not emit light.

光通信对于全球无线频谱短缺仍然是一个潜在的解决方案。可见光通信技术的各种解决方案已被提出。通常,光发射元件如LED,和图像传感器如相机,都是可见光通信解决方案的现存元件。然而,LED的频率响应具有低的带宽,并且图像传感器因为共享ADC而具有低的画面速率。因此,对于可见光通信的高数据传输率(high data transmission rate)的解决方案仍然存在很多的挑战。Optical communication remains a potential solution to the global wireless spectrum shortage. Various solutions for visible light communication technology have been proposed. Typically, light-emitting elements such as LEDs, and image sensors such as cameras, are existing components of VLC solutions. However, the frequency response of the LED has a low bandwidth, and the image sensor has a low frame rate due to the shared ADC. Therefore, there are still many challenges for the solution of high data transmission rate of visible light communication.

发明内容Contents of the invention

本发明实施例提供一种光通信传送和接收装置与方法及光通信系统与方法。Embodiments of the present invention provide an optical communication transmission and reception device and method, and an optical communication system and method.

本发明的一实施例是关于一种光通信的传送装置,此传送装置可包含一图样产生单元,被配置为产生一或多个图样,来决定至少一或多个参考区域;一光通信(LC)控制单元,连接到一传送器-基频处理单元,并且此LC控制单元从此传送器-基频处理单元或从此图样产生单元来选择其输入;以及一发光元件,从此一或多个图样或此一或多个图样决定的此一或多个参考区域中发射光。An embodiment of the present invention relates to a transmission device for optical communication. The transmission device may include a pattern generating unit configured to generate one or more patterns to determine at least one or more reference areas; an optical communication ( LC) control unit connected to a transmitter-baseband processing unit, and the LC control unit selects its input from the transmitter-baseband processing unit or from the pattern generation unit; and a light emitting element from which one or more pattern Or emit light in the one or more reference areas determined by the one or more patterns.

本发明的另一实施例是关于一种光通信的传送方法,此传送方法可包含:经由使用一发光元件,在至少一周期的期间,传送一或多个图样来决定一或多个参考区域;以及使用此发光元件,通过从此一或多个图样决定的一或多个参考区域中发射光来传送数据。Another embodiment of the present invention relates to a transmission method of optical communication. The transmission method may include: determining one or more reference regions by transmitting one or more patterns during at least one cycle by using a light emitting element and using the light emitting element to transmit data by emitting light in one or more reference areas determined by the one or more patterns.

本发明的又一实施例是关于一种光通信的接收装置,此接收装置可包含一兴趣区域(ROI)决定单元、一图像感测元件(image sensing element)、以及一图像处理单元。此ROI决定单元被配置为侦测一感测图像中的光的一或多个图样,并且根据至少一侦测到的图样(detected pattern)来决定此至少一ROI。此图像感测元件被配置为产生此感测图像,并且根据此ROI决定单元产生的一输出来感测光。此图像处理单元在此至少一ROI中,根据此图像感测元件的输出来进行图像处理。Another embodiment of the present invention relates to a receiving device for optical communication. The receiving device may include a region of interest (ROI) determining unit, an image sensing element, and an image processing unit. The ROI determining unit is configured to detect one or more patterns of light in a sensing image, and determine the at least one ROI according to at least one detected pattern. The image sensing element is configured to generate the sensing image, and sense light according to an output generated by the ROI determining unit. The image processing unit performs image processing in the at least one ROI according to the output of the image sensing element.

本发明的又一实施例是关于一种光通信的接收方法,此接收方法可包含:在一获取模式(acquisition mode)下,采用比一图像感测元件的一感测图像的一像素总量较少量的一第一多个测量,来侦测被接收的一或多个图样,并且根据一或多个侦测到的图样来决定至少一ROI;以及在一数据接收模式(data receiving mode)下,使用此至少一ROI中光的所有像素数据来处理光通信。Yet another embodiment of the present invention relates to a receiving method for optical communication, the receiving method may include: in an acquisition mode (acquisition mode), using a total amount of pixels compared to a sensing image of an image sensing element a lesser amount of a first plurality of measurements to detect the received one or more patterns, and determine at least one ROI according to the one or more detected patterns; and in a data receiving mode (data receiving mode ), use all the pixel data of the light in the at least one ROI to process the light communication.

本发明的又一实施例是关于一种光通信系统。此光通信系统包含一传送装置以及一接收装置。此传送装置被配置为产生一或多个图样来决定至少一参考区域,并且通过从此一或多个图样决定的一或多个参考区域中发射光来传送数据。此接收装置被配置为侦测此一或多个图样,并且根据一或多个侦测到的一或多个图样来决定至少一ROI,然后使用此至少一ROI中的光的所有信号来处理光通信。Another embodiment of the present invention relates to an optical communication system. The optical communication system includes a transmitting device and a receiving device. The transmission device is configured to generate one or more patterns to determine at least one reference area, and to transmit data by emitting light in the one or more reference areas determined by the one or more patterns. The receiving device is configured to detect the one or more patterns, and determine at least one ROI based on the one or more detected one or more patterns, and then use all signals of light in the at least one ROI for processing Optical Communication.

本发明的又一实施例是关于一种光通信方法。此方法可包含:在一传送装置中,产生光的一或多个图样来决定至少一参考区域,并且通过从此一或多个图样决定的一或多个参考区域中发射光来传送数据;以及一接收装置中,采用比一感测图像的一像素总量较少量的一第一多个测量,来侦测光的此一或多个图样,并且根据一或多个侦测到的图样来决定至少一ROI,然后使用此至少一ROI中光的所有像素数据来处理光通信。Another embodiment of the present invention relates to an optical communication method. The method may include: in a transmitting device, generating one or more patterns of light to determine at least one reference area, and transmitting data by emitting light in the one or more reference areas determined from the one or more patterns; and In a receiving device, the one or more patterns of light are detected using a first plurality of measurements less than the total number of pixels of a sensed image, and based on the one or more detected patterns to determine at least one ROI, and then use all pixel data of light in the at least one ROI to process light communication.

现配合下列附图、实施例的详细说明及权利要求,将上述及本发明的其他优点详述于后。The above and other advantages of the present invention will be described in detail below in conjunction with the following drawings, detailed description of the embodiments and claims.

附图说明Description of drawings

图1是使用一LED阵列和一图像传感器的光通信系统的一范例示意图。FIG. 1 is an exemplary schematic diagram of an optical communication system using an LED array and an image sensor.

图2是使用一单一LED和一图像传感器的光通信系统的一范例示意图。FIG. 2 is an exemplary schematic diagram of an optical communication system using a single LED and an image sensor.

图3是一可见光通信技术的一范例示意图。FIG. 3 is a schematic diagram of an example of a visible light communication technology.

图4是另一可见光通信技术的一范例示意图。FIG. 4 is an example schematic diagram of another visible light communication technology.

图5是根据本发明一实施例,说明一光通信系统。FIG. 5 illustrates an optical communication system according to an embodiment of the present invention.

图6A是根据本发明一实施例,说明一光通信的传送方法。FIG. 6A illustrates an optical communication transmission method according to an embodiment of the present invention.

图6B是根据本发明一实施例,说明一被传送的图样可以决定一参考区域的一范例示意图。FIG. 6B is a schematic diagram illustrating an example of a transmitted pattern determining a reference area according to an embodiment of the present invention.

图7A是根据本发明一实施例,说明在三个不同时间由一16×16LED阵列发射出三个不同的图样的范例。Fig. 7A illustrates an example of three different patterns emitted by a 16x16 LED array at three different times, according to an embodiment of the present invention.

图7B是根据本发明一实施例,说明一参考区域由多个点状的LEDs来表示。FIG. 7B illustrates a reference area represented by a plurality of dot-shaped LEDs according to an embodiment of the present invention.

图7C是根据本发明一实施例,说明由一LED阵列发射的其他三图样。FIG. 7C illustrates three other patterns emitted by an LED array, according to an embodiment of the present invention.

图8是根据本发明一实施例,说明在五个不同的时间由一单一LED传送器发射的一范例图样。FIG. 8 illustrates an example pattern emitted by a single LED transmitter at five different times, according to an embodiment of the present invention.

图9是根据本发明一实施例,说明多个光源传送图样的另一范例。FIG. 9 illustrates another example of transmission patterns of multiple light sources according to an embodiment of the present invention.

图10是根据本发明一实施例,说明一光通信的接收方法的运作。FIG. 10 illustrates the operation of an optical communication receiving method according to an embodiment of the present invention.

图11A至图11F是根据本发明一实施例,说明一光通信系统的运作流程。11A to 11F illustrate the operation flow of an optical communication system according to an embodiment of the present invention.

图12是根据本发明一实施例,说明一光通信方法。FIG. 12 illustrates an optical communication method according to an embodiment of the present invention.

图13是根据本发明一实施例的,说明在获取模式或追踪模式中侦测一图样的方法。FIG. 13 illustrates a method for detecting a pattern in acquisition mode or tracking mode according to an embodiment of the present invention.

【主要元件符号说明】[Description of main component symbols]

110传送器 112LED阵列110 transmitters 112 LED arrays

114编码器 120接收器114 encoder 120 receiver

122图像传感器 124译码器122 image sensors 124 decoders

212单一LED 222图像传感器212 single LED 222 image sensor

320接收器 322图像传感器320 receiver 322 image sensor

326接收器-基频处理单元326 Receiver - Baseband Processing Unit

400传送器 410调制电路400 transmitter 410 modulation circuit

412调制信号 421驱动信号412 modulation signal 421 drive signal

420光发射驱动电路 422发光元件420 light emitting driving circuit 422 light emitting element

440可见光440 visible light

500光通信系统 510传送装置500 optical communication system 510 transmission device

512图样产生单元 512a一或多个图样512 pattern generation unit 512a one or more patterns

514传送器-基频处理单元 516光通信控制单元514 transmitter - baseband processing unit 516 optical communication control unit

516a一或多个信号 520接收装置516a one or more signal 520 receiving means

517驱动器单元 518发光元件517 driver unit 518 light emitting element

555通道 522图像感测元件555 channels 522 image sensing elements

524兴趣区域决定单元 524a至少一兴趣区域524 area of interest determination unit 524a at least one area of interest

526图像处理单元 528接收器-基频处理单元526 image processing unit 528 receiver - baseband processing unit

610传送一或多个图样,并且形成一或多个形状的图样,来决定一或多个参考区域610 Send one or more patterns, and form one or more shapes of patterns to determine one or more reference regions

615从此一或多个图样决定的一或多个参考区域中发射光来传送数据615 emit light in one or more reference areas determined by the one or more patterns to transmit data

620被传送的图样 625参考区域620 transmitted pattern 625 reference area

T1、T2、T3时间T1, T2, T3 time

a、b、c、d光源a, b, c, d light source

1101、1102、1103图像 1130参考区域1101, 1102, 1103 image 1130 reference area

1140兴趣区域 1160追踪区域1140 Interest Area 1160 Tracking Area

1210产生一或多个光的图样,并且此图样可以形成一或多个的形状来决定的一或多个参考区域1210 generate one or more patterns of light, and this pattern can form one or more reference areas determined by the shape of one or more

1220经由一发光元件在一或多个图样决定的一或多个参考区域中发射光1220 emit light in one or more reference areas determined by one or more patterns through a light emitting element

12301230

获取模式get mode

采取比一感测图像的一像素总量较少量的测量来侦测一或多个光的图样,并且根据一或多个侦测到的图样来决定至少一兴趣区域Detecting one or more patterns of light taking fewer measurements than a total number of pixels of a sensed image, and determining at least one region of interest based on the one or more detected patterns

12401240

数据接收模式data receiving mode

采取此至少一兴趣区域所有的光信号来进行光通信的后续处理Taking all the optical signals of the at least one region of interest for subsequent processing of optical communication

12501250

追踪模式tracking mode

采取比一追踪区域的一像素总量较少量的测量来追踪此发光元件所发射的光的此一或多个图样taking fewer measurements than a total number of pixels in a tracking area to track the one or more patterns of light emitted by the light emitting element

1310将感测图像的所有直线量化为一参数空间1310 Quantize all straight lines of the sensed image into a parameter space

1315推导出一逆转换1315 derives an inverse transformation

1320采取比来自感测图像或来自至少一追踪区域的像素的随机组合的一总量较少量的随机测量1320 taking a lesser number of random measurements than a total amount from a random combination of pixels from the sensed image or from at least one tracking region

1325应用一修正的正交匹配追踪于此少量随机的测量上,以得到此参数空间中此图样的参数1325 apply a modified orthogonal matching pursuit on the small number of random measurements to obtain the parameters of the pattern in the parameter space

1330重复步骤1320和1325,直到达到此图样的一最后画面为止1330 repeats steps 1320 and 1325 until a final frame of the pattern is reached

具体实施方式detailed description

本发明实施例提供一种增加数据传输率(data rate)的光通信技术。此技术侦测光通信的兴趣区域(ROI),大幅地减少在图像传感器中的一或多个共享的ADCs的采样率(sampling rate)。一旦接收器决定此ROI后,此ADC可以只被使用于此兴趣区域中的像素。相比于现有的光通信技术,本发明实施例可以大幅增加画面速率,还可以大幅降低执行光通信的占用时间(acquisition time)。要完成此特征,一传送器可发射一或多个图样的光,而此一或多个图样可以形成一或多种形状,来决定参考区域。此发射光可以是,但不限于,X-射线、紫外光、可见光、或是从109Hz至1019Hz频率范围的红外线。然后,此传送器可以通过从此一或多个图样决定的参考区域中发射光,来传送信号。在一接收器中,可采取比一传感图像的一像素总量较少量的测量,来侦测此传送器发射的光的一或多个图样。测量可以包括此感测图像中的像素的随机组合。一旦此接收器根据侦测到的此一或多个图样,决定出此感测图像的兴趣区域,此接收器可采用此兴趣区域中所有的信号来进行光通信的处理。Embodiments of the present invention provide an optical communication technology that increases a data transmission rate (data rate). This technique detects optical regions of interest (ROIs) and drastically reduces the sampling rate of one or more shared ADCs in the image sensor. Once the receiver determines the ROI, the ADC can only be used for pixels in the region of interest. Compared with the existing optical communication technology, the embodiment of the present invention can greatly increase the frame rate, and can also greatly reduce the acquisition time for performing optical communication. To accomplish this feature, a transmitter can emit light in one or more patterns, and the one or more patterns can form one or more shapes to determine the reference area. The emitted light can be, but is not limited to, X-rays, ultraviolet light, visible light, or infrared light in the frequency range from 10 9 Hz to 10 19 Hz. The transmitter can then transmit a signal by emitting light in the reference area determined by the one or more patterns. In a receiver, fewer measurements than the total number of a pixel of a sensory image may be taken to detect one or more patterns of light emitted by the transmitter. Measurements may include random combinations of pixels in this sensed image. Once the receiver determines the ROI of the sensing image based on the detected one or more patterns, the receiver can use all the signals in the ROI for optical communication processing.

图5是根据本发明的一实施例的一光通信系统。如图5所示,此光通信系统500可包含一传送装置510以及一接收装置520。在传送装置510中,一图样产生单元512可以被配置为产生一或多个图样512a,并且图样512a可以形成一或多个形状来决定一或多个参考区域;一发光元件518可以在一或多个图样512a所决定的一或多个参考区域中发射光;以及一光通信(LC)控制单元516连接到一传送器-基频处理单元514。此发光元件可以是,但不限于,一单一LED或一LED阵列。此LC控制单元516可从此传送器-基频处理单元514、或从此图样产生单元512,来选择它的输入。连接到光通信(LC)控制单元516的传送器-基频处理单元514可执行无线通信的一多个基频运作,如错误修正编码、交错(interleaving)、调制、IFFT等。当传送装置510在一数据传送期间时,则从传送器-基频处理单元514选择此LC控制单元516的输入。当此传送装置是在一参考区域指示期间(reference region indicationperiod)时,则从图样产生单元512选择此LC控制单元516的输入。一驱动器单元517,例如一LED驱动器,可将LC控制单元516产生的一或多个信号516a的每一信号,作为一AC电流或电压,附加于发光元件518的一个直流(DC)偏压,并且可驱动此发光元件518在一或多个图样512a所决定的一或多个参考区域中发射光。FIG. 5 is an optical communication system according to an embodiment of the present invention. As shown in FIG. 5 , the optical communication system 500 may include a transmitting device 510 and a receiving device 520 . In the transmission device 510, a pattern generation unit 512 can be configured to generate one or more patterns 512a, and the patterns 512a can form one or more shapes to determine one or more reference regions; a light emitting element 518 can be in one or more emit light in one or more reference regions determined by the plurality of patterns 512 a ; and an optical communication (LC) control unit 516 connected to a transmitter-baseband processing unit 514 . The light emitting element can be, but not limited to, a single LED or an LED array. The LC control unit 516 can select its input from the transmitter-baseband processing unit 514 or from the pattern generation unit 512 . The transmitter-baseband processing unit 514 connected to the optical communication (LC) control unit 516 can perform a plurality of baseband operations for wireless communication, such as error correction coding, interleaving, modulation, IFFT, etc. The input of the LC control unit 516 is selected from the transmitter-baseband processing unit 514 when the transmitting device 510 is in a data transmission period. The input of the LC control unit 516 is selected from the pattern generating unit 512 when the transmitting device is in a reference region indication period. A driver unit 517, such as an LED driver, may apply each of the one or more signals 516a generated by the LC control unit 516 as an AC current or voltage to a direct current (DC) bias of the light emitting element 518, And the light emitting element 518 can be driven to emit light in one or more reference regions determined by one or more patterns 512a.

在此一或多个参考区域中所发射的光经由一通道555传送到接收装置520。在接收装置520中,一图像感测元件522,例如图像传感器,被配置为根据一兴趣区域(ROI)决定单元524产生的输出来感测光;此ROI决定单元524被配置为侦测从传送装置510发射的光的一或多个图样,并根据一或多个侦测到的图样来决定从图像感测元件522的一感测图像的至少一ROI 524a;以及一图像处理单元525根据ROI 524a中图像感测元件522的输出,来执行光通信的处理。此输出可以是,例如RGB至YUV(或YCbCr)、颜色调整、滤波等。此ROI决定单元可采取比感测图像的一像素总量较少量的测量来侦测被收到的光的图样。测量可以包括感测图像中像素的随机组合。图像处理单元525还可以采取比至少一追踪区域的一像素总量较少量的测量,来追踪由此传送装置发射的光的图样。The light emitted in the one or more reference regions is transmitted to the receiving device 520 through a channel 555 . In the receiving device 520, an image sensing element 522, such as an image sensor, is configured to sense light based on the output generated by a region of interest (ROI) determination unit 524; this ROI determination unit 524 is configured to detect one or more patterns of light emitted by the device 510, and determine at least one ROI 524a of a sensed image from the image sensing element 522 based on the one or more detected patterns; and an image processing unit 525 based on the ROI The output of the image sensing element 522 in 524a is used to perform optical communication processing. This output can be, for example, RGB to YUV (or YCbCr), color adjusted, filtered, etc. The ROI determination unit may take fewer measurements than the total number of one pixel of the sensed image to detect the received light pattern. Measurements may include sensing random combinations of pixels in an image. The image processing unit 525 may also take a smaller number of measurements than a total of one pixel of at least one tracking area to track the pattern of light emitted by the delivery device.

接收装置520还可包括连接到图像处理单元526的一接收器-基频处理单元528,来执行基频处理,例如FFT,解调,去交错,错误修正等,以复原收到的数据。The receiving device 520 may further include a receiver-baseband processing unit 528 connected to the image processing unit 526 to perform baseband processing, such as FFT, demodulation, de-interleaving, error correction, etc., to recover the received data.

依此,一光通信方法的运作如下。在一传送装置中,此光通信方法可产生一或多个图样的光,此图样可以形成一或多个形状来决定至少一参考区域;并且在一或多个图样决定的至少一参考区域中发射光来传送数据。并且,在一接收装置中,此光通信方法可采取比一感测图像的一像素总量较少量的测量来侦测光的一或多个图样,并根据一或多个侦测到的一或多个图样来决定此感测图像的至少一ROI,然后采取此至少一ROI中所有的光信号来处理光通信。在此接收装置中,此光通信方法还可以采取比至少一追踪区域的一像素总量较少量的测量来追踪此传送装置发射的光的一或多个图样。此测量可以包括此至少一追踪区域中像素的随机组合。Accordingly, an optical communication method operates as follows. In a transmission device, the optical communication method can generate one or more patterns of light, and the patterns can form one or more shapes to determine at least one reference area; and in the at least one reference area determined by the one or more patterns emit light to transmit data. Also, in a receiving device, the optical communication method may take fewer measurements than the total number of pixels of a sensed image to detect one or more patterns of light, and based on one or more detected One or more patterns are used to determine at least one ROI of the sensing image, and then all optical signals in the at least one ROI are used to process optical communication. In the receiving device, the optical communication method may also take fewer measurements than a total of one pixel in at least one tracking area to track one or more patterns of light emitted by the transmitting device. The measurement may include a random combination of pixels in the at least one tracking area.

从图中可以看出,因为传送装置510所发射的光的一或多个图样,而可大幅降低在接收装置520的图样侦测中的两个数量,例如共享的ADC取样量以及计算复杂度。从而大幅减少占用时间。在接收装置520决定ROI之后,ADC(s)可以只使用于ROI中的像素。所以,当执行光通信时,因而大幅地提高画面速率。It can be seen from the figure that because of one or more patterns of light emitted by the transmitting device 510, two quantities in the pattern detection of the receiving device 520 can be greatly reduced, such as the shared ADC sampling amount and computational complexity . This significantly reduces the time taken. After the receiving device 520 determines the ROI, the ADC(s) may only be used for pixels in the ROI. Therefore, when optical communication is performed, the picture rate is thus greatly increased.

图6A是根据本发明一实施例,说明一种光通信的传送方法。在图6A中,此传送方法首先传送一或多个图样512a,并且在至少一个周期的期间可以形成一或多个形状的此图样,来决定一或多个参考区域(步骤610)。对于光通信的使用,此传送方法可以通过使用一发光元件,从此一或多个图样决定的一或多个参考区域中发射光来传送数据(步骤615)。图6B是根据本发明一实施例,说明一被传送的图样620可以决定一参考区域625的一范例示意图。此一或多个图样决定的一或多个参考区可以辨识传送装置的位置,例如在多光源的情况下,或是被用于光通信中来传送信号。此传送方法还可包括使用一光通信控制单元,来选择一或多个图样作为它的输入,或是从一传送器-基频处理单元来选择它的输入,此传送器-基频处理单元执行无线通信的多个基频运作。FIG. 6A illustrates a transmission method of optical communication according to an embodiment of the present invention. In FIG. 6A, the transmission method first transmits one or more patterns 512a, and one or more shapes of the patterns can be formed during at least one cycle to determine one or more reference regions (step 610). For use in optical communication, the transmission method may transmit data by using a light-emitting element to emit light in one or more reference regions determined by the one or more patterns (step 615). FIG. 6B is a schematic diagram illustrating an example of a reference area 625 determined by a transmitted pattern 620 according to an embodiment of the present invention. The one or more reference areas determined by the one or more patterns can identify the position of the transmission device, such as in the case of multiple light sources, or be used in optical communication to transmit signals. The transmission method may also include using an optical communication control unit to select one or more patterns as its input, or select its input from a transmitter-baseband processing unit, the transmitter-baseband processing unit Perform multiple baseband operations for wireless communications.

此传送的一或多个图样可以形成一随时间变化的(time-invariant)序列。图7A是根据本发明一实施例,说明在三个不同时间由一16×16LED阵列发射出三个不同的图样的范例。在图7A中,斜线的小方块代表已接通的(turned on)LED,空白的方块代表已关闭的(turned off)LED灯。三个箭头表示三个不同的时间,即分别为时间T1、时间T2、以及时间T3。所以,已接通的LED可形成一随时间变化的图样序列,并且每一图样可以包含在此LED阵列的边界或中心,并且可以决定一参考区域。为了减少在接收器端的侦测复杂度和时间,一被传送的图样可以只包括两条线。图7B是根据本发明一实施例,说明一参考区域由多个点状的LEDs来表示。此参考区域中的数据可以经由接通-关闭键控调制(on-off keyingofmodulation)方式由此多个LEDs来传送。图7C是根据本发明一实施例,说明由一LED阵列发射的其他三图样。The transmitted pattern or patterns may form a time-invariant sequence. Fig. 7A illustrates an example of three different patterns emitted by a 16x16 LED array at three different times, according to an embodiment of the present invention. In FIG. 7A , small squares with slashes represent turned on LEDs, and blank squares represent turned off LEDs. Three arrows indicate three different times, namely time T1, time T2, and time T3. Therefore, the turned-on LEDs can form a sequence of patterns that vary with time, and each pattern can be included in the boundary or center of the LED array, and a reference area can be determined. To reduce detection complexity and time at the receiver, a transmitted pattern may only include two lines. FIG. 7B illustrates a reference area represented by a plurality of dot-shaped LEDs according to an embodiment of the present invention. Data in the reference area can be transmitted by the LEDs via on-off keying of modulation. FIG. 7C illustrates three other patterns emitted by an LED array, according to an embodiment of the present invention.

图8是根据本发明一实施例,说明在五个不同的时间由一单一LED传送器发射的一范例图样。在图8中,一灰色泡罩(bubble)表示此单一LED被关闭,一白色泡罩表示此单一LED被接通。通过定期地接通和关闭此单一LED来形成此图样。五个箭头分别代表第一周期至第五周期。参考区域是相等于此单一LED的照明区域。在此图样形成后,经由接通-开闭或调整此单一LED的电压或电流的准位(level),此单一LED可以开始传送数据。FIG. 8 illustrates an example pattern emitted by a single LED transmitter at five different times, according to an embodiment of the present invention. In FIG. 8, a gray bubble indicates that the single LED is turned off, and a white bubble indicates that the single LED is turned on. This pattern is formed by periodically turning this single LED on and off. The five arrows represent the first period to the fifth period respectively. The reference area is equivalent to the illuminated area of this single LED. After the pattern is formed, the single LED can start to transmit data by turning on-off or adjusting the voltage or current level of the single LED.

图9是根据本发明一实施例,说明多个光源传送图样的另一范例。如图9所示,有四个光源,以光源a到光源d表示,并且只有光源a被用作光通信的一传送器。所以,只有光源a发射出一预定且随时间变化的图样,来辨识其位置。换句话说,由预定且随时间变化的图样所决定的参考区域可以被用来辨识发射此预定且随时间变化的图样的光源的位置。FIG. 9 illustrates another example of transmission patterns of multiple light sources according to an embodiment of the present invention. As shown in FIG. 9, there are four light sources, denoted by light source a to light source d, and only light source a is used as a transmitter for optical communication. Therefore, only the light source a emits a predetermined and time-varying pattern to identify its position. In other words, the reference area determined by the predetermined and time-varying pattern can be used to identify the location of the light source emitting the predetermined and time-varying pattern.

图10是根据本发明一实施例,说明一光通信的接收方法的运作。此接收方法可包括三种运作模式,即获取模式((acquisition mode)、数据接收(data receiving)模式、以及追踪(tracking)模式。在获取模式下,此接收方法从一图像感测元件的一感测图像中多个像素采取少量的测量,来侦测一或多个传送图样(transmitted pattern)。此测量可以包括此感测图像中多个像素的随机组合。在获取获模式中采取的测量的数量是少于在此感测图像中的一像素总量,例如,在一图像传感器中的图像感测阵列(imagesensing array)。此接收方法然后比较所侦测到的图样与一或多个图样,此图样例如可保存在一存储器装置(memory means)中。如果从比较中获得一成功的匹配结果,此接收方法根据所侦测到的图样来决定一兴趣区域(ROI)。如果没有从比较中获得这样的一成功的匹配结果,此接收方法继续执行上述获取模式中图样侦测的运作。FIG. 10 illustrates the operation of an optical communication receiving method according to an embodiment of the present invention. The receiving method may include three modes of operation, namely, an acquisition mode, a data receiving mode, and a tracking mode. In the acquisition mode, the receiving method starts from an image sensor A small number of measurements are taken by multiple pixels in the sensed image to detect one or more transmitted patterns. The measurements may include random combinations of pixels in the sensed image. Measurements taken in acquisition mode The number is less than the total number of pixels in the sensed image, for example, an image sensing array (imagesensing array) in an image sensor. The receiving method then compares the detected pattern with one or more pattern, such pattern can be stored in a memory device (memory means). If a successful matching result is obtained from the comparison, the receiving method determines a region of interest (ROI) according to the detected pattern. If not obtained from Obtaining such a successful matching result in the comparison, the receiving method continues to perform the above-mentioned operation of pattern detection in the acquisition mode.

在决定ROI之后,此接收方法可以进入数据接收模式。在数据接收模式下,此接收方法采取此ROI中所有像素资料进行光通信的处理,例如图像处理和接收器(Rx)-基频处理。此像素数据可以从感测图像,或从光信号被采取。此ROI的光通信的处理结束后,此接收方法可以进入追踪模式。在追踪模式下,此接收方法采取比至少一追踪区域的一像素总量较少量的测量来追踪传送一或多个图样的传送器,例如传送器的位置。根据追踪模式下的一图样侦测结果,此ROI可以再被改善(refined)。当ROI被改善完成时,此接收方法返回到数据接收模式来接收数据。此数据接收模式与追踪模式的处理可以迭代地继续,直到完成光通信为止。After determining the ROI, the receive method can enter a data receive mode. In data receiving mode, the receiving method uses all pixel data in the ROI for optical communication processing, such as image processing and receiver (Rx)-baseband processing. This pixel data can be taken from a sensed image, or from an optical signal. After the processing of the optical communication of the ROI is completed, the receiving method can enter the tracking mode. In tracking mode, the receiving method takes fewer measurements than a total of one pixel of at least one tracking area to track a transmitter transmitting one or more patterns, such as the position of the transmitter. According to a pattern detection result in the tracking mode, the ROI can be refined. When the ROI improvement is complete, the receive method returns to data receive mode to receive data. This data receiving mode and tracking mode processing may continue iteratively until optical communication is complete.

图11A至图11F是根据本发明一实施例,说明一光通信系统的运作流程,此光通信系统备有以一LED阵列实现的一发光元件。在图11A中,在三个不同的时间,图像传感器中的一图像感测阵列感测到三个图像1101到1103,其中在每一图像中的小灰色方块是在获取模式下被接收装置中的一ADC所采取的测量,其中此测量是多个像素的多个RGB值,并且在每一图像中的粗体线条是由此传送装置传送的图样。在此ADC为每一图像上采取的测量上进行图像处理后,例如将这些像素的RGB值转换为代表像素值的亮度、应用正交匹配追踪(Orthogonal Matching Pursuit,OMP)到代表像素值的有决定性的亮度以及一相乘矩阵(product matrix),可侦测形成每一个图像上的图样的线条的参数,如图11B所示。在图11C中,一参考区域1130是根据所侦测到的三个图像的图样来决定,如虚线部分所示。此参考区域可以是,但不限于,图11B中侦测到的线条所包围的一最大区域。此接收装置的ADC采取含有参考区域1130的ROI 1140的每一取样,并且以垂直线填充的方块表示,如图11D所示,用于光通信的后续处理。在各种实现方式中,此ROI 1140的大小可以大于、小于或等于参考区域1130。并且,一ROI可以包括的一区域、或是多个更小区域的联集,如图11E所示。在图11F中,水平线表示一追踪区域1160,其中,接收装置可采用比追踪区域1160的一像素总量较少量的测量,来追踪传送装置的位置。11A to FIG. 11F illustrate the operation flow of an optical communication system according to an embodiment of the present invention. The optical communication system is provided with a light emitting element realized by an LED array. In FIG. 11A, at three different times, an image sensing array in the image sensor senses three images 1101 to 1103, where the small gray squares in each image are received in the receiving device in acquisition mode Measurements taken by an ADC of , where the measurements are RGB values of pixels, and the bold lines in each image are patterns transmitted by the transmitting device. After image processing is performed on the measurements taken by this ADC for each image, such as converting the RGB values of these pixels into luminance representing the pixel value, applying Orthogonal Matching Pursuit (OMP) to a valid value representing the pixel value Determining the intensity and a product matrix, the parameters of the lines forming the pattern on each image can be detected, as shown in FIG. 11B. In FIG. 11C , a reference area 1130 is determined according to the detected patterns of the three images, as shown by the dotted line. The reference area may be, but not limited to, a maximum area enclosed by the detected lines in FIG. 11B . The ADC of this receiving device takes each sample of the ROI 1140 containing the reference region 1130 and is represented by a square filled with vertical lines, as shown in FIG. 11D , for subsequent processing of the optical communication. In various implementations, the size of this ROI 1140 can be larger, smaller, or equal to the reference region 1130 . Moreover, an ROI can include an area, or a collection of multiple smaller areas, as shown in FIG. 11E . In FIG. 11F , the horizontal line represents a tracking area 1160 in which the receiving device can track the position of the transmitting device using a smaller number of measurements than the total number of one pixel of the tracking area 1160 .

图12是根据本发明一实施例,说明一光通信方法。如图12所示,此光通信方法可以产生一或多个光的图样,并且此图样可以形成一或多个的形状来决定一或多个参考区域(步骤1210),并且可经由一发光元件在一或多个图样决定的一或多个参考区域中发射光(步骤1220)。在一获取模式1230中,此光通信方法可以采取比一感测图像的一像素总量较少量的测量(一第一多个测量)来侦测一或多个光的图样,并且根据一或多个侦测到的图样来决定至少一ROI。在一数据接收模式1240中,此光通信方法可采取此至少一ROI所有的光信号来进行光通信的后续处理。此光通信方法还可以进入一追踪模式。在此追踪模式1250中,此光通信方法可以采取比一追踪区域的一像素总量较少量的测量(一第二多个的测量)来追踪此发光元件所发射的光的此一或多个图样。产生光的一或多个图样以及此一或多个图样的细节已在较早的实施例中描述,并在此省略。FIG. 12 illustrates an optical communication method according to an embodiment of the present invention. As shown in Figure 12, this optical communication method can generate one or more patterns of light, and this pattern can form one or more shapes to determine one or more reference areas (step 1210), and can pass through a light-emitting element Light is emitted in one or more reference regions determined by the one or more patterns (step 1220). In an acquisition mode 1230, the optical communication method may take fewer measurements (a first plurality of measurements) than the total number of pixels of a sensed image to detect one or more light patterns, and based on a or multiple detected patterns to determine at least one ROI. In a data receiving mode 1240, the optical communication method can adopt all optical signals of the at least one ROI to perform subsequent processing of optical communication. The optical communication method can also enter a tracking mode. In the tracking mode 1250, the optical communication method may take fewer measurements (a second plurality of measurements) than the total number of pixels in a tracking area to track the one or more measurements of the light emitted by the light-emitting element. pattern. The one or more patterns for generating light and the details of the one or more patterns have been described in earlier embodiments and are omitted here.

压缩感测(compressive sensing)以及广义的(generalized)Hough转换(GHT)或是Radon转换的技术可以被应用于来自侦测有决定性的(under-determinant)随机测量的被传送的图样。详细的过程说明如下。令P={π1,π2,...,πN}是参数空间中的一组可能参数(possible parameter),其中参数空间可以是直线、圆、或是任意形状的几何图形的组合或是任何组合的集合。令一参数向量p是一指针函数(indicator function),即如果图像包含参数πk,则p的第k个元素是非零。例如,图7A中三个感测图像分别对应于三个指针函数P1,p2和p3。图7A中的每一图像包含两直线,所以每一指针函数只包含两个非零元素。换句话说,二维图像空间中的M条直线等于参数空间经过GHT后的M个点。对于一图像f,f与p之间的关系可写为f=Hp,其中H是GHT的一逆运算(inverse operator)或是随机转换(randomtransform)的一逆运算。由于指针函数p是稀疏的(sparse),压缩感测的理论可以被应用。因此,本发明实施例中的接收装置可以采取有决定性的随机测量,而不是一整个图像的取样,来侦测指针函数p所传送的图样。令y是多个随机测量,并且y的大小远小于整个图像的大小。一关系式y=Ψf=ΨHp是保持的,其中Ψ是一组随机测量的基底向量(basisvector)的集合。指针函数p可经由满足y=ΨHp条件的的一估计器来被复原。所以,包含在一转换的图样(transformed pattern)中的直线的数目是尽可能小是比较好的。Compressive sensing and generalized Hough transform (GHT) or Radon transform techniques can be applied to the transmitted patterns from under-determinant stochastic measurements. The detailed procedure is explained below. Let P={π 1 , π 2 ,..., π N } be a set of possible parameters in the parameter space, where the parameter space can be a straight line, a circle, or a combination of geometric figures of any shape or is the set of any combination. Let a parameter vector p be an indicator function, ie if the image contains the parameter π k , then the kth element of p is non-zero. For example, the three sensing images in FIG. 7A correspond to the three pointer functions P1, p2 and p3 respectively. Each graph in Figure 7A contains two lines, so each pointer function contains only two non-zero elements. In other words, M straight lines in the two-dimensional image space are equal to M points in the parameter space after GHT. For an image f, the relationship between f and p can be written as f=Hp, where H is an inverse operator of GHT or an inverse operator of random transform. Since the pointer function p is sparse, the theory of compressed sensing can be applied. Therefore, the receiving device in the embodiment of the present invention can detect the pattern transmitted by the pointer function p by taking a deterministic random measurement instead of sampling an entire image. Let y be a number of random measurements, and the size of y is much smaller than the size of the entire image. A relation y=Ψf=ΨHp holds, where Ψ is a set of randomly measured basis vectors. The pointer function p can be passed through an estimator satisfying the condition of y=ΨHp to be restored. Therefore, it is better that the number of straight lines included in a transformed pattern be as small as possible.

图13是根据本发明一实施例的,说明在获取模式或追踪模式中侦测一图样的方法。如图13所示,此方法首先将感测图像的所有直线量化为一参数空间(步骤1310),并且推导出一逆转换(步骤1315),例如一Hough转换或一随机转换。产生逆Hough转换的一矩阵的应用范例可以先经由采用0°到180°的范围内的角度θ,以及-25到25的范围内的半径r,例如,Δθ等于2°及Δr等于3,然后得到(r,θ)坐标系统中参数空间的大小(size),其中此大小可计算为(180/Δθ)×(50/Δr),即等于1530。然后,此方法采取比来自感测图像(一第一测量)或来自至少一追踪区域(一第二测量)的像素的随机组合的一总量较少量的随机测量(第一测量或第二测量中的多个测量)(步骤1320),并且应用一修正的OMP在此少量随机的测量上,以得到此参数空间中此图样的参数(步骤1325)。此图样需要采取的此少量测量的数量可以计算为C×k×log(N/k),其中C是一常数,k是此图样中直线的数目,并且N是此感测图像中像素的数量。此方法重复步骤1320和1325,直到达到此图样的一最后画面为止(步骤1330)。FIG. 13 illustrates a method for detecting a pattern in acquisition mode or tracking mode according to an embodiment of the present invention. As shown in FIG. 13 , the method first quantizes all straight lines of the sensed image into a parameter space (step 1310 ), and derives an inverse transformation (step 1315 ), such as a Hough transformation or a random transformation. An example of the application of a matrix to generate the inverse Hough transform can first be by taking an angle θ in the range of 0° to 180°, and a radius r in the range of -25 to 25, for example, Δθ equals 2° and Δr equals 3, and then The size (size) of the parameter space in the (r, θ) coordinate system is obtained, where this size can be calculated as (180/Δθ)×(50/Δr), which is equal to 1530. The method then takes a smaller number of random measurements (first measurement or second measurement) than a total amount from a random combination of pixels from the sensed image (a first measurement) or from at least one tracking region (a second measurement). measurements) (step 1320), and apply a modified OMP on the small number of random measurements to obtain the parameters of the pattern in the parameter space (step 1325). The number of this small number of measurements that the pattern needs to take can be calculated as C x k x log(N/k), where C is a constant, k is the number of lines in the pattern, and N is the number of pixels in the sensed image . The method repeats steps 1320 and 1325 until a final frame of the pattern is reached (step 1330).

综上所述,本发明上述的实施例提供了一种光通信传送和接收装置和方法,以及光通信系统和方法。此光通信系统包含一传送装置和一接收装置。此传送装置产生光的一或多个图样,并且此图样可以形成一或多个形状,以决定一或多个参考区域;以及从经由一或多个图样所决定一或多个参考区域中发射光来传送信号。在一获取模式下,此接收装置采取比一感测图像的一像素总量的一较少量(第一数量)的测量来侦测光的一或多个图样,并且根据一或多个侦测到的图样来决定一感测图像的至少一ROI。在一数据接收模式下,此接收装置采取此至少一ROI中的所有信号来处理光通信。在一追踪模式下,此接收装置采取比至少一追踪区域的一像素总量的一较少量(第二数量)的测量来侦测由此传送装置发射出的光的一或多个图样。与现有的光通信技术相比,当光通信被执行时,本发明实施例可以大幅增加画面速率以及大幅减少占用时间。In summary, the foregoing embodiments of the present invention provide an optical communication transmission and reception device and method, and an optical communication system and method. The optical communication system includes a transmitting device and a receiving device. The transmitting device generates one or more patterns of light, and the patterns can form one or more shapes to determine one or more reference areas; and emit light from the one or more reference areas determined by the one or more patterns light to transmit the signal. In an acquisition mode, the receiving device detects one or more patterns of light by taking a smaller number (a first number) of measurements than a total number of pixels of a sensed image, and based on one or more detected The detected pattern is used to determine at least one ROI of a sensing image. In a data receiving mode, the receiving device adopts all signals in the at least one ROI to process optical communication. In a tracking mode, the receiving device takes a smaller number (a second number) of measurements than a total number of pixels of at least one tracking area to detect one or more patterns of light emitted by the transmitting device. Compared with the existing optical communication technology, when the optical communication is performed, the embodiment of the present invention can greatly increase the frame rate and greatly reduce the occupation time.

以上所述仅为本发明实施例,当不能依此限定本发明实施的范围。即但凡本发明权利要求所作的等同变化与修饰,都应仍属本发明专利涵盖的范围。The above descriptions are only examples of the present invention, and should not limit the implementation scope of the present invention accordingly. That is, all equivalent changes and modifications made by the claims of the present invention shall still fall within the scope covered by the patent of the present invention.

Claims (29)

1.一种光通信的传送装置,包含:1. A transmission device for optical communication, comprising: 一图样产生单元,被配置为产生多个图样,来决定至少一或多个参考区域,其中所述多个图样形成一随时间变化的序列;a pattern generation unit configured to generate a plurality of patterns to determine at least one or more reference regions, wherein the plurality of patterns form a time-varying sequence; 一光通信LC控制单元,连接到一传送器-基频处理单元,并且该LC控制单元从该传送器-基频处理单元或从该图样产生单元来选择其输入;以及an optical communication LC control unit connected to a transmitter-baseband processing unit, and the LC control unit selects its input from the transmitter-baseband processing unit or from the pattern generation unit; and 一发光元件,从所述多个图样或所述多个图样决定的该一或多个参考区域中发射的所有光来传送数据。A light emitting element transmits data from all light emitted from the plurality of patterns or the one or more reference areas determined by the plurality of patterns. 2.根据权利要求1所述的装置,其中由所述多个图样决定的该一或多个参考区域识别该传送装置的一或多个位置。2. The device of claim 1, wherein the one or more reference areas determined by the plurality of patterns identify one or more locations of the conveying device. 3.根据权利要求1所述的装置,其中由所述多个图样决定的该一或多个参考区域是用来传送光通信的多个信号。3. The device according to claim 1, wherein the one or more reference areas determined by the patterns are used to transmit signals of optical communication. 4.根据权利要求1所述的装置,其中当该传送装置是在一数据传送期间时,该LC控制单元从执行无线通信的多个基频运作的该传送器-基频处理单元来选择其输入。4. The device according to claim 1, wherein when the transmitting device is during a data transmission, the LC control unit selects one of the transmitter-baseband processing units performing a plurality of baseband operations for wireless communication enter. 5.根据权利要求1所述的装置,其中当该传送装置是在一参考区域指示期间时,该LC控制单元从该图样产生单元选择其输入。5. The device of claim 1, wherein the LC control unit selects its input from the pattern generating unit when the transmitting device is during a reference area indication. 6.根据权利要求1所述的装置,该装置还包括一驱动单元来驱动该发光元件发射光。6. The device according to claim 1, further comprising a driving unit to drive the light emitting element to emit light. 7.一种光通信的传送方法,该方法包含:7. A transmission method for optical communication, the method comprising: 经由使用一发光元件,在至少一周期的期间,传送多个图样来决定一或多个参考区域,其中所述多个图样形成一随时间变化的序列;以及determining one or more reference regions by transmitting a plurality of patterns during at least one cycle using a light-emitting element, wherein the plurality of patterns form a time-varying sequence; and 使用该发光元件,通过从所述多个图样决定的该一或多个参考区域中发射的所有光来传送数据。Using the light emitting element, data is transmitted by all light emitted from the one or more reference areas determined by the plurality of patterns. 8.根据权利要求7所述的方法,该方法还包括:8. The method of claim 7, further comprising: 使用一光通信控制单元,来选择所述多个图样作为其输入,或从执行无线通信的多个基频运作的一传送器-基频处理单元选择其输入。An optical communication control unit is used to select the plurality of patterns as its input, or select its input from a transmitter-baseband processing unit performing multiple baseband operations of the wireless communication. 9.根据权利要求7所述的方法,其中该一或多个参考区域中的该光是经由多种调制方式的其中之一的接通-关断键控调制方式,被一LED阵列所发射。9. The method of claim 7, wherein the light in the one or more reference regions is emitted by an LED array via an on-off keying modulation scheme, one of a plurality of modulation schemes . 10.根据权利要求7所述的方法,其中所述多个图样是经由定期地接通与关闭一单一LED来形成。10. The method of claim 7, wherein the plurality of patterns are formed by periodically turning on and off a single LED. 11.一种光通信的接收装置,包含:11. A receiving device for optical communication, comprising: 一兴趣区域ROI决定单元,被配置为侦测一感测图像中的光的多个图样,并且根据至少一侦测到的图样来决定至少一ROI,其中所述多个图样形成一随时间变化的序列;A region of interest ROI determining unit configured to detect a plurality of patterns of light in a sensed image, and determine at least one ROI according to at least one detected pattern, wherein the plurality of patterns form a time-varying the sequence of; 一图像感测元件,被配置为产生该感测图像,并且根据该ROI决定单元产生的一输出来感测光,其中该图像感测元件采用该ROI中光的所有像素数据来处理光通信,所述所有像素数据被用以传送数据;以及an image sensing element configured to generate the sensed image and sense light according to an output generated by the ROI determining unit, wherein the image sensing element processes light communication using all pixel data of light in the ROI, said all pixel data is used to transfer data; and 一图像处理单元,在该至少一ROI中,根据该图像感测元件的输出来进行图像处理;An image processing unit, in the at least one ROI, performs image processing according to the output of the image sensing element; 其中该ROI决定单元采用比该感测图像的一像素总量较少量的一第一多个测量来侦测所述多个图样,该第一多个测量包括该感测图像中的像素的多种随机组合。wherein the ROI determination unit detects the patterns using a first plurality of measurements less than a total number of pixels in the sensed image, the first plurality of measurements comprising pixels in the sensed image Various random combinations. 12.根据权利要求11所述的装置,其中该接收装置还包括一接收器-基频处理单元,该接收器-基频处理单元连接到该图像处理单元,并执行用于复原接收到的数据的一基频处理。12. The device according to claim 11, wherein the receiving device further comprises a receiver-baseband processing unit, the receiver-baseband processing unit is connected to the image processing unit, and performs an operation for restoring the received data A fundamental frequency processing. 13.根据权利要求11所述的装置,其中该至少一ROI的每一ROI包含一区域或是多个更小区域的一联集。13. The apparatus of claim 11, wherein each ROI of the at least one ROI comprises a region or a union of a plurality of smaller regions. 14.根据权利要求11所述的装置,其中图像处理单元还采用比至少一追踪区域的一像素总量较少量的一第二多个测量来追踪接收到的光的所述多个图样。14. The apparatus of claim 11, wherein the image processing unit further tracks the plurality of patterns of received light with a second plurality of measurements that is less than a total number of pixels of at least one tracking region. 15.根据权利要求14所述的装置,其中该第二多个测量包括该至少一追踪区域中的像素的多种随机组合。15. The apparatus of claim 14, wherein the second plurality of measurements comprises random combinations of pixels in the at least one tracking region. 16.一种光通信的接收方法,包含:16. A receiving method for optical communication, comprising: 在一获取模式下,采用比一图像感测元件的一感测图像的一像素总量较少量的一第一多个测量,来侦测被接收的多个图样,并且根据多个侦测到的图样来决定至少一兴趣区域ROI,其中所述多个图样形成一随时间变化的序列;以及In an acquisition mode, the received patterns are detected using a first plurality of measurements less than the total number of pixels of a sensed image of an image sensing element, and based on the plurality of detected Determine at least one region of interest (ROI) based on the obtained patterns, wherein the plurality of patterns form a time-varying sequence; and 在一数据接收模式下,使用该至少一ROI中光的所有像素数据来处理光通信,所述所有像素数据被用以传送数据;In a data receiving mode, processing light communication using all pixel data of light in the at least one ROI, said all pixel data being used to transmit data; 其中该第一多个测量包括该感测图像中的像素的多种随机组合。Wherein the first plurality of measurements includes random combinations of pixels in the sensed image. 17.根据权利要求16所述的方法,该方法还包括:17. The method of claim 16, further comprising: 在一追踪模式下,采用比至少一追踪区域的一像素总量较少量的一第二多个测量来追踪一传送装置的至少一位置。In a tracking mode, at least one position of a transport device is tracked using a second plurality of measurements less than a total number of pixels of at least one tracking area. 18.根据权利要求17所述的方法,其中该方法在该获取模式或该追踪模式中,使用一个方案来侦测多个图样的任一图样,并且该方案包括:18. The method of claim 17, wherein the method uses a scheme to detect any one of a plurality of patterns in the acquisition mode or the tracking mode, and the scheme comprises: 将该感测图像中的全部线条量化为一参数空间,并且推导出一逆转换;quantizing all lines in the sensed image into a parameter space, and deriving an inverse transformation; 采用该第一或该第二多个测量,并且应用一修正的正交匹配追踪来获得该参数空间中该图样的一或多个参数,并且重复本步骤,直到达成该图样的一最后画面为止。taking the first or the second plurality of measurements and applying a modified orthogonal matching pursuit to obtain one or more parameters of the pattern in the parameter space, and repeating this step until a final frame of the pattern is achieved . 19.根据权利要求16所述的方法,其中在多种实现方式中,该至少一ROI的每一ROI大于、或小于、或等于所述多个图样所决定的该至少一参考区域的每一参考区域。19. The method according to claim 16, wherein in multiple implementations, each ROI of the at least one ROI is greater than, or smaller than, or equal to each of the at least one reference region determined by the plurality of patterns reference area. 20.根据权利要求16所述的方法,其中该至少一ROI的每一ROI包含一区域或是多个更小区域的一联集。20. The method of claim 16, wherein each ROI of the at least one ROI comprises a region or a union of a plurality of smaller regions. 21.根据权利要求17所述的方法,其中该第二多个测量包括该至少一追踪区域中的像素的多种随机组合。21. The method of claim 17, wherein the second plurality of measurements comprises random combinations of pixels in the at least one tracking region. 22.一种光通信系统,包含:22. An optical communication system comprising: 一传送装置,被配置为在至少一周期的期间产生多个图样来决定至少一参考区域,并且通过从所述多个图样决定的一或多个参考区域中发射光来传送数据,其中所述多个图样形成一随时间变化的序列;以及A transmission device configured to generate a plurality of patterns during at least one period to determine at least one reference area, and transmit data by emitting light from one or more reference areas determined by the plurality of patterns, wherein the the plurality of patterns forming a time-varying sequence; and 一接收装置,被配置为侦测所述多个图样,并且根据多个侦测到的图样来决定至少一兴趣区域ROI,然后使用该至少一ROI中的光的所有信号来处理光通信,所述所有像素数据被用以传送数据。A receiving device configured to detect the plurality of patterns, and determine at least one region of interest ROI according to the plurality of detected patterns, and then use all signals of light in the at least one ROI to process optical communication, so All pixel data described above is used to transmit data. 23.根据权利要求22所述的系统,其中该至少一ROI的每一ROI包含一区域或是多个更小区域的一联集。23. The system of claim 22, wherein each ROI of the at least one ROI comprises a region or a union of a plurality of smaller regions. 24.根据权利要求22所述的系统,其中该接收装置还采用比至少一追踪区域的一像素总量较少量的多个测量来追踪该传送装置发射的光的所述多个图样。24. The system of claim 22, wherein the receiving device further tracks the patterns of light emitted by the transmitting device using a smaller number of measurements than a total number of pixels of at least one tracking area. 25.根据权利要求24所述的系统,其中该多个测量包括该至少一追踪区域中的像素的多种随机组合。25. The system of claim 24, wherein the plurality of measurements comprise random combinations of pixels in the at least one tracking region. 26.一种光通信方法,包含:26. A method of optical communication, comprising: 在一传送装置中,在至少一周期的期间产生光的多个图样来决定至少一参考区域,并且通过从所述多个图样决定的该至少一参考区域中发射光来传送数据,其中所述多个图样形成一随时间变化的序列;以及In a transmission device, a plurality of patterns of light are generated during at least one cycle to determine at least one reference area, and data is transmitted by emitting light from the at least one reference area determined by the plurality of patterns, wherein said the plurality of patterns forming a time-varying sequence; and 在一接收装置中,采用比一感测图像的一像素总量较少量的一第一多个测量来侦测所述多个图样,并且根据侦测到的多个图样来决定至少一兴趣区域ROI,然后采用该至少一ROI中的光的所有信号来处理光通信,所述所有像素数据被用以传送数据。In a receiving device, detecting the patterns using a first plurality of measurements less than a total number of pixels of a sensed image, and determining at least one interest based on the detected patterns Region ROI, then use all signals of the light in the at least one ROI to process optical communication, said all pixel data is used to transmit data. 27.根据权利要求26所述的方法,其中该方法还包括:27. The method of claim 26, wherein the method further comprises: 使用所述多个图样决定的该至少一参考区域辨识该传送装置的一或多个位置。The at least one reference area determined using the plurality of patterns identifies one or more locations of the conveying device. 28.根据权利要求26所述的方法,其中该方法还包括:28. The method of claim 26, wherein the method further comprises: 在该接收装置中,采用比至少一追踪区域的一像素总量较少量的一第二多个测量来追踪该传送装置发射的光的所述多个图样。In the receiving device, the patterns of light emitted by the transmitting device are tracked using a second plurality of measurements less than a total number of pixels of at least one tracking area. 29.根据权利要求28所述的方法,其中该第一多个测量包括该感测图像的像素的多种随机组合,并且该第二多个测量包括该至少一追踪区域中的像素的多种随机组合。29. The method of claim 28, wherein the first plurality of measurements includes a plurality of random combinations of pixels of the sensed image, and the second plurality of measurements includes a plurality of random combinations of pixels in the at least one tracking region. random combination.
CN201210561820.9A 2012-03-20 2012-12-21 Optical communication transmitting and receiving apparatus and method, and optical communication system and method Active CN103327317B (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201261613477P 2012-03-20 2012-03-20
US61/613,477 2012-03-20
US13/671,085 2012-11-07
US13/671,085 US9450671B2 (en) 2012-03-20 2012-11-07 Transmitting and receiving apparatus and method for light communication, and the light communication system thereof

Publications (2)

Publication Number Publication Date
CN103327317A CN103327317A (en) 2013-09-25
CN103327317B true CN103327317B (en) 2017-10-27

Family

ID=49195818

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210561820.9A Active CN103327317B (en) 2012-03-20 2012-12-21 Optical communication transmitting and receiving apparatus and method, and optical communication system and method

Country Status (1)

Country Link
CN (1) CN103327317B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104378163A (en) * 2014-11-14 2015-02-25 北京智谷睿拓技术服务有限公司 Method and device for controlling receiving of visible light signals and device for receiving visible light signals
CN104393931B (en) * 2014-11-17 2018-12-25 北京智谷睿拓技术服务有限公司 Visible light signal reception control method, control device and receiving device
JP6693365B2 (en) * 2016-09-20 2020-05-13 カシオ計算機株式会社 Notification device, notification method, and program
CN109995488B (en) * 2017-12-29 2024-12-24 中兴通讯股份有限公司 Phase tracking reference signal transmission and reception method and device
WO2021102878A1 (en) * 2019-11-29 2021-06-03 深圳市大疆创新科技有限公司 Method and device for configuring photographing device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1524390A (en) * 2001-06-08 2004-08-25 耐克斯特格网络公司 Network and methof for connecting antennas to base stations in a wireless communication network using space diversity
US6995774B2 (en) * 2002-07-10 2006-02-07 L3 Communications Corporation Display system and method of diminishing unwanted artifacts
CN101159821A (en) * 2007-11-21 2008-04-09 华东理工大学 Signal Output Method of Optical Receiver Area Array Sensor
CN101170359A (en) * 2007-12-03 2008-04-30 华东理工大学 Movement tracking method of output signal of area array photoelectric sensor

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4072632B2 (en) * 2002-11-29 2008-04-09 豊田合成株式会社 Light emitting device and light emitting method
US7570246B2 (en) * 2005-08-01 2009-08-04 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. Method and apparatus for communication using pulse-width-modulated visible light
JP4919648B2 (en) * 2005-10-31 2012-04-18 株式会社日立国際電気 Wireless terminal management system
CN101232327B (en) * 2007-10-30 2011-05-18 华东理工大学 Visible light space division multiple access multichannel communication system
KR101195498B1 (en) * 2008-11-28 2012-10-29 한국전자통신연구원 Visible light communication apparatus and visible light communication method
KR101042772B1 (en) * 2009-02-13 2011-06-20 삼성전자주식회사 Color lamp driving method and device
KR101621095B1 (en) * 2009-09-16 2016-05-16 삼성전자주식회사 Method and apparatus for transmitting additional information through display
JP5308391B2 (en) * 2010-03-31 2013-10-09 富士フイルム株式会社 Image encoding apparatus and method, and program
KR101938391B1 (en) * 2010-10-07 2019-01-14 한국전자통신연구원 Apparatus and method for transmitting and receiving, for visible light communication

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1524390A (en) * 2001-06-08 2004-08-25 耐克斯特格网络公司 Network and methof for connecting antennas to base stations in a wireless communication network using space diversity
US6995774B2 (en) * 2002-07-10 2006-02-07 L3 Communications Corporation Display system and method of diminishing unwanted artifacts
CN101159821A (en) * 2007-11-21 2008-04-09 华东理工大学 Signal Output Method of Optical Receiver Area Array Sensor
CN101170359A (en) * 2007-12-03 2008-04-30 华东理工大学 Movement tracking method of output signal of area array photoelectric sensor

Also Published As

Publication number Publication date
CN103327317A (en) 2013-09-25

Similar Documents

Publication Publication Date Title
TWI532331B (en) Transmitting and receiving apparatus and method for light communication, and the light communication system and method thereof
CN103327317B (en) Optical communication transmitting and receiving apparatus and method, and optical communication system and method
US9148250B2 (en) Methods and arrangements for error correction in decoding data from an electromagnetic radiator
CN103941940A (en) Parallel driving capacitive touch sensing device and transmission system
US9571193B2 (en) Transmitter, receiver, and method
US20180191437A1 (en) A method for visible light communication using display colors and pattern types of display
CN106464361A (en) Light-Based Communication Transmission Protocol
US11991455B2 (en) Light sensor chip and image processing device having different operating modes
JP2017525258A (en) Encoding optical symbols
US20190280770A1 (en) Method and apparatus for free-space optical transmission
US20130173999A1 (en) Hierarchical modulation and demodulation apparatus and method
KR101706849B1 (en) Apparatus and method for transceiving data using a visible light communication system
KR102179127B1 (en) RoI-based optical wireless communication method and apparatus
Duquel et al. Decoding methods in LED-to-smartphone bidirectional communication for the IoT
KR102324926B1 (en) Apparatus and method for 2d color code optical wireless communication considering signal circumstances
KR101794933B1 (en) Visible light communication method using display / light source matrix adaptive color and pattern types
JP2010032267A (en) Light receiver and optical communication system
KR102063418B1 (en) Method and apparatus for modulating and demodulating in communication system
JP7182722B2 (en) Method and apparatus for detecting LED array signals
WO2018130559A1 (en) Detecting coded light
CN1332533A (en) Apparatus and method for determining pulse position by signal of pulse modulation code
Borodkin et al. Errors in simplex data transmission channel based on visible light communication
KR102336163B1 (en) Apparatus and method for long range communication
CN110166124B (en) MIMO visible light communication signal extraction method based on mobile phone camera
Banik et al. Improvement of color detection by regression analysis of visual-MIMO system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant