WO2018137236A1

WO2018137236A1 - Camera communication method, apparatus and device

Info

Publication number: WO2018137236A1
Application number: PCT/CN2017/072733
Authority: WO
Inventors: 李强; 姜彤; 董晨
Original assignee: 华为技术有限公司
Priority date: 2017-01-26
Filing date: 2017-01-26
Publication date: 2018-08-02
Also published as: CN110073611B; CN110073611A

Abstract

Provided are a camera communication method, apparatus and device. The method comprises : performing multi-amplitude modulation on data to be transmitted, so as to obtain a plurality of paths of amplitude modulation signals; adding a pre-set sequence before each path of amplitude modulation signals, so as to obtain an initial signal of each path; performing SAM on the initial signal of each path, so as to obtain a sub-carrier modulation signal of each path; and sending a plurality of paths of sub-carrier modulation signals to a receiving end device. The method improves the spectrum utilization of a camera communication system.

Description

Method, device and device for camera communication

Technical field

The present application relates to communication technologies, and in particular, to a method, device and device for camera communication

Background technique

With the development of light-emitting diode (LED) technology, such high-efficiency, small-sized, long-life LED lamps are widely used in lighting, indication, screen, etc., and because of the good LED time response characteristics, light The signal can be sent out by high-speed light and dark flicker that is not visible to the naked eye, so that it can be used as a signal transmitter of the optical communication system; in addition, the photodiode (PD) will receive all the received signals during the reception of the optical signal. The optical power is converted into a current signal, so the PD can serve as a signal receiver for the optical communication system. Based on the characteristics of the above-mentioned LED lamps and PDs, visible light communication (VLC) has gradually become an issue of increasing concern in the lighting and communication industries.

However, although the response rate of the PD is very high, the detection area is small, so when the communication distance is on the order of meters (m), the PD of the millimeter size can only receive very weak optical power, and finally limit the optical communication. Communication rate and communication distance of the system (VLC system). In order to increase the received optical power of a PD-based VLC system, one usually uses an optical lens (combination) before the PD and places the PD at the focus of the optical lens (combination), but because the lens will space the received optical signal. Separation, in which case it is difficult for a single PD to simultaneously receive optical signals of a plurality of LEDs, thereby affecting signal switching during movement of the receiving device. Unlike a single PD, an image sensor (IS) uses a PD array as a photoreceiver, and each PD is a pixel of IS that can receive signals independently. When the IS works with the imaging lens, light from different directions will be focused at different positions on the IS, enabling reception of pictures or video. At present, since mobile phones, automobiles and other devices have built-in LED light source, camera and other modules (IS is built in the camera), LED light source and camera are integrated between the mobile phone and the mobile phone, between the car and the car, or any other two. Camera communication (Octical Camera Communications, OCC) can be achieved between devices through LED light sources and cameras.

At present, one of the hotspots in the field of OCC research is how to achieve flicker-free communication when using a normal frame rate camera (for example, the camera's frame rate is less than 60 fps) for signal transmission and reception. Since the frame rate of a common camera is low, and the critical flicker frequency (CFF) of the naked eye is 100 Hz, if the on-off keying (OOK) modulation is directly adopted, according to the Nyquist sampling theorem The signal transmission frequency needs to be set to less than half of the camera frame rate to achieve complete reception of the signal, but such a low transmission frequency of the transmitting device can cause the LED to blink. In order to solve this problem, the prior art adopts the Undersampled Frequency Shift ON-OFF keying (UFSOOK) modulation method, that is, the white LED of the transmitting device transmits a white light signal, and the UFSOOK system allows the receiving device (ie, the camera) to operate in the owu In the sampling mode, due to the special relationship between the carrier frequency fs (fs> CFF) and the camera frame rate, it can realize the complete signal transmitted by the camera to receive the original signal, thereby achieving flicker-free communication.

However, in the above prior art, when the corresponding communication information is transmitted by white light, all the color components of the white light transmit the same communication information, and thus the spectrum utilization rate is low. Therefore, how to improve the spectrum utilization under the condition that the camera communication is free from flicker has become a technical problem to be solved.

Summary of the invention

The method, device and device for camera communication provided by the embodiments of the present application are used to solve the problem that when the corresponding communication information is transmitted by white light, the same communication information is sent by all the color components of the white light, resulting in low spectrum utilization. technical problem.

In a first aspect, an embodiment of the present application provides a method for camera communication, including:

Performing multiple modulations on the transmitted data to obtain a multi-channel amplitude modulated signal, wherein each of the amplitude modulated signals has multiple amplitudes;

Adding a preset sequence before each of the amplitude modulation signals to obtain an initial signal of each channel; wherein the sequence is used to indicate state information of the amplitude modulation signal;

Subcarrier amplitude modulation SAM is performed on the initial signal of each channel to obtain a subcarrier modulation signal of each channel;

Transmitting multiple subcarrier modulation signals to the receiving device.

In the method for camera communication provided above, the transmitting device performs multiple modulations on the data to be transmitted, and obtains multiple parallel amplitude modulated signals, which are parallel and independent signals, so that they can carry different data information. Therefore, the embodiment of the present application increases the spectrum utilization rate of the camera communication system from the number of parallel branches of the transmitted optical signal, and further, since the optical signal of each channel is modulated by multiple amplitudes, the obtained amplitude modulated signal is obtained. A symbol having a plurality of amplitudes is included, and symbols of different amplitudes can carry different data information. Therefore, the embodiment of the present application further increases the spectrum utilization ratio of the camera communication system from the number of amplitudes; meanwhile, the transmitting device is based on each channel. The amplitude modulation signal and the preset sequence can obtain multiple initial signals, thereby performing subcarrier amplitude modulation on each channel initial signal to avoid signal flickering when the receiving end device performs optical signal reception, and ensuring that the receiving end device is at the receiving and transmitting end. The stability of the signal sent by the device to avoid signal flashing . That is to say, the embodiment of the present application further improves the spectrum utilization rate of the camera communication system on the basis of ensuring flicker-free communication.

In one possible design, the method further includes:

Receiving information of the gamma gamma curve determined by the receiving end device according to the sequence;

Performing gamma nonlinear compensation on each subcarrier modulation signal according to the information of the Gamma curve to obtain a multiplexed modulated signal;

Transmitting the multiplexed modulated signal to the receiving end device.

The possible design provides a method of camera communication, which greatly simplifies the operation of the receiving device and saves the processing overhead of the receiving device.

In a second aspect, an embodiment of the present application provides a method for camera communication, including:

Receiving, by the transmitting end device, a plurality of subcarrier modulation signals, wherein the multiple subcarrier modulation signals are signals obtained by performing subcarrier amplitude modulation SAM on an initial signal of each path of the transmitting end device, where the initial signal is The transmitting end device is generated according to a preset sequence and an amplitude modulated signal obtained by performing multiple modulations on the data to be transmitted, and the sequence is used to indicate state information of the amplitude modulated signal;

Processing the multi-channel subcarrier modulation signal to obtain the data to be transmitted.

In combination with the first aspect and the second aspect, in a possible design, the sequence is specifically used to indicate at least one of the following state information of the amplitude modulated signal:

Indicating a starting position of the sequence;

Instructing the subcarrier modulation signal whether there is a phase error;

Parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulated signal is indicated.

In combination with the above first aspect and second aspect, in one possible design, when the plurality of modulations are CIM modulation, the sequence includes: a first portion, a second portion, and a third portion;

The first portion includes a first symbol, the first symbol is used to indicate a starting position of the sequence in the initial signal; and the first symbol includes three parallel first first sub-symbols having an amplitude of K+l The K is a maximum amplitude after CIM modulation of the data to be transmitted, and the l is an arbitrary positive integer;

The second portion includes N second symbols,

Each of the second symbols includes three second sub-symbols in parallel and having a preset first association relationship, and each of the N second sub-symbols

The second sub-symbol has a magnitude of -K, and the remaining

The difference between the amplitudes of any two sub-symbols in the second sub-symbol is a multiple of the step size m, the multiple is a positive integer, and the second portion is used to indicate to the receiving end device for determining the Gamma curve of the amplitude modulated signal and parameter information of the channel matrix;

The third part includes N third symbols, and the third symbol includes three third sub-symbols whose amplitudes have a preset second association relationship, and the amplitudes of the N third symbols are And performing, after the amplitude of the second symbol of the second part, performing a reverse operation, for indicating a gamma for determining the amplitude modulation signal to the receiving end device when a phase error occurs in the subcarrier modulation signal Parameter information of the Gamma curve and the channel matrix.

In combination with the first aspect and the second aspect described above, in one possible design, the second portion includes an increasing sub-symbol string, and the increasing sub-symbol string of each path includes

Sub-symbols, the amplitudes of the sub-symbols in the increasing sub-symbol string are successively incremented from K at equal intervals of m in steps of m; the third portion includes three decrementing sub-symbol strings, decrementing sub-symbols of each path String includes

a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;

The first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;

The second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.

Each of the above possible designs provides a method in which the first portion, the second portion, and the third portion of the sequence enable the receiving device to determine a starting position of a sequence in each subcarrier modulation signal and to learn the received secondary Whether the carrier modulated signal or the amplitude modulated signal has a phase inversion, and the channel matrix and the gamma curve of each channel are obtained according to the second part or the third part, thereby nonlinearly receiving the received multiple subcarrier modulated signals. The compensation of the damage and the corresponding color correction improve the accuracy of the data recovery by the receiving device and ensure the reliability of the data to be transmitted restored by the receiving device.

In combination with the above first aspect and second aspect, in a possible design, when the plurality of modulations are color shift keying CSK modulation, the sequence includes: a first portion and a second portion;

The first portion includes N first symbols,

Each first symbol includes three first parallel sub-symbols whose amplitudes have a preset first association relationship, and N of each of the first sub-symbols

The first sub-symbol has a magnitude of -K, and the remaining

The difference between the amplitudes of any two sub-symbols in the first sub-symbol is a multiple of the step size m, and the multiple is a positive integer;

The second part includes N second symbols, and the second symbol includes three second sub-symbols in parallel and having a second associated relationship, and the amplitudes of the N second symbols are The amplitude of the first symbol of the first part performs the value after the inverse operation;

The first part and the second part are used together to indicate a starting position of the sequence, and a gamma gamma curve and a channel matrix for indicating to the receiving end device for determining the amplitude modulated signal Parameter information.

In combination with the first aspect and the second aspect above, in one possible design, the first portion includes three increasing sub-symbol strings, and the increasing sub-symbol string of each path includes

a sub-symbol, the amplitude of the sub-symbol in the increasing sub-symbol string is continuously incremented to K from -K at equal intervals in m steps; the second portion includes three-way descending sub-symbol strings, decrementing sub-symbols of each path String includes

Each of the above possible designs provides a method in which the first portion and the second portion of the sequence enable the receiving device to determine the starting position of the sequence in each of the subcarrier modulation signals and to obtain the received subcarrier modulation signal or Whether the amplitude modulation signal has a phase inversion, and the channel matrix and the Gamma curve of each channel are obtained according to the first part and the second part, thereby compensating for the nonlinear damage of the received multi-subcarrier modulation signal and correspondingly The color correction and the like improve the accuracy of the data recovery by the receiving device, and ensure the reliability of the data to be transmitted restored by the receiving device.

In combination with the first aspect and the second aspect above, in one possible design, the sequence includes a first portion and a second portion;

The first portion includes a plurality of symbols outside the modulation constellation point for indicating a starting position of the sequence in the initial signal;

The second part includes all the symbols in the plurality of modulation constellation points, and is used to indicate that the receiving end device trains the decider according to the training part, and the decider is configured to acquire the signal according to the signal received by the receiving end device. The data to be transmitted is mentioned.

The possible design provides a method that cancels the nonlinear compensation, color correction, and phase error cancellation of the receiving device, but trains the decider based on the second part of the sequence, and uses the determiner to restore the data to be transmitted, simplifying The complexity of the receiving device.

With reference to the foregoing second aspect, in a possible design, the multi-channel subcarrier modulation signal is processed to obtain the data to be transmitted, which specifically includes:

If a symbol is detected, and the amplitude of the three-way sub-symbol of the symbol is the maximum amplitude of the branch, the starting position of the sequence is determined according to the symbol transmission order of the preset sequence and the symbol;

Determining a second portion and a third portion of the sequence based on the starting position, the length of the sequence, and a symbol transmission order of the sequence;

Acquiring a gamma curve and a channel matrix according to the second part;

And processing the multi-channel subcarrier modulation signal according to the gamma curve and the channel matrix to obtain the to-be-transmitted data.

With reference to the foregoing second aspect, in a possible design, the acquiring the gamma curve according to the second part includes:

Determining the difference between the amplitudes of any two sub-symbols on each path in the second portion as a multiple of the step size m

Second sub-symbol, obtained and described

Sub-symbols corresponding to the second sub-symbol;

For each road and said

The sub-symbols corresponding to the second sub-symbols perform a Gamma signal extraction operation to determine the gamma curve of each path.

With reference to the foregoing second aspect, in a possible design, the acquiring the channel matrix according to the second part includes:

Obtaining, from the received symbols, a first received symbol corresponding to a symbol sent by the transmitting end device with an amplitude of [K, -K, -K]; wherein [K, -K, -K] characterizes the The first received symbol is a symbol corresponding to when the amplitude of the second sub-symbol of the first branch is K, and the amplitude of the second sub-symbol of the second branch and the third branch is -K;

Obtaining, from the received symbols, a second received symbol corresponding to a symbol sent by the transmitting end device with an amplitude of [-K, K, -K]; wherein [-K, K, -K] represents the The second received symbol is when the amplitude of the second sub-symbol of the first branch is K, the amplitude of the second sub-symbol of the second branch is K, and the amplitude of the second sub-symbol of the third branch is -K Corresponding symbol;

Obtaining, from the received symbols, a third received symbol corresponding to a symbol sent by the transmitting end device with an amplitude of [-K, -K, K]; wherein [-K, -K, K] represents the The third received symbol is a symbol corresponding to when the amplitude of the second sub-symbol of the first branch and the second branch is -K, and the amplitude of the second sub-symbol of the third branch is K;

And obtaining the channel matrix according to the first received symbol, the second received symbol, and the third received symbol.

With reference to the foregoing second aspect, in a possible design, the processing the multiple subcarrier modulation signals to obtain the data to be transmitted further includes:

If a symbol is detected and the amplitude of the three-way sub-symbol of the symbol is the minimum amplitude of the branch, determining that the sub-carrier modulation signal has a phase error, and determining a starting position of the sequence according to the symbol ;

Obtaining a Gamma curve and a channel matrix according to the third part;

The above various possible design provides a method, when the transmitting device uses the CIM to perform multiple modulations on the data to be transmitted, the transmitting device adopts a sequence including the first part, the second part, and the third part, and then based on the sequence. Form, the receiving device can know, by the first part of the sequence, whether the received subcarrier modulation signal or the amplitude modulation signal is phase inverted, and determine the starting position of the sequence in the subcarrier modulation signal, and combine the starting position The length of the sequence and the symbol transmission order of the sequence determine the second part and the third part of the sequence, and then, in conjunction with whether the phase is inverted, whether the second part is used or the third part is used to determine the channel matrix and each The Gamma curve of one way, and then adopting the channel matrix and the Gamma curve of each channel, performing nonlinear compensation, color correction, demodulation and the like on the received multi-channel subcarrier modulation signals to obtain data to be transmitted, thereby greatly improving the reception. The accuracy of the data recovery by the end device ensures that the receiving device restores The reliability of the data to be transmitted; in addition, when the subcarrier modulation signal is nonlinearly compensated, the information of the Gamma curve determined by the receiving device can also be sent to the transmitting device, and the transmitting device can perform the subcarrier modulation signal. The nonlinear compensation greatly simplifies the operation of the device at the receiving end and saves the processing overhead of the device at the receiving end. Further, the embodiment of the present application can also determine the channel matrix and the third part of the sequence when the phase is in error. The gamma curve of each way further ensures the accuracy of data restoration.

In combination with the second aspect above, in a possible design, the performing the multiple subcarrier modulation signals Processing, obtaining the data to be transmitted, specifically:

If a symbol in the sequence is detected, and another symbol of the sequence is detected again after a preset number of symbols, determining a starting position of the sequence according to the one symbol; The order of the symbol and the other symbol satisfies the symbol transmission order of the preset sequence;

Determining whether the subcarrier modulation signal has a phase error according to a symbol transmission order of the sequence and an amplitude of the one symbol and an amplitude of the another symbol;

If there is no phase error, acquiring a gamma curve and a channel matrix according to the first part, and processing the multiple subcarrier modulation signals according to the gamma curve and the channel matrix to obtain the to-be-transmitted data;

If there is a phase error, the Gamma curve and the channel matrix are acquired according to the second part, and the multi-channel subcarrier modulation signal is processed according to the Gamma curve and the channel matrix to obtain the to-be-transmitted data.

With reference to the foregoing second aspect, in a possible design, the acquiring the gamma curve according to the first part includes:

Determining the difference between the amplitudes of any two sub-symbols on each path in the first portion as a multiple of the step size m

First sub-symbol, obtained and described

Sub-symbols corresponding to the first sub-symbol;

For each road and said

The sub-symbols corresponding to the first sub-symbols perform a Gamma signal extraction operation to determine the gamma curve of each path.

With reference to the foregoing second aspect, in a possible design, the acquiring the channel matrix according to the first part includes:

Obtaining, from the received symbols, a first received symbol corresponding to a symbol sent by the transmitting end device with an amplitude of [K, -K, -K]; wherein [K, -K, -K] characterizes the The first received symbol is a symbol corresponding to when the amplitude of the first sub-symbol of the first branch is K, and the amplitude of the first sub-symbol of the second branch and the third branch is -K;

Obtaining, from the received symbols, a second received symbol corresponding to a symbol sent by the transmitting end device with an amplitude of [-K, K, -K]; wherein [-K, K, -K] represents the The second received symbol is when the amplitude of the first sub-symbol of the first branch is K, the amplitude of the second sub-symbol of the second branch is K, and the amplitude of the first sub-symbol of the third branch is -K Corresponding symbol;

Obtaining, from the received symbols, a third received symbol corresponding to a symbol sent by the transmitting end device with an amplitude of [-K, -K, K]; wherein [-K, -K, K] represents the The third received symbol is a symbol corresponding to when the amplitude of the first sub-symbol of the first branch and the second branch is -K, and the amplitude of the first sub-symbol of the third branch is K;

With reference to the foregoing second aspect, in a possible design, if any one of the plurality of modulation constellation points is detected, determining the sequence according to the symbol transmission order of the any one of the symbols and the preset sequence Starting position

And determining a decider according to the starting position, a symbol order in a preset sequence, and a length of the sequence; and acquiring the to-be-transmitted data from the multiple subcarrier modulation signals according to the decider.

With reference to the foregoing second aspect, in a possible design, the processing the multi-channel subcarrier modulation signal according to the gamma curve and the channel matrix to obtain the data to be transmitted, specifically includes:

Performing nonlinear compensation on the subcarrier modulation signal according to the Gamma curve, and performing color correction on the compensated modulation signal according to the channel matrix to obtain a corrected signal;

Deleting the order in the corrected signal according to the corrected signal and the length of the amplitude modulated signal Column, obtaining the amplitude modulated signal;

Demodulating the amplitude modulated signal to obtain the data to be transmitted.

Transmitting, by the sending end device, the information of the Gamma curve, where the information of the Gamma curve is used to instruct the transmitting end device to perform nonlinear compensation on the subcarrier modulation signal by using the Gamma curve, to obtain a compensated modulation. signal;

Receiving, by the transmitting end device, the compensated modulated signal, and performing color correction on the compensated modulated signal according to the channel matrix to obtain a corrected signal;

Deleting a sequence in the corrected signal according to the corrected signal and a length of the amplitude modulated signal to obtain the amplitude modulated signal;

The above various possible design provides a method, when the transmitting device uses the CSK to perform multiple modulations on the data to be transmitted, the transmitting device adopts the sequence of the second possible implementation manner described above, and then receives according to the sequence form. The end device can determine whether the received subcarrier modulation signal or the amplitude modulation signal is phase inverted by the first part and the second part of the sequence, and determine the starting position of the sequence in the subcarrier modulation signal, and combine the start The position, the length of the sequence, and the symbol transmission order of the sequence determine the first portion and the second portion of the sequence, and then, in conjunction with whether the phase is inverted, whether the first portion or the second portion is used to determine the channel matrix and each path The gamma curve, and then adopting the channel matrix and the Gamma curve of each channel, performing nonlinear compensation, color correction, demodulation and the like on the received multi-channel subcarrier modulation signals to obtain data to be transmitted, thereby greatly improving the receiving end. Accuracy when the device performs data restoration, ensuring that the receiving device restores The reliability of the data to be transmitted is additionally provided. In addition, when the subcarrier modulation signal is nonlinearly compensated, the information of the Gamma curve determined by the receiving end device may be transmitted to the transmitting end device, and the transmitting end device modulates the subcarrier. The non-linear compensation greatly simplifies the operation of the device at the receiving end and saves the processing overhead of the device at the receiving end. Further, the embodiment of the present application can also determine the channel matrix by using the second part of the sequence when the phase occurs. And the gamma curve of each way further ensures the accuracy of data restoration; further, the embodiment of the present application solves the problem that the CSK signal cannot be transmitted in the OCC system using the low speed camera, and the application range of the camera communication is expanded. .

In a third aspect, in order to implement the method for camera communication in the first aspect, the embodiment of the present application provides a device for camera communication, and the device for the camera communication has a function of a method for implementing the camera communication described above. The functions may be implemented by hardware or by corresponding software implemented by hardware. The hardware or software includes one or more modules corresponding to the functions described above.

In a possible implementation manner of the third aspect, the device for communicating by the camera includes a plurality of functional modules or units, and the method for implementing the camera communication of any one of the foregoing first aspects.

In another possible implementation manner of the third aspect, the structure of the device for communicating by the camera may include a processor, a receiver, and a transmitter. The processor is configured to support a corresponding function of the apparatus for performing the method of any of the above-described first aspects of camera communication. The transmitter is configured to support communication between the device and other network devices or terminal devices, for example, can be capable of transmitting multiple optical signals and integrated VLC module LED lights, and the receiver can be a camera device or a video recording device. The apparatus can also include a memory for coupling with the processor that retains program instructions and data necessary for the method by which the camera communication device performs the camera communication described above.

In a fourth aspect, in order to implement the method for camera communication in the second aspect, the embodiment of the present application provides a device for camera communication, and the device for the camera communication has a function of a method for implementing the camera communication described above. The functions may be implemented by hardware or by corresponding software implemented by hardware. The hardware or software includes one or more modules corresponding to the functions described above.

In a possible implementation manner of the fourth aspect, the device for communicating by the camera includes a plurality of functional modules or units, and the method for implementing the camera communication of any one of the foregoing second aspects.

In another possible implementation manner of the fourth aspect, the structure of the device for communicating by the camera may include a processor, a receiver, and a transmitter. The processor is configured to support a corresponding function of the method in which the apparatus performs the camera communication of any of the above second aspects. The transmitter is configured to support communication between the device and other network devices or terminal devices, for example, can be capable of transmitting multiple optical signals and integrated VLC module LED lights, and the receiver can be a camera device or a video recording device. The apparatus can also include a memory for coupling with the processor that retains program instructions and data necessary for the method by which the camera communication device performs the camera communication described above.

In a fifth aspect, an embodiment of the present application provides a computer storage medium for storing computer software instructions for a device for communicating by the camera, which includes a program designed to execute the first aspect.

In a sixth aspect, an embodiment of the present application provides a computer storage medium for storing computer software instructions for a device for communicating by the camera, which includes a program designed to execute the second aspect.

In a seventh aspect, an embodiment of the present application provides a computer program product, comprising instructions for causing a computer to perform a function performed by a device for camera communication in the above method when the computer program is executed by a computer.

In an eighth aspect, an embodiment of the present application provides a computer program product, comprising instructions for causing a computer to perform functions performed by a device for camera communication in the above method when the computer program is executed by a computer.

Compared with the prior art, in the method and device provided by the embodiments of the present application, the transmitting device performs multiple modulations on the data to be transmitted, and obtains multiple parallel amplitude modulated signals, which are parallel and independent of each other. a signal, so that it can carry different data information, so the embodiment of the present application increases the spectrum utilization of the camera communication system from the number of parallel branches of the transmitted optical signal, and additionally, because of the optical signal for each channel Amplitude modulation, therefore, the obtained amplitude modulation signal contains symbols having multiple amplitudes, and symbols of different amplitudes can carry different data information. Therefore, the embodiment of the present application further increases the spectrum utilization rate of the camera communication system from the number of amplitudes. At the same time, the transmitting device can obtain multiple initial signals based on the amplitude modulation signal and the preset sequence of each channel, thereby performing subcarrier amplitude modulation on the initial signal of each channel to avoid the signal flickering when the receiving end device performs optical signal reception. , to ensure that the receiving device receives the signal sent by the transmitting device. Nature, avoid the occurrence of flicker signal. That is to say, the embodiment of the present application further improves the spectrum utilization rate of the camera communication system on the basis of ensuring flicker-free communication.

DRAWINGS

FIG. 1 is a schematic structural diagram of a camera communication system according to an embodiment of the present application;

2 is a signaling flowchart of a method for camera communication provided by an embodiment of the present application;

3 is a waveform diagram of a sequence provided by an embodiment of the present application;

4 is a schematic flowchart of a method for camera communication according to an embodiment of the present application;

FIG. 5 is a schematic flowchart of acquiring a Gamma curve according to an embodiment of the present application;

6 is a schematic flowchart of acquiring a channel matrix according to an embodiment of the present application;

Figure 7 is a waveform diagram of a sequence provided by an embodiment of the present application;

FIG. 8 is a schematic flowchart diagram of a method for camera communication according to an embodiment of the present disclosure;

FIG. 9 is a schematic flowchart diagram of a method for camera communication according to an embodiment of the present application;

FIG. 10 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application;

FIG. 11 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application;

FIG. 12 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application;

FIG. 13 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present disclosure;

FIG. 14 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application.

detailed description

The method of camera communication provided by the embodiment of the present application can be applied to the camera communication system shown in FIG. 1. As shown in FIG. 1 , the camera communication system includes: a transmitting end device and a receiving end device, both of which are devices capable of implementing camera communication, and the transmitting end device may be an integrated LED light capable of transmitting multiple different colors of light. (The light of different colors carries the corresponding communication information, and the light may be referred to as an optical signal at this time), for example, may be an RGB LED lamp integrated with a visible light communication (VLC) module, the receiving end The device can be a device that contains a built-in camera or video recording device. Optionally, the camera communication system shown in FIG. 1 above may be applied to various communication scenarios, as long as the transmitting end device of the communication scenario integrates an LED light and a receiving end device capable of transmitting multiple different color optical signals. A built-in camera or video recording device can be used, for example, for communication between a vehicle and a vehicle. A front headlight or other light on one vehicle can be used as a transmitting device, a camera on another vehicle, or other camera device. The application scenario of the camera communication system is not limited in the embodiment of the present application.

In the existing camera communication system, how to realize a flicker-free communication when a signal is transmitted and received by a camera with a normal frame rate (for example, a frame rate of the camera is less than 60 fps). Since the frame rate of a common camera is low, and the blinking cutoff frequency CFF of the naked eye is 100 Hz, if OOK modulation is directly used, the signal transmission frequency needs to be set to be less than half of the camera frame rate, thereby achieving complete reception of the signal, but transmitting Such a low transmission frequency of the end device makes it possible to visually observe the LED flicker. In order to solve this problem, the prior art adopts an undersampling UFSOOK modulation mode, that is, a white LED of a transmitting device transmits a white light signal, and the UFSOOK system allows a receiving device (which may be a camera or a device with a built-in camera) to operate in an undersampling mode. In the following, due to the special relationship between the carrier frequency fs (fs>CFF) and the camera frame rate, it can realize the complete signal transmitted by the camera to receive the original signal, thereby achieving flicker-free communication.

However, in the above prior art, when the corresponding communication information is transmitted by white light, all the color components of the white light transmit the same communication information, and thus the spectrum utilization rate is low. Therefore, the method, device and device for camera communication provided by the present application are intended to solve the above technical problems of the prior art.

The technical solutions of the present application are described in detail below with specific embodiments. The following specific embodiments may be combined with each other, and the same or similar concepts or processes may not be described in some embodiments.

FIG. 2 is a signaling flowchart of a method for camera communication provided by an embodiment of the present application. The embodiment relates to that the transmitting end device performs multiple modulations on the data to be transmitted into a multi-channel amplitude modulation signal, so as to improve the spectrum utilization rate of the camera communication system, and obtain an initial signal of each channel according to the amplitude modulation signal of each channel, thereby The initial signal of each channel is subjected to subcarrier amplitude modulation to avoid the specific process of the signal flickering when the receiving end device performs optical signal reception. As shown in Figure 2, the method includes:

S101: the transmitting end device performs multiple modulations on the data to be transmitted, and obtains multiple amplitude modulated signals, where each The amplitude modulation signal of the path has multiple amplitudes.

Specifically, the transmitting end device of the embodiment of the present application may be an LED lamp integrated with light capable of transmitting multiple different colors, for example, an RGB LED lamp integrated with a VLC module may be integrated, and the RGB LED lamp may send three channels. Parallel and independent optical signals. When the transmitting device needs to send the data to be transmitted to the receiving device, the transmitting device performs multiple modulations on the data to be transmitted, and actually performs multiple modulation on the parallel multiple optical signals sent by the transmitting device to obtain multiple channels. The amplitude modulation signal, each channel of the amplitude modulation signal has a plurality of amplitudes, that is to say, each channel of the amplitude modulation signal includes a plurality of symbols, the plurality of symbols having a plurality of level values, and different levels of symbols can be carried Different data information in the data is transmitted. In addition, since the transmitting end device can transmit multiple parallel optical signals, after the multiple parallel optical signals are separately modulated, the obtained multi-channel amplitude modulated signals are multi-channel parallel. The amplitude modulation signal, the amplitude modulation signal of different paths can carry different data information in the data to be transmitted.

In the prior art, a white LED that transmits a white light by a transmitting end device transmits all the color components of the transmitted white light (such as red orange, yellow, green, blue, purple, etc.) when the data to be transmitted is transmitted to the receiving device. The same data information is sent in the component, and the white light signal has only two amplitudes, so the frequency utilization of the prior art is low; however, in the embodiment of the present application, the transmitting device can transmit multiple lights of different colors. The signal, therefore, after performing multiple modulations on each of the optical signals, a multi-channel amplitude modulated signal is obtained, and the multi-channel amplitude modulated signals are parallel and independent signals, so that they can carry different data information from the transmitted The number of parallel branches of the optical signal increases the spectrum utilization of the camera communication system. In addition, since a plurality of modulations are performed on each of the optical signals, the obtained amplitude modulated signal includes symbols having a plurality of amplitudes, different The symbol of the amplitude can carry different data information. Therefore, the embodiment of the present application further increases the amount of the amplitude. The spectrum utilization camera communication systems.

S102: The transmitting device adds a preset sequence before each of the amplitude modulation signals to obtain an initial signal of each channel, where the sequence is used to indicate state information of the amplitude modulation signal.

Specifically, the sequence in this embodiment may include one symbol, and may further include multiple symbols, and the symbols included in the sequence do not carry valid data information of the data to be transmitted. Optionally, the sequence may include an indication of a phase by which the receiving end device may be instructed whether the phase modulation signal has undergone phase inversion. The embodiment of the present application does not limit the specific form of the sequence, as long as it can indicate the state information of the multipath amplitude modulation signal. Optionally, the state information of the amplitude modulation signal may include whether the amplitude modulation signal has a phase reversal. Turn, or the starting position of the sequence, etc.

Optionally, the preset sequence may also include multiple parallel sequence sub-symbols, the number of branches of the sequence is equal to the number of branches of the amplitude modulation signal, and the amplitude modulation signal of each channel for each channel is for each channel. The amplitude modulation signal adds a sequence sub-symbol of the corresponding one of the sequences.

After the transmitting device adds a preset sequence to each channel's amplitude modulation signal, an initial signal for each channel is obtained. In the initial signal, before the sequence, the valid data information is followed.

S103: The source device performs Subcarrier Amplitude Modulation (SAM) on the initial signal of each channel to obtain a subcarrier modulation signal of each channel.

S104: The transmitting end device sends multiple subcarrier modulation signals to the receiving end device.

Specifically, after the transmitting device obtains the initial signal of each channel, after performing SAM on each channel initial signal, each channel's subcarrier modulation signal is obtained, so that each channel's subcarrier modulation signal is sent to the receiving device in parallel. Optionally, the transmitting device can also select an appropriate amplification factor for each subcarrier modulation signal and add an appropriate DC bias voltage (the DC bias voltage ensures undistorted transmission of the signal), thereby adding and adding DC The multi-channel subcarrier modulation signal of the bias voltage is sent to the receiving device in parallel. Based on the modulation characteristics of the SAM, when the receiving device receives multiple subcarrier modulation signals, it does not cause signal flicker, thereby ensuring signal stability between the transmitting device and the receiving device.

S105: The receiving end device receives the multiple subcarrier modulation signals sent by the sending end device.

S106: The receiving end device processes the multiple subcarrier modulation signals to obtain the to-be-transmitted data.

Specifically, after the receiving end device receives the multiple parallel subcarrier modulation signals sent by the sending end device, optionally, the receiving end device may demodulate or parse the multiple subcarrier modulation signals, optionally, Determining the starting position of the sequence by combining the signal format of each subcarrier modulation signal, or determining whether the amplitude modulation signal has phase inversion or the like, and based on the obtained information, the receiving end device can receive the multipath The subcarrier modulation signal performs compensation for nonlinear damage or phase reversal, color correction, and the like, thereby obtaining original data to be transmitted. In this embodiment, the specific manner in which the receiving end device processes the multi-channel subcarrier modulation signal is not limited, as long as it can obtain the data to be transmitted of the transmitting end device.

In the method for camera communication provided by the embodiment of the present application, the transmitting end device performs multiple modulations on the data to be transmitted, and obtains multiple parallel amplitude modulated signals, which are parallel and mutually independent signals, so they can carry different Data information, and thus the embodiment of the present application increases the spectrum utilization rate of the camera communication system from the number of parallel branches of the transmitted optical signal, and further, since multiple optical signals are applied to each channel, the obtained The amplitude modulation signal includes symbols having multiple amplitudes, and the symbols of different amplitudes can carry different data information. Therefore, the embodiment of the present application further increases the spectrum utilization ratio of the camera communication system from the number of amplitudes; meanwhile, the transmitting device is based on The amplitude modulation signal and the preset sequence of each channel can obtain multiple initial signals, thereby performing subcarrier amplitude modulation on the initial signal of each channel to avoid signal flickering when the receiving end device performs optical signal reception, thereby ensuring that the receiving end device is Receive the stability of the signal sent by the sender device to avoid its transmission Signal flashing. That is to say, the embodiment of the present application further improves the spectrum utilization rate of the camera communication system on the basis of ensuring flicker-free communication.

On the basis of the above embodiment, the preset sequence is specifically used for at least one of the following state information of the amplitude modulated signal: indicating a starting position of the sequence; indicating the subcarrier modulation signal Whether there is a phase error; indicating parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulated signal. The sequence may include various implementations, with particular reference to the first possible implementation, the second possible implementation, and the third possible implementation described below.

As a first possible implementation manner of the embodiment of the present application, the implementation manner relates to the specific content of the foregoing preset sequence. In this possible implementation, when the multi-modulation of the data to be transmitted by the transmitting device is Color-Intensity Modulation (CIM), the sequence may specifically include: a first part, a second part, and a third part. a portion; wherein the first portion includes a first symbol, the first symbol is used to indicate a starting position of the sequence in the initial signal; and the first symbol includes a plurality of parallel parallel amplitudes of K+l a first sub-symbol, where K is a maximum amplitude after CIM modulation of the data to be transmitted, the l is an arbitrary positive integer; the second part includes N second symbols,

Each second symbol includes a second sub-symbol that is multiplexed in parallel and has a preset first association relationship, and each of the N second sub-symbols of each path

The second sub-symbol has a magnitude of -K, and the remaining

The difference between the amplitudes of any two sub-symbols in the second sub-symbol is a multiple of the step size m, the multiple is a positive integer, n is the number of branches of the optical signal transmitted by the transmitting device, and the second Partially for indicating to the receiving end device parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulated signal; the third portion comprising N third symbols, the third symbol comprising multiple paths a third sub-symbol having a second correlation relationship in parallel and having a magnitude, wherein the amplitude of the N third symbols is a value obtained by performing an inverse operation on the amplitude of the second symbol of the second portion, When a phase error occurs in the subcarrier modulation signal, parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulation signal is indicated to the receiving end device.

Specifically, in the first possible implementation manner, the preset sequence includes three parts of different functions, and each part includes multiple parallel symbols. Wherein the first part comprises a first symbol, the first symbol comprises a plurality of parallel first sub-symbols having an amplitude of K+l, and the term “parallel” as used herein refers to that the sub-symbols of the plurality of branches at the same time are simultaneously Sent. When the transmitting device integrates an RGB LED, it can transmit three optical signals. Therefore, the sequence here also includes three sub-symbols, and the amplitude of the first symbol of the first portion can be [K+l, K+l, K +l], the first part is used to indicate the starting position of the sequence in the initial signal of each way. The receiving end device may determine the starting position of the sequence in the multiple subcarrier modulation signal in combination with the first part and the symbol sending order when the transmitting end device that the receiving end device knows in advance sends the sequence. For specific determination methods, refer to the following description of the embodiments.

For the second part of the first possible implementation, the second part may comprise N second symbols,

n is the number of branches of the optical signal transmitted by the transmitting device, and each second symbol includes a plurality of parallel second sub-symbols having a first correlation relationship between the amplitudes, that is, a certain time is sent The second symbol is actually a parallel multiplexed second sub-symbol, and the amplitude between the multiplexed second sub-symbols transmitted at that moment is correlated. Here again, the RGB LED is integrated with the transmitting device, and the second part includes N second symbols.

A second symbol includes three second sub-symbols in parallel and having a first correlation relationship, for example, assuming that the amplitude of the second symbol transmitted at the first moment is [-K, -K, -K], that is, when RGB When the amplitude of the red sub-symbol on the red branch sent by the LED at the first moment is -K, the amplitude of the green branch and the blue branch at the first moment can only be -K, assuming the second time sent at the second moment. The amplitude of the symbol is [K, -K, -K], that is, when the amplitude of the red sub-symbol on the red branch sent by the RGB LED at the first moment is K, the green branch and the blue branch are at the first moment. The amplitude can only be -K, that is, at each moment, there is a corresponding correlation between the amplitudes of the three second sub-symbols, that is, the amplitudes of the three second sub-symbols belonging to the same second symbol. There is an association between them. In the second part, in each of the N second sub-symbols

The second sub-symbol has a magnitude of -K, and the remaining

The difference between the amplitudes of any two sub-symbols in the second sub-symbol is a multiple of the step size m. Optional, the remaining

The second sub-symbol may be a series of symbol strings continuously incremented to K from -K in steps of m, or may be a symbol string continuously decremented to -K in steps of m from K, or may be any Sequential

Second sub-symbol. The second part is configured to indicate to the receiving end device parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulated signal, and the receiving end device can determine the gamma curve and the channel matrix of each path in combination with the second part, thereby The received multiple subcarrier modulation signals perform nonlinear damage compensation and corresponding color correction. The specific gamma curve and the determination of the channel matrix can be found in the following embodiments.

For the third part of the first possible implementation, the third part comprises N third symbols, the third symbol comprises a third sub-symbol with multiple parallels and a second associated relationship of amplitudes The amplitude of the N third symbols is a value obtained by performing an inverse operation on the amplitude of the second symbol of the second portion, that is, the third portion is actually all the first parts of the second part. The amplitude of the two symbols is the sequence obtained after the inverse operation. It should be noted that the “inversion” here is only for the inverse of the amplitude, and does not limit the order of the third symbol of the third part, that is, the third part may be the amplitude of the second symbol of the second part. The partial sequence obtained after the direct inversion may be the partial sequence obtained by rearranging all the obtained third symbols again after the amplitude of the second symbol of the second part is directly inverted, and the embodiment of the present application is This is not a limitation. The third portion is configured to, when the phase error of the subcarrier modulation signal occurs, indicate parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulation signal to the receiving end device. Similarly, the RGB LED is integrated with the transmitting device, and the third part includes N third symbols.

A third symbol includes a third sub-symbol that is three-way parallel and has a second correlation.

It should be noted that the order between the first part, the second part and the third part in the above sequence may be that the first part is in the front, the second part is in the middle, the third part is in the end, or the second part is in the front. The first part is in the middle, the third part is in the end, and the third part is in the front, the first part is in the middle, the second part is in the end, and other arrangements are possible. The order of the three parts in the embodiment of the present application Not limited.

On the other hand, whether the second symbol of the second part or the third symbol of the third part, from the perspective of the symbol, the second symbol in the second part may be arranged in a certain order, or may be disordered in order The arrangement of the third symbol in the third part may also be arranged in a certain order, or may be arranged in a disorderly manner. This embodiment of the present application does not limit this.

For example, the RGB LED is integrated with the transmitting device (for example, the transmission of the three-way optical signal is continued as an example), and further, as one of the first possible implementations, the second and third portions are used. Alternatively, the second part may include a three-way incremental sub-symbol string, and the incremental sub-symbol string of each path includes

a sub-symbol, the amplitude of the sub-symbol in the increasing sub-symbol string is continuously incremented to K from -K at equal intervals in m steps; the third portion may include a three-way decreasing sub-symbol string, decrementing sub-symbols of each path String includes

a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is successively decremented to -K at intervals of m in steps of m; and the first correlation relationship includes: when the amplitude of the sub-symbol of any one of the paths is from - When K starts to increase in increments of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are all -K; the second correlation relationship includes: the amplitude of the sub-symbols of any one of the paths When K is successively decremented to -K at equal intervals in steps of m to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are all K.

Specifically, the optional manner is directed to a possible form of the second part and the third part. For the waveform diagram of the sequence shown in FIG. 3, the sequence in FIG. 3 includes three sub-symbols. The path sub-symbol is divided into a first part, a second part and a third part, and the first part marked in FIG. 3 includes a first symbol having an amplitude of [K+l, K+l, K+l], the first symbol It is composed of three first sub-symbols, which are a first sub-symbol of amplitude K+l of the red branch, a first sub-symbol of amplitude K+l of the green branch, and an amplitude of the blue branch. Is the first subsymbol of K+l. The second part of Figure 3 includes three incremental substrings, each of which includes an incrementing subsymbol string.

Second sub-symbol, the

The amplitudes of the second sub-symbols are successively incremented to K from -K at equal intervals in m steps. It should be noted that the three-way incremental sub-symbol strings are not transmitted in parallel, but according to "the amplitude of the sub-symbols of any one of the sub-symbols is continuously incremented to K at equal intervals of m from -K to form the incrementer. When the symbol string is transmitted, the other parallel two-way sub-symbols are transmitted with the first correlation of -K", that is, see the waveform in FIG. 3, when the red branch transmits the incremental symbol string, the green branch and the blue The amplitude of the second sub-symbol on the color branch is -K. When the green branch transmits the increasing symbol string, the amplitude of the second sub-symbol of the red branch and the blue branch is -K, when the blue branch When the incremental symbol string is transmitted, the amplitude of the second sub-symbol of the green branch and the red branch is -K. The waveform of the third portion in FIG. 3 and the waveform of the second portion are inversely proportional in magnitude, the third portion includes a three-way decreasing sub-symbol string, and the decrementing sub-symbol string of each path includes

Third sub-symbol, the

The amplitudes of the third sub-symbols are successively decremented to -K at equal intervals of m in steps of K. It should be noted that the three-way decrementing sub-symbol strings are not transmitted in parallel, but according to "the decrement is formed when the amplitudes of the sub-symbols of any one of the sub-symbols are successively decremented to -K at equal intervals in m steps. When the symbol string is transmitted, the other parallel two-way sub-symbols are transmitted with the second correlation of K", that is, see the waveform in FIG. 3, when the red branch transmits the descending symbol string, the green branch and the blue The amplitude of the third sub-symbol on the branch is K. When the green branch transmits the decreasing symbol string, the amplitude of the third sub-symbol of the red branch and the blue branch is K, when the blue branch transmits the decreasing symbol. In the case of a string, the amplitude of the third sub-symbol of the green branch and the red branch is K.

It should be noted that the incremental sub-symbol string and the other second sub-symbol in the second part are interchangeable with the descending sub-symbol string and the other third sub-symbol in the third part, that is, the second part includes the decrementing sub-symbol and a third sub-symbol, the third portion comprising an increasing sub-symbol string and a second sub-symbol. Based on the situation, when the phase of the sub-carrier modulation signal is inverted, the gamma curve and the channel matrix may be determined based on the second portion. When the phase of the subcarrier modulation signal is not inverted, the determination of the Gamma curve and the channel matrix can be performed based on the third portion.

In summary, in the first possible implementation manner, the first part, the second part, and the third part of the sequence may enable the receiving end device to determine the starting position of the sequence in each subcarrier modulation signal. And knowing whether the received subcarrier modulation signal or the amplitude modulation signal has phase inversion, and also obtaining the channel matrix and the Gamma curve of each channel according to the second part or the third part, thereby receiving the multipath The subcarrier modulation signal compensates for nonlinear damage and corresponding color correction, etc., improves the accuracy of the data recovery by the receiving end device, and ensures the reliability of the data to be transmitted restored by the receiving end device.

In conjunction with the description of the content of the preset sequence in the first possible implementation manner, another embodiment of the present application provides a schematic flowchart of a method for camera communication. Referring to FIG. 4, the embodiment relates to the foregoing A possible implementation manner is that when the transmitting end device uses multiple modulations to be transmitted by the CIM to be transmitted, the receiving end device processes the received multiple subcarrier modulation signals to obtain a specific process of the data to be transmitted. It should be noted that, in this embodiment, the RGB LED is integrated with the transmitting end device as an example, that is, the sequence includes three sub-symbols as an example for description. As shown in FIG. 4, the foregoing S107 may specifically include:

S201: If the receiving device detects a symbol, determine whether the amplitude of the three-way sub-symbol of the symbol is the maximum amplitude of the branch. If yes, execute S202, if no, execute S205.

Specifically, before the present embodiment is introduced, the possibility between the amplitude of the symbol transmitted by the transmitting device and the amplitude of the symbol received by the receiving device is first described. For example, suppose the sender device sends a symbol of [K+l, K+l, K+l], and the amplitude of the symbol received by the receiving device may be [K+l, K+l, K+l]. It may also be a symbol that is closer to the amplitude of [K+l, K+l, K+l], that is, the symbol sent by the transmitting device and the symbol received by the receiving device may be inconsistent due to the influence of the propagation medium and the surrounding environment. Case.

Therefore, in the embodiment of the present application, the receiving end device receives the multipath amplitude modulation signal sent by the transmitting end device, and the receiving end device actually receives the symbol according to one symbol and then one symbol. When the receiving device detects a symbol, the receiving device determines whether the amplitude of the three-way sub-symbol of the symbol is the maximum amplitude of the branch on which it is located. If so, the following S202 to S204 are performed, and if not, S205 and S206 are executed.

S202: If the amplitude of the three-way sub-symbol of the symbol is the maximum amplitude of the branch road, according to the preset order The symbol transmission order of the columns and the symbols determine the starting position of the sequence. S203 and S204 are performed.

Specifically, when the receiving end device determines that the amplitude of the three sub-symbols of the currently received symbol is the maximum amplitude of the branch, the receiving end device determines that the currently received sub-carrier modulation signal or the amplitude modulation signal does not have a phase. Inversion (here, it should be noted that the sign of the three-way sub-symbols whose amplitude is the maximum amplitude of the branch will only appear in the first part, and the second part and the third part will not appear such symbols). Then, since the sequence of symbol transmission of the sequence sent by the receiving device to the transmitting device is known, the receiving device can determine the amplitude of the current three-way sub-symbol as the maximum amplitude of the branch on the branch in combination with the symbol transmission sequence of the sequence. The symbol is located at the first position, and then the starting position of the sequence in the subcarrier modulation signal is determined according to the position of the current symbol, and then according to the length of the sequence and the starting position, it is known from which position is valid data. The location of the symbol.

To illustrate this step more clearly, here is a simple example to illustrate:

Assuming that the sequence includes Y symbols, the transmitting device transmits a first symbol of amplitude [K+l, K+l, K+l] at the Yth position, when the receiving device receives a symbol, and the symbol The amplitude of the three sub-symbols is the maximum amplitude of the branch, and the receiving device determines that the symbol is the Yth symbol, so that the receiving device can learn to push Y-1 from the Y position according to the length of the sequence. The position after the symbol is the starting position of the sequence. If the receiving device detects the next symbol again, the symbol is the valid data symbol, that is, the first symbol of the X symbols in FIG. It should be noted that the amplitude of the above three sub-symbols whose maximum amplitude is on the branch may be the first symbol.

S203: Determine a second part and a third part of the sequence according to the starting position, the length of the sequence, and the symbol transmission order of the sequence.

Specifically, after the receiving end device determines the starting position of the sequence in the subcarrier modulation signal, the receiving end device may combine the starting position, the length of the sequence, and the symbol sending order of the sequence, that is, the receiving end device may The starting position and the symbol transmission order of the sequence determine the lengths of the second part and the third part, respectively. For example, if the length of the sequence is Y symbols, the lengths of the second part and the third part are both (Y-1) /2 symbols, then the receiving device can combine the sequence of symbol transmissions of the sequence, knowing that the received symbol is located at the first position of the sequence, and combining the amplitudes of the three sub-symbols of the symbol to determine the currently received Whether the symbol belongs to the second part or the third part. For example, if the receiving device receives a symbol, for example, if the symbol is a symbol of [-K–KK], the receiving device can combine the amplitude of the symbol and the symbol transmission sequence of the sequence to know that the symbol is located at the first position. It is determined that the amplitude of the symbol will only appear in the second portion, and therefore, the symbol determining the position is the symbol of the second portion.

Optionally, according to the starting position of the sequence, the length of the sequence, and the waveform of the symbol in the sequence (ie, the association relationship of the three sub-symbols), which symbols belong to the second part, and which symbols belong to the third part, that is, The second and third parts of the sequence.

S204: Acquire a Gamma curve and a channel matrix according to the second part. Execute S207.

Specifically, after the receiving end device determines the second part and the third part of the sequence in the subcarrier modulation signal, since the receiving end device determines that the subcarrier modulation signal does not undergo phase inversion, the receiving end device determines to adopt subcarrier modulation. The second part of the sequence in the signal determines the Gamma curve and the channel matrix. For the specific determination manner, refer to the embodiment shown in FIG. 5 and the embodiment shown in FIG. 6.

It should be noted that each subcarrier modulation signal corresponds to a Gamma curve, that is, the receiving end device needs to determine the gamma curve of each channel according to the three-way sub-symbol of the sequence, but the multi-channel sub-carrier modulation signal corresponds to one channel matrix at the same time. .

S205: If the amplitude of the three-way sub-symbol of the symbol is the minimum amplitude of the branch, determining that the sub-carrier modulation signal has a phase error, and determining a starting position of the sequence according to the symbol. Thereafter, S206 and S207 are executed.

Specifically, when the receiving end device determines that the amplitude of the three-way sub-symbol of the currently received symbol is the minimum amplitude of the branch, the receiving end device determines that the currently received sub-carrier modulation signal or the amplitude modulation signal has a phase inverse. Turning (here, it should be noted that the sign of the three-way sub-symbols whose amplitude is the minimum amplitude of the branch will only appear in the first part, and the second part and the third part will not appear such symbols). Then, since the sequence of symbol transmission of the sequence sent by the receiving device to the transmitting device is known, the receiving device can determine the amplitude of the current three-way sub-symbol as the minimum amplitude of the branch on the branch in combination with the symbol transmission sequence of the sequence. The symbol is located at the first position, and then the starting position of the sequence in the subcarrier modulation signal is determined according to the position of the current symbol, and then according to the length of the sequence and the starting position, it is known from which position is valid data. The location of the symbol.

To illustrate this step more clearly, here is a simple example to illustrate:

Assuming that the sequence includes Y symbols, the transmitting device transmits a symbol of amplitude [-Kl, -Kl, -Kl] at the Yth position, when the receiving device receives a symbol, and the amplitude of the three sub-symbols of the symbol The minimum amplitude is on the branch, and the receiving device determines that the symbol is the Yth symbol, so that the receiving device can know that the position after pushing the Y-1 symbols from the Y position is based on the length of the sequence. The starting position of the sequence, if the receiving device detects the next symbol again, the symbol is the valid data symbol, that is, the first symbol of the X symbols in FIG. It should be noted that the amplitude of the above three sub-symbols whose minimum amplitude is on the branch may be the symbol of the amplitude [-K-l, -K-l, -K-l] transmitted by the transmitting device.

S206: Obtain a Gamma curve and a channel matrix according to the third part.

Specifically, after the receiving end device determines that the subcarrier modulation signal or the amplitude modulation signal has undergone phase inversion, in combination with the second part and the third part of the sequence determined by the receiving end device, the receiving end device determines to adopt the third part. Obtaining a Gamma curve and a channel matrix. The acquisition method can be referred to the following steps 5 and 6 in which the receiving end device uses the second part to acquire the Gamma curve and the channel matrix, and only needs to replace the second part with the third part. However, the manner of obtaining is similar, and details are not described herein again.

It can be seen that, in the embodiment of the present application, when the phase of the subcarrier modulation signal received by the receiving end device is reversed, the channel matrix and the gamma curve of each channel can still be obtained according to the third part of the sequence.

S207: Process the multiple subcarrier modulation signals according to the gamma curve and the channel matrix to obtain the to-be-transmitted data.

Specifically, after the receiving end device obtains the channel matrix and the Gamma curve of each path, the received multi-subcarrier modulation signal is processed by using the channel matrix and the Gamma curve of each path, where the subcarrier modulation is performed for one way. For the processing of the signal, for example, the processing method of the subcarrier modulation signal of each of the other channels is the same, and the path is assumed to be the subcarrier modulation signal of the A channel, and the specific processing manner is as follows: the receiving device is based on the Gamma curve of the A channel. The subcarrier modulation signal of channel A is nonlinearly compensated, and the compensated modulated signal is color-corrected according to the obtained channel matrix to obtain the corrected signal of each channel, and then the receiving device according to the corrected signal of the path And the length of the amplitude modulation signal of the original A way, delete the sequence in the corrected signal of the path (here the sequence refers to Is the sequence sub-symbol located in the path in the above sequence), and obtains the amplitude modulation signal of the A path. Alternatively, when deleting the sequence in the corrected signal, it may be deleted every X valid data information or valid data symbols. Y sequence subsymbols. Finally, the receiving end device uses the CIM to demodulate the amplitude modulated signal of the A channel to obtain valid data information of the data to be transmitted transmitted on the road. Since the receiving end device processes the subcarrier modulation signals of each channel in parallel, finally, the complete data to be transmitted can be obtained.

Optionally, the receiving end device may further send, according to the obtained Gamma curve of each path, the information of the Gamma curve of each path to the transmitting end device, where the information of the Gamma curve is used to indicate that the transmitting end device uses the Gamma curve to the subcarrier. The modulated signal is nonlinearly compensated to obtain a compensated modulated signal; after receiving the information of the Gamma curve of each channel transmitted by the receiving device, the transmitting device combines the Gamma curve of each channel to perform the non-subcarrier modulated signal of each channel. Linear compensation, thereby obtaining a multi-channel compensated modulated signal; then, the transmitting device transmits the obtained compensated modulated signal to each of the receiving devices in parallel, so that the receiving device can perform all the channels according to the obtained channel matrix. The compensated modulated signal is color-corrected to obtain a corrected signal, and then the sequence in the corrected signal is deleted according to the length of the corrected signal and the amplitude modulated signal, and an amplitude modulated signal is obtained and demodulated Get the data to be transmitted. This optional method greatly simplifies the operation of the receiving device and saves the processing overhead of the receiving device.

FIG. 5 is a schematic flowchart of obtaining a Gamma curve according to an embodiment of the present application, and FIG. 6 is a schematic flowchart of acquiring a channel matrix according to an embodiment of the present application. Based on the above embodiment, referring to FIG. 5, the method for acquiring a Gamma curve according to the second part includes:

S301: According to the difference between the amplitudes of any two sub-symbols on each road in the second part, a multiple of the step size m

Second sub-symbol, obtained and described

Sub-symbols corresponding to the second sub-symbol.

S302: for each road and said

Specifically, when the receiving end device determines that the received subcarrier modulation signal does not undergo phase inversion, the second part acquires a Gamma curve of each path, specifically: the receiving end device according to any two subpaths in each path in the second part. The difference between the amplitudes of the symbols is a multiple of the step size m

Second sub-symbol, obtaining a step relationship with the amplitude

The sub-symbol corresponding to the second sub-symbol (the number of sub-symbols is also

()), these sub-symbols are non-equal-increasing sub-symbols. Based on the non-equal interval incrementing sub-symbols, the receiving end device performs a Gamma signal extraction operation to determine a Gamma curve for each path.

An embodiment of obtaining a channel matrix by using the second part in FIG. 6 may specifically include the following steps:

S401: Obtain, from the received symbol, a first received symbol corresponding to a symbol sent by the transmitting end device with an amplitude of [K, -K, -K]; wherein, [K, -K, -K] is characterized The first received symbol is a symbol corresponding to when the amplitude of the second sub-symbol of the first branch is K, and the amplitude of the second sub-symbol of the second branch and the third branch is -K.

S402: Acquire, from the received symbol, a second received symbol corresponding to a symbol sent by the sending end device with a range of [-K, K, -K]; wherein, [-K, K, -K] is characterized The second received symbol is when the amplitude of the second sub-symbol of the first branch is K, the amplitude of the second sub-symbol of the second branch is K, and the amplitude of the second sub-symbol of the third branch is -K The symbol corresponding to the time.

S403: Acquire, from the received symbol, a third received symbol corresponding to a symbol sent by the sending end device with a range of [-K, -K, K]; wherein, [-K, -K, K] is characterized The third received symbol is a symbol corresponding to when the amplitude of the second sub-symbol of the first branch and the second branch is -K and the amplitude of the second sub-symbol of the third branch is K.

In this embodiment, the symbol received by the receiving end device includes a sequence of multiple sub-symbols. When the receiving end device determines the channel matrix according to the received symbol, the receiving end device receives the received symbol according to the sending mechanism of the transmitting end device. Acquiring a plurality of received symbols corresponding to the sending mechanism; wherein the sending mechanism is configured to represent a condition that the plurality of received symbols should satisfy, and an amplitude of each of the plurality of received symbols is actually in a channel matrix Elements. Optionally, the sending mechanism may be the sending mechanism in the foregoing S401 to S403 (the foregoing S401 to S403 are not strictly time-limited, and the three may be executed in parallel, and may be executed one after the other. This is not limited. It should be noted that the above S401 to S403 are exemplified by the fact that the RGB LED is integrated on the transmitting device, but the embodiment of the present application is not limited thereto. When the other LEDs above or two optical signals are used, the above S401, S402 and S403 may be deformed accordingly.

For example, the RGB LED is integrated with the sending device. The above sending mechanism may be: the receiving device can obtain the symbol corresponding to the transmitting device with the amplitude of [K, -K, -K] from the received symbol. The first receiving symbol, at the same time, the receiving end device can also obtain, from the received symbol, the second receiving symbol corresponding to the sending end device transmitting the symbol of amplitude [-K, K, -K], and The third received symbol corresponding to the symbol sent by the transmitting device with the amplitude of [-K, -K, K] is obtained from the received symbols. Where [K, -K, -K] characterizes the first received symbol as the amplitude of the second sub-symbol of the first branch is K, and the amplitude of the second sub-symbol of the second branch and the third branch The symbol corresponding to -K, [-K, K, -K] characterizes the second received symbol as the amplitude of the second sub-symbol of the first branch is K, and the second sub-symbol of the second branch The amplitude of the second sub-symbol of the third branch is the symbol corresponding to -K, and [-K, -K, K] characterizes the third received symbol as the first branch and the second The amplitude of the second sub-symbol of the branch is -K, and the amplitude of the second sub-symbol of the third branch is K.

S404: Obtain the channel matrix according to the first received symbol, the second received symbol, and the third received symbol.

Specifically, taking the RGB LED integrated by the transmitting device as an example, the first received symbol, the second received symbol, and the third received symbol are symbols having three sub-symbols, each of the sub-symbols having respective amplitudes and receiving The end device performs corresponding arrangement of the first received symbol, the second received symbol and the third received symbol to obtain a channel matrix having 9 elements in the channel matrix.

In conjunction with the embodiments shown in Figures 5 and 6 above, the receiving end device obtains the channel matrix and the gamma curve for each path. Then, the receiving end device processes the received multi-channel subcarrier modulation signal based on the channel matrix and the gamma curve of each channel to obtain the data to be transmitted.

The method for camera communication provided by the embodiment of the present application, when the transmitting device uses the CIM to perform multiple modulations on the data to be transmitted, the transmitting device adopts the sequence of the sequence in the first possible implementation manner, and then based on the sequence of the sequence. The receiving end device can learn, by using the first part of the sequence, whether the received subcarrier modulation signal or the amplitude modulation signal is phase inverted, and determining the starting position of the sequence in the subcarrier modulation signal, and combining the starting position, The length of the sequence and the symbol transmission order of the sequence determine the second part and the third part of the sequence, and then, in conjunction with whether the phase is inverted, whether the second part is used or the third part is used to determine the channel matrix and each path The gamma curve, and then adopting the channel matrix and the Gamma curve of each channel, performing nonlinear compensation, color correction, demodulation and the like on the received multi-channel subcarrier modulation signals to obtain data to be transmitted, thereby greatly improving the receiving end. Accuracy when the device performs data restoration, ensuring that the receiving device restores Reliable data to be transmitted In addition, when the subcarrier modulation signal is nonlinearly compensated, the information of the Gamma curve determined by the receiving end device can also be sent to the transmitting end device, and the transmitting end device nonlinearly compensates the subcarrier modulation signal, which greatly simplifies The complexity of the operation of the receiving device is also saved, and the processing overhead of the receiving device is also saved. Further, in the embodiment of the present application, the third part of the sequence may be used to determine the channel matrix and the gamma curve of each channel when the phase is in error. Further ensure the accuracy of data restoration.

As a second possible implementation manner of the embodiment of the present application, the implementation manner relates to another specific content of the foregoing preset sequence. In this possible implementation, when the multiple modulations to be transmitted by the transmitting device are color shift keying CSK, the sequence may specifically include: a first part and a second part; the first part includes N first symbol,

Each first symbol includes a first sub-symbol that is multiplexed in parallel and has a preset first association relationship, and each of the N first sub-symbols of each path

The first sub-symbol has a magnitude of -K, and the remaining

The difference between the amplitudes of any two sub-symbols in the first sub-symbol is a multiple of the step size m, the multiple is a positive integer, n is the number of branches of the optical signal transmitted by the transmitting device; the second The portion includes N second symbols, the second symbol includes three second sub-symbols having parallel and amplitudes having a preset second association, the amplitude of the N second symbols being the first portion The amplitude of the first symbol performs a value after the inverse operation;

Specifically, in the first possible implementation manner, the preset sequence includes two parts of different functions, and each part includes multiple parallel symbols. Wherein the first part may include N first symbols,

n is the number of branches of the optical signal sent by the transmitting device, and each first symbol includes a plurality of parallel first sub-symbols having a first association relationship between the amplitudes, that is, a certain time is sent The first symbol is actually sent the parallel multi-channel first sub-symbol, and the amplitude between the multiple parallel first sub-symbols transmitted at this moment is correlated. Here again, the RGB LED is integrated with the transmitting device, and the first part includes N first symbols.

A first symbol includes three first parallel sub-symbols having the first correlation relationship, for example, assuming that the amplitude of the first symbol transmitted at the first moment is [-K, -K, -K], that is, when RGB When the amplitude of the red sub-symbol on the red branch sent by the LED at the first moment is -K, the amplitude of the green branch and the blue branch at the first moment can only be -K, assuming the first time sent at the first moment. The amplitude of the symbol is [K, -K, -K], that is, when the amplitude of the red sub-symbol on the red branch sent by the RGB LED at the first moment is K, the green branch and the blue branch are at the first moment. The amplitude can only be -K, that is, at each moment, there is a corresponding correlation between the amplitudes of the three first sub-symbols, that is, the amplitudes of the three first sub-symbols belonging to the same first symbol. There is an association between them. In the first part, in each of the N first sub-symbols of each way

The first sub-symbol has a magnitude of -K, and the remaining

The difference between the amplitudes of any two sub-symbols in the first sub-symbol is a multiple of the step size m. Optional, the remaining

The first sub-symbol may be a series of symbol strings continuously incremented to K from -K in steps of m, or may be a symbol string continuously decremented to -K in steps of m from K, or may be arbitrary Sequential

The first sub-symbol.

For the second part of the first possible implementation, the second part comprises N second symbols, the second symbol comprises a second sub-symbol with multiple parallel and amplitudes having a preset second association relationship The amplitude of the N second symbols is a value obtained by performing an inverse operation on the amplitude of the first symbol of the first portion, that is, the second portion is actually the second possible implementation manner described above. The amplitude of all the first symbols of the first part of the sequence is performed after the inverse operation. It should be noted that the “inversion” here is only for the inverse of the amplitude, and does not limit the order of the second symbol of the second part, that is, the second part may be the amplitude of the first symbol of the first part directly The partial sequence obtained after the negation may be a partial sequence obtained by rearranging all the obtained second symbols again after the amplitude of the first symbol of the first part is directly inverted, which is the embodiment of the present application. Not limited. Similarly, the RGB LED is integrated with the transmitting device, and the second part includes N second symbols.

A second symbol includes a third sub-symbol having three parallels and a second correlation.

The first part and the second part are used together to indicate a starting position of the sequence, and parameter information for indicating to the receiving end device a gamma gamma curve and a channel matrix for determining the amplitude modulated signal. After receiving the received multiple subcarrier modulation signals, the start position of the sequence in the multiple subcarrier modulation signals may be determined based on the first portion and the second portion of the sequence (ie, as described above, the sequence includes multiple sub-symbols) And determining a channel matrix corresponding to the multi-channel subcarrier modulation signal based on the sequence, and a Gamma curve corresponding to each sub-carrier modulation signal. For determining the specific Gamma curve and the channel matrix, refer to the description of the following embodiments.

It should be noted that the order between the first part and the second part in the above sequence may be that the first part is in front and the second part is in the back, or the second part is in front and the first part is in the back. The order of the two parts is not limited.

On the other hand, whether it is the first symbol of the first part or the second symbol of the second part, from the perspective of the symbol, the first symbol in the first part may be arranged in a certain order, or may be a disordered manner. Arranged, the second symbol in the second part may also be arranged in a certain order, or may be arranged in a disordered manner. This embodiment of the present application does not limit this.

Continuing with the example that the RGB LED is integrated on the transmitting device (ie, continuing to send the three-way optical signal by the transmitting device), further, as one of the first and second portions of the second possible implementation manner described above Alternatively, the first part may include three increasing sub-symbol strings, and the increasing sub-symbol string of each path includes

a sub-symbol, the amplitude of the sub-symbol in the increasing sub-symbol string is continuously incremented to K from -K at equal intervals in m steps; the second portion includes three decrementing sub-symbol strings, decrementing sub-symbol strings of each way include

Specifically, the optional manner is directed to a possible form of the first part and the second part. For the waveform diagram of the sequence shown in FIG. 7, the sequence in FIG. 7 includes three sub-symbols, and the three-way sub-symbol The symbol is divided into a first part and a second part. The first part of Figure 7 includes three increasing sub-symbol strings, each of which increments the sub-symbol string including

First sub-symbol, the

The amplitudes of the first sub-symbols are successively incremented to K from -K starting at intervals of m. It should be noted that the three-way incremental sub-symbol strings are not transmitted in parallel, but according to "the amplitude of the sub-symbols of any one of the sub-symbols is continuously incremented to K at equal intervals of m from -K to form the incrementer. When the symbol string is transmitted, the other parallel two-way sub-symbols are transmitted with the first correlation of -K", that is, see the waveform in FIG. 7, when the red branch transmits the incremental symbol string, the green branch and the blue The amplitude of the first sub-symbol on the color branch is -K. When the green branch transmits the increasing symbol string, the amplitude of the first sub-symbol of the red branch and the blue branch is -K, when the blue branch When the incremental symbol string is transmitted, the amplitude of the first sub-symbol on the green branch and the red branch is -K. The waveform of the second portion in FIG. 7 is opposite in amplitude to the waveform of the first portion, the second portion includes a three-way decreasing sub-symbol string, and the decrementing sub-symbol string of each path includes

Third sub-symbol, the

The amplitudes of the second sub-symbols are successively decremented to -K at equal intervals of m in steps of K. It should be noted that the three-way decrementing sub-symbol strings are not transmitted in parallel, but according to "the decrement is formed when the amplitudes of the sub-symbols of any one of the sub-symbols are successively decremented to -K at equal intervals in m steps. In the case of a symbol string, the other parallel two-way sub-symbols are transmitted in a second relationship of K", that is, see the waveform in FIG. 7, when the red branch transmits the descending symbol string, the green branch and the blue The amplitude of the second sub-symbol on the branch is K. When the green branch transmits the decreasing symbol string, the amplitude of the second sub-symbol of the red branch and the blue branch is K, when the blue branch transmits the decreasing symbol In the case of a string, the amplitude of the second sub-symbol of the green branch and the red branch is K.

In summary, in the second possible implementation manner, the first part and the second part of the sequence may enable the receiving end device to determine the starting position of the sequence in each subcarrier modulation signal, and obtain the receiving Whether the subcarrier modulation signal or the amplitude modulation signal to the phase inversion occurs, and the channel matrix and the Gamma curve of each channel are obtained according to the first part and the second part, thereby performing the received multiple subcarrier modulation signals. The compensation of the nonlinear damage and the corresponding color correction improve the accuracy of the data recovery at the receiving end device and ensure the reliability of the data to be transmitted restored by the receiving device.

In conjunction with the description of the content of the preset sequence in the second possible implementation manner, another embodiment of the present application provides a schematic flowchart of a method for camera communication. Referring to FIG. 8 , the embodiment relates to the foregoing. There are two possible implementation manners, that is, when the transmitting end device uses multiple modulations to be transmitted by the CSK to be transmitted data, the receiving end device processes the received multiple subcarrier modulation signals to obtain a specific process of the data to be transmitted. It should be noted that, in this embodiment, the RGB LED is integrated with the transmitting end device as an example, that is, the sequence includes three sub-symbols as an example for description. As shown in FIG. 8, the foregoing S107 may specifically include:

S501: If one symbol in the sequence is detected, and another symbol of the sequence is detected again after a preset number of symbols, determining a starting position of the sequence according to the one symbol; The order in which one symbol and the other symbol are described satisfies the symbol transmission order of the preset sequence.

Specifically, when receiving the multiple subcarrier modulation signals, the receiving end device receives one symbol and then one symbol, but because the symbol is continuously transmitted, the receiving end device does not know the currently received symbol when receiving. It is the first symbol, and it is necessary to combine the order of symbol transmission of the preset sequence and the amplitude of the detected symbol to know that the currently received symbol is the first symbol. In this embodiment, when the receiving end device detects one symbol of the sequence, and detects another symbol of the sequence again after the preset number of symbols, the order of sending the two symbols to each other satisfies the symbol sending order of the sequence. Then, the receiving device determines that the "one symbol" received before is the starting position of the sequence. To illustrate this step more clearly, here is a simple example to illustrate:

Assume that when the transmitting device sends a sequence, the sequence of symbol transmission in its sequence is C symbol (amplitude K1), A symbol (amplitude is K2), B symbol (amplitude is K3), F symbol (amplitude is -K3), E symbol (Amplitude is -K2), D symbol (amplitude is -K1), wherein the A symbol, the B symbol, the C symbol are the first symbol of the first part, the F symbol, the E symbol, and the D symbol are the second symbol of the second part, 6 Each symbol includes a three-way sub-symbol. The amplitudes of K1, K2, K3, -K1, -K2, and -K3 are all a generation. It is actually composed of the amplitudes of three sub-symbols. Simplify the description, and set the preset number of intervals to three.

When the receiving end device detects the C symbol of amplitude K1 and then detects the E symbol of amplitude -K2 again after three symbols, the receiving device knows the order between the C symbol and the E symbol. That is, the receiving device knows that the transmitting device is the first to transmit the C symbol and the fifth to transmit the E symbol when transmitting the sequence. Therefore, the receiving device determines that the order between the C symbol and the E symbol is currently satisfied. The symbol transmission order, the receiving device can determine the current C symbol according to the C symbol, that is, the sequence start position. Of course, if the receiving end device detects the A symbol and then detects a D symbol again after three symbols are separated, since the receiving end device knows that the transmitting end device is the second transmitting A symbol when transmitting the sequence, the sixth sending The D symbol, therefore, the receiving end device determines that the order between the A symbol and the D symbol is currently detected to satisfy the symbol transmission order of the sequence, so the receiving end device learns that the A symbol is the second position of the sequence, adjacent to the A symbol. The previous symbol is the starting position of the sequence.

S502: Determine whether the subcarrier modulation signal has a phase error according to a symbol transmission order of the sequence and an amplitude of the one symbol and an amplitude of the another symbol; if not, execute S503, and if yes, execute S504.

Specifically, taking the example given in the above S501 as an example, when the receiving end device detects the C symbol with the amplitude K1, and then intervals the three symbols, the E symbol with the amplitude of -K2 is detected again, because the receiving end device has Knowing the order between the C symbol and the E symbol sent by the transmitting device (ie, the receiving device knows that the transmitting device is the first to transmit the C symbol and the fifth to transmit the E symbol) and the known two The respective amplitudes of the symbols, therefore, the receiving end device determines that the order between the C symbol of the current detected K1 and the E symbol of the amplitude -K2 satisfies the symbol transmission order of the sequence, and the amplitude order of the two symbols is also related to the sequence. The amplitudes of the symbols in the symbol transmission order are identical, so the receiving device can determine that the subcarrier modulation signal does not have a phase error. It should be noted here that the amplitude of the C symbol and the amplitude of the E symbol detected by the receiving end device may have some error with the amplitude of the C symbol sent by the transmitting end device and the amplitude of the E symbol, but the error does not cause the receiving end device. Identify errors, such as identifying C symbols as other symbols.

Of course, if the receiving device detects a symbol with the amplitude -K1 and detects a symbol with the amplitude K2 again after the interval of 3 symbols, the receiving device knows that the transmitting device transmits the symbol and amplitude with the amplitude K1. The order between the symbols of -K2 and the respective amplitudes of the two symbols are known. Therefore, the receiving end device determines the order in which the symbol having the amplitude of -K1 and the symbol of the amplitude K2 are currently detected and the symbol transmission order of the sequence. The amplitudes of the symbols in the phase are opposite, so the receiving device can determine that the subcarrier modulation signal has a phase error, and determine that the detected position of the symbol of -K1 is the starting position of the sequence.

Of course, after determining the starting position of the sequence in the subcarrier modulation signal, the receiving end device may determine the first part and the second part of the sequence by combining the length of the sequence and the symbol transmission order of the sequence or the waveform of the sequence.

S503: if there is no phase error, acquiring a gamma curve and a channel matrix according to the first part, and processing the multiple subcarrier modulation signals according to the gamma curve and the channel matrix to obtain the to-be-transmitted data. .

Specifically, when the receiving end device determines that the subcarrier modulation signal does not have a phase error, the receiving end device uses the first part of the sequence to obtain a Gamma curve corresponding to the channel matrix and each subcarrier modulation signal, and the specific Gamma curve acquisition manner. Referring to the embodiment shown in FIG. 5 above, it is only necessary to replace the second part in FIG. 4 with the first part in the embodiment, and replace the second sub-symbol in FIG. 5 with the first part in the embodiment. The symbol can be, that is, according to the difference between the amplitudes of any two first sub-symbols on each road in the first part is a multiple of the step size m

First sub-symbol, obtained and described

Sub-symbols corresponding to the second sub-symbol;

The sub-symbols corresponding to the first sub-symbols perform a Gamma signal extraction operation to determine the gamma curve of each path. The specific process will not be described in detail here.

In addition, the specific channel matrix can be obtained by referring to the embodiment shown in FIG. 6 , and only the second sub-symbol needs to be replaced with the first sub-symbol in the embodiment, that is, from the receiving. The first received symbol corresponding to the symbol sent by the transmitting device with the amplitude of [K, -K, -K] is obtained from the received symbol; and the transmitted amplitude of the received device is obtained from the transmitting device as [-K a second received symbol corresponding to the symbol of , K, -K]; obtaining a third corresponding to the symbol transmitted by the transmitting device from the receiving device with the amplitude of [-K, -K, K] Receiving a symbol; wherein [K, -K, -K] characterizes the first received symbol as when the first sub-symbol of the first branch has an amplitude of K, the first branch of the second branch and the third branch The symbol corresponds to the sign corresponding to -K; [-K, K, -K] characterizes the second received symbol when the amplitude of the first sub-symbol of the first branch is K, and the second branch The amplitude of a sub-symbol is K, the first sub-symbol of the third branch has a magnitude corresponding to -K; [-K, -K, K] characterizes the third received symbol as the first branch with The amplitude of the first sub-symbol of the two branches is -K, and the amplitude of the first sub-symbol of the third branch is K; then, according to the first received symbol, the second received symbol, and the third receiving The symbol determines the channel matrix.

After the receiving device obtains the channel matrix and the gamma curve of each channel based on the first part in this embodiment, the multi-subcarrier modulation signal may be processed based on the channel matrix and the gamma curve of each channel to obtain the For the specific data processing, refer to the description of S207 in the foregoing embodiment. The difference from the S207 is that the demodulation mode is different. The SIM uses CIM demodulation. In this embodiment, the CSK is performed. Demodulation.

S504: if there is a phase error, acquiring a Gamma curve and a channel matrix according to the second part, and processing the multiple subcarrier modulation signals according to the Gamma curve and the channel matrix to obtain the to-be-transmitted data. .

Specifically, when the receiving end device determines that a phase error occurs in the subcarrier modulation signal, the receiving end device uses the second part of the sequence to obtain a Gamma curve corresponding to the channel matrix and each subcarrier modulation signal, and the specific Gamma curve acquisition manner. Referring also to the embodiment shown in FIG. 5 above, it is only necessary to replace the second portion in FIG. 5 with the second portion in the present embodiment (the second portion in FIG. 5 and the second portion in the present embodiment). The meaning of the reference is different. The second sub-symbol in FIG. 5 may be replaced by the second sub-symbol in the embodiment, that is, according to the amplitude of any two second sub-symbols on each road in the second part. The difference between the steps is a multiple of the step size m

Second sub-symbol, obtained and described

Sub-symbols corresponding to the second sub-symbol;

The sub-symbols corresponding to the second sub-symbols perform a Gamma signal extraction operation to determine the gamma curve of each path. The specific process will not be described in detail here.

In addition, the specific mode of the channel matrix can be referred to the embodiment shown in FIG. 6 , and only the second sub-symbol in FIG. 6 needs to be replaced with the second sub-symbol in the embodiment, that is, from the receiving. Get and send to the symbol The first receiving symbol corresponding to the end device transmitting the symbol of the amplitude [K, -K, -K]; obtaining the transmission amplitude from the received symbol with the transmitting device is [-K, K, -K] a second received symbol corresponding to the symbol; obtaining, from the received symbol, a third received symbol corresponding to a symbol transmitted by the transmitting device with an amplitude of [-K, -K, K]; wherein, [ K, -K, -K] characterizes that the first received symbol is when the amplitude of the second sub-symbol of the first branch is K, and the amplitude of the second sub-symbol of the second branch and the third branch is -K The symbol corresponding to the time; [-K, K, -K] characterizes the second received symbol when the amplitude of the second sub-symbol of the first branch is K, and the amplitude of the second sub-symbol of the second branch is K, the second sub-symbol of the third branch has a magnitude corresponding to -K; [-K, -K, K] characterizes the third received symbol as the first branch and the second branch The amplitude of the second sub-symbol is -K, and the amplitude of the second sub-symbol of the third branch is K; then, the channel matrix is determined according to the first received symbol, the second received symbol, and the third received symbol .

After the receiving device obtains the channel matrix and the gamma curve of each channel based on the first part in this embodiment, the multi-subcarrier modulation signal may be processed based on the channel matrix and the gamma curve of each channel to obtain the For the specific data processing, refer to the description about S207 in the foregoing embodiment.

The method for camera communication provided by the embodiment of the present application, when the transmitting device uses CSK to perform multiple modulations on the data to be transmitted, the transmitting device adopts the sequence of the sequence in the second possible implementation manner, and then based on the sequence of the sequence. The receiving end device can jointly determine whether the received subcarrier modulation signal or the amplitude modulation signal is phase inverted by using the first part and the second part of the sequence, and determining a starting position of the sequence in the subcarrier modulation signal, and combining the The starting position, the length of the sequence, and the symbol transmission order of the sequence determine the first portion and the second portion of the sequence, and then, in conjunction with whether the phase is inverted, whether the first portion or the second portion is used to determine the channel matrix and The Gamma curve of each channel, and then the channel matrix and the Gamma curve of each channel are used to perform nonlinear compensation, color correction, demodulation and the like on the received multi-channel subcarrier modulation signals, thereby obtaining data to be transmitted, which greatly improves the data. The accuracy of the data recovery by the receiving device to ensure the receiving end The reliability of the data to be transmitted is restored; in addition, when the subcarrier modulation signal is nonlinearly compensated, the information of the Gamma curve determined by the receiving device can also be sent to the transmitting device, and the subcarrier by the transmitting device The modulating signal is non-linearly compensated, which greatly simplifies the operation of the receiving device and saves the processing overhead of the receiving device. Further, the embodiment of the present application can also determine the second part of the sequence when the phase occurs. The channel matrix and the gamma curve of each channel further ensure the accuracy of data restoration; further, the embodiment of the present application solves the problem that the CSK signal cannot be transmitted in the OCC system using the low speed camera, and the camera communication is expanded. Scope of application.

As a third possible implementation manner of the embodiment of the present application, the implementation manner relates to another specific content of the foregoing preset sequence. In this possible implementation, the sequence may include a first portion and a second portion; the first portion includes a plurality of symbols outside the modulation constellation point for indicating a starting position of the sequence in the initial signal; The two parts include all the symbols in the plurality of modulation constellation points for instructing the receiving end device to train the decider according to the second part, and the determiner is configured to acquire the to-be-acquired according to the signal received by the receiving end device transfer data. In conjunction with the third possible implementation, the receiving end device can use the sequence to determine the starting position of the sequence, and use the second part to train the decider, and obtain the blocked subcarrier modulation signal from the received blocker through the determiner. Data to be transmitted. Referring to the embodiment of the method for the camera communication shown in FIG. 9, on the basis of the foregoing embodiment, further, as shown in FIG. 9, the foregoing S107 may specifically include:

S601: when any one of the plurality of modulation constellation points is detected, according to any one of the symbols and the preset The symbolic transmission order of the sequence determines the starting position of the sequence.

Specifically, as mentioned above, when receiving the multi-channel subcarrier modulation signal, the receiving end device receives one symbol and then one symbol, and when the receiving end device detects any symbol, if the symbol is located outside the multiple modulation constellation points The receiving device can determine the starting position of the sequence in combination with the symbol and the symbol sequence of the known sequence. For the specific determining manner, refer to the determining manner of S501 in the foregoing embodiment, and details are not described herein again.

S602: Train the decider according to the starting position, the symbol order in the preset sequence, and the length of the sequence.

S603: Acquire, according to the determiner, the data to be transmitted from the multiple subcarrier modulation signals.

Specifically, different from the data to be transmitted in the foregoing embodiment, the embodiment does not need to perform the RGB three-way sub-symbol received by the camera, and does not need nonlinear compensation, color correction, phase error determination, etc., but introduces machine learning. a method for determining a second portion of the sequence by using the determined starting position, the symbol order in the preset sequence, and the length of the sequence, and then using the second portion to train the determiner of the receiving device, After the judging device learns successfully, the determiner can be used to obtain the data to be transmitted from the multi-channel subcarrier modulation signal. The embodiment of the present application does not limit how to obtain the judging device.

The method for camera communication provided by the embodiment of the present application cancels operations such as nonlinear compensation, color correction, and phase error elimination of the receiving device, but trains the decider based on the second part of the sequence, and uses the determiner to restore the to-be-transmitted The data simplifies the complexity of the receiving device.

A person skilled in the art can understand that all or part of the steps of implementing the above method embodiments may be completed by using hardware related to the program instructions. The foregoing program may be stored in a computer readable storage medium, and the program is executed when executed. The foregoing steps include the steps of the foregoing method embodiments; and the foregoing storage medium includes: a medium that can store program codes, such as a ROM, a RAM, a magnetic disk, or an optical disk.

FIG. 10 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application. The device may be the sender device device in the foregoing embodiment, or may be integrated in the sender device device in the foregoing method embodiment. As shown in FIG. 10, the apparatus includes: a first modulation module 10, a sequence addition module 11, a second modulation module 12, and a transmission module 13.

The first modulation module 10 is configured to perform multiple modulations on the data to be transmitted to obtain a multi-channel amplitude modulation signal, where each channel of the amplitude modulation signal has multiple amplitudes;

The sequence adding module 11 is configured to add a preset sequence before each of the amplitude modulation signals to obtain an initial signal of each channel; wherein the sequence is used to indicate state information of the amplitude modulation signal;

The second modulation module 12 is configured to perform subcarrier amplitude modulation SAM on the initial signal of each channel to obtain a subcarrier modulation signal of each channel;

The sending module 13 is configured to send multiple subcarrier modulation signals to the receiving end device.

Optionally, the first modulation module 10 and the second modulation module 12 and the sequence adding module 11 may correspond to components having processing and control functions, such as a processor or a microprocessor unit in the transmitting device, or The other components of the VLC module are integrated. The transmitting module 13 may be an optical communication unit in the transmitting device, for example, an LED capable of transmitting multiple optical signals.

The apparatus for the camera communication provided by the embodiment of the present application may perform the foregoing method embodiments, and the implementation principle and technical effects thereof are similar, and details are not described herein again.

Optionally, the sequence is specifically used to indicate at least one of the following status information of the amplitude modulated signal:

Indicating a starting position of the sequence;

Instructing the subcarrier modulation signal whether there is a phase error;

As a first possible implementation manner, when the multiple modulation is a color intensity modulation CIM, the sequence includes: a first portion, a second portion, and a third portion;

The second portion includes N second symbols,

The second sub-symbol has a magnitude of -K, and the remaining

The difference between the amplitudes of any two sub-symbols in the second sub-symbol is a multiple of the step size m, the multiple is a positive integer, and the second portion is used to indicate to the receiving end device for determining the The gamma gamma curve of the amplitude modulated signal and the parameter information of the channel matrix;

As an optional manner of the first possible implementation manner, the second part includes three increasing sub-symbol strings, and the increasing sub-symbol string of each path includes

As a second possible implementation manner of the embodiment of the present application, when the multiple modulation is color shift keying CSK modulation, the sequence includes: a first part and a second part;

The first portion includes N first symbols,

Each of the first symbols includes three second sub-symbols in parallel and having a preset first association relationship, and each of the N first sub-symbols of each path

The first sub-symbol has a magnitude of -K, and the remaining

The first portion and the second portion are used together to indicate a starting position of the sequence, and to The receiving end device indicates parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulated signal.

As an optional manner of the second possible implementation manner of the embodiment of the present application, the first part includes a three-way incremental sub-symbol string, and the incremental sub-symbol string of each path includes

As a third possible implementation manner of the embodiment of the present application, the sequence includes a first part and a second part;

FIG. 11 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application. On the basis of the foregoing embodiment shown in FIG. 10, the device may further include: a receiving module 14 and a compensation module 15. The receiving module 14 can be a camera device or a video recording device or the like on the above-mentioned transmitting device device.

The receiving module 14 is configured to receive information about a gamma gamma curve determined by the receiving end device according to the sequence;

The compensation module 15 is configured to perform Gamma nonlinear compensation on each subcarrier modulation signal according to the information of the Gamma curve to obtain a multipath compensated modulation signal;

The sending module 13 is further configured to send the multiplexed modulated signal to the receiving end device.

FIG. 12 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application. The device may be the receiving device in the foregoing method embodiment, and may also be integrated in the receiving device device in the foregoing method embodiment. As shown in FIG. 12, the apparatus includes: a receiving module 20 and a processing module 21; optionally, the apparatus may further include a transmitting module 22.

The receiving module 20 is configured to receive the multiple subcarrier modulation signals sent by the sending end device, where the multiple subcarrier modulation signals are signals obtained by subcarrier amplitude modulation SAM for the initial signal of each path of the transmitting end device, The initial signal is generated by the transmitting end device according to a preset sequence and an amplitude modulated signal obtained by performing multiple modulations on the data to be transmitted, and the sequence is used to indicate state information of the amplitude modulated signal;

The processing module 21 is configured to process the multiple subcarrier modulation signals to obtain the data to be transmitted.

Optionally, the sending module 22 may be an optical communication unit in the receiving device, for example, an LED capable of transmitting multiple optical signals, and the receiving module 20 may be a camera device or a video recording device in the receiving device. . The processing module 21 may correspond to a processor or a microprocessor unit or the like in the receiving device device. The components that handle and control functions can also be other components that integrate the VLC module.

Indicating a starting position of the sequence;

Instructing the subcarrier modulation signal whether there is a phase error;

As a first possible implementation manner of the embodiment of the present application, when the multiple modulation is a color intensity modulation CIM, the sequence includes: a first part, a second part, and a third part;

The second portion includes N second symbols,

The second sub-symbol has a magnitude of -K, and the remaining

As an optional manner of the first possible implementation manner of the embodiment of the present application, the second part includes a three-way incremental sub-symbol string, and the incremental sub-symbol string of each path includes

The first portion includes N first symbols,

The first sub-symbol has a magnitude of -K, and the remaining

The second portion includes N second symbols, the second symbol includes three parallel channels, and the amplitude has a preset number a second sub-symbol of the second association, the amplitude of the N second symbols being a value obtained by performing an inverse operation on the amplitude of the first symbol of the first portion;

As an optional manner of the second possible implementation manner of the embodiment of the present application, the first part includes three increasing sub-symbol strings, and the increasing sub-symbol string of each path includes

Optionally, in combination with the foregoing first possible implementation, the processing module 21 is specifically configured to: when a symbol is detected, and the amplitude of the three-way sub-symbol of the symbol is the maximum amplitude of the branch, according to a symbol transmission order of the preset sequence and the symbol determining a starting position of the sequence, and determining a second portion of the sequence according to the starting position, the length of the sequence, and the symbol transmission order of the sequence And a third part; and, acquiring a gamma curve and a channel matrix according to the second part, and processing the multiple subcarrier modulation signals according to the gamma curve and the channel matrix to obtain the data to be transmitted.

Further, the processing module 21 is specifically configured to acquire a gamma curve according to the second part, and specifically includes:

The processing module 21 is specifically configured to use, according to the difference between the amplitudes of any two sub-symbols on each path in the second portion, a multiple of the step size m

Second sub-symbol, obtained and described

Sub-symbols corresponding to the second sub-symbol, and for each of the roads

Further, the processing module 21 is specifically configured to acquire a channel matrix according to the second part, and specifically includes:

The processing module 21 is specifically configured to: acquire, from the received symbol, a first received symbol corresponding to a symbol sent by the sending end device with a range of [K, -K, -K]; wherein, [K, -K, -K] characterizing the first received symbol when the amplitude of the second sub-symbol of the first branch is K, and the amplitude of the second sub-symbol of the second branch and the third branch is -K Corresponding symbols; and obtaining, from the received symbols, a second received symbol corresponding to a symbol sent by the transmitting device with an amplitude of [-K, K, -K]; wherein, [-K, K, -K] characterizing the second received symbol as the second of the first branch The amplitude of the sub-symbol is K, the amplitude of the second sub-symbol of the second branch is K, the sign of the second sub-symbol of the third branch is -K, and the symbol received from the symbol Obtaining a third received symbol corresponding to when the transmitting device sends a symbol of amplitude [-K, -K, K]; wherein [-K, -K, K] represents the third received symbol as the first The amplitude of the second sub-symbol of one of the roads and the second branch is -K, and the second sub-symbol of the third branch has a magnitude corresponding to K; and, according to the first received symbol, the second The symbol and the third received symbol are received to obtain the channel matrix.

Further, in combination with the first possible implementation manner, the processing module 21 is further configured to: when a symbol is detected, and the amplitude of the three-way sub-symbol of the symbol is the minimum amplitude of the branch on the branch, Determining a phase error of the subcarrier modulation signal, and determining a starting position of the sequence according to the symbol; and obtaining a Gamma curve and a channel matrix according to the third portion; and, according to the Gamma curve and the channel matrix pair The multi-channel subcarrier modulation signal is processed to obtain the data to be transmitted.

Optionally, in combination with the foregoing second possible implementation manner, the processing module 21 is specifically configured to: when detecting a symbol in the sequence, and detect the sequence again after a preset number of symbols are separated Another symbol, determining a starting position of the sequence according to the one symbol; an order of the one symbol and the another symbol satisfies a symbol transmission order of a preset sequence; and, according to the symbol of the sequence Transmitting order and amplitude of said one symbol and amplitude of said another symbol determining whether said subcarrier modulation signal has a phase error; if there is no phase error, acquiring a Gamma curve and a channel matrix according to said first portion, and according to The gamma curve and the channel matrix process the multi-channel subcarrier modulation signal to obtain the data to be transmitted; if there is a phase error, acquire a gamma curve and a channel matrix according to the second part, and according to the The gamma curve and the channel matrix process the multi-channel subcarrier modulation signal to obtain the data to be transmitted.

Optionally, in combination with the foregoing third possible implementation manner, the processing module 21 is configured to process the multiple subcarrier modulation signals to obtain the data to be transmitted, and specifically includes:

The processing module 21 is specifically configured to: when detecting any one of the plurality of modulation constellation points, determine a starting position of the sequence according to the symbol transmission order of the any one of the symbols and the preset sequence; The starting position, the symbol order in the preset sequence, and the length of the sequence training the decider; and acquiring the data to be transmitted from the multiple subcarrier modulation signals according to the decider.

Optionally, in combination with the first possible implementation manner and the second possible implementation manner, the processing module 21 is specifically configured to modulate the multiple subcarriers according to the gamma curve and the channel matrix. The processing is performed to obtain the data to be transmitted, which specifically includes:

The processing module 21 is configured to perform nonlinear compensation on the subcarrier modulation signal according to the Gamma curve, and perform color correction on the compensated modulation signal according to the channel matrix to obtain a corrected signal, and according to the Decoding the corrected signal and the amplitude of the amplitude modulated signal, deleting the sequence in the corrected signal to obtain the amplitude modulated signal; and demodulating the amplitude modulated signal to obtain the data to be transmitted

Optionally, in combination with the foregoing first possible implementation manner and the second possible implementation manner, the sending module 22 is configured to send information about the Gamma curve to the sending end device, where the information of the Gamma curve is And the receiving module 20 is further configured to receive the compensation sent by the sending end device by using the gamma curve to perform nonlinear compensation on the subcarrier modulation signal to obtain a compensated modulated signal. a modulated signal, and performing color correction on the compensated modulated signal according to the channel matrix to obtain a corrected signal; the processing module 21 is specifically configured to perform, according to the corrected signal and the amplitude modulated signal Length, deleting the sequence in the corrected signal, obtaining the amplitude modulated signal, and demodulating the amplitude modulated signal to obtain the to-be-transmitted Lose data.

FIG. 13 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application. The device in which the camera communicates may include a processor 30, a memory 31, at least one communication bus 32, and a transmitter 33. Optionally, the device communicated by the camera may further include a receiver 34. Communication bus 32 is used to implement a communication connection between components. The memory 31 may include a high speed RAM memory, and may also include a non-volatile memory NVM, such as at least one disk memory, in which various programs may be stored for performing various processing functions and implementing the method steps of the present embodiment. Optionally, the transmitter 33 in this embodiment may be an LED light integrated with a VLC module in the sending device, and the receiver 34 in this embodiment may be a camera device or a video recording device on the sending device device. Wait.

In this embodiment, the processor 30 is configured to perform multiple modulations on the data to be transmitted to obtain a multi-channel amplitude modulated signal, wherein each of the amplitude modulated signals has multiple amplitudes; and adding a pre-amplitude before each of the amplitude modulated signals The sequence is set to obtain an initial signal of each channel, and subcarrier amplitude modulation SAM is performed on each channel initial signal to obtain a subcarrier modulation signal of each channel; wherein the sequence is used to indicate state information of the amplitude modulation signal ;

The transmitter 33 is configured to send multiple subcarrier modulation signals to the receiving end device.

Indicating a starting position of the sequence;

Instructing the subcarrier modulation signal whether there is a phase error;

The second portion includes N second symbols,

The second sub-symbol has a magnitude of -K, and the remaining

The first portion includes N first symbols,

The first sub-symbol has a magnitude of -K, and the remaining

Optionally, the receiver 34 is configured to receive information about a gamma gamma curve determined by the receiving end device according to the sequence;

The processor 30 is further configured to perform Gamma nonlinear compensation on each subcarrier modulation signal according to the information of the Gamma curve to obtain a multipath compensated modulation signal;

The transmitter 33 is further configured to send the multiplexed modulated signal to the receiving end device.

FIG. 14 is a schematic structural diagram of an apparatus for camera communication according to an embodiment of the present application. The device in which the camera communicates may include a processor 40, a memory 41, at least one communication bus 42 and a receiver 43. Optionally, the device communicated by the camera may further include a transmitter 44. Communication bus 42 is used to implement a communication connection between components. The memory 41 may include a high speed RAM memory, and may also include a non-volatile memory NVM, such as at least one disk memory, in which various programs may be stored for performing various processing functions and implementing the method steps of the present embodiment. Optionally, the receiver 43 in this embodiment may be a camera device or a video recording device on the receiving device device. The transmitter 44 in this embodiment may be an LED integrated with the VLC module in the receiving device device. light.

Indicating a starting position of the sequence;

Instructing the subcarrier modulation signal whether there is a phase error;

The second portion includes N second symbols,

The second sub-symbol has a magnitude of -K, and the remaining

As a second possible implementation manner of the embodiment of the present application, when the multiple modulation is color shift keying CSK modulation The sequence includes: a first portion and a second portion;

The first portion includes N first symbols,

The first sub-symbol has a magnitude of -K, and the remaining

Optionally, in combination with the foregoing first possible implementation, the processor 40 is specifically configured to: when a symbol is detected, and the amplitude of the three sub-symbols of the symbol is the maximum amplitude of the branch, according to a symbol transmission order of the preset sequence and the symbol determining a starting position of the sequence, and determining a second portion of the sequence according to the starting position, the length of the sequence, and the symbol transmission order of the sequence And a third part; and, acquiring a gamma curve and a channel matrix according to the second part, and processing the multiple subcarrier modulation signals according to the gamma curve and the channel matrix to obtain the data to be transmitted.

Further, the processor 40 is specifically configured to acquire a gamma curve according to the second part, and specifically includes:

The processor 40 is specifically configured to use, according to the difference between the amplitudes of any two sub-symbols on each path in the second portion, a multiple of the step size m

Second sub-symbol, obtained and described

Sub-symbols corresponding to the second sub-symbol, and for each of the roads

Further, the processor 40 is specifically configured to acquire a channel matrix according to the second part, and specifically includes:

The processor 40 is specifically configured to: acquire, from the received symbols, a first received symbol corresponding to a symbol sent by the sending end device with a range of [K, -K, -K]; wherein, [K, -K, -K] characterizing the first received symbol when the amplitude of the second sub-symbol of the first branch is K, and the amplitude of the second sub-symbol of the second branch and the third branch is -K Corresponding symbols; and obtaining, from the received symbols, a second received symbol corresponding to a symbol sent by the transmitting device with an amplitude of [-K, K, -K]; wherein, [-K, K, - K] characterizing the second received symbol when the amplitude of the second sub-symbol of the first branch is K, the amplitude of the second sub-symbol of the second branch is K, and the second sub-symbol of the third branch a symbol corresponding to the amplitude of -K; and, from the received symbol, a third received symbol corresponding to the symbol transmitted by the transmitting device with the amplitude [-K, -K, K]; wherein [-K, -K, K] characterizing the third received symbol is when the amplitude of the second sub-symbol of the first branch and the second branch is -K, and the amplitude of the second sub-symbol of the third branch is The symbol corresponding to K; And, based on the first received symbol, the second received symbol and the third received symbols to obtain a channel matrix.

Further, in combination with the first possible implementation manner, the processor 40 is further configured to: when a symbol is detected, and the amplitude of the three-way sub-symbol of the symbol is the minimum amplitude of the branch on the branch, Determining a phase error of the subcarrier modulation signal, and determining a starting position of the sequence according to the symbol; and obtaining a Gamma curve and a channel matrix according to the third portion; and, according to the Gamma curve and the channel matrix pair The multi-channel subcarrier modulation signal is processed to obtain the data to be transmitted.

Optionally, in combination with the foregoing second possible implementation manner, the processor 40 is specifically configured to: when detecting a symbol in the sequence, and detect the sequence again after a preset number of symbols are separated Another symbol, determining a starting position of the sequence according to the one symbol; an order of the one symbol and the another symbol satisfies a symbol transmission order of a preset sequence; and, according to the symbol of the sequence Transmitting order and amplitude of said one symbol and amplitude of said another symbol determining whether said subcarrier modulation signal has a phase error; if there is no phase error, acquiring a Gamma curve and a channel matrix according to said first portion, and according to The gamma curve and the channel matrix process the multi-channel subcarrier modulation signal to obtain the data to be transmitted; if there is a phase error, acquire a gamma curve and a channel matrix according to the second part, and according to the The gamma curve and the channel matrix process the multi-channel subcarrier modulation signal to obtain the data to be transmitted.

Optionally, in combination with the foregoing third possible implementation manner, the processor 40 is configured to process the multiple subcarrier modulation signals to obtain the data to be transmitted, and specifically includes:

The processor 40 is configured to: when detecting any one of the plurality of modulation constellation points, determine a starting position of the sequence according to the symbol transmission order of the any one of the symbols and the preset sequence; The starting position, the symbol order in the preset sequence, and the length of the sequence training the decider; and acquiring the data to be transmitted from the multiple subcarrier modulation signals according to the decider.

Optionally, in combination with the foregoing first possible implementation manner and the second possible implementation manner, the processor 40 is specifically configured to modulate the multiple subcarriers according to the gamma curve and the channel matrix. The processing is performed to obtain the data to be transmitted, which specifically includes:

The processor 40 is configured to perform nonlinear compensation on the subcarrier modulation signal according to the gamma curve, and perform color correction on the compensated modulation signal according to the channel matrix to obtain a corrected signal, and according to the Decoding the corrected signal and the amplitude of the amplitude modulated signal, deleting the sequence in the corrected signal to obtain the amplitude modulated signal; and demodulating the amplitude modulated signal to obtain the data to be transmitted

Optionally, in combination with the foregoing first possible implementation manner and the second possible implementation manner, the transmitter 44 is configured to send information about the Gamma curve to the sending end device, where the information of the Gamma curve is And the receiver 43 is further configured to receive the compensation sent by the sending end device by using the gamma curve to perform nonlinear compensation on the subcarrier modulation signal to obtain a compensated modulated signal. a modulated signal, and performing color correction on the compensated modulated signal according to the channel matrix to obtain a corrected signal; the processor 40 is specifically configured to perform, according to the corrected signal and the amplitude modulated signal Length, deleting the sequence in the corrected signal, obtaining the amplitude modulated signal, and demodulating the amplitude modulated signal to obtain the data to be transmitted.

The steps of the method or algorithm described in connection with the disclosure of the present application may be implemented in a hardware manner, or may be implemented by a processor executing a software instruction, or may be implemented by a computer program product. The software instructions may be comprised of corresponding software modules that may be stored in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable hard disk, CD-ROM, or any other form of storage well known in the art. In the medium. An exemplary storage medium is coupled to the processor to enable the processor to read information from, and write information to, the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and the storage medium can be located in an ASIC. Additionally, the ASIC can be located in the user equipment. Of course, the processor and the storage medium may also reside as discrete components in the user equipment.

Those skilled in the art will appreciate that in one or more examples described above, the functions described herein can be implemented in hardware, software, firmware, or any combination thereof. When implemented in software, the functions may be stored in a computer readable medium or transmitted as one or more instructions or code on a computer readable medium. Computer readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one location to another. A storage medium may be any available media that can be accessed by a general purpose or special purpose computer.

In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners without departing from the scope of the present application. For example, the embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined. Or it can be integrated into another system, or some features can be ignored or not executed. The units described as separate components may or may not be physically separated, and the components displayed as the unit may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. . Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without any creative effort.

In addition, the described systems, devices, and methods, and the schematic diagrams of various embodiments, may be combined or integrated with other systems, modules, techniques or methods without departing from the scope of the present application. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in electronic, mechanical or other form.

Finally, it should be noted that the above embodiments are only for explaining the technical solutions of the present application, and are not limited thereto; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that The technical solutions described in the foregoing embodiments may be modified, or some or all of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the technical solutions of the embodiments of the present application. range.

Claims

A method of camera communication, comprising:

Performing multiple modulations on the transmitted data to obtain a multi-channel amplitude modulated signal, wherein each of the amplitude modulated signals has multiple amplitudes;

Adding a preset sequence before each of the amplitude modulation signals to obtain an initial signal of each channel; wherein the sequence is used to indicate state information of the amplitude modulation signal;

Subcarrier amplitude modulation SAM is performed on the initial signal of each channel to obtain a subcarrier modulation signal of each channel;

Transmitting multiple subcarrier modulation signals to the receiving device.
The method according to claim 1, wherein the sequence is specifically used to indicate at least one of the following state information of the amplitude modulated signal:

Indicating a starting position of the sequence;

Instructing the subcarrier modulation signal whether there is a phase error;

Parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulated signal is indicated.
The method according to claim 2, wherein when said plurality of modulations are color intensity modulated CIMs, said sequence comprises: a first portion, a second portion, and a third portion;

The first portion includes a first symbol, the first symbol is used to indicate a starting position of the sequence in the initial signal; and the first symbol includes three parallel first first sub-symbols having an amplitude of K+l The K is a maximum amplitude after CIM modulation of the data to be transmitted, and the l is an arbitrary positive integer;

The second portion includes N second symbols,
Each of the second symbols includes three second sub-symbols in parallel and having a preset first association relationship, and each of the N second sub-symbols
The second sub-symbol has a magnitude of -K, and the remaining
The difference between the amplitudes of any two sub-symbols in the second sub-symbol is a multiple of the step size m, the multiple is a positive integer, and the second portion is used to indicate to the receiving end device for determining the The gamma gamma curve of the amplitude modulated signal and the parameter information of the channel matrix;

The third part includes N third symbols, and the third symbol includes three third sub-symbols whose amplitudes have a preset second association relationship, and the amplitudes of the N third symbols are And performing, after the amplitude of the second symbol of the second part, performing a reverse operation, for indicating a gamma for determining the amplitude modulation signal to the receiving end device when a phase error occurs in the subcarrier modulation signal Parameter information of the Gamma curve and the channel matrix.
The method according to claim 2, wherein when said plurality of modulations are color shift keyed CSK modulation, said sequence comprises: a first portion and a second portion;

The first portion includes N first symbols,
Each of the first symbols includes three second sub-symbols in parallel and having a preset first association relationship, and each of the N first sub-symbols of each path
The first sub-symbol has a magnitude of -K, and the remaining
The difference between the amplitudes of any two sub-symbols in the first sub-symbol is a multiple of the step size m, and the multiple is a positive integer;

The second part includes N second symbols, and the second symbol includes three second sub-symbols in parallel and having a second associated relationship, and the amplitudes of the N second symbols are The amplitude of the first symbol of the first part The value after performing the negation operation;

The first part and the second part are used together to indicate a starting position of the sequence, and a gamma gamma curve and a channel matrix for indicating to the receiving end device for determining the amplitude modulated signal Parameter information.
The method of claim 3 wherein said second portion comprises a three-way incremental sub-symbol string, and each of said increasing sub-symbol strings comprises
Sub-symbols, the amplitudes of the sub-symbols in the increasing sub-symbol string are successively incremented from K at equal intervals of m in steps of m; the third portion includes three decrementing sub-symbol strings, decrementing sub-symbols of each path String includes
a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;

The first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;

The second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
The method of claim 4 wherein said first portion comprises a three-way incremental sub-symbol string, and each of said increasing sub-symbol strings comprises
a sub-symbol, the amplitude of the sub-symbol in the increasing sub-symbol string is continuously incremented to K from -K at equal intervals in m steps; the second portion includes three-way descending sub-symbol strings, decrementing sub-symbols of each path String includes
a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;

The first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;

The second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
The method according to any one of claims 1 to 6, wherein the method further comprises:

Receiving information of the gamma gamma curve determined by the receiving end device according to the sequence;

Performing gamma nonlinear compensation on each subcarrier modulation signal according to the information of the Gamma curve to obtain a multiplexed modulated signal;

Transmitting the multiplexed modulated signal to the receiving end device.
A method of camera communication, comprising:

Receiving, by the transmitting end device, a plurality of subcarrier modulation signals, wherein the multiple subcarrier modulation signals are signals obtained by performing subcarrier amplitude modulation SAM on an initial signal of each path of the transmitting end device, where the initial signal is The transmitting end device is generated according to a preset sequence and an amplitude modulated signal obtained by performing multiple modulations on the data to be transmitted, and the sequence is used to indicate state information of the amplitude modulated signal;

Processing the multi-channel subcarrier modulation signal to obtain the data to be transmitted.
The method of claim 8 wherein said sequence is specifically for indicating said amplitude modulation At least one of the following status information of the signal:

Indicating a starting position of the sequence;

Instructing the subcarrier modulation signal whether there is a phase error;

Parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulated signal is indicated.
The method according to claim 9, wherein when said plurality of modulations are CIM modulation, said sequence comprises: a first portion, a second portion, and a third portion;

The first portion includes a first symbol, the first symbol is used to indicate a starting position of the sequence in the initial signal; and the first symbol includes three parallel first first sub-symbols having an amplitude of K+l The K is a maximum amplitude after CIM modulation of the data to be transmitted, and the l is an arbitrary positive integer;

The second portion includes N second symbols,
Each of the second symbols includes three second sub-symbols in parallel and having a preset first association relationship, and each of the N second sub-symbols
The second sub-symbol has a magnitude of -K, and the remaining
The difference between the amplitudes of any two sub-symbols in the second sub-symbol is a multiple of the step size m, the multiple is a positive integer, and the second portion is used to indicate to the receiving end device for determining the Gamma curve of the amplitude modulated signal and parameter information of the channel matrix;

The third part includes N third symbols, and the third symbol includes three third sub-symbols whose amplitudes have a preset second association relationship, and the amplitudes of the N third symbols are And performing, after the amplitude of the second symbol of the second part, performing a reverse operation, for indicating a gamma for determining the amplitude modulation signal to the receiving end device when a phase error occurs in the subcarrier modulation signal Parameter information of the Gamma curve and the channel matrix.
The method according to claim 9, wherein when said plurality of modulations are color shift keying CSK modulation, said sequence comprises: a first portion and a second portion;

The first portion includes N first symbols,
Each first symbol includes three first parallel sub-symbols whose amplitudes have a preset first association relationship, and N of each of the first sub-symbols
The first sub-symbol has a magnitude of -K, and the remaining
The difference between the amplitudes of any two sub-symbols in the first sub-symbol is a multiple of the step size m, and the multiple is a positive integer;

The second part includes N second symbols, and the second symbol includes three second sub-symbols in parallel and having a second associated relationship, and the amplitudes of the N second symbols are The amplitude of the first symbol of the first part performs the value after the inverse operation;

The first part and the second part are used together to indicate a starting position of the sequence, and a gamma gamma curve and a channel matrix for indicating to the receiving end device for determining the amplitude modulated signal Parameter information.
The method of claim 10 wherein said second portion comprises an increasing number of sub-symbol strings, each of said increasing sub-symbol strings comprising
Sub-symbols, the amplitudes of the sub-symbols in the increasing sub-symbol string are successively incremented from K at equal intervals of m in steps of m; the third portion includes three decrementing sub-symbol strings, decrementing sub-symbols of each path String includes
a sub-symbol, the amplitude of the sub-symbols in the descending sub-symbol string is successively decremented to -K at intervals of m in steps of m;

The first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;

The second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
The method of claim 11 wherein said first portion comprises a three-way incremental sub-symbol string, and each of said increasing sub-symbol strings comprises
a sub-symbol, the amplitude of the sub-symbol in the increasing sub-symbol string is continuously incremented to K from -K at equal intervals in m steps; the second portion includes three-way descending sub-symbol strings, decrementing sub-symbols of each path String includes
a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;

The first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;

The second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
The method according to claim 10, wherein the processing the multi-channel subcarrier modulation signal to obtain the data to be transmitted comprises:

If a symbol is detected, and the amplitude of the three-way sub-symbol of the symbol is the maximum amplitude of the branch, the starting position of the sequence is determined according to the symbol transmission order of the preset sequence and the symbol;

Determining a second portion and a third portion of the sequence based on the starting position, the length of the sequence, and a symbol transmission order of the sequence;

Acquiring a gamma curve and a channel matrix according to the second part;

And processing the multi-channel subcarrier modulation signal according to the gamma curve and the channel matrix to obtain the to-be-transmitted data.
The method according to claim 14, wherein the acquiring the gamma curve according to the second part comprises:

Determining the difference between the amplitudes of any two sub-symbols on each path in the second portion as a multiple of the step size m
Second sub-symbol, obtained and described
Sub-symbols corresponding to the second sub-symbol;

For each road and said
The sub-symbols corresponding to the second sub-symbols perform a Gamma signal extraction operation to determine the gamma curve of each path.
The method according to claim 14, wherein the acquiring the channel matrix according to the second part comprises:

Obtaining, from the received symbols, a first received symbol corresponding to a symbol sent by the transmitting end device with an amplitude of [K, -K, -K]; wherein [K, -K, -K] characterizes the The first received symbol is a symbol corresponding to when the amplitude of the second sub-symbol of the first branch is K, and the amplitude of the second sub-symbol of the second branch and the third branch is -K;

Obtaining, from the received symbols, a second received symbol corresponding to a symbol sent by the transmitting end device with an amplitude of [-K, K, -K]; wherein [-K, K, -K] represents the The second received symbol is when the amplitude of the second sub-symbol of the first branch is K, the amplitude of the second sub-symbol of the second branch is K, and the amplitude of the second sub-symbol of the third branch is -K Corresponding symbol;

Obtaining, from the received symbols, a third received symbol corresponding to a symbol sent by the transmitting end device with an amplitude of [-K, -K, K]; wherein [-K, -K, K] represents the The third received symbol is a symbol corresponding to when the amplitude of the second sub-symbol of the first branch and the second branch is -K, and the amplitude of the second sub-symbol of the third branch is K;

And obtaining the channel matrix according to the first received symbol, the second received symbol, and the third received symbol.
The method according to claim 10, wherein the processing the multi-channel subcarrier modulation signal to obtain the data to be transmitted further comprises:

If a symbol is detected and the amplitude of the three-way sub-symbol of the symbol is the minimum amplitude of the branch, determining that the sub-carrier modulation signal has a phase error, and determining a starting position of the sequence according to the symbol ;

Obtaining a Gamma curve and a channel matrix according to the third part;

And processing the multi-channel subcarrier modulation signal according to the gamma curve and the channel matrix to obtain the to-be-transmitted data.
The method according to claim 11, wherein the processing the multi-channel subcarrier modulation signal to obtain the data to be transmitted comprises:

If a symbol in the sequence is detected, and another symbol of the sequence is detected again after a preset number of symbols, determining a starting position of the sequence according to the one symbol; The order of the symbol and the other symbol satisfies the symbol transmission order of the preset sequence;

Determining whether the subcarrier modulation signal has a phase error according to a symbol transmission order of the sequence and an amplitude of the one symbol and an amplitude of the another symbol;

If there is no phase error, acquiring a gamma curve and a channel matrix according to the first part, and processing the multiple subcarrier modulation signals according to the gamma curve and the channel matrix to obtain the to-be-transmitted data;

If there is a phase error, the Gamma curve and the channel matrix are acquired according to the second part, and the multi-channel subcarrier modulation signal is processed according to the Gamma curve and the channel matrix to obtain the to-be-transmitted data.
The method according to any one of claims 14 to 18, wherein the multi-channel subcarrier modulation signal is processed according to the gamma curve and the channel matrix to obtain the data to be transmitted, specifically include:

Performing nonlinear compensation on the subcarrier modulation signal according to the Gamma curve, and performing color correction on the compensated modulation signal according to the channel matrix to obtain a corrected signal;

Deleting a sequence in the corrected signal according to the corrected signal and a length of the amplitude modulated signal to obtain the amplitude modulated signal;

Demodulating the amplitude modulated signal to obtain the data to be transmitted.
Method according to any of claims 14-18, wherein said according to said Gamma The curve and the channel matrix process the multi-channel subcarrier modulation signal to obtain the data to be transmitted, which specifically includes:

Transmitting, by the sending end device, the information of the Gamma curve, where the information of the Gamma curve is used to instruct the transmitting end device to perform nonlinear compensation on the subcarrier modulation signal by using the Gamma curve, to obtain a compensated modulation. signal;

Receiving, by the transmitting end device, the compensated modulated signal, and performing color correction on the compensated modulated signal according to the channel matrix to obtain a corrected signal;

Deleting a sequence in the corrected signal according to the corrected signal and a length of the amplitude modulated signal to obtain the amplitude modulated signal;

Demodulating the amplitude modulated signal to obtain the data to be transmitted.
A device for communicating with a camera, comprising:

a first modulation module, configured to perform multiple modulations on the data to be transmitted, to obtain a multi-channel amplitude modulation signal, wherein each of the amplitude modulation signals has multiple amplitudes;

a sequence adding module, configured to add a preset sequence before each of the amplitude modulation signals to obtain an initial signal of each channel; wherein the sequence is used to indicate state information of the amplitude modulation signal;

a second modulation module, configured to perform subcarrier amplitude modulation SAM on each path of the initial signal to obtain a subcarrier modulation signal of each channel;

And a sending module, configured to send multiple subcarrier modulation signals to the receiving end device.
The apparatus according to claim 21, wherein the sequence is specifically used to indicate at least one of the following state information of the amplitude modulated signal:

Indicating a starting position of the sequence;

Instructing the subcarrier modulation signal whether there is a phase error;

Parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulated signal is indicated.
The apparatus according to claim 22, wherein when said plurality of modulations are color intensity modulated CIMs, said sequence comprises: a first portion, a second portion, and a third portion;

The first portion includes a first symbol, the first symbol is used to indicate a starting position of the sequence in the initial signal; and the first symbol includes three parallel first first sub-symbols having an amplitude of K+l The K is a maximum amplitude after CIM modulation of the data to be transmitted, and the l is an arbitrary positive integer;

The second portion includes N second symbols,
Each of the second symbols includes three second sub-symbols in parallel and having a preset first association relationship, and each of the N second sub-symbols
The second sub-symbol has a magnitude of -K, and the remaining
The difference between the amplitudes of any two sub-symbols in the second sub-symbol is a multiple of the step size m, the multiple is a positive integer, and the second portion is used to indicate to the receiving end device for determining the The gamma gamma curve of the amplitude modulated signal and the parameter information of the channel matrix;

The third part includes N third symbols, and the third symbol includes three third sub-symbols whose amplitudes have a preset second association relationship, and the amplitudes of the N third symbols are And performing, after the amplitude of the second symbol of the second part, performing a reverse operation, for indicating a gamma for determining the amplitude modulation signal to the receiving end device when a phase error occurs in the subcarrier modulation signal Parameter information of the Gamma curve and the channel matrix.
The apparatus according to claim 22, wherein when said plurality of modulations are color shift keying CSK modulation, said sequence comprises: a first portion and a second portion;

The first portion includes N first symbols,
Each of the first symbols includes three second sub-symbols in parallel and having a preset first association relationship, and each of the N first sub-symbols of each path
The first sub-symbol has a magnitude of -K, and the remaining
The difference between the amplitudes of any two sub-symbols in the first sub-symbol is a multiple of the step size m, and the multiple is a positive integer;

The second part includes N second symbols, and the second symbol includes three second sub-symbols in parallel and having a second associated relationship, and the amplitudes of the N second symbols are The amplitude of the first symbol of the first part performs the value after the inverse operation;

The first part and the second part are used together to indicate a starting position of the sequence, and a gamma gamma curve and a channel matrix for indicating to the receiving end device for determining the amplitude modulated signal Parameter information.
The apparatus of claim 23 wherein said second portion comprises three incremental sub-symbol strings, each of said increasing sub-symbol strings comprising
Sub-symbols, the amplitudes of the sub-symbols in the increasing sub-symbol string are successively incremented from K at equal intervals of m in steps of m; the third portion includes three decrementing sub-symbol strings, decrementing sub-symbols of each path String includes
a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;

The first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;

The second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
The apparatus of claim 24 wherein said first portion comprises three incremental sub-symbol strings, and each of said increasing sub-symbol strings comprises
a sub-symbol, the amplitude of the sub-symbol in the increasing sub-symbol string is continuously incremented to K from -K at equal intervals in m steps; the second portion includes three-way descending sub-symbol strings, decrementing sub-symbols of each path String includes
a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;

The first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;

The second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
The device according to any one of claims 21 to 26, wherein the device further comprises:

a receiving module, configured to receive information about a gamma gamma curve determined by the receiving end device according to the sequence;

a compensation module, configured to perform Gamma nonlinear compensation on each subcarrier modulation signal according to the information of the Gamma curve to obtain a multipath compensated modulation signal;

The sending module is further configured to send the multi-channel compensated modulated signal to the receiving end device.
A device for communicating with a camera, characterized in that the device comprises:

a receiving module, configured to receive a multiple subcarrier modulation signal sent by the sending end device, where the multiple subcarrier modulation signal is a signal obtained by subcarrier amplitude modulation SAM for an initial signal of each path of the transmitting end device, where The initial signal is generated by the transmitting end device according to a preset sequence and an amplitude modulated signal obtained by performing multiple modulations on the data to be transmitted, and the sequence is used to indicate state information of the amplitude modulated signal;

And a processing module, configured to process the multiple subcarrier modulation signals to obtain the data to be transmitted.
The apparatus according to claim 28, wherein the sequence is specifically for indicating at least one of the following status information of the amplitude modulated signal:

Indicating a starting position of the sequence;

Instructing the subcarrier modulation signal whether there is a phase error;

Parameter information for determining a gamma gamma curve and a channel matrix of the amplitude modulated signal is indicated.
The apparatus according to claim 29, wherein when said plurality of modulations are CIM modulation, said sequence comprises: a first portion, a second portion, and a third portion;

The first portion includes a first symbol, the first symbol is used to indicate a starting position of the sequence in the initial signal; and the first symbol includes three parallel first first sub-symbols having an amplitude of K+l The K is a maximum amplitude after CIM modulation of the data to be transmitted, and the l is an arbitrary positive integer;

The second portion includes N second symbols,
Each of the second symbols includes three second sub-symbols in parallel and having a preset first association relationship, and each of the N second sub-symbols
The second sub-symbol has a magnitude of -K, and the remaining
The difference between the amplitudes of any two sub-symbols in the second sub-symbol is a multiple of the step size m, the multiple is a positive integer, and the second portion is used to indicate to the receiving end device for determining the Gamma curve of the amplitude modulated signal and parameter information of the channel matrix;

The third part includes N third symbols, and the third symbol includes three third sub-symbols whose amplitudes have a preset second association relationship, and the amplitudes of the N third symbols are And performing, after the amplitude of the second symbol of the second part, performing a reverse operation, for indicating a gamma for determining the amplitude modulation signal to the receiving end device when a phase error occurs in the subcarrier modulation signal Parameter information of the Gamma curve and the channel matrix.
The apparatus according to claim 29, wherein when said plurality of modulations are color shift keying CSK modulation, said sequence comprises: a first portion and a second portion;

The first portion includes N first symbols,
Each first symbol includes three first parallel sub-symbols whose amplitudes have a preset first association relationship, and N of each of the first sub-symbols
The first sub-symbol has a magnitude of -K, and the remaining
The difference between the amplitudes of any two sub-symbols in the first sub-symbol is a multiple of the step size m, and the multiple is a positive integer;

The second part includes N second symbols, and the second symbol includes three second sub-symbols in parallel and having a second associated relationship, and the amplitudes of the N second symbols are The amplitude of the first symbol of the first part performs the value after the inverse operation;

The first part and the second part are used together to indicate a starting position of the sequence, and a gamma gamma curve and a channel matrix for indicating to the receiving end device for determining the amplitude modulated signal Parameter information.
The apparatus of claim 30 wherein said second portion comprises an increasing number of substrings, each of said increasing substrings comprising
Sub-symbols, the amplitudes of the sub-symbols in the increasing sub-symbol string are successively incremented from K at equal intervals of m in steps of m; the third portion includes three decrementing sub-symbol strings, decrementing sub-symbols of each path String includes
a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;

The first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;

The second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
The apparatus of claim 31 wherein said first portion comprises a three-way incremental sub-symbol string, and each of said increasing sub-symbol strings comprises
a sub-symbol, the amplitude of the sub-symbol in the increasing sub-symbol string is continuously incremented to K from -K at equal intervals in m steps; the second portion includes three-way descending sub-symbol strings, decrementing sub-symbols of each path String includes
a sub-symbol, the amplitude of the sub-symbol in the descending sub-symbol string is continuously decremented to -K at intervals of m in steps of m;

The first association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are continuously incremented from -K in steps of m to the K to form the increasing sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are -K;

The second association relationship includes: when the amplitudes of the sub-symbols of any one of the paths are successively decremented from -K in steps of m to -K to form the descending sub-symbol string, the amplitudes of the other parallel two-way sub-symbols are K.
The device according to claim 30, wherein the processing module is configured to: when a symbol is detected, and the amplitude of the three-way sub-symbol of the symbol is the maximum amplitude of the branch, according to the preset a sequence of symbol transmissions of the sequence and the symbol determining a starting position of the sequence, and determining a second portion and a portion of the sequence based on the starting position, the length of the sequence, and the symbol transmission order of the sequence And obtaining a gamma curve and a channel matrix according to the second part, and processing the multiple subcarrier modulation signals according to the gamma curve and the channel matrix to obtain the to-be-transmitted data.
The device according to claim 34, wherein the processing module is configured to acquire a gamma curve according to the second part, and specifically includes:

The processing module is specifically configured to use a difference between the amplitudes of any two sub-symbols on each path in the second portion as a multiple of the step size m
Second sub-symbol, obtained and described
Sub-symbols corresponding to the second sub-symbol, and for each of the roads
The sub-symbols corresponding to the second sub-symbols perform a Gamma signal extraction operation to determine the gamma curve of each path.
The device according to claim 34, wherein the processing module is configured to acquire a channel matrix according to the second part, and specifically includes:

The processing module is specifically configured to: obtain, by using the received symbol, a first received symbol corresponding to a symbol sent by the sending end device with a range of [K, -K, -K]; wherein, [K, - K, -K] characterizing the first received symbol is when the amplitude of the second sub-symbol of the first branch is K, and the amplitude of the second sub-symbol of the second branch and the third branch is -K And a second received symbol corresponding to the symbol transmitted by the transmitting device with the amplitude of [-K, K, -K] is obtained from the received symbol; wherein, [-K, K, - K] characterizing the second received symbol as the second sub-character of the first branch The amplitude of the number is K, the amplitude of the second sub-symbol of the second branch is K, and the amplitude of the second sub-symbol of the third branch is -K; and, from the received symbol Obtaining a third received symbol corresponding to the sending end device transmitting a symbol of amplitude [-K, -K, K]; wherein [-K, -K, K] characterizing the third received symbol is first a second sub-symbol of the branch and the second branch having a magnitude of -K, a second sub-symbol of the third branch having a magnitude corresponding to K; and, according to the first received symbol, the second receiving The symbol and the third received symbol result in the channel matrix.
The device according to claim 30, wherein the processing module is further configured to: when a symbol is detected, and the amplitude of the three-way sub-symbol of the symbol is the minimum amplitude of the branch on the branch, a subcarrier modulation signal having a phase error, and determining a starting position of the sequence according to the symbol; and obtaining a Gamma curve and a channel matrix according to the third portion; and, according to the Gamma curve and the channel matrix pair The multi-channel subcarrier modulation signal is processed to obtain the data to be transmitted.
The apparatus according to claim 31, wherein the processing module is specifically configured to: when detecting one symbol in the sequence, and detect the sequence again after spacing a preset number of symbols a symbol, determining a starting position of the sequence according to the one symbol; an order of the one symbol and the another symbol satisfies a symbol transmission order of a preset sequence; and, according to a symbol transmission order of the sequence And determining, by the amplitude of the one symbol and the amplitude of the another symbol, whether the subcarrier modulation signal has a phase error; if there is no phase error, acquiring a Gamma curve and a channel matrix according to the first portion, and according to the Processing the multi-channel subcarrier modulation signal by the Gamma curve and the channel matrix to obtain the data to be transmitted; if there is a phase error, acquiring a Gamma curve and a channel matrix according to the second portion, and according to the Gamma The curve and the channel matrix process the multi-channel subcarrier modulation signal to obtain the data to be transmitted.
The apparatus according to any one of claims 34 to 38, wherein the processing module is configured to process the multi-subcarrier modulation signal according to the gamma curve and the channel matrix, to obtain a location The data to be transmitted, including:

The processing module is specifically configured to perform nonlinear compensation on the subcarrier modulation signal according to the gamma curve, and perform color correction on the compensated modulated signal according to the channel matrix to obtain a corrected signal, and obtain a corrected signal according to the Decoding the corrected signal and the length of the amplitude modulated signal, deleting the sequence in the corrected signal to obtain the amplitude modulated signal; and demodulating the amplitude modulated signal to obtain the data to be transmitted
The device according to any one of claims 34 to 38, wherein the device further comprises: a transmitting module;

The sending module is configured to send information about the gamma curve to the sending end device, where the information of the gamma curve is used to indicate that the sending end device uses the gamma curve to perform nonlinearity on the subcarrier modulation signal. Compensation, obtaining a compensated modulated signal;

The receiving module is further configured to receive the compensated modulated signal sent by the sending end device, and perform color correction on the compensated modulated signal according to the channel matrix to obtain a corrected signal;

The processing module is specifically configured to: delete the sequence in the corrected signal according to the corrected signal and the length of the amplitude modulated signal, obtain the amplitude modulated signal, and demodulate the amplitude modulated signal And obtaining the data to be transmitted.