Next Article in Journal
Human-Like Lane Change Decision Model for Autonomous Vehicles that Considers the Risk Perception of Drivers in Mixed Traffic
Previous Article in Journal
Passive Underwater Target Tracking: Conditionally Minimax Nonlinear Filtering with Bearing-Doppler Observations
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Design and Implementation of the MIMO–COOK Scheme Using an Image Sensor for Long-Range Communication

Department of Electronics Engineering, Kookmin University, Seoul 02707, Korea
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(8), 2258; https://doi.org/10.3390/s20082258
Submission received: 18 February 2020 / Revised: 1 April 2020 / Accepted: 14 April 2020 / Published: 16 April 2020
(This article belongs to the Section Optical Sensors)

Abstract

:
Radio-frequency technologies are widely applied in many fields such as mobile systems, healthcare systems, television and radio broadcasting, and satellite communications. However, one major problem in wireless communication based on radio frequencies is its impact on human health. High frequencies adversely impact human health more than low frequencies if the signal power transgresses the permissible threshold. Therefore, researchers are investigating the use of visible light waves (instead of the radio-frequency band) for data transmission in three major areas: visible light communication, light fidelity, and optical camera communication. In this paper, we propose a scheme that upgrades the camera on–off keying (COOK) scheme by using it with the multiple-input multiple-output (MIMO) scheme; COOK has been recommended by the IEEE 802.15.7-2018 standard. By applying technologies, such as matched filter, region of interest, and MIMO, our proposed scheme promises to improve the performance of the conventional scheme by improving the data rate, communication distance, and bit error rate. By controlling the exposure time, the focal length in a single camera and using channel coding, our proposed scheme can achieve the communication distance of up to 20 m, with a low error rate.

1. Introduction

Wireless communication presents advantages over wired communication because it is easier to set up and broadcast data without having to use wires. Wireless communication based on radio frequencies (RFs) has led to the rapid development of mobile networks. However, the radio-frequency resources are being exhausted. To increase the data rate, we need to increase the communication frequencies. Various research groups worldwide have been investigating ways of improving upon the fifth-generation (5G) of digital cellular networks in the frequency band of millimeter waves that increase the data rate (1–10 Gbps). However, it is important to consider that RFs have potentially harmful effects on human health [1]. Therefore, researchers worldwide have attempted to find new technologies to replace RF technologies currently in use. Studies have shown that visible light [2] can be used for data transmission instead of the RF techniques; the optical wireless communication (OWC) technique include three main techniques using LEDs to transmit data [3]: visible light communication (VLC), light fidelity (LiFi), and optical camera communication (OCC). VLC and LiFi both use photodiodes for the reception of signals from LEDs. The difference between VLC and LiFi is not only using visible light spectrum, but infrared spectrum also tested in LiFi [4]. Besides that, LiFi used the bidirectional transmission, with visible light as downlink and the infrared spectrum in uplink when VLC just uses visible light with one-direction. Unlike VLC or Li-Fi technologies that use photodiodes as receivers, the OCC system uses an image sensor as a detector on the receiver side. The performance of the OCC system depends significantly on the camera type [5]. Global shutter and rolling shutter cameras are two types of cameras suitable for the OCC system, and these cameras are available in the commercial market at reasonable prices. For the global shutter camera, the frame rate is the main factor that affects the OCC performance because the frame rate determines whether the sampling rate satisfies the Nyquist sampling requirement. However, in the rolling shutter camera, the sampling rate depends also on the rolling rate of the camera. Their advantages of OWC technique over the RF technique are as follows:
  • Visible light waves do not have any negative influences on the human body [6]. In contrast, RF waves adversely affect human health and reduce system performance because of electromagnetic interference (EMI).
  • The bandwidth of the visible light wave is much greater than that of the RF bandwidth; it is more than 1000 times the RF bandwidth.
  • It is important to consider that when the line-of-sight transmission is gained by the channel model, visible light waves are more safe and efficient.
Given this potential, many companies are investing a substantial amount in funding research on innovations in this technique. OWC technologies were introduced in the IEEE 802.15 standard [7]. The uniqueness of the OWC technique and its complexity protocol are given in [7]. The IEEE 802.15.7m task group (TG 7m) was created to amend the previous standard (i.e., IEEE 802.15.7-2011) [7], which focused only on the VLC mode. In TG 7m, the OWC technique includes the following four features:
  • The updated VLC modes are used in the IEEE 802.157-2011 standard [8].
  • OCC uses cameras or image sensors to receive signals from a light source by using various modulation techniques.
  • Light-emitting diode (LED) identification is a low-speed communication scheme with speeds below 1 Mbps; LEDs are used as photodiodes.
  • Light fidelity (Li-Fi) is a high-speed modulation scheme that uses a high-rate photodiode with data exceeding 1 Mbps in the physical layer.
Currently, the RF technologies cover most areas, such as mobile communication systems, monitoring systems, and radar systems, with typical techniques such as Wi-Fi, ZigBee, and Bluetooth. However, RF frequencies radiate EMI [9]. In [10], the author presented the adverse effects of EMI on human health, especially on brain functions; this fact is now receiving the attention of health researchers worldwide. Recently, the visible light technique has risen as a novel EMI-free substitute for RF technology [11]. In a conventional VLC system, the photodiode receives data according to the fast switching on or switching off of information from LEDs on the transmitter side [12]. In [13], the author implemented an ultra-high-speed pulse density (PD) modulation scheme with extremely effective spectral properties based on the VLC technology. To transmit high-speed data, [14,15] applied multiple-input multiple-output (MIMO) in the VLC/Li-Fi technology with ultra-high-speed multi-channels. When PD schemes are used as detectors, VLC and Li-Fi have a disadvantage that they can only be operated within short distances; this suits the indoor communication system. In an outdoor environment, the effect of the distortion channel impedes the photodiodes from receiving light intensities. To eliminate this, the OCC technology deploys an image sensor as a detector, which can receive data up to 200 m. In [16,17], the researchers assumed that the type of an image sensor (global shutter or rolling shutter) affects the OCC performance. To satisfy Nyquist’s law in the OCC system based on the global shutter camera, the sampling rate needs to focus on the frame rate of the camera. However, with a rolling shutter camera, the sampling rate needs to focus not only on the frame rate of the camera but also on the camera rolling rate. Then, the rolling shutter camera is usually operated for a high data rate system. For long-distance operations and to enhance the signal-to-noise ratio (SNR), the focal length was employed to focus the light beam on the image sensor. Currently, Li-Fi technology is being improved by using a photodiode lens to extend the communication distance, but the maximum distance is only 10 m [18].
The OCC system can easily deploy the MIMO technique. It can cope with the big OCC problem of simultaneous connection with many light sources, and it can make it feasible for the camera as well. The MIMO technique is not feasible for the PD-based system when connecting a large number of links. Besides, OCC technology can be operated with many applications based on the image processing algorithm. Region-of-interest (RoI) signaling is an algorithm, which has been applied in OCC [19]. Based on the rolling shutter effect and orthogonal frequency-division multiplexing (OFDM) waveform, the authors of [20] proposed a rolling-OFDM modulation for high-rate communication because when intensity modulation/direct detection (IM/DD) modulation is used, it is difficult to find suitable LED materials comparable with the on-off keying. A two-dimensional OFDM for OCC using the screen method has been discussed in [21]; the researchers achieved a high data rate. However, one disadvantage was the large transmitter size and the short distance, which made it an expensive transmitter.
In [22], we proposed the camera on-off keying (COOK) scheme with a single LED. To decode data, we used the zero-crossing to verify the on/off value in the images. However, certain drawbacks were found. The limited transmission distance and high error rate were compared by using a matched filter to decode the data. In this paper, we propose the MIMO–COOK scheme in which the COOK scheme has been upgraded by using MIMO, region of interest, and matched filter. These technologies are also recommended in [23,24] but we proposed this scheme to upgrade the conventional COOK, which is recommended in IEEE 802.15.7-2018 standard. With this upgrade scheme, the system performance, distance communication and data rate are improved compared with the conventional COOK, which will be illustrated below.
The remainder of this paper consists of four sections. Section 2 highlights the contributions of the MIMO–COOK scheme. In Section 3, we show the system architecture of the proposed scheme. The implementation results of the proposed scheme are presented in Section 4. Finally, Section 5 concludes this paper.

2. Contributions of This Research

In this study, we proposed the MIMO–COOK modulation, which reduces the bit error rate (BER) and improves the data rate as compared with the conventional COOK modulation. Our scheme has the following advantages:
  • Frame rate variation support: frame rate variations have an important effect on the OCC system; packets can be missed when decoding data on the receiver side. Most people believe that the camera frame rate is constantly similar to the camera specifications (e.g., 30 fps or 1000 fps). It is very difficult to synchronize the transmitter (Tx) and the receiver (Rx) depending on the technical parameters of the different cameras. The sequence number (SN) will improve the system performance by checking whether it has a frame rate larger than the packet rate of the transmitter.
  • Detection of missing packets: we used two consecutive images captured by the camera to easily detect each missing packet by comparing two SNs when the length of the SN exceeded a certain value. A comparison of the SN and Ab bit to detect missing packets in the COOK scheme is presented in Section 4.
  • Data merger algorithm: in our experiment, we proposed this algorithm for each data sequence by compacting the packages into it in the exact order. In this scheme, we used the SN to combine the data packets such as the Ab bit.
  • Improve system performance as compared with the conventional COOK: a matched filter is the optimal linear filter for maximizing the SNR. For determining the on/off thresholds in images, the matched filter is superior to the conventional zero-crossing filter. The SNR is maximized; therefore, the communication distance also is increased, and we can achieve the desired BER. This will be shown in Section 3.3.
  • Improved data rate: using multi-LEDs, the data rate will be increased as compared with the conventional COOK. Multi-LEDs are used to transmit data; therefore, RoI signaling is chosen to detect quickly the light sources in images corresponding to each LED.
  • Improve the communication distance: by using the matched filter to detect the start of frame and decode data, the communication distance is improved than the conventional COOK (using Zero Crossing) because of its SNR improvement.

3. System Architecture

On off keying (OOK) scheme is known as the simplest form of amplitude-shift keying modulation by using two statuses: ON/OFF to transmit data. In the simplest form of OOK, a binary one is presented by a carrier for a specific duration and a binary zero is presented by the absence of a carrier for the same duration. OOK almost is applied to transfer Morse code via RF waveform or the industrial, scientific, and medical (ISM) band to connect among computers in the computer network because of its simplicity.
In Section 3, we provide the details of the MIMO–COOK scheme. Unlike the COOK mentioned in [22], we used RoI algorithms to detect light sources. To detect preambles and decode, we used a matched filter instead of the zero-crossing filter. Figure 1 illustrates the architecture of MIMO-COOK scheme. The operations of the blocks are presented below.

3.1. Line Coding

Line coding is the process of converting digital data to digital signals that convert a sequence of bits into a digital signal. At the sender’s side, the digital data are encoded into a digital signal. At the receiver’s side, the digital data are recreated by decoding the digital signal.
Run-length limited (RLL) coding is a common/useful line-coding technique for a limited bandwidth communication channel. The RLL codes include four parameters: m, n, d, and k. The rate of the code was calculated using the two parameters m and n. However, the two parameters d and k specify the minimum and the maximum number of zeros between consecutive codes. Special RLL codes are used in light communication to provide dc balance because flicker mitigation is required in VLC (except in some OCC modes). In the IEEE 802.15.7-2018 standard, the Manchester codes 4B6B and 8B610 are recommended for deployment in the OCC system [25]. Table 1 presents three line codes, which are recommended in IEEE 802.15.7-2018.

3.2. RoI Detection

RoI algorithms are being increasingly used to detect objects because these algorithms provide high accuracy in problem-solving. Almost all RoI algorithms use two approaches: object-based and feature-based [26]. The feature-based approach collects all possible pixels based on the similarity of optical features. Then, these pixels are analyzed to make RoI algorithms. One disadvantage of a feature-based approach is that it is insufficient for identifying the entire target because all pixels do not have a robust feature that is displayed in optical pixels. In contrast, the object-based method can detect RoIs better than the pixel-to-pixel feature-based method because the object-based method uses information about the structures and shapes for detection. The object-based method includes many typical approaches, such as matched filter and template matching [27]. However, the object-based method has certain disadvantages, such as complex calculations and unreliable and low-quality images. In this research, because of using multi-LEDs to transmit data, we need some algorithms to detect and receive data automatically at light sources. RoI emerged as the brightest candidate for it. In this paper, we used the RoI methods to detect the LED objects in each image, which were captured by a camera. It reveals the position of transmitters. Then, the signal from the transmitters can be decoded by receivers.

3.3. Match Filter

To highlight the advantages of the matched filter with the COOK scheme, we will compare the matched filter with zero crossing filter (which we used in the conventional COOK scheme). Similar to its name, the zeros crossing filter distinguishes the ON/OFF levels in the receiver side based on the zero levels as the threshold level. This method will have a good performance if the SNR of the system is high, but with the SNR lower, the distinction between ON/OFF statuses is unclear as shown in Figure 2. Then if we depend on the zero levels to define the threshold level, the performance of the system is reduced. From that, we can conclude that the zero crossing filter becomes ineffective with the low signal to noise system. In Section 4, we demonstrate the relationship of SNR, exposure time of camera, and communication distance. With the same exposure time, the SNR will be reduced if the communication distance is high. From that, we need another technique instead of the zero crossing filter to improve the communication distance and the system performance.
The matched filter is a filter technology achieved by comparing a template signal with the real signal to determine the template signal in the real signal. The matched filter, which is one of the linear filter technologies, optimizes the SNR in the appearance of additive random noise. Matched filters are widely used in almost all wireless communication systems, such as mobile communications and radar systems to maximize the SNR of the system; these filters increase the system performance. In the IEEE 802.15.7-2018 standard [25], the matched filter is also recommended for use in the OCC system. The performances of the matched filter and zero-crossing filter in the COOK scheme have been compared in Section 4. In this paper, we used the matched filter for two purposes: detect preamble and decode data.
To detect preamble positions, the received signal is multiplied with the known preamble signal via the convolution algorithm as Equation (1). The preamble positions in each image are the peak of the resulting signal as Figure 3. From that, we can explore payload positions.
f * g t + f τ g t τ d τ
After the detect preamble, to decode data, we also used the matched filter to decode data to improve the system performance. By create known patterns as Figure 4, the received signal is multiplied with the known preamble signal via the convolution algorithm. From convolution results, we can know that: which patterns are the most like the received signal? From that, it is easy to verify the value of signals (0 or 1). Same with the Manchester code, we can create 16 patterns of 4B6B code to decode data.

4. Implementation

4.1. Experimental SNR Measurement

The SNR was measured to demonstrate the relationship between the communication distance, SNR, and exposure times. We can adjust the exposure time to achieve the desirable BER value and communication distance for the OCC system. In the experiment, we conducted many measurements for the distance between 5–20 m to calculate the SNR. As shown in Figure 5, we used LED (12-V, 3-W, 2 × 2 cm2 rectangle) as a transmitter and a rolling shutter camera (Point Gray) as a receiver. We also set up the exposure times of the camera in the range of 50–500 μs with appropriate distance.
The SNR was measured at a distance of 5, 10, 15, and 20 m (Figure 6, Figure 7, Figure 8 and Figure 9). We can use two status of LED to calculate SNR. The first status of LED is ON, the SNR can be considered as the signal power of the LED and is displayed as a red line at a different distance. The second status of the LED is OFF, we used a blue line to display the SNR which can be awarded as background noise at this status. The SNR (dB) can be figured out based on the experiment by using the following equation:
S N R d B = 20 log 1 n i = 0 n 1 A i 2 1 n i = 0 n 1 B i 2
here, A is represented for the signal power of the LED (i.e., pixel amplitudes which are measured when the LED turned on); B is represented for the background noise (i.e., pixel amplitude which is measured when the LED is turned off); and the number of measured samples is represented by n.
The received pixel amplitude values will be large at a short distance and small at a long distance. The shuttle speed and exposure time also affect the SNR calculation. The relationship between the SNR value and pixel intensity with a different exposure time of 50, 150, 300, and 50 μs is illustrated clearly in Figure 7. The most important factor that affects the SNR is exposure time. In this scenario, the operation of the image sensor is similar to a low-pass filter. Since the high-tone signal will be smoothened when the exposure time is greater. Moreover, the communication bandwidth will go down as well which significantly affects to decrease in the total noise power spread over the bandwidth when the exposure time increases. Long exposure time also leads to the rise in the SNR. Besides that, the relationship between the SNR and the communication distance is illustrated in Figure 10. In the longer distance, the SNR value is reduced because of the power of light sources received in image sensors reduces. As we mentioned before, the matched filter is one of the linear filters to optimize the SNR of the system, then it also improves the communication distance. The comparison of COOK performance between zero-crossing and matched filter is illustrated in Section 4.4.

4.2. Simulation BER of COOK Scheme

In the receiver side of the communication system, the electrical amplitude of the received signal is illustrated as:
r ( t ) = I ( t ) + i = + I ( t ) a i g ( t i T s y m b o l ) + n ( t )
where a i is the level of the i t h OOK symbol and a i ∈ {0,1}; we assumed that the probabilities of bit 0 and 1 are P 0 and P 1 , g ( t ) presents as the rectangular function, and T s y m b o l is the symbol duration. Because of the only additive white Gaussian noise (AWGN) in channel model, the BER can be presented [26] in Equation (4).
P e = 1 2 e r f c ( E b 2 σ n 2 )
Because of the only AWGN channel, the received signal in the receiver side for bits “0” and “1” is shown as follows:
r ( t ) = n ( t ) , a i = 0 2 I ( t ) + n ( t ) , a i = 1
Figure 11 shows the estimated curve of the COOK scheme versus the SNR with the matched filter and zero-crossing filter compared with the theoretical bit error probability of OOK modulation based on the additive white Gaussian noise channel. The figure demonstrates that the use of a matched filter to decode the COOK scheme is better than the zero-crossing filter. It illustrates that the performance of our proposed scheme is better than that of the COOK proposed in [22]. From the SNR measurements of Figure 10 and Figure 11, we can gain a BER of 10 4 at 20 m (SNR of 12.5 dB, exposure time of 50 μs) using the matched filter. However, with the zero-crossing filter, we need an SNR of 15 dB corresponding to the distance of 15 m and an exposure time of 50 μs. The exposure time has a significant role in the SNR measurement because the SNR improves with an increase in the exposure time. However, a long exposure will reduce the communication bandwidth. To achieve the best performance, it is important to set the exposure time carefully depending on the application. Besides that, the COOK using matched filter improved the performance significantly, which is almost the same with the theoretical bit error probability of OOK modulation in E b / N 0 values of 0–8 dB. This facility to improve the SNR values of the system without changing the exposure time, from that increase the distance communication without reducing the system performance.

4.3. Proposed Scheme

Figure 12 shows the format of the proposed scheme that we will discuss in this subsection. In this scheme, every packet contains many sub-packets to support the compatibility of the frame rate variations. The serial number of the sub-packet was created as an SN. The sub-packet in the same packet had the same data payload. In practice, depending on the combination of the packet rate of the transmitter and the frame rate of the camera, the SN was divided and controlled. When the frame rate was smaller than the packet rate, undersampling occurred. In contrast, when the frame rate was larger than the packet rate, oversampling occurred. The packet rate is the number of packets (containing different payloads) being constantly transmitted in one time period (e.g., 20 packets/s). The proposed data frame of our scheme contained data packet frames that contained smaller data sub-packets (DSs); every DS holds the payload data and an SN. The SN carries the sequence information of a data packet and the identity of the payload. Payload identification was useful in practice because it helped the receiver identify the arrival state of a new payload in the oversampling case and detect lost payloads in the undersampling case. An example of SN in practical studies [22] is where the 1-bit Ab is used in the oversampling case, and 2-bit Ab is used for the undersampling case. A disadvantage of this method is the confusion of the receiver in the decoding process and the limited missing payload that it can detect. The proposed scheme can overcome this disadvantage by using n bits of the SN. The length of the SN can be changed based on the practical situation and the system parameters. Depending on the channel environment, the SN length is chosen suitably. In harsh environment or a bad camera quality, the missed packet is large, then we need the SN of large length. However, with a good camera quality, we can reduce the SN length to improve the system performance. In our paper, we used the SN length of 4 bits to implement the MIMO-COOK scheme.
Same with the COOK scheme, Figure 12 shows how to use SN with oversampling and undersampling cases. Besides that, to identify the order of LEDs in MIMO–COOK, we proposed LED_ID, which helped combining each separated packet in each LED in the order of the images.

4.3.1. Oversampling

When the frame rate of a rolling shutter camera is at least two times larger than the packet rate of light sources, the data packet is sampled multiple times causing the oversampling effect. It occurs because of the frame rate variation effect, then we need to use the repetition code to transmit data. When the packet is sampled more than once, errors of packet merger are created at the receiver side. The SN is added to the DS to deal with this problem because it improves the receiver’s ability to decrease the frame rate variation effect. Redundant data were removed from the receiver when the same SN value is recognized in the DS of different packets. The receiver side can exclude consecutive packets with the same SN value and select packets with consecutive SN values (n − 1, n, n + 1) for the merger, as illustrated in Figure 13.
In our proposed algorithms, the data sub-packets are added to the data packet; this is repeated N times to reduce the loss rate of the packets while the camera cannot capture the time between the sub-packets. To enhance the reliability of the OCC system, we need to prevent the missing of packets when there is a change in the frame rate of the camera. For this, the calculation of the N value must conform to the following equation:
N ( T c a m ) max D S _ l e n g t h
where T c a m is the inter-frame interval between two consecutive images, and DS_length is the data packet interval.

4.3.2. Undersampling

When the frame rate of the camera decreases below the packet rate of the transmitter, undersampling occurs. The payload will be lost in undersampling unlike in the case for oversampling. Figure 14 shows the scenario in which the missing payload is created and detected using the SN. In this case, if the SN is long enough, the receiver can detect the missing payload. If one payload is missing, the error can be detected by comparing the SN of the two adjacent DSs which received on the receiver side. The number of SNs in different states depend on the length of SN part in each sub-packet. For example, four missing payloads of the transmitted packets can be detected if we use two bits for the SN length. When one error is detected, the error correction becomes easier. If two consecutive sub-packets have two non-consecutive sequence number values (n − 1 and n + 1), missings occur as shown in Figure 14. In our implementation below, we use the SN length of 4 bits then 16 missing payloads can be detected if the undersampling case occurs.

4.3.3. Maximum Length of Sub-Packet

The time interval for scanning one of the pixels in each image is called the rolling rate of the rolling shutter camera [28]. The number of pixels considered as a bit are counted as Equation (7):
N p i x e l / b i t = T c l o c k T r o l l i n g
According to Nyquist’s theorem, certain new features are available in the rolling shutter camera. The condition for the optical clock rate of LEDs based on the shutter speed of rolling shutter camera is T c l o c k 2 T r o l l i n g .
N s y m b o l L E D _ s i z e N p i x e l / b i t

4.4. Implementation Results

Our experiments were performed ten times with the MIMO–COOK scheme, and some rolling shutter cameras were used to verify the frame variation effect. The asynchronous process includes asynchronous decoding, merging data technique, and the detection of missing parts. The SN length also is chosen carefully for the overall process. For the Point Gray rolling shutter camera, the frame rate variation was between 20 fps and 60 fps. Figure 15 shows the setup of implementation, and Figure 16 shows the practical MIMO–COOK waveform. The experimental results are shown in Figure 16, and the results and parameters are shown in Table 2.
Figure 17 depicts the implemented results; the experiments were performed ten times with different communication distances at the same exposure time of 100 us for comparing the COOK with our proposed scheme. Figure 17 shows that with the same communication distance and channel environment, the matched filter significantly improved the system performance more than the zero-crossing filter. From Figure 10, we can modify the pixel SNR by setting an exposure time to improve the system performance at a long communication distance; however, the high exposure time will increase the probability that the fuzzy states of LEDs lead to a reduction in the communication bandwidth. From that, we can conclude that: by using the matched filter, the communication distance can improve without reducing the system performance. Besides this, to improve the system performance at longer communication distances, channel coding is recommended to mitigate the high ratio of fuzzy states.
Table 2 shows the experimental results obtained by conducting experiments several times using different optical clock rates. The table shows that the data rate can increase by increasing the data sub-packet length and the optical clock rate; however, the clock rate and the data sub-packet length must suit the rolling shutter camera parameters, namely, the rolling rate of the rolling shutter camera and the size of images, as shown in Equations (7) and (8). We implement this scheme with two LEDs at the communication distance of 2 m, which can be visually assessed by the Supplementary Materials.

5. Conclusions

In this paper, we proposed the MIMO–COOK scheme, which was an upgrade of the conventional COOK scheme. The MIMO–COOK scheme uses a matched filter instead of a zero-crossing filter; this significantly improved the performance of the OCC system. The proposed frame structure using SN can support the frame rate variation effect and recover data in images. Furthermore, we deployed the SNR measurements with different exposure times and distances to verify the relationship between the exposure time, SNR, and communication distance. Finally, we measured the BER of this scheme with different communication distances and compared these with the conventional COOK scheme.
By inserting the sequence number on each sub-packet, we can connect the sub-packet from other images to become the huge packet, which is the desired transmitted signal. By using the SN length which is long enough, the lost packets can be detected based on the non-sequentials of SNs leading to improved BER performance. However, the trade-off between the BER performance and the data rate needs to be considered carefully because the SN is a redundant component that does not carry data.
Besides that, by using the matched filter to detect preamble and decode data, the system performance is improved compared with the conventional COOK scheme using zero-crossing. Because of the increase in SNR value, the matched filter also increases the communication distance without changing the system performance compared with the conventional COOK scheme.

Supplementary Materials

Supplementary Materials can be seen at: https://susy.mdpi.com/user/submission/video/abc2d558f8f595cf4b51373819dca01e. The supplementary material video shows the implementation of our proposal scheme at the distance of 2 m.

Author Contributions

All authors contributed to this paper: V.H.N. and M.D.T. proposed the idea and implemented the methodology; H.N. performed all experiments and V.H.N. wrote the paper, verified the experiment process and results, reviewed and edited the paper; Y.M.J. supervised the work and provided funding support. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIT) (No. 2017-0-00824, Development of Intelligent and Hybrid OCC-LiFi Systems for Next Generation Optical Wireless Communications) and the Ministry of Trade, Industry and Energy (MOTIE) and Korea Institute for Advancement of Technology (KIAT) through the International Cooperative R&D program.

Acknowledgments

I would like to thank my seniors: Cong Hoan Nguyen, Van Bui, Tung Lam Pham, and Thanh Luan Vu for the stimulating discussions and time worked together.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kim, J.H.; Lee, J.K.; Kim, H.G.; Kim, K.B.; Kim, H.R. Possible Effects of Radiofrequency Electromagnetic Field Exposure on Central Nerve System. Biomol. Ther. 2019, 27, 265–275. [Google Scholar] [CrossRef] [PubMed]
  2. Haas, H.; Yin, L.; Chen, C.; Videv, S.; Parol, D.; Poves, E.; Alshaer, H.; Islim, M.S. Introduction to indoor networking concepts and challenges in LiFi. J. Opt. Commun. Netw. 2020, 12, A190–A203. [Google Scholar] [CrossRef]
  3. Chowdhury, M.Z.; Hossan, M.T.; Islam, A.; Jang, Y.M. A Comparative Survey of Optical Wireless Technologies: Architectures and Applications. IEEE Access 2018, 6, 9819–9840. [Google Scholar] [CrossRef]
  4. Haas, H. LiFi is paradigm-shifting 5G technology. Rev. Phys. 2018, 3, 26–31. [Google Scholar] [CrossRef]
  5. Rajagopal, S.; Roberts, R.D.; Lim, S.K. IEEE 802.15.7 Visible Light Communication: Modulation and Dimming Support. IEEE Commun. Mag. 2012, 50, 72–82. [Google Scholar] [CrossRef]
  6. Nikola, S.; Volker, J.; Yeong Min, J.; John, L.Q. An Overview on High-Speed Optical Wireless/Light Communications. Available online: https://mentor.ieee.org/802.11/dcn/17/11-17-0962-02-00lc-an-overview-on-high-speed-optical-wireless-light-communications.pdf (accessed on 1 February 2019).
  7. IEEE—SA. IEEE Std 802.15.7–2011–IEEE Standard for Local and Metropolitan Area Networks-Part 15.7: Short-Range Wireless Optical Communication Using Visible Light; IEEE-SA: Piscataway, NJ, USA, 2011. [Google Scholar]
  8. Nguyen, T.; Islam, A.; Yamazato, T.; Jang, Y.M. Technical Issues on IEEE 802.15.7m Image Sensor Communication Standardization. IEEE Commun. Mag. 2018, 56, 213–218. [Google Scholar] [CrossRef]
  9. Tan, K.S.; Hinberg, I.; Wadhwani, J. Electromagnetic interference in medical devices: Health Canada’s past current perspectives and activities. In Proceedings of the International Symposium on Electromagnetic Compatibility, Montreal, QC, Canada, 13–17 August 2001; pp. 1283–1288. [Google Scholar]
  10. Masao, T.A.K.I.; Watanabe, S. Biological and health effects of exposure to electromagnetic field from mobile communications system. IATSS Res. 2001, 25, 40–50. [Google Scholar]
  11. Ong, Z.; Rachim, V.P.; Chung, W.Y. Novel Electromagnetic-Interference-Free Indoor Environment Monitoring System by Mobile Camera Image Sensor based VLC. IEEE Photonics J. 2017, 9, 1–11. [Google Scholar] [CrossRef]
  12. Haas, H.; Yin, L.; Wang, Y.; Chen, C. What is LiFi? J. Lightwave Technol. 2015, 34, 1533–1544. [Google Scholar] [CrossRef]
  13. Ali, A.Y.; Zhang, Z.; Zong, B. Pulse position and shape modulation for visible light communication system. In Proceedings of the International Conference on Electromagnetics in Advanced Applications (ICEAA), Palm Beach, FL, USA, 3–8 August 2014; pp. 546–549. [Google Scholar]
  14. Deng, P.; Kavehrad, M. Real-time software-defined single-carrier QAM MIMO visible light communication system. In Proceedings of the Integrated Communications Navigation and Surveillance (ICNS), Herndon, VA, USA, 19–21 April 2016; pp. 5A3-1–5A3-11. [Google Scholar]
  15. Cai, H.B.; Zhang, J.; Zhu, Y.J.; Zhang, J.K.; Yang, X. Optimal constellation design for Indoor MIMO visible light communications. IEEE Commun. Lett. 2016, 20, 264–267. [Google Scholar] [CrossRef]
  16. Nguyen, T.; Nam, T.L.; Jang, Y.M. Practical Design of Screen-to-Camera based Optical Camera Communication. In Proceedings of the 2015 International Conference on Information Networking (ICOIN), Siem Reap, Cambodia, 12–14 January 2015. [Google Scholar]
  17. Nguyen, T.; Islam, A.; Hossan, T.; Jang, Y.M. Current Status and Performance Analysis of optical camera communication Technologies for 5G Networks. IEEE Access 2017, 5, 4574–4594. [Google Scholar] [CrossRef]
  18. Ayyash, M.; Elgala, H.; Khreishah, A.; Jungnickel, V.; Little, T.; Shao, S.; Rahaim, M.; Schulz, D.; Hilt, J.; Freund, R. Coexistence of WiFi and LiFi Toward 5G: Concepts, Opportunities, and Challenges. IEEE Commun. Mag. 2016, 54, 64–71. [Google Scholar] [CrossRef]
  19. Nguyen, T.; Islam, A.; Jang, Y.M. Region of Interest Signaling Vehicular System using optical camera communication. IEEE Photonics J. 2017, 9, 1–20. [Google Scholar] [CrossRef]
  20. Nguyen, H.; Thieu, M.D.; Nguyen, T.; Jang, Y.M. Rolling OFDM for Image Sensor Based Optical Wireless Communication. IEEE Photonics J. 2019, 11, 1–17. [Google Scholar] [CrossRef]
  21. Nguyen, T.; Thieu, M.D.; Jang, Y.M. 2D-OFDM for optical camera communication: Principle and Implementation. IEEE Access 2019, 7, 29405–29424. [Google Scholar] [CrossRef]
  22. Nguyen, T.; Hossain, M.A.; Jang, Y.M. Design and Implementation of a Novel Compatible Encoding Scheme in the Time Domain for Image Sensor Communication. Sensors 2016, 16, 736. [Google Scholar] [CrossRef] [PubMed]
  23. Yang, Y.; Hao, J.; Luo, J. CeilingTalk: Lightweight Indoor Broadcast through LED-Camera Communication. IEEE Trans. Mob. Comput. 2017, 16, 3308–3319. [Google Scholar] [CrossRef]
  24. Luo, P.; Zhang, M.; Ghassemlooy, Z.; Zvanovec, S.; Feng, S.; Zhang, P. Undersampled-Based Modulation Schemes for Optical Camera Communications. J. Opt. Commun. Netw. 2020, 56, 204–212. [Google Scholar] [CrossRef]
  25. IEEE—SA. IEEE Std 802.15.7–2018–IEEE Standard for Local and Metropolitan Area Networks—Part 15.7: Short-Range Optical Wireless Communications; IEEE-SA: Piscataway, NJ, USA, 2018. [Google Scholar]
  26. Barua, B. Comparision the performance of Free-Space Optical Communication with OOK and BPSK Modulation under Atmospheric Turbulence. Int. J. Comput. Eng. Sci. 2011, 3, 4391–4399. [Google Scholar]
  27. Lin, H.; Si, J.; Abousleman, G.P. Region-of-interest detection and its application to image segmentation and compression. In Proceedings of the International Conference on Integration of Knowledge Intensive Multi-Agent Systems, Waltham, MA, USA, 30 April–3 May 2007. [Google Scholar]
  28. Nguyen, H.; Thieu, M.D.; Pham, T.L.; Nguyen, H.; Jang, Y.M. The Impact of Camera Parameters on Optical Camera Communication. In Proceedings of the 2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), Okinawa, Japan, 11–13 February 2019. [Google Scholar]
Figure 1. Reference architecture of the multiple-input multiple-output–camera on–off keying (MIMO–COOK) scheme.
Figure 1. Reference architecture of the multiple-input multiple-output–camera on–off keying (MIMO–COOK) scheme.
Sensors 20 02258 g001
Figure 2. An experimental result of COOK signals within a rolling image with low signal-to-noise ratio (SNR).
Figure 2. An experimental result of COOK signals within a rolling image with low signal-to-noise ratio (SNR).
Sensors 20 02258 g002
Figure 3. (a) An experimental result of COOK within a rolling image. (b) The results of preamble position detection based on matched filter.
Figure 3. (a) An experimental result of COOK within a rolling image. (b) The results of preamble position detection based on matched filter.
Sensors 20 02258 g003
Figure 4. Manchester code signal patterns and COOK received signal. (a) 0 impulse, (b) 1 impulse, (c) COOK received signal.
Figure 4. Manchester code signal patterns and COOK received signal. (a) 0 impulse, (b) 1 impulse, (c) COOK received signal.
Sensors 20 02258 g004
Figure 5. Device for SNR measurement.
Figure 5. Device for SNR measurement.
Sensors 20 02258 g005
Figure 6. SNR measurement with Point Gray rolling shutter camera at communication distance of 5 m and exposure time of 50 μs.
Figure 6. SNR measurement with Point Gray rolling shutter camera at communication distance of 5 m and exposure time of 50 μs.
Sensors 20 02258 g006
Figure 7. SNR measurement with Point Gray rolling shutter camera at communication distance of 10 m and exposure time of 50 μs.
Figure 7. SNR measurement with Point Gray rolling shutter camera at communication distance of 10 m and exposure time of 50 μs.
Sensors 20 02258 g007
Figure 8. SNR measurement with Point Gray rolling shutter camera at communication distance of 15 m and exposure time of 50 μs.
Figure 8. SNR measurement with Point Gray rolling shutter camera at communication distance of 15 m and exposure time of 50 μs.
Sensors 20 02258 g008
Figure 9. SNR measurement with Point Gray rolling shutter camera at communication distance of 20 m and exposure time of 50 μs.
Figure 9. SNR measurement with Point Gray rolling shutter camera at communication distance of 20 m and exposure time of 50 μs.
Sensors 20 02258 g009
Figure 10. SNR measurement.
Figure 10. SNR measurement.
Sensors 20 02258 g010
Figure 11. Comparison of bit error rate (BER) of the C-OOK scheme using a matched filter and zero-crossing techniques with the theoretical Bit Error probability of OOK modulation.
Figure 11. Comparison of bit error rate (BER) of the C-OOK scheme using a matched filter and zero-crossing techniques with the theoretical Bit Error probability of OOK modulation.
Sensors 20 02258 g011
Figure 12. MIMO–COOK data packet structure.
Figure 12. MIMO–COOK data packet structure.
Sensors 20 02258 g012
Figure 13. Merging procedure of MIMO COOK scheme in the time domain.
Figure 13. Merging procedure of MIMO COOK scheme in the time domain.
Sensors 20 02258 g013
Figure 14. Error detection in grouping image during undersampling case.
Figure 14. Error detection in grouping image during undersampling case.
Sensors 20 02258 g014
Figure 15. Setup for the MIMO–COOK implementation.
Figure 15. Setup for the MIMO–COOK implementation.
Sensors 20 02258 g015
Figure 16. Rx interface.
Figure 16. Rx interface.
Sensors 20 02258 g016
Figure 17. BER of the COOK system with an exposure time of 100 us.
Figure 17. BER of the COOK system with an exposure time of 100 us.
Sensors 20 02258 g017
Table 1. Coding scheme and proposed preamble.
Table 1. Coding scheme and proposed preamble.
RLL CodeProposed Preamble (SF)
Manchester011100
4B6B0011111000
8B10B0000111111111100000
Table 2. MIMO–COOK parameters.
Table 2. MIMO–COOK parameters.
Transmitter Side
Clock rate8 kHz10 kHz
RLLManchester4B6BManchester4B6B
FECRS (15,11)
LED type12 V, 3 W
Number of LEDs2
Packet rate20 packet/s
Receiver side
CameraPoint Gray rolling shutter camera
Camera frame rate60 fps
Data rate
Uncode bit rate1.2 kbps1.8 kbps1.5 kbps2.25 kbps
Code bit rate0.88 kbps1.32 kbps1.1 kbps1.65 kbps

Share and Cite

MDPI and ACS Style

Nguyen, V.H.; Thieu, M.D.; Nguyen, H.; Jang, Y.M. Design and Implementation of the MIMO–COOK Scheme Using an Image Sensor for Long-Range Communication. Sensors 2020, 20, 2258. https://doi.org/10.3390/s20082258

AMA Style

Nguyen VH, Thieu MD, Nguyen H, Jang YM. Design and Implementation of the MIMO–COOK Scheme Using an Image Sensor for Long-Range Communication. Sensors. 2020; 20(8):2258. https://doi.org/10.3390/s20082258

Chicago/Turabian Style

Nguyen, Van Hoa, Minh Duc Thieu, Huy Nguyen, and Yeong Min Jang. 2020. "Design and Implementation of the MIMO–COOK Scheme Using an Image Sensor for Long-Range Communication" Sensors 20, no. 8: 2258. https://doi.org/10.3390/s20082258

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop