Next Article in Journal
Effects of Body-Mounted Inertial Measurement Unit (IMU) Backpacks on Space Use and Behaviors of Laying Hens in a Perchery System
Next Article in Special Issue
YOLO-Based Light-Weight Deep Learning Models for Insect Detection System with Field Adaption
Previous Article in Journal
CRISPR/Cas9 for Insect Pests Management: A Comprehensive Review of Advances and Applications
Previous Article in Special Issue
Codling Moth Monitoring with Camera-Equipped Automated Traps: A Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Novel Plug-in Board for Remote Insect Monitoring

Department of IT Systems and Networks, Faculty of Informatics, University of Debrecen, 4028 Debrecen, Hungary
Agriculture 2022, 12(11), 1897; https://doi.org/10.3390/agriculture12111897
Submission received: 3 October 2022 / Revised: 31 October 2022 / Accepted: 9 November 2022 / Published: 11 November 2022
(This article belongs to the Special Issue Hardware and Software Support for Insect Pest Management)

Abstract

:
The conventional approach to monitoring insect swarming is based on traps that are periodically checked by human operators. However, human checking of trap contents is expensive, and in many environments, the pest species most frequently encountered in the traps can be detected and monitored automatically. To achieve this goal, a dedicated data acquisition device is necessary, which makes real-time and online pest monitoring possible from a distant location. In addition, it is beneficial for the device to run machine learning algorithms that count and identify insects automatically from pictures. Thanks to the advantages of integrated circuits, more systems have been designed to improve integrated pest management in the context of precision agriculture. However, in our opinion, all of those systems have one or more disadvantages, such as high cost, low power autonomy, low picture quality, a WIFI coverage requirement, intensive human control, and poor software support. Therefore, the aim of this work is to present a novel plug-in board for automatic pest detection and counting. The plug-in board is dedicated to Raspberry Pi devices, especially the Raspberry Pi Zero. The proposed board, in combination with a Raspberry Pi device and a Pi camera, overcomes the limitations of other prototypes found in the literature. In this paper, a detailed description can be found about the schematic and characteristics of the board with a deep-learning-based insect-counting method.

1. Introduction

In all fields of agriculture, a general goal is to increase the crop yield year by year. Since crop yields are affected by pests that may damage crops, farmers use insecticides periodically. However, a much more optimized approach would be to use insecticides only if the insect population exceeded a threshold level. Therefore, pest monitoring and density prediction in the field are important tasks for farmers. This forecast has economic (saving money) and environmental effects (less spraying, lower amounts of insecticides, etc.) because fruit growers can apply insecticides at the right time against insect pests [1].
To acquire quantitative information for pest density prediction, different types of traps can be used, such as light- [2], color- [3], and pheromone-based traps [4]. In this article, we mainly focus on sticky paper traps, where the trap has an attractive color and/or contains a pheromone.
Conventional trap-based insect monitoring requires the manual counting and identification of pests. Manually counting pests in a trap is a slow and expensive process. In addition, the number of skilled persons who can distinguish insect species is limited. For such reasons, the automation of counting and identification tasks would be helpful. Furthermore, traditional pest counting does not give immediate feedback, while an automatized trap provides continuous sampling, and thus, pest population monitoring has a higher temporal resolution. The temporal resolution is important because if the number of pests cannot be obtained in time, it is impossible to take quick action. As an example, management decisions on the codling moth (Cydia pomonella), which is a harmful pest to apple fruit, rely on frequently checked trap captures [5].
For insect counting to be automatized, machine learning and embedded system technologies need to be merged. According to the state of the art of object detection, deep-learning-based detectors can be used with high efficiency not just in computer science but also in agriculture [6]. Since insect counting also relies on object detection, one or more stages of a CNN-based (Convolutional Neural Network) detector might be an obvious choice [7,8]. Due to the success of deep object detectors, many researchers have focused only on image processing software, where sample images were taken by a high-resolution camera [9,10]. However, in an automatized pest monitoring system, the sensing device is at least as important as the image processing software.
Nowadays, IoT (Internet of Things) devices (with RGB cameras) are widely used for the remote monitoring of trap contents [2,11]. In the market, commercial remote monitoring traps are already available, but growers are not satisfied with their scalability and cost. The authors of [5] pointed out that only a few growers apply commercial (smart) traps because they are expensive (approximately USD 1375/ha). In the past several years, some research groups also developed prototype smart traps for pest monitoring. Rustia et al. [12] designed a trap where the main controller unit is a Rapberry Pi 3 mini-computer, and the image sensing unit is a Raspberry Pi camera v2. Their trap requires WIFI coverage for wireless communication and an AC power socket to provide power consumption, which is between 400 and 600 mA, depending on the operating phase. Obviously, this type of trap can be used only in greenhouses where the necessary conditions are met. Chen et al. [13] used Nvidia Jetson Nano and a Raspberry Pi camera to capture images of insects on sticky paper. Their prototype system can be used only indoors. Brunelli et al. [14] designed a low-power camera board where the controller unit is a GAP8 SoC (System on Chip). The device consumes only 30 uW (microwatt) in deep sleep mode, but its power consumption in the active mode is unknown. The used grayscale camera has a rather low resolution (244 × 324 pixels), and it is not easy to transpose deep object detector models to the device. Hadi et al. [15] published a sticky cube (or box) that consists of four polystyrene plates. Inside the box, a Raspberry Pi camera is responsible for image capture, and it can be rotated by servo motors. In this system, there are two controller devices, an Arduino and a Raspberry Pi 3 Model B+. The Arduino is used for motor movement and sensor handling, while the Raspberry Pi is responsible for image capturing and saving. In their prototype system, the circuit’s components are located on a breadboard, which is placed in a plastic box. The power source is a battery, but the power consumption is not detailed. Even though we do not have information about the power consumption, presumably, this trap could operate unattended only for a limited duration. The work of Schrader et al. [5] presented a plug-in imaging system that is dedicated to delta traps. In this system, an Arducam development platform was used as a controller unit that is extended with a 2 MP (Megapixel) OV2640 image capture sensor. In this case, the collected images are stored on the onboard microSD card. The circuit is powered by a 350 mAh (milliampere-hour) 3.7 V lithium polymer ion battery, and its operating time is approximately 2 weeks in the case of daily image capture. The device’s estimated cost is USD 33. Although the device has advantages, it is not able to process captured images, and they must be collected manually.
In summary, these systems have one or more disadvantages that prevent them from being used effectively and widely, e.g., high cost, low power autonomy, low picture quality, a WIFI coverage requirement, intensive human control requirement, or poor software support. Therefore, these devices will remain in the prototype phase, and they will not become a product in their current form. The above-mentioned drawbacks of commercial and prototype traps were the main motivation for our development. Additional information about commercial and prototype traps can be found in [16]. Our proposed sensing device (controller unit plus the plug-in board) overcomes the weaknesses of earlier traps and fulfills the following requirements:
  • Programming framework available for deep-learning-based object detectors;
  • Long operating time with battery power supply, even without solar charging;
  • Long-range wireless communication;
  • Cost-effectiveness.
Meeting such requirements supports the wide distribution of the proposed hardware component, which is applicable not only for research purposes but also for practical goals. Since it automatizes exhausting and time-consuming manual counting, time and cost can be saved. Moreover, continuous data acquisition provides high temporal resolution, which helps to schedule spraying against insect pests more precisely. Spraying needs to be started before the insect population builds up because it is much more difficult to protect the crop against a well-established population. Moreover, the environment will be better protected due to the reduction in the frequency of spraying.

2. Materials and Methods

This section presents all major components of the sensing device, detailing the key features of the proposed plug-in board. Its front and back sides can be seen in Figure 1.

2.1. Controller Unit

The members of the Raspberry Pi “family” and microcontrollers are widely used devices for remote sensing in agriculture [17,18]. Raspberry Pi devices are single-board computers from the Raspberry Pi Foundation. Since its first appearance (2012), numerous new Raspberry Pi devices have been released. They can be categorized into three model types: A, B, and Zero [19]. The core in all members of these three categories is an SoC with more CPUs (Central Processing Units) and memory. All models also have a dedicated camera port, as well as several GPIO (General-Purpose Input/Output) pins that can be used to control a wide range of connected devices.
Although Raspberry Pi computers have several advantages, selecting an appropriate controller unit for the trap is not an easy decision because single-board computers and microcontrollers have different features. Single-board computers have relatively high processing power, physical memory, and storage capacity, but microcontrollers use less energy than a single-board computer uses. Table 1 shows a comparison between the main features of the Raspberry Pi Zero W and the Arduino Uno (ATmega328P) to illustrate the differences between a microcontroller board and a single-board computer.
In our sensing device, we have chosen the Raspberry Pi Zero W (Zero W 2 is also compatible) as a controller unit, which is one of the smallest members of the Raspberry Pi family. The main reason for our decision was the possibility of the high-level Python programming provided by the Linux operating system. It allows the easy transfer of deep learning algorithms. However, it also has disadvantages that need to be taken into consideration in the circuit design. From the sensing device point of view, we have collected the pros and cons of the Raspberry Pi Zero W computer. Its advantages are:
  • Relatively high processing power;
  • Relatively high main memory;
  • Large background storage;
  • Wide range of interfaces (I2C, SPI, UART, CSI, etc.);
  • High-level programming environment;
  • Small size.
Its disadvantages are:
  • Lack of deep sleep mode;
  • Lack of a real-time clock (RTC);
  • Lack of analog capabilities (e.g., analog–digital converter);
  • Only one UART interface.
Fortunately, all of the above disadvantages can be handled by external components. Therefore, the Raspberry Pi Zero can be an efficient controller unit without any restrictions.

2.2. Camera Unit

On the market, there are more RGB (red, green, blue color space) camera units that are compatible with Raspberry Pi devices. The most popular official camera is probably the Raspberry Pi camera v2. Another popular camera type is the HQ (high-quality) 12 MP Raspberry Pi camera. As the name indicates, the HQ camera can capture images at a rather higher resolution (4056 × 3040 pixels). In addition to the official Raspberry Pi cameras, some other third-party camera modules also exist, such as the most advanced cameras from Arducam [20].
Although the image quality is higher for the HQ or Arducam cameras than the quality of the v2 camera, our experiences show that images taken with the v2 camera can be sharp enough to detect small insects. Moreover, higher-resolution cameras can be twice as expensive as the Raspberry Pi camera v2. For these reasons, image capturing is performed by a Raspberry Pi camera v2 in our sensing device, which is connected to the Raspberry Pi Zero W via the dedicated CSI (Camera Serial Interface) port. This fixed-focus 8 MP RGB camera is positioned at the center of the plug-in board, as shown in Figure 1.
From the software point of view, the developer has several options for fine-tuning the camera. The most widely used Pi camera package provides a Python interface with the camera unit and significantly facilitates the writing of customized image-capturing functions.

2.3. Communication Modules

On the plug-in board, there are two communication modules (Figure 2). The first one is the SIM7600E-H, and the second one is the EMB-LR1276S.
The SIM7600E-H allows information exchange via different telecommunication networks, including LTE (Long-Term Evolution). All functionalities of the module are available through 87 pads, which are located on the perimeter of the 30 × 30 × 2.9 mm module. There are 4 dedicated pads for voltage input (but only 2 need to be used) and several pads for ground. The module’s supply voltage is between 3.4 and 4.2 V, where 3.8 V is recommended. The power supply must be able to provide more than 2 A current. Out of the pads, three pads can be used to connect external antennas: main, auxiliary, and GNSS (Global Navigation Satellite System). Many of the pads are used as communication or control channels in the different serial communication interfaces, such as UART, SPI, I2C, and USB. Out of the serial communication interfaces, we utilized only the UART. This interface is used as an AT command and data stream channel. The module has 7 pads to the UART interface, including pads to the RTS/CTS hardware handshake. It supports an adjustable baud rate (from 300 bps to 4 Mbps), where the default is 115,200 bps. In our circuit, only the transmitter and receiver lines are connected to the Raspberry Pi’s UART interface. However, the Pi’s UART interface operates at the 3.3 V voltage level, while the SIM7600′s UART is a 1.8 V voltage interface. In this case, a level shifter needs to be used. In most cases, engineers apply a voltage-matching IC (Integrated Circuit), such as the TXB0108RGYR from Texas Instruments. In contrast, we recommend another level shifter circuit due to its simplicity and cost efficiency (Figure 3).
The SIM7600E-H module can be used not just for information transmission but also for time synchronization and for global positioning thanks to the GNSS engine. Before using GNSS, we need to configure it in the proper operating mode with the AT command. It merges satellite and network information for high availability and accuracy. In addition, it offers industrial accuracy and performance. The key features of the GNSS engine are listed below [21]:
  • Accuracy (Open Sky): 2.5 m;
  • TTFF (Open Sky): <35 s (cold start);
  • Update rate: 1 Hz;
  • Data format: NMEA-0183 (GSV, GGA, RMC, GSA, and VTG sentences);
  • GNSS current consumption: 100 mA;
  • GNSS antenna: active or passive.
For network monitoring, the SIM7600E-H provides a “netlight” pin that can control a network status LED (D1 in Figure 2). If the LED is always on, it means that the module is searching for the network. If the LED is blinking with a 200 ms on/off period, the module is registered to a 4G network. In that case, if the blinking period is longer, the module is registered to a 2G or 3G network. On the board, the usage of the status LED is optional (J2 jumper in Figure 2), and it is not used when the sensing device is outsourced.
The second communication module is the EMB-LR1276S from the Embit company. The core of this wireless module is a SAMR34 ultra-low-power microcontroller that includes a 32-bit ARM Cortex-M0+ processor with 48 MHz clock frequency, 256 KB of Flash memory, and 40 KB of SRAM memory. It is equipped with a UHF (Ultra-High-Frequency) transceiver that supports the LoRaWAN (Long-Range Wide Area Network) long-range wireless protocol. The LoRaWAN is a telecommunication protocol for low-speed communication by radio. It provides low-power communication and Internet access according to LoRa technology (2009) via gateways. This protocol is mainly used for smart city, industrial, and agricultural applications. Similarly, as in other widely used wireless protocols, the LoRaWAN operates in the ISM (Industrial, Scientific, and Medical) unlicensed spectrum bands, where its physical layer establishes the communication channel between nodes and gateways.
The EMB-LR1276S can communicate with the controller device over the UART interface. The default settings of the UART interface are 9600 baud/sec, 8 data bits, no parity, and no hardware flow control. The controller can send simple “AT-like” commands to the module, packed into small packets.
The double communication units may seem to be redundant, but both may be required depending on the short- and long-term goals. It is well known that deep machine learning models require a huge amount of input data (trap images) to fine-tune the network’s parameters. To increase the size of the available dataset, it is worth periodically taking images of trapped insects and sending them to the server side. With the SIM7600E-H, this task can be accomplished easily with the HTTPS protocol. On the other hand, if we want to transmit only the number of cached insects with some additional information (e.g., timestamp), it is sufficient to use only the LoRaWAN communication channel because it has a lower monthly fee (a smaller number of agreements with the network service provider) and power requirement.
Since the Raspberry Pi has only one UART interface and both communication modules use the UART, we must enable the control of the shared interface access. In our design, it is fixed with an HTC125 quadruple bus buffer gate IC that incorporates four 3-state buffers. Utilizing the enable lines of the 3-state buffers, we can easily control access to the Raspberry Pi’s UART interface.

2.4. Power Supply

Three LDO (Low-Dropout) regulators are placed on the plug-in board. Two of them are the MIC29312, while the third one is an NCP1117LP. The MIC29312 is a 3 A regulator with a very-low-dropout voltage. Its output voltage is adjustable between 1.24 V and 15 V. To set the desired output voltage, two external resistors (voltage divider) are used. Its output voltage can be calculated with the following formula, where R1 is the first resistor while R2 is the second resistor of the voltage divider chain:
V o u t = 1.24 × R 1 R 2 + 1
The regulator is protected against overcurrent faults, reversed input polarity, and over-temperature operation. Moreover, it has an enable pin, which was especially important for us in order to turn off the regulator if it is not needed.
One of the MIC29312 regulators is used to create the 5 V supply voltage, which mainly feeds the Raspberry Pi Zero. As shown in Figure 4, the enable input is controlled by a PNP MOSFET, where the gate voltage comes from the on/off timing circuit (next subsection). This means that the Raspberry Pi Zero will be totally switched off if we turn off the regulator.
The other MIC29312 provides an approximately 3.8 V output. This is used to operate the LTE communication module. The schematic of the second MIC regulator can be seen in Figure 5. Here, the enable input is directly controlled by a GPIO pin of the Raspberry Pi Zero.
The NCP1117LP LDO regulator is capable of providing 1 A output current with a dropout voltage of 1.3 V at full current load. The NPC1117 “family” has adjustable and fixed voltage members. On the plug-in board, we used the fixed 3.3 V version. As with the MIC regulator, it also has internal protection features. This regulator feeds more components on the plug-in board, including the RTC. Therefore, it is constantly turned on.

2.5. On/off Timing Circuit

Raspberry Pi single-board computers have no sleep mode. Therefore, an external circuit is necessary in those applications where on/off scheduling is required. Commercial HATs (Hardware Attached on Top) exist for this task, such as the Sleepy Pi, WittyPi, and PiJuice [19]. These HATs can stabilize the DC power supply from a fluctuating DC power source. Moreover, some of them are also capable of programmatically turning the Raspberry Pi on and off. However, all of those HATs apply an additional independent microcontroller to the Raspberry Pi’s safe shutdown. In addition, some circuits cannot be efficiently integrated into special-purpose circuits. Therefore, in this section, we propose a special solution to on/off scheduling.
An RTC circuit is needed to time the Raspberry Pi startup. We used the MCP79410 real-time clock and calendar from Microchip (Figure 6). Its operating voltage range is between 1.8 V and 3.3 V, and it requires a very low (1.2 uA) timekeeping current. In the circuit, the RTC operates continuously on the independent 3.3 V power line; therefore, it does not need to be reset every time the system is restarted. The clock source of the RTC is a 32.768 kHz external crystal. The Raspberry Pi communicates with the MCP79410 via the I2C interface. Both lines of the interface are open-drain; therefore, both of them require a pull-up resistor. Beyond the power, clock, and communication lines, the MCP79410 has one additional important pin. This is the MFP (Multi-Function Pin), which can be used as an alarm output. The alarm functionality of the RTC is very simple. If the counter reaches a pre-defined time point, the voltage level of the MFP will be changed (both positive and negative logics are supported). This output signal is used to turn the 5 V LDO voltage regulator on/off, but not directly.
Here, there is another problem that needs to be addressed. The MFP’s output signal should be delayed to allow the system to shut down correctly. This means that when we remove the power supply, the Raspberry Pi will turn off immediately, with the risk of losing data and corrupting the SD card. Our experiences show that at least a 12 s delay is necessary to correctly shut down the Raspberry Pi Zero W. For this problem, one of the most obvious solutions is a timer, such as the well-known is the 555 IC. However, timers require a trigger pulse, while the RTC can provide only a fixed voltage level. Therefore, our signal delay circuit is based on an 8-bit shift register (SN74HC595), where the clock signal comes from an RC oscillator. The schematic of the delayer circuit is depicted in Figure 7.
Due to our stock, we used the CD74HC14M IC as the inverter of the RC oscillator, but any IC with a smaller number of inverters can also be used here. The other two components of the RC circuit are a 25 kOhm resistor and a 100 uF capacitor. With these values, the RC circuit provides an approximately 0.64 Hz clock signal with a 1.57 s period according to the formula f = 1 2 π R C . Since 8 clock cycles are necessary to shift a logical value through the shift register, the circuit delays the signal by at least 12.57 s.

2.6. Sensing Device Case

The sensing device was built to be weather-resistant using a plastic KradeX Z-74 container (Figure 8). This container consists of a protection box and a transparent cover. The sensing device and a battery are placed inside the protection box. Its dimensions are 56 mm × 126 mm × 177 mm (height × width × length). Thanks to the water-resistant case, the sensing device can be rated up to IP65 (according to the Ingress Protection Rating). Inside the trap, the electronics circuit container needs to hang 20 cm away from the sticky paper.

2.7. Sensing Device Timing and Data Capture Hardware and Software

Before the device’s characteristics are investigated, the principles of the moth-counting software are defined. According to these, the sensing device turns on every day during the observation period at 10:00 o’clock for sufficient light and a lower daily temperature. At the beginning of the process, the software initializes the system components (used modules) and synchronizes the RTC and system time from the GNSS’s NMEA messages. Timestamps are generated from the RTC time. Setting the time accurately is important for tracking the date of capture. In the next step, the Raspberry Pi Zero takes an image of insects on sticky paper and applies the insect-counting algorithm. Depending on the operating mode, the number of detected insects and the timestamp will be transmitted to the server side, and the captured image may also be sent through the LTE network. At the end of the process, the software sets up the next “wake up” time and initiates the shutdown of the Raspberry. A simplified flow chart of the controller software can be seen in Figure 9.

3. Results

The operation of the sensing device was tested in apple orchards near Debrecen, Hungary. At present, only a few automated traps (sensing devices) are currently in operation, but their number will be significantly increased in the next year.

3.1. Sensing Device Operation

Obviously, one of the key components of the trapping system is the insect-counting software. Since the proposed sensing device has been designed to operate with deep-learning-based object detectors, we adopted a deep artificial neural network-based insect-counting strategy from our earlier work [22] to measure the characteristics of the circuit. The used insect-counting method consists of three phases:
  • Object proposition;
  • Object classification;
  • Non-maximum suppression.
In the object propositional stage, the goal is to find all possible image regions where insects could be located. In the used insect-counting method, the Selective Search (SS) algorithm performs this task. To measure the accuracy of the SS method, we introduced the metrics in (2), where N is the number of test images, Mi is the number of ground truth boxes in the i-th test image, tb is the true box, pb is the proposed box (by SS), and IoU() is the intersection over union of the two boxes. SS achieved (in percentage) 82% accuracy on our test set, which indicates that this method can be used with high confidence.
A C C S S = 1 N i = 1 N 1 M i j = 1 M i max I o U t b i , j ,   p b i , k
Depending on the image, SS may identify several thousands of image region proposals. In the next phase, all “moth candidate” image regions are passed to a binary moth classifier model. Its backbone is the MobileNetV2 deep convolutional architecture (pre-trained on the ImageNet) extended with two fully connected layers, where the number of neurons is 128 and 2, respectively. The activation function is ReLu in the hidden layer, while it is softmax in the output layer. The cost function is binary cross-entropy. Due to the softmax function, the model’s output can be seen as a probability value that indicates whether a region contains a moth or not. If a probability value of a candidate region is higher than the threshold (0.5), the region will be labeled as a possible moth. The model was trained on a binary dataset that was generated from a public database [22]. As usual, the whole dataset was divided into training and validation sets. In total, 20% of all images were used for validation, while the remaining images were used for the training set. The batch size was 32 with a small learning rate (0.0001) due to continuous convergence. The stop condition was “no improvement in 5 epochs” (the model was trained within 30 epochs).
After the second phase, there can be more regions that cover the same moth. Therefore, in the last phase, overlapping regions will be “suppressed”. For this task, the Soft Non-Max Suppression (NMS) algorithm is used in the insect-counting method, which eliminates the less likely bounding boxes and tries to keep only the best ones according to the probabilities and the IoU values of overlapping boxes. A sample image of the sticky paper trap and its processed version can be seen in Figure 10. To measure the performance of the insect-counting method, we introduced the loss function in (3), where N is the number of sample images, cp is the number of predicted boxes, and cr is the number of real insects (ground-truth boxes). This loss value was 0.164 on our test set.
l c p , c r = 1 N i = 1 N c i p c i r c i r + 1
After the implementation of the above-described software, we investigated three key characteristics of the sensing device: power consumption, time requirement, and operating temperature.

3.2. Power Consumption

The computational load and the type of information transmission significantly influence the power consumption of an embedded system. Since the sensing device supports two communication units, the power consumption of the sensing device must be examined separately with both units. During the measurements, the input voltage was 7.3 V (voltage of the used battery), while the sampling frequency was 1 Hz. Moreover, the unused components, such as Bluetooth and activity LEDs, were deactivated. The outcome of the measurements can be seen in Figure 11. According to the measurements, the average power consumption was 2.4 W with LTE-based information transmission and 2.12 W with LoRa-based transmission in the active period. In the inactive period, it decreased to 22 mW. Similarly, the average current loads were 0.329 A and 0.290 A with LTE- and LoRa-based information transmission in the active state, respectively. In the inactive state, it was 0.003 A.

3.3. Time Requirement

Figure 11 also shows that the active period of the sensing device was more than 400 s with both communication modules. This time interval comes from the sum of the time required for each subtask. Our additional measurements show that the average time requirement for the main subtasks is the following:
  • Boot duration: 50 s;
  • System component initialization: 36 s;
  • GNSS time synchronization: 98 s (180 s is the upper time limit);
  • Selective Search object proposal’s duration: 187 s;
  • Image proposal (bounding box) pre-processing and classification: 7 s;
  • Soft NMS duration: 1 s;
  • Information transmission time: 60 s (LTE module) and 31 s (LoRa);
  • Shut down time: 17 s.
The 400 s time requirement may seem too much, even if it can be faster depending on GNSS signal detection. However, it must be considered that the Raspberry Pi Zero W has much less computing power than a GPU (Graphics Processing Unit)-accelerated computer.

3.4. Operating Temperature

Since the electronic circuit is placed in a waterproof box, we must make sure that the circuit can dissipate its heat. This is especially important if a computationally heavy insect-counting algorithm is used. In addition, external conditions also should be considered. In such an application, where the protective box retains the heat and may receive direct sunlight, it is a significant risk factor. Dedicated heat sinks can attenuate the processor’s operating temperature, but the usage of a small fan is obviously not practical due to power consumption growth. To obtain information about the operating temperature of the proposed sensing device, we measured the processor’s heat (with LTE information transmission) at two different ambient temperatures. In the first measurement, the temperature was 24 °C, while in the second measurement, the temperature was 30 °C. The measurements were taken after subtasks such as GNSS synchronization, image capture, etc. The results are depicted in Figure 12.

4. Discussion

Knowing the duration of active and inactive states and the expected average power consumption in those states, we can decide on the appropriate size of the battery and predict the operating time of the device. In the case of LTE communication, if we calculate with a 456 s active state period, the average current load per day is approximately 0.0047 A. Thus, the sensing device can run for about 1872 h (78 days) with our 11,000 mAh battery (80% efficiency). In the case of LoRa communication, the operating time is a little bit longer (80 days) because both the average active state (427 s) and the average current load (0.0046 A) are smaller than in the case of LTE communication. However, those operating times depend on several factors, such as ambient temperature, battery condition, age, etc. It is also important to highlight that changing the moth-counting algorithm can significantly change the operating time of the sensing device.
Depending on the insect type, the earlier calculated operating time may not cover the whole insect swarm period. In this case, a solar charger circuit can fix the problem. Such a solar charger circuit is also placed on the plug-in board (Figure 13). The heart of the charger is an LT3652 power-tracking battery charger from the Linear Technology Corporation. It operates in a voltage range between 4.95 V and 32 V, and it provides an externally programmable charge current of up to 2 A. The LTE3652 can be adjusted to terminate charging when the charge current falls below a threshold level. After charging is terminated, it goes into standby mode. In standby mode, its current consumption is only 85 uA. The next charging cycle will start if the battery voltage falls 2.5% below the pre-defined float voltage. As another charging shutdown option, the charger contains a timer that can terminate charging after the desired time has elapsed. However, this option has not been used in our schematic. The output battery voltage can be programmed using a voltage divider via the VFB pin. The charge current can also be programmed via the SENSE pin with an appropriate resistor value. The circuit in Figure 13 has been designed for a 7.3 V battery that can be charged with the maximum 2 A current. If the sensed battery voltage is very low, the charger IC automatically enters a battery precondition mode. In this case, the charge current is reduced to 15% of the programmed maximum.
Utilizing the solar charger circuit, we can fit the capacity and the solar panel’s power according to the target insect’s swarm period. To estimate the battery capacity and solar panel power, we need to know the expected average power consumption per day. With LTE information transmission, this value is 0.035 W.
In the results section, we saw that, even if the ambient temperature is high (30 °C), the processor’s temperature remains below 70 °C. This means that the sensing device can operate safely even in the summer heat because the maximum allowed operating temperature of the Raspberry Pi Zero is 85 °C. As the Raspberry Pi’s temperature approaches its upper limit, the system will automatically begin to throttle the processor to try to cool back down. The highest daily temperature can be significantly higher than 30 °C, but this is usually expected in the afternoon, while the temperature is significantly lower at around 10 o’clock (in the active period of the trap).
Since the proposed plug-in board was not specifically designed for a particular research work but for series production, its cost is another key factor. In Table 2, we summarize the current costs of all circuit components and component groups that have been implanted in the plug-in board. The ICs used in the plug-in board were selected due to their price, power consumption, voltage interval, and availability (“global chip shortage”). It is also important to highlight that those prices depend on more factors, such as the distributor and quantity. In Table 2, the prices are valid for 100 pieces without tax. Thus, the full cost of one plug-in board is less than USD 76 (without the PCD) at the time of writing.

5. Conclusions

In this work, a novel plug-in board is presented for remote insect monitoring purposes. The main components of the board are presented in detail, supported by schematics. Thanks to the plug-in board, the sensing device is easily portable and provides long-range wireless communication. It is also worth mentioning that the device can be used for the monitoring of different insect species, and it requires only minimal human intervention (e.g., changing sticky paper).
Based on the measurement results, we can conclude that the proposed sensing unit is able to operate for a long period with or without solar charging, to perform a deep insect-counting algorithm, and its operating temperature remains below the safe limit.
We tried to design the plug-in board cost-efficiently to make it widely available for fruit growers. At present, only a few sensing devices are available, but we are planning to start the production of the device in cooperation with the Hungarian Eközig company.

Funding

This work has been supported by the eKÖZIG Regionális Informatikai Szolgáltató Központ Zrt thanks to project No. 2020-1.1.2-PIACI-KFI-2021-00249. Project No. 2020-1.1.2-PIACI-KFI-2021-00249 has been implemented with the support provided by the Ministry of Innovation and Technology of Hungary from the National Research, Development and Innovation Fund, financed under the 2020-1.1.2-PIACI KFI funding scheme.

Institutional Review Board Statement

Not applicable.

Acknowledgments

The authors would like to thank the Eközig company for its technical background.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Tetila, E.C.; Machado, B.B.; Astolfi, G.; Belete, N.A.S.; Amori, W.P.; Roel, A.R.; Pistori, H. Detection and classification of soybean pests using deep learning with UAV images. Comput. Electron. Agric. 2020, 179, 105836. [Google Scholar] [CrossRef]
  2. Qing, Y.A.; Jin, F.E.; Jian, T.A.; Xu, W.G.; Zhu, X.H.; Yang, B.J.; Jun, L.Ü.; Xie, Y.Z.; Bo, Y.A.; Wu, S.Z.; et al. Development of an automatic monitoring system for rice light-trap pests based on machine vison. J. Integr. Agric. 2020, 19, 2500–2513. [Google Scholar]
  3. Faria, P.; Nogueira, T.; Ferreira, A.; Carlos, C.; Rosado, L. AI-powered mobile image acquisition of vineyard insect traps with automatic quality and adequacy assessment. Agronomy 2021, 11, 731. [Google Scholar] [CrossRef]
  4. Hoye, T.T.; Arje, J.; Bjerge, K.; Hansen, O.L.P.; Iosifidis, A.; Leese, F.; Mann, H.M.R.; Meissner, K.; Melvad, C.; Raitoharju, J. Deep learning and computer vision will transform entomology. Proc. Natl. Acad. Sci. USA 2020, 118, e2002545117. [Google Scholar] [CrossRef] [PubMed]
  5. Schrader, M.J.; Smytheman, P.; Beers, E.H.; Khot, L.R. An open-source low-cost imaging system plug-in for pheromone traps aiding remote insect pest population monitoring in fruit crops. Machines 2022, 10, 52. [Google Scholar] [CrossRef]
  6. Kamilaris, A.; Prenafeata-Boldú, F. Deep learning in agriculture: A survey. Comput. Electron. Agric. 2018, 147, 70–90. [Google Scholar] [CrossRef] [Green Version]
  7. Hong, S.J.; Nam, I.; Kim, S.Y.; Kim, E.; Lee, C.H.; Ahn, S.; Park, I.K.; Kim, G. Automatic pest counting from pheromone trap images using deep learning object detectors for Matsucoccus thunbergianae monitoring. Insects 2021, 12, 342. [Google Scholar] [CrossRef] [PubMed]
  8. Mamdouh, N.; Khattab, A. YOLO-based deep learning framework for olive fruit fly detection and counting. IEEE Access 2021, 9, 84252–84262. [Google Scholar] [CrossRef]
  9. Hong, S.J.; Kim, S.Y.; Kim, E.; Lee, C.H.; Lee, J.S.; Lee, D.S.; Bang, J.; Kim, G. Moth detection from pheromone trap images using deep learning object detectors. Agriculture 2020, 10, 170. [Google Scholar] [CrossRef]
  10. Korsch, D.; Bodesheim, P.; Denzler, J. Deep learning pipeline for automated visual moth monitoring: Insect localization and species classification. In Proceedings of the INFORMATIK 2021, Berlin, Germany, 27–29 September 2021; Gesellschaft für Informatik: Bonn, Germany, 2021; pp. 443–460. [Google Scholar]
  11. Zhong, Y.; Gao, J.; Lei, Q.; Zhou, Y. A vision-based counting and recognition system for flying insects in intelligent agriculture. Sensors 2018, 18, 1489. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Rustia, D.J.A.; Lin, C.E.; Chung, J.Y.; Zhuang, Y.J.; Hsu, J.C.; Lin, T.T. Application of image and environmental sensor network for automated greenhouse insect pest monitoring. J. Asia-Pac. Entomol. 2020, 23, 17–28. [Google Scholar] [CrossRef]
  13. Chen, Y.S.; Hsu, C.S.; Lo, C.L. An entire-and-partial feature transfer learning approach for detecting the frequency of pest occurrence. IEEE Access 2020, 8, 92490–92502. [Google Scholar] [CrossRef]
  14. Brunelli, D.; Polonelli, T.; Benini, L. Ultra-low energy pest detection for smart agriculture. In 2020 IEEE Sensors; IEEE: Rotterdam, The Netherlands, 2020; pp. 1–4. [Google Scholar]
  15. Hadi, M.K.; Kassim, M.S.M.; Wayayok, A. Development of an automated multidirectional pest sampling detection system using motorized sticky traps. IEEE Access 2021, 9, 67391–67404. [Google Scholar] [CrossRef]
  16. Suto, J. Condling moth monitoring with camera-equipped automated traps: A review. Agriculture 2022, 12, 1721. [Google Scholar] [CrossRef]
  17. Droissart, V.; Azandi, L.; Onguene, E.R.; Savignac, M.; Smith, T.B.; Deblauwe, V. PICT: A low-cost, modular, open-source camera trap system to study plant-insect interactions. Methods Ecol. Environ. 2021, 12, 1389–1396. [Google Scholar] [CrossRef]
  18. Preti, M.; Verheggen, F.; Angeli, S. Insect pest monitoring with camera-equipped traps: Strengths and limitations. J. Pest Sci. 2021, 94, 203–217. [Google Scholar] [CrossRef]
  19. Jolles, J.W. Broad scale applications of the Raspberry Pi: A Review and guide for biologist. Methods Ecol. Evol. 2021, 12, 1562–1579. [Google Scholar] [CrossRef]
  20. Vega, J.; Canas, J.M. Open vision system for low-cost robotics education. Electronics 2019, 8, 1295. [Google Scholar] [CrossRef] [Green Version]
  21. Gang, M.H. Sim7600E-L1C Hardware Design; v1.00; SIMCom Wireless Solutions Limited: Shanghai, China, 2019. [Google Scholar]
  22. Suto, J. Embedded system -based sticky paper trap with deep learning-based insect-counting algorithm. Electronics 2021, 10, 1754. [Google Scholar] [CrossRef]
Figure 1. Front (left) and back (right) sides of the sensing device.
Figure 1. Front (left) and back (right) sides of the sensing device.
Agriculture 12 01897 g001
Figure 2. The SIM7600E-H (left) and the EMB-LR1276S (right).
Figure 2. The SIM7600E-H (left) and the EMB-LR1276S (right).
Agriculture 12 01897 g002
Figure 3. Voltage-matching circuit. The SIM_1V8 label refers to the 1.8 V voltage line that comes from the SIM7600E-H module.
Figure 3. Voltage-matching circuit. The SIM_1V8 label refers to the 1.8 V voltage line that comes from the SIM7600E-H module.
Agriculture 12 01897 g003
Figure 4. Schematic of the 5 V regulator.
Figure 4. Schematic of the 5 V regulator.
Agriculture 12 01897 g004
Figure 5. Schematic of the 3.8 V regulator.
Figure 5. Schematic of the 3.8 V regulator.
Agriculture 12 01897 g005
Figure 6. The RTC circuit.
Figure 6. The RTC circuit.
Agriculture 12 01897 g006
Figure 7. Schematic of the signal delay circuit.
Figure 7. Schematic of the signal delay circuit.
Agriculture 12 01897 g007
Figure 8. Sensing device case with transparent cover. The battery is placed behind the printed circuit board (not visible).
Figure 8. Sensing device case with transparent cover. The battery is placed behind the printed circuit board (not visible).
Agriculture 12 01897 g008
Figure 9. Flowchart of the software.
Figure 9. Flowchart of the software.
Agriculture 12 01897 g009
Figure 10. Sample image of cached insects taken by the sensing device (left) and the moths detected by the insect-counting algorithm (right).
Figure 10. Sample image of cached insects taken by the sensing device (left) and the moths detected by the insect-counting algorithm (right).
Agriculture 12 01897 g010
Figure 11. Power consumption of the circuit with different communication modules.
Figure 11. Power consumption of the circuit with different communication modules.
Agriculture 12 01897 g011
Figure 12. The processor’s operating temperature.
Figure 12. The processor’s operating temperature.
Agriculture 12 01897 g012
Figure 13. Solar power charger circuit.
Figure 13. Solar power charger circuit.
Agriculture 12 01897 g013
Table 1. Comparison of the Raspberry Pi Zero and Arduino Uno.
Table 1. Comparison of the Raspberry Pi Zero and Arduino Uno.
SpecificationRaspberry Pi Zero WArduino Uno (ATmega328P)
TypeSingle-board computerMicrocontroller
Operating systemRaspberry Pi OSNone
Processor32-bit8-bit
Memory512 MB32 Kb
Clock frequency1 GHz16 MHz
Camera portYesNo
Input voltage5 V7–12 V
GPIO pins40 (PWR, GND, digital)20 (PWR, GND, digital, analog)
Background storageMicroSD card (up to 1 TB)Flash memory (32 KB)
Power consumption (in idle state)750 mW<250 mW
Sleep modeNoYes
Table 2. Cost of the used electronics components.
Table 2. Cost of the used electronics components.
ComponentNumberCost (USD)
MIC29302WU24
MCP7941011.1
EMB-LR1276S19.3
LT3652EMSE16
SN74HC12510.3
SIM7600E-H130.4
NCP1117-3.310.4
SN74HC59510.4
CD74HC14M10.3
Resistors261.1
Capacitors266.5
Antennas25.3
Connectors66.3
Diodes52.3
Other91.6
Total8475.3
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Suto, J. A Novel Plug-in Board for Remote Insect Monitoring. Agriculture 2022, 12, 1897. https://doi.org/10.3390/agriculture12111897

AMA Style

Suto J. A Novel Plug-in Board for Remote Insect Monitoring. Agriculture. 2022; 12(11):1897. https://doi.org/10.3390/agriculture12111897

Chicago/Turabian Style

Suto, Jozsef. 2022. "A Novel Plug-in Board for Remote Insect Monitoring" Agriculture 12, no. 11: 1897. https://doi.org/10.3390/agriculture12111897

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop