Search Results (17)

Strawberry (Fragaria × ananassa), a nutrient-dense fruit with significant economic value in commercial cultivation, faces critical detection challenges in automated harvesting due to complex growth conditions such as foliage occlusion and variable illumination. To address these limitations, this study proposes Ripe-Detection, a novel lightweight object detection framework integrating three key innovations: a PEDblock detection head architecture with depth-adaptive feature learning capability, an ADown downsampling method for enhanced detail perception with reduced computational overhead, and BiFPN-based hierarchical feature fusion with learnable weighting mechanisms. Developed using a purpose-built dataset of 1021 annotated strawberry images (Fragaria × ananassa ‘Red Face’ and ‘Sachinoka’ varieties) from Changchun Xiaohongmao Plantation and augmented through targeted strategies to enhance model robustness, the framework demonstrates superior performance over existing lightweight detectors, achieving mAP50 improvements of 13.0%, 9.2%, and 3.9% against YOLOv7-tiny, YOLOv10n, and YOLOv11n, respectively. Remarkably, the architecture attains 96.4% mAP50 with only 1.3M parameters (57% reduction from baseline) and 4.4 GFLOPs (46% lower computation), simultaneously enhancing accuracy while significantly reducing resource requirements, thereby providing a robust technical foundation for automated ripeness assessment and precision harvesting in agricultural robotics. Full article

The continuous and reliable operation of autonomous systems is important for farm management decision making, whether such systems perform crop monitoring using imaging systems or crop handling in pruning and harvesting applications using robotic manipulators. Autonomous systems, including robotic ground vehicles, drones, and tractors, are major research efforts of precision crop management. However, these systems may be less effective or require specific customizations for planting systems in low tunnels, high tunnels, or other environmentally controlled enclosures. In this work, a compact and lightweight crop management platform is developed that uses overhead power cables for continuous operation over row crops, requiring less human intervention and independent of the ground terrain conditions. The platform does not carry batteries onboard for its operation, but rather pulls power from overhead cables, which it also uses to navigate over crop rows. It is developed to be modular, with the top section consisting of mobility and power delivery and the bottom section addressing a custom task, such as incorporating additional sensors for crop monitoring or manipulators for crop handling. This prototype illustrates the infrastructure, locomotive mechanism, and sample usage of the system (crop imaging) in the application of low-tunnel-covered strawberries; however, there is potential for other row crop systems with regularly spaced support structures to adopt this platform as well. Full article

Strawberry harvesting represents a labor-intensive agricultural operation where existing end-effector pose control algorithms frequently exhibit insufficient precision in fruit grasping, often resulting in unintended damage to target fruits. Concurrently, deep learning-based pose control algorithms suffer from inherent training instability, slow convergence rates, and inefficient learning processes in complex environments characterized by high-density fruit clusters and occluded picking scenarios. To address these challenges, this paper proposes an enhanced reinforcement learning framework DRFW-TQC that integrates Dynamic L2 Regularization for adaptive model stabilization and a Group-Wise Feature Weighting Network for discriminative feature representation. The methodology further incorporates a picking posture traction mechanism to optimize end-effector orientation control. The experimental results demonstrate the superior performance of DRFW-TQC compared to the baseline. The proposed approach achieves a 16.0% higher picking success rate and a 20.3% reduction in angular error with four target strawberries. Most notably, the framework’s transfer strategy effectively addresses the efficiency challenge in complex environments, maintaining an 89.1% success rate in eight-strawberry while reducing the timeout count by 60.2% compared to non-adaptive methods. These results confirm that DRFW-TQC successfully resolves the tripartite challenge of operational precision, training stability, and environmental adaptability in robotic fruit harvesting systems. Full article

In this paper, a novel tool prototype for harvesting tabletop-grown strawberries is presented. Demonstrating resilience to localization inaccuracies of up to $\pm 15$ mm and achieving an average cycle time of $8.02$ s at half its maximum operational speed, the tool represents a promising step forward in automating strawberry harvesting. It features a compact 35 mm fruit-engagement width, improving accessibility through its small operational footprint. A complete harvesting system is also proposed that can be mounted to a mobile platform for field tests. An experimental demonstration is performed to showcase the new methodology and derive relevant metrics. Full article

With the development of intelligent modern agriculture, strawberry harvesting robots play an increasingly important role in precision agriculture. However, existing vision systems face multiple challenges in complex farmland environments, including fruit occlusion, difficulties in recognizing fruits at varying ripeness levels, and limited real-time processing capabilities. This study proposes a keypoint detection and 3D localization method for strawberry fruits utilizing a depth camera to address these challenges. By introducing a Haar Wavelet Downsampling (HWD) module and Gold-YOLO neck, the proposed method achieves significant improvements in feature extraction and detection performance. The integration of the HWD module effectively reduces image noise, enhances feature extraction accuracy, and strengthens the method’s ability to recognize fruit stems. Additionally, incorporating the Gold-YOLO neck structure enhances multi-scale feature fusion, improving detection accuracy and enabling the method to adapt to complex environments. To further accelerate inference speed and enable deployment in an embedded system, Layer-adaptive sparsity for Magnitude-based Pruning (LAMP) technology is employed, significantly reducing redundant parameters and thereby enhancing the lightweight performance of the model. Experimental results demonstrate that the proposed method can accurately identify strawberries at different ripeness stages and exhibits strong robustness under various lighting conditions and complex scenarios, achieving an average precision of 97.3% while reducing model parameters to 38.2% of the original model, significantly improving the efficiency of strawberry fruit localization. This method provides robust technical support for the practical application and widespread adoption of agricultural robots. Full article

As the world’s population continues to rise while the agricultural workforce declines, farmers are increasingly challenged to meet the growing food demand. Strawberries grown in the U.S. are especially threatened by such stipulations, as the cost of labor for such a delicate crop remains the bulk of the total production costs. Autonomous systems within the agricultural sector have enormous potential to catalyze the labor and land expansions required to meet the demands of feeding an increasing population, as well as heavily reducing the amount of food waste experienced in open fields. Our team is working to enhance robotic solutions for strawberry production, aiming to improve field processes and better replicate the efficiency of human workers. We propose a modular configuration that includes a Delta X parallel robot and a pneumatically powered end effector designed for precise strawberry harvesting. Our primary focus is on optimizing the design of the end effector and validating its high-speed actuation capabilities. The prototype of the presented end effector achieved high success rates of 94.74% in simulated environments and 100% in strawberry fields at Farias Farms, even when tasked to harvest in the densely covered conditions of the late growing season. Using an off-the-shelf robotic configuration, the system’s workspace has been validated as adequate for harvesting in a typical two-plant-per-row strawberry field, with the hardware itself being evaluated to harvest each strawberry in 2.8–3.8 s. This capability sets the stage for future enhancements, including the integration of the machine vision processes such that the system will identify and pick each strawberry within 5 s. Full article

Due to the complex unstructured environmental factors in ridge-planting strawberry cultivation, automated harvesting remains a significant challenge. This paper presents an oriented-ridge double-arm cooperative harvesting robot designed for this cultivation. The robot is equipped with a novel non-destructive harvesting end-effector and two self-developed specialized manipulators, integrated with the strawberry picking point visual perception system based on the lightweight Mask R-CNN and a CAN bus-based machine control system. The greenhouse harvesting experiments show that the robot achieved an average harvesting success rate of 49.30% in natural environments after flower and fruit thinning, while only a 30.23% success rate was achieved in untrimmed natural environments. This indicates that the agronomic practice of flower and fruit thinning can significantly simplify the automated harvesting environment and improve harvesting performance. Automated harvesting efficiency test results show that the single-arm average harvesting speed is 7 s per fruit, while double-arm cooperative harvesting can achieve 4 s per fruit. Future expansion by increasing the number of robotic arms could significantly improve harvesting efficiency. However, the study conducted for this paper was poor for those strawberries whose body or stem was severely blocked, which should be further improved upon in follow-up studies. Full article

This study presents the design and implementation of a wire-driven, multi-joint robotic arm equipped with a cutting and gripping mechanism for harvesting delicate strawberries, with the goal of reducing labor and costs. The arm is mounted on a lifting mechanism and linked to a laterally movable module, which is affixed to the tube cultivation shelf. The trained deep learning model can instantly detect strawberries, identify optimal picking points, and estimate the contour area of fruit while the mobile platform is in motion. A two-stage fuzzy logic control (2s-FLC) method is employed to adjust the length of the arm and bending angle, enabling the end of the arm to approach the fruit picking position. The experimental results indicate a 90% accuracy in fruit detection, an 82% success rate in harvesting, and an average picking time of 6.5 s per strawberry, reduced to 5 s without arm recovery time. The performance of the proposed system in harvesting strawberries of different sizes under varying lighting conditions is also statistically analyzed and evaluated in this paper. Full article

This paper presents the design of a strawberry fruit head gripper unit, together with the concept of a control system for the operation of its mechanisms and vision system. The developed design consists of three specialised mechanisms: positioning, grasping, and cutting off of the fruit. A Finite Element Method (FEM) model was developed for the described design. Next, calculations were carried out, based on which the construction materials were selected. The key performance parameters of the functional model, built on the basis of the developed design concept, were verified under laboratory conditions. In tests carried out on the possible hematoma caused by exceeding the breaking stress induced by the pressure of the encompassing jaws on the fruit, it was found that none of the fruit tested suffered mechanical damage as a result of the sensor triggering force, and the average length of the trimmed stalk was approximately 14 mm. The designed head gripper, together with the proposed automation system, will contribute to improving harvesting precision, and this will favour a reduction in the quantitative and qualitative losses of the harvested crop. The experimental tests conducted under harvesting conditions showed a high efficiency of 95% in identifying ripe fruit, and the harvesting efficiency of the robotic arm was 90%. Full article

Automatic harvesting robots are crucial for enhancing agricultural productivity, and precise fruit maturity detection is a fundamental and core technology for efficient and accurate harvesting. Strawberries are distributed irregularly, and their images contain a wealth of characteristic information. This characteristic information includes both simple and intuitive features, as well as deeper abstract meanings. These complex features pose significant challenges to robots in determining fruit ripeness. To increase the precision, accuracy, and efficiency of robotic fruit maturity detection methods, a strawberry maturity detection algorithm based on an improved CES-YOLOv8 network structure from YOLOv8 was developed in this study. Initially, to reflect the characteristics of actual planting environments, the study collected image data under various lighting conditions, degrees of occlusion, and angles during the data collection phase. Subsequently, parts of the C2f module in the YOLOv8 model’s backbone were replaced with the ConvNeXt V2 module to enhance the capture of features in strawberries of varying ripeness, and the ECA attention mechanism was introduced to further improve feature representation capability. Finally, the angle compensation and distance compensation of the SIoU loss function were employed to enhance the IoU, enabling the rapid localization of the model’s prediction boxes. The experimental results show that the improved CES-YOLOv8 model achieves an accuracy, recall rate, mAP50, and F1 score of 88.20%, 89.80%, 92.10%, and 88.99%, respectively, in complex environments, indicating improvements of 4.8%, 2.9%, 2.05%, and 3.88%, respectively, over those of the original YOLOv8 network. This algorithm provides technical support for automated harvesting robots to achieve efficient and precise automated harvesting. Additionally, the algorithm is adaptable and can be extended to other fruit crops. Full article

As strawberries are a widely grown cash crop, the development of strawberry fruit-picking robots for an intelligent harvesting system should match the rapid development of strawberry cultivation technology. Ripeness identification is a key step to realizing selective harvesting by strawberry fruit-picking robots. Therefore, this study proposes combining deep learning and image processing for target detection and classification of ripe strawberries. First, the YOLOv8+ model is proposed for identifying ripe and unripe strawberries and extracting ripe strawberry targets in images. The ECA attention mechanism is added to the backbone network of YOLOv8+ to improve the performance of the model, and Focal-EIOU loss is used in loss function to solve the problem of imbalance between easy- and difficult-to-classify samples. Second, the centerline of the ripe strawberries is extracted, and the red pixels in the centerline of the ripe strawberries are counted according to the H-channel of their hue, saturation, and value (HSV). The percentage of red pixels in the centerline is calculated as a new parameter to quantify ripeness, and the ripe strawberries are classified as either fully ripe strawberries or not fully ripe strawberries. The results show that the improved YOLOv8+ model can accurately and comprehensively identify whether the strawberries are ripe or not, and the mAP50 curve steadily increases and converges to a relatively high value, with an accuracy of 97.81%, a recall of 96.36%, and an F1 score of 97.07. The accuracy of the image processing method for classifying ripe strawberries was 91.91%, FPR was 5.03%, and FNR was 14.28%. This study demonstrates the program’s ability to quickly and accurately identify strawberries at different stages of ripeness in a facility environment, which can provide guidance for selective picking by subsequent fruit-picking robots. Full article

A lightweight strawberry detection and localization algorithm plays a crucial role in enabling the harvesting robot to effectively harvest strawberries. The YOLO model has often been used in strawberry fruit detection for its high accuracy, speed, and robustness. However, some challenges exist, such as the requirement for large model sizes, high computation operation, and undesirable detection. Therefore, the lightweight improved YOLOv5s-CGhostnet was proposed to enhance strawberry detection. In this study, YOLOv5s underwent comprehensive model compression with Ghost modules GCBS and GC3, replacing modules CBS and C3 in the backbone and neck. Furthermore, the default GIOU bounding box regressor loss function was replaced by SIOU for improved localization. Similarly, CBAM attention modules were added before SPPF and between the up-sampling and down-sampling feature fusion FPN–PAN network in the neck section. The improved model exhibited higher mAP@0.5 of 91.7% with a significant decrement in model size by 85.09% and a reduction in GFLOPS by 88.5% compared to the baseline model of YOLOv5. The model demonstrated an increment in mean average precision, a decrement in model size, and reduced computation overhead compared to the standard lightweight YOLO models. Full article

The smart farm is currently a hot topic in the agricultural industry. Due to the complex field environment, the intelligent monitoring model applicable to this environment requires high hardware performance, and there are difficulties in realizing real-time detection of ripe strawberries on a small automatic picking robot, etc. This research proposes a real-time multistage strawberry detection algorithm YOLOv5-ASFF based on improved YOLOv5. Through the introduction of the ASFF (adaptive spatial feature fusion) module into YOLOv5, the network can adaptively learn the fused spatial weights of strawberry feature maps at each scale as a way to fully obtain the image feature information of strawberries. To verify the superiority and availability of YOLOv5-ASFF, a strawberry dataset containing a variety of complex scenarios, including leaf shading, overlapping fruit, and dense fruit, was constructed in this experiment. The method achieved 91.86% and 88.03% for mAP and F1, respectively, and 98.77% for AP of mature-stage strawberries, showing strong robustness and generalization ability, better than SSD, YOLOv3, YOLOv4, and YOLOv5s. The YOLOv5-ASFF algorithm can overcome the influence of complex field environments and improve the detection of strawberries under dense distribution and shading conditions, and the method can provide technical support for monitoring yield estimation and harvest planning in intelligent strawberry field management. Full article

Strawberry fruits are products of high commercial and consumption value, and, at the same time, they are difficult to harvest due to their very low mechanical strength and difficulties in identifying them within the bush. Therefore, robots collecting strawberries should be equipped with four subsystems: a video object detection system, a collecting arm, a unit for the reception and possible packaging of the fruit, and a traction system unit. This paper presents a concept for the design and operation of the working section of a harvester for strawberry fruit crops grown in rows or beds, in open fields, and/or under cover. In principle, the working section of the combine should meet parameters comparable with those of manually harvested strawberries (efficiency, quality of harvested fruit) and minimise contamination in the harvested product. In order to meet these requirements, in the presented design concept, it was assumed that these activities would be performed during harvesting with the natural distribution of fruits within the strawberry bush, and the operation of the working head arm maneuvering in the vicinity of the picked fruit, the fruit receiving unit, and other obstacles was developed on the basis of image analysis, initially general, and in detail in the final phase. The paper also discusses the idea of a vision system in which the algorithm used has been positively tested to identify the shapes of objects, and due to the similarity of space, it can be successfully used for the correct location of strawberry fruit. Full article

Protected cultivation systems such as greenhouses are becoming increasingly popular globally and have been adopted because of unpredictable climatic conditions and their ability to easily control micro- and macroenvironments. However, limitations such as hazardous work environments and shortages in labor are major concerns for agricultural production using these structures. This has led to the development and adoption of robotic systems. For the efficient use of robots in protected cultivation systems, we formulate the work efficiency problem and model a three-dimensional standard strawberry greenhouse to analyze the effectiveness of a strawberry-harvesting robot compared to different levels of human workforce (experienced, average, and beginner). Simulations are conducted using Quest software to compare the efficiency of different scenarios of robotics to humans. Different methods of improvement from battery capacity and charge rate to harvesting speed are investigated and optimal conditions are recommended. The average hourly production of the robot is about five times lower than that of skilled workers. However, robots are more productive due to their ability to work around the clock. Comparative analyses show that a reduction in harvesting time per strawberry from 3 to 1 s would result in an increase in daily production from 347.93 to 1021.30 kg. This would lead to a five-fold increase in comparison to present daily production. A 10% improvement in battery charge time would result in the battery capacity gaining two extra hours from the current 10 h and would cut the current 2 h needed for charge to 1 h. This paper proposes an operation process and suggestions for changes needed for improving the work efficiency of robots in a greenhouse. This could be extended to other crops and greenhouses. Full article