1. Introduction
Robotic manipulation tasks frequently involve multiple physical contacts between the robots’ end-effector and the external environment, where tactile sensing provides crucial capabilities for perceiving these interactions [
1]. Unlike vision sensors, tactile sensors excel in fine texture identification and force/shear mapping in the local contact area, focusing on capturing the dynamic information generated by the contact process rather than the global 3D environmental sensing. Tactile sensing plays a pivotal role in human-robot interaction and precise in-hand manipulation tasks. Various tactile sensors employing different mechanisms, such as magnetic sensors [
2,
3] is missing, please check and revise it., capacitive sensors [
4,
5], resistive sensors [
6,
7], vision-based tactile sensors (VBTSs) [
8,
9,
10,
11,
12], etc. Among these types of sensors, VBTSs are distinguished by various advantages. Assisted by an embedded camera, the high-resolution tactile data can be captured and transferred into standard image format naturally during imaging instead of the time-consuming analog-to-digital conversion post-process and complex integration circuit design for data collection. This property leads to the evident benefit of high spatial resolution, such as GelSight [
8], which can accurately reconstruct fine textures such as fingerprints or clothing fiber. VBTSs, with their image-based output, enable the application of advanced machine-learning models for tactile perception. For instance, the contact geometry and relative pose are able to be estimated by Graph Neural Networks with other Voronoi-based augmented features [
13], while contact depth and force can be predicted through pixel intensity regression and deep learning [
14]. Furthermore, integrating vision and tactile modalities facilitates comprehensive multimodal perception, achieved through mechanisms like see-through-skin technology [
12,
15].
Despite their promising capabilities, the development of VBTSs is hindered by current manual manufacturing techniques. This traditional fabrication method is labour-intensive and variable, leading to potential inconsistencies in sensor quality and performance. Moreover, the diverse designs documented in various studies complicate the standardization of VBTS production and pose significant challenges in adapting internal structures and external dimensions for different robotic tasks. Typically, most existing VBTSs comprise three main components: the contact module, perception module, and illumination module [
11,
12,
16]. The manufacturing process, particularly within the contact module, involves intricate steps such as skin application, coating deposition, marker integration, elastomer casting, lens assembly, and base mounting. For instance, producing a single-layer elastomer via the prevalent mould-forming method entails multiple critical steps: (1) mould design and fabrication, (2) solution preparation, (3) degassing, (4) elastomer casting, (5) thermal curing, and (6) de-moulding, which necessitate specialised equipment including vacuum extractors, thermal ovens, airbrushes, and laser cutters. However, the complexity even escalates for VBTS designs featuring multi-layer structures, intricate marker patterns, or delicate coatings.
In addition to complex processes, the reliance on manual skills for VBTS manufacturing and assembly poses another significant challenge: the quality of the final product, including assembly precision and error rates, heavily relies on the proficiency and experience of the workforce. This variability complicates the mastery and replication of VBTS designs by researchers, impacting their consistency and scalability. These errors contribute to manufacturing flaws in individual components and result in inconsistencies across production batches, leading to varying outputs among identical VBTS units operating under similar conditions. Also, such hardware inconsistencies pose substantial challenges for developing generalised and adaptable software solutions, particularly signal processing and calibration algorithms, which are critical for deep learning models that rely extensively on data collected from these sensors [
17]. Moreover, as per [
16], VBTS manufacturing costs encompass processing, material, equipment expenses, etc. The intricate procedures, specialised equipment requirements, and skilled labour involved in existing VBTS manufacturing methods significantly escalate costs. Additionally, the sequential assembly method and lack of specialised assembly equipment contribute to prolonged assembly times, even when utilizing prefabricated components.
In summary, the challenges of low assembly efficiency, high error rates, and performance variability among VBTS units represent significant obstacles to their reliability and standardisation. These issues not only impede prototype development but also hinder the mass production of VBTSs. Consequently, current manufacturing techniques often yield unsatisfactory results in terms of production quality, particularly in large-scale production and maintaining consistency. For a comprehensive analysis, we examine the challenges faced by current VBTS manufacturing through the lens of four primary complexities: design, process, time, and quality. Each of these aspects is explored in detail to provide a sequential understanding of the issues involved.
1.1. Design Complexity
Changes in the structural design of VBTS, such as the addition or modification of components, can significantly impact their manufacturing process. Conversely, the specific requirements imposed by current manufacturing methods constrain the design possibilities of VBTSs in return. This mutual limitation complicates the overall VBTS manufacturing process.
Large Category Difference: Different tactile sensing mechanisms rely on distinct hardware structures. For example, GelSight-type sensors [
8,
18,
19] require reflective coatings, whereas marker-based sensors [
9,
11,
20] rely on the marker patterns. The lack of a standardised manufacturing process results in significant disparities in the production of various categories of VBTSs.
Low Customised Flexibility: The traditional manufacturing methods are usually monofunctional and lack flexibility. For example, the mould-forming method is widely used in elastomer manufacturing for VBTSs. However, modifying the original design of such VBTSs requires additional time for remanufacturing the new mould. This issue, often referred to as the ‘mould dependency’ problem [
21], severely restricts design flexibility.
1.2. Process Complexity
VBTS manufacturing consists of two primary steps: first, the fabrication of subcomponents, followed by the final assembly process. However, manufacturing and assembly may interact in a mutually influential manner.
Cumbersome Manufacturing Procedure: The preparation of a single-layer elastomer using the mould-forming method includes multiple steps: mould manufacture, solution preparation, air elimination, mould casting, heat curing, and mould release. Additional procedures, such as dyeing and stiffness adjustment, may also be required, making the procedure more cumbersome.
Complicated Equipment: With the increase in manufacturing steps, additional specialised equipment becomes necessary. Typically, these devices serve a single manufacturing procedure, posing a significant burden on small or individual research teams.
Special Manual Skill: Certain manual processes necessitate experience and specialised skills, making them challenging for beginners or other researchers to master. Consequently, this limitation hampers the design sustainability and restricts horizontal collaboration across different research groups.
1.3. Time Complexity
Most VBTSs have extended production lead times, negatively impacting the iteration speed of proof-of-principle prototypes as well as the scale-up manufacturing of mature products. It is often overlooked that increased time complexity also elevates the overall manufacturing costs.
Long Manufacturing Time: The manufacturing of elastomers involves significant time for preparing, casting, and curing the silicone solution, typically ranging from hours to several days. Similarly, painting coating layers and casting lenses with complex shapes also demands extended time.
Low Assembly Efficiency: Due to the serial assembly workflow, achieving direct assembly of the final product using all pre-fabricated subparts is challenging. Additionally, the lack of assembly equipment further reduces overall efficiency.
1.4. Quality Complexity
With existing manufacturing techniques, it is difficult to manufacture VBTSs in bulk with consistent quality.
Large Assembly Errors: Most VBTS manufacturing involves manual assembly, resulting in random assembly errors, which magnify the adverse effects of any existing manufacturing errors.
Large Individual Variability: Assembly errors can cause output data variations among VBTSs with identical designs. This complicates the generalisation of subsequent signal processing and calibration algorithms, especially for deep learning models.
To address these challenges, this paper introduces a unified monolithic 3D printing technique designed for the rapid manufacturing of VBTSs. Inspired by the impressive flexibility of the integrated printing proposed in [
21], embedded grid structures can serve as an alternative option to silicone elastomer, easily adapted to various VBTS designs. The novel monolithic manufacturing technique leverages advancements in additive manufacturing to create sensors with enhanced precision and functionality. By simplifying the manufacturing process into a single, unified printing sequence, this method not only accelerates production but also ensures greater consistency and integration of the sensory components. To demonstrate the efficiency of such a proposed method, we create a C-Sight sensor using monolithic manufacturing as displayed in
Figure 1A, which gains inspiration from DTac [
10,
14], but with distinct advantages in rapid manufacturing. Furthermore, to validate the feasibility, versatility, and practicality of our rapid manufacturing approach, we conduct a comprehensive quantitative evaluation.
The main contributions of this paper are outlined as follows:
We introduce a unified manufacturing framework for VBTS, employing monolithic manufacturing to streamline production and reduce associated costs.
We develop a novel VBTS sensor, C-Sight, leveraging monolithic manufacturing to demonstrate the adaptability and efficacy of our fabrication method.
2. Design and Fabrication
2.1. Comparison between Typical 3D-Printing Methods
As discussed in the previous section, the primary challenge in manufacturing VBTS lies mostly in the contact module, with recent research focusing on enhancing its fabrication techniques [
9,
11,
16,
21,
22]. Notably, 3D printing technology has demonstrated significant potential in this regard. For example, TacTip [
9] and ChromaTouch [
22] utilised 3D-printing technology to fabricate their bases, markers, and skins, while MagicTac [
21] even fabricated its whole contact module including the elastomer and lens. The specific 3D-printing machines used in their manufacturing are Stratasys J826 (
https://www.stratasys.com/en/3d-printers/printer-catalog/polyjet/j8-series-printers/j826-prime-3d-printer/, accessed on 9 July 2024) and J735 (
https://support.stratasys.com/en/Printers/PolyJet-Legacy/J735-J750, accessed on 9 July 2024), both of which utilise PolyJet Printing (PP) [
23], a superior printing technology with high-resolution performance on multi-material additive fabrication. A comparison between PP and other typical 3D-printing methods is shown in
Table 1. Fused Deposition Modeling (FDM) [
24] has the lowest printing costs but the worst printing quality, and it is also hard to utilise flexible materials except for the opaque thermoplastic polyurethane (TPU). Stereolithography (SLA) [
25] offers the highest printing quality, but it lacks multi-material printing capabilities. Additionally, its post-processing includes the cleaning of liquid resins, requiring specialised dissolving equipment. Selective Laser Sintering (SLS) [
26] offers ease of post-processing due to the absence of supports; however, it still lacks the ability to print multi-material components for transparent or flexible materials. In comparison, PP stands out by combining the advantages of the aforementioned techniques with fine printing accuracy, flexible multi-material function, and straightforward post-process, only with its primary limitation being the relatively high cost of the printing equipment.
2.2. Monolithic Manufacturing for VBTS
Based on the PP, we propose a monolithic manufacturing technology for the VBTS contact module, which simplifies the production process as follows. Initially, the printing process commences with a thin layer of support material on the printer’s tray, composed of a soft, translucent gel. This layer ensures the horizontal stability of printed objects with non-flat bottom shapes and facilitates harmless separation from the print tray upon completion. Then, the components are printed layer by layer according to the CAD model of the VBTS design. A typical fabricating sequence often includes the skin, coating, markers, elastomer, lens, and base. Once the printing process concludes, the printed object is detached from the printer’s tray, and then the bottom support part is removed. This removal is facilitated by the material’s soft texture and thin thickness, allowing for easy separation using water spray or hand tools within a few minutes. After completing the above steps, the entire fabrication process of the VBTS contact module is finished, including the manufacturing and assembly. Finally, the contact module can be directly assembled with the illumination and camera modules to form the complete VBTS system without any extra process. Therefore, the whole process above is defined as monolithic manufacturing technology.
The printing materials commonly used in the PP process are listed in
Table 2. According to their attributes, Vero (
https://www.stratasys.com/en/materials/materials-catalog/polyjet-materials/vero/, accessed on 9 July 2024) is suitable to manufacture the base, lens, and 2D marker [
27] due to its resin-like properties and full-color capability. Similar to Tango (
https://www.stratasys.com/en/materials/materials-catalog/polyjet-materials/tango/, accessed on 9 July 2024), Agilus30 (
https://www.stratasys.com/en/materials/materials-catalog/polyjet-materials/agilus30/, accessed on 9 July 2024) is a rubber-like flexible material. Its colour and stiffness can be adjusted by mixing with Vero material, making it suitable for skin, elastomer, and flexible marker applications. The support material is gel-like with a translucent appearance. Its ultra-soft property allows for effective utilization in designs that structurally combine it with other materials, including Vero. For the base of VBTS, DraftGrey (
https://www.stratasys.com/en/materials/materials-catalog/polyjet-materials/draftgrey/, accessed on 9 July 2024) and Digital ABS (
https://www.stratasys.com/en/materials/materials-catalog/polyjet-materials/digital-abs-plus/, accessed on 9 July 2024) are considered ideal substitutes for Vero material. As demonstrated by the existing research [
9], three sub-components of VBTS, including the base, marker, and skin, can be effectively manufactured using 3D printing. However, its feasibility for creating the other three remaining components, such as the lens, elastomer, and coating, is rarely discussed.
2.2.1. Lens
According to [
21], the lens can be manufactured properly using VeroClear, which could be regarded as the alternative option for acrylic. Alternatively, VeroUltraClear provides higher light transmission (95%) and clarity than VeroClear.
2.2.2. Elastomer
Agilus30 Clear is a promising material for elastomer manufacturing because of its flexibility and transparency. However, its stiffness limitation, with a minimum hardness of 30A, may not be suitable for softer elastomer requirements in many VBTS designs. As per [
21], the stiffness of printed elastomer could be further reduced by introducing the multi-layer grid structure.
2.2.3. Coating
Both reflective and controllable coating require metal material such as flake/powder pigments or foil. However, PP has not supplied the printing materials that contain metal pigment until now. Given the materials listed in
Table 2, the conventional coating is difficult to realise through monolithic manufacturing at the current stage.
2.3. Comparison with Current VBTS Manufacturing
In general, the traditional manufacturing technique for VBTS can be categorised into four categories based on elastomer preparation methods, which are
mould-formed manufacturing,
injection-filled manufacturing,
DIY-modified manufacturing, and also the
monolithic manufacturing which is proposed in this work. Due to the lack of quantitative metrics, these four methods are evaluated qualitatively based on the aforementioned complexities defined in the Introduction section, including design, process, time, and quality in four parts and nine related metrics. Scores ranging from one to four are assigned to rank each method from best to worst based on these metrics. Detailed results of this evaluation are presented in
Figure 2.
Based on the results, mould-formed manufacturing ranks lowest due to its limited customization flexibility, complex fabrication steps, and extended production duration. Conversely, DIY-modified manufacturing excels in reducing equipment dependency, but it faces significant limitations in enhancing production quality and stability. Injection-filled manufacturing, which employs 3D-printing technology as a partial replacement for mould casting, can be regarded as an advanced iteration of mould-formed manufacturing. However, it remains limited by the time-intensive nature of the silicone preparation and gel injection process. In comparison, monolithic manufacturing offers a more effective solution to the constraints inherent in current VBTS manufacturing processes. It holds the potential to evolve into a universal design and manufacturing framework for VBTS, thereby enhancing design flexibility, streamlining production, and lowering overall costs. To illustrate this efficiency, the subsequent sections provide a detailed description of the design and manufacturing process of the C-Sight, created by the proposed monolithic manufacturing.
2.4. Design and Fabrication of C-Sight
Here, we introduce the novel C-Sight sensor fabricated using the proposed monolithic manufacturing technique, which is inspired by the structure of the DTac-type sensor [
10,
14]. DTac distinguishes itself from other tactile sensors that rely on reflective coating or marker patterns due to its novel combination of outer opaque black layer, middle translucent elastomer layer, and internal transparent elastomer layer, providing impressive tactile feature mapping ability. However, such a stacked architecture places a challenge in mould-formed manufacturing, where three different silicone formulations with varying compositions must be manually cast layer by layer. Referring to
Figure 2, such a manufacturing method may lead to significant design, process, time, and quality complexities. In this case, we aim to fabricate a DTac-type sensor, C-Sight, to demonstrate that the proposed monolithic manufacturing method has the feasible ability to create VBTS with complicated structures.
The exploded view and section view of C-Sight are illustrated in
Figure 3. Between the external opaque skin and the internal transparent elastomer, two additional components are present: a translucent layer composed of support material and a pure white layer fabricated from Agilus30White. Similar to the DTac sensor’s mechanism, the deformation resulting from an object’s contact induces a variation in the distance between C-Sight’s outer black skin and embedded white skin. This deformation is facilitated by the ultra-soft and translucent properties of the support material. Theoretically, from the camera’s imaging, places, where the distance between black and white skins is shortened (concave inwards), appear darker in pixels. As shown in
Figure 1D, this unique feature of C-Sight is the subtraction between the reference and camera imaging. This property makes it possible to infer the tactile texture and depth information from the pixel values.
As displayed in the exploded and section views of the sensor assembly in
Figure 3A, the C-Sight contact module comprises six components: opaque skin (1), a translucent layer (2), a white layer (3), a transparent layer (4), a lens (5), and the mounting base (6). Also, the designed base consists of four parts, including a home base (7), LED lights (8), a camera base (9), and a camera (10). C-Sight uses six white LEDs to provide illumination in the vertical direction where the cross-sectional view of the sensor base reveals that the light emitted by the LEDs is scattered through the intermediate baffles in the home base.
Figure 3B presents a schematic diagram detailing the materials used for each subpart of the C-Sight contact module. Compared to the original design of the DTac, it can be noted that C-Sight introduces an extra structure, a white layer (3) between the translucent layer (2) and the transparent layer (4). The role of this white layer is to better filter the tactile image background and enhance the contrast of the black layer when contact occurs. It’s important to note that this work does not aim to prescribe a standardised or definitive design for C-Sight to match or surpass the tactile sensing performance of the official DTac sensor. Instead, the details of its internal structure, each layer’s dimensions, and the materials’ distribution can be modified flexibly, depending on specific application requirements. This approach aims to demonstrate the potential that if a DTac-type sensor can be produced through monolithic manufacturing, then VBTSs with other complex structures can also be feasibly developed, offering developers a solution to realize diverse and novel designs. Therefore, C-Sight serves more as a template, encouraging researchers to explore their own innovative VBTS structures using monolithic manufacturing techniques.
4. Conclusions and Future Work
In this paper, we introduce the C-Sight sensor, fabricated using the proposed monolithic manufacturing technique, which aims to provide a faster, more reliable, and versatile method for the production of VBTSs. The proposed monolithic manufacturing technique represents a significant improvement over traditional VBTS manufacturing techniques by (i) leveraging 3D printing to streamline the production process, enhancing manufacturing efficiency and consistency, and (ii) simplifying the customisation of VBTSs to meet specific requirements across various applications. This technique eliminates the need for a manual fabrication process and significantly reduces production costs and manufacturing time compared to other typical VBTSs. The utility and performance of C-Sight are evaluated in several contact-rich tasks, demonstrating its potential to enhance tactile perception.
Our future research will explore the integration of advanced computational models with monolithically manufactured VBTSs of novel architecture, extending their inference capabilities for tactile sensing. This will pave the way for their use in more complex sensory tasks, such as vision-tactile fusion and robot manipulation. We plan to explore the miniaturisation of sensors for seamless integration with multi-fingered robotic hands. Ultimately, our goal is to establish a standardised, scalable approach for VBTS manufacturing to support the rapid development and deployment of tactile sensing technologies across various domains in robotics.