Search Results (19)

Atmospheric turbulence introduces distortions to the wavefront of propagating optical radiation. It causes image resolution degradation in astronomical telescopes and significantly reduces the power density of radiation on the target in focusing applications. The impact of turbulence fluctuations on the wavefront can be investigated under laboratory conditions using either a fan heater (roughly tuned), a phase plate, or a deformable mirror (finely tuned) as a turbulence-generation device and a wavefront sensor as a wavefront-distortion measurement device. We designed and developed a software simulator and an experimental setup for the reconstruction of atmospheric turbulence-phase fluctuations as well as an adaptive optical system for the compensation of induced aberrations. Both systems use two 60 mm, 92-channel, bimorph deformable mirrors and two tip-tilt correctors. The wavefront is measured using a high-speed Shack–Hartmann wavefront sensor based on an industrial CMOS camera. The system was able to achieve a 500 Hz correction frame rate, and the amplitude of aberrations decreased from 2.6 μm to 0.3 μm during the correction procedure. The use of the tip-tilt corrector allowed a decrease in the focal spot centroid jitter range of 2–3 times from ±26.5 μm and ±24 μm up to ±11.5 μm and ±5.5 μm. Full article

Autonomous outdoor moving objects like cars, motorcycles, bicycles, and pedestrians present different risks to the safety of Visually Impaired People (VIPs). Consequently, many camera-based VIP mobility assistive solutions have resulted. However, they fail to guarantee VIP safety in practice, i.e., they cannot effectively prevent collisions with more dangerous threats moving at higher speeds, namely, Critical Moving Objects (CMOs). This paper presents the first practical camera-based VIP mobility assistant scheme, ARAware, that effectively identifies CMOs in real-time to give the VIP more time to avoid danger through simultaneously addressing CMO identification, CMO risk level evaluation and classification, and prioritised CMO warning notification. Experimental results based on our real-world prototype demonstrate that ARAware accurately identifies CMOs (with 97.26% mAR and 88.20% mAP) in real-time (with a 32 fps processing speed for 30 fps incoming video). It precisely classifies CMOs according to their risk levels (with 100% mAR and 91.69% mAP), and warns in a timely manner about high-risk CMOs while effectively reducing false alarms by postponing the warning of low-risk CMOs. Compared to the closest state-of-the-art approach, DEEP-SEE, ARAware achieves significantly higher CMO identification accuracy (by 42.62% in mAR and 10.88% in mAP), with a 93% faster end-to-end processing speed. Full article

This study proposes a Nipkow-based pinhole disk laser scanning confocal microscopic imaging system for ordinary optical microscopy, fluorescence microscopy, and confocal microscopy imaging of biological samples in order to realize the dynamic experimental monitoring of space-based life science experiments and the fine observation of biological samples. Confocal microscopic imaging is mainly completed by a scanning module that is composed of a spinning disk and other components. The parameters of the spinning disk directly determine the quality of the image. During the design process, the resolution and signal-to-noise ratios caused by different pinhole diameters in the spinning disk are the main considerations. Changes and image blurring caused by crosstalk due to the pinhole arrangement and different pinhole spacings are addressed. The high photon efficiency of the new EMCCD (electron-multiplying charge-coupled device) and CMOS (complementary metal-oxide-semiconductor) camera reduces the exposure time as much as possible, reduces damage to living cells, and achieves high-speed confocal imaging. It is shown in a confocal imaging experiment with a variable magnification of 1–40× that the imaging resolution of the system can reach a maximum of 2592 × 1944, the spatial resolution can reach 1 μm, and the highest sampling frequency is 10 fps, thus meeting the design requirements for high-speed live-cell imaging. Full article

Spherical reticulated shell structure is an important structural form of large-span space buildings. It is of great significance to monitor three-dimensional (3D) dynamic responses of spherical reticulated shell structure to better understand its seismic performances, which will be helpful in the future to ensure the healthy condition of large-span space buildings during their lifespan. In this study, with the advantages of non-contact and high accuracy, a high-speed videogrammetric measurement method is proposed for monitoring the 3D dynamic responses of the seismically isolated, spherical, reticulated shell structural model. Two issues—the high-speed videogrammetric acquisition system and network configuration, as well as image sequence target tracking and positioning—are emphasized to achieve a cache of high-speed images and to improve the accuracy of tracking and positioning target points. The experimental results on the shaking table from the proposed method have been compared with those from traditional Optotrak Certus and accelerometers. The results prove that the proposed method is capable and useful for analyzing the seismic performance of spherical reticulated shell structures, as the dynamic responses monitoring accuracy of the method can reach the submillimeter level, with root mean square error values of 0.32 mm, 0.7 mm and 0.06 mm in the X, Y and Z directions, respectively. Full article

Photoplethysmography (PPG) is a noninvasive optical technology with applications including vital sign extraction and patient monitoring. However, its current use is primarily limited to heart rate and oxygenation monitoring. This study aims to demonstrate the utility of PPG for physiological investigations. In particular, we sought to demonstrate the utility of simultaneous data acquisition from several regions of tissue using remote/contactless PPG (rPPG). Specifically, using a high-speed scientific-grade camera, we collected rPPG from the hands (palmar/dorsal) of 22 healthy volunteers. Data collected through the red and green channels of the RGB CMOS sensor were analyzed. We found a statistically significant difference in the amplitude of the glabrous skin signal over the non-glabrous skin signal (1.41 ± 0.85 in the red channel and 2.27 ± 0.88 in the green channel). In addition, we found a statistically significant lead of the red channel over the green channel, which is consistent between glabrous (17.13 ± 10.69 ms) and non-glabrous (19.31 ± 12.66 ms) skin. We also found a statistically significant lead time (32.69 ± 55.26 ms in the red channel and 40.56 ± 26.97 ms in the green channel) of the glabrous PPG signal over the non-glabrous, which cannot be explained by bilateral variability. These results demonstrate the utility of rPPG imaging as a tool for fundamental physiological studies and can be used to inform the development of PPG-based devices. Full article

With the wide application of autonomous mobile robots (AMRs), the visual inertial odometer (VIO) system that realizes the positioning function through the integration of a camera and inertial measurement unit (IMU) has developed rapidly, but it is still limited by the high complexity of the algorithm, the long development cycle of the dedicated accelerator, and the low power supply capacity of AMRs. This work designs a reconfigurable accelerated core that supports different VIO algorithms and has high area and energy efficiency, precision, and speed processing characteristics. Experimental results show that the loss of accuracy of the proposed accelerator is negligible on the most authoritative dataset. The on-chip memory usage of 70 KB is at least 10× smaller than the state-of-the-art works. Thus, the FPGA implementation’s hardware-resource consumption, power dissipation, and synthesis in the 28 nm CMOS outperform the previous works with the same platform. Full article

This study examines the relationship between rubber-wheel and the contact area on the road surface. Ultraviolet-induced fluorescence microscopy was used to observe and measure the contact parts with pyranine as a dye solution. The high sensitivity to U.V. light makes it easy to distinguish contact and non-contact regions on a very small scale. The experiment was conducted in static and dynamic conditions to identify its influence on the apparent contact area of rubber-wheel and road surface. The in-situ observation of the contact area was captured and recorded using a high-speed digital camera with 1-inch a CMOS (complementary metal oxide semiconductor) sensor. Additionally, the contact area between rubber-wheel and road surface was measured using an analyzing software. The results show differences in static and dynamic contact conditions based on the operating parameters. Full article

The Pencil Beam Scanning (PBS) technique in proton therapy uses fast magnets to scan the tumor volume rapidly. Changing the proton energy allows changing to layers in the third dimension, hence scanning the same volume several times. The PBS approach permits adapting the speed and/or current to modulate the delivered dose. We built a simple prototype that measures the dose distribution in a single step. The active detection material consists of a single layer of scintillating fibers (i.e., 1D) with an active length of 100 mm, a width of 18.25 mm, and an insignificant space (20 $\mathsf{\mu }$m) between them. A commercial CMOS-based camera detects the scintillation light. Short exposure times allow running the camera at high frame rates, thus, monitoring the beam motion. A simple image processing method extracts the dose information from each fiber of the array. The prototype would allow scaling the concept to multiple layers read out by the same camera, such that the costs do not scale with the dimensions of the fiber array. Presented here are the characteristics of the prototype, studied under two modalities: spatial resolution, linearity, and energy dependence, characterized at the Center for Proton Therapy (Paul Scherrer Institute); the dose rate response, measured at an electron accelerator (Swiss Federal Institute of Metrology). Full article

The oil boom in the North Dakota oilfields has resulted in improved energy security for the US. Recent estimates of oil production rates indicate that even completion of the Keystone XL pipeline will only fractionally reduce the need to ship this oil by rail. Current levels of oil shipment have already caused significant strain on rail infrastructure and led to crude oil train derailments, resulting in loss of life and property. Treating crude oil as a multicomponent liquid fuel, this work aims to understand crude oil droplet burning and thereby lead to methods to improve train fire safety. Sub-millimeter sized droplets of Pennsylvania, Texas, Colorado, and Bakken crude were burned, and the process was recorded with charge-couple device (CCD) and complementary metal-oxide semiconductor (CMOS) high-speed cameras. The resulting images were post-processed to obtain various combustion parameters, such as burning rate, ignition delay, total combustion time, and microexplosion behavior. The soot left behind was analyzed using a Scanning Electron Microscope (SEM). This data is expected be used for validation of combustion models for complex multicomponent liquid fuels, and subsequently in the modification of combustion properties of crude oil using various additives to make it safer to transport. Full article

Laminated rubber bearings are widely used for the mitigation of seismic damage of large-scale structures and equipment. However, owing to the flexibility in horizontal direction, the traditional contacted transducer is difficult to acquire the displacement data accurately in the three directions, respectively. In this paper, three-dimensional displacement measurement of laminated rubber bearing based on the large-scale shaking table is achieved by the use of a tri-camera high-speed videogrammetric system consisting of three complementary-metal-oxide-semiconductor (CMOS) cameras, one synchronous controller, and one pair of 1000 watt light sources, which are used to simultaneously acquire the tri-camera image sequences of laminated rubber bearing at a speed of 300 frames per second (fps). Firstly, this paper proposes a fast image block technique for detecting and tracking targets in tri-camera image sequences by integration of techniques morphological edge detection, attribute based ellipse extraction and least-squares-based fitting adjustment. Secondly, this paper presents an integrated bundle adjustment approach, which brings continuous tracking points into one collinearity condition equation, to reconstruct the three dimensional coordinates of continuous tracking points, for the purpose of improving the accuracy of three-dimensional coordinates of tracking points based on tri-camera image sequences. At last, an empirical experiment was conducted to measure the three-dimensional displacement of laminated rubber bearings on the shaking table by the use of the proposed method. The experimental results showed that the proposed method could obtain three-dimensional displacement of laminated rubber bearings with an accuracy of more than 0.5 mm. Full article

Following a patent owned by Tobii, the framerate of a CMOS camera can be increased by reducing the size of the recording window so that it fits the eyes with minimum room to spare. The position of the recording window can be dynamically adjusted within the camera sensor area to follow the eyes as the participant moves the head. Since only a portion of the camera sensor data is communicated to the computer and processed, much higher framerates can be achieved with the same CPU and camera. Eye trackers can be expected to present data at a high speed, with good accuracy and precision, small latency and with minimal loss of data while allowing participants to behave as normally as possible. In this study, the effect of headbox adjustments in real-time is investigated with respect to the above-mentioned parameters. It was found that, for the specific camera model and tracking algorithm, one or two headbox adjustments per second, as would normally be the case during recording of human participants, could be tolerated in favour of a higher framerate. The effect of adjustment of the recording window can be reduced by using a larger recording window at the cost of the framerate. Full article

With recent advancements, micro-object contactless conveyers are becoming an essential part of the biomedical sector. They help avoid any infection and damage that can occur due to external contact. In this context, a smart micro-conveyor is devised. It is a Field Programmable Gate Array (FPGA)-based system that employs a smart surface for conveyance along with an OmniVision complementary metal-oxide-semiconductor (CMOS) HD camera for micro-object position detection and tracking. A specific FPGA-based hardware design and VHSIC (Very High Speed Integrated Circuit) Hardware Description Language (VHDL) implementation are realized. It is done without employing any Nios processor or System on a Programmable Chip (SOPC) builder based Central Processing Unit (CPU) core. It keeps the system efficient in terms of resource utilization and power consumption. The micro-object positioning status is captured with an embedded FPGA-based camera driver and it is communicated to the Image Processing, Decision Making and Command (IPDC) module. The IPDC is programmed in C++ and can run on a Personal Computer (PC) or on any appropriate embedded system. The IPDC decisions are sent back to the FPGA, which pilots the smart surface accordingly. In this way, an automated closed-loop system is employed to convey the micro-object towards a desired location. The devised system architecture and implementation principle is described. Its functionality is also verified. Results have confirmed the proper functionality of the developed system, along with its outperformance compared to other solutions. Full article

Vision-based sensing algorithms are computationally-demanding tasks due to the large amount of data acquired and processed. Visual sensors deliver much information, even if data are redundant, and do not give any additional information. A Selective Change Driven (SCD) sensing system is based on a sensor that delivers, ordered by the magnitude of its change, only those pixels that have changed most since the last read-out. This allows the information stream to be adjusted to the computation capabilities. Following this strategy, a new SCD processing architecture for high-speed motion analysis, based on processing pixels instead of full frames, has been developed and implemented into a Field Programmable Gate-Array (FPGA). The programmable device controls the data stream, delivering a new object distance calculation for every new pixel. The acquisition, processing and delivery of a new object distance takes just 1.7 $\mathsf{\mu }$ s. Obtaining a similar result using a conventional frame-based camera would require a device working at roughly 500 Kfps, which is far from being practical or even feasible. This system, built with the recently-developed 64 × 64 CMOS SCD sensor, shows the potential of the SCD approach when combined with a hardware processing system. Full article

Microfluidics has been used to perform various chemical operations for pL–nL volumes of samples, such as mixing, reaction and separation, by exploiting diffusion, viscous forces, and surface tension, which are dominant in spaces with dimensions on the micrometer scale. To further develop this field, we previously developed a novel microfluidic device, termed a microdroplet collider, which exploits spatially and temporally localized kinetic energy. This device accelerates a microdroplet in the gas phase along a microchannel until it collides with a target. We demonstrated 6000-fold faster mixing compared to mixing by diffusion; however, the droplet acceleration was not optimized, because the experiments were conducted for only one droplet size and at pressures in the 10–100 kPa range. In this study, we investigated the acceleration of a microdroplet using a high-pressure (MPa) control system, in order to achieve higher acceleration and kinetic energy. The motion of the nL droplet was observed using a high-speed complementary metal oxide semiconductor (CMOS) camera. A maximum droplet velocity of ~5 m/s was achieved at a pressure of 1–2 MPa. Despite the higher fluid resistance, longer droplets yielded higher acceleration and kinetic energy, because droplet splitting was a determining factor in the acceleration and using a longer droplet helped prevent it. The results provide design guidelines for achieving higher kinetic energies in the microdroplet collider for various microfluidic applications. Full article

High-speed photography is an important tool for studying rapid physical phenomena. However, low-frame-rate CCD (charge coupled device) or CMOS (complementary metal oxide semiconductor) camera cannot effectively capture the rapid phenomena with high-speed and high-resolution. In this paper, we incorporate the hardware restrictions of existing image sensors, design the sampling functions, and implement a hardware prototype with a digital micromirror device (DMD) camera in which spatial and temporal information can be flexibly modulated. Combined with the optical model of DMD camera, we theoretically analyze the per-pixel coded exposure and propose a three-element median quicksort method to increase the temporal resolution of the imaging system. Theoretically, this approach can rapidly increase the temporal resolution several, or even hundreds, of times without increasing bandwidth requirements of the camera. We demonstrate the effectiveness of our method via extensive examples and achieve 100 fps (frames per second) gain in temporal resolution by using a 25 fps camera. Full article