Next Article in Journal / Special Issue
An Efficient Polymer Inclusion Membrane-Based Device for Cd Monitoring in Seawater
Previous Article in Journal / Special Issue
Electrospun Silver Coated Polyacrylonitrile Membranes for Water Filtration Applications
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Current and Emerging Techniques for High-Pressure Membrane Integrity Testing

1
Institute for Sustainable Industries and Liveable Cities, Victoria University, Werribee 3030, Australia
2
Stantec, Washington, DC 20005-3957, USA
*
Author to whom correspondence should be addressed.
Membranes 2018, 8(3), 60; https://doi.org/10.3390/membranes8030060
Submission received: 21 June 2018 / Revised: 3 August 2018 / Accepted: 6 August 2018 / Published: 9 August 2018

Abstract

:
Ideally, pressure driven membrane processes used in wastewater treatment such as reverse osmosis and nanofiltration should provide a complete physical barrier to the passage of pathogens such as enteric viruses. In reality, manufacturing imperfections combined with membrane ageing and damage can result in breaches as small as 20 to 30 nm in diameter, sufficient to allow enteric viruses to contaminate the treated water and compromise public health. In addition to continuous monitoring, frequent demonstration of the integrity of membranes is required to provide assurance that the barrier to the passage of such contaminants is intact. Existing membrane integrity monitoring systems, however, are limited and health regulators typically credit high-pressure membrane systems with only 2 log10 virus rejection, well below their capability. A reliable real-time method that can recognize the true rejection potential of membrane systems greater than 4 log10 has not yet been established. This review provides a critical evaluation of the current methods of integrity monitoring and identifies novel approaches that have the potential to provide accurate, representative virus removal efficiency estimates.

1. Introduction

High-pressure nanofiltration (NF) and reverse osmosis (RO) membranes are widely used for water reclamation and desalination [1,2,3]. The mechanism of water transport in these high-pressure membrane systems is based on solute transport by diffusion through the nonporous active membrane layer [4,5]. These membranes are, therefore, capable of rejecting particles, bacteria and pathogens, and dissolved ions including salts as illustrated in Figure 1. In reality, however, NF and RO membranes are not complete barriers to these contaminants [6] and over time the integrity of membrane systems may be compromised due to a range of breaches that can develop in the system. Membrane breaches can occur as a result of: damage to the membrane layer as a result of chemical or biological degradation and particulate abrasion; delamination of the skin layer from the supporting layer; telescoping; and failures of O-rings, gaskets, connectors and other fittings [7,8,9,10,11,12,13]. In addition to these ‘in service’ failure modes, manufacturing defects such as incomplete glue-lines can affect the integrity of membrane elements and depending on the quality control processes employed, these are usually detected before membranes are shipped to customers.
In order to ensure the quality and safety of water treated by NF or RO membranes, the integrity of the entire system must remain intact over the service life of the elements. Moreover, system operators must be able to provide evidence of the integrity to satisfy regulatory requirements on a regular basis [14]. Several integrity monitoring techniques have been developed for these systems and they are broadly classified into direct and indirect techniques [6,15]. In general, direct methods assess the integrity of membrane elements by the application of a pressure-based test whereas indirect methods use a surrogate parameter measured in the permeate for assessing the integrity of the whole membrane system [6,16,17]. Direct tests are usually performed offline on individual elements but indirect tests can be performed on membranes during service and have a wider scope for online continuous monitoring. Challenge tests are a type of indirect technique where a surrogate species is introduced into the feed water and the removal efficiency is determined by the measurements of the surrogate species in the permeate [16,17].
Several reviews of high-pressure membrane integrity monitoring techniques have been published with a focus on existing, widely accepted methods [15,18,19,20]. These methods are primarily focused on common spiral-wound NF or RO membranes, although there are examples of integrity monitoring of hollow-fiber NF membranes [21]. In order to fully realize the rejection capabilities of high-pressure systems, new, robust techniques that can be implemented in real-time and online are required. This paper presents a review of existing integrity tests and focuses on emerging techniques that have the potential to demonstrate the rejection capabilities of spiral-wound high-pressure membrane systems online. This is followed by a discussion of current methods and potential methods that show promise for future development.

1.1. Log Reduction Value

For membrane processes, the rejection or removal efficiency of a given parameter or surrogate is reported as a log reduction value (LRV) that is calculated according to the following formula:
LRV = log10 (Cf/Cp)
where Cf is the feed concentration of the chemical or surrogate species and Cp is the concentration detected in the permeate [22].
Although LRVs are widely reported, their determination is limited by the feed concentration and the detection limits of the chemical or surrogate in the permeate. Nevertheless, the aim of a challenge test is to report a removal efficiency based on the feed concentration of the surrogate, so it is also important to be consistent with dosing of surrogates for a given system to enable direct comparisons of LRVs over time. The principle of LRV applies to any integrity monitoring technique that has the capacity to enumerate the feed and permeate concentrations of the surrogate and is adopted as the industry standard for the verification of membrane integrity.

1.2. The Target—Poliovirus

Conventional treatment incorporating membrane filtration plus disinfection practices have been successful in preventing the spread of waterborne pathogens to the public. However, monitoring for all bacterial, viral and protozoan species would be extremely expensive and a drain on operational resources. For this reason, a surrogate species in the RO feedwater should be identified and monitored [23]. Larger bacterial and protozoan pathogens are typically eliminated by unit operations employed upstream of high-pressure membranes and via size exclusion but not necessarily for viruses that are considerably smaller. The performance of advanced water treatment operations that incorporate high-pressure membranes is, therefore, critical to effective virus control.
Monitoring for viruses is challenging and requires specialist skills and apparatus that must be undertaken offline in a laboratory with results available sometime after the samples were taken, usually several days. This does not equate to timely monitoring of membrane integrity, particularly in the event that a membrane or system fails the integrity test. Consequently, the challenge is to select a non-microbial surrogate can mimic the target virus in terms of size and shape. Viruses are classified into families and then genera, based on many criteria, including physical and biological properties. Picornaviridae are the smallest family of RNA viruses [24], with picornaviruses divided into four groups [25]: poliovirus (3 types), coxsackievirus (30 types), echovirus (34 types) and enteroviruses (68 to 71 types).
An important characteristic of enteroviruses is their resistance to high and low pH and relative stability over a pH range of 3–5 for up to 3 h [25]. Alcohol at 70 vol %, 1% quaternary ammonium compounds and other common laboratory disinfectants are not effective against enteroviruses which are reported to be insensitive to detergents that otherwise destroy lipid containing viruses [25]. In theory, high-pressure RO and some NF membranes should exclude virus size particles providing they are intact. The poliovirus is one of the smallest of the RNA viruses with a shell (capsid) between 25 and 30 nm in diameter [24,25] and is therefore difficult to remove by size exclusion membrane processes. The ability to demonstrate that high-pressure membrane systems can reject such virus size particles is therefore crucial and challenge testing with similarly sized non-microbial surrogates is one possibility providing that the surrogate can be detected at very low concentrations to meet the target of at least 99.99% (4 log10) removal in accordance with the US EPA Long Term 2 Enhanced Surface Water Treatment Rule [26].

1.3. The “Ideal” Integrity Test

In order to evaluate individual integrity monitoring systems, it is important to define the characteristics of an “ideal” system. In general, an ideal system is one that can accurately measure the ability of a system to reject pathogens in a reasonable time so that the risk of these pathogens entering the product water is minimized or eliminated. The cost of performing the integrity test should also be considered as these costs may be passed on to consumers. Table 1 presents a summary of some suggested key criteria that any potential monitoring system should be measured against.

2. Direct Integrity Monitoring

Direct monitoring techniques are used to measure the integrity of single membrane elements or very small RO systems. These tests are primarily pressure-based techniques that are used to detect defects such as pinholes in membrane sheets and glue-line failures. Vacuum decay and pressure decay tests are the most common direct monitoring techniques applied to NF and RO membranes [7,26,27,28] and the capital costs for instrumentation to measure these decay tests is relatively low. However, these techniques are not able to detect holes of the size that can permit the passage of virus sized particles except at very high-pressures that could potentially result in damage to membrane elements. Moreover, these tests must be performed when the membrane filtration system is offline.

2.1. Vacuum Decay Testing

In a vacuum decay test (VDT), the permeate tube of a membrane element is sealed and a vacuum is applied to the tube. A schematic representation of VDT equipment is shown in Figure 2. The basic procedure in accordance with ASTM D3923 [27] and ASTM D6908 [28] involves soaking the membrane element for a period of time in RO permeate water (usually overnight), draining the membrane module for a defined period of time (usually an hour) and sealing one end of the permeate tube using a leak tight cap. As shown in the schematic, Figure 2, the system can be integrated with a digital manometer and computer to record the VDT data and generate the decay curve.
The rate of decay of the applied vacuum pressure is monitored over a set period of time. For RO elements, a decay rate of >10 kPa min−1 represents a significant membrane defect and this test is typically performed on elements by the manufacturer prior to sale [6,27,29]. This method can be applied to a single element or a complete pressure vessel containing several elements for small scale RO systems [30]. Figure 3 shows typical VDT results from two different commercially available RO membranes with one intact and one compromised. The vacuum pressure of the intact membrane shows only a slight decline whereas the compromised element shows a rapid decline indicative of a gross defect.
The VDT method is generally only applicable for the detection of mechanically damaged membrane elements or damaged O-rings and will not detect chemical impairments that create much smaller inconsistencies in the membrane. Therefore, this method is only useful as a screening procedure to detect significant defects in RO systems. However, some reports suggest that VDT results correlate well with virus and total organic carbon (TOC) rejection by RO membranes and it is therefore a potentially useful integrity screening procedure for RO membrane elements [6]. Since the test is applied directly to membrane elements, the VDT cannot be performed when filtration is taking place [16] and thus does not enable real-time membrane integrity monitoring in the strictest sense but could allow frequent monitoring to identify slow degradation of system integrity.

2.2. Pressure Decay Testing

In a pressure decay test (PDT), the feed and concentrate ends of a membrane element are sealed and compressed air is introduced. In this case, the permeate side remains open and the pressure decay is measured over time. This test is particularly useful for measuring the integrity of low pressure hollow fiber MF and UF membranes [26,28,31] and although the PDT is not common for NF and RO membranes, there are examples of patented methods for PDT of spiral wound modules on wet or dry elements [32]. In an example of a PDT trial on an entire stage of RO vessels for a small scale RO application [33], the membranes were drained, the permeate side was pressurized to 600 kPa (87 psi) and the pressure decay was monitored over a 10-min period. The study concluded that this method was sensitive in detecting breaches but was not practical for full-scale systems because the entire element array must be drained prior to the test. Other examples have demonstrated the use of automated PDT on RO systems for direct potable reuse applications [13,34]. In practice, the main aim of the PDT for RO in most cases is to determine an LRV for relatively large protozoa and this only requires low pressures. Moreover, this technique, that has similarities to the VDT, has the potential to induce mechanical failures such as telescoping in spiral wound elements. Telescoping can occur during a PDT as a result of the charging and discharging of compressed air from an RO element [13] although this can be prevented by the use of anti-telescoping devices [35].

3. Indirect Integrity Monitoring

Indirect monitoring techniques measure the rejection of chemical surrogate species that are naturally present in the feed water in order to report the permeate quality. Some indirect monitoring techniques can be performed online but often the species being measured are smaller than virus-sized particles such as salt and organic carbon. In these cases, the compounds may not be as effectively rejected by RO membranes and measurement systems are therefore only capable of validating to low LRVs. Other indirect monitoring techniques include challenge tests where a surrogate species (chemical, nanoparticle, bacteriophage, etc.) is introduced into the feed water at a known concentration in order to evaluate the amount of the surrogate that can pass into the permeate. In any case, indirect monitoring based on the rejection of a chemical species results in a more conservative measurement of the system LRV and is based on the ability of the membrane to exclude the chemical rather than virus-sized particles.

3.1. Naturally Occurring Substances

3.1.1. Particle and Turbidity Monitoring

A typical particle monitoring device measures changes in light transmittance through a fixed volume of permeate as a result of particles blocking the light source. The minimum particle size these monitors can detect is ca. 500 nm, which is considerably larger than any particle that could breach an NF or RO system. As such, particle monitors are generally used in MF and UF systems rather than NF and RO systems. In addition, air bubbles can interfere with the signal output causing erroneous results.
Online particle monitoring for RO is generally not recommended due to the high removal of particles by MF/UF prior to RO treatment [6]. However, not all RO treatment processes utilize MF/UF pre-treatments so in general, the resolution for these particle monitoring systems is dependent on the type of pretreatment. In addition, particles large enough to be detected in particle counters may be present in RO permeates in events such as O-ring or permeate interconnector damage that are considered as gross integrity failures.
The principle of turbidity monitoring is similar to that of particle monitoring whereby the passage of light through a sample is measured and related to the concentration of suspended particles. Typical nephelometric sensors also suffer from similar disadvantages including low sensitivity and interference. Laser turbidimetry, however, can reportedly measure much lower turbidity values [36,37] but this is limited to particles larger than ca. 1000 nm in diameter that is on the order of thirty-fold larger than the smallest pathogens of concern at between 25 and 30 nm.

3.1.2. Total Organic Carbon

Total organic carbon monitoring involves the oxidation of carbon and the detection of carbon dioxide generated during the process. Pre-treatment for NF/RO membranes should exclude all organic particulates and therefore the TOC is equivalent to the dissolved organic carbon content. The measurement of TOC is reported to be more sensitive than conductivity testing and particle counting [6] and although the measurement of TOC is perhaps the closest to instantaneous integrity monitoring, typical TOC measuring devices are prone to drift. Moreover, TOC is not representative of virus-sized particles as it is a measure of water soluble compounds that are generally much smaller. Additionally, their chemical structure can be more flexible than viruses and this combined with their smaller size, may allow passage through membranes. As a consequence, TOC monitoring will generally provide a more conservative LRV because the soluble compounds can be transported across the membrane into the permeate where virus-sized particles would otherwise be rejected. A major limitation of this test and most other indirect techniques is related to the sensitivity of the instrumentation. Given that the sensitivity of TOC is limited due to the relatively low RO/NF feed concentrations (around 10–20 mg/L) and the lower resolution of the instruments (around 0.15 mg/L), TOC monitoring can only provide a rejection of around 99.75% (2.6 log10). A high sensitivity instrument is ideal to measure the low TOC found in the permeate, however, it is unlikely that the same instrument could reliably measure the higher levels of TOC in the feed, thus necessitating the need for two complex and expensive instruments. This would limit the use of this technique to large treatment plants producing large volumes of treated water for direct or indirect potable use applications. Additionally, changes in organic and inorganic carbon dioxide compositions within the feed, as well as changes in temperature and fouling conditions may result in higher or lower than anticipated organic carbon rejections resulting in inaccurate integrity results. Nevertheless, full-scale online TOC monitoring has been implemented at the NEWater plant in Singapore to monitor the integrity of an RO system installed for indirect potable reuse applications with a Sievers 820 online TOC instrument with a detection limit of 0.15 mg/L installed at this facility [38].

3.1.3. Sulphate Monitoring

The monitoring of naturally occurring sulphate levels can potentially be implemented online and can reportedly provide high resolution, provided the feed concentration is consistent and sufficiently high [39]. Measurement is typically performed by ion chromatography and a resolution of 3 log10 removal has been reported with a feed sulphate concentration of 140 mg/L and a detected permeate sulphate concentration of 0.1 mg/L [29]. The measurement of sulphate can be achieved ex-situ and reported quickly but this test does not provide real-time information on the integrity of the membrane system and can become difficult where multiple trains operate in parallel.
As a soluble chemical species, sulphate is much smaller than the smallest pathogens such as viruses, so this technique offers only a conservative evaluation of membrane integrity. Moreover, the mechanism of transport of sulphate through a membrane would be expected to differ significantly than that of a solid virus particle. In addition, biological species entrained in biofoulants on the membrane surface can utilize the oxygen under anoxic conditions so the measured sulphate concentration in the feed can be reduced thereby altering the LRV. Scale forming compounds such as BaSO4 and CaSO4 can also alter the measured permeate sulphate concentration as well as adversely affect membrane performance and prematurely trigger the need for a clean-in-place procedure to restore performance. These issues represent a significant limitation to the efficacy of this technique.

3.1.4. Electrical Conductivity

Electrical conductivity (EC) is generally used as an indicator of membrane integrity, however, the sensitivity of such measurements can be grossly distorted through an array. Temperature, feed concentration, pressure, position along an array and fouling all have an effect on permeate EC and slight fluctuations in permeate EC can mask compromised membranes. Conductivity testing can be implemented online or via intermittent probing with the latter providing higher sensitivity than the online technique [6]. This is useful when the feed water contains a relatively high concentration of salt that is efficiently rejected by RO [18]. Typically, damage to components of RO systems such as an O-ring can cause a spike in permeate conductivity that can indicate a leak.
Due to its ease of implementation, conductivity monitoring is a common method for detection of integrity breach at full-scale for NF and RO systems. However, the resolution of this method is low and will provide only up to 2 log10 removal when feed EC is around 20,000 µS/cm and permeate EC is 200 µS/cm. Electrical conductivity readings are subject to fluctuations as a result of temperature, ionic species in the feed as well as membrane fouling. Ionic speciation can have a significant impact on electrical conductivity with predominantly monovalent species having a higher TDS to EC ratio whereas a greater proportion of divalent ions in the feed will reduce the TDS to EC ratio. This can be significant in industrial applications that have a high degree of variation in discharged wastewater characteristics and have the potential to inadvertently introduce bias in the LRV result in specific circumstances.

3.1.5. Periodic Testing

Periodic monitoring methods include conductivity profiling, conductivity probing and UV-254 probing. Conductivity profiling involves sampling permeate from each pressure vessel and analyzing the conductivity, allowing this method to detect a breach in a particular pressure vessel. Conductivity probing is widely used to determine the location of a leak within a pressure vessel and is usually combined with conductivity profiling [40,41]. Probing for UV absorbance at the 254 nm wavelength has also been reported [33] but this method is limited because it can only achieve low resolution which depends on the concentration of UV active species present in the RO feed water. Similar to EC monitoring, a spike in the measurement of the monitored species will clearly indicate a breach in membrane integrity [2].

3.2. Challenge Testing

3.2.1. Dyes and Tracer Chemicals

Chemical tracers have been used widely to study flow patterns in a range of water and soil systems [42,43]. These include the use of fluorescent dyes such as fluorescein [17,43,44,45] and rhodamine WT (RWT) [42,43,45,46] and synthetic food dyes such as Brilliant Blue FCF [47,48]. The fluorescent dyes are particularly useful as water tracers, due to their high sensitivity of detection and selectivity when contained in systems with other fluorescent compounds. Detection limits for these compounds are in the region of 100 ng/L levels so only small amounts are needed in the feed [45]. Rhodamine WT is a non-toxic fluorescent chemical that was specifically developed as a water tracing dye [49,50]. As such, it is reported to be stable under a range of saline conditions [46,51] and has shown potential for use in RO integrity monitoring [8] with a minimum detection limit of approximately 10 ng/L [44]. Instrumentation for measuring fluorescent tracers, including online commercial probes for measuring RWT, are readily available [52,53].
Integrity monitoring using RWT has been widely reported for RO systems in order to assess virus removal or to determine LRVs [8,9,14,18,26,28,54,55,56,57,58]. In addition to its high sensitivity, RWT was also reported to be stable under a range of environmental conditions and not to be readily adsorbed onto membrane surfaces. However, the fluorescence can be affected by the presence of chlorinated oxidizing agents, UV light and temperature. Under full-scale and pilot testing using RWT, LRVs of >4 log10 have been achieved for several RO membranes [54,57,58]. As a soluble chemical, however, the correlation between RWT and solid particles such as viruses and other pathogens is limited, with RWT providing a conservative estimate of pathogen LRV. Table 2 presents a summary of several RWT field or laboratory tests and LRVs obtained. In most cases, high LRVs can be achieved with low concentrations of RWT in the feed.

3.2.2. Spiked Integrity Monitoring

A relatively new technique, the spiked integrity monitoring (SIM) test can be performed intermittently and online by dosing or injecting a challenge species into the feed [29,59]. In these examples, powdered activated carbon (PAC) was used as the challenge species and was detected using particle counters with relatively high LRVs achieved depending on the dose of the PAC added to the feed. Although this technique is applicable to MF/UF membranes, it could be applied to NF and RO systems providing the PAC is sufficiently small and monitoring systems are available to detect small particles. However, the potential for sub-micron PAC particles to agglomerate with biofoulants can result in artificially high LRVs, premature fouling, and increased biological activity on the surface of the PAC particles.

3.2.3. Pulse Integrity Testing

The pulse integrity test (PIT) is similar in principal to the SIM and involves the addition of a short pulse of a highly rejected chemical species such as sulphate salts (i.e., MgSO4 or Na2SO4) [60,61]. The sulphate is monitored in the permeate over time then compared to known profiles representing intact and compromised membranes. Defects such as holes and glue-line faults present distinct sulphate profiles which can also be attributed to different locations in a membrane module. Although this protocol appears promising, it does not provide continuous security against membrane breaches, however, it does present a potentially useful tool to characterize the failure mode and location of a breach in a membrane array.
This technique also has the potential to be used online and in real-time providing the test is calibrated for each system although this would be complicated, time consuming and expensive for large installations. There is also a potential to develop this technique further using other tracer species such as RWT or even particulate surrogates that could increase the detection limits and also enable a concurrent LRV determination. However, as previously discussed, the limitations of using sulphate as a surrogate include contributing to biological fouling and chemical scaling. Both of these conditions would reduce the sulphate available to migrate across a membrane and would artificially improve the apparent LRV. Unlike a challenge test, the membrane is only subjected to the pulse for a very short period minimizing the contact and potential absorption on the membrane surface.

3.2.4. Microbial Surrogates

Microbial surrogates include the MS2 bacteriophage that is widely adopted as a substitute for pathogenic viruses [14] and is the recommended microbial surrogate for enteric viruses [26]. It is often used in membrane integrity testing due to its similar size (22–29 nm [62]), shape and composition to some common enteric viruses [63,64,65,66]. Standard methods or protocols for performing challenge tests using MS2 seeding have been developed and the results of pilot and full-scale tests are widely reported [9,14,18,26,63,67,68,69,70,71,72]. In one example, an LRV > 5 was reported for the removal of MS2 by intact RO membranes [63]. Although widely implemented, this technique has some limitations for application in full-scale plants including high costs, sample preparation and preservation and the potential for false positive results [17]. The use of this testing protocol to determine the integrity of an operational high-pressure membrane system is limited by this risk and implementing this testing procedure online is not feasible. In addition, enumerating the MS2 bacteriophage must be performed by a specialist laboratory and this time-consuming assessment does not provide for a real-time integrity evaluation of the operating membrane plant.

3.2.5. Non-Microbial Nanoparticle Surrogates

The use of non-microbial surrogates removes some of the risk involved in performing challenge tests with high concentrations of live bacteriophage. Other than fluorescent dyes, non-microbial surrogates include fluorescent latex micro- and nano-spheres [8,54,58,63,70,73,74], gold nanoparticles [74] and magnetic nanoparticles [75,76] and other readily detectable particles [77]. These particles offer the potential for real-time and online monitoring which is one of the key criteria for the ideal NF/RO integrity test.
Most nanoparticle challenge tests do not consider the effects of solubility, surface chemistry, agglomeration and other factors that may influence rejection. For example, some nanoparticles have been reported to aggregate and foul the surface of membranes [78] and this can improve the rejection of similar sized particles resulting in higher LRVs than clean membranes, thereby providing an overestimation of system integrity. Other disadvantages include the costs associated with the production of fluorescent nanoparticles on a large scale. Although fluorescence detection instruments are widely available and relatively inexpensive, fluorescent nanoparticles can be very expensive to synthesize and large quantities would be required for full-scale operations. Fluorescence can also be quenched in the presence of salt, organic species, oxidants and several other chemicals and under certain environmental conditions. In addition, depending on how the fluorescent markers are attached to the latex particles, they can leach from the surface into the surrounding carrier solution. This can lead to detection of the dye marker in the permeate which would otherwise reject the intact particle, thus biasing the LRV determination. The fate and toxicity of synthetic or engineered nanomaterials is relatively unknown with the exception of common inorganic nanoparticles such as TiO2 [79].
Magnetic nanoparticles are an example of a particle that can potentially be recovered and reused in the case of UF integrity testing using 35 nm Fe3O4 particles [76]. Although this report suggested the technique was suitable for large-scale plants, the instrumentation to detect these particles would add considerable cost to existing and new plants. Magnetic resonance relaxometers used to detect magnetic nanoparticles are commercially available as bench-top instruments, however, the relaxometer and magnetic resonance scanner are impractical due to their high cost that results principally from the large magnets employed and the lack of miniaturized electronic components [80]. Other metal-based surrogates include silver nanoparticles which have shown some promise for integrity monitoring with particles of 62 ± 10 nm used to challenge used RO membrane elements [81]. In these tests, the feed concentration was > 8 mg/L and the maximum LRV obtained was 2.57 log10 although higher LRVs for UF and MF membranes have been reported for similar particles [19]. In addition, the detection technique used was inductively coupled plasma-optical emission spectrometry which restricts this method to offline analysis in a laboratory environment.

4. Integrated and Multi-Parameter Monitoring Systems

A range of other techniques for monitoring the condition of high-pressure membrane systems have been reported. Some of these techniques offer the potential for real-time monitoring while others are more qualitative and require integration with other instruments. Online hybrid systems can offer multiple detectors in a single unit that can increase the sensitivity of these units and reduce the need for separate instrumentation.

4.1. TRASAR® Testing

The TRASAR® system is based on the use of a fluorescent chemical with antiscalant compounds in order to monitor and control antiscalant dosing in RO systems and to prevent overdosing [82]. Monitoring the fluorescent marker that is part of the antiscalant chemical can be used as a potential integrity monitoring system. Fluorescence is measured in the permeate with LRVs up to 6 log10 when the chemical is added in a spiked dose and 2 log10 when added with antiscalant [18,72]. In principal, the system is similar to that of the dye test except that in the case of the TRASAR® system, the fluorescent compound is a larger molecule than typical fluorescent dyes with a molecular weight ca. 610 Daltons. It would be expected that the sensitivity of TRASAR® antiscalant would be lower than a dye such as RWT, so much higher concentrations would be needed to achieve an LRV of 6 log10. Similar to other fluorescent dyes, the use of the TRASAR® fluorescent chemical compound could potentially detect integrity breaches from chemicals of concern such as endocrine disruptors that are smaller than virus particles, thereby extending the capabilities of the integrity test beyond microbial pathogens to chemical surrogates.

4.2. Small Sensor Cell Membrane Testing

In a small sensor cell membrane test, a micro-sieve sensor membrane is placed in the permeate side of the crossflow stream of a high-pressure system. A change in the TMP of the sensor membrane is detected as an integrity breach but it can take more than one hour to detect even a very small breach. In addition, the system is sensitive to the permeate flux, so to overcome this a second sensor membrane can be added [83]. This technique has shown promise at both the bench- and pilot-scale but a limitation of using this technique is the long delay before an integrity breach is detected.

4.3. Binary Gas Integrity Testing

The binary gas integrity test (BGIT) measures the diffusion of a select pair of gases injected into the feed of a low-pressure membrane system. For a membrane with an integrity breach, the low permeating gas is detected in the permeate using mass flowmeters and the composition determined using infrared spectroscopy [84]. This technique is reported to be highly sensitive and has been well correlated to virus removal [85]. However, the sensitivity can be limited by the minimum detectable excess flow and a range of intrinsic membrane factors can influence the measured gas diffusion rate. In this case, normalization to a baseline measurement would be necessary to compare membrane performance over time. In addition, the need for multiple gases and detectors limits the applicability and practicality of this technique. There may be some potential to apply this technique to high-pressure membranes at the small scale but the complexity associated with larger systems would generally preclude its adoption.

4.4. ZAPS LiquID Station

The zero angle photo-spectrometry (ZAPS) LiquID Station offers real-time water quality monitoring based on an entirely optical system utilizing three simultaneous techniques to measure a wide range of water quality parameters [86,87]. It uses absorption, fluorescence and reflectance measurement techniques with a single sensor, which eliminates the differential drift of multi-sensor devices. In addition, it uses no reagents and is self-cleaning and self-calibrating. It is typically used to monitor source water, drinking water treatment and distribution systems, wastewater treatment and re-use and industrial water systems [88,89,90]. The parameters it measures include TOC, UV254 transmission, specific UV absorbance, nitrate + nitrite, turbidity, biochemical oxygen demand (BOD) and chemical oxygen demand (COD). The detection ranges of the TOC and BOD alone can enable LRVs of ca. 5.7 and 6.5 log10 respectively.
In addition to the monitoring of standard indicator compounds present in the water sample, the system is capable of indirect detection of E. coli. Since enteric pathogens cannot occur without the presence of enteric bacteria, testing for these bacteria can be used to monitor pathogen risk. The ZAPS system detects tryptophan that is a highly fluorescent amino acid that bacteria and other living microorganisms utilize to manufacture proteins. The E. coli bacterium maintain high concentrations of tryptophan as part of their cellular structure so this chemical can, therefore, be used as a biomarker to detect their presence. However, tryptophan is a common amino acid in many proteins and is not unique to E. coli so this may limit its sensitivity for detecting this species.

5. Emerging Techniques

5.1. Pathogen Detection Systems

The ability to detect and quantify potentially hazardous pathogens in food and water is increasingly important to prevent and minimize the proliferation of infectious diseases [91]. The development of biosensors has grown rapidly over the past few decades with a range of devices available commercially and as prototypes [92,93,94]. Some of these show promise for the future development of membrane integrity monitoring techniques where the removal of viruses and other pathogens is critical.

5.1.1. BioSentry Device

The BioSentry device is a commercially available instrument that can detect chemical and biological contamination in water and report detected problems continuously in real-time with online capabilities. The device measures unique bio-optical signals of particles and compares them to those in its library to identify microbial contaminants such as E. coli, Giardia and Cryptosporidium [95]. In addition to microbial species, the device is reported to detect chemical contamination in drinking water so it has the potential to be adapted to monitor membrane integrity. The system uses multiple sensors to measure a range of quality indicators and also uses a multi-angle light scattering detector at 660 nm to determine the size, shape and internal structure of detected particles. However, the current configurations of the system limit size analysis to particles greater than 400 nm [96] and that is an order of magnitude larger than the required resolution needed to detect viruses with an average size between 25 and 30 nm.

5.1.2. Real-Time Polymerase Chain Reaction Monitoring

The real-time polymerase chain reaction (RT-PCR) technique is based on the detection of part of the viral genome [62]. Although the technique is relatively fast, it requires specialized sampling, testing and analysis and is therefore an expensive test that at present must be performed offline in a laboratory environment. In addition, the technique cannot differentiate between infectious and non-infectious viruses and this can complicate the results [97].

5.1.3. Evanescent Wave Fiber Optic Sensors

Evanescent wave fiber optic sensors (EWFOS) use a laser spectrofluorometer to detect a laser derived evanescent wave that is excited over a sample [98,99,100,101]. These sensors can be highly customized to detect a range of pathogens and can be integrated into existing systems enabling the potential for online testing using flow-through systems. Although these EWFOS systems are currently susceptible to interference due to complex background matrices, it is expected that future EWFOS could be increasingly sensitive measuring concentrations as low as 1 CFU/mL [101]. However, this may not be sensitive enough to measure low permeate concentrations to provide a high LRV.

5.1.4. Surface Generated Acoustic Wave Biosensors

In a surface generated acoustic wave (SGAW) biosensor, metal electrodes mechanically generate acoustic waves through a substrate such as a liquid medium [102]. Biochemical interactions with target pathogens result in changes in the acoustic wave that are detected and then analyzed with output signals related to the type and concentration of pathogen in the medium. The SGAW biosensors offer rapid, real-time, label-free analyses that are claimed to be cost effective and easy to use although they are not currently available commercially and some can require long incubation times of the bacterial sample on the biosensor surface [103]. At present, reports on these systems are limited, so they do not address potential issues such as diffusion and detection of pathogens in large volumes of water.

5.1.5. RAPTOR Fiber Optic Biosensors

The RAPTOR fiber optic biosensor is a type of EWFOS that monitors complex formation by evanescently exciting surface-bound tracer antibody fluorophores with a diode laser [98,104]. The assay is achieved in less than 10 min in a fully automated, portable unit with few moving parts and long-lasting probes. This system has been successfully demonstrated in food safety applications [105] and for the detection of pathogens in irrigation and recreational waters [106,107]. A major limitation of the system is the need for replacement of the fiber probes and fluorescent reagents as soon as a positive result is obtained, although up to four antibody probes can be used to detect multiple pathogens [104].

5.1.6. Block II Chemical Biological Mass Spectrometer

The block II chemical biological mass spectrometer (CBMS) is an integrated system that can identify chemical and biological contaminants in a single unit [108]. The US military developed the CBMS, that is similar to the RAPTOR biosensor system, primarily for the detection of threats and as such, the instrument is portable and robust. The CBMS system can only use a single detection mode at any time but the instrument has the ability to rapidly switch between detectors. This detection system has potential as a membrane integrity device but it is not currently commercially available.

5.1.7. Miniaturized Portable Biosensors

This technique uses a miniaturized gold electrode biosensor to detect pathogens by immobilization of antibodies onto the bio-functionalized electrode. An electrochemical technique based on impedance spectroscopy, the test can take several hours to complete and is currently only being developed for clinical purposes [109]. At present the device has been developed to detect different strains of the avian influenza virus but it has the potential for further development to detect other similar viruses. However, the data acquisition time and the technical capacity to operate and maintain the instrumentation limits its application in the field for membrane integrity surveillance.

5.1.8. Microarray Biosensors

A microarray biosensor uses an automated concentration system to detect pathogens in water using a range of detectors including fluorescence [110] and other optical techniques [111]. Systems can be configured for online integration and although offering rapid analyses, these tests generate minor quantities of waste products [112]. Moreover, the detection limits of typical bacteria are relatively high on the order to 105 CFU/mL for E. coli, so it is unlikely that high LRVs could be achieved with these sensors.

5.1.9. Surface Plasmon Resonance Biosensors

Surface plasmon resonance (SPR) biosensors offer qualitative and quantitative label-free detection and analysis of biomacromolecules including proteins and nucleic acids in real-time [113,114,115,116]. There are a wide range of configurations for various applications but the general principal of SPR biosensors is based on the change in refractive index of a metallic surface irradiated with a light source. Light is reflected at an angle defined by the type and amount of target bacteria in the solution that are bound to the metallic surface which is then measured and quantified. Although most configurations are capable of detecting large molecules, some sandwich assays and competitive inhibition assays can detect much smaller molecules including engineered nanoparticles [117,118] and the presence of gold nanoparticles can also enhance SPR signals [113]. Utilizing this technique in the field for membrane system integrity surveillance may be challenging due to environmental exposure of the sensitive instrumentation.

5.1.10. Quantum Dot Based DNA Nanosensors

These ultrasensitive nanosensors use quantum dots (QDs) linked to DNA probes to capture and concentrate DNA from specific targets. The detection is based on fluorescence resonance energy transfer (FRET) to detect DNA at low concentrations which is capable of generating a distinct, highly detectable FRET signal [119]. Single QD-based sensors have also been developed to detect multiple virus strains in a single assay [120]. Although typically used for clinical tests, there is a potential for other applications such as direct integrity monitoring for pathogen transport through membrane systems. The system requires specialized personnel to operate the bench-scale systems and it is a relatively expensive technique that currently limits the potential application in membrane integrity surveillance. Similar to other engineered nanoparticles, solubility, surface chemistry and the potential for agglomeration are also potential issues for QDs.

5.1.11. Laser Scanning Cytometry

Online laser scanning cytometry (LSC) can be used to detect and enumerate microspheres in feed and permeate samples [121]. The LSC technique is based on fluorescence using a fixed laser light source but on a fixed membrane sample rather than in a flowing solution such as a permeate sample. At present the technique is only applicable to micron sized particles using a bench-scale prototype instrument, although there is a strong potential to develop more sensitive, portable instruments providing the costs can also be reduced.

5.1.12. Microfluidic Biochip Systems

Microfluidic systems for detecting pathogens cover a range of miniaturized devices utilizing techniques to measure DNA, protein and pathogen cells in integrated biochip devices [122]. Microfluidic biochips can utilize the detection systems of a range of techniques including RT-PCR for DNA analysis, protein/enzyme sensing and cell-based assays to identify and quantify different cellular systems. In general, these systems offer high surface to volume ratios in microchannels which increases the probability of pathogen interaction and cell capture at the sensor surfaces allowing rapid identification of small amounts of pathogens [104]. A wide range of commercial examples of these systems are available that can target different pathogens such as viruses and bacteria [122]. Rapid developments in technologies such as these could ultimately lead to developing these systems for membrane integrity monitoring [104], however, there have been no recent developments to further the prospects for this technique for membrane integrity surveillance.

5.2. Other Detection Systems

Developments in nanotechnologies over the past few decades have required new techniques for the detection of synthetic nanosized particles in a range of media [123,124,125]. Most viruses and many bacteria fall within the nanometer size range so techniques used to detect nanoparticles in water are readily applicable to NF and RO integrity monitoring, particularly where high sensitivity at low concentrations are available. The ability to detect single virus particles in a solution is perhaps the ultimate challenge for a membrane integrity test and there are several recent attempts to achieve this goal.

5.2.1. NanoSight Particle Tracking

The NanoSight nanoparticle tracking analysis (NTA) system was first commercialized in 2004 and covers a range of biological and biochemical applications [125]. Not unlike conventional zetasizer instruments, the NTA system can measure the particle size and zeta potential of nanoparticle suspensions. In addition to these analyses, the NTA system can measure fluorescence and the concentration of particles in solution in the size range 10–2000 nm diameter [126]. Particle counting relies on the diffusion of particles and subsequent micrograph imaging and counting which is sensitive to camera settings [127]. A report of the application of NTA technologies details a wide selection of examples of the versatile system in use, including uses in virology and vaccines, nanoparticle systems and drug delivery [125]. The potential for scaling the system to a robust, portable, online instrument is not clear and this may limit its use to offline assays at present.

5.2.2. Online Chemical Oxygen Demand

AquaDiagnostic Pty Ltd., Melbourne, Australia, produces an online system to measure the COD of water samples [128]. Results can be obtained in less than 5 min using a robust, portable instrument that can perform a direct measurement of absolute COD that avoids the need for calibration. The minimum detection limit is reported to be 0.2 mg/L with a working COD range up to 350 mg/L but some consumables and reagents are required. Table 3 shows results of a test performed using the COD analyzer on the first and second pass RO permeates from a water recycling plant in Victoria, Australia. The COD results clearly show the sensitivity of the technique to measure low levels of organics and the test was also able to demonstrate a significant difference between the first- and second-pass RO membranes. Although the COD of the RO feed was not measured, the RO feed had a TDS of 3160 mg/L so the 2nd pass permeate had an apparent LRV of 3.1.
The challenge for the online COD technique is to differentiate between chemical compounds and biological material that both exert a chemical oxygen demand. The data provided by the COD instrumentation is similar to that provided by the more expensive TOC instrument and has similar limitations based on the vagaries of feed concentration and the interferences and inhibitions arising from heavy metal contamination and chloride ion concentrations.

5.2.3. Whispering Gallery Microlasers

Whispering gallery mode (WGM) microlasers are a type of evanescent wave sensor that detects discrete changes in the WGM resonance frequency excited in a microspherical cavity. The resonance shift is detected in response to the presence of a bound single virus particle such as the influenza virus [129]. The WGM concept is based on the observation that sound waves could travel around a concave surface first discovered in the late 1800’s in the whispering gallery of St Paul’s Cathedral [130]. The relatively recent development of WGM microresonator systems based on this acoustic phenomenon offer label-free detection of single viral pathogens but is currently only available in bench-scale systems [131,132,133]. In addition, only very small volumes can be measured so this may limit its applications to low throughput applications.

5.2.4. Fluorescence Emission Excitation Spectroscopy

Typical fluorescence emission excitation matrix (EEM) spectroscopy scans present emission fluorescence signals as a function of incremental changes in excitation wavelengths [134]. The result is a three dimensional, or contour, plot which highlights areas of high fluorescence intensity [135]. In water and wastewater samples, these areas are related to dissolved organic matter (DOM) with specific regions attributed to distinct components including proteins and organic acids. Fluorescence EEMs are widely used to monitor water quality [136,137,138,139,140], to track effluent flows [141,142], and to monitor recycled water schemes [140,143,144,145]. In most cases, qualitative data is obtained but in some cases, semi-quantitative data can be obtained and changes in organic species can be monitored [146]. Figure 4 shows examples of EEMs from the RO feed and first stage RO permeate from a water recycling plant in Victoria, Australia. The RO feed clearly shows regions of fluorescent organics (Figure 4a) that are not present in the first stage RO permeate (Figure 4b).
Some reports have claimed the use of fluorescence EEMs to characterize RO permeates from multiple pass systems [147]. In this report, qualitative and quantitative analyses of EEMs could distinguish between the different stages with a general trend towards lower organic fluorescence across the stages. Recently, a direct evaluation of the use of fluorescence EEMs for RO integrity monitoring compared the technique to conductivity testing [39]. The results outlined a procedure for analyzing the EEMs and the results suggest that the fluorescence technique is more sensitive than conductivity testing with DOM rejections of >99.9% obtained or better than 3 log10 removal.
Quantifying the capacity to reject DOM can be used to infer the integrity of a membrane system and will generally understate the case as low molecular weight DOM can pass through a high-pressure membrane where virus-sized particles will be rejected leading to a more conservative LRV for the system being tested. The ability to identify the log removal potential of a membrane system using EEM is suitable where DOM is the principle measure, however, where nanoparticles such as viruses are the primary concern, then this technique provides an inferred, qualitative surveillance capacity.

5.2.5. Quantum Dots

Many types of QDs are reported to be highly detectable with strong fluorescence at low concentrations [148,149,150,151,152,153]. Typical QDs are formed using cadmium or zinc with the latter preferred due to its lower toxicity to humans and the environment [154]. Due to their high sensitivity and their ease of synthesis, QDs could potentially be used for challenge tests providing the size of the particles could be extended beyond the relatively small sub-10 nm range to virus-sized particles on the order of 20 nm [155].
More recently, a new class of QD has emerged based on carbon. Nano-diamonds or carbon QDs are reported to be biocompatible, highly fluorescent, easy to synthesize and can be formed in a range of sizes [156,157,158,159,160,161,162]. These materials are now finding applications in the medical field as tracers and biomarkers [163,164] and due to their apparent compatibility with biological systems, they may offer a new type of safe, highly sensitive membrane integrity challenge test. The use of nano-diamonds to detect the presence of brain tumors in humans has been reported by researchers at Sydney University [165] where targeted drug delivery methods to destroy tumor growths are being developed. Although the technique is still primarily focused on human therapies, it has potential to monitor membrane integrity as the nano-diamonds are reported to be relatively inexpensive to synthesize. However, this report was on the basis of medical applications which may be comparatively expensive for the water industry where large quantities of surrogates are required for challenge tests.

6. Assessing the Current and Emerging Techniques

Table 4 presents a summary of current and emerging techniques for NF/RO membrane integrity monitoring. The advantages and limitations are presented with a brief description of the test and the general application of the test to membrane systems. It is evident from this review that there are numerous techniques that are already available to be fully explored as options for online integrity monitoring and others that could be further developed. However, the limitations reported and the complexity of some of the techniques reduces the opportunities considerably. The membrane integrity techniques shaded in grey are deemed to adequately meet most or all the objectives of an ideal integrity test described earlier. Dye and TRASAR® testing rely on the detection of optically active chemicals that can potentially be detected at ng/L levels, particularly the fluorescent dyes including RWT, fluorescein and TRASAR®. Instrumentation for the detection of these dyes is readily available and the capacity for implementation at full-scale and in real-time is high and at relatively low cost. Similarly, and perhaps closer to the ideal surrogate, fluorescent nanospheres are another promising and viable option, although the costs of synthesizing the required quantities of these particles for full-scale testing may be prohibitive. Moreover, the fate of synthetic nanomaterials in the reject water is relatively unknown.

7. Conclusions

The techniques identified in this review are widely varied based on their sensitivity and the capacity to perform the tests in real-time and at a reasonable cost. Of all the methods, those based on challenge testing are among those that would be more acceptable to industry based on the availability of the surrogate species and the ease at which the tests can be implemented. Fluorescent chemical compounds and tagged nanoparticles are becoming more widely accepted as alternatives to the MS2 bacteriophage as they show the required sensitivity to provide an LRV performance up to and potentially beyond 4 log10. A range of new and innovative techniques based on the detection of individual pathogens or the use of sensitive detection equipment also show some promise for the future development of novel integrity monitoring techniques.

Author Contributions

M.J.C. and E.R.O. performed the review and wrote the paper; J.J. and S.R.G. identified additional techniques and provided critical comments for refinement of ideas.

Funding

This research was funded by Water Research Australia project number 2018 and Water Environment & Reuse Foundation project number WRRF-12-07.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bartels, C.R.; Wilf, M.; Andes, K.; Iong, J. Design considerations for wastewater treatment by reverse osmosis. Water Sci. Technol. 2005, 51, 473–482. [Google Scholar] [CrossRef] [PubMed]
  2. DeCarolis, J.; Adham, S.; Kumar, M.; Pearce, B.; Wasserman, L. Integrity and Performance Evaluation of New Generation Desalting Membranes During Municipal Wastewater Reclamation. In Proceedings of the Water Environment Federation (WEFTEC 2005), Washington, DC, USA, 29 October–2 November 2005; pp. 3518–3529. [Google Scholar]
  3. Greenlee, L.F.; Lawler, D.F.; Freeman, B.D.; Marrot, B.; Moulin, P. Reverse osmosis desalination: Water sources, technology, and today’s challenges. Water Res. 2009, 43, 2317–2348. [Google Scholar] [CrossRef] [PubMed]
  4. Ridgway, H.F.; Gale, J.D.; Hughes, Z.E.; Stewart, M.B.; Orbell, J.D.; Gray, S.R. Molecular scale modeling of membrane water treatment processes. In Functional Nanostructured Materials and Membranes for Water Treatment; Duke, M., Zhao, D., Semiat, R., Eds.; Wiley-VCH Verlag GmbH & Co. KGaA: Weinheim, Germany, 2013; Volume 10, pp. 249–299. [Google Scholar]
  5. Paul, D.R. Reformulation of the solution-diffusion theory of reverse osmosis. J. Membr. Sci. 2004, 241, 371–386. [Google Scholar] [CrossRef]
  6. Adham, S.; Gagliardo, P.; Smith, D.; Ross, D.; Gramith, K.; Trussell, R. Monitoring the integrity of reverse osmosis membranes. Desalination 1998, 119, 143–150. [Google Scholar] [CrossRef]
  7. Crozes, G.F.; Sethi, S.; Mi, B.; Curl, J.; Mariñas, B. Improving membrane integrity monitoring indirect methods to reduce plant downtime and increase microbial removal credit. Desalination 2002, 149, 493–497. [Google Scholar] [CrossRef]
  8. Kitis, M.; Lozier, J.C.; Kim, J.H.; Mi, B.; Marinas, B.J. Microbial removal and integrity monitoring of RO and NF membranes. J. Am. Water Works Assoc. 2003, 95, 105–119. [Google Scholar] [CrossRef]
  9. Lozier, J.; Kitis, M.; Colvin, C.; Kim, J.-H.; Mi, B.; Marinas, B. Microbial Removal and Integrity Monitoring of High-Pressure Membranes; IWA Publishing: London, UK, 2003; p. 220. [Google Scholar]
  10. Surawanvijit, S.; Thompson, J.; Rahardianto, A.; Frenkel, V.; Cohen, Y. Pulsed marker method for real-time detection of reverse osmosis membrane integrity loss. Desalination 2015, 370, 25–32. [Google Scholar] [CrossRef]
  11. Huang, X.; Min, J.H.; Lu, W.; Jaktar, K.; Yu, C.; Jiang, S.C. Evaluation of methods for reverse osmosis membrane integrity monitoring for wastewater reuse. J. Water Proc. Eng. 2015, 7, 161–168. [Google Scholar] [CrossRef]
  12. Min, J.H.; Yu, C.; Jiang, S. New Techniques for Real-Time Monitoring of Membrane Integrity for Virus Removal Using Submicron Particle Characterization Methods. Water Reuse Foundation Report WRF-09-06a-1. 2013, p. 92. Available online: https://watereuse.org/watereuse-research/09-06a-new-techniques-for-real-time-monitoring-of-membrane-integrity-for-virus-removal-using-submicron-particle-characterization-methods/ (accessed on 7 August 2018).
  13. Zhang, J.; Cran, M.; Northcott, K.; Packer, M.; Duke, M.; Milne, N.; Scales, P.; Knight, A.; Gray, S.R. Assessment of pressure decay test for RO protozoa removal validation in remote operations. Desalination 2016, 386, 19–24. [Google Scholar] [CrossRef]
  14. Victorian Government Department of Health. Guidelines for validating treatment processes for pathogen reduction. In Supporting Class A Recycled Water Schemes in Victoria; Department of Health, Australia: Canberra, Australia, 2013; p. 96. [Google Scholar]
  15. Kumar, M.; Adham, S.; DeCarolis, J. Reverse osmosis integrity monitoring. Desalination 2007, 214, 138–149. [Google Scholar] [CrossRef]
  16. Casani, S.; Hansen, T.B.; Christensen, J.; Knøchel, S. Comparison of methods for assessing reverse osmosis membrane treatment of shrimp process water. J. Food Prot. 2005, 68, 801–807. [Google Scholar] [CrossRef] [PubMed]
  17. Gitis, V.; Adin, A.; Nasser, A.; Gun, J.; Lev, O. Fluorescent dye labeled bacteriophages—A new tracer for the investigation of viral transport in porous media: 1. Introduction and characterization. Water Res. 2002, 36, 4227–4234. [Google Scholar] [CrossRef]
  18. DeCarolis, J.; Adham, S.; Kumar, M.; Hirani, Z. Reverse Osmosis Membrane Integrity; MWH Global Inc.: Denver, CO, USA, 2006; p. 117. [Google Scholar]
  19. Antony, A.; Blackbeard, J.; Leslie, G. Removal efficiency and integrity monitoring techniques for virus removal by membrane processes. Crit. Rev. Environ. Sci. Technol. 2012, 42, 891–933. [Google Scholar] [CrossRef]
  20. Pype, M.-L.; Lawrence, M.G.; Keller, J.; Gernjak, W. Reverse osmosis integrity monitoring in water reuse: The challenge to verify virus removal—A review. Water Res. 2016, 98, 384–395. [Google Scholar] [CrossRef] [PubMed]
  21. Lidén, A.; Lavonen, E.; Persson, K.M.; Larson, M. Integrity breaches in a hollow fiber nanofilter—Effects on natural organic matter and virus-like particle removal. Water Res. 2016, 105, 231–240. [Google Scholar] [CrossRef] [PubMed]
  22. Bennett, A. Drinking water: Pathogen removal from water—Technologies and techniques. Filtr. Separ. 2008, 45, 14–16. [Google Scholar] [CrossRef]
  23. Hill, D. Basic Microbiology for Drinking Water Personnel; American Water Works Association: Denver, CO, USA, 2006. [Google Scholar]
  24. Adu, F.D. The virology of the polio virus. Ann. Ibadan Postgrad. Med. 2005, 3, 13–19. [Google Scholar] [CrossRef]
  25. American Water Works Association. Manual of Water Supply Practices (M48): Waterborne Pathogens; AWWA: Denver, CO, USA, 1999. [Google Scholar]
  26. U.S. Environmental Protection Agency. Membrane Filtration Guidance Manual; EPA 815-R-06-009; U.S. Environmental Protection Agency: Washington, DC, USA, 2005; p. 332.
  27. ASTM D 3923-08. Standard Practices for Detecting Leaks in Reverse Osmosis and Nanofiltration Devices. 2014. Available online: http://www.astm.org/Standards/D3923.htm (accessed on 7 August 2018).
  28. ASTM D 6908-06. Standard Practice for Integrity Testing of Membrane Filtration Systems. 2017. Available online: http://www.astm.org/Standards/D6908.htm (accessed on 7 August 2018).
  29. Kruithof, J.C.; Kamp, P.C.; Folmer, H.C.; Nederlof, M.M.; van Hoof, S.C.J.M. Development of a membrane integrity monitoring strategy for the UF/RO Heemskerk drinking water treatment plant. Water Sci. Technol. Water Suppl. 2001, 1, 261–271. [Google Scholar] [CrossRef]
  30. Eriksson, P.; Mueller, P. Vacuum Decay test of membrane systems with spiral wound elements. In Proceedings of the AWWA Membrane Technology Conference, Atlanta, GA, USA, 2–5 March 2003. [Google Scholar]
  31. Pearce, B.; DeCarolis, J.; Wetterau, G. Evaluation of performance monitoring methods for advanced water purification processes: City of San Diego. In Proceedings of the 16th Annual Wate Reuse & Desalination Research Conference, San Diego, CA, USA, 4–5 June 2012. [Google Scholar]
  32. Jons, S.D. Method of Testing the Integrity of Spiral Wound Modules. U.S. Patent 2011/0091094A1, 2011. Available online: https://patents.google.com/patent/US20110091094A1 (accessed on 7 August 2018).
  33. Wilbert, M.C.; Linton, K. Methods for Monitoring the Integrity of Reverse Osmosis and Nanofiltration Membrane Systems; US Department of Interior: Denver, CO, USA, 2000; p. 239.
  34. Zhang, J.; Knight, A.; Duke, M.; Northcott, K.; Packer, M.; Scales, P.J.; Gray, S.R. A new integrated potable reuse process for a small remote community in Antarctica. Proc. Saf. Environ. Protect. 2016, 104, 196–208. [Google Scholar] [CrossRef]
  35. Johnson, J.; Busch, M. Engineering aspects of reverse osmosis module design. Desal. Water Treat. 2010, 15, 236–248. [Google Scholar] [CrossRef]
  36. Banerjee, A.; Lambertson, M.; Lozier, J.; Colvin, C. Monitoring membrane integrity using high sensitivity laser turbidimetry. Water Sci. Technol. Water Suppl. 2001, 1, 273–276. [Google Scholar] [CrossRef]
  37. Naismith, J. Membrane integrity—Direct turbidity measurement of filtrate from mf membrane modules at an operating potable water treatment plant. Desalination 2005, 179, 25–30. [Google Scholar] [CrossRef]
  38. Seah, H. Newater: Regulatory Framework in Singapore. In Proceedings of the International Conference on Water Reuse for Drinking Purposes, Umhlanga, KwaZulu-Natal, South Africa, 9–11 October 2012. [Google Scholar]
  39. Pype, M.-L.; Patureau, D.; Wery, N.; Poussade, Y.; Gernjak, W. Monitoring reverse osmosis performance: Conductivity versus fluorescence excitation–emission matrix (EEM). J. Membr. Sci. 2013, 428, 205–211. [Google Scholar] [CrossRef]
  40. Hydranautics. Procedure for Pressure Vessel Probing, Technical Service Bulletin TSB114.03. Available online: http://www.membranes.com/docs/tsb/tsb114.pdf (accessed on 19 November 2012).
  41. Montgomery Watson. Water Re-Purification Project: Final Report on Membrane Prequalification Pilot Study; MWH Global Inc.: Denver, CO, USA, 1997; p. 121. [Google Scholar]
  42. Binet, S.; Jomard, H.; Lebourg, T.; Guglielmi, Y.; Tric, E.; Bertrand, C.; Mudry, J. Experimental analysis of groundwater flow through a landslide slip surface using natural and artificial water chemical tracers. Hydrol. Process. 2007, 21, 3463–3472. [Google Scholar] [CrossRef] [Green Version]
  43. Harden, H.S.; Chanton, J.P.; Rose, J.B.; John, D.E.; Hooks, M.E. Comparison of sulfur hexafluoride, fluorescein and rhodamine dyes and the bacteriophage prd-1 in tracing subsurface flow. J. Hydrol. 2003, 277, 100–115. [Google Scholar] [CrossRef]
  44. Ford, D.E.; Thornton, K.W. Lissamine ff fluorescent dye. J. Environ. Eng. 1983, 109, 952–955. [Google Scholar] [CrossRef]
  45. Chua, L.H.C.; Robertson, A.P.; Yee, W.K.; Shuy, E.B.; Lo, E.Y.M.; Lim, T.T.; Tan, S.K. Use of fluorescein as a ground water tracer in brackish water aquifers. Ground Water 2007, 45, 85–88. [Google Scholar] [CrossRef] [PubMed]
  46. Stanbro, W.D.; Pyrch, D.A. Stability of rhodamine WT in saline waters. Water Resour. Res. 1979, 15, 1631–1632. [Google Scholar] [CrossRef]
  47. Flury, M.; Fluehler, H. Tracer characteristics of Brilliant Blue FCF. Soil Sci. Soc. Am. J. 1995, 59, 22–27. [Google Scholar] [CrossRef]
  48. Reinken, G.; Kale, S.P.; Fuehr, F. Distribution pattern of organic carbon in soils and its role in preferential movement of brilliant blue in a structured silty soil. Sci. Soils. 1996. Available online: http://hintze-online.com/sos/1996/Articles/Art2/art2.html (accessed on 9 August 2018).
  49. Smart, P.L.; Laidlaw, I.M.S. An evaluation of some fluorescent dyes for water tracing. Water Resour. Res. 1977, 13, 15–33. [Google Scholar] [CrossRef]
  50. Sutton, D.J.; Kabala, Z.J.; Francisco, A.; Vasudevan, D. Limitations and potential of commercially available rhodamine WT as a groundwater tracer. Water Resour. Res. 2001, 37, 1641–1656. [Google Scholar] [CrossRef] [Green Version]
  51. Magal, E.; Weisbrod, N.; Yakirevich, A.; Yechieli, Y. The use of fluorescent dyes as tracers in highly saline groundwater. J. Hydrol. 2008, 358, 124–133. [Google Scholar] [CrossRef]
  52. YSI Environmental. Water Tracing, in Situ Dye Fluorometry and the YSI 6130 Rhodamine WT Sensor. Available online: http://www.ysi.com (accessed on 3 February 2012).
  53. Aqualab Scientific. Rhodamine WT. Available online: http://www.aqualab.com.au/products/rhodamine-wt.html (accessed on 12 January 2010).
  54. Kitis, M.; Lozier, J.C.; Kim, J.H.; Mi, B.; Marinas, B.J. Evaluation of biologic and non-biologic methods for assessing virus removal by and integrity of high pressure membrane systems. Water Sci. Technol. Water Suppl. 2003, 3, 81–92. [Google Scholar] [CrossRef]
  55. Australian Water Recycling Centre of Excellence. Roadmap for a National Validation Framework; Water Quality Research Australia Limited: Adelaide, Australia, 2011; Available online: http://www.australianwaterrecycling.com.au/coe/images/stories/publications/NatVal_Road_Map_Report_2011.pdf (accessed on 19 July 2012).
  56. Lozier, J.C.; Zornes, G.L.; Jansen, E. Validation testing of a full-scale RO system for pathogen removal. In Proceedings of the IDA World Congress, Perth, WA, USA, 4–9 September 2011. [Google Scholar]
  57. Lozier, J.C.; Edwards, B.; Scholes, E. Use and suitability of dye-based pathogen integrity testing of RO systems within advanced water recycling schemes. In Proceedings of the AWA Water Recycling Conference, Brisbane, Australia, 1–4 July 2013; p. 10. [Google Scholar]
  58. Ostarcevic, E.; Cran, M.; Gray, S. Screening fluorescent chemicals and nanoparticles as potential surrogates for real-time reverse osmosis integrity monitoring. In Proceedings of the AWA Water Recycling Conference, Brisbane, Australia, 1–4 July 2013; p. 8. [Google Scholar]
  59. Van Hoof, S.C.J.M.; Broens, L.; Nahrstedt, A.; Panglisch, S.; Gimbel, R. Development of a new integrity testing system. Water Sci. Technol. Water Suppl. 2003, 3, 101–108. [Google Scholar] [CrossRef]
  60. Jons, S.D.; Haynes, T.N.; Nathan, J.S. Sensitive integrity test for RO/NF elements. In Proceedings of the International Water Conference, Orlando, FL, USA, 9–13 October 2005. [Google Scholar]
  61. Jons, S.D.; Johnson, J.E.; Fialkowski, M.A. Method for Testing Separation Modules. U.S. Patent US 7,698,928 B2, 2010. Available online: https://patents.google.com/patent/US7698928B2 (accessed on 8 August 2018).
  62. Langlet, J.; Gaboriaud, F.; Gantzer, C. Effects of ph on plaque forming unit counts and aggregation of ms2 bacteriophage. J. Appl. Microbiol. 2007, 103, 1632–1638. [Google Scholar] [CrossRef] [PubMed]
  63. Mi, B.; Eaton, C.L.; Kim, J.-H.; Colvin, C.K.; Lozier, J.C.; Marinas, B.J. Removal of biological and non-biological viral surrogates by spiral-wound reverse osmosis membrane elements with intact and compromised integrity. Water Res. 2004, 38, 3821–3832. [Google Scholar] [CrossRef] [PubMed]
  64. Jacangelo, J.G.; Laine, J.M.; Carns, K.E.; Cummings, E.W.; Mallevialle, J. Low-pressure membrane filtration for removing giardia and microbial indicators. J. Am. Water Works Assoc. 1991, 83, 97–106. [Google Scholar] [CrossRef]
  65. Wu, B.; Wang, R.; Fane, A.G. The roles of bacteriophages in membrane-based water and wastewater treatment processes: A review. Water Res. 2017, 110, 120–132. [Google Scholar] [CrossRef] [PubMed]
  66. Pype, M.-L.; Donose, B.C.; Marti, L.; Patureau, D.; Wery, N.; Gernjak, W. Virus removal and integrity in aged RO membranes. Water Res. 2016, 90, 167–175. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  67. Jacangelo, J.G.; Brown, N.L.P.; Madec, A.; Schwab, K.; Huffman, D.; Amy, G.; Mysore, C.; Leparc, J.; Prescott, A. Micro- and Ultrafiltration Performance Specifications Based on Microbial Removal; IWA Publishing: London, UK, 2006; p. 10. [Google Scholar]
  68. Adham, S.S.; Trussell, R.S.; Gagliardo, P.F.; Trussell, R.R. Rejection of ms-2 virus by RO membranes. J. Am. Water Works Assoc. 1998, 90, 130–135. [Google Scholar] [CrossRef]
  69. Colvin, C.K.; Acker, C.L.; Marinas, B.J.; Lozier, J.C. Microbial removal by NF/RO. In Proceedings of the American Water Works Association Annual Conference, Denver, CO, USA, 11–15 June 2000; pp. 1275–1293. [Google Scholar]
  70. Acker, C.L.; Colvin, C.K.; Marinas, B.J.; Lozier, J.C. Assessing the integrity of reverse osmosis spiral-wound membrane elements with biological and non-biological surrogate indicators. In Membrane Practices for Water Treatment; Duranceau, S.J., Ed.; American Water Works Association: Denver, CO, USA, 2001; Volume 10, pp. 464–484. [Google Scholar]
  71. California Department of Public Health. California Surface Water Treatment Rule, Alternative Filtration Technology Demonstration Report; California Department of Public Health: Sacramento, CA, USA, 2001; p. 75.
  72. DeCarolis, J.; Adham, S.; Hirani, Z.; Pearce, W. Integrity evaluation of new generation reverse osmosis membranes during municipal wastewater reclamation. In Proceedings of the Water Quality Technology Conference, Denver, CO, USA, 5–9 November 2006. [Google Scholar]
  73. Pontius, F.W.; Amy, G.L.; Hernandez, M.T. Fluorescent microspheres as virion surrogates in low-pressure membrane studies. J. Membr. Sci. 2009, 335, 43–50. [Google Scholar] [CrossRef]
  74. Gitis, V.; Haught, R.C.; Clark, R.M.; Gun, J.; Lev, O. Application of nanoscale probes for the evaluation of the integrity of ultrafiltration membranes. J. Membr. Sci. 2006, 276, 185–192. [Google Scholar] [CrossRef]
  75. Deluhery, J.; Rajagopalan, N. Use of paramagnetic particles in membrane integrity testing. J. Membr. Sci. 2008, 318, 176–181. [Google Scholar] [CrossRef]
  76. Guo, H.; Wyart, Y.; Perot, J.; Nauleau, F.; Moulin, P. Application of magnetic nanoparticles for UF membrane integrity monitoring at low-pressure operation. J. Membr. Sci. 2010, 350, 172–179. [Google Scholar] [CrossRef]
  77. Choi, S.H.; Yang, J.; Suh, C.; Cho, J. Use of fluorescent silica particles for checking the integrity of microfiltration membranes. J. Membr. Sci. 2011, 367, 306–313. [Google Scholar] [CrossRef]
  78. Lohwacharin, J.; Takizawa, S. Effects of nanoparticles on the ultrafiltration of surface water. J. Membr. Sci. 2009, 326, 354–362. [Google Scholar] [CrossRef]
  79. O’Malley, E. Fate and toxicity of engineered nanomaterials in treated wastewater. Water J. Aust. Water Assoc. 2015, 42, 66–70. [Google Scholar]
  80. Koh, I.; Josephson, L. Magnetic nanoparticle sensors. Sensors 2009, 9, 8130–8145. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  81. Lawler, W.; Antony, A.; Cran, M.; Duke, M.; Leslie, G.; Le-Clech, P. Production and characterisation of UF membranes by chemical conversion of used RO membranes. J. Membr. Sci. 2013, 447, 203–211. [Google Scholar] [CrossRef] [Green Version]
  82. Zeiher, E.H.K.; Ho, B.; Williams, K.D. A fluorescent technology to ensure RO antiscalant performance. Ultrapure Water 2003, 20, 36–43. [Google Scholar]
  83. Fane, T. Monitoring membrane processes for improved performance. In Proceedings of the AWA Membranes and Desalination Specialty Conference, Sydney, Australia, 11–13 February 2009. [Google Scholar]
  84. Giglia, S.; Krishnan, M. High sensitivity binary gas integrity test for membrane filters. J. Membr. Sci. 2008, 323, 60–66. [Google Scholar] [CrossRef]
  85. Giglia, S.; Krishnan, M. New binary gas integrity test improves membrane quality assurance. BioPharm Int. 2011, 24, 24–28. [Google Scholar]
  86. ZAPS Technologies Inc. Technical Specification Sheet: The LiquIDTM Station. Available online: http://www.zapstechnologies.com/wp-content/uploads/2012/05/LiquID-Tech-Specifications-July-2013.pdf (accessed on 10 October 2013).
  87. Optimos Solutions. Solutions/ZAPS Technologies. Available online: http://www.optimos.com.au_zaps-liquid.php (accessed on 10 October 2013).
  88. ZAPS Technologies Inc. Automated Online Water Qualtiy Monitoring. Available online: http://www.zapstechnologies.com/wp-content/uploads/2013/02/LiquID-2013-Product-Brochure.pdf (accessed on 10 October 2013).
  89. ZAPS Technologies Inc. Real-Time E. coli Monitoring with the Liquid Station. Available online: http://www.zapstechnologies.com/wp-content/uploads/2012/07/Monitoring-E.coli-in-the-Creek.pdf (accessed on 10 October 2013).
  90. ZAPS Technologies Inc. Raw Water Monitoring and Event Detection. Available online: http://www.zapstechnologies.com/wp-content/uploads/2012/05/ZAPS-RW-Monitoring-and-Event-Detection.pdf (accessed on 10 October 2013).
  91. Ivnitski, D.; Abdel-Hamid, I.; Atanasov, P.; Wilkins, E. Biosensors for detection of pathogenic bacteria. Biosens. Bioelectron. 1999, 14, 599–624. [Google Scholar] [CrossRef]
  92. Mukundan, H.; Anderson, A.S.; Grace, W.K.; Grace, K.M.; Hartman, N.; Martinez, J.S.; Swanson, B.I. Waveguide-based biosensors for pathogen detection. Sensors 2009, 9, 5783–5809. [Google Scholar] [CrossRef] [PubMed]
  93. Irudayaraj, J. Pathogen sensors. Sensors 2009, 9, 8610–8612. [Google Scholar] [CrossRef] [PubMed]
  94. Pejcic, B.; De Marco, R.; Parkinson, G. The role of biosensors in the detection of emerging infectious diseases. Analyst 2006, 131, 1079–1090. [Google Scholar] [CrossRef] [PubMed]
  95. Adams, J. Shedding light on continuous water monitoring. J. Am. Water Works Assoc. 2009, 101, 46–48. [Google Scholar] [CrossRef]
  96. JMar. Contamination Warning and Process Control Device for Waterborne Microorganisms. Available online: http://www.jmar.com/wordpress/?page_id=329 (accessed on 6 September 2013).
  97. Shirasaki, N.; Matsushita, T.; Matsui, Y.; Kobuke, M.; Ohno, K. Comparison of removal performance of two surrogates for pathogenic waterborne viruses, bacteriophage qβ and MS2, in a coagulation-ceramic microfiltration system. J. Membr. Sci. 2009, 326, 564–571. [Google Scholar] [CrossRef]
  98. Byrne, B.; Stack, E.; Gilmartin, N.; O’Kennedy, R. Antibody-based sensors: Principles, problems and potential for detection of pathogens and associated toxins. Sensors 2009, 9, 4407–4445. [Google Scholar] [CrossRef] [PubMed]
  99. Lim, D.V. Detection of microorganisms and toxins with evanescent wave fiber-optic biosensors. Proc. IEEE 2003, 91, 902–907. [Google Scholar] [CrossRef]
  100. Lee, W.E.; Thompson, H.G. Detection of Newcastle disease virus using an evanescent wave inamno-based biosensor. Can. J. Chem. 1996, 74, 707–712. [Google Scholar] [CrossRef]
  101. Taitt, C.R.; Anderson, G.P.; Ligler, F.S. Evanescent wave fluorescence biosensors. Biosens. Bioelectron. 2005, 20, 2470–2487. [Google Scholar] [CrossRef] [PubMed]
  102. Bisoffi, M.; Hjelle, B.; Brown, D.C.; Branch, D.W.; Edwards, T.L.; Brozik, S.M.; Bondu-Hawkins, V.S.; Larson, R.S. Detection of viral bioagents using a shear horizontal surface acoustic wave biosensor. Biosens. Bioelectron. 2008, 23, 1397–1403. [Google Scholar] [CrossRef] [PubMed]
  103. Rocha-Gaso, M.I.; March-Iborra, C.; Montoya-Baides, A.; Arnau-Vives, A. Surface generated acoustic wave biosensors for the detection of pathogens: A review. Sensors 2009, 9, 5740–5769. [Google Scholar] [CrossRef] [PubMed]
  104. Anderson, G.P.; Rowe-Taitt, C.A.; Ligler, F.S. Raptor: A portable, automated biosensor. In Proceedings of the First Joint Conference on Point Detection for Chemical and Biological Defense, Williamsburg, VA, USA, 23–27 October 2000; p. 7. [Google Scholar]
  105. Nanduri, V.; Kim, G.; Morgan, M.; Ess, D.; Hahm, B.-K.; Kothapalli, A.; Valadez, A.; Geng, T.; Bhunia, A. Antibody immobilization on waveguides using a flow–through system shows improved Listeria monocytogenes detection in an automated fiber optic biosensor: Raptor™. Sensors 2006, 6, 808–822. [Google Scholar] [CrossRef]
  106. Kramer, M.F.; Lim, D.V. A rapid and automated fiber optic-based biosensor assay for the detection of salmonella in spent irrigation water used in the sprouting of sprout seeds. J. Food Prot. 2004, 67, 46–52. [Google Scholar] [CrossRef] [PubMed]
  107. Leskinen, S.D.; Lim, D.V. Rapid ultrafiltration concentration and biosensor detection of Enterococci from large volumes of Florida recreational water. Appl. Environ. Microbiol. 2008, 74, 4792–4798. [Google Scholar] [CrossRef] [PubMed]
  108. Griest, W.H.; Wise, M.B.; Hart, K.J.; Lammert, S.A.; Hryncewich, A.P.; Sickenberger, D.W. The block ii chemical biological mass spectrometer—Point detection for both chemical and biological warfare agents. In Proceedings of the First Joint Conference on Point Detection for Chemical and Biological Defense, Williamsburg, VA, USA, 23–27 October 2000; p. 10. [Google Scholar]
  109. Diouani, M.F.; Helali, S.; Hafaid, I.; Hassen, W.M.; Snoussi, M.A.; Ghram, A.; Jaffrezic-Renault, N.; Abdelghani, A. Miniaturized biosensor for avian influenza virus detection. Mater. Sci. Eng. C 2008, 28, 580–583. [Google Scholar] [CrossRef]
  110. Byungchul, J.; Peiyan, C.; Chevalier, A.; Ellington, A.; Hassibi, A. A CMOS fluorescent-based biosensor microarray. In Proceedings of the Solid-State Circuits Conference, San Francisco, CA, USA, 8–12 February 2009; pp. 436–437. [Google Scholar]
  111. Weller, M. Optical microarray biosensors. Anal. Bioanal. Chem. 2005, 381, 41–43. [Google Scholar] [CrossRef] [PubMed]
  112. U.S. Environmental Protection Agency. Final Report: Online Water Monitoring Utilizing an Automated Microarray Biosensor Instrument. Available online: http://cfpub.epa.gov/ncer_abstracts/index.cfm/fuseaction/display.abstractDetail/abstract/8951/report/F (accessed on 6 September 2013).
  113. Li, Y.; Liu, X.; Lin, Z. Recent developments and applications of surface plasmon resonance biosensors for the detection of mycotoxins in foodstuffs. Food Chem. 2012, 132, 1549–1554. [Google Scholar] [CrossRef] [PubMed]
  114. Homola, J.; Yee, S.S.; Gauglitz, G. Surface plasmon resonance sensors: Review. Sens. Actuators B 1999, 54, 3–15. [Google Scholar] [CrossRef]
  115. Bedford, E.E.; Spadavecchia, J.; Pradier, C.-M.; Gu, F.X. Surface plasmon resonance biosensors incorporating gold nanoparticles. Macromol. Biosci. 2012, 12, 724–739. [Google Scholar] [CrossRef] [PubMed]
  116. Wei, D.; Oyarzabal, O.A.; Huang, T.-S.; Balasubramanian, S.; Sista, S.; Simonian, A.L. Development of a surface plasmon resonance biosensor for the identification of Campylobacter jejuni. J. Microbiol. Meth. 2007, 69, 78–85. [Google Scholar] [CrossRef] [PubMed]
  117. Wang, W.; Yang, X.; Cui, H. Growth mechanism of flowerlike gold nanostructures: Surface plasmon resonance (SPR) and resonance Rayleigh scattering (RRS) approaches to growth monitoring. J. Phys. Chem. C 2008, 112, 16348–16353. [Google Scholar] [CrossRef]
  118. Sherry, L.J.; Chang, S.-H.; Schatz, G.C.; Van, D.R.P.; Wiley, B.J.; Xia, Y. Localized surface plasmon resonance spectroscopy of single silver nanocubes. Nano Lett. 2005, 5, 2034–2038. [Google Scholar] [CrossRef] [PubMed]
  119. Zhang, C.-Y.; Yeh, H.-C.; Kuroki, M.T.; Wang, T.-H. Single-quantum-dot-based DNA nanosensor. Nature Mater. 2005, 4, 826–831. [Google Scholar] [CrossRef]
  120. Zhang, C.-Y.; Hu, J. Single quantum dot-based nanosensor for multiple DNA detection. Anal. Chem. 2010, 82, 1921–1927. [Google Scholar] [CrossRef] [PubMed]
  121. Ladner, D.A.; Lee, B.W.; Clark, M.M. Laser scanning cytometry for enumeration of fluorescent microspheres. J. Am. Water Works Assoc. 2007, 99, 110–117. [Google Scholar] [CrossRef]
  122. Mairhofer, J.; Roppert, K.; Ertl, P. Microfluidic systems for pathogen sensing: A review. Sensors 2009, 9, 4804–4823. [Google Scholar] [CrossRef] [PubMed]
  123. Sanvicens, N.; Pastells, C.; Pascual, N.; Marco, M.P. Nanoparticle-based biosensors for detection of pathogenic bacteria. Trends Anal. Chem. 2009, 28, 1243–1252. [Google Scholar] [CrossRef]
  124. Herrmann, J.; Escher, B.; Jämting, Å.; Neale, P.A. The Fate of Engineered Nanoparticles in Wastewater: Literature Review; Water Quality Research Australia Limited: Adelaide, SA, Australia, 2012; Available online: http://www.waterra.com.au/project-details/135 (accessed on 30 October 2012).
  125. Carr, B.; Wright, M. Nanoparticle Tracking Analysis. A Review of Applications and Usage 2010—2012; NanoSight Ltd.: Salisbury, UK, 2013; p. 188. [Google Scholar]
  126. NanoSight. Measuring Concentration with Nanoparticle Tracking Analysis. Available online: http://www.nanosight.com/technology/nta-software/concentration-measurement (accessed on 11 May 2013).
  127. Defante, A.P.; Vreeland, W.N.; Benkstein, K.D.; Ripple, D.C. Using image attributes to assure accurate particle size and count using nanoparticle tracking analysis. J. Pharmaceut. Sci. 2018, 107, 1383–1391. [Google Scholar] [CrossRef] [PubMed]
  128. AquaDiagnostic. PeCOD™ Laboratory or Field COD Analysis—L100/F100. Available online: http://www.aquadiagnostic.com/downloads/brochures/L100.pdf (accessed on 5 September 2013).
  129. Vollmer, F.; Arnold, S.; Keng, D. Single virus detection from the reactive shift of a whispering-gallery mode. Proc. Natl. Acad. Sci. USA 2008, 105, 20701–20704. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  130. Quinten, M. Optical Properties of Nanoparticle Systems; Wiley-VCH Verlag GmbH & Co. KGaA: Weinheim, Germany, 2011; p. 488. [Google Scholar]
  131. He, L.; Ozdemir, S.K.; Zhu, J.; Kim, W.; Yang, L. Detecting single viruses and nanoparticles using whispering gallery microlasers. Nat. Nanotechnol. 2011, 6, 428–432. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  132. Zhu, J.; Ozdemir, S.K.; Xiao, Y.-F.; Li, L.; He, L.; Chen, D.-R.; Yang, L. On-chip single nanoparticle detection and sizing by mode splitting in an ultrahigh-q microresonator. Nat. Photonics 2010, 4, 46–49. [Google Scholar] [CrossRef]
  133. Vollmer, F. Optical microresonators: Label-free detection down to single viral pathogens. SPIE News. 2010. [Google Scholar] [CrossRef]
  134. Johnson, D.W.; Callis, J.B.; Christian, G.D. Rapid scanning fluorescence spectroscopy. Anal. Chem. 1977, 49, 747A–757A. [Google Scholar] [CrossRef]
  135. Senga, Y.; Minami, S. Excitation-emission matrix scanning spectrofluorometer. Appl. Spectrosc. 1991, 45, 1721–1725. [Google Scholar] [CrossRef]
  136. Yan, Y.; Li, H.; Myrick, M.L. Fluorescence fingerprint of waters: Excitation-emission matrix spectroscopy as a tracking tool. Appl. Spectrosc. 2000, 54, 1539–1542. [Google Scholar] [CrossRef]
  137. Baker, A. Fluorescence properties of some farm wastes: Implications for water quality monitoring. Water Res. 2002, 36, 189–195. [Google Scholar] [CrossRef]
  138. Stedmon, C.A.; Markager, S.; Bro, R. Tracing dissolved organic matter in aquatic environments using a new approach to fluorescence spectroscopy. Mar. Chem. 2003, 82, 239–254. [Google Scholar] [CrossRef]
  139. Carstea, E.M.; Baker, A.; Bieroza, M.; Reynolds, D. Continuous fluorescence excitation–emission matrix monitoring of river organic matter. Water Res. 2010, 44, 5356–5366. [Google Scholar] [CrossRef] [PubMed]
  140. Hambly, A.; Henderson, R.K.; Baker, A.; Stuetz, R.M.; Khan, S.J. Probabilistic analysis of fluorescence signals for monitoring dual reticulation water recycling schemes. Water Sci. Technol. 2010, 62, 2059–2065. [Google Scholar] [CrossRef] [PubMed]
  141. Baker, A. Fluorescence excitation—Emission matrix characterization of some sewage-impacted rivers. Environ. Sci. Technol. 2001, 35, 948–953. [Google Scholar] [CrossRef] [PubMed]
  142. Baker, A. Fluorescence excitation-emission matrix characterization of river waters impacted by a tissue mill effluent. Environ. Sci. Technol. 2002, 36, 1377–1382. [Google Scholar] [CrossRef] [PubMed]
  143. Bieroza, M.Z.; Bridgeman, J.; Baker, A. Fluorescence spectroscopy as a tool for determination of organic matter removal efficiency at water treatment works. Drink. Water Eng. Sci. 2010, 3, 63–70. [Google Scholar] [CrossRef] [Green Version]
  144. Hambly, A.C.; Henderson, R.K.; Storey, M.V.; Baker, A.; Stuetz, R.M.; Khan, S.J. Fluorescence monitoring at a recycled water treatment plant and associated dual distribution system—Implications forcross-connection detection. Water Res. 2010, 44, 5323–5333. [Google Scholar] [CrossRef] [PubMed]
  145. Galinha, C.F.; Carvalho, G.; Portugal, C.A.M.; Guglielmi, G.; Reis, M.A.M.; Crespo, J.G. Two-dimensional fluorescence as a fingerprinting tool for monitoring wastewater treatment systems. J. Chem. Technol. Biotechnol. 2011, 86, 985–992. [Google Scholar] [CrossRef]
  146. Singh, S.; Henderson, R.K.; Baker, A.; Stuetz, R.M.; Khan, S.J. Distinguishing stage 1 and 2 reverse osmosis permeates using fluorescence spectroscopy. Water Sci. Technol. 2009, 60, 2017–2023. [Google Scholar] [CrossRef] [PubMed]
  147. Singh, S.; Henderson, R.K.; Baker, A.; Stuetz, R.M.; Khan, S.J. Characterisation of reverse osmosis permeates from municipal recycled water systems using fluorescence spectroscopy: Implications for integrity monitoring. J. Membr. Sci. 2012, 421–422, 180–189. [Google Scholar] [CrossRef]
  148. Zhang, P.; Liu, W. Zno qd@pmaa-co-pdmaema nonviral vector for plasmid DNA delivery and bioimaging. Biomaterials 2010, 31, 3087–3094. [Google Scholar] [CrossRef] [PubMed]
  149. Zhang, B.-H.; Wu, F.-Y.; Wu, Y.-M.; Zhan, X.-S. Fluorescent method for the determination of sulfide anion with ZnS:Mn quantum dots. J. Fluoresc. 2010, 20, 243–250. [Google Scholar] [CrossRef] [PubMed]
  150. Knappenberger, K.L.; Wong, D.B.; Romanyuk, Y.E.; Leone, S.R. Excitation wavelength dependence of fluorescence intermittency in cdse/ZnS core/shell quantum dots. Nano Lett. 2007, 7, 3869–3874. [Google Scholar] [CrossRef] [PubMed]
  151. Ni, X. Photoluminescent, Water-Soluble Mn-Doped ZnS Quantum Dots. Available online: http://nanotechweb.org/cws/article/lab/37256 (accessed on 2 April 2012).
  152. Borisov, S.M.; Mayr, T.; Karasyov, A.A.; Klimant, I.; Chojnacki, P.; Moser, C.; Nagl, S.; Schaeferling, M.; Stich, M.I.; Kocincova, A.S.; et al. New plastic microparticles and nanoparticles for fluorescent sensing and encoding. In Springer Series on Fluorescence; Springer: Berlin, Germany, 2008; Volume 4, pp. 431–463. [Google Scholar]
  153. Schneider, R.L.; Balan, L.; Aldeek, F. Synthesis, Characterization and Biological Applications of Water-Soluble ZnO Quantum Dots. In Nanomaterials; Rahaman, M.M., Ed.; InTech: London, UK, 2011; Volume 2, pp. 27–42. [Google Scholar]
  154. Geszke, M.; Murias, M.; Balan, L.; Medjahdi, G.; Korczynski, J.; Moritz, M.; Lulek, J.; Schneider, R. Folic acid-conjugated core/shell ZnS:Mn/ZnS quantum dots as targeted probes for two photon fluorescence imaging of cancer cells. Acta Biomater. 2011, 7, 1327–1338. [Google Scholar] [CrossRef] [PubMed]
  155. Pandey, S.; Verma, P.; Pandey, A.C. Synthesis of Highly Luminescent Manganese Doped ZnS Nanophosphor. In Proceedings of the ASID ‘06, New Delhi, India, 8–12 October 2006; pp. 259–261. [Google Scholar]
  156. Hu, S.; Bai, P.; Sun, J.; Cao, S. Fluorescent carbon nanoparticles: Recent achievements and technical challenges. Prog. Chem. 2010, 22, 345–351. [Google Scholar]
  157. Mochalin, V.N.; Gogotsi, Y. Wet chemistry route to hydrophobic blue fluorescent nanodiamond. J. Am. Chem. Soc. 2009, 131, 4594–4595. [Google Scholar] [CrossRef] [PubMed]
  158. Bourlinos, A.B.; Zboril, R.; Kubala, M.; Stathi, P.; Deligiannakis, Y.; Karakassides, M.A.; Steriotis, T.A.; Stubos, A.K. Fabrication of fluorescent nanodiamond@c core-shell hybrids via mild carbonization of sodium cholate-nanodiamond complexes. J. Mater. Sci. 2011, 46, 7912–7916. [Google Scholar] [CrossRef]
  159. Wee, T.-L.; Mau, Y.-W.; Fang, C.-Y.; Hsu, H.-L.; Han, C.-C.; Chang, H.-C. Preparation and characterization of green fluorescent nanodiamonds for biological applications. Diamond Relat. Mater. 2009, 18, 567–573. [Google Scholar] [CrossRef]
  160. Boudou, J.-P.; Tisler, J.; Reuter, R.; Thorel, A.; Curmi, P.A.; Jelezko, F.; Wrachtrup, J. Fluorescent nanodiamonds derived from HPHT with a size of less than 10 nm. Diamond Relat. Mater. 2013, 37, 80–86. [Google Scholar] [CrossRef]
  161. Havlik, J.; Petrakova, V.; Rehor, I.; Petrak, V.; Gulka, M.; Stursa, J.; Kucka, J.; Ralis, J.; Rendler, T.; Lee, S.-Y.; et al. Boosting nanodiamond fluorescence: Towards development of brighter probes. Nanoscale 2013, 5, 3208–3211. [Google Scholar] [CrossRef] [PubMed]
  162. Tan, D.; Zhou, S.; Xu, B.; Chen, P.; Shimotsuma, Y.; Miura, K.; Qiu, J. Simple synthesis of ultra-small nanodiamonds with tunable size and photoluminescence. Carbon 2013, 62, 374–381. [Google Scholar] [CrossRef]
  163. Liu, J.-H.; Yang, S.-T.; Chen, X.-X.; Wang, H. Fluorescent carbon dots and nanodiamonds for biological imaging: Preparation, application, pharmacokinetics and toxicity. Curr. Drug MeTable 2012, 13, 1046–1056. [Google Scholar] [CrossRef]
  164. Liang, Q.; Ma, W.; Shi, Y.; Li, Z.; Yang, X. Easy synthesis of highly fluorescent carbon quantum dots from gelatin and their luminescent properties and applications. Carbon 2013, 60, 421–428. [Google Scholar] [CrossRef]
  165. Boulet, S. Diamonds Could Help Detect Early Stage Cancers, University of Sydney Researchers Say. Available online: http://www.abc.net.au/news/2015-10-10/diamonds-could-help-detect-early-stage-cancers/6844212 (accessed on 12 February 2016).
  166. Adham, S.S.; Jacangelo, J.G.; Laine, J.M. Low-pressure membranes: Assessing integrity. J. Am. Water Works Assoc. 1995, 87, 62–75. [Google Scholar] [CrossRef]
Figure 1. Schematic representation of membrane barrier performance.
Figure 1. Schematic representation of membrane barrier performance.
Membranes 08 00060 g001
Figure 2. Schematic illustration of vacuum decay test (VDT) apparatus.
Figure 2. Schematic illustration of vacuum decay test (VDT) apparatus.
Membranes 08 00060 g002
Figure 3. Examples of VDT results from intact (A) and compromised (B) RO membrane elements.
Figure 3. Examples of VDT results from intact (A) and compromised (B) RO membrane elements.
Membranes 08 00060 g003
Figure 4. Examples of EEMs from RO: (a) feed and (b) 1st pass permeate.
Figure 4. Examples of EEMs from RO: (a) feed and (b) 1st pass permeate.
Membranes 08 00060 g004
Table 1. Suggested criteria for ideal integrity monitoring systems or devices.
Table 1. Suggested criteria for ideal integrity monitoring systems or devices.
CriteriaRequirement(s)
Technique Considerations
Test typeTest should be online and provide integrity performance (LRV) results in real-time.
Detection in permeate from membrane elements, individual pressure vessels or membrane array of complete membrane train.
System shutdown unnecessary, normal operations continue during integrity surveillance.
SensitivityHigh sensitivity at low challenge species concentration.
SelectivityChallenge species should be representative of the smallest virus rather than chemical compounds and not be subject to changes in detection resulting from variations in environmental or chemical conditions such as NOM, salinity, pH and temperature.
OutputTest should deliver minimum LRV of 4 log10 sensitivity.
Financial Considerations
Capital costIn the same order or less of capital cost as existing online real-time systems such as total organic carbon instrumentation.
Installation IntegrationThe ability to be fully integrated into existing systems as well as new systems seamlessly (greenfield and brownfield applications).
OperationShould require minimal training for operators.
Running costsShould not add more than 1–1.5% of the tariff charged to consumers for the provision of treated water.
Table 2. Summary of reported RWT integrity tests.
Table 2. Summary of reported RWT integrity tests.
Feed Concentration (mg/L)Mode *LRVReference
0.1–1C3.5–5.3[54]
1–2C3.9[8]
1C2.7–3[9]
0.1–1C2–5[57]
0.1C2.6[56]
5–10P>4[58]
* Mode: C = continuous, P = pulse.
Table 3. Example of TDS and COD results of 1st and 2nd stage RO permeates.
Table 3. Example of TDS and COD results of 1st and 2nd stage RO permeates.
RO PermeateTDS (mg/L)COD (ppm)
1st pass48.21.57
2nd pass2.40.27
Table 4. Assessment of current and emerging integrity monitoring methods.
Table 4. Assessment of current and emerging integrity monitoring methods.
Monitoring TechniqueMembrane ApplicationsModeDescriptionScaleAdvantages/LimitationsReferences
Existing Techniques—Direct Monitoring
Vacuum Decay TestingNF and RO membranesOfflineElement soaked with RO permeate overnight, drained then capped, vacuum applied; decay monitored over 1 min; fail at >10 kPa/min decayPost-manufacturing; bench- and pilot-scaleApplies only to individual elements and not to the entire system[6,9,28,71]
Pressure Decay TestingMF, UF, NF and RO membranesOfflineOne side of the membrane pressurized, pressure loss over time monitoredBench- and pilot-scale; can be used for entire stage of NF and RO systemsNot practical for full-scale elements due to drainage requirement; pressurizing permeate side can cause damage to NF/RO membrane; not widely used for these systems[28,33,71,166]
Existing Techniques—Indirect Monitoring—Naturally Occurring Substances
Particle MonitoringMF and UF membranesOnlineParticle concentration measured in feed and permeatePilot-scaleNot suitable for NF/RO as particle size is too large; resolution dependent on particle concentration in feed water[33]
Turbidity MonitoringMF and UF membranesOnlineSimilar to particle monitoring, concentration measured in feed and permeateFull- and pilot-scaleMinimum particle size is 1 µm; low resolution[36]
TOC MonitoringNF and RO membranesOnlineTOC concentrations measured in feed and permeateFull-scale; can be used for entire stage of NF and RO systemsUsed in several installations but equipment to detect very low levels is expensive[18,41]
Sulphate MonitoringNF and RO membranesOfflineSulphate concentrations measured in feed and permeateFull-scale; can be used for entire stage of NF and RO systemsExpensive to monitor continuously using ICP[18]
Conductivity MonitoringNF and RO membranesOnlineConductivity of feed and permeate monitoredBench-, pilot-, and full-scale; can be used for entire stage of NF and RO systemsLow resolution; removal limited to 2 log10 for water reuse applications; probing more effective than online monitoring[41]
Periodic TestingNF and RO elements, trainsOnlineCan involve multiple tests including conductivity probing and UV-254Full-scale of NF and RO systemsOffers multiple, periodic testing; can locate defects but is complex to implement in full scale applications[41]
Existing Techniques—Indirect Monitoring—Challenge Tests
Dye TestingNF and RO membranesOnlineLog removal of dye measured by calibrated absorbance or fluorescence at optimum wavelengthPilot- and full-scaleCan provide up to 4 log10 resolution; fouling can be an issue for some dyes but not RWT[18,33]
Spiked Integrity MonitoringMF and UF membranesOnlinePAC particles injected in feed side and particle concentration measured in permeateFull-scaleApplicable only for micron size particles[59]
Pulse Integrity TestNF and ROOnlineMeasures a pulse of highly rejected species (i.e., sulphate)Pilot scaleCan locate defects if calibrated[60]
Microbial Surrogates (i.e., MS2, E. coli etc.)MF, UF, NF and RO membranesOfflineHigh concentrations of surrogate introduced into feed and concentration measured in permeatePilot- and full-scaleSeeding required since MF/UF pretreatment will remove most surrogates; can be expensive[71]
Fluorescent MicrospheresMF and UF membranesOfflineMicrosphere concentration in feed and permeate measured by fluorescencePilot- and full-scaleUp to 4 log10 removal reported; expensive due to cost of particles[18]
Existing Techniques—Integrated and Multi-Parameter Monitoring Systems
TRASAR®NF and RO membranesOnlineFluorescent molecules injected with antiscalant; fluorescence measured in permeate using trace leak detectionFull-scale; can be used for entire stage of NF and RO systemsUp to 6 log10 removal reported with non-continuous spikes; up to 2 log10 when used with antiscalant[18]
Small Sensor Cell with Collection MembraneMF and UF membranesOnlineMicrosieve sensor membrane placed in permeate side stream; change in TMP of sensor membrane detects breachBench- and pilot-scaleCan take >60 min to detect very small breach[83]
Binary Gas Integrity Test MF and UF membranesOnlineDiffusivity of low permeating gas detected in permeate using mass flowmeters and composition with FTIRBench-scaleComplex to implement in larger membrane systems; gas permeability may be an issue as would the cost of inert gases required[84]
ZAPS LiquID StationGeneral water quality monitoring device; could be applicable for MF, UF, NF and ROOnlineMeasures multiple optical parameters simultaneouslyFull-scaleCan potentially report high LRVs for TOC and BOD; difficult to quantify system LRV as it uses tryptophan, a common amino acid in many proteins not unique to E. coli and that may limit its sensitivity[86]
Emerging Techniques—Pathogen Detection Systems
BioSentry DeviceGeneral water quality monitoring device; could be applicable for MF, UF, NF and ROOfflineMulti-angle light scattering at 660 nm used to determine particle size, shape and internal structureBench-scaleValid only for particles greater than 0.4 micron[96]
Real-Time Polymerase Chain ReactionWater quality monitoring specifically for virusesOfflineFeed and permeate collected and virus detected using centrifugation, filtration and enumeration techniquesBench-scaleRequires specialized personnel, sample preparation and long time periods for results; expensive[97]
Evanescent Wave Fiber Optic SensorDetection of pathogensOnlineLaser derived evanescent wave is excited over sample and fluorescence measured using laser spectrofluorometerBench-scaleLong detection time (several h)[98,99,100]
RAPTOR Fiber Optic BiosensorDetection of pathogensOnlineMonitors complex formation by evanescently exciting surface-bound fluorophores with a diode laserBench-scalePortable; results in less than 10 min[104]
Miniaturized Portable BiosensorDetection of pathogensOnlineElectrochemical technique (impedance spectroscopy) used to detect virus by immobilization of antibodies onto biofunctionalized gold electrodeBench-scaleLong detection time (several h)[109]
Microarray Biosensor InstrumentDetection of pathogensOnlineAutomated concentration system uses advance array biosensor to detect pathogens in waterBench-scaleLaboratory-scale systems common[112]
Surface Plasmon Resonance BiosensorsDetection of pathogensOnlineIllumination of a metallic surface by visible or near-infrared radiation from a monochromatic light source via a hemispherical prism; electromagnetic waves are generated and detectedBench-scaleNot currently available as a commercial technique for field applications[116]
Quantum Dot Based DNA NanosensorsDetection of pathogens-Ultrasensitive nanosensor based on fluorescence resonance for detecting DNABench-scaleRequires specialized personnel; expensive[119]
Laser- Scanning Cytometry Detection of pathogensOnlineLaser-scanning cytometry used to detect microspheres in feed and permeate samplesBench-scaleOnly applicable for micron-sized particles[121]

Share and Cite

MDPI and ACS Style

Ostarcevic, E.R.; Jacangelo, J.; Gray, S.R.; Cran, M.J. Current and Emerging Techniques for High-Pressure Membrane Integrity Testing. Membranes 2018, 8, 60. https://doi.org/10.3390/membranes8030060

AMA Style

Ostarcevic ER, Jacangelo J, Gray SR, Cran MJ. Current and Emerging Techniques for High-Pressure Membrane Integrity Testing. Membranes. 2018; 8(3):60. https://doi.org/10.3390/membranes8030060

Chicago/Turabian Style

Ostarcevic, Eddy R., Joseph Jacangelo, Stephen R. Gray, and Marlene J. Cran. 2018. "Current and Emerging Techniques for High-Pressure Membrane Integrity Testing" Membranes 8, no. 3: 60. https://doi.org/10.3390/membranes8030060

APA Style

Ostarcevic, E. R., Jacangelo, J., Gray, S. R., & Cran, M. J. (2018). Current and Emerging Techniques for High-Pressure Membrane Integrity Testing. Membranes, 8(3), 60. https://doi.org/10.3390/membranes8030060

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop