Next Article in Journal
Test-Driven Development of a Substructuring Technique for the Analysis of Electromagnetic Finite Periodic Structures
Previous Article in Journal
Study of the Phenolic Compound Profile of Arbutus unedo L. Fruits at Different Ripening Stages by HPLC-TQ-MS/MS
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Integrative Assessment of Sediments Affected by CO2 Enrichment: A Case Study in the Bay of Santos—SP, Brazil

by
Marina Cunha Passarelli
1,2,
Estefanía Bonnail
3,
Augusto Cesar
4,
T. Ángel DelValls
5,* and
Inmaculada Riba
2
1
Department of Environment, Petrobras, Santos 11010-310, Brazil
2
Department of Physico-Chemistry, Aquatic Systems Research Group, UNESCO/UNITWIN WiCop, Faculty of Environmental and Marine Sciences, 11510 Cádiz, Spain
3
Centro de Investigaciones Costeras—Universidad de Atacama (CIC-UDA), University of Atacama, Copiapó 1530000, Chile
4
Department of Ocean Sciences, Federal University of São Paulo (UNIFESP), Santos 11030-100, Brazil
5
Department of Ecotoxicology, Santa Cecília University (UNISANTA), Boqueirão 11045-907, Brazil
*
Author to whom correspondence should be addressed.
Appl. Sci. 2021, 11(24), 11603; https://doi.org/10.3390/app112411603
Submission received: 8 November 2021 / Revised: 28 November 2021 / Accepted: 30 November 2021 / Published: 7 December 2021
(This article belongs to the Section Environmental Sciences)

Abstract

:
CO2 enrichment in the marine environment caused by leakages from carbon capture and storage technologies may occur over operational procedures. An integrated approach using weight-of-evidence was applied to assess the environmental risk associated with the acidification caused by CO2 enrichment in coastal sediments from Santos (Brazil). Chemical analyses (metal(loid)s and organic contaminant (e.g., hydrocarbons), toxicity tests (amphipods mortality, sea-urchin embryo-larval development) and macro-benthic community structure alteration assessment were performed with different acidified scenarios (pH 8.0–6.0) for two stations with different contamination degrees. These lines of evidence were statistically analyzed and integrated (multivariate analysis and ANOVA). Results of toxicity showed significant chronic effects starting at pH 7.0 while acute effects were observed starting at pH 6.5. The macro-benthic community integrity showed significant differences for all treatments at the Piaçaguera channel station, considered to be moderately contaminated. Results from the multivariate analysis correlated toxic effects and increase in the mobility of some elements with acidification. Also, the biological indexes were correlated with concentrations of dissolved Zn in seawater. The pH of 6.0 was extremely toxic for marine life due to its high acidification and metal bioavailability. The approach herein identified and discriminated the origin of the degradation caused by the acidification related to the enrichment of CO2.

1. Introduction

The increasing of anthropogenic activities since the pre-industrial era produced a series of changes in the ecosystems due to the CO2 increase in the atmosphere and high anthropogenic emissions such as the use of fossil fuel, electric power plants, and automobiles, among others [1]. Previous studies estimated that CO2 concentrations in the atmosphere have been raised from 280 ppm, dated in the pre-industrial era, to current concentrations higher than 415 ppm (Mauna Loa–Hawaii–observatory 2021 [2]). In this way, mitigation strategies to combat the impact caused from the increase of greenhouse gases (such as carbon dioxide) and the climate change phenomena have been considered in the last few years [3]. Among the strategies to reduce the CO2 atmosphere levels, some consist of large-scale carbon capture and storage (CCS) in geological formations, which might contribute to a 19% reduction of CO2 emissions by 2050 [4]. However, despite of this current practice, there are some gaps in the environmental risk assessment of the technique; it still remains largely unexplored hampered by complex ecological relationships and different ecosystems [5,6].
Many studies have been performed in the last few years in order to analyze the potential effects from CO2 enrichment in the ocean caused by both increases in CO2 atmosphere concentrations and natural uptake on seawater surface, and by CO2 leakages during the CCS process (e.g., [7,8,9,10]), as well as in combination with harmful substances [11,12].
On the other hand, the weight-of-evidence (WoE) approach has been indicated as a good method to achieve precise results of environmental characterization and quality status [6,13,14,15,16]. According to [17], several questions commonly asked in an environmental assessment of chemicals include the following: Are contaminants present in the ecosystem and at what levels? Are contaminants bioavailable? Do they cause biological adverse effects? These questions were adapted in this study in relation to the influence of acidification caused by CO2 enrichment in the seawater. In this sense, these questions were addressed in the present study in the Bay of Santos with particular chemical characterization and its characteristic infauna.
Recent studies have evaluated the relationship between decrease in seawater pH, adverse effects on marine organisms, and changes in the metal concentrations [7,8,18,19,20,21,22,23]. However, none of these studies have been designed or applied under an integrative point of view using multiples lines of evidence as recommended by [24].
Therefore, the use of an integrated approach using the maximum amount of information could be an effective way to contribute with the studies of environmental risk related to CO2 enrichment in the ocean, which would support stakeholders and policymakers in finding appropriate solutions for the conservation and protection of marine ecosystems. In the present study, the relationship between CO2 enrichment in the ocean and increases of the contamination levels was assessed based on the WoE and using sediment and water physicochemical analysis, ecotoxicological analysis, and macro-benthic community alteration as the mains lines of evidence linked in the WoE.

2. Materials and Methods

2.1. Study Area and Sampling Stations

The Santos Estuary System (SES), located on the central coast of the state of São Paulo (SE Brazil), has been widely characterized in terms of contamination in water and sediment [14,16,25,26,27]. Sediment samples were collected from two sampling sites according the contamination levels (Figure 1): low contaminated (Palm Island, PAI) and intermediate contamination (Piaçaguera channel, CPI). Chemical characterization of the sampling sites can be found in [22]. Briefly, seawater elements were below detection limits, 24 °C (±1) of temperature, pH 8.0 ± 1, and a DO below 60% when sampling. Sediment from PAI registered 1.11% of OM, and 26.8% of fines, and sediments from CPI were characterized by 13.1% and 34.6% for OM and fines, respectively. Based on the ecotoxicological assessment of sediments from the Santos and São Vicente estuarine system study [23] maximum element concentration was 167.2 mg kg−1 Cu, 6.02 for Ni, 154.2 for Zn, 0.950 for PAHs, 4.00 for PCBs; meanwhile organic carbon content was ranged between 0.85 and 3.75 (close to PAI), and the percentage of fines varied from 1.42 to 11.56. These high levels are attributed to the mangroves and sewage disposal [25].

2.2. CO2 Injection System

Aiming to mimic scenarios of acidification associated with CO2 enrichment in the marine environment, a CO2 injection system was employed for ecotoxicological assessment and for mesocosms using macro-benthic community structure (Figure 2). The system was previously described by [19] and updated by [21]. Briefly, the AT Control System from Aqua Medic (Bissendorf, Germany) was used to independently manipulate and control the pH in each chamber test. The electrodes (NBS scale) are placed inside the chamber test and connected to the computer system to control the pH in each test vessel. The CO2 gas is added in the chambers through a solenoid valve that opens when the pH increases 0.01 units above the predetermined pH values and closes when target pH is reached. This system was used for all the treatments and toxicity tests (Table 1).

2.3. Toxicity Tests

Acute and chronic toxicity tests were carried out to analyze the effect of the acidification caused by CO2 enrichment using different marine organisms. The pH values of the treatments ranged between 8.0 and 6.0 (8.0 ± 1, 7.5 ± 1, 7.0 ± 1, 6.5 ± 1 and 6.0 ± 1) using three replicates. Table 1 shows a summarized description of the different biological responses and the toxicity test conditions.

2.3.1. Acute Test

Amphipods Hyale youngi were collected from stalks of the macro-algae Ulva sp. from the rocky reefs in Palm Island from Bay of Santos (Figure 1). The organisms were acclimated to laboratory conditions for a week before testing. Tests were performed using 2-L glass beakers in a ratio of 1:4 v/v sediment samples/seawater following [19]. Briefly, the chambers tests were left for 24 h under constant aeration before starting the CO2 injection, and then, amphipods were introduced. Organisms (n = 10) were exposed for 10 days to different acidification scenarios described (in triplicate). Amphipod survival rate was determined after exposure.

2.3.2. Chronic Test

Specimens of Lytechinus variegatus were collected from Palm Island from the Bay of Santos, transported to the laboratory, and placed in tanks with aerated seawater before testing. Sediment-seawater (ratio 1:4 v/v) was first acidified by the injection of CO2 gas until the target pH was reached. Then, sediment elutriate was obtained by mixing sediment and filtered seawater. The mixture was kept under agitation (50 rpm) for 30 min, followed by a settling period of 12 h [20]. After this procedure, the supernatant fraction was extracted and placed in glass tubes (20 mL of sample per replicate). Elutriates were acidified with CO2 bubbles to maintain the target pH treatments during the test. The gametes were obtained by KCl (0.5 M) injection following [28].

2.4. Macro-Benthic Community

Sediments infauna (top layer from 0 to 5 cm depth) were collected using a 0.025 m2 van Veen grab and exposed to different pH values in order to analyze the impact of the CO2-induced acidification in the benthic community in the marine environment. Briefly, 25-L plastic aquarium replicates were filled with sediment grabs. Two of these aquaria were randomly selected as day 0 (D0) and the others were exposed to the different pH treatments and control. Sediments from D0 were sieved immediately and the retained fauna were fixed. The experiments were performed following [29]. After the acclimation time (1 day), mesocosms were performed in duplicate and maintained at 21 °C with natural photoperiod, and constant aeration for 21 days. Water was replaced every three days. Abundance and richness using Margalef’s method (d) and the Shannon’s diversity (H0) were calculated for each replicate.

2.5. Chemical Analyses

Overlying seawater (50 mL) was collected and preserved in darkness, avoiding any headspace for posterior analysis of total alkalinity (TA). TA was determined by automatic titration (Mettler Toledo, T50, Schwerzenbach, Switzerland) using a combined glass electrode (Mettler Toledo, DGi115-SC) calibrated on the NBS scale.
The metal(loid) concentrations (As, Cr, Cu, Ni, Zn,) in the total fraction sediments, water, and elutriates were determined due to presence and potential adverse effects over biota found in previous studies [23]. These elements are also associated with concentrations of PAHs and PCBs.
The sediment samples (0.1 g of 40 °C dried sediment sample) were digested with a mixture of acids (nitric, hydrochloric, and hydrofluoric acid) under controlled temperature (first at 180 °C, and posterior heating at 110 °C), and complexation with boric acid (10 min). After digestion by microwaves (Speed wave of Berghof), samples were analyzed using inductively coupled plasma−mass spectrometer (ICP- MS) (Thermo Elemental Series-X, Santa Clara, CA, USA). These elements were also analyzed in overlying and elutriate seawater at the end of the toxicity tests in filtered (0.45 mm) subsamples and acidified (pH < 2). Analyses were performed using inductively coupled plasma optical emission spectrometry (ICP-OES). These analyses were performed in the Scientific Instrumentation Center of the University of Granada.

2.6. WoE Approach

Three main LoEs were determined in the present study to characterize and distinguish the impacts related to the contamination degree and the acidification caused by the CO2 enrichment (Figure 3).
The hypothesis of this work predicted that marine organisms and environment might be affected by exposure to the acidification caused by CO2 enrichment that was statistically tested using an integrated approach (WoE) based on significant differences and a multivariate analysis. The obtained results from each LoEs were linked for each derived component assessed using three different methods as outlined by [6,17,30]: (a) tabular matrix based on statistical significance (p < 0.05) compared to the reference site; (b) pie charts, showing statistical differences (p < 0.05 significant different and positive effect; 0. 1 ≥ p > 0.05 significant different but moderate effect; and p > 0.1 not significant different among the samples sites and pH values; and (c) linking the results using a multivariate analysis approach [6].
The significant differences found between the pH treatments and the reference site (PAI station, pH 8.0), and to develop the pie charts and tabular matrix ANOVA and Dunnet’s tests were used through TOXSTAT software, version 3.5.+
The values used for these analyses were determined through index of contamination, toxicity, and ecological integrity. The indexes were calculated considering the values of ratio to reference (RTR) following [17]. For it, the results from each LoE in each pH treatment were divided by the values presented in the reference case (PAI, pH 8.0) and then deriving the minimum value to calculate the index. Then, these values were averaged for metal contamination in sediment and mobility, acute toxicity, chronic toxicity, and ecological integrity.
The contamination index was calculated considering two conditions: the concentration of As, Cr, Cu, Ni, and Zn in the sediment (RTRsediment) and in seawater and elutriates (RTRmobility). The index of acute toxicity was derived from the results of amphipod survival rate and to chronic toxicity was estimated from the larval development inhibition results of sea-urchins. In relation to the index of benthic integrity, the inverted average values of RTR were calculated for total abundance, diversity, and richness. The formulas used to determine the indexes were:
R T R i = v i v i o   and   I = i = n R T R i n     i
where i = parameter and Vi = value of the parameter in the reference case, and I [Index] is equal the sum of number calculated for each RTR per the total variable number considered in the respective case.
Multivariate analysis was conducted following methods previously described by [17,26]. The results were analyzed using factor analysis method with extraction of the variables by principal component analysis (PCA). Factors were rotated using the varimax normalized procedure. The component loading cutoff of 0.40 was used in the selection of variables for inclusion into the factors. Also, the factor scores for each sampling site were calculated. Statistical analyses were carried out by means of the STATISTICA® software package version 13.2.

3. Results

Summarized results for sediment and seawater chemistry, acute and chronic toxicity, and benthic community structure related to CO2 enrichment in the marine environment are described in Table 2. Results of the concentration of metal(loid)s in elutriate treatment and seawater were shown for the different pH tested. In general, greater concentration of metal(loid)s in overlying seawater were found than elutriate treatments, except in the case of Zn and As, that were higher in the elutriates. Moreover, higher concentrations of metals were found in the sediment samples from CPI than PAI, with the exception of Ni and As. Regarding to biological responses, significant (p < 0.05) mortalities were found at pH 6.0 when using the PAI sediment, and at pH 6.5 using the CPI sediment. However, significant (p < 0.05) effects were found for the larval development of sea-urchin at pH 7.0 and 6.5 for PAI and CPI sediments, respectively. No significant (p < 0.05) decreases were found in the community indexes of PAI sediment fauna when compared with the control treatment (i.e., no CO2 added), except in the total abundance which decreased considerably at lowest pH level. However, the results found for the benthic community from CPI showed significant decrease in the diversity at pH 6.0. On the other hand, an increase in the total abundance of species was showed at pH 6.0 from CPI.

3.1. Tabular Matrix

Significant differences (p < 0.05) between the reference station (PAI, pH 8.0) and the treatments with both sediments were represented as showing a positive response either in contamination, toxicity, and integrity (Table 3). The results obtained for the metal(loid) concentrations in the sediment samples showed no significant difference between the treatments used in this study. However, significant differences were found in the results of metal(loid) mobility between the reference (PAI, pH 8.0) and the lower acidification treatments (pH 6.5 and 6.0) for both stations. Regarding the results of toxicity, significant chronic effects were found from pH 7.0 for the PAI sediment and from pH 6.5 for CPI sediment. Meanwhile acute effects were observed at pH 6.0 in PAI sediment and at pH 6.5 for CPI sediment. Moreover, the results of macro-benthic community integrity showed significant differences for all treatments for CPI sediment, pointing out that the contamination presented in CPI sediments is caused by mobility and bioavailability.

3.2. Pie Charts

Figure 4 represents significant differences based on the weights for the different lines of evidence (element contamination, acute and chronic toxicity, and macro-benthic integrity). The PAI sampling site was selected as reference site at control pH (no CO2 added; pH 8.0 ± 0.1). Each pH treatment for both sampling sites were compared with the control treatment Significant differences were represented as black sections when p < 0.05, gray sections when significant differences were 0.01 ≥ p > 0.05, and white section for no significant difference (p > 0.01).
These results confirm those reported by tabular matrix and provide more information related to the cases with moderate effects (0.01 ≥ p > 0.05). The results showed significant effects (p < 0.05) for chronic toxicity and moderate (0.01 ≥ p > 0.05) effects for mobility of metals at a pH of 7.0 using PAI sediment. In the case of CPI sediment, significant effects (p < 0.05) for the most of LoEs tested were found at pH 6.5, showing a strong environmental degradation at the treatment within this pH level. Furthermore, moderate increases in the metal mobility were found in the CPI control and at higher values of pH when compared with the reference case.

3.3. Multivariate Analysis

A multivariate analysis approach was performed in order to identify the correlation among sediment and water contamination, biological effects in the laboratory and the pH reduction in seawater caused by CO2. The original variables are represented by three new principal components (Table 4).
The first three components explained 82.74% of the variance in the original data set. The first component #1 represents a 43.38% of variance and combined the results of Cu and Zn in overlying seawater and in sediment, Zn and Ni in elutriates, and Cr, Cu, and Zn in sediment. The second component #2 explains a 28.56% of variance and linked As, Zn and Ni in seawater, Cr, Cu, and As in elutriate, the increase in the concentration of H+ protons (pH reduction) and the biological effects (mortalities of amphipods and sea-urchin larval development inhibition), and the third component #3 explains a 10.80% of variance linking Zn in overlying water and the larval development inhibition of sea-urchins.
Moreover, negative values were found for the diversity, total abundance, and richness at #1 and #3, which indicates correlations among these results. These variables were linked as negative due to the form in which the results were represented (as the values of ecological integrity decrease, more effects were found to be correlated with these factors).
These results suggest that the toxic effects were correlated with the increase in the concentrations of protons associated with the enrichment of CO2. The results also correlate the toxic effect with the increase in the mobility of some metals (As, Zn, and Ni in seawater and As, Cr, and Cu in elutriate). Furthermore, the larval development of sea-urchin and the diversity and richness of the macro-benthic communities was shown to have also been affected by the concentration of Zn in seawater that was not correlated with the pH reduction.
Factor scores estimated for each case are represented in Figure 5. This is a clear visualization of the relationship between the components (factors) and the cases (treatments) tested in the study.
The factors scores showed that the results indicated in the component #2 that were the toxicity effects and the mobility of certain metals were associated with the pH 6.0 in both stations studied. Moreover, a higher influence of the factors #1 and #3 in the CPI station that were related to the contamination of metals in both cases, sediment and mobility, was observed. These results confirmed Table 3 and Figure 4 since significant effects (p < 0.05) were found at pH 6.0 for both stations, and greater effects associated with the contamination were shown for CPI station.

4. Discussion

The CCS technologies may cause punctual potential acidification events due to CO2 enrichment in the marine environment caused by leakages. These CO2 leakages may occur over time during some steps of operations technology [31]. In this context, studies of environmental risk characterization in the areas nearby CCS operations are highlighted [2].
In Brazil there are projects with operating status of CCS system in Rio de Janeiro and Bahia [32]. The sediment stations selected for this study are located in the Santos estuary and Bay; this zone is considered relatively close to Rio de Janeiro and with tropical characteristics as well. Moreover, both sediment stations selected for this study are areas usually known to receive large quantities of organic matter from the surrounding mangrove and urban activities.
According to the report on coastal waters quality of the State of São Paulo [33], the pH value found in the areas selected in this study varies between a pH of 6.5 and 8.5. Furthermore, a previous study has shown a value of 2.2% and 7.5% of total organic carbon (TOC) in the PAI and CPI stations, respectively [16]. Therefore, studies of the impact caused by enrichment of CO2 in areas that present tropical characteristics as Brazil and with organic carbon concentrations in sediments are also highlighted.
The results found in the study were expressed using the WoE approach, based on different lines of evidence, to characterize the environmental degradation associated with the enrichment of CO2 in the coastal zones. The use of this integrated approach has been widely indicated as an efficient method to identify and distinguish the origin of contamination and provide a better monitoring and protection of the marine environment [6,15,25,27,34]. Previous studies have characterized the sediment contamination by means of metals, PAHs and PCB concentrations in the Santos Estuary [16,27,35]). These authors and their results agree with our study showing that the lowest metal concentrations were found for the control sediment station (PAI). The concentrations obtained in the other station (CPI) were also in agreement with previous studies showing the sediments at this station as an intermediate contamination. Besides, sediment quality guidelines based on Tiburonella viscana [23] determined no pollution for concentrations below 63 mg kg−1 Cu, 73.3 for Zn, below 0.5 for ΣPAHs and 4 µg.kg−1 ΣPCBs. However, no significant differences were showed in the concentration of metals in the sediment between the reference case, and all pH treatments tested for both stations when using the tabular matrix and pie charts. Additionally, the concentration of metals found in both stations were below limit values defined by [36] (used in Brazil to classify the levels of metal concentrations in dredged sediment).
The results from the multivariate analysis showed no correlation between the biological indexes of macro-benthic communities and pH reduction (#2, Table 3). The diversity and richness of the macro-benthic communities were associated with concentrations of Zn in seawater (#3), while the total abundance of the organisms was associated with the sediment contamination and the mobility of Cu, Zn, and Ni (#1). These results can explain those demonstrated in the tabular matrix and pie charts that were found a significant difference (p < 0.05) in the ecological integrity in all pH treatments when using the CPI sediment station. Moreover, these findings may indicate the contamination and bioavailability of elements present in this station, which was confirmed with the estimated factor scores (Figure 5).
Benthic organisms may be exposed to contaminants on different routes, such as by their contact with pore water, sediment-water interface through walls of the body, and respiratory surface or by the ingestion of contaminated sediment particles [37]. Although no significant difference was found in the metal concentration in the sediment stations, the higher difference in the macro-benthic communities could be related to the effects of other environmental factors and contaminants that were not measured in this study. The Santos estuary is influenced by a number of factors, such as port and dredging activities, human sewage effluents, contribution of nutrients from the mangroves, and others [16,25,34]. It was reported by [16,23] a greater bioavailability of PAHs at CPI station, such as benzo(a)anthracene, benzo(a)pyrene, and dibenzo(a,h)anthracene, which are considered very toxic for both biota and humans [38,39]. Furthermore, these authors reported higher concentrations of Hg bioaccumulated in the oysters. Thus, all of these factors reported and the high carbon concentration (7.5%) found in the CPI station could contribute to the low biological indexes of macro-benthic community present there.
It is known that the reduction in the concentration of both hydroxide and carbonate (OH and CO32−) could change the speciation of some metals and, consequently, raise up the fraction in free forms at lower pH [40]. One of the lines of evidence selected for this study was to analyze the mobility of metals and their toxicity in relation to acidification by enrichment of CO2. The results showed a significant increase in the metals concentrations in overlying water and elutriate treatment at pH 6.5 and 6.0 using the tabular matrix and the pie charts for both sediment stations when compared with the reference case (PAI, pH 8.0). Moreover, moderate effects in the mobility of metals were observed in the gray areas (Figure 4) at pH 7.5 and 7.0 using the CPI station.
A recent study showed that there are more sulfides forms in the sediments from SES than other complex forms [16]. Furthermore, these authors reported that when there is more sulfide complex than divalent metals in the environment it is supposed that these metals are complexed to the sulfides, which are less bioavailable. According to [40], metals form strong complexes with hydroxide and carbonate, which undergo significant changes in speciation as the pH of seawater decreases. Thus, for an environmental risk assessment in case of a CO2 enrichment, it is important to analyze the speciation of metals to understand interactions with lower pH in seawater and how they affect the biota. The tabular matrix (Table 3) and pie charts (Figure 4) showed chronic effects associated with pH values of 7.0 and pH 6.5 for PAI and CPI sediment, respectively. However, the sediment from PAI is considerate lesser contaminated than CPI sediment, so higher bioavailability of some elements are present as carbonate forms. In addition, the results using the multivariate analysis indicated strongly correlation between certain metals (As, Zn, and Ni in seawater, and Cr, As, and Cu in elutriate) and the biological effects related to the increase in the concentration of H+ protons (pH reduction). These results may confirm the statistical results reported (Table 3 and Figure 4) and provide an estimation of the metal(loid)s related biological responses (included in the ‘gray and black’ areas of the WoE analysis from Figure 4).
Furthermore, the results of factor scores from component 2# also confirm a relationship between metal mobility, toxicity, and acidification as a positive score only at the lowest pH (6.0) in both stations. This means that the CO2 enrichment in these stations could cause effects under extreme acidified conditions-.

5. Conclusions

The weight-of-evidence approach was successfully applied in this study using different lines-of-evidence that allows an environmental risk characterization related to the enrichment of CO2 in the studied coastal zones.
The results showed chronic biological adverse effects associated with values of pH 7.0, significantly differenced to the reference case (PAI station, pH 8.0) using a sediment with low contamination levels (PAI station). Furthermore, moderate effects were also observed in the mobility of metals associated with the pH 7.0 using both sediment stations.
The mobility of certain metals (As, Zn and Ni in seawater, and Cr, As, and Cu in elutriate) and the toxic effects were significantly related to the increase in the concentrations of protons. These findings suggest that metals might be responsible for the adverse effects as demonstrated from the WoE analysis, probably promoted an increasing of metal bioavailability and toxicity at pH values of 7 or lower.
Regarding the ecological integrity of the macro-benthic community, there was no correlation between the biological indexes and the pH reduction when using the multivariate analysis. The results correlated the biological indexes with the metals contamination in the sediment and the dissolved Zn in seawater. Although no significant differences were found in the metals concentration in the sediment in both stations studied, other contaminants may have influenced in the results.
The WoE approach identified a source of contamination responsible for the pollution and for the adverse effects on marine organisms studied in this work. The results applying this technique showed that the pH value of 6.0 is significantly toxic to the exposed marine organisms and associated with both the increase of the proton concentration itself and direct toxicity to organisms (and, consequently, the increase of the mobility and bioavailability of metals driving pollution in the coastal zones).

Author Contributions

The contribution of the authors to the final version of the paper is summarized as follows: M.C.P. has provided conceptualization, methodology validation, formal analysis, writing, original draft preparation and investigation; E.B. has participated in the validation, writing-review, and editing; A.C. provided conceptualization, writing-original draft preparation, visualization. and supervision; T.Á.D. has leader the research from conceptualization and writing-review and editing to supervision and funding acquisition; and I.R. has provided inputs in all the items of the paper including conceptualization, methodology, software, validation, formal analysis, investigation, resources, data treatment and analysis, writing—original draft preparation, writing—review and editing, visualization, supervision, project administration, and funding acquisition. All authors have read and agreed to the published version of the manuscript.

Funding

This study was partially funded by FAPESP Grant #2018/18456-4.

Acknowledgments

The first author would like to thank the Erasmus Mundus Program for the doctoral fellowship (2014-0693/001-001-EMJD). A. Cesar would like to thank the Brazilian National Council for Scientific and Technological Development (CNPq) for the productivity fellowship (No PQ2 305417/2019-3) and thanks to FAPESP#2017/075353-7 for partial support. T.A. DelValls thanks the Brazilian National Council for Scientific and Technological Development (CNPq) for the productivity fellowship (No. 305734/2018-0). I. Riba, thanks her partial support for this study to the mobility grant (FAPESP#2017/25936-0) as Visiting Researcher Program at Universidade Federal de São Paulo. E. Bonnail thanks ANID/CONICYT (FONDECYT11180015).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Edenhofer, O.; Pichs-Madruga, R.; Sokona, Y.; Minx, J.C.; Farahani, E. Climate Change 2014: Mitigation of Climate Change; Intergovernmental Panel on Climate Change (IPCC): Geneva, Switzerland, 2014. [Google Scholar]
  2. National Oceanic and Atmospheric Administration (NOAA). Global Monitoring Laboratory. In Earth System Research Laboratories. Trends in Atmospheric Carbon Dioxide; 2021. Available online: https://gml.noaa.gov/ccgg/trends/weekly.html (accessed on 28 November 2021).
  3. United Nations Framework Convention on Climate Change (UNFCCC). Adoptions of the Paris Agreement. 2015. Available online: http://unfccc.int/files/essential_background/convention/application/pdf/english_paris_agreemen.pdf (accessed on 28 November 2021).
  4. International Energy Agency (IEA). Energy Technology Perspectives 2010: Scenarios & Strategies to 2050, Strategies; IEA: Paris, France, 2010. [Google Scholar]
  5. Blackford, J.; Bull, J.M.; Cevatoglu, M.; Connelly, D.; Hauton, C.; James, R.H.; Lichtschlag, A.; Stahl, H.; Widdicombe, S.; Wright, I.C. Marine baseline and monitoring strategies for carbon dioxide capture and storage (CCS). Int. J. Greenh. Gas Control 2015, 38, 221–229. [Google Scholar] [CrossRef] [Green Version]
  6. DelValls, T.Á.; Forja, J.M.; Gómez-Parra, A. Integrative assessment of sediment quality in two littoral ecosystems from the Gulf of Cadiz, Spain. Environ. Toxicol. Chem. 1998, 17, 1073–1084. [Google Scholar] [CrossRef]
  7. Rodríguez-Romero, A.; Jiménez-Tenorio, N.; Basallote, M.D.; Orte, M.R.D.; Blasco, J.; Riba, I. Predicting the impacts of CO2 leakage from sub-seabed storage: Effects of metal accumulation and toxicity on the model benthic organism Ruditapes philippinarum. Environ. Sci. Technol. 2014, 48, 12292–12301. [Google Scholar] [CrossRef]
  8. Rodriguez-Romero, A.; Jiménez-Tenorio, N.; Riba, I.; Blasco, J. Laboratory simulation system, using Carcinus maenas as the model organism, for assessing the impact of CO2 leakage from sub-seabed injection and storage. Environ. Res. 2016, 144, 117–129. [Google Scholar] [CrossRef] [PubMed]
  9. Szalaj, D.; De Orte, M.R.; Goulding, T.A.; Medeiros, I.D.; DelValls, T.A.; Cesar, A. The effects of ocean acidification and a carbon dioxide capture and storage leak on the early life stages of the marine mussel Perna perna (Linneaus, 1758) and metal bioavailability. Environ. Sci. Pollut. R 2017, 24, 765–781. [Google Scholar]
  10. Goulding, T.; De Orte, M.R.; Szalaj, D.; Basallote, M.D.; DelValls, T.A.; Cesar, A. Assessment of the environmental impacts of ocean acidification (OA) and Carbon Capture and Storage (CCS) leaks using the amphipod Hayle youngi. Ecotoxicology 2017, 6, 521–533. [Google Scholar] [CrossRef]
  11. De Orte, M.R.; Bonnail, E.; Sarmiento, A.M.; Bautista-Chamizo, E.; Basallote, M.D.; Riba, I. Metal fractionation in marine sediments acidified by enrichment of CO2: A risk assessment. Mar. Pollut. Bull. 2018, 131, 611–619. [Google Scholar] [CrossRef] [PubMed]
  12. Souza, L.S.; Bonnail, E.; Maranho, L.; Pusceddu, F.H.; Cortez, F.S.; Cesar, A.; Ribeiro, D.A.; Riba, I.; de Souza Abessa, D.M.; DelValls, Á.; et al. Sub-lethal combined effects of illicit drug and decreased pH on marine mussels: A short-time exposure to crack cocaine in CO2 enrichment scenarios. Mar. Pollut. Bull. 2021, 171, 112735. [Google Scholar] [CrossRef]
  13. DelValls, T.Á. Diseño y Aplicación de Modelos Integrados de Evaluación de la Contaminación y Sus Efectos Sobre los Sistemas Marinos y Litorales y la Salud Humana; Cent. para la Prevención y Lucha contra la Contam. Maritíma y Litoral; Serie Investigación Madrid; Ministerio de la Presidencia: Madrid, Spain, 2007. [Google Scholar]
  14. Cesar, A.; Choueri, R.B.; Riba, I.; Moralles-Caselles, C.; Pereira, C.D.S.; Santos, A.R.; Abessa, D.M.S.; DelValls, T.A. Comparative sediment quality assessment in different littoral ecosystems from Spain (Gulf of Cadiz) and Brazil (Santos and São Vicente estuarine system). Environ. Intern. 2007, 33, 429–435. [Google Scholar] [CrossRef] [PubMed]
  15. Choueri, R.B.; Cesar, D.M.S.; Torres, R.J.; Morais, R.D.; Riba, I.; Pereira, C.D.S.; Nascimento, M.R.L.; Mozeto, A.A.; DelValls, T.A. Development of site-specific sediment quality guidelines for North and South Atlantic littoral zones: Comparison against national and international sediment quality benchmarks. J. Hazard. Mat. 2009, 170, 320–331. [Google Scholar] [CrossRef] [PubMed]
  16. Torres, R.J.; Cesar, A.; Pastor, V.A.; Pereira, C.D.S.; Choueri, R.B.; Cortez, F.S.; Morais, R.D.; Abessa, D.M.S.; Nascimento, M.R.L.; Morais, C.R.; et al. A Critical Comparison of Different Approaches to Sediment- Quality Assessments in the Santos Estuarine System in Brazil. Arch. Environ. Cont. Toxicol. 2015, 68, 132–147. [Google Scholar] [CrossRef] [PubMed]
  17. Riba, I.; Casado-Martínez, C.; Forja, J.M.; DelValls, T.Á. Sediment quality in littoral regions of the Gulf of Cádiz: A triad approach to address the influence of mining activities. Environ. Pollut. 2004, 132, 341–353. [Google Scholar] [CrossRef] [PubMed]
  18. Riba, I.; Kalman, J.; Vale, C.; Blasco, J. Influence of sediment acidification on the bioaccumulation of metals in Ruditapes philippinarum. Environ. Sci. Pollut. R 2010, 17, 1519–1528. [Google Scholar]
  19. Basallote, M.D.; DelValls, T.Á.; Riba, I. Studying the effect of CO2-Induced acidification on sediment toxicity using acute amphipod toxicity test. Environ. Sci. Technol. 2014, 48, 8864–8872. [Google Scholar] [CrossRef] [PubMed]
  20. Basallote, M.; Rodríguez-Romero, A.; De Orte, M.R.; DelValls, A.; Riba, I. Evaluation of the threat of marine CO2 leakage-associated acidification on the toxicity of sediment metals to juvenile bivalves. Aq. Toxicol. 2015, 166, 63–71. [Google Scholar] [CrossRef]
  21. Passarelli, M.C.; Riba, I.; Cesar, A.; Serrano-Bernando, F.; DelValls, T.A. Assessing the influence of ocean acidification to marine amphipods: A comparative study. Sci. Total Environ. 2017, 595, 759–768. [Google Scholar] [CrossRef]
  22. Passarelli, M.C.; Cesar, A.; Riba, I.; DelValls, T.A. Comparative evaluation of sea-urchin larval stage sensitivity to ocean acidification. Chemosphere 2017, 184, 224–234. [Google Scholar] [CrossRef]
  23. Cesar, A.; Pereira, C.D.S.; Santos, A.R.; Abessa, D.M.S.; Fernández, N.; Choueri, R.B.; DelValls, T.A. Ecotoxicological assessment of sediments from the Santos and São Vicente estuarine system- Brazil. Braz. J. Oceanogr. 2006, 56, 55–63. [Google Scholar] [CrossRef]
  24. DelValls, T.A.; Souza, L.D.S.; De Seabra, A.A.; Bonnail, E.; Riba, I. Integrative assessment of sediment quality in acidification scenarios associated with carbón capture and storage operations. Environ. Rev. 2019, 27, 333–345. [Google Scholar] [CrossRef]
  25. Abessa, D.M.S.; Carr, R.S.; Sousa, E.C.P.M.; Rachid, B.R.; Zaroni, L.P.; Pinto, Y.A.; Gasparro, M.R.; Bícego, M.C.; Hortellani, M.A.; Sarkis, J.E.S.; et al. Integrative Ecotoxicological Assessment of a Complex Tropical Estuarine System. Hoffer, T.N., Ed.; Nova Science Publishers: New York, NY, USA, 2008; pp. 125–159. [Google Scholar]
  26. Cesar, A.; Lia, L.R.B.; Pereira, C.D.S.; Santos, A.R.; Cortez, F.S.; Choueri, R.B.; De Orte, M.R.; Rachid, B.R.F. Environmental assessment of dredged sediment in the major Latin American seaport (Santos, São Paulo—Brazil): An integrated approach. Sci. Total Environ. 2014, 497–498, 679–687. [Google Scholar] [CrossRef]
  27. Pereira, C.D.S.; Martin-Díaz, M.L.; Zanette, J.; Cesar, A.; Choueri, R.B.; Abessa, D.M.S.; Catharino, M.G.M.; Vasconcelos, M.B.A.; Bayne, A.C.D.; Sousa, E.C.P.M.; et al. Integrated biomarker responses as environmental status descriptors of coastal zone (São Paulo, Brazil). Ecotoxicol. Environ. Safe 2011, 74, 1257–1264. [Google Scholar] [CrossRef] [PubMed]
  28. Ecotoxicologia Aquática—Toxicidade Crônica de Curta Duração—Método de Ensaio Com Ouriço-do-Mar (Echinodermata: Echinoidea); Norma Brasileira; ABNT NBR 15350 de 08/2020; 2020. Available online: https://www.abntcatalogo.com.br/norma.aspx?Q=M01JRFMraml6a0lnWlN2OElPRUVvRXUyL2J5d3kwajViSEdxU0h0TmFCQT0= (accessed on 28 November 2021).
  29. Almagro-Pastor, V.; Conradi, M.; DelValls, T.A.; Riba, I. Alterations in the macrobenthic fauna from Guadarranque River (Southern Spain) associated with sediment–seawater acidification deriving from CO2 leakage. Mar. Pollut. Bull. 2015, 96, 65–75. [Google Scholar] [CrossRef] [PubMed]
  30. Chapman, P.M.; Wang, F.; Janssen, C.R.; Goulet, R.R.; Kamunde, C.N. Conducting ecological risk assessments of inorganic metals and metalloids: Current status. Hum. Ecol. Risk Assess. 2003, 9, 641–697. [Google Scholar] [CrossRef]
  31. Hawkins, D.G. No exit: Thinking about leakage from geologic carbon storage sites. Energy 2004, 29, 1571–1578. [Google Scholar] [CrossRef]
  32. SCCS Scottish Carbon Capture & Storage. 2017. Available online: http://www.sccs.org.uk/expertise/map.html (accessed on 28 November 2021).
  33. Cetesb. Qualidade das Águas Costeiras do Estado de São Paulo. Companhia Ambiental do Estado de São Paulo. 2017. Available online: https://cetesb.sp.gov.br/aguas-costeiras/wp-content/uploads/sites/2/2018/06/Relat%C3%B3rio-de-Qualidade-das-%C3%81guas-Costeiras-do-Estado-de-S%C3%A3o-Paulo-2017.pdf (accessed on 28 November 2021).
  34. Abessa, D.M.; Carr, R.S.; Rachid, B.R.; Sousa, E.C.; Hortelani, M.A.; Sarkis, J.E. Influence of a Brazilian sewage outfall on the toxicity and contamination of adjacent sediments. Mar. Pollut. Bull. 2005, 50, 875–885. [Google Scholar] [CrossRef] [PubMed]
  35. Buruaem, L.M.; Castro, I.B.; Hortellani, M.A.; Taniguchi, S.; Fillman, G.; Sasaki, S.T.; Petti, M.A.V.; Sarkis, J.E.S.; Bicego, M.C.; Maranho, L.A.; et al. Integrated quality assessment of sediments from harbor areas in Santos-São Vicente Estuarine System. Estuar. Coast. Shelf Sci. 2013, 130, 179–189. [Google Scholar] [CrossRef]
  36. CONAMA 454. Estabelece as Diretrizes Gerais e os Procedimentos Referenciais para o Gerenciamento do Material a ser Dragado em Águas sob Jurisdição Nacional; Conselho Nacional de Meio Ambiente (CONAMA): Brasília, DF, Brazil, 2012. [Google Scholar]
  37. Adams, W.J.; Kimerle, R.A.; Mosher, R.G. Aquatic safety assessment of chemicals sorbed to sediments. In Aquatic Toxicology and Hazard Assessment: 7th Symposium; Cardwell, R.D., Purdy, R., Bahner, R.C., Eds.; STP 854; American Society for Testing and Materials: Philadelphia, PA, USA, 1985; pp. 429–453. [Google Scholar]
  38. USEPA. Technical Basis for the Derivation of Equilibrium Partitioning Sediment Guidelines (ESG) for the Protection of Benthic Organisms: Nonionic Organics; EPA-822-R-00-001; USEPA: Washington, DC, USA, 2002. [Google Scholar]
  39. USEPA. Methods for Collection, Storage and Manipulation of Sediments for Chemical and Toxicological Analyses: Technical Manual; EPA 823-B-01-002; Environmental Protection Agency, Office of Water: Washington, DC, USA, 2001. [Google Scholar]
  40. Millero, F.J.; Woosley, R.; Ditrolio, B.; Waters, J. Effect of ocean acidification on the speciation of metals in seawater. Oceanography 2009, 22, 72–85. [Google Scholar] [CrossRef]
Figure 1. Location of sampling sites selected in the Bay of Santos (SP, Brazil): Piaçaguera channel (CPI) station (intermediate contaminated area) and Palma Island (PAI) station (no contaminated area).
Figure 1. Location of sampling sites selected in the Bay of Santos (SP, Brazil): Piaçaguera channel (CPI) station (intermediate contaminated area) and Palma Island (PAI) station (no contaminated area).
Applsci 11 11603 g001
Figure 2. Schematic design of the CO2 injection system for the different biological adverse effect lines of evidence selected: (i) to assess the effects of CO2 enrichment on the benthic integrity; (ii) design used with elutriate assays. At the first step was acidified the samples before mixed and then the supernatant fraction was used to analyze the larval development of sea urchin; and (iii) design used for acute toxicity tests with amphipods.
Figure 2. Schematic design of the CO2 injection system for the different biological adverse effect lines of evidence selected: (i) to assess the effects of CO2 enrichment on the benthic integrity; (ii) design used with elutriate assays. At the first step was acidified the samples before mixed and then the supernatant fraction was used to analyze the larval development of sea urchin; and (iii) design used for acute toxicity tests with amphipods.
Applsci 11 11603 g002
Figure 3. Schematic representation of the lines of evidence (LoEs) applied in the study to assess the environmental risks of CO2 enrichment in marine ecosystem: Contamination addresses the chemical concentration in sediments to answer two main questions, which contaminants and level of contamination? Sediment toxicity addresses the adverse biological effects under laboratory conditions and alteration on the macro-benthic community effects under in-situ conditions.
Figure 3. Schematic representation of the lines of evidence (LoEs) applied in the study to assess the environmental risks of CO2 enrichment in marine ecosystem: Contamination addresses the chemical concentration in sediments to answer two main questions, which contaminants and level of contamination? Sediment toxicity addresses the adverse biological effects under laboratory conditions and alteration on the macro-benthic community effects under in-situ conditions.
Applsci 11 11603 g003
Figure 4. Pie charts showing statistical differences among the pH levels using the different LOEs. (A) Representing PAI sediment samples and (B) representing CPI sediment samples. The segments shown in black were associated with significant difference (p < 0.05) compared to the control, gray segments were related based on differences using different p values (0.01 ≥ p > 0.05), white segments indicated results not significantly different to the reference case.
Figure 4. Pie charts showing statistical differences among the pH levels using the different LOEs. (A) Representing PAI sediment samples and (B) representing CPI sediment samples. The segments shown in black were associated with significant difference (p < 0.05) compared to the control, gray segments were related based on differences using different p values (0.01 ≥ p > 0.05), white segments indicated results not significantly different to the reference case.
Applsci 11 11603 g004
Figure 5. Estimated factor scores for each sediment sampling sites used in this study (PAI and CPI). The factor scores quantify the prevalence of every component for each sediment site in relation to the pH levels and are used to confirm the factor description (Table 4).
Figure 5. Estimated factor scores for each sediment sampling sites used in this study (PAI and CPI). The factor scores quantify the prevalence of every component for each sediment site in relation to the pH levels and are used to confirm the factor description (Table 4).
Applsci 11 11603 g005
Table 1. Summarized description of the toxicity test conditions and endpoints determined.
Table 1. Summarized description of the toxicity test conditions and endpoints determined.
OrganismspH RangeT (°C)DO (%)DurationEndpoint
H. youngi8.0–6.025 ± 1>8010 daysMortality
L. variegatus8.0–6.025 ± 1>8024 hPluteus stage
Macrobenthos8.0–6.025 ± 1>8021 daysBiological indexes
T, temperature; DO, dissolved oxygen saturation.
Table 2. Summarized results for chemical concentrations in sediment (mg kg−1 dry weight), overlying water and elutriate (µg L−1), acute and chronic toxicity tests (mortality of amphipods- Mort_A, and sea urchins -Inh_SU) and, ecological integrity exposed to the pH treatments (pH 8.0, 7.5, 7.0, 6.5, and 6.0) using the PAI and CPI sample sites. (-) Reflects concentrations below of detection limit of the equipment.
Table 2. Summarized results for chemical concentrations in sediment (mg kg−1 dry weight), overlying water and elutriate (µg L−1), acute and chronic toxicity tests (mortality of amphipods- Mort_A, and sea urchins -Inh_SU) and, ecological integrity exposed to the pH treatments (pH 8.0, 7.5, 7.0, 6.5, and 6.0) using the PAI and CPI sample sites. (-) Reflects concentrations below of detection limit of the equipment.
pH Values
PAICPI
8.07.57.06.56.08.07.57.06.56.0
Contamination
Cu elu3.02.84.83.05.72.551.41.12.5
Cu sw6.72.32.52.34.65.756.866.847
Cu sed7.27.27.17.27.31111.110.810.911
Cr elu0.80.80.83.122.81-1.661.472.51.53
Cr sw1.854.36.925.882.32.11.62.232.62.28
Cr sed27.627.427.727.927.430.930.931.130.830.9
Zn elu--34253240915460.438.8
Zn sw24232640353926485496
Zn sed123122126127125133134133137138
Ni elu--1.12-0.161.221.181.231.121.14
Ni sw--1.82.124.91.71.822.133.756.2
Ni sed13.713.713.613.713.85.925.965.965.945.95
As elu4075451001426565606095
As sw57---15058485964130
As sed3.163.143.153.173.162.832.832.852.892.85
Toxicity
Mort_A (%)1827243810020262247100
Inh_SU (%)17.2516707210061017100100
Macrobenthic
Diversity0.590.610.630.570.600.630.670.790.220.31
T. abundance545765.55421688820
Richness0.640.650.690.510.670.911.011.070.270.51
Table 3. Matrix results for the different pH treatment used and sediment samples, representing significant differences (p < 0.05) were found when compared to the reference case (PAI, pH 8.0). Responses are shown as either positive (+), negative (−) and (+/−) when the result was close to be positive but not showed significant difference.
Table 3. Matrix results for the different pH treatment used and sediment samples, representing significant differences (p < 0.05) were found when compared to the reference case (PAI, pH 8.0). Responses are shown as either positive (+), negative (−) and (+/−) when the result was close to be positive but not showed significant difference.
Site, pH TreatmentMetalsToxicityBenthic
SedimentMobilityAcuteChronic
PAI, pH 8.0
PAI, pH 7.5
PAI, pH 7.0±+
PAI, pH 6.5++
PAI, pH 6.0+++
CPI, pH 8.0+
CPI, pH 7.5±+
CPI, pH 7.0±+
CPI, pH 6.5++++
CPI, pH 6.0++++
Table 4. Sorted rotated factor of the original variables on the three principal factors. The loading >0.4 are highlighted in the table.
Table 4. Sorted rotated factor of the original variables on the three principal factors. The loading >0.4 are highlighted in the table.
VariablesComponents
#1#2#3
Variance43.3828.5610.80
Mobility of metals
As sw 0.82
Cr sw−0.65
Cu sw0.76
Ni sw 0.85
Zn sw0.540.480.54
As elu 0.88
Cr elu 0.62
Cu elu−0.450.37−0.57
Ni elu0.84
Zn elu0.74
Sediment metal concentration
As sed−0.99
Cr sed0.99
Cu sed0.99
Ni sed−0.99
Zn sed0.92
Toxicity
Larval Inhibition 0.720.60
Amphipod Mortality 0.96
Acidification (H+) 0.96
Ecological Integrity
Diversity −0.84
T. Abundance−0.88
Richness −0.87
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Passarelli, M.C.; Bonnail, E.; Cesar, A.; DelValls, T.Á.; Riba, I. Integrative Assessment of Sediments Affected by CO2 Enrichment: A Case Study in the Bay of Santos—SP, Brazil. Appl. Sci. 2021, 11, 11603. https://doi.org/10.3390/app112411603

AMA Style

Passarelli MC, Bonnail E, Cesar A, DelValls TÁ, Riba I. Integrative Assessment of Sediments Affected by CO2 Enrichment: A Case Study in the Bay of Santos—SP, Brazil. Applied Sciences. 2021; 11(24):11603. https://doi.org/10.3390/app112411603

Chicago/Turabian Style

Passarelli, Marina Cunha, Estefanía Bonnail, Augusto Cesar, T. Ángel DelValls, and Inmaculada Riba. 2021. "Integrative Assessment of Sediments Affected by CO2 Enrichment: A Case Study in the Bay of Santos—SP, Brazil" Applied Sciences 11, no. 24: 11603. https://doi.org/10.3390/app112411603

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop