ALBERT

Notes: This study evaluates airborne concentrations of common trihalomethane (THM) compounds in bathrooms during showering and bathing in homes supplied with chlorinated tap water. Three homes in an urban area were selected, each having three bedrooms, a full bath, and approximately 1,000 square feet of living area. THMs were concurrently measured in tap water and air in the shower/bath enclosure and the bathroom vanity area using Summa canisters. Chloroform (TCM), bromodichloromethane (BDCM), and chlorodibromomethane (CDBM) were quantified using U.S. Environmental Protection Agency (EPA) Method TO-14. Air samples were collected prior to, during, and after the water-use event for 16 shower and 7 bath events. Flow rate and temperature were measured, but not controlled. The increase in average airborne concentration (± standard error) during showers (expressed as μg/m3 in shower enclosure or bathroom air per μg/L in water) was 3.3 ± 0.4 for TCM, 1.8 ± 0.3 for BDCM, and 0.5 ± 0.1 for CDBM (n = 12), and during baths was 1.2 ± 0.4 for TCM, 0.59 ± 0.21 for BDCM, and 0.15 ± 0.05 for CDBM (n = 4). The relative contribution of each chemical to the airborne concentrations was consistent for all shower and bath events, with apparent release of TCM〉 CDBM. The results are therefore consistent with their relative concentration in tap water and their vapor pressures. When the shower findings for TCM are normalized for water concentration, flow rate, shower volume, and duration, the average exposure concentrations in these urban residences are about 30% lower than those reported by other investigators using EPA analytical methods. This difference is likely attributable primarily to greater air exchange rates in residential shower/bath stalls compared to more “airtight” laboratory shower chambers. This appears to be the first field study to thoroughly evaluate THM exposures from residential showers and baths, and can be used to validate previously published models of tap water volatile chemical transfer to indoor air.

Notes: This article explores public perceptions of, and attitudes toward, possible health risks from polluted coastal bathing waters in the United Kingdom. Cultural theory is applied in the present analysis, using a mixed methodology of quantitative analysis from interviews and qualitative interpretation of focus group discussions to provide insights into how different cultural solidarities view a number of issues. These include risks to health; attitudes toward regulation; public consultation and information provision; and trust, blame, and accountability applied to different stakeholders in the bathing-water-quality debate. The results show that individuals' standpoints can be represented on a number of dimensions, consistent with cultural theory, including perceptions of power and authority, beliefs in the efficacy of collective action, and acceptance or rejection of incremental change as opposed to radical solutions. The discussion focuses both on methodological and substantive issues related to the use of cultural theory as a research tool, and on policy recommendations arising from this research.

Notes: Social theories of risk suggest that a combination of scientific and cultural perspectives converge to influence risk perception. This article first surveys sociological perspectives suggesting that risks from modern technological development have become predominant concerns in the social consciousness. Particular attention is given to those theses describing how social elements work to create perception of risks in relation to new technologies. The themes that emerge from this survey are then related to comtemporary debates concerning biotechnology. Specific attention is given to recent controversies regarding genetically modified crops, and parallels are drawn between debates over nuclear power and biotechnology. A procedural ethic for public discourse and decision making over the diffusion of genetically modified foods is offered. Ethical and social theories are linked with the hope that by recognizing the social dimensions of debates over new technologies a broader framework for conducting risk analysis may emerge.

Notes: A risk assessment was performed to incorporate uncertainty in food processing conditions to develop a risk-based sterilization process design. The focus of this analysis was uncertainty associated with heterogeneous food products. Quartered button mushrooms were the chosen food product because it represents the most typical type. A model for sterilization of spherical particles was utilized, and each parameter's uncertainty was characterized for use under Monte Carlo simulation. Various particle distributions and fluid types were compared. The output of the model was the required sterilization time to achieve the target sterilization conditions with 95% probability. This value was then used to determine the mean fluid velocity for a given tube length. Finally, the output from the model was analyzed to determine the confidence in output based on uncertainty in the input parameters. The model was more sensitive to variation in particle size distribution than fluid type for power-law fluids. The 90% confidence interval included a holding time range of 1 min. With a 95% confidence level that only 8% of the data will be below the target sterilization conditions, a maximum of 9% of the data were expected to achieve double the target level. The results of such an analysis would be useful for management decisions concerning the design of aseptic food processing operations.

Notes: Multimedia fate and exposure models are widely used to regulate the release of toxic chemicals, to set cleanup standards for contaminated sites, and to evaluate emissions in life-cycle assessment. CalTOX, one of these models, is used to calculate the potential dose, an outcome that is combined with the toxicity of the chemical to determine the Human Toxicity Potential (HTP), used to aggregate and compare emissions. The comprehensive assessment of the uncertainty in the potential dose calculation in this article serves to provide the information necessary to evaluate the reliability of decisions based on the HTP. A framework for uncertainty analysis in multimedia risk assessment is proposed and evaluated with four types of uncertainty. Parameter uncertainty is assessed through Monte Carlo analysis. The variability in landscape parameters is assessed through a comparison of potential dose calculations for different regions in the United States. Decision rule uncertainty is explored through a comparison of the HTP values under open and closed system boundaries. Model uncertainty is evaluated through two case studies, one using alternative formulations for calculating the plant concentration and the other testing the steady state assumption for wet deposition. This investigation shows that steady state conditions for the removal of chemicals from the atmosphere are not appropriate and result in an underestimate of the potential dose for 25% of the 336 chemicals evaluated.

Notes: A dynamic risk model is developed to track the occurrence and evolution of a drinking-water–borne cryptosporidiosis outbreak. The model characterizes and integrates the various environmental, medical, institutional, and behavioral factors that determine outbreak development and outcome. These include contaminant delivery and detection, water treatment efficiency, the timing of interventions, and the choices that people make when confronted with a known or suspected risk. The model is used to evaluate the efficacy of alternative strategies for improving risk management during an outbreak, and to identify priorities for improvements in the public health system. Modeling results indicate that the greatest opportunity for curtailing a large outbreak is realized by minimizing delays in identifying and correcting a drinking-water problem. If these delays cannot be reduced, then the effectiveness of risk communication in preemptively reaching and persuading target populations to avoid exposure becomes important.

Notes: The theme of one of the plenary sessions held at the 1998 annual meeting of the Society for Risk Analysis, ‘Assessing and Managing Risks in a Democratic Society,’ was chosen to reflect the current debate about the best ways to integrate social, political, economic, and technical issues into fair risk management decisions. In the papers presented here, the three plenary speakers provide their perspectives on how environmental risk management decision making is—or should be—informed by democratic processes.John D. Graham Making Sense of RiskRobert F. Kennedy, Jr. Risk, Democracy, and the EnvironmentJason Shogren Markets to Master Health and Environmental RiskAudience Questions and Answers

Notes: It was postulated that shared values determine social trust in institutions and persons related to a technology: One has trust in people holding similar salient values. Furthermore, it was hypothesized that social trust has a positive influence on perceived benefits and a negative impact on perceived risks. Results of a survey of University of Zürich students indicated that the proposed causal model explained perception of pesticides, nuclear power, and artificial sweetener very well. When social trust was controlled, the relation between risks and benefits perceived diminished. Results indicate that social trust is a key predictive factor of the perceived risks and benefits of a technology, and provide support for the salient values similarity theory of social trust.

Notes: Application of Executive Order 12898 to risk assessment of highway or rail transport of hazardous materials has proven difficult; in general, the location and conditions affecting the propagation of a plume of hazardous material released in a potential accident are unknown. Therefore, analyses have only been possible in a geographically broad or approximate manner. The advent of geographic information systems and development of software enhancements at Sandia National Laboratories have made kilometer-by-kilometer analysis of populations tallied by U.S. Census blocks along entire routes practicable. Tabulations of total or racially/ethnically distinct populations close to a route, its alternatives, or the broader surrounding area, can then be compared and differences evaluated statistically. This article presents methods of comparing populations and their racial/ethnic compositions using simple tabulations, histograms, and chi-square tests for statistical significance of differences found. Two examples of these methods are presented: comparison of two routes and comparison of a route with its surroundings.

Notes: Cultural Theory distinguishes between myths of human and physical nature as two integrated aspects of four cultural biases: hierarchy, egalitarianism, individualism, and fatalism. These biases serve as individuals' key orientations toward, for example, risk perception, public policy, and political preference. Myths of human and physical nature draw upon different intellectual histories, and an epistemological merger between the two aspects is not unproblematic. A self-administered mail survey of organized environmentalists in Norway included the theory's graphical description of myths of physical nature and verbal descriptions of myths of human nature. The respondents understood the logic of the myths of physical nature well and did not have problems in ranking them, thereby disconfirming the theory's claim that any of the myths appear irrational from the perspective of any other. The empirical results show that respondents gave the highest priority to the hierarchical myth of physical nature and that they also endorsed the egalitarian myth of human nature. Although this outcome may appear irrational from a theoretical perspective, the authors argue that (Grid/group) Cultural Theory is best served by treating the myths of physical and human nature as logically independent of one another.

Notes: Risk assessment is an established methodology for environmental and public health issues. However, economists' core approach to both risk assessment and risk management, benefit-cost analysis, often fails to transparently evaluate variability in a way that is a trademark of quantitative risk assessment. Concurrently, environmental advocates are proposing new management criteria based on a vaguely framed “Precautionary Principle.” This manuscript demonstrates how risk assessment techniques for characterizing variability, benefit-cost analysis, and decision-making criteria under uncertainty and irreversibility can be combined. The result is a quantifiable, case-specific, and risk-dependent “precautionary” threshold for action compared to standard benefit-cost approaches. The Clean Air Act and the regulation of genetically modified corn provide applications.

Notes: Numerous governments have introduced regulations governing the use of mobile (cellular) telephones while driving. Despite significant research into the “objective” risks, there is relatively little research into risk perceptions either in relation to other in-car distractions or with respect to the factors underlying such perceptions. The current article reports on two studies addressing these issues. Study 1 (N= 199) found that whereas the use of hand-held sets is seen as one of the riskiest activities to perform while driving, the risks of using a hands-free kit are perceived to be relatively small. Study 2 (N= 1,320) found that nearly half of all drivers in the sample with a mobile phone reported having used it while driving and that, overall, the probability of having an accident was perceived to be less for oneself than for one's peers, indicating an optimistic bias. Two factors underpinned risk perceptions, “impact” including perceived severity and equitability, and “controllability” including immediacy, detectability, and probability. While higher “impact” scores were associated with increased preferences for restrictions on the use of hand-held mobiles while driving, the “controllability” scores moderated this relationship such that when perceived “controllability” was low, restriction preferences were high irrespective of perceived “impact.” However, when “controllability” was high, restriction preferences remained high when “impact” was high but were low when “impact” was low. Given the growing number of in-car technological innovations, it is suggested that regulators act strategically, rather than finding themselves developing a series of “hazard-specific” regulations, which may ultimately lack coherence.

Notes: The evaluation studies of the proposed repository for long-term storage of spent nuclear fuel and high-level nuclear waste at Yucca Mountain, Nevada, are underway. Fulfillment of the requirements for limiting dose to the public, which includes containment of the radioactive waste emplaced in the proposed repository and subsequent slow release of radionuclides from the Engineered Barrier System (EBS) into the geosphere, will rely on a robust waste container design, among other EBS components. Part of the evaluation process involves sensitivity studies aimed at elucidating which model parameters contribute most to the waste package and overlying drip shield degradation characteristics. The model parameters identified for this study include (1) general corrosion rate parameters and (2) stress corrosion cracking (SCC) parameters. Temperature dependence and parameter uncertainty are evaluated for the general corrosion rate model parameters while for the SCC model parameters, uncertainty treatment of stress intensity factor, crack initiation threshold, and manufacturing flaw orientations are evaluated. Based on these evaluations new uncertainty distributions are generated and recommended for future analyses. Also, early waste package failures due to improper heat treatment were added to the waste package degradation model. The results of these investigations indicate that the waste package failure profiles are governed by the manufacturing flaw orientation model parameters.

Notes: Because of the increase in workplace automation and the diversification of industrial processes, workplaces have become more and more complex. The classical approaches used to address workplace hazard concerns, such as checklists or sequence models, are, therefore, of limited use in such complex systems. Moreover, because of the multifaceted nature of workplaces, the use of single-oriented methods, such as AEA (man oriented), FMEA (system oriented), or HAZOP (process oriented), is not satisfactory. The use of a dynamic modeling approach in order to allow multiple-oriented analyses may constitute an alternative to overcome this limitation. The qualitative modeling aspects of the MORM (man-machine occupational risk modeling) model are discussed in this article. The model, realized on an object-oriented Petri net tool (CO-OPN), has been developed to simulate and analyze industrial processes in an OH&S perspective. The industrial process is modeled as a set of interconnected subnets (state spaces), which describe its constitutive machines. Process-related factors are introduced, in an explicit way, through machine interconnections and flow properties. While man-machine interactions are modeled as triggering events for the state spaces of the machines, the CREAM cognitive behavior model is used in order to establish the relevant triggering events. In the CO-OPN formalism, the model is expressed as a set of interconnected CO-OPN objects defined over data types expressing the measure attached to the flow of entities transiting through the machines. Constraints on the measures assigned to these entities are used to determine the state changes in each machine. Interconnecting machines implies the composition of such flow and consequently the interconnection of the measure constraints. This is reflected by the construction of constraint enrichment hierarchies, which can be used for simulation and analysis optimization in a clear mathematical framework. The use of Petri nets to perform multiple-oriented analysis opens perspectives in the field of industrial risk management. It may significantly reduce the duration of the assessment process. But, most of all, it opens perspectives in the field of risk comparisons and integrated risk management. Moreover, because of the generic nature of the model and tool used, the same concepts and patterns may be used to model a wide range of systems and application fields.

Notes: The bounding analysis methodology described by Ha-Duong et al. (this issue) is logically incomplete and invites serious misuse and misinterpretation, as their own example and interpretation illustrate. A key issue is the extent to which these problems are inherent in their methodology, and resolvable by a logically complete assessment (such as Monte Carlo or Bayesian risk assessment), as opposed to being general problems in any risk-assessment methodology. I here attempt to apportion the problems between those inherent in the proposed bounding analysis and those that are more general, such as reliance on questionable expert elicitations. I conclude that the specific methodology of Ha-Duong et al. suffers from logical gaps in the definition and construction of inputs, and hence should not be used in the form proposed. Furthermore, the labor required to do a sound bounding analysis is great enough so that one may as well skip that analysis and carry out a more logically complete probabilistic analysis, one that will better inform the consumer of the appropriate level uncertainty. If analysts insist on carrying out a bounding analysis in place of more thorough assessments, extensive analyses of sensitivity to inputs and assumptions will be essential to display uncertainties, arguably more essential than it would be in full probabilistic analyses.

Notes: This article describes a simple model for quantifying the health impacts of toxic metal emissions. In contrast to most traditional models it calculates the expectation value of the total damage (summed over the total population and over all time) for typical emission sites, rather than “worst-case” estimates for specific sites or episodes. Such a model is needed for the evaluation of many environmental policy measures, e.g., the optimal level of pollution taxes or emission limits. Based on the methodology that has been developed by USEPA for the assessment of multimedia pathways, the equations and parameters are assembled for the assessment of As, Cd, Cr, Hg, Ni, and Pb, and some typical results are presented (the dose from seafood is not included and for Hg the results are extremely uncertain); the model is freely available on the web. The structure of the model is very simple because, as we show, if the parameters can be approximated by time-independent constants (the case for the USEPA methodology), the total impacts can be calculated with steady-state models even though the environment is never in steady state. The collective ingestion dose is found to be roughly 2 orders of magnitude larger than the collective dose via inhalation. The uncertainties are large, easily an order of magnitude, the main uncertainties arising from the parameter values of the model, in particular the transfer factors. Using linearized dose-response functions, estimates are provided for cancers due to As, Cd, Cr, and Ni as well as IQ loss due to Pb emissions in Europe.

Notes: Recent qualitative analyses warn of potential future human health risks from emergence of antibiotic resistance in food-borne pathogens due to the use of similar antimicrobial drugs in both food animals and human medicine. While historical data suggest that human health risks from some animal antimicrobials, such as virginiamycin (VM), have remained low (McDonald et al., 2001), there is a widespread concern that “resistance epidemics” or endemics could arise in the future. How reassuring is the past about the future? This article applies quantitative risk assessment methods to help find out, using human health risks from VM and the nearly identical human antimicrobial quinupristin-dalfopristin (QD) as a case study. A dynamic simulation model is used to predict the risks of emerging resistance to human antimicrobials in human populations from given input assumptions. Bayesian Monte Carlo uncertainty analysis allows past data to constrain and inform selection of input parameter values, and thus to predict the possible future resistance patterns that are consistent with historical data. The results show that health risks from VM use in food animals are highly sensitive to the human prescription rate of QD. For realistic prescription rates, quantitative risks are less than 1 × 10−6 even for members of the most-threatened (ICU patient) population, while societal risks are 〈1 excess statistical death per year for the whole U.S. population. Such quantitative estimates complement more qualitative assessments that discuss the possibility of future “resistance epidemics” (or endemics) without quantifying their probabilities.

Notes: During the 21st century, environmental challenges are likely to intensify across the world and possibly lead to violent conflicts. Strategies for conflict avoidance will be incomplete unless they recognize, discuss, and mitigate regional environmental stress factors. Comparative risk assessment (CRA) is one of the most critical tools emerging to influence modern environmental policies and is increasingly used to create a common language to help reconcile competing interests in development and environmental disputes around the world. This article considers the environmental challenges facing the Middle East in light of their “transboundary” nature and proposes CRA as a framework for setting environmental priorities and reducing tensions in the region.

Notes: This article introduces a human error analysis or human reliability analysis methodology, AGAPE-ET (AGuidance And Procedure for Human Error Analysis for Emergency Tasks), for analyzing emergency tasks in nuclear power plants. The AGAPE-ET method is based on a simplified cognitive model and a set of performance-influencing factors (PIFs). At each cognitive function, error-causing factors (ECF) or error-likely situations have been identified considering the characteristics of the performance of each cognitive function and the influencing mechanism of the PIFs on the cognitive function. Then, a human error analysis procedure based on the error analysis factors is organized to cue or guide the analyst in conducting the human error analysis. The method can be characterized by the structured identification of weak points of the task required to be performed and by the efficient analysis process such that the analyst has only to carry out the analysis with the necessary cognitive functions. Through the application, AGAPE-ET showed its usefulness, which effectively identifies the vulnerabilities with respect to cognitive performance as well as task execution, and that helps the analyst directly draw specific error reduction measures through the analysis.

Notes: Decision problems depending on extrapolation promise to become increasingly important. The key problem is determining if the model being used for extrapolation is going to give reasonable results, or err in a dangerous manner. Ideally, as one proceeds from investigation to decision, some guidance should be present based on the goal as to which investigation will reduce the risk the most given the cost. In this report, a very simple version of the problem is formalized and examined. The result is, interestingly, that the best evidence in support of the favored model is a null result in the experiment most likely to raise doubt over that model. The theory is applied to a simple example drawn from accelerated testing.

Notes: Understanding of risk views in multiethnic societies and in a globalizing world may be enhanced by use of measures of ethnic identity and acculturation. Ethnic identity includes such attributes as positive attitudes about one's ethnic group and a sense of belonging to it, voluntary and frequent association with other ethnic group members, and ethnic practices (preferred music, food, language; attendance at ethnic festivities). Acculturation is absorption of the “host” society's cultural norms, beliefs, attitudes and behavior patterns by immigrants, or by other groups historically excluded from the larger society. Both generic and ethnicity-specific measures of these concepts are available in the literature. This Perspective reviews the literature on risk implications of these concepts, how the nature of these measures presents both opportunities and challenges to risk researchers, and the degree to which ethnic identity and acculturation may be correlated with sociodemographic factors. Conceptual and methodological suggestions are made for risk research using these concepts, and hypotheses are offered about what such research might find.

Notes: Previous research has reported strong consumer perception that genetically modified (GM) food crops may lead to adverse outcomes in a number of different areas. This is despite the widespread promulgation of the potential benefits and opportunities ascribed to the same technology by many scientists and other experts. A computer-based information gathering and evaluation task was completed by 198 adults to assess the extent to which their initial focus on the dangers or opportunities of genetic modification, or both, could be ascribed to the manner in which they gathered information on the topic (heuristically vs. systematically). Results did not confirm the hypothesis that initial focus (risks, benefits, or both) predicted ongoing information gathering and evaluation behavior. Moreover, also contrary to prediction, most participants primarily used systematic strategies when deriving their initial position, regardless of that opinion. Participants found it difficult to achieve a balanced perspective on GM food crop, even though balanced argument, as measured by order of story selection and time spent reading, was preferred as the source of information. Perceived importance is probably the most influential variable determining information gathering about issues or events to which a level of risk is attached.

Notes: A study (N= 198) was conducted to examine hypotheses derived from an emotion-based model of stigma responses to radiation sources. A model of stigma susceptibility is proposed in which affective reactions and cognitive worldviews activate predispositions to appraise and experience events in systematic ways that result in the generation of negative emotion, risk perceptions, and stigma responses. Results of structural equation modeling supported the hypotheses. Radiation sources that scored higher on a measure of stigma were included in the analyses (i.e., nuclear power plants, radioactive waste from nuclear power plants, radiation from nuclear weapons testing). Individual differences in negative reactivity and worldviews were associated with the strength of emotional appraisals that were associated, in turn, with negative emotion toward stigmatized radiation sources. As hypothesized, the model fit better with perceived risk as a function of negative emotion rather than vice versa. Finally, a measure of stigma was associated with negative emotion and, to a lesser extent, with risk perceptions. Risk communication about stigmatized objects may benefit from a more complete understanding of how affective and emotional reactions are constructed and the routes through which they affect responses and behaviors.

Notes: Decreasing acceptance of biotechnologies over time has been reported in Europe. Studies claim that attitudes are negative, even hostile, and that people are very worried about genetic engineering in food and medicine. However, such studies are mostly based on surveys and these have significant methodological problems, such as low response rates, which may indicate that only those with strong views respond, thus biasing the sample. Here an alternative method, involving “topic-blind” recruitment of participants and a behavioral measure (food tasting), was used. We show that in a topic-blind sample of 100 individuals, 93% willingly tasted and ate what they believed to be genetically modified (GM) food in an experimental setting, and 48% said they would buy GM food in the future, results that are surprising in the context of other reports about attitudes and intentions toward GM food. Purchasers and nonpurchasers differed in their attitudes toward GM food on key risk-related scales (particularly on a dread-not dread scale—a measure of integral affect—and an ethical-unethical scale). Despite these differences, however, and despite their negative attitude, most nonpurchasers (85.7%) still tasted the GM apple. Incidental affect (state stress and trait worry) was not found to influence risk-related judgments about GM food. Integral affect (dread of GM plants and animals used for food) and concerns about the future risks of GM animals in food were found to be key predictors of willingness to purchase GM food.

Notes: A joint workshop was convened by the Society for Risk Analysis Ecological Risk Assessment Specialty Group and the Ecological Society of America Theoretical Ecology Section to provide independent scientific input into the formulation of methods and processes for risk assessment of invasive species. In breakout sessions on (1) the effects of invasive species on human health, (2) effects on plants and animals, (3) risk analysis issues and research needs related to entry and establishment of invasive species, and (4) risk analysis issues and research needs related to the spread and impacts of invasive species, workshop participants discussed an overall approach to risk assessment for invasive species. Workshop participants agreed on the need for empirical research on areas in which data are lacking, including potential invasive species, native species and habitats that may be impacted by invasive species, important biological processes and phenomena such as dispersal, and pathways of entry and spread for invasive species. Participants agreed that theoretical ecology can inform the process of risk assessment for invasive species by providing guidelines and conceptual models, and can contribute to improved decision making by providing a firm biological basis for risk assessments.

Notes: A new computer system is being developed to classify U.S. air travelers by the degree of terrorist threat they might pose. Reports indicate that the system—called CAPPS II—would use large amounts of information about each passenger, perhaps including such personal details as his or her magazine-subscription behavior. We argue that what is publicly known about CAPPS II raises questions about how substantially the system would improve aviation security. We discuss conditions under which CAPPS II could yield safety benefits, but suggest that it might be more prudent to view the system as one component of future security arrangements rather than the centerpiece of these arrangements.

Notes: Decisions about management of invasive species are difficult for all the reasons typically addressed by multiattribute decision analysis: uncertain outcomes, multiple and conflicting objectives, and many interested parties with differing views on both facts and values. This article illustrates how the tools of multiattribute analysis can improve management of invasive species, with an emphasis on making explicit the social values and preferences that must inform invasive species management. Risk assessment protocols developed previously for invasive species management typically suffer from two interacting flaws: (1) separating risk assessment from risk management, thus disrupting essential connections between the social values at stake in invasive species decisions and the scientific knowledge necessary to predict the likely impacts of management actions, and (2) relying on expert judgment about risk framed in qualitative and value-laden terms, inadvertently mixing the expert's judgment about what is likely to happen with personal preferences. Using the values structuring and probability-modeling elements of formal decision analysis can remedy these difficulties and make invasive species management responsive to both good science and public values. The management of feral pigs in Hawaiian ecosystems illustrates the need for such an integrated approach.

Notes: Exotic pests are serious threats to North American ecosystems; thus, economic analysis of decisions about eradication, stopping, or slowing their spread may be critical to ecosystem management. The proposed bioeconomic model assumes that the rate of population expansion can be reduced (even to negative values in a case of eradication) if certain management actions are taken along the population front. The area of management can be viewed as a dynamic barrier zone that moves together with the population front. The lower is the target rate of spread, the higher would be both benefits and costs of the project. The problem is to find the optimal target rate of spread at which the present value of net benefits from managing population spread reaches its maximum value. If a population spreads along an infinite habitat strip, the target rate of spread is optimal if the slope of the cost function versus the rate of spread is equal to the ratio of the average pest-related damage per unit time and unit area to the discount rate. In a more complex model where the potential area of expansion is limited, two local maxima of net benefits may exist: one for eradication and another for slowing the spread. If both maxima are present, their heights are compared and the strategy that corresponds to a higher value of net benefits is selected. The optimal strategy changes from eradication to slowing the spread and finally to doing nothing as the area occupied by the species increases. The model shows that slowing the spread of pest species generates economic benefits even if a relatively small area remains uninfested. The cost of slowing the spread can be estimated from a model of population expansion via establishment of isolated colonies beyond the moving front. The model is applied to managing the spread of the gypsy moth (Lymantria dispar) populations in the United States.

Notes: Risk related to economic values is treated by many disciplines, including safety and production engineering, business, and project management. Within each of these and across these disciplines different nomenclature and principles are adopted for describing and communicating risk. The situation is rather confusing. In this article, we review various approaches and concepts that are used to express risk. We present and discuss a unifying approach for dealing with economic risk, with uncertainty being the key risk concept. The approach represents a rethinking on how to implement the Bayesian paradigm in practice to support decision making.

Notes: Many environmental data sets, such as for air toxic emission factors, contain several values reported only as below detection limit. Such data sets are referred to as “censored.” Typical approaches to dealing with the censored data sets include replacing censored values with arbitrary values of zero, one-half of the detection limit, or the detection limit. Here, an approach to quantification of the variability and uncertainty of censored data sets is demonstrated. Empirical bootstrap simulation is used to simulate censored bootstrap samples from the original data. Maximum likelihood estimation (MLE) is used to fit parametric probability distributions to each bootstrap sample, thereby specifying alternative estimates of the unknown population distribution of the censored data sets. Sampling distributions for uncertainty in statistics such as the mean, median, and percentile are calculated. The robustness of the method was tested by application to different degrees of censoring, sample sizes, coefficients of variation, and numbers of detection limits. Lognormal, gamma, and Weibull distributions were evaluated. The reliability of using this method to estimate the mean is evaluated by averaging the best estimated means of 20 cases for small sample size of 20. The confidence intervals for distribution percentiles estimated with bootstrap/MLE method compared favorably to results obtained with the nonparametric Kaplan–Meier method. The bootstrap/MLE method is illustrated via an application to an empirical air toxic emission factor data set.

Notes: The maritime industry is moving toward a “goal-setting” risk-based regime. This opens the way to safety engineers to explore and exploit flexible and advanced risk modeling and decision-making approaches in the design and operation processes. In this article, following a brief review of the current status of maritime risk assessment, a design/operation selection framework and a design/operation optimization framework are outlined. A general discussion of control engineering techniques and their application to risk modeling and decision making is given. Four novel risk modeling and decision-making approaches are then outlined with illustrative examples to demonstrate their use. Such approaches may be used as alternatives to facilitate risk modeling and decision making in situations where conventional techniques cannot be appropriately applied. Finally, recommendations on further exploitation of advances in general engineering and technology are suggested with respect to risk modeling and decision making.

Notes: General patterns of bias in risk beliefs are well established in the literature, but much less is known about how these biases vary across the population. Using a sample of almost 500 people, the regression analysis in this article yields results consistent with the well-established pattern that small risks are overassessed and large risks are underassessed. The accuracy of these risk beliefs varies across demographic factors, as does the switch point at which people go from underassessment to overassessment, which we found to be 1,500 deaths annually for the full sample. Better educated people have more accurate risk beliefs, and there are important differences in the risk perception by race and gender that also may be of policy interest.

Notes: Genetically modified (GM) crops have met with widespread approval among scientists and policy makers in the United States, but public approval of GM crops, both domestically and abroad, is progressing much more slowly. An underlying cause of public wariness may be that both nations and individual consumers do not perceive significant benefits to themselves from GM crops, while fearing the risks they may incur. In this study, an economic analysis is conducted to determine whether the benefits of one type of GM corn, Bt corn (genetically modified to resist damage from the ECB and Southwestern corn borer), outweigh the potential risks; and who the “winners” and “losers” are among stakeholder groups that may be affected by Bt corn. It is found that Bt corn growers, consumers, and industry all benefit from Bt corn adoption, though the purported health and environmental benefits of reducing chemical pesticide usage through Bt corn are negligible. Though the aggregated public benefit is large, the welfare gain to individual consumers is small and may not make up for perceived risks. While environmental and health risks of Bt corn are unlikely, the potential market risks—impacting both the organic corn market and total U.S. corn exports—are found to be significant. Currently, distributional analysis is not a part of regulatory decision making of Bt corn in the United States; yet it may help to explain why decision makers at both the government and individual-consumer levels have failed to embrace Bt corn and other GM crops.

Notes: One measure of the potency of compounds that lead to the effects through ligand-dependent gene transcription is the relative affinity for the critical receptor. Endocrine active compounds that are presumed to act principally through binding to the estrogen receptor (e.g., estradiol, genistein, bisphenol A, and octylphenol) comprise one class of such compounds. For making simple comparisons, receptor-binding affinity has been equated to in vivo potency, which consequently defines the dose-response characteristics for the compound. Direct extrapolation of in vitro estimated affinities to the corresponding in vivo system and to specific species or life stages (e.g., neonatal, pregnancy) can be misleading. Accurate comparison of the potency of endocrine active compounds requires characterization of biochemical and pharmacokinetic factors that affect their free concentration. Quantitative in vitro and in vivo models were developed for integrating pharmacokinetics factors (e.g., serum protein and receptor-binding affinities, clearance) that affect potency. Data for parameterizing these models for several estrogenic compounds were evaluated and the models exercised. While simulations of adult human or rat sera were generally successful, difficulties in describing early life stages were identified. Exogenous compounds were predicted to be largely ineffective at competing estradiol off serum-binding proteins, suggesting this was unlikely to be physiologically significant. Discrepancies were identified between relative potencies based upon modeling in vitro receptor-binding activity versus in vivo activity in the presence of clearance and serum-binding proteins. The examples illustrate the utility of this approach for integrating available experimental data from in vitro and in vivo studies to estimate the relative potency of these compounds.

Notes: The development of engineered containment and control systems for contaminated sites must consider the environmental setting of each site. The behaviors of both contaminated materials and engineered systems are affected by environmental conditions that will continue to evolve over time as a result of such natural processes as climate change, ecological succession, pedogenesis, and landform changes. Understanding these processes is crucial to designing, implementing, and maintaining effective systems for sustained health and environmental protection. Traditional engineered systems such as landfill liners and caps are designed to resist natural processes rather than working with them. These systems cannot be expected to provide long-term isolation without continued maintenance. In some cases, full-scale replacement and remediation may be required within 50 years, at an effort and cost much higher than for the original cleanup. Approaches are being developed to define smarter containment and control systems for stewardship sites, considering lessons learned from implementing prescriptive waste disposal regulations enacted since the 1970s. These approaches more effectively involve integrating natural and engineered systems; enhancing sensors and predictive tools for evaluating performance; and incorporating information on failure events, including precursors and consequences, into system design and maintenance. An important feature is using natural analogs to predict environmental conditions and system responses over the long term, to accommodate environmental change in the design process, and, as possible, to engineer containment systems that mimic favorable natural systems. The key emphasis is harmony with the environment, so systems will work with and rely on natural processes rather than resisting them. Implementing these new integrated systems will reduce current requirements for active management, which are resource-intensive and expensive.

Notes: Modern theories in cognitive psychology and neuroscience indicate that there are two fundamental ways in which human beings comprehend risk. The “analytic system” uses algorithms and normative rules, such as probability calculus, formal logic, and risk assessment. It is relatively slow, effortful, and requires conscious control. The “experiential system” is intuitive, fast, mostly automatic, and not very accessible to conscious awareness. The experiential system enabled human beings to survive during their long period of evolution and remains today the most natural and most common way to respond to risk. It relies on images and associations, linked by experience to emotion and affect (a feeling that something is good or bad). This system represents risk as a feeling that tells us whether it is safe to walk down this dark street or drink this strange-smelling water. Proponents of formal risk analysis tend to view affective responses to risk as irrational. Current wisdom disputes this view. The rational and the experiential systems operate in parallel and each seems to depend on the other for guidance. Studies have demonstrated that analytic reasoning cannot be effective unless it is guided by emotion and affect. Rational decision making requires proper integration of both modes of thought. Both systems have their advantages, biases, and limitations. Now that we are beginning to understand the complex interplay between emotion and reason that is essential to rational behavior, the challenge before us is to think creatively about what this means for managing risk. On the one hand, how do we apply reason to temper the strong emotions engendered by some risk events? On the other hand, how do we infuse needed “doses of feeling” into circumstances where lack of experience may otherwise leave us too “coldly rational”? This article addresses these important questions.

Notes: This article estimates the risk of tuberculosis (TB) transmission on a typical commercial airliner using a simple one box model (OBM) and a sequential box model (SBM). We used input data derived from an actual TB exposure on an airliner, and we assumed a hypothetical scenario that a highly infectious TB source case (i.e., 108 infectious quanta per hour) travels as a passenger on an 8.7-hour flight. We estimate an average risk of TB transmission on the order of 1 chance in 1,000 for all passengers using the OBM. Applying the more realistic SBM, we show that the risk and incidence decrease sharply in a stepwise fashion in cabins downstream from the cabin containing the source case assuming some potential for airflow from more contaminated to less contaminated cabins. We further characterized spatial variability in the risk within the cabin by modeling a previously reported TB outbreak in an airplane to demonstrate that the TB cases occur most likely within close proximity of the source TB patient.

Notes: In 1996, an outbreak of E. coli O157:H7-associated illness occurred in an elementary school in Japan. This outbreak has been studied in unusual detail, making this an important case for quantitative risk assessment. The availability of stored samples of the contaminated food allowed reliable estimation of exposure to the pathogens. Collection of fecal samples allowed assessment of the numbers infected, including asymptomatic cases. Comparison to other published dose-response studies for E. coli O157:H7 show that the strain that caused the outbreak studied here must have been considerably more infectious. We use this well-documented incident as an example to demonstrate how such information on the response to a single dose can be used for dose-response assessment. In particular, we demonstrate how the high infectivity limits the uncertainty in the low-dose region.

Notes: In November 2001, the University of Michigan hosted one of the first dialogues among international trade law scholars and scientists in the field of risk assessment with the goal of identifying critical areas of misunderstanding between the two fields. This article discusses key issues that need to be addressed in order to better harmonize the scientific and legal systems of evidence within the context of trade disputes and trade law and presents the recommendations that emerged from the Michigan meeting.

Notes: This article considers the role of scientific rationality in understanding statements of risk produced by a scientific community. An argument is advanced that, while scientific rationality does impose constraints on valid scientific justifications for restrictions on products and practices, it also provides flexibility in the judgments needed to both develop and apply characterizations of risk. The implications of this flexibility for the understanding of risk estimates in WTO and NAFTA deliberations are explored, with the goal of finding an intermediate ground between the view that science unambiguously justifies or rejects a policy, and the view that science is yet another cultural tool that can be manipulated in support of any decision. The result is a proposal for a dialogical view of scientific rationality in which risk estimates are depicted as confidence distributions that follow from a structured dialogue of scientific panels focused on judgments of evidence, evidential reasoning, and epistemic analysis.

Notes: Risk analysis has been recognized and validated in World Trade Organization (WTO) decision processes. In recent years the precautionary principle has been proposed as an additional or alternative approach to standard risk assessment. The precautionary principle has also been advocated by some who see it as part of postmodern democracy in which more power is given to the public on health and safety matters relative to the judgments of technocrats. A more cynical view is that the precautionary principle is particularly championed by the European Community as a means to erect trade barriers. The WTO ruling against the European Community's trade barrier against beef from hormone-treated cattle seemed to support the use of risk assessment and appeared to reject the argument that the precautionary principle was a legitimate basis for trade barriers. However, a more recent WTO decision on asbestos contains language suggesting that the precautionary principle, in the form of taking into account public perception, may be acceptable as a basis for a trade barrier. This decision, if followed in future WTO trade disputes, such as for genetically modified foods, raises many issues central to the field of risk analysis. It is too early to tell whether the precautionary principle will become accepted in WTO decisions, either as a supplement or a substitute for standard risk assessment. But it would undermine the value of the precautionary principle if this principle were misused to justify unwarranted trade barriers.

Notes: Based on the data from the integrated Danish Salmonella surveillance in 1999, we developed a mathematical model for quantifying the contribution of each of the major animal-food sources to human salmonellosis. The model was set up to calculate the number of domestic and sporadic cases caused by different Salmonella sero and phage types as a function of the prevalence of these Salmonella types in the animal-food sources and the amount of food source consumed. A multiparameter prior accounting for the presumed but unknown differences between serotypes and food sources with respect to causing human salmonellosis was also included. The joint posterior distribution was estimated by fitting the model to the reported number of domestic and sporadic cases per Salmonella type in a Bayesian framework using Markov Chain Monte Carlo simulation. The number of domestic and sporadic cases was obtained by subtracting the estimated number of travel- and outbreak-associated cases from the total number of reported cases, i.e., the observed data. The most important food sources were found to be table eggs and domestically produced pork comprising 47.1% (95% credibility interval, CI: 43.3–50.8%) and 9% (95% CI: 7.8–10.4%) of the cases, respectively. Taken together, imported foods were estimated to account for 11.8% (95% CI: 5.0–19.0%) of the cases. Other food sources considered had only a minor impact, whereas 25% of the cases could not be associated with any source. This approach of quantifying the contribution of the various sources to human salmonellosis has proved to be a valuable tool in risk management in Denmark and provides an example of how to integrate quantitative risk assessment and zoonotic disease surveillance.

Notes: Monte Carlo simulation has become the accepted method for propagating parameter uncertainty through risk models. It is widely appreciated, however, that correlations between input variables must be taken into account if models are to deliver correct assessments of uncertainty in risk. Various two-stage methods have been proposed that first estimate a correlation structure and then generate Monte Carlo simulations, which incorporate this structure while leaving marginal distributions of parameters unchanged. Here we propose a one-stage alternative, in which the correlation structure is estimated from the data directly by Bayesian Markov Chain Monte Carlo methods. Samples from the posterior distribution of the outputs then correctly reflect the correlation between parameters, given the data and the model. Besides its computational simplicity, this approach utilizes the available evidence from a wide variety of structures, including incomplete data and correlated and uncorrelated repeat observations. The major advantage of a Bayesian approach is that, rather than assuming the correlation structure is fixed and known, it captures the joint uncertainty induced by the data in all parameters, including variances and covariances, and correctly propagates this through the decision or risk model. These features are illustrated with examples on emissions of dioxin congeners from solid waste incinerators.

Notes: Precautionary behavior serves a valuable protective purpose as a first response to the new. It causes a quick retreat to the safety of the familiar; it provides time for a realistic “friend or foe” assessment of a new event. This rational assessment is often delayed by the sluggishness of government bureaucratic processes, or stopped by an implied challenge to a status quo. At the public level, reassurance may be slow to overcome an early uncertainty. However, a precautionary response does not provide an operational governing principle, although it makes publicly plausible an indefinite concealment of de facto political actions, or nonaction. The alternative of rational decision making at the policy level should flow from a comparative benefit/cost/risk analysis. Such early risk analyses have pragmatic uncertainties based on the limited available knowledge base and, accordingly, require judgmental application.

Notes: The joint persistence (JP) quantifies the environmental persistence of a parent compound and a selection of relevant transformation products. Here, the importance as well as the uncertainty of the JP in comparison to the persistence of the parent compound alone (primary persistence, PP) are investigated. To demonstrate the effect of transformation products on the environmental persistence of organic chemicals, three case studies of parent compounds (nonylphenol ethoxylates, perchloroethylene, atrazine) and transformation products are investigated in detail with a multimedia fate model. Comparison of the PP and JP values shows that transformation products can significantly increase the persistence. In addition to the point estimates of PP and JP, the associated uncertainties are investigated. For each of the case studies, the chemical-specific input parameters of all compounds are varied and the corresponding variance of the PP and JP is determined by Monte Carlo simulations. Interestingly, the higher number of input parameters required for the JP does not necessarily increase the uncertainty of the JP as compared to that of the PP alone. An exact mathematical expression specifying the contribution of each transformation product to the JP is given. When transformation products are grouped in different generations, it becomes discernible that the first generation increases the JP most; the later generations are of decreasing importance. Finally, the effect of incomplete knowledge of the transformation products and their properties on the JP results is discussed. For reliable JP estimates, knowledge of the first generation transformation products and their degradation rate constants is required.

Notes: Physicians are increasingly asked to use cost-effectiveness information when evaluating alternative health care interventions. Little is known about how the way such information is presented can influence medical decision making. We presented physicians with hypothetical screening scenarios with multiple options, varying the type of cost-effectiveness ratios provided as well as whether the scenarios described cancer screening settings that were familiar or unfamiliar. Half the scenarios used average cost-effectiveness ratios, as commonly reported, calculating benefits and costs relative to a no-screening option. The other half used the preferred incremental cost-effectiveness ratios, with each option's benefits and costs calculated relative to the next best alternative. Relative to average cost-effectiveness ratios, incremental cost-effectiveness information significantly reduced preference for the most expensive screening strategies in two of three unfamiliar scenarios. No such difference was found for familiar scenarios, for which physicians likely have established practice patterns. These results suggest that, in unfamiliar settings, average cost-effectiveness ratios as reported in many analyses reported in the literature can hide the often high price for achieving incremental health care goals, potentially causing physicians to choose interventions with poor cost effectiveness.

Notes: In earlier work we assembled a database of classical pharmacokinetic parameters (e.g., elimination half-lives; volumes of distribution) in children and adults. These data were then analyzed to define mean differences between adults and children of various age groups. In this article, we first analyze the variability in half-life observations where individual data exist. The major findings are as follows. The age groups defined in the earlier analysis of arithmetic mean data (0–1 week premature; 0–1 week full term; 1 week to 2 months; 2–6 months; 6 months to 2 years; 2–12 years; and 12–18 years) are reasonable for depicting child/adult pharmacokinetic differences, but data for some of the earliest age groups are highly variable. The fraction of individual children's half-lives observed to exceed the adult mean half-life by more than the 3.2-fold uncertainty factor commonly attributed to interindividual pharmacokinetic variability is 27% (16/59) for the 0–1 week age group, and 19% (5/26) in the 1 week to 2 month age group, compared to 0/87 for all the other age groups combined between 2 months and 18 years. Children within specific age groups appear to differ from adults with respect to the amount of variability and the form of the distribution of half-lives across the population. The data indicate departure from simple unimodal distributions, particularly in the 1 week to 2 month age group, suggesting that key developmental steps affecting drug removal tend to occur in that period. Finally, in preparation for age-dependent physiologically-based pharmacokinetic modeling, nationally representative NHANES III data are analyzed for distributions of body size and fat content. The data from about age 3 to age 10 reveal important departures from simple unimodal distributional forms—in the direction suggesting a subpopulation of children that are markedly heavier than those in the major mode. For risk assessment modeling, this means that analysts will need to consider “mixed” distributions (e.g., two or more normal or log-normal modes) in which the proportions of children falling within the major versus high-weight/fat modes in the mixture changes as a function of age. Biologically, the most natural interpretation of this is that these subpopulations represent children who have or have not to yet received particular signals for change in growth pattern. These apparently distinct subpopulations would be expected to exhibit different disposition of xenobiotics, particularly those that are highly lipophilic and poorly metabolized.

Notes: Three topics are addressed: (1) measurement issues (e.g., the reliability and validity of neurobehavioral test scores), (2) general principles of assessment, including test selection, and (3) interpretation of scores. Psychological tests generally perform as well as medical tests in terms of reliability and validity. Test manuals, assessment textbooks, and psychologists are useful resources to the risk assessor. The variety of different tests employed in neurobehavioral studies complicates interstudy comparisons. In addition, tests that ostensibly assess the same general domain of function might assess somewhat different abilities within that domain. Although a uniform battery for use in all studies seems desirable, the battery appropriate for a specific study depends on study goals, knowledge about the mechanism(s) of neurotoxicity, nature of the study population, and pattern of exposure. Exposure-related neurobehavioral deficits are generally indicators of “altered function” rather than of “clinical disease.” Limiting concern to end points corresponding to clinical disease might not be appropriate. Many neurobehavioral diagnoses are phenomenological and a neurotoxicant might cause a unique pattern of deficits for which no label has been created. The concern that a small shift in the central tendency of a distribution of test scores has no significance for the individual should be reexamined in light of the prevention paradox, formulated on the basis of epidemiologic studies of chronic disease. Poor performance on a neurobehavioral test does not necessarily map clearly onto underlying behavioral or neural substrate. The absence of such linkages, given current knowledge about brain-behavior relationships, should not reduce confidence in neurobehavioral end points. Use of neurobehavioral test scores involves considerations that differ little from those that the risk assessor routinely addresses in using end points commonly used in research on other topics in environmental epidemiology.

Notes: Public perceptions and political debates regarding the risks and benefits of agricultural biotechnology are well documented in industrialized countries. Yet, hardly any surveys have been conducted in developing countries. The following study aims to contribute to a better understanding of stakeholder attitudes toward agricultural biotechnology in developing countries. For this purpose, stakeholder representatives in the public debates in Mexico and the Philippines were asked to complete two nearly identical questionnaires on the risks and benefits of agricultural biotechnology. A comparison of stakeholder attitudes in the Philippines and Mexico is interesting because it shows how the different political systems, cultural and ecological backgrounds, and the regional context of food and agriculture influence perceptions. In general, the results of the surveys indicate that the participants in both countries consider genetic engineering to be an important tool to address agricultural, nutritional, and environmental problems, and they do not regard transgenic foods as risky for consumers. However, they are concerned about the potential impact of such transgenic crops on their countries' rich biological diversity and do not believe that national biosafety guidelines will be implemented properly. Although the surveys show that stakeholder attitudes in the Philippines and Mexico are quite similar, they also highlight significant differences in perception often related to cultural and political aspects.

Notes: Dermal absorption experiments form an important component in the assessment of risk from exposure to pesticides and other substances. Much dermal absorption data is gathered in rat experiments carried out using a certain standard protocol. Uncertainties in these data arise from many sources and can be quite large. For example, measurements of the systemic absorption of hexaconazole differed by more than an order of magnitude within a single experiment. Two diniconazole studies produced quite different results, due to minor differences in protocol and in chemical formulation. Limits of detection can also prevent accurate measurement when the amounts absorbed are small. These examples illustrate the need for measuring and reporting uncertainties in estimates that are based on these data. The most direct way to estimate uncertainty is to compute the sample standard deviations of replicate measurements. By pooling these estimates across dose and duration groups for which they are similar, the number of degrees of freedom is increased, and more precise confidence intervals can be obtained. In particular, the ratio of upper to lower 95% confidence limits was reduced by as much as ten-fold for hexaconazole, seven-fold for uniconazole, and nearly four-fold for propiconazole.

Notes: Recent advances in risk assessment have led to the development of joint dose-response models to describe prenatal death and fetal malformation rates in developmental toxicity experiments. These models can be used to estimate the effective dose corresponding to a 5% excess risk for both these toxicological endpoints, as well as for overall toxicity. In this article, we develop optimal experimental designs for the estimation of the effective dose for developmental toxicity using joint Weibull dose-response models for prenatal death and fetal malformation. Based on an extended series of developmental studies, near-optimal designs for prenatal death, malformation, and overall toxicity were found to involve three dose groups: an unexposed control group, a high dose equal to the maximum tolerated dose, and a low dose above or comparable to the effective dose. The effect on the optimal designs of changing the number of implants and the degree of intra-litter correlation is also investigated. Although the optimal design has only three dose groups in most cases, practical considerations involving model lack of fit and estimation of the shape of the dose-response curve suggest that, in practice, suboptimal designs with more than three doses will often be preferred.

Notes: Life cycle impact assessment (LCIA) and comparative risk assessment (RA) use the same building blocks for analyzing fate and potential effects of toxic substances. It is tacitly assumed that emission-effect calculations can give uniform and decisive answers in debates on toxicity problems. For several decades, mainstream policy sciences have taken a different starting point when analyzing decision making on complex, controversial societal issues. Such controversies in essence are thought to be caused by the fact that different actor coalitions adhere to a different, but in scientific terms equally reasonable, conceptualization or “framing” of the problem. A historical, argumentative analysis of the Dutch chlorine debate and the Swedish PVC debate shows that this is also true in the discussions on toxic substances. Three frames have been identified, which were coined the “risk assessment frame,”“the strict control frame,” and the “precautionary frame.” These frames tacitly disagree about the extent of knowledge/ignorance about the impacts of substances, the robustness/fallibility of emission-reduction schemes, and the robustness/vulnerability of nature. The latter frame, adhered to by environmentalists, seeks to judge substances mainly on their inherent safety. Under the current institutional arrangements and practices, RA and LCIA are executed mainly in line with the philosophy expressed by the risk assessment frame. This article gives various suggestions for dealing with framing in debates on toxic substances. One of the options is elaborated in somewhat more detail, i.e., the development of multiple indicators and calculation schemes for RA and LCIA that reflect the different frames. An outline is given for a possible indicator system reflecting the precautionary principle.

Notes: Quantitative risk assessment (RA) and life cycle assessment (LCA) are both analytical tools used to support decision making in environmental management. They have been developed and used by largely separate groups of specialists, and it is worth considering whether there is a common research agenda that may increase the relevance of these tools in decision-making processes. The validity of drawing comparisons between use of the tools is established through examining key aspects of the two approaches for their similarities and differences, including the nature of each approach and contextual and methodological aspects. Six case studies involving use of each approach in public decision making are described and used to draw out concerns about using RA and LCA in this context. The following categories of concern can be distinguished: philosophical approach of the tools; quantitative versus qualitative assessment; stakeholder participation; the nature of the results; and the usefulness of the results in relation to time and financial resource requirements. These can be distilled into a common policy research agenda focusing on: the legitimacy of using tools built on a particular perspective in decision making; recognition and role of value judgments in RA and LCA; treatment of uncertainty and variability; the influence of analytical tools in focusing attention on particular aspects of a decision-making situation; and understandability of the results for nonspecialists. It is concluded that it is time to bring together the experiences of RA and LCA specialists and benefit from cross-fertilization of ideas.

Notes: Life cycle assessment (LCA) is a framework for comparing products according to their total estimated environmental impact, summed over all chemical emissions and activities associated with a product at all stages in its life cycle (from raw material acquisition, manufacturing, use, to final disposal). For each chemical involved, the exposure associated with the mass released into the environment, integrated over time and space, is multiplied by a toxicological measure to estimate the likelihood of effects and their potential consequences. In this article, we explore the use of quantitative methods drawn from conventional single-chemical regulatory risk assessments to create a procedure for the estimation of the cancer effect measure in the impact phase of LCA. The approach is based on the maximum likelihood estimate of the effect dose inducing a 10% response over background, ED10, and default linear low-dose extrapolation using the slope βED10 (0.1/ED10). The calculated effects may correspond to residual risks below current regulatory compliance requirements that occur over multiple generations and at multiple locations; but at the very least they represent a “using up” of some portion of the human population's ability to accommodate emissions. Preliminary comparisons are performed with existing measures, such as the U.S. Environmental Protection Agency's (U.S. EPA's) slope factor measure q1*. By analyzing bioassay data for 44 chemicals drawn from the EPA's Integrated Risk Information System (IRIS) database, we explore estimating ED10 from more readily available information such as the median tumor dose rate TD50 and the median single lethal dose LD50. Based on the TD50, we then estimate the ED10 for more than 600 chemicals. Differences in potential consequences, or severity, are addressed by combining βED10 with the measure disability adjusted life years per affected person, DALYp. Most of the variation among chemicals for cancer effects is found to be due to differences in the slope factors (βED10) ranging from 10−4 up to 104 (risk of cancer/mg/kg-day).

Notes: Environmental decision-support tools often predict a multitude of different human health effects due to environmental stressors. The accounting and aggregating of these morbidity and mortality outcomes is key to support decision making and can be accomplished by different methods that we call human health metrics. This article attempts to answer two questions: Does it matter which metric is chosen? and What are the relevant characteristics of these metrics in environmental applications? Three metrics (quality adjusted life years (QALYs), disability adjusted life years (DALYs), and willingness to pay (WTP)) have been applied to the same diverse set of health effects due to environmental impacts. In this example, the choice of metric mattered for the ranking of these environmental impacts and it was found for this example that WTP was dominated by mortality outcomes. Further, QALYs and DALYs are sensitive to mild illnesses that affect large numbers of people and the severity of these mild illnesses are difficult to assess. Eight guiding questions are provided in order to help select human health metrics for environmental decision-support tools. Since health metrics tend to follow the paradigm of utility maximization, these metrics may be supplemented with a semi-quantitative discussion of distributional and ethical aspects. Finally, the magnitude of age-dependent disutility due to mortality for both monetary and nonmonetary metrics may bear the largest practical relevance for future research.

Notes: The tragic attacks of September 11 and the bioterrorist threats with respect to anthrax that followed have raised a set of issues regarding how we deal with events where there is considerable ambiguity and uncertainty about the likelihood of their occurrence and their potential consequences. This paper discusses how one can link the tools of risk assessment and our knowledge of risk perception to develop risk management options for dealing with extreme events. In particular, it suggests ways that the members of the Society for Risk Analysis can apply their expertise and talent to the risks associated with terrorism and discusses the changing roles of the public and private sectors in dealing with extreme events.

Notes: Beryllium is the strongest of the lightweight metals. Used primarily in military applications prior to the end of the Cold War, beryllium is finding new applications in many commercial products, including computers, telecommunication equipment, and consumer and automotive electronics. The use of beryllium in nondefense consumer applications is of concern because beryllium is toxic. Inhalation of beryllium dust or vapor causes a chronic lung disease in some individuals at concentrations as low as 0.01 μg/m3 in air. As beryllium enters wider commerce, it is prudent to ask what risks this might present to the general public and to workers downstream of the beryllium materials industry. We address this question by evaluating the potential for beryllium exposure from the manufacturing, use, recycle, and disposal of beryllium-containing products. Combining a market study with a qualitative exposure analysis, we determine which beryllium applications and life cycle phases have the largest exposure potential. Our analysis suggests that use and maintenance of the most common types of beryllium-containing products do not result in any obvious exposures of concern, and that maintenance activities result in greater exposures than product use. Product disposal has potential to present significant individual risks, but uncertainties concerning current and future routes of product disposal make it difficult to be definitive. Overall, additional exposure and dose-response data are needed to evaluate both the health significance of many exposure scenarios, and the adequacy of existing regulations to protect workers and the public. Although public exposures to beryllium and public awareness and concern regarding beryllium risks are currently low, beryllium risks have psychometric qualities that may lead to rapidly heightened public concern.

Notes: Health care professionals are a major source of risk communications, but their estimation of risks may be compromised by systematic biases. We examined fuzzy-trace theory's predictions of professionals' biases in risk estimation for sexually transmitted infections (STIs) linked to: knowledge deficits (producing underestimation of STI risk, re-infection, and gender differences), gist-based mental representation of risk categories (producing overestimation of condom effectiveness for psychologically atypical but prevalent infections), retrieval failure for risk knowledge (producing greater risk underestimation when STIs are not specified), and processing interference involving combining risk estimates (producing biases in post-test estimation of infection, regardless of knowledge). One-hundred-seventy-four subjects (experts attending a national workshop, physicians, other health care professionals, and students) estimated the risk of teenagers contracting STIs, re-infection rates for males and females, and condom effectiveness in reducing infection risk. Retrieval was manipulated by asking estimation questions in two formats, a specific format that “unpacked” the STI category (infection types) and a global format that did not provide specific cues. Requesting estimates of infection risk after relevant knowledge was directly provided, isolating processing effects, assessed processing biases. As predicted, all groups of professionals underestimated the risk of STI transmission, re-infection, and gender differences, and overestimated the effectiveness of condoms, relative to published estimates. However, when questions provided better retrieval supports (specified format), estimation bias decreased. All groups of professionals also suffered from predicted processing biases. Although knowledge deficits contribute to estimation biases, the research showed that biases are also linked to fuzzy representations, retrieval failures, and processing errors. Hence, interventions that are designed to improve risk perception among professionals must incorporate more than knowledge dissemination. They should also provide support for information representation, effective retrieval, and accurate processing.

Notes: The adverse impacts of particulate air pollution and ground-level ozone on public health and the environment have motivated the development of Canada Wide Standards (CWS) on air quality. In cost-benefit analysis of air-quality options, valuation of reduction in mortality is a critical step as it accounts for almost 80% of the total benefits and any bias in its evaluation can significantly skew the outcome of the analysis. The overestimation of benefits is a source of concern since it has the potential of diverting valuable resources from other needs to support broader health care objectives, education, and social services that contribute to enhanced quality of life. We have developed a framework of reasoning for the assessment of risk-reduction initiatives that would support the public interest and enhance safety and quality of life. This article presents the Life Quality Index (LQI) as a tool to quantify the level of expenditure beyond which it is no longer justifiable to spend resources in the name of safety. It is shown that the LQI is a compound social indicator comprising societal wealth and longevity, and it is also equivalent to a utility function consistent with the basic principles of welfare economics and decision analysis. The LQI approach overcomes several shortcomings of the method used by the CWS Development Committee and provides guidance on the compliance costs that can be justified to meet the Standards.

Notes: Preregulation estimates of benefits and costs are rarely validated after regulations are implemented. This article performs such a validation for the mandatory automobile airbag requirement. We found that the original 1984 model used to estimate benefits became invalid when 1997 values were input into that 1984 model. However, using a published 1997 cost-effectiveness model, we demonstrate, by replacing the model inputs with the values from 1984, that the 1997 cost-effectiveness ratios, based on real-world crash data and tear-down cost data, are less attractive than what would have been originally anticipated. The three most important errors in the 1984 input values are identified: the overestimation of airbag effectiveness, the overestimation of baseline fatality/injury rates, and the underestimation of manual safety belt use. This case study, which suggests that airbags are a reasonable investment in safety, shows that the regulatory analysis tools do not always produce findings that are biased against health, safety, and environmental regulation. Future validation studies of health, safety, and environmental regulation should focus on validation of benefit and risk estimates, areas where we found significant error, as well as on cost estimates.

Notes: Biomagnification of organochlorine and other persistent organic contaminants by higher trophic level organisms represents one of the most significant sources of uncertainty and variability in evaluating potential risks associated with disposal of dredged materials. While it is important to distinguish between population variability (e.g., true population heterogeneity in fish weight, and lipid content) and uncertainty (e.g., measurement error), they can be operationally difficult to define separately in probabilistic estimates of human health and ecological risk. We propose a disaggregation of uncertain and variable parameters based on: (1) availability of supporting data; (2) the specific management and regulatory context (in this case, of the U.S. Army Corps of Engineers/U.S. Environmental Protection Agency tiered approach to dredged material management); and (3) professional judgment and experience in conducting probabilistic risk assessments. We describe and quantitatively evaluate several sources of uncertainty and variability in estimating risk to human health from trophic transfer of polychlorinated biphenyls (PCBs) using a case study of sediments obtained from the New York-New Jersey Harbor and being evaluated for disposal at an open water off-shore disposal site within the northeast region. The estimates of PCB concentrations in fish and dietary doses of PCBs to humans ingesting fish are expressed as distributions of values, of which the arithmetic mean or mode represents a particular fractile. The distribution of risk values is obtained using a food chain biomagnification model developed by Gobas(1,2) by specifying distributions for input parameters disaggregated to represent either uncertainty or variability. Only those sources of uncertainty that could be quantified were included in the analysis. Results for several different two-dimensional Latin Hypercube analyses are provided to evaluate the influence of the uncertain versus variable disaggregation of model parameters. The analysis suggests that variability in human exposure parameters is greater than the uncertainty bounds on any particular fractile, given the described assumptions.

Notes: Delays in evoked potential latencies were observed at increased exposures to methylmercury from seafood in two cohorts of children. Because this outcome parameter appeared to be virtually independent of confounders, including cultural differences, a joint analysis of benchmark doses was carried out. Comparable cohort members included 382 Faroese and 113 Madeiran children without middle ear infection or neurological disease at age seven years. Maternal hair-mercury concentrations at parturition in the Faroese cohort ranged from 0.6 to 39.1 μg/g (geometric average, 4.49 μg/g). In Madeira, mothers who had not changed their diet since pregnancy had current hair-mercury concentrations ranging from 1.1 to 54.4 μg/g (geometric average 10.14 μg/g). The mercury-associated delay in peak III latencies at two frequencies (20 and 40 Hz) showed similar regression equations in the two groups of children, and benchmark dose calculations were therefore carried out for the two groups separately and jointly. For a doubling of a 5% prevalence of abnormal results of the peak III latencies at 40 Hz in a linear dose-response model, the benchmark dose for the maternal hair-mercury concentration was 8.79 μg/g for the Faroese children; 8.04 μg/g for the Madeiran children; and 9.46 μg/g for both groups. Results were similar for the 20 Hz condition. Benchmark dose results were substantially lower using a logarithmic or square root curve function, although the difference in fit between the curves was far from statistically significant. The benchmark results using evoked potential latencies are in close agreement with results based on neuropsychological test performance.

Notes: We discuss the management of catastrophe-risks from a theoretical point of view. The concept of a catastrophe is informally and formally defined, and a number of desiderata for catastrophe-averse decision rules are introduced. However, the proposed desiderata turn out to be mutually inconsistent. As a consequence of this result, it is argued that the ``rigid'' form of catastrophe aversion articulated by, for example, the maximin rule, the maximum probable loss rule, (some versions of) the precautionary principle, and the rule proposed in Ekenberg et al. (1997, 2000) should be given up. An alternative form of ``non-rigid'' catastrophe aversion is considered.

Notes: We review briefly some examples that would support an extended role for quantitative sensitivity analysis in the context of model-based analysis (Section 1). We then review what features a quantitative sensitivity analysis needs to have to play such a role (Section 2). The methods that meet these requirements are described in Section 3; an example is provided in Section 4. Some pointers to further research are set out in Section 5.

Notes: Because ethical considerations often preclude directly determining the human health effects of treatments or interventions by experimentation, such effects are estimated by extrapolating reactions predicted from animal experiments. Under such conditions, it must be demonstrated that the reliability of the extrapolated predictions is not excessively affected by inherent data limitations and other components of model specification. This is especially true of high-level models composed of ad hoc algebraic equations whose parameters do not correspond to specific physical properties or processes. Models based on independent experimental data restricting the numerical space of parameters that do represent actual physical properties can be represented at a more detailed level. Sensitivities of the computed trajectories to parameter variations permit more detailed attribution of uncertainties in the predictions to these low-level properties. S-systems, in which parameters are estimated empirically, and physiological models, whose parameters can be estimated accurately from independent data, are used to illustrate the applicability of trajectory sensitivity analysis to lower-level models.

Notes: Exposure scenarios are a critical part of risk assessment; however, representative scenarios are not generally available for tribal communities where a traditional subsistence lifestyle and diet are relevant and actively encouraged. This article presents portions of a multipathway exposure scenario developed by AESE, Inc. in conjunction with the Spokane Tribal Cultural Resources Program. The scenario serves as the basis for a screening-level reasonable maximum exposure (RME) developed for the Midnite Uranium Mine Superfund site. The process used in developing this scenario balances the need to characterize exposures without revealing proprietary information. The scenario and resulting RME reflect the subsistence use of original and existing natural resources by a hypothetical but representative family living on the reservation at or near the mine site. The representative family lives in a house in a sparsely populated conifer forest, tends a home garden, partakes in a high rate of subsistence activities (hunting, gathering, fishing), uses a sweat lodge daily, has a regular schedule of other cultural activities, and has members employed in outdoor monitoring of natural and cultural resources. The scenario includes two largely subsistence diets based on fish or game, both of which include native plants and home-grown produce. Data gaps and sources of uncertainty are identified. Additional information that risk assessors and agencies need to understand before doing any kind of risk assessment or public health assessment in tribal situations is presented.

Notes: The destruction by terrorists of the twin towers of the World Trade Center and major damage wrought to the Pentagon on September 11, 2001, followed closely by the bioterrorist anthrax attacks via the mails raised the question of whether risk analysis might have a place in defending the United States against terrorist attacks. After first reviewing the multifaceted nature of terrorism and the reasons it is likely to become endemic in world society in the long term, just as other areas of crime are endemic, this article surveys several fields of risk analysis, finding possible short- and long-term uses of risk analysis. The areas chiefly considered are: risk communication and chemical, biological, and technological risk analysis. Broad policy and other uses are also considered. The author finds that risk analysis has already played some role, perhaps informally, but he sees the possibility for a much larger, formal one, a role that is centrally important for the present and future of the United States and the world.

Notes: Incidents can be defined as low-probability, high-consequence events and lesser events of the same type. Lack of data on extremely large incidents makes it difficult to determine distributions of incident size that reflect such disasters, even though they represent the great majority of total losses. If the form of the incident size distribution can be determined, then predictive Bayesian methods can be used to assess incident risks from limited available information. Moreover, incident size distributions have generally been observed to have scale invariant, or power law, distributions over broad ranges. Scale invariance in the distributions of sizes of outcomes of complex dynamical systems has been explained based on mechanistic models of natural and built systems, such as models of self-organized criticality. In this article, scale invariance is shown to result also as the maximum Shannon entropy distribution of incident sizes arising as the product of arbitrary functions of cause sizes. Entropy is shown by simulation and derivation to be maximized as a result of dependence, diversity, abundance, and entropy of multiplicative cause sizes. The result represents an information-theoretic explanation of invariance, parallel to those of mechanistic models. For example, distributions of incident size resulting from 30 partially dependent causes are shown to be scale invariant over several orders of magnitude. Empirical validation of power law distributions of incident size is reviewed, and the Pareto (power law) distribution is validated against oil spill, hurricane, and insurance data. The applicability of the Pareto distribution, in particular, for assessment of total losses over a planning period is discussed. Results justify the use of an analytical, predictive Bayesian version of the Pareto distribution, derived previously, to assess incident risk from available data.

Notes: The fugacity model for evaluating DDTs dynamic performances in the environment was combined with the dietary exposure evaluation model, including the contribution of imported food, to develop the macroscopic mathematical model relating DDTs in the environment with the health risks of the reference Japanese. The model validity was examined by comparing the simulated DDTs concentrations in environmental media, various kinds of food, and dietary intake with those observed. Numerical simulations were done for the past half and future of one century to evaluate the effect of the DDTs usage prohibition in 1970 in Japan. The major results obtained under the limits considered are as follows. The DDTs concentrations in environmental media, various kinds of foods, and the dietary intake showed the steady exponential decrease after the DDTs usage prohibition in 1970. The DDE/DDTs ratio is larger in the higher position in an ecological system, and increased steadily with time. The critical exposure of DDTs occurred through animal product intake until 1960; after 1990 marine product intake caused the most exposure. The estimated DDTs intake was evaluated to be less than the PTDI and RfD. The annual excess cancer induction risk due to the annual dietary intake of DDTs was the largest at the level of (0.5−2.0)×10−6 (1/yr) in the early 1970s. The effect of the DDT usage prohibition on dietary exposure reduction was expected to appear after about 20 years. The life-span excess cancer induction risk was conservatively estimated to be larger than 10−5 (1/lifespan) for the reference Japanese who were born before 1970. The DDTs usage prohibition in 1970 was effective to reduce the life-span cancer risk under the 10−5 level.

Notes: In the event of a terrorist attack or catastrophic release involving potential chemical and/or biological warfare agents, decisionmakers will need to make timely and informed choices about whether, or how, to respond. The objective of this article is to provide a decision framework to specify initial and follow-up actions, including possible decontamination, and to address long-term health and environmental issues. This decision framework consists of four phases, beginning with the identification of an incident and ending with verification that cleanup and remediation criteria have been met. The flowchart takes into account both differences and similarities among potential agents or toxins at key points in the decision-making process. Risk evaluation and communication of information to the public must be done throughout the process to ensure a successful effort.

Notes: Probabilistic risk analyses often construct multistage chance trees to estimate the joint probability of compound events. If random measurement error is associated with some or all of the estimates, we show that resulting estimates of joint probability may be highly skewed. Joint probability estimates based on the analysis of multistage chance trees are more likely than not to be below the true probability of adverse events, but will sometimes substantially overestimate them. In contexts such as insurance markets for environmental risks, skewed distributions of risk estimates amplify the ``winner's curse'' so that the estimated risk premium for low-probability events is likely to be lower than the normative value. Skewness may result even in unbiased estimators of expected value from simple lotteries, if measurement error is associated with both the probability and pay-off terms. Further, skewness may occur even if the error associated with these two estimates is symmetrically distributed. Under certain circumstances, skewed estimates of expected value may result in risk-neutral decisionmakers exhibiting a tendency to choose a certainty equivalent over a lottery of equal expected value, or vice versa. We show that when distributions of estimates of expected value are positively skewed, under certain circumstances it will be optimal to choose lotteries with nominal values lower than the value of apparently superior certainty equivalents. Extending the previous work of Goodman (1960), we provide an exact formula for the skewness of products.

Notes: The practice of chlorine disinfection of drinking water to reduce microbial risks provides substantial benefits to public health. However, increasing concern around potential risks of cancer associated with exposure to chlorinated disinfection byproducts confuses this issue. This article examines the science agenda regarding chlorinated disinfection byproducts (CDBP) and cancer in Canada and the United States, focusing on the social construction of scientific knowledge claims and evidence. Data for this analysis were obtained from published documents as well as from in-depth interviews with epidemiologists and toxicologists centrally involved with the issue in both countries. Results of the analysis suggest that toxicological scientists want to close the door on the “chloroform issue” due to increasing evidence that chloroform is safe at low doses, because epidemiological scientists can no longer move forward the cancer science until significant improvements can be made in assessing human exposures, and because the scientific foci of research on DBP have shifted accordingly. Further, a distinction emerges in terms of how scientific uncertainties are interpreted when they cross-cut disciplines in the context of human health risk assessment. We suggest this tension reflects a balance of how uncertainty and authorities are managed in a mandated science-policy domain. Sufficient evidence was provided to keep the DBP issue on the regulatory agenda and to generate additional research, yet authorities and concomitant interpretations of uncertainty were contested. Such science generation and contestation inevitably influences complex risk assessment processes with respect to what water-related health risks are addressed and how.

Notes: This guest editorial is a summary of the NCSU/USDA Workshop on Sensitivity Analysis held June 11–12, 2001 at North Carolina State University and sponsored by the U.S. Department of Agriculture's Office of Risk Assessment and Cost Benefit Analysis. The objective of the workshop was to learn across disciplines in identifying, evaluating, and recommending sensitivity analysis methods and practices for application to food-safety process risk models. The workshop included presentations regarding the Hazard Assessment and Critical Control Points (HACCP) framework used in food-safety risk assessment, a survey of sensitivity analysis methods, invited white papers on sensitivity analysis, and invited case studies regarding risk assessment of microbial pathogens in food. Based on the sharing of interdisciplinary information represented by the presentations, the workshop participants, divided into breakout sessions, responded to three trigger questions: What are the key criteria for sensitivity analysis methods applied to food-safety risk assessment? What sensitivity analysis methods are most promising for application to food safety and risk assessment? and What are the key needs for implementation and demonstration of such methods? The workshop produced agreement regarding key criteria for sensitivity analysis methods and the need to use two or more methods to try to obtain robust insights. Recommendations were made regarding a guideline document to assist practitioners in selecting, applying, interpreting, and reporting the results of sensitivity analysis.

Notes: The concept of Hazard Analysis and Critical Control Point (HACCP) is a system that enables the production of safe meat and poultry products through the thorough analysis of production processes, identification of all hazards that are likely to occur in the production establishment, the identification of critical points in the process at which these hazards may be introduced into product and therefore should be controlled, the establishment of critical limits for control at those points, the verification of these prescribed steps, and the methods by which the processing establishment and the regulatory authority can monitor how well process control through the HACCP plan is working. The history of the development of HACCP is reviewed, and examples of practical applications of HACCP are described.

Notes: A sequence of linear, monotonic, and nonmonotonic test problems is used to illustrate sampling-based uncertainty and sensitivity analysis procedures. Uncertainty results obtained with replicated random and Latin hypercube samples are compared, with the Latin hypercube samples tending to produce more stable results than the random samples. Sensitivity results obtained with the following procedures and/or measures are illustrated and compared: correlation coefficients (CCs), rank correlation coefficients (RCCs), common means (CMNs), common locations (CLs), common medians (CMDs), statistical independence (SI), standardized regression coefficients (SRCs), partial correlation coefficients (PCCs), standardized rank regression coefficients (SRRCs), partial rank correlation coefficients (PRCCs), stepwise regression analysis with raw and rank-transformed data, and examination of scatter plots. The effectiveness of a given procedure and/or measure depends on the characteristics of the individual test problems, with (1) linear measures (i.e., CCs, PCCs, SRCs) performing well on the linear test problems, (2) measures based on rank transforms (i.e., RCCs, PRCCs, SRRCs) performing well on the monotonic test problems, and (3) measures predicated on searches for nonrandom patterns (i.e., CMNs, CLs, CMDs, SI) performing well on the nonmonotonic test problems.