J. Anim. Sci. 2004. 82:E110-E118
© 2004 American Society of Animal Science
The power of tests for bioequivalence in feed experiments with poultry1
W. B. Roush*,2 and
P. R. Tozer
* USDA-ARS Poultry Research Unit, Mississippi State, MS 39762 and
and
Department of Dairy and Animal Science, Pennsylvania State University, State College 16802
 |
Abstract
|
|---|
Several studies have compared the feeding of genetically modified (GM) grains and conventional grains to poultry. The general conclusion has been that there were no significant differences detected in the biological performance of the birds (i.e., the grains were bioequivalent). However, the question has been posed whether the experimental designs used in the studies had sufficient statistical power to detect treatment differences. The power of tests can be used to determine the ability of an experimental design to detect treatment differences. The definition of statistical power is the probability of rejecting the null hypothesis when it is false and should be rejected. The complement of statistical power is the Type II error (ß). That is, accepting the null hypothesis that there is no difference in treatments when there is one. A priori power analysis can indicate the probability at which the sampling regimen or experiment can actually detect an effect if a difference exists. Post hoc power analysis indicates the sufficiency or the sample size needed for an experiment that has already been conducted. In the current study, the power of tests for experiments published in the literature where significant and nonsignificant differences were reported between control birds and birds fed new feed grains was examined. With some exceptions, the power of tests is rarely formally considered or mentioned in poultry research. The results of the survey of the literature showed, in general, low power of statistical tests for feeding experiments involving non-GM grains or in those cases when GM and non-GM grains were compared in poultry feeding experiments. These results suggest that care needs to be taken when designing experiments for bioequivalence of grains fed to poultry.
Key Words: Bioequivalence Genetically Modified Grains Poultry Power Tests
 |
Introduction
|
|---|
Several studies have been conducted involving the comparison of feeding genetically modified (GM) grains with conventional grains to poultry. The general conclusion has been that there were no significant differences in the biological performance of the birds, implying that the GM grains are bioequivalent with the non-GM grains (Table 1
). However, the question has been proposed whether the statistical designs used in the studies had sufficient statistical power to detect biologically important differences.
Researchers typically design experiments to determine if differences between experimental treatments exist. The statistical difference between treatments is tested with the null hypothesis that there is no difference between treatments. The researchers test the null hypothesis and typically set a significance level for the test (
) at a predetermined level, usually 0.05. The significance level of the test measures the probability of making a Type I error. A Type I error is the rejection of a true null hypothesis (Steel et al., 1997).
Poultry, compared with other agricultural and companion species, have an advantage as experimental subjects. Generally, poultry are small in size, relatively docile, available in large numbers, and they have a short production cycle. Despite these advantages, sampling for poultry studies is still subject to the availability of facilities, availability of animals, ethical considerations, limited budgets, convenience, and tradition. With some exceptions (e.g., Hammond et al., 1996; Hall et al., 2003), researchers conducting poultry studies have not mentioned the consideration of the analysis of power of statistical research designs. Statistical power analysis shows whether an experiment is capable of detecting differences in the treatment mean values for given level of
. Formally, statistical power is defined as the probability of rejecting the null hypothesis when it is false and should be rejected (Table 2
). The power of a statistical test is calculated as 1-ß, where ß is the probability of making a Type II error. A Type II error is accepting a null hypothesis that is false (Steel et al., 1997).
If the test shows that a significant difference at the predetermined level of
is present, then usually there is no need to further consider the statistical power of the study (Sheppard, 1999). However, if no significant differences are detected, then a post hoc statistical power analysis may be conducted. It could mean that there is actually no difference or that the sample size was insufficient to detect a treatment difference. Researchers are occasionally tempted to report numerical (but statistically nonsignificant treatment) differences, a practice that is discouraged in journals such as Poultry Science. The question then arises as to whether detection of significant differences in the means would have been made had there been enough replications in the experiment.
Traditionally, scientists avoid committing Type I (
) rather than Type II (ß) statistical errors. That is, they want to avoid the conclusion that there is a difference in treatments, when a treatment difference does not exist (Type I error). With some studies, however, it may be important to avoid errors at the other extreme. That is, a change is made in the perspective of the hypothesis from a no-difference null hypothesis (Ho: µ1 = µ2) to a nonequivalence null hypothesis (Ho: µ1
µ2; Hoenig and Heisey, 2001). For example, when feeding animals GM grains, it may be more desirable to have no differences in biological responses. Type II statistical errors may occur when sample sizes are too small to show an effect. An a priori power analysis can be used to show the sample size and probability at which the statistical design would show a difference. It should be pointed out that, ideally, the appropriate use of power analysis is made during the planning stage of the experiment. It is inappropriate to use post hoc power analysis on observations in an effort to justify conclusions about the responses (Lenth, 2001). As an alternative, Hoenig and Heisey (2001) recommend the use of confidence intervals for interpreting inconclusive experiments. In this paper, the power analysis was used to gain insight into the capability of published research on grain comparisons to detect treatment differences.
A key component of power analysis is the effect size. Thomas and Krebs (1997) point out that effect size is the difference between the null and alternative hypotheses, and can be measured by using raw or standardized values. An example of a raw measure is the difference between means. Alternatively, standardized measures as shown in Table 3
are dimensionless and incorporate the sampling variance.
Cohen (1962) was the first to conduct a systematic literature survey of statistical power analysis in the behavioral sciences. For survey purposes, Cohen (1962) suggested using standardized (unit-free) effect size calculations for various statistical tests (Table 3
). He suggested calculating and categorizing the effects into small, medium, and large effects based on treatment number, total sample size, and probability level. Since Cohens (1962) initial survey, several other literature surveys, including Rossi (1990) and Fox and Mathers (1997), have been conducted in the behavioral and medical sciences to determine the adequacy of the statistical power to detect differences in treatments. The surveys have shown that the power of statistics in research is, generally, insufficient to comfortably accept the null hypothesis.
It is conventional to set 80% as the target value for statistical power (Fox and Mathers, 1997). That is, unless the statistical design of a study has a power of at least 80%, and if the treatments are not significant at the
= 0.05 level, then the results must be considered inconclusive (Lalouel and Rohrwasser, 2002).
This paper describes a survey of the power of tests in poultry-feeding research, including investigations with birds that were fed GM and non-GM feed grains. The intention of this paper is to suggest that statistical power analysis is a planning tool that may aid poultry researchers to enhance the credibility of feed grain comparisons and GM bioequivalence studies.
 |
Methods and Procedures
|
|---|
Examination was made of the statistical power of recent poultry-feeding experiments that compared bird response to different non-GM feed grains, or the comparison of bird responses to GM and non-GM feed grains in poultry feeding experiments.
Survey Procedure
Examination was made of research comparing feed ingredients, including GM grains, to poultry. The objective was to estimate the power of experiments to detect effect sizes of 0.1, 0.4, and 0.8. A sample of 37 papers from 1995 to 2003 was analyzed for the relative power of tests using previous surveys as a guideline (Table 4
). The treatments were determined for each experiment or trial. Only the tests (i.e., t-test, F-test or regression) designated by the authors were used for the analysis. Total observations or samples depending on the test were determined. The total sample size in this survey is defined as the number of observations summed over all of the treatment groups of the design. Statistical power was calculated based on the type of test. The power reported is an average for each paper. This allowed each paper to count equally in the survey. Descriptive statistics for the power survey, such as means, modes, and medians, were calculated in an MS Excel spreadsheet based on the collected data. A subset of 15 of the 37 representing GM and non-GM feed grain comparison experiments was examined for their power according to the three levels of effect size (Table 5
).
View this table:
[in this window]
[in a new window]
|
Table 4. Distribution of the power of 37 poultry ingredient feeding studies according to population effect size calculated with G*Power ( = 0.05)a
|
|
View this table:
[in this window]
[in a new window]
|
Table 5. Distribution of the power of 15 poultry studies related to the feeding of genetically modified grains according to population effect size calculated with G*Power ( = 0.5)a
|
|
Standard Conditions
The
= 0.05 Type I error was used as a standard condition throughout the survey. That is, the null hypothesis in the studies is considered a no-difference null hypothesis (Ho: µ1 = µ2). Following the reasoning of Cohen (1962), the nondirectional version of the null hypothesis (two-tailed distribution) was used. The calculation of the power of tests was conducted with G*Power, a freeware program. Buchner et al. (1997) provide a downloadable version of the G*Power program with supporting documents.
Effect Size
Cohen (1962) suggested an arbitrary classification of tests according to small, medium, and large effects. Sheppard (1999) pointed out that the meaning of small, medium, and large are likely to differ between disciplines and may not directly correspond to a perceived degree of importance for the variable(s) of interest. The levels determined by Cohen (1988) for social sciences may not easily correspond to a contaminant level for example. With this in mind, the calculated power levels in this paper are reported for effect sizes of 0.1, 0.4, and 0.8. These effect sizes might be roughly thought of as small, medium and large. The effect sizes were calculated according to the statistical test (i.e., t-test, F-test or regression) employed in the respective papers. Table 3
shows the calculation of the effect size for various statistical tests according to Cohen (1962).
 |
Results and Discussion
|
|---|
The descriptive statistics and dispersal of the papers for the power values according to the effect sizes for the non-GM grain and GM grain studies are shown in Tables 4
and 5
, respectively. On average, the surveyed studies had less than one chance in 12 or 13 of detecting a small effect (0.1). None of the studies had as much as a 50% chance of detecting a slight effect. For a medium effect size (0.4), the studies averaged less than a 50% chance of successfully rejecting a null hypothesis for ingredient studies, and approximately a 50% probability for the subset of GM grain feeding studies. Large size effects (0.8) needed fewer samples for detection than small effects. When the effect size was large, the power of the studies met and exceeded the minimum of 80% power that is considered a standard.
Table 6
shows post hoc power test calculations of selected production and carcass measurements from the literature for laying hens and broilers. The standardized effect sizes were calculated from the standard deviation of treatment means and the pooled standard deviation. For 17 of the 19 variables measured, the power of the test was considerably below the conventional power level of 0.8. Exceptions are noted for the grain energy level evaluations for both broilers and layers. The average effect size for variables, not including the energy values, was 0.28 ± 0.14, and with the energy values, the average effect size was 0.40 ± 0.39. The average power for the variables measured, not including energy values, was 0.24 ± 0.15. When the energy power values were included, the average power size was 0.31 ± 0.26. These effect sizes and powers provide the researcher a sense of the magnitude for these values found in the literature. The generally small power values for these effect sizes suggest the sample sizes are low. (In many cases, and in the discussion that follows, sample size and number of experimental units can be used interchangeably.) Subsequently, an a priori test was conducted to examine the sample size that would be required to produce a power of 80% (Table 7
). The results illustrate the dilemma in determining sample size. For some variables, such as digestibility of CP and energy levels, the required sample size might be considered reasonable. For other physiological variables, the sample size would probably be considered quite unreasonable (e.g., 1,890 and 2,480 total samples for feed conversion and thigh percent, respectively).
View this table:
[in this window]
[in a new window]
|
Table 6. Post hoc power test calculation of selected measurements from the literature for laying hens and broilers (F-test, = 0.05). Power was calculated with G*Powera
|
|
View this table:
[in this window]
[in a new window]
|
Table 7. A priori power test calculation of selected measurements from the literature for laying hens and broilers (F-test, = 0.05). Sample size was calculated with G*Powera
|
|
As an alternative, a "compromise" option is available in G*Power (Erdfelder, 1984), which is based on a balance between Type I (
) and Type II (ß) errors. In the compromise approach, the researcher specifies the size of effect to be detected, the sample size that seems reasonable, and the error ratio that defines the relative seriousness of both types of error. Given this, an optimal critical value for the test statistic and the associated
and ß values are computed. An illustration of the compromise option is shown in Table 8
. The calculation of power was based on an arbitrary sample size of 120 (60 observations for each grain treatment) and an equal ratio between
and ß (i.e., ratio = 1). The challenge to the researcher is that the compromise results may give nonstandard levels for
and ß, as indicted in the example. That is, probability values other than 0.05 or 0.01.
View this table:
[in this window]
[in a new window]
|
Table 8. Compromise power calculation of selected measurements from the literature for laying hens and broilers (F-test) where total possible sample size is held at 120 and the ß/ ratio = 1. The = ß value and power were calculated with G*Powera
|
|
Yet another approach is shown in Table 9
. In this case, the researcher would like to maintain a balance of
= 0.05 and ß = 0.20 (power = 0.80). These sample sizes were calculated using the a priori option of G*Power according to different effect sizes. Again, the detection of small effect sizes requires large sample sizes.
View this table:
[in this window]
[in a new window]
|
Table 9. A priori sample sizes for a balance between = 0.05 and ß = 0.20 (power = 0.80) for small (0.1), medium (0.4), and large (0.8) effect sizes. Sample sizes were calculated with G*Powera
|
|
Power is a function of three variables: 1) sample size (Cohen, 1962, Fox and Mathers, 1997); 2) the effect size (the degree of departure in the population from the null hypothesis); and 3) the level of significance (
or Type I error), The following are some thoughts on how these variables, and power itself, might be adjusted to improve the ability of the researcher to make statistical conclusions.
Sample Size
Berndtson (1991) provides equations for determining numbers of replicates and tables for determining replication at power levels of 0.8, 0.90, and 0.95. Software such as G*Power gives some flexibility in determining sample sizes. Sampling strategies have been noted using a compromise approach to balance Type I and Type II errors. An a priori approach was suggested to maintain a relationship between Type I and Type II errors (e.g.,
= 0.05 and ß = 0.20). However, there is no absolute size of a sample that is best. Declaration of a critical number of samples as being absolutely necessary is tempting. The interaction of strain of bird, grain varieties, environmental conditions etc. makes it impossible to make concrete declarations of sample size or levels of significance. The reference section for the G*Power program (Buchner, 1997) illustrates approaches to determining sample sizes for interactions in multifactor designs.
Generally, the cost of large sample sizes makes it uneconomical in terms of money and time. Reductions of sample sizes can come at a cost in power and may result in probabilities other than the conventional 0.05 and 0.01 levels.
The sample size is related to the amount of variance in the experiment. Accordingly, the variance can be affected by relationship between the experimental unit and the subsamples making up the experimental unit. The treatment variance decreases as the number of replicates increase, at the expense of the number of subsamples in the treatment replicate (Steel et al., 1997). In other words, as the replications of pens increase and the bird number per pen decreases, there is a decrease in treatment variation.
Effect Size
An observation can be made that the larger the effect size, the lower the number of replicates is needed for sufficient statistical power. However, Lenth (2001) cautions that the standardized effect size (as a ratio of the pooled standard deviation of the means to the error standard deviation) has no relevance, in itself, as a criterion for determining sample size. Lenth (2001) argues that the numerator and denominator of the effect size ratio for the t-test and F-test (Table 3
) need to be looked at separately. For example, the effect size can be improved by lowering the standard deviation value of the denominator. The type of measurement tools used can be effective in more accurately determining measurements and reducing variance. Another approach is to reduce experimental variation by using sensitive research designs (e.g., blocking, covariates, etc.).
Significance (
) Level
In science, the tendency is to think in terms of absolutes. This orientation is inherited, no doubt, from the hard disciplines of mathematics, physics, and chemistry, where accuracy and precision are hallmarks. In the biological sciences, variability is ubiquitous. Statistics in research is commonly driven by the almost magical values of 0.05 and 0.01 (Sheppard, 1999). As Sheppard (1999) points out, it must be kept in mind that these values are convenient cut-off values. Gill (1981) referred to the strict adherence to the 0.05 level as the cult of P < 0.05 or perish. That is, if P is 0.06, then the treatments are not considered significantly different by some researchers. One approach to put experimental results in perspective is to report the probability level at which the treatments are significant. These values are available in most statistical package printouts.
Power (1-ß)
Improvement of statistical power can be made by the use of proper experimental designs. For example, quantitative experiments are occasionally analyzed by ANOVA. The analysis of a quantitative experiment as a regression will increase the power of the test. It should be kept in mind that for quantitative experiments, where the regression is significant, the differences between treatment values are significant.
The ability to conduct power tests has been enhanced. The website of R. V. Lenth (www.stat.uiowa.edu/rlenth/Power/) provides links to several power analysis calculators. In addition, Thomas and Krebs (1997) have reviewed a number software programs, available to researchers for power analysis and sample size determination.
 |
Implications
|
|---|
With regard to safety (perceived or otherwise) and in an effort to preserve the credibility of the research, it is important that careful consideration be given to the experimental design for the detection of differences or lack of differences. With this in mind, Buhl-Mortensen (1996) pointed out that the awareness of how methods affect results in science is crucial if we want to appraise objectively what an investigation does or does not say about the actual extent of a given risk and will help to keep science as objective as possible. Accordingly, power analysis of experimental designs for planned research is encouraged to accomplish meaningful bioequivalent feed studies for poultry.
 |
Footnotes
|
|---|
1 This article was presented at the 2003 ADSA-ASAS-AMPA meeting as part of the Contemporary Issues symposium "Designing Animal Experiments for Power." 
2 Correspondence: P.O. Box 5367 (phone: 662-320-7480; fax: 662-320-7589; e-mail: broush{at}ars.usda.gov).
Received for publication July 9, 2003.
Accepted for publication August 22, 2003.
 |
Literature Cited
|
|---|
Aeschbacher, K., L. Meile, R. Messikommer, and C. Wenk. 2001. Genetically modified maize in diets for chickens and laying hens: Influence on performance and product quality. Pages 4142 in Proc. Int. Symp. Genetically Modified Crops and Co-Products as Feeds for Livestock, Nitra, Slovak Republic.
Ali, M. A., and S. Leeson. 1995. The nutritive value of some indigenous Asian poultry feed ingredients. Anim. Feed Sci. Technol. 55:227237.
Aulrich, K., H. Böhme, R. Daenicke, I. Halle, and G. Flachowsky. 2001. Genetically modified feeds in animal nutrition 1st communication: Bacillus thuringiensis (Bt) corn in poultry, pig and ruminant nutrition. Arch. Anim. Nutr. 54:183195.
Aulrich, K., I. Halle, and G. Flachowsky. 1998. Inhaltsstoffe und Verdaulichkeit von Maiskornen der Sorte Cesar und der gentechnisch veranderten Bt-hybride bei Legenhennen. Pages 465468 in Proc. Einfluss von Erzeugung und Verarbeitung auf die Qualitat laudwirtschaftlicher Produkte (VDLUFA) Kongressband. VDLUFA-Kongress, Giessen, Germany.
Batal, A. B., and C. M. Parsons. 2003. Utilization of different soyproducts as affected by age in chicks. Poult. Sci. 82:454462.[Abstract/Free Full Text]
Bennett, C. D., H. L. Classen, and C. Riddell. 2002. Feeding broiler chickens wheat and barley diets containing whole, ground and pelleted grain. Poult. Sci. 81:9951003.[Abstract/Free Full Text]
Benitez, J. A., A. G. Gernat, J. G. Murillo, and M. Araba. 1999. The use of high oil corn in broiler diets. Poult. Sci. 78:861865.[Abstract/Free Full Text]
Berndtson, W. E. 1991. A simple, rapid and reliable method for selecting or assessing the number of replicates for animal experiments. J. Anim. Sci. 69:6776.[Abstract]
Boling, S. D., M. W. Douglas, J. L. Snow, C. M. Parsons, and D. H. Baker, 2000. Citric acid does not improve phosphorus utilization in laying hens fed a corn-soybean meal diet. Poult. Sci. 79:13351337.[Abstract/Free Full Text]
Brake, J., and D. Vlachos. 1998. Evaluation of transgenic event 176 "Bt" corn in broiler chickens. Poult. Sci. 77:648653.[Abstract/Free Full Text]
Brake, J., M. A. Faust, and J. Stein. 2003. Evaluation of transgenic event Bt11 hybrid corn in broiler chickens. Poult. Sci. 82:551559.[Abstract/Free Full Text]
Buchner, A., E. Erdfelder, and F. Faul. 1997. How to Use G*Power. Available: http://www.psycho.uni-duesseldorf.de/aap/projects/gpower/how_to_use_gpower.html. Accessed Aug. 12, 2003.
Buhl-Mortentsen, L. 1996. Type-II statistical errors in environmental science and the precautionary principle. Mar. Pollut. Bull. 32:528531.
Cohen, J. 1962. The statistical power of abnormal-social psychological research: A review. J. Abnorm. Soc. Psychol. 65:145153.[Medline]
Cohen, J. 1988. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Lawrence Erlbaum Associates, Hillsdale, N.J.
Daghir, N. J., M. T. Farran, G. W. Barbour, and M. M. Beck. 2003. Nutritive value of high-oil corn grown under semi-arid conditions and its impact on broiler performance and carcass composition. Poult. Sci. 82:267271.[Abstract/Free Full Text]
Del Carmen, J., A. G. Gernat, R. Myhrman, and L. B. Carew. 1999. Evaluation of raw and heated velvet beans (Mucuna pruriens) as feed ingredients for broilers. Poult. Sci. 78:866872.[Abstract/Free Full Text]
Donkoh, A., C. C. Atuahene, Y. B. Poku-Prempeh, and I. G. Twum. 1999. The nutritive value of chaya meal (Cnidoscolus aconitifolius (Mill.) Johnston): studies with broiler chickens. Anim. Feed Sci. Technol. 77:163172.
Douglas, M. W., and C. M. Parsons. 2000. Effect of presolvent extraction processing method on the nutritional value of soybean meal for chicks. Poult. Sci. 79:16231626.[Abstract/Free Full Text]
Douglas, M. W., C. M. Parsons, and T. Hymowitz. 1999. Nutritional evaluation of lectin-free soybeans for poultry. Poult. Sci. 78:9195.[Abstract/Free Full Text]
Erdfelder, E. 1984. Zur Bedeutung und Kontolle des ß-Fehlers bei der inferenzstatischen Prüfung log-linearer Modelle. [On significance and control of the ß error in statistical tests of log-linear models]. Z. Sozialpsychol. 15:1832.
Fernandez, J. I. M., F. R. Lima, C. X. Mendonca, I. Mabe, R. Albuquerque, and P. M. Leal. 1999. Relative bioavaility of phosphorus in feed and agricultural phosphates for poultry. Poult. Sci. 78:17291736.[Abstract/Free Full Text]
Fox, N., and N. Mathers. 1997. Empowering research: Statistical power in general practice research. Fam. Pract. 14:324329.[Abstract/Free Full Text]
Gaines, A. M., G. L. Allee, and B. W. Ratliff. 2001. Nutritional evaluation of Bt (MON810) and Roundup Ready® corn compared with commercial hybrids in broilers. Poult. Sci. 80(Suppl. 1):51. (Abstr.)
Gill, J. L. 1981. Evolution of statistical design and analysis of experiments. J. Dairy Sci. 64:14941519.[Abstract/Free Full Text]
Gonzalez-Esquerra, R., and S. Leeson. 2000. Studies on the metabolizable energy content of ground full-fat flaxseed fed in mash, pellet, and crumbled diets assayed with birds of different ages. Poult. Sci. 79:16031607.[Abstract/Free Full Text]
Hall, L. E., R. B. Shirley, R. I. Bakalli, S. E. Aggrey, G. M. Pesti and H. M. Edwards, Jr. 2003. Power of two methods for the estimation of bone ash of broilers. Poult. Sci. 82:414418.[Abstract/Free Full Text]
Halle, I., K. Aulrich, and G. Flachowsky, 1999. Einsatz von Maisekornen der Sorte Cesar und des gentechnisch verandern Bt-Hybriden in der Broiler mast. Pages 265267 in Proc. 5. Tagung, Schweine- und Geflugelernahrung, Wittenberg, Deutschland.
Hammond, B. G., J. L. Vicini, G. F. Hartnell, M. W. Naylor, C. D. Knight, E. H. Robinson, R. L. Fuchs and S. R. Padgette. 1996. The feeding value of soybeans fed to rats, chickens, catfish and dairy cattle is not altered by genetic incorporation of glyphosate tolerance. J. Nutr. 126:717727.
Hoenig, J. M., and D. M. Heisey. 2001. The abuse of power: The pervasive fallacy of power calculations for data analysis. Amer. Stat. 55:1924.
Humphrey, B. D., N. Huang and K. C. Klasing. 2002. Rice expressing lactoferrin and lysozyme has antibiotic-like properties when fed to chicks. J. Nutr. 132:12141218.[Abstract/Free Full Text]
Kan, C. A., H. A. J. Versteegh, T. G. Uijttengoogarrt, H. G. M. Reimert, and G. F. Hartnell. 2001. Comparison of broiler performance when fed Bt parental/isogenic control or commercial varieties of dehulled soybean meal. Pages 1922 in Proc. Int. Symp. on Genetically Modified Crops and Co-Products as Feeds for Livestock, Nitra, Slovak Republic.
Lalouel, J., and A. Rohrwasser. 2002. Power and replication in case-control studies. Am. J. Hypertens. 15:201205.[Medline]
Lee, B. D., D. J. Kim, and S. J. Lee. 2001. Nutritive and economic values of high oil corn in layer diet. Poult. Sci. 80:15271534.[Abstract/Free Full Text]
Leeson, S. 1998. The effect of corn hybrid CBH35 on the growth of male broiler chickens. Dept. of Animal and Poultry Science, Arkell Research Farms, Univ. of Guelph, Guelph, ON, Canada. Lab project ID No. C298. April 20, 1998.
Lenth, R. V. 2001. Some practical guidelines for effective sample-size determination. Am. Stat. 55:187193.
Li, Y. C., D. R. Ledoux, T. L. Veum, V. Raboy, and D. S. Ertl. 2000. Effects of low phytic acid corn on phosphorus utilization, performance, and bone mineralization in broiler chicks. Poult. Sci. 79:14441450.[Abstract/Free Full Text]
Mireles, A., S. Kim, R. Thompson and B. Amundsen. 2000. GMO (Bt) corn is similar in composition and nutrient availability to broilers as non-GMO corn. Poult. Sci. 79(Suppl. 1):65. (Abstr.)
Novak, C., and S. E. Scheideler. 2001. Long-term effects of feeding flaxseed-based diets. 1. Egg production measurements, components, and eggshell quality in two strains of laying hens. Poult. Sci. 80:14801489.[Abstract/Free Full Text]
OECD. 2003. Considerations for the safety assessment of animal feedstuffs derived from genetically modified plants. Series on the Safety of Novel Foods and Feeds. No. 9. Org. for Econ. Coop. and Dev., Paris, France.
Parsons, C. M., F. Castanon, and Y. Han. 1997. Protein and amino acid quality of meat and bone meal. Poult. Sci. 76:361368.[Abstract/Free Full Text]
Perez, J. F., A. G. Gernat, and J. G. Murillo. 2000. The effect of different levels of palm kernel meal in layer diets. Poult. Sci. 79:7779.[Abstract/Free Full Text]
Piva, G., M. Morlacchini, A. Pietri, F. Rossi, and A. Prandini. 2001. Growth performance of broilers fed insect- protected (MON 810) or near isogenic control corn. Poult. Sci. 80(Suppl. 1):320. (Abstr)[Abstract/Free Full Text]
Ravindran, V., R. L. Hood, R. J. Gill, C. R. Kneale, and W. L. Bryden. 1996a. Nutritional evaluation of grain amaranth (Amaranthus hypochondriacus) in broiler diets. Anim. Feed Sci. Technol. 63:323331.
Ravindran, V., R. Sivakanesan, and H. W. Cyril. 1996b. Nutritive value of raw and processed colocasia (Colocasia esculenta) corn mean for poultry. Anim. Feed Sci. Technol. 57:335345.
Rosenfeld, D. J., A. G. Gernat, J. D. Marcano, J. G. Murillo, G. H. Lopez, and J. A. Flores. 1997. The effect of using different levels of shrimp meal in broiler diets. Poult. Sci. 76:581587.[Abstract/Free Full Text]
Rossi, J. S. 1990. Statistical power of psychological research: What have we gained in 20 years? J. Consult. Clin. Psychol. 58:646656.[Medline]
Scott, T. A., F. G. Silversides, H. L. Classen, M. L. Swift, M. R. Bedford, and J. W. Hall. 1998. Broiler chick bioassay for measuring the feeding value of wheat and barley in complete diets. Poult. Sci. 77:449455.[Abstract/Free Full Text]
Sheppard, C.R. 1999. How large should my sample be? Some quick guides to sample size and the power of tests. Mar. Pollut. Bull. 38:439447.
Sidhu, R. S., B. G. Hammond, R. L. Fuchs, J.-N. Mutz, L. R. Holden, B. George, and T. Olson. 2000. Glyphosate-tolerant corn: The composition and feeding value of grain from glyphosate-tolerant corn is equivalent to that of conventional corn (Zea mays L.). J. Agric. Food Chem. 48:23052312.[Medline]
Slominski, B. A., J. Simbaya, L. D. Campbell, G. Rakow, and W. Guenter. 1999. Nutritive value for broilers of meals derived from newly developed varieties of yellow-seeded canola. Anim. Feed Sci. Technol. 78:249262.
Steel, R. G. D., J. H. Torrie, and D. A. Dickey. 1997. Principles and Procedures of Statistics. A Biometrical Approach. 3rd ed. McGraw-Hill Book Co., New York.
Sterling, K. G., E. F. Costa, M. H. Henry, G. M. Pesti, and R. I. Bakalli. 2002. Responses of broiler chickens to cottonseed- and soybean meal-based diets at several protein levels. Poult. Sci. 81:217226.[Abstract/Free Full Text]
Svihus, B., and M. Gullord, 2002. Effect of chemical content and physical characteristics on nutritional value of wheat, barley and oats for poultry. Anim. Feed Sci. Technol. 102:7192.
Taylor, M. L., G. F. Hartnell, M. A. Nemeth, B. George and J. D. Astwood, 2001a. Comparison of broiler performance when fed diets containing Roundup Ready corn event NK603, parental line or commercial corn. Poult. Sci. 80(Suppl. 1):320. (Abstr.)
Taylor, M. L., G. F. Hartnell, M. A. Nemeth, B. George, and J. D. Astwood. 2001b. Comparison of broiler performance when fed diets containing YieldGard corn, YieldGard and Roundup Ready® corn, parental lines, or commercial corn. Poult. Sci. 80(Suppl. 1):319. (Abstr.)
Taylor, M. L., G. F. Hartnell, S. G., Riordan, M. A., Nemeth, K. Karunanandaa, B. George, and J. D. Astwood. 2003a. Comparison of broiler performance when fed diets containing grain from Roundup Ready (NK603), YieldGard x Roundup Ready (MON810 x NK603), non-transgenic control, or commercial corn. Poult. Sci. 82:443453.[Abstract/Free Full Text]
Taylor, M. L., G. F. Hartnell, S. G. Roirdan, M. A. Nemeth, K. Karunanandaa, B. George, and J. D. Astwood. 2003b. Comparison of broiler performance when fed diets containing grain from YieldGard (MON810), YieldGard x Roundup Ready (GA21), nontransgenic control, or commercial corn. Poult. Sci. 82:823830.[Abstract/Free Full Text]
Thomas, L., and C. J. Krebs. 1997. A review of statistical power analysis software. Bull. Ecol. Soc. Am. 78:126139
Wang, X., and C. M. Parsons. 1997. Effect of processing systems on protein quality of feather meals and hog hair meals. Poult. Sci. 76:491496.[Abstract/Free Full Text]