Estimation of prediction error variances via Monte Carlo sampling methods using different formulations of the prediction error variance
- John M Hickey^{1, 2, 3}Email author,
- Roel F Veerkamp^{1},
- Mario PL Calus^{1},
- Han A Mulder^{1} and
- Robin Thompson^{4, 5, 6}
https://doi.org/10.1186/1297-9686-41-23
© Hickey et al; licensee BioMed Central Ltd. 2009
Received: 17 December 2008
Accepted: 09 February 2009
Published: 09 February 2009
Abstract
Calculation of the exact prediction error variance covariance matrix is often computationally too demanding, which limits its application in REML algorithms, the calculation of accuracies of estimated breeding values and the control of variance of response to selection. Alternatively Monte Carlo sampling can be used to calculate approximations of the prediction error variance, which converge to the true values if enough samples are used. However, in practical situations the number of samples, which are computationally feasible, is limited. The objective of this study was to compare the convergence rate of different formulations of the prediction error variance calculated using Monte Carlo sampling. Four of these formulations were published, four were corresponding alternative versions, and two were derived as part of this study. The different formulations had different convergence rates and these were shown to depend on the number of samples and on the level of prediction error variance. Four formulations were competitive and these made use of information on either the variance of the estimated breeding value and on the variance of the true breeding value minus the estimated breeding value or on the covariance between the true and estimated breeding values.
Keywords
Introduction
In quantitative genetics the prediction error variance-covariance matrix is central to the calculation of accuracies of estimated breeding values ($\widehat{u}$) [e.g. [1]], to REML algorithms for the estimation of variance components [2], to methods which restrict the variance of response to selection [3], and can be used to explore trends in Mendelian sampling deviations over time [4]. The mixed model equations (MME) for most national genetic evaluations range from 100,000 to 20,000,000 equations and inversion of systems of equations of this size is generally not possible because of their magnitude or because of loss of numerical precision [5]. Methods that approximate the prediction error variances (PEV) and calculate the accuracy of $\widehat{\text{u}}$ provide biased estimates in some circumstances by ignoring certain information [e.g. [6]]. Variance components upon which genetic evaluations of large populations are based are generally estimated using reduced data sets. The use of reduced data sets may create bias in the estimates as REML only provides unbiased estimates of variance components when all the data on which selection has taken place is included in the analysis [7]. Variance of response to selection is generally not controlled in breeding programs although it might be a risk to them [3].
Approximations of the PEV without needing to invert the coefficient matrix or to delete data, can be obtained by comparing Monte Carlo samples of the data and successive solutions of the mixed model equations of this data.
However different formulations have been presented to approximate the PEV in this way [8–11]. Approximations of the PEV using these formulations converge to the exact PEV (PEV_{ exact }) as the number of Monte Carlo samples increases, but the number of samples is generally limited by computational requirements in practice [e.g. [12]]. Also, differences in the rates of convergence have been shown to depend on the level of PEV_{exact} for a given genetic variance (${\sigma}_{g}^{2}$) [10]. Consequently, when finding the optimal number of iterations required, both the different formulations, and the level of PEV_{exact} need to be taken into account. Some of the formulations are weighted averages of other formulations, with the weighting depending on the sampling variances of these. Garcia-Cortes et al. [10] use asymptotic approximations of these sampling variances. Alternative weighting strategies could use empirically approximated sampling variances based on independent replicates of samples or using leave-one-out Jackknife procedures [13, 14].
The objective of this study was to compare the convergence to PEV_{exact} of ten different formulations of the PEV, using simulations based on data and pedigree from a commercial population containing animals with different levels of PEV and using different numbers of samples (n = 50, 100, ..., 950, 1000). Four of the formulations were previously published, four were alternative versions of these, and two were derived as part of this study.
Methods
Monte Carlo sampling procedure for calculating PEV
The Monte Carlo sampling procedure for calculating the sampled PEV has been described extensively elsewhere for single breed [8–10] and multiple breed scenarios [12]. Assuming a simple additive genetic animal model without genetic groups y = Xb + Zu + e, where the distribution of random variables is y ~ N(Xb, ZGZ' + R), u ~ N(0, G), and e ~ N(0, R), the three steps involved in calculating the sampled PEV are as follows: 1. Simulate n samples of y and u using the pedigree and the distributions of the original data, modified to account for the fact that the expectation of Xb does not affect the distribution of random variables [15, 16] thus the samples of y can be simulated using random normal deviates from N(0, ZGZ' + R) instead of N(Xb, ZGZ' + R). 2. Set up and solve the mixed model equations for the data set using the n simulated samples of y instead of the true y. This accounts for the fixed effects structure of the real data. 3. Calculate the sampled PEV for some formulation.
Formulations of PEV
Previously published, alternative, and new formulations of the prediction error variance for a random effect u with ${\sigma}_{g}^{2}$, the assumptions pertinent to each formulation, the information used in each formulation, and the asymptotic sampling variances of each formulation
Formulation | Assumptions | Uses information on | Asymptotic sampling variance |
---|---|---|---|
^{1}PEV_{GC1} = ${\sigma}_{\text{g}}^{\text{2}}$ - Var($\widehat{\text{u}}$) | Cov(u, $\widehat{\text{u}}$) = Var($\widehat{\text{u}}$) Var(u) = ${\sigma}_{\text{g}}^{\text{2}}$ | $\widehat{\text{u}}$ | 2r^{4} ${\sigma}_{\text{g}}^{4}$/n |
^{2}PEV_{GC2} = Var(u - $\widehat{\text{u}}$) | ^{11}Cov(u, $\widehat{\text{u}}$) ≠/= Var($\widehat{\text{u}}$) Var(u) = ${\sigma}_{\text{g}}^{\text{2}}$ | u - $\widehat{\text{u}}$ | 2(1-r^{2})^{2} ${\sigma}_{\text{g}}^{4}$/n |
^{3} ${\text{PEV}}_{\text{GC3}}=\frac{\left[\frac{{\text{PEV}}_{\text{GC1}}}{{\text{Var(PEV}}_{\text{GC1}}\text{)}}\right]+\left[\frac{{\text{PEV}}_{\text{GC2}}}{{\text{Var(PEV}}_{\text{GC2}}\text{)}}\right]}{\frac{\text{1}}{{\text{Var(PEV}}_{\text{GC1}}\text{)}}+\frac{\text{1}}{{\text{Var(PEV}}_{\text{GC2}}\text{)}}}$ | Cov(u - $\widehat{\text{u}}$, $\widehat{\text{u}}$) = 0 Var(u) = ${\sigma}_{\text{g}}^{\text{2}}$ | $\widehat{\text{u}}$, u - $\widehat{\text{u}}$ | {[2r^{4}(1-r^{2})^{2}]/[(1-r^{2})^{2} + r^{4}]}${\sigma}_{\text{g}}^{4}$/n |
^{4}PEV_{FL} = ${\sigma}_{\text{g}}^{\text{2}}$ - Cov(u, $\widehat{\text{u}}$) | Cov(u, $\widehat{\text{u}}$) = Var($\widehat{\text{u}}$) Var(u) = ${\sigma}_{\text{g}}^{\text{2}}$ | Cov(u, $\widehat{\text{u}}$) | r^{2}(1+r^{2})${\sigma}_{g}^{2}$/n |
^{5}PEV_{AF1} = ${\sigma}_{\text{g}}^{\text{2}}$ - [Var($\widehat{\text{u}}$)/Var(u)] ${\sigma}_{\text{g}}^{\text{2}}$ | Cov(u, $\widehat{\text{u}}$) = Var($\widehat{\text{u}}$) Var(u) ≠ ${\sigma}_{\text{g}}^{\text{2}}$ | $\widehat{\text{u}}$, u | 4r^{4}(1-r^{2})${\sigma}_{\text{g}}^{4}$/n |
^{6}PEV_{AF2} = [Var(u - $\widehat{\text{u}}$)/Var(u)] ${\sigma}_{\text{g}}^{\text{2}}$ | ^{11}Cov(u, $\widehat{\text{u}}$) ≠/= Var($\widehat{\text{u}}$) Var(u) ≠ ${\sigma}_{\text{g}}^{\text{2}}$ | u - $\widehat{\text{u}}$, u | 4r^{2}(1-r^{2})^{2} ${\sigma}_{\text{g}}^{4}$/n |
^{7} ${\text{PEV}}_{\text{AF3}}=\frac{\left[\frac{{\text{PEV}}_{\text{AF1}}}{{\text{Var(PEV}}_{\text{AF1}}\text{)}}\right]+\left[\frac{{\text{PEV}}_{\text{AF2}}}{{\text{Var(PEV}}_{\text{AF2}}\text{)}}\right]}{\frac{\text{1}}{{\text{Var(PEV}}_{\text{AF1}}\text{)}}+\frac{\text{1}}{{\text{Var(PEV}}_{\text{AF2}}\text{)}}}$ | Cov(u - $\widehat{\text{u}}$, $\widehat{\text{u}}$) = 0 Var(u) ≠ ${\sigma}_{\text{g}}^{\text{2}}$ | $\widehat{\text{u}}$, u - $\widehat{\text{u}}$, u | 4r^{4} (1 - r^{2})^{2} ${\sigma}_{\text{g}}^{4}$/n |
^{8}PEV_{AF4} = ${\sigma}_{\text{g}}^{\text{2}}$ - [Cov(u, $\widehat{\text{u}}$)/Var(u)] ${\sigma}_{\text{g}}^{\text{2}}$ | Cov(u, $\widehat{\text{u}}$) = Var($\widehat{\text{u}}$) Var(u) ≠ ${\sigma}_{\text{g}}^{\text{2}}$ | Cov(u, $\widehat{\text{u}}$), u | r^{2}(1-r^{2})${\sigma}_{g}^{2}$/n |
^{9}PEV_{NF1} = [1 - Cov(u, $\widehat{\text{u}}$)^{2}/(Var(u) × Var($\widehat{\text{u}}$))]${\sigma}_{\text{g}}^{\text{2}}$ | 4r^{2}(1-r^{2})^{2} ${\sigma}_{g}^{2}$/n | ||
^{10}PEV_{NF2} = {Var(u - $\widehat{\text{u}}$)/[Var($\widehat{\text{u}}$) + Var(u - $\widehat{\text{u}}$]}${\sigma}_{\text{g}}^{\text{2}}$ | Cov(u - $\widehat{\text{u}}$, $\widehat{\text{u}}$) = 0 | $\widehat{\text{u}}$ and u - $\widehat{\text{u}}$ | 4r^{4}(1-r^{2})^{2} ${\sigma}_{\text{g}}^{4}$/n |
Approximation of sampling variance of PEV
Formulae, based on Taylor series approximations, to predict the asymptotic sampling variances for each of the ten formulations of sampled PEV at different levels of PEV_{exact} are given in Table 1. The sampling variance can also be approximated stochastically using a number (e.g. 100) of independent replicates of the n samples or by applying a leave-one-out Jackknife [13, 14] to the n samples.
Application to test data set
Data and model
A data set containing 32,128 purebred Limousin animals with records for a trait (height) and a corresponding pedigree of 50,435 animals was extracted from the Irish Cattle Breeding Federation database. In the simulations the trait was assumed to have a ${\sigma}_{g}^{2}$ of 1.0 and residual variance ${\sigma}_{r}^{2}$ of 3.0. Fixed effects were contemporary group, technician who scored the animal, parity of dam, age of animal at scoring and sex.
Calculation of exact PEV
The PEV_{exact} were calculated for the extracted data set by setting up and solving the MME, with fixed effects of contemporary group, technician who scored the animal, parity of dam, and a second order polynomial of age of animal at scoring nested within sex, and random animal and residual effects, using the BLUP option in ASReml [17] which fully inverts the left hand side of the MME.
Sampled PEV
Following the Monte Carlo sampling procedure described above, 100,000 samples of the extracted data set were simulated assuming a ${\sigma}_{g}^{2}$ of 1.0 and ${\sigma}_{r}^{2}$ of 3.0. For each of the simulated data sets MME, using the same design matrix (X) as used when estimating the PEV_{exact}, were set up and solved using MiX99 [18]. The sampled PEV of the $\widehat{\text{u}}$ for each animal in the pedigree was approximated using the formulations of the sampled PEV described in Table 1 using n samples (n = 50, 100, ..., 950, 1000).
Stochastic approximations of the sampling variance of the sampled PEV were calculated using 100 independent replicates of the n samples, and using the leave-one-out Jackknife on n samples, for the different formulations, with the exception of PEV_{GC3} and PEV_{AF3}. To calculate the sampling variance for PEV_{GC3} and PEV_{AF3} using n independent replicates would have required more than 100,000 samples (due to the need to generate sampling variances of component formulations) generated for this study so therefore these were not considered. Asymptotic sampling variances for all ten formulations were calculated using the formulae in Table 1.
Alternative weighting strategies
Of the formulations presented in Table 1, PEV_{GC3} and PEV_{AF3} are weighted averages of PEV_{GC1} and PEV_{GC2} and of PEV_{AF1} and PEV_{AF2} respectively with the weighting dependent on the sampling variances of the component formulations. Garcia-Cortes et al. [10] suggest weighting by asymptotic approximations of the sampling variances. The sampling variances could also be approximated empirically using independent replicates of n samples or by leave-one-out Jackknife procedures [13, 14]. These alternative weighting strategies were compared by calculating sampling variances using 100 independent replicates of the n samples, using the n samples and a leave-one-out Jackknife procedure [14], and using the asymptotic sampling variances outlined in Table 1 as part of an iterative procedure, which involved two iterations. In the first iterations the asymptotic sampling variances were calculated using the PEV_{GC1} and PEV_{GC2} of the component formulations, in the second they used the PEV_{GC3} approximated in the first iteration.
Calculation of required variances and covariances
where n are the number samples at any stage in the updating procedure and T and S are the sum and sum of squares of the data points 1 through n. It was modified to calculate the covariances between X and Y by changing ${\left[\left(\raisebox{1ex}{${T}_{n-1}$}\!\left/ \!\raisebox{-1ex}{$n-1$}\right.\right)-{x}_{i}\right]}^{2}$ to $\left[\left(\raisebox{1ex}{${T}_{{x}_{n-1}}$}\!\left/ \!\raisebox{-1ex}{$n-1$}\right.\right)-{x}_{i}\right]\times \left[\left(\raisebox{1ex}{${T}_{{y}_{n-1}}$}\!\left/ \!\raisebox{-1ex}{$n-1$}\right.\right)-{y}_{i}\right]$. Both of these algorithms were tested using one replication of 100,000 samples and found to be stable.
Results
As the ${\sigma}_{g}^{2}$ was taken to be 1.0, the PEV ranged between 0.00 and 1.0. For the purpose of categorizing the results PEV with values between 0.00 and 0.33 were regarded as low, values between 0.34 and 0.66 were regarded as medium, and values between 0.67 and 1.00 were regarded as high.
Henderson [20] showed that it is much easier to form A^{-1} than A, where A is the numerator relationship matrix among animals. This follows from the fact that, if the individuals are listed with ancestors above descendants, A can be written as TMT' where M is a diagonal matrix and T is a lower triangular matrix with non-zero diagonal elements and i, j th elements that are non-zero if the j th individual is an ancestor of the i th [21]. The matrix T has a simple inverse with both the diagonal elements and i, j th elements being non-zero if the j th individual is a parent of the i th individual. Hence A has a simple inverse. It is interesting to note that an animal effect can be written as an accumulation of independent terms from its ancestors ${u}_{i}=\frac{\left({u}_{si}+{u}_{di}\right)}{2}+{m}_{i}$, where u_{ si }and u_{ di }are the additive genetic effects of the sire and dam of animal i and m_{ i }is the Mendelian sampling effect with variance ${A}_{{m}_{i}}=\frac{\left(1-{F}_{i}\right)}{2}{\sigma}_{g}^{2}$, where F_{ i }is the average inbreeding of the parents of animal i. Hence there is a simple recursive procedure for generation of the additive effects u_{ i }by generating independent Mendelian sampling terms m_{ i }with diagonal variance matrix ${A}_{{m}_{i}}$.
General trends of sampled PEV
Comparison of formulations
Intercept, slope, R^{2}, and root mean squared error (RMSE) of regressions of exact prediction error variance on sampled prediction error variance approximated using one of 10 different formulations of the prediction error variance using 300 samples, for 18,855 non-inbred animals
PEV_{exact} | PEV_{GC1} | PEV_{GC2} | PEV_{GC3} | PEV_{FL} | PEV_{AF1} | PEV_{AF2} | PEV_{AF3} | PEV_{AF4} | PEV_{NF1} | PEV_{NF2} | |
---|---|---|---|---|---|---|---|---|---|---|---|
Intercept | 0.00–0.33 | 0.09 | 0.01 | 0.01 | 0.09 | 0.05 | 0.02 | 0.01 | 0.02 | 0.01 | 0.01 |
0.34–0.66 | 0.26 | 0.32 | 0.17 | 0.31 | 0.27 | 0.30 | 0.18 | 0.18 | 0.29 | 0.17 | |
0.67–1.00 | 0.09 | 0.29 | 0.06 | 0.05 | 0.09 | 0.06 | 0.02 | 0.02 | 0.04 | 0.04 | |
Slope | |||||||||||
0.00–0.33 | 0.62 | 0.90 | 0.93 | 0.62 | 0.77 | 0.89 | 0.93 | 0.93 | 0.91 | 0.95 | |
0.34–0.66 | 0.57 | 0.43 | 0.71 | 0.47 | 0.54 | 0.48 | 0.68 | 0.69 | 0.49 | 0.71 | |
0.67–1.00 | 0.91 | 0.67 | 0.94 | 0.95 | 0.91 | 0.93 | 0.98 | 0.97 | 0.96 | 0.96 | |
R ^{2} | 0.00–0.33 | 0.65 | 0.94 | 0.95 | 0.65 | 0.76 | 0.91 | 0.95 | 0.94 | 0.93 | 0.95 |
0.34–0.66 | 0.59 | 0.43 | 0.68 | 0.49 | 0.54 | 0.48 | 0.67 | 0.69 | 0.49 | 0.70 | |
0.67–1.00 | 0.96 | 0.64 | 0.97 | 0.97 | 0.95 | 0.90 | 0.98 | 0.98 | 0.92 | 0.98 | |
RMSE | 0.00–0.33 | 0.05 | 0.02 | 0.02 | 0.05 | 0.04 | 0.03 | 0.02 | 0.02 | 0.02 | 0.02 |
0.34–0.66 | 0.03 | 0.03 | 0.02 | 0.03 | 0.03 | 0.03 | 0.02 | 0.02 | 0.03 | 0.02 | |
0.67–1.00 | 0.02 | 0.06 | 0.02 | 0.02 | 0.02 | 0.03 | 0.01 | 0.02 | 0.03 | 0.01 |
PEV_{GC1} and PEV_{FL} gave good approximations for high PEV_{exact} and poor approximations for low PEV_{exact}. PEV_{GC2} gave good approximations for low PEV_{exact} and poor approximations for high PEV_{exact}. Improving the published formulations by correcting for the effects of sampling resulted in better approximations in areas where the published formulations were weak. Slight (dis)improvements were observed where the previously published formulations were strong. Of the new formulations PEV_{NF1} gave poor approximations and PEV_{NF2} gave good approximations.
Coefficients of regressions of PEV_{GC3}and PEV_{AF3} (sampling variances calculated empirically) on PEV_{GC3} and PEV_{AF3} (sampling variances calculated using Jackknife) and on PEV_{GC3} and PEV_{AF3} (sampling variances calculated asymptotically and weighting done iteratively)
Jackknife | Asymptotic | |||
---|---|---|---|---|
PEV_{GC3} | PEV_{AF3} | PEV_{GC3} | PEV_{AF3} | |
Intercept | 0.00 | 0.00 | 0.00 | 0.01 |
Slope | 1.00 | 1.00 | 1.00 | 1.00 |
R ^{2} | 1.00 | 1.00 | 1.00 | 1.00 |
RMSE | 0.01 | 0.00 | 0.00 | 0.01 |
Required number of samples
The formulations PEV_{GC3}, PEV_{AF3}, PEV_{AF4}, and PEV_{NF2} gave similar approximations and had the lowest sampling variance. Even when a few samples (n = 50) were used, low and high PEV were well approximated and intermediate PEV_{exact} were poorly approximated. Correlations between PEV_{NF2} and PEV_{exact} were 0.88 for low, 0.96 for high PEV_{exact} and 0.51 for intermediate PEV_{exact}. To increase the correlation for intermediate PEV_{exact} to at least 0.90 at least 550 samples was needed. At this number of samples the correlations for low and high PEV_{exact} were ≥ 0.99. To obtain a satisfactory level of convergence 300 samples were sufficient.
Discussion
Differences between formulations
With infinite samples the Var(u) is equal to the ${\sigma}_{g}^{2}$, but due to sampling error resulting from using a limited number of samples this not likely to be true in practice. Therefore each of the alternative formulations makes use of information on the Var(u) in addition to making use of information on either/or/both of the Var($\widehat{\text{u}}$) and the Var(u - $\widehat{\text{u}}$) or the Cov(u, $\widehat{\text{u}}$). The Var($\widehat{\text{u}}$) = Cov(u, $\widehat{\text{u}}$) when the Cov((u - $\widehat{\text{u}}$), $\widehat{\text{u}}$) = 0. The Var($\widehat{\text{u}}$) ≠ Cov(u, $\widehat{\text{u}}$) when the Cov((u - $\widehat{\text{u}}$), $\widehat{\text{u}}$) ≠ 0.
Competitive formulations
Of the ten different approaches four competitive formulations, PEV_{GC3}, PEV_{AF3}, PEV_{AF4}, and PEV_{NF2}, were identified. These gave similar approximations. Of the four, two, PEV_{GC3} and PEV_{AF3}, were weighted averages of component formulations. The weighting was based on the sampling variances of their component formulations. These sampling variances can be calculated using a number of independent replicates, using Jackknife procedures, or asymptotically. Each of these approaches gave almost identical results but the Jackknife and asymptotic approaches were far less computationally demanding.
Computational time
A single BLUP evaluation for the routine Irish multiple breed beef genetic cattle evaluation (January 2007) which included a pedigree of 1,500,000 and 493,092 animals with performance records on at least one of the 15 traits could be run using MiX99 [18] in 366 min on a 64 bit PC, with a 2.40 GHz AMD Opteron dual-core processor and 8 gigabytes of RAM [12]. Using n = 300 samples and PEV_{NF2} the accuracy of the estimated breeding values could be estimated in 1,830 hours on a single processor. Several samples can be solved simultaneously on multiple processors thereby reducing computer time. Nowadays PC's are available that contain two quad core 64 bit processors (i.e. 8 CPU's) and cost approximately 5,000 euro. Using six of these PC's the accuracy of estimated breeding values for the Irish data set could be estimated in less than 38.1 h.
Application
The Monte Carlo sampling approach using one of these four competitive formulations can be used to improve many tasks in animal breeding. Stochastic REML algorithms [e.g. [9]] can be improved in terms of speed of calculation using these formulations, therefore allowing variance components to be estimated using REML in large data sets. These REML formulations are usually written in terms of additive genetic effects u'A^{-1}u and trace [A^{-1}PEV], where PEV is the prediction error covariance matrix for the estimated breeding values. The results of Henderson [22] show how the REML formulations can be equivalently written as in terms of Mendelian sampling effects m m'A^{-1}m and trace [A_{ m }^{-1}PEV_{ m }], where PEV_{ m }is the prediction error covariance matrix for the Mendelian sampling effects. As A_{ m }is diagonal we see that we only need to compute the sampling variances of the Mendelian sampling terms. When the sampling was carried out in this study we, in error, did not correct the Mendelian sampling terms for inbreeding. We therefore have only reported results for non-inbred animals and think that the incorrect generation will have a minimal effect on the sampling variances, which are presented as an empirical check on the formulae. There may be circumstances where a Stochastic REML approach may be faster than Gibbs sampling and have less bias than Method R [23]. Calculating variance components using more complete data sets would facilitate a reduction in the bias of estimated variance components caused by the ignoring of data on which selection has taken place in the population [12], due to computational limitations. Calculation of unbiased accuracy of within breed [8] and across breed [12] estimated breeding values can be improved by reducing the computational time required of calculation or reducing the sampling error for a given computational time. Application of an algorithm controlling the variance of response to selection [24] to large data sets can be speeded up. The variance of response to selection is a risk to breeding programs [3], which is generally not explicitly controlled using the approach outlined by Meuwissen [24] due to the inability to generate a prediction error (co)variance matrix for large data sets.
Computational power is a major limitation of stochastic methods, particularly when large data sets are involved, however this is dissipating rapidly with the improvement in processor speed, parallelization, and the adoption of 64-bit technology, however in the meantime deterministic methods will continue to be used for large scale BLUP analysis.
Conclusion
PEV approximations using Monte Carlo estimation were affected by the formulation used to calculate the PEV. The difference between the formulations was small when the number of samples increased, but differed depending on the level of the exact PEV and the number of samples. Rescaling from the scale of Var(u) to the scale of ${\sigma}_{g}^{2}$ improved the approximation of the PEV and four of the 10 formulations gave the best approximations of PEV_{exact} thereby improving the efficiency of the Monte Carlo sampling procedure for calculating the PEV. The fewer samples that are required the less the computational time will be.
Declarations
Acknowledgements
The authors acknowledge the Irish Cattle Breeding Federation for providing funding and data. Robin Thompson acknowledges the support of the Lawes Agricultural Trust.
Authors’ Affiliations
References
- Henderson CR: Best linear unbiased estimation and prediction under a selection model. Biometrics. 1975, 31: 423-447. 10.2307/2529430.View ArticlePubMedGoogle Scholar
- Patterson HD, Thompson R: Recovery of inter-block information when block sizes are unequal. Biometrika. 1971, 58: 545-554. 10.1093/biomet/58.3.545.View ArticleGoogle Scholar
- Meuwissen THE, Woolliams JA: Maximizing genetic response in breeding schemes of dairy cattle with constraints on variance of response. J Dairy Sci. 1994, 77: 1905-1916.View ArticlePubMedGoogle Scholar
- Lidauer M, Vuori K, Stranden I, Mantysaari E: Experiences with Interbull Test IV: Estimation of genetic variance. Proceedings of the Interbull Annual Meeting: Dublin, Ireland. 2007, 37: 69-72.Google Scholar
- Harris B, Johnson D: Approximate reliability of genetic evaluations under an animal model. J Dairy Sci. 1998, 81: 2723-2728.9.View ArticlePubMedGoogle Scholar
- Tier B, Meyer K: Approximating prediction error covariances among additive genetic effects within animals in multiple-trait and random regression models. J Anim Breed Genet. 2004, 121: 77-89. 10.1111/j.1439-0388.2003.00444.x.View ArticleGoogle Scholar
- Jensen J, Mao IL: Transformation algorithms in analysis of single trait and of multitrait models with equal design matrices and one random factor per trait: a review. J Anim Sci. 1988, 66: 2750-2761.Google Scholar
- Fouilloux MN, Laloë D: A sampling method for estimating the accuracy of predicted breeding values in genetic evaluation. Genet Sel Evol. 2001, 33: 473-486. 10.1051/gse:2001128.PubMed CentralView ArticlePubMedGoogle Scholar
- Garcia-Cortes LA, Moreno C, Varona L, Altarriba J: Variance component estimation by resampling. J Anim Breed Genet. 1992, 109: 358-363.View ArticleGoogle Scholar
- Garcia-Cortes LA, Moreno C, Varona L, Altarriba J: Estimation of prediction error variances by resampling. J Anim Breed Genet. 1995, 112: 176-182.View ArticleGoogle Scholar
- Thompson R: Integrating best linear unbiased prediction and maximum likelihood estimation. Proceedings of the 5th World Congress on Genetics Applied to Livestock Production: Guelph, Canada. 1994, 18: 337-340.Google Scholar
- Hickey JM, Keane MG, Kenny DA, Cromie AR, Mulder HA, Veerkamp RF: Estimation of accuracy and bias in genetic evaluations with genetic groups using sampling. J Anim Sci. 2008, 86: 1047-1056. 10.2527/jas.2007-0653.View ArticlePubMedGoogle Scholar
- Efron B: Bootstrap methods: another look at the jackknife. Ann Stat. 1979, 7: 1-26. 10.1214/aos/1176344552.View ArticleGoogle Scholar
- Tukey J: Bias and confidence in not quite large samples. Ann Math Statist. 1958, 29: 614-10.1214/aoms/1177706647.View ArticleGoogle Scholar
- Klassen DJ, Smith SP: Animal model estimation using simulated REML. Proceedings of the 4th World Congress on Genetics Applied to Livestock Production: Edinburgh. 1990, 12: 472-475.Google Scholar
- Thallman RM, Taylor JF: An indirect method of computing REML estimates of variance components from large data sets using an animal model. J Dairy Sci. 1991, 74 (Suppl 1): 160-Google Scholar
- Gilmour AR, Cullis BR, Welham SJ, Thompson R: ASReml User Guide (Release 2). 2006, VSN International, Hemel Hempstead, HP1 1ES, UKGoogle Scholar
- Lidauer M, Stranden I, Vuori K, Mantysaari E: MiX99 User Manual. 2006, MTT, Jokioinen, FinlandGoogle Scholar
- Chan TF, Golub GH, LeVeque RJ: Algorithms for computing the sample variance: analysis and recommendations. Am Stat. 1983, 37: 242-247. 10.2307/2683386.Google Scholar
- Henderson CR: A simple method for computing the inverse of a numerator relationship matrix used in prediction of breeding values. Biometrics. 1976, 32: 69-10.2307/2529339.View ArticleGoogle Scholar
- Thompson R: Sire evaluation. Biometrics. 1979, 35: 339-353. 10.2307/2529955.View ArticleGoogle Scholar
- Henderson CR: Applications of Linear Models in Animal Breeding. 1984, Guelph, Ontario, Canada, University of GuelphGoogle Scholar
- Reverter A, Golden BL, Bourdon RM, Brinks JS: Method R variance components procedure: application on the simple breeding value model. J Anim Sci. 1994, 72: 2247-2253.PubMedGoogle Scholar
- Meuwissen TH: Maximizing the response of selection with a predefined rate of inbreeding. J Anim Sci. 1997, 75: 934-940.PubMedGoogle Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.