Skip to main content

A fast algorithm for estimating transmission probabilities in QTL detection designs with dense maps



In the case of an autosomal locus, four transmission events from the parents to progeny are possible, specified by the grand parental origin of the alleles inherited by this individual. Computing the probabilities of these transmission events is essential to perform QTL detection methods.


A fast algorithm for the estimation of these probabilities conditional to parental phases has been developed. It is adapted to classical QTL detection designs applied to outbred populations, in particular to designs composed of half and/or full sib families. It assumes the absence of interference.


The theory is fully developed and an example is given.


Experimental designs used for mapping QTL in livestock based on linkage analysis techniques generally comprise two or three generations. The younger generation consists of large offsprings (either half sib only or mixture of half and full sib) measured on quantitative traits to be dissected. This generation and in most cases their parents are genotyped for a set of molecular markers. Genotyping an older generation (the grand parents) helps the determination of parents' phases, an information essential to linkage analysis. QTL detection is a multiple step procedure. First the parental phases must be determined from grand parental and/or progeny genotype information, either looking for their most probable phase, or building all possible phases and computing their probabilities. Then transmission probabilities of chromosomal segments from the parents to the progeny must be estimated conditional to the phases. Finally a test statistic (e.g. F or likelihood ratio test), based on a given model (e.g. regression, mixture model, variance component model...) is performed at each putative QTL position on the chromosomal segments traced. In crosses between inbred lines, the transmission probabilities are simply obtained, as described by [1], from the information given by markers flanking the QTL. In outbred populations, the computation is not straightforward, due to the variability of marker informativity between families and within families between progenies. In [2, 3], the transmission probabilities were estimated conditionally to the sole flanking markers. [47] used a direct algorithm where all types of gametes corresponding to a linkage group are successively considered: if L markers are heterozygous in the parent, 2Lgametes may be produced. This procedure is simple and computationnally fast for a small number of linked markers, but not feasible as soon as their number exceeds about 15. The difficulty can be circumvented in Bayesian approaches using MCMC techniques where these probabilities need not to be explicitly computed (e.g. [8]).

Nettelblad and colleagues [9] recently proposed a simple algorithm, which makes the transmission probabilities easily computable even for a large number of markers. In their approach the full length of the linkage group is still considered. A new algorithm, similar to the principle of [9] but exploring the minimum number of useful markers, was implemented in QTLMap software developed by INRA ([10]). Here, we describe and illustrate this algorithm.

Hypotheses. Notations. Objective

Progeny p was born from sire s and dam d. All were genotyped at L loci (M l , l = 1 L). The location of M l on the linkage group, i.e. its distance from one end of this group, is x(M l ) centiMorgan, also denoted x l . The hypothesis of absence of interference is made, allowing the Haldane distance function to be used.

The recombination rate between locus l1 and l2 will be noted , l2. Using the Haldane distance, . When distances vary with sex, the superscript m (for males) or f (for females) will be used for x l and , l2.

Let the lthmarker information be for the sire, for the dam, allele for the progeny. In P ilk , i = s, d or p, the subscript k (k = 1, or 2) denotes the kthallele read in the records file.

The probabilities of transmission of a chromosomal segment from the parents to the progeny are estimated conditional to parental phases. A phase of parent i (s or d) is characterised by a particular order of its marker phanotypes P i = {P ilk }, for loci l = 1 to L, giving G i = {G ilk } where k = 1 means the grand sire allele and k = 2 the grand dam allele. If grand parental origins cannot be built, one of the alleles of the first heterozygous marker in the parent to be phased is arbitrary assigned the subscript k = 1.

Let T(M l ) be the transmission event for marker l, and T(M) the vector of transmission events on the linkage group: T(M) = {T(M1), T(M2) T(M L )}. T(M s ) and T (M d ) are respectively the transmission events from the sire and from the dam to the progeny. T(M il ) = k if the progeny received G ilk , i = s or d. If the grand parental origins are known, progeny p may have received alleles from both its grand sires (T(M sl ) = 1 and T(M dl ) = 1, thus T(M l ) = 11), from its paternal grand sire and maternal grand dam (T(M l ) = 12), from its paternal grand dam and maternal grand sire (T(M l ) = 21), or from both its grand dams (T(M l ) = 22). The probabilities of the transmission events, given the marker phenotypes and parental phases are listed in Table 1 for a biallelic marker.

Table 1 P[T(M l ) | G sl , G dl , P pl ]: Probabilities of the transmission events, given the marker phenotypes and parental phases, in the case of a biallelic marker (a, b alleles)

The 16 situations described in Table 1 belong to five types:

  • Type 'ksd' : Transmission fully known for both parents (cases 1 to 4),

  • Type 'ks 0': Transmission known for the sire only (cases 5 to 8),

  • Type 'k 0d': Transmission known for the dam only (cases 9 to 12),

  • Type 'k 00': Unknown Transmission (cases 13 and 14),

  • Type 'amb': Ambiguous Transmission (case 15 and 16).

The amb type corresponds to fully heterozygous trios. It is essential to note that this is the only type of marker phenotypes for which the sire and dam transmissions are not independent (e.g. in situation 15, if sire transmits 1, dam transmits 2 and the reverse).

When the information about one or both parents is missing the conditionnal probability of T(M l ) most often corresponds to the k 00 type [1/4, 1/4, 1/4, 1/4]. However, when only one parent possesses a marker phanotype and is phased heterozygous (a, b), the probabilities are [1/2, 0, 1/2, 0] if P pl = (a, a) and [0, 1/2, 0, 1/2] if P pl = (b, b).

Two properties of the transmission probabilities must be underlined:

Property 1: Marginally to the marker phenotype, the sire and dam transmission events are independent: P[T(M l )] = P[T(M sl )].P[T(M dl )].

Property 2: Due to the no interference hypothesis, the transmission events follow a Markovian process described by:

Note that property 2 is also valid when considering subsets of M, M b and M a , allowing an independent estimation of probabilities before and after a given marker M c . If M = {M b , M c , M a },

At any position x for a QTL, four grand parental origins are possible for the chromosomal segment Q x inherited by the progeny. Let q = (q s , q d ), (q = (11), (12), (21) or (22)), the origin of Q x .

The objective is to estimate P x (q) = P[T (Q x ) = q | G s , G d , P p ], the probability of q given the marker information.

To minimize the computation, two procedures are presented: the first one is an iterative exploration of the linkage group, the second a reduction of this group within bounds specific of the tested position x.

Iterative exploration of the linkage group

The observed marker phenotypes and parents' phases can be consistent with different transmission events T(M). All these events must be considered in turn when evaluating the QTL transmission T(Q x ). For a given marker transmission event, markers must be successively considered, the no interference hypothesis allowing an iterative estimation of the probability.

Proposition 1 : Let Ω be the domain, for the progeny p, of transmissions T(M) consistent with the observations G s , G d and P p . The transmission probability P x (q) is given by:


This is obtained after very simple algebra (see appendix).

The domain Ω is obtained listing possible transmissions. If Ω l is the consistent domain for marker l, the Ω domain is formed of nested domains Ω1 Ω2 Ω L ·Ω l is directly obtained from Table 1: it is formed of transmission events the probability of which are not nul. For instance, if G s = aa, G d = ab and P p = aa, then Ω l = {11, 12}.

In the following we shall note SΩ = ∑T(M)ΩP[T(M)] and TΩ = ∑T(M)ΩP[T(Q x ) = q, T(M)].

Proposition 2 : The summation SΩ = ∑T(M)ΩP[T(M)] in (1) can be obtained recursively with the following algorithm:


This is obtained under the hypothesis of absence of interference (see appendix).

Note 1: the numerator of (1) is obtained similarly, considering the extended domain Ω* = Ω1 Ω2 Ω x Ω L , with Ω x = q.

Note 2: The P[T(M l ) | T(Ml-1)] are simply obtained as given in Table 2, for k = l - 1.

Table 2 Transmission probability at locus l given the transmission at locus k: P[T(M l ) | T(M k )]

They may be summarized by a single formulae. Let θr, i, j = 1 - r - (1 - 2r).(i - j)2,

Note 3: System (2) may be generalized to any subdivision of the linkage group M, M = {M1, M2, M G }, defining T(M g ), g = 1 G, as the vector of T(M l ), l M g .

Reduction of the linkage group

The set of markers M = {M l , l = 1 L} may be sequenced as M = {M a , M α , M c , M β , M b } where M c is a subset of interest, M β and M α its flanking markers, and M b and M a all the remaining markers before and after the area (M α , M c , M β ). We now propose three simplifications of the summation SΩ = ∑T(M)ΩP[T(M)].

Proposition 3 : In the summation SΩ, the type k 00 markers can be ignored, i.e. they may be bypassed in the iterative system (2).

Here M c is a single k 00 type marker. Proposition 3 means (see appendix for a demonstration) that, in (2), the sequence:

which corresponds to two iterations, may be replaced by:

Proposition 4: In the summation SΩ, the elements corresponding to the unknown parental transmission for types k 0d or ks 0 markers can be ignored, i.e. they may be bypassed in the iterative system (2).

Here M c is a single ks 0 or k 0d type marker. Proposition 4 means (see appendix for a demonstration) that, in (2), the sequence

which corresponds to two iterations, may be replaced by (successively k 0d and ks 0 markers):

Corollary 1: In the summation SΩ, a sequence M c of markers all belonging to "k" types (i.e. non amb) appears as a single element where only the certain transmissions are involved.

From propositions 3 and 4,

where the markers subscripted j s (= 1 J s ) are successive markers belonging to ksd or ks 0 types, and the markers subscripted j d (= 1 J d ) to ksd or k 0d types in the sequence M c .

Definition : A series of markers N = {M α , M c , M β } starting with a ks 0 (resp. k 0d) type marker {M α }, ending with a k 0d (resp. ks 0) type marker {M β }, and only with k 00 type markers between those bounds (in M c ) will be called a sd-node (resp. ds-node).

Proposition 5: If the sequence N = {M α , M c , M β } of M is a sd-node, the summation SΩ may be separated in three terms corresponding to [M b /M βs , M αd ], [M βs , M αd ], and [M a /M βs , M αd ] Proposition 5 means (see appendix for a demonstration) that, in (2), SΩ is obtained by

Note 4: The {M β , M c , M α } sequence may be reduced to a single marker M γ if it belongs to the ksd type. In this case,

In general we shall note T(N) the transmission event for a node, {T(M ), T (M )}, {T(M ), T(M )} or T(M γ ).

Corollary 2: If the tested QTL position x is located in segment M c between two nodes N1 and N2, only the markers belonging to the interval [N1, N2] have to be considered when computing the transmission probability P[T(Q x ) = q | G s , G d , P p ], see appendix, giving:



Based on the propositions and corollaries developed above, an algorithm for the computation of transmission probabilities of the chromosomic segment x can be given.

  1. 1.

    From the position x, the markers are explored towards the left until a node (a ksd type marker or a pair of markers one of ks 0 and the other of k 0d type, separated only by k 00 type markers) or the extremity of the linkage group is found. Let T(N l ) be the transmission events for the left node N l . P[T(N l )] = 1/4.

  2. 2.

    From the position x, the markers are explored towards the right until a node or the extremity of the linkage group is found. Let T(N r ) be the transmission events for the right node N r . P [T (N r )] = 1/4. The only necessary informative segment for x in the full linkage group is {N l , N r }.

  3. 3.

    Let the amb type markers in {N l , N r }. Together with N l and N r , the delimit n + 1 intervals I k , which may be empty or include k 00, ks 0 or k 0d type markers. The reduced summation , see (the part of S Ω which differs from T Ω and has to be used in see appendix) is computed iteratively:


    It must be underlined that there is no node between two adjacent amb type markers of the informative segment {N l , N r }, since this segment ends at the first node found on both sides. As a consequence, neither a ksd marker type nor a mixture of ks 0 and k 0d types markers could be found between the ambiguous markers M(a k ) and M(ak+1): the I k interval may be classified as K 00 (only k 00 types markers), Ks 0 (one or more ks 0 type markers, no k 0d type marker and any number of k 00 type markers) or K 0d (the reverse).

  4. 4.

    Let and be two successive amb markers, in the iterative process (4), the probabilities P [T()/T()] are given by

    where θr, i, j = 1 - r - (1 - 2r).(i - j)2.

  5. 5.

    The reduced summation is computed iteratively adding the T(Q x ) transmission in the list of transmission {T[N l ], T[], , T[], T[N r ]}.

  6. 6.

    The transmission probability P[T(Q x ) = q | G s , G d , P p ] = .

Note 5 : The algorithm can be organised scanning the interval {N l , N r } from the left to the right rather than from the right to the left as described above.


A linkage group of eight markers is available (Figure 1). Markers M2 and M6 are ambiguous, with types 15 and 16. Markers 1 and 8 are fully informative (types 1 and 2), the other markers are semi informative. The tested position for the QTL x is located between markers 4 and 5. The nodes are, on the left, marker 1 (ksd type) and on the right, the group M7 - M8. Thus the informative segment here is the full group. Steps of the proposed algorithm are detailed Table 3.

Table 3 Calculation of the marker transmission probability corresponding to the example in Figure 1
Figure 1
figure 1

Example of a linkage group with 8 markers including 2 ambigous. The figure represents a chromosome with eight markers. Two (M2 and M6) are ambiguous (For M2, the progeny received either the 1stallele of its sire and 2ndallele of its dam, or the 2ndof its sire and 1stof its dam. The nodes are, on the left, the first marker, and on the right, markers M7 and M8. The dark (respectively white) circles represent markers with a known (respectively unknown) grand parental origin.

Discussion - Conclusion

The algorithm presented in this paper to estimate the transmission probability of QTL from parents to progeny needs only very limited computational resources, both in terms of time and space. Complementary to the algorithm presented by Nettleblad and colleagues (2009), it limits the exploration of the linkage group to the markers really informative for a given position to be traced, and thus performs faster. As [9], it deals with sex differences between recombination rates.

The QTL transmission probability is estimated conditionnaly to the observed transmission at the surrounding markers loci. The algorithm does not make use of possible information about the marker allele frequencies to fill potential information gaps.

The major difficulty addressed in this algorithm is the non independence of transmission events from the sire and the dam to the progeny in triple heterozygous trios. In the absence of such trios, the transmission from the parents are fully independent and may be treated separately simply by considering the flanking informative markers. This is the case for QTL located on the sex chromosome X or W.

The algorithm has been developed in the framework of QTL detection designs involving two or three generations in outbred populations. It has been implemented in QTLMap, a software for the analysis of such designs. QTLMap is available upon request to the authors.

In more complex pedigrees, the transmission probability should not be conditioned only on parents phases and progeny marker phanotypes. Information from the grand progeny (and the spouses lineages) may improve the estimation, since the progeny phase can be inferred, at least partially, from these data. A recursive process inspirated from [3] should possibly be implemented.

The transmission probabilities are estimated conditionally to parental phases. In linear approaches (e.g. the Haley Knott regression), if more than one phase is probable, the marginal transmission probability could be estimated considering all of them in a weighted sum of conditional probabilities. Alternatively, the only most probable phase could be considered [11].

The absence of interference hypothesis is central in the present algebra. If this is not true, then most of the propositions are not valid and the algorithm not applicable.

Finally, compared to the most common codominant markers, dominant markers will be characterized by a lower informativity, with an increase of the between nodes segment length and a concomitant decrease of the transmission probability.

Appendix: Demonstration of the propositions and corollary

Proposition 1: P[T(Q x ) = q | G s , G d , P p ] =

And, similarly, P[T(Q x ) = q, P p | G s , G d ] = P[T(Q x ) = q, T(M)] if T(M) Ω, = 0 if not

Proposition 2

Due to the no interference hypothesis, the transmission events follow a Markovian process described by:


The summations may be inverted:


Proposition 3

With an argument similar to the demonstration of proposition 2, the sum SΩ may be expressed as:



As Ω c forms a complete set of events, since all transmissions are possible,


Proposition 4

In the equation(A1), we have, from property 1,

Without loss of generality, we assume that the parent with unknown transmission at M c is the sire. There is a unique consistent T(M dc ), and the 2 possible T(M sc ) form a complete set of events, thus:

The simplification of F[T(M β )] follows:

Proposition 5

When M c contains markers of k 00 type, they can be forgotten following proposition 3. We thus assume that the M c group is empty, and the linkage group is described as M = {M b , M β , M α , M a }

But P[T(M b ), T(M d β ) | T(M s β ), T(M α ), T(M a )] = P[T(M b ), T(M ) | T(M ), T (M )]


Corollary 2

Let M = {M b , N l , M c , N r , M a }, with x(N l ) ≤ xx(N r )

From proposition 5, assuming both nodes N l and N r are sd-nodes,

From proposition 5 again,

The elements and being also present in the numerator TΩ of (1) they can be forgotten.

The summation SΩ may be reduced to :



  1. Lander ES, Botstein D: Mapping mendelian factors underlying quantitative traits using RFLP linkage maps. Genetics. 1989, 121: 185-199.

    PubMed Central  CAS  PubMed  Google Scholar 

  2. Liu JM, Jansen GB, Lin CY: The covariance between relatives conditional on genetic markers. Genet Sel Evol. 2002, 34: 657-678. 10.1186/1297-9686-34-6-657.

    PubMed Central  CAS  Article  PubMed  Google Scholar 

  3. Pong-Wong R, George AW, Woolliams JA, Haley CS: A simple and rapid method for calculating identity-by-descent matrices using multiple markers. Genet Sel Evol. 2002, 33: 453-471. 10.1186/1297-9686-33-5-453.

    Article  Google Scholar 

  4. Haley CS, Knott SA, Elsen JM: Mapping quantitative trait loci in crosses between outbred lines using least squares. Genetics. 1994, 136: 1195-1207.

    PubMed Central  CAS  PubMed  Google Scholar 

  5. Knott SA, Elsen JM, Haley CS: Methods for multiple marker mapping of quantitative trait loci in half-sib populations. Theor Appl Genet. 1996, 93: 71-80. 10.1007/BF00225729.

    CAS  Article  PubMed  Google Scholar 

  6. Elsen JM, Mangin B, Goffinet B, Boichard D, Le Roy P: Alternative models for QTL detection in livestock - 1 General introduction. Genet Sel Evol. 1999, 31: 213-224. 10.1186/1297-9686-31-3-213.

    PubMed Central  Article  Google Scholar 

  7. Le Roy P, Elsen JM, Boichard D, Mangin B, Bidanel JP, Goffinet B: An algorithm for QTL detection in mixture of full and half sib families. Proceedings of the 6th World Congress on Genetics Applied to Livestock Production: 12-16 January 1998; Armidale Australia. 1998

    Google Scholar 

  8. Totir LR, Fernando RL, Dekkers JC, Fernández SA, Guldbrandtsen B: A comparison of alternative methods to compute conditional genotype probabilities for genetic evaluation with finite locus models. Genet Sel Evol. 2003, 35: 585-604. 10.1186/1297-9686-35-7-585.

    PubMed Central  CAS  Article  PubMed  Google Scholar 

  9. Nettelblad C, Holmgren S, Crooks L, Carlborg O: cnF2freq: Efficient Determination of Genotype and Haplotype Probabilities in Outbred Populations Using Markov Models. BICoB. 2009, 307-319.

    Google Scholar 

  10. Elsen JM, Filangi O, Gilbert H, Legarra A, Le Roy P, Moreno C: QTLMap: a software for the detection of QTL in full and half sib families. Proceedings of the EAAP Annual meeting 24-27 August 2009; Barcelona. 2009

    Google Scholar 

  11. Windig JJ, Meuwissen THE: Rapid haplotype reconstruction in pedigrees with dense marker maps. J Anim Breed Genet. 2004, 121: 2639-10.1046/j.1439-0388.2003.00439.x.

    Article  Google Scholar 

Download references


Financial support of this work was provided by the EC-funded FP6 Project "SABRE".

Author information

Authors and Affiliations


Corresponding author

Correspondence to Jean-Michel Elsen.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

JME drafted the manuscript. All authors participated in the development of the method and read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Elsen, JM., Filangi, O., Gilbert, H. et al. A fast algorithm for estimating transmission probabilities in QTL detection designs with dense maps. Genet Sel Evol 41, 50 (2009).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI:


  • Linkage Group
  • Transmission Probability
  • Parental Phasis
  • Type Marker
  • Transmission Event