Recent from talks
Contribute something
Nothing was collected or created yet.
Division algorithm
View on WikipediaA division algorithm is an algorithm which, given two integers N and D (respectively the numerator and the denominator), computes their quotient and/or remainder, the result of Euclidean division. Some are applied by hand, while others are employed by digital circuit designs and software.
Division algorithms fall into two main categories: slow division and fast division. Slow division algorithms produce one digit of the final quotient per iteration. Examples of slow division include restoring, non-performing restoring, non-restoring, and SRT division. Fast division methods start with a close approximation to the final quotient and produce twice as many digits of the final quotient on each iteration.[1] Newton–Raphson and Goldschmidt algorithms fall into this category.
Variants of these algorithms allow using fast multiplication algorithms. It results that, for large integers, the computer time needed for a division is the same, up to a constant factor, as the time needed for a multiplication, whichever multiplication algorithm is used.
Discussion will refer to the form , where
- N = numerator (dividend)
- D = denominator (divisor)
is the input, and
is the output.
Division by repeated subtraction
[edit]The simplest division algorithm, historically incorporated into a greatest common divisor algorithm presented in Euclid's Elements, Book VII, Proposition 1, finds the remainder given two positive integers using only subtractions and comparisons:
function divide_unsigned(N, D)
if D = 0 then error(DivisionByZero) end
R := N
Q := 0
while R ≥ D do
R := R − D
Q := Q + 1
end
return (Q, R)
end
The proof that the quotient and remainder exist and are unique (described at Euclidean division) gives rise to a complete division algorithm, applicable to both negative and positive numbers, using additions, subtractions, and comparisons:
function divide(N, D)
if D = 0 then error(DivisionByZero) end
if D < 0 then
(Q, R) := divide(N, −D)
return (−Q, R)
end
if N < 0 then
(Q, R) := divide(−N, D)
if R = 0 then
return (−Q, 0)
else
-- Example: N = -7, D = 3
-- divide(-N, D) = divide(7, 3) = (2, 1)
-- R ≠ 0, so return (-2 - 1, 3 - 1) = (-3, 2)
-- Check: (-3)*3 + 2 = -7
return (−Q − 1, D − R)
end
end
-- At this point, N ≥ 0 and D > 0
return divide_unsigned(N, D)
end
This procedure always produces R ≥ 0. Although very simple, it takes Ω(Q) steps, and so is exponentially slower than even slow division algorithms like long division. It is useful if Q is known to be small (being an output-sensitive algorithm), and can serve as an executable specification.
Alternative implementation
[edit]An alternative implementation increments a remainder and resets it when it reaches the divisor.
For , the algorithm computes such that , with :
Consider this code in Python:
def divide_unsigned2(numerator: int, denominator: int) -> tuple[int, int]
quotient: int = 0
remainder: int = 0
for _ in range(numerator):
remainder += 1
if remainder == denominator:
quotient += 1
remainder = 0
return quotient, remainder
Notes
- Special cases are
- and
.[2]
- and
- Variable
quotientis never read. So when its assignments —highlighted— are removed from the code andquotientis removed from the output list, divide_unsigned2, like divide_unsigned, still will compute .
Alternative implementation as counter machine
A simple counter machine (CM) can be based on the alternative implementation. The CM instructions are[3][4]
- Z (n): Replace rn by 0.
- S (n): Add 1 to rn.
- J (m, n, q): If rm = rn, jump to the qth instruction; otherwise go on to the next instruction in the program.
The counter machine program is[5]
1: J(1,5,0)
2: S(4)
3: J(4,2,6)
4: S(5)
5: J(0,0,1)
6: S(3)
7: Z(4)
8: S(5)
9: J(0,0,1)
After the CM finishes the computation on initial register values R1=N, R2=D (remaining registers = 0),
- register R3 holds the (integer part of the) quotient of the division N/D, and
- register R4 holds the remainder.
Long division
[edit]Long division is the standard algorithm used for pen-and-paper division of multi-digit numbers expressed in decimal notation. It shifts gradually from the left to the right end of the dividend, subtracting the largest possible multiple of the divisor (at the digit level) at each stage; the multiples then become the digits of the quotient, and the final difference is then the remainder.
When used with a binary radix, this method forms the basis for the (unsigned) integer division with remainder algorithm below. Short division is an abbreviated form of long division suitable for one-digit divisors. Chunking – also known as the partial quotients method or the hangman method – is a less-efficient form of long division which may be easier to understand. By allowing one to subtract more multiples than what one currently has at each stage, a more freeform variant of long division can be developed as well.
Integer division (unsigned) with remainder
[edit]The following algorithm, the binary version of the famous long division, will divide N by D, placing the quotient in Q and the remainder in R. In the following pseudo-code, all values are treated as unsigned integers.
if D = 0 then error(DivisionByZeroException) end
Q := 0 -- Initialize quotient and remainder to zero
R := 0
for i := n − 1 .. 0 do -- Where n is number of bits in N
R := R << 1 -- Left-shift R by 1 bit
R(0) := N(i) -- Set the least-significant bit of R equal to bit i of the numerator
if R ≥ D then
R := R − D
Q(i) := 1
end
end
Example
[edit]If we take N=11002 (1210) and D=1002 (410)
Step 1: Set R=0 and Q=0
Step 2: Take i=3 (one less than the number of bits in N)
Step 3: R=00 (left shifted by 1)
Step 4: R=01 (setting R(0) to N(i))
Step 5: R < D, so skip statement
Step 2: Set i=2
Step 3: R=010
Step 4: R=011
Step 5: R < D, statement skipped
Step 2: Set i=1
Step 3: R=0110
Step 4: R=0110
Step 5: R>=D, statement entered
Step 5b: R=10 (R−D)
Step 5c: Q=10 (setting Q(i) to 1)
Step 2: Set i=0
Step 3: R=100
Step 4: R=100
Step 5: R>=D, statement entered
Step 5b: R=0 (R−D)
Step 5c: Q=11 (setting Q(i) to 1)
end
Q=112 (310) and R=0.
Slow division methods
[edit]Slow division methods are all based on a standard recurrence equation[6]
where:
- Rj is the j-th partial remainder of the division (R(0) := N(i) step is included)
- B is the radix (base, usually 2 internally in computers and calculators)
- q n − (j + 1) is the digit of the quotient in position n−(j+1), where the digit positions are numbered from least-significant 0 to most significant n−1
- n is number of digits in the quotient
- D is the divisor
Restoring division
[edit]Restoring division operates on fixed-point fractional numbers and depends on the assumption 0 < D < N.[citation needed]
The quotient digits q are formed from the digit set {0,1}.
The basic algorithm for binary (radix 2) restoring division is:
R := N
D := D << n -- R and D need twice the word width of N and Q
for i := n − 1 .. 0 do -- For example 31..0 for 32 bits
R := 2 * R − D -- Trial subtraction from shifted value (multiplication by 2 is a shift in binary representation)
if R >= 0 then
q(i) := 1 -- Result-bit 1
else
q(i) := 0 -- Result-bit 0
R := R + D -- New partial remainder is (restored) shifted value
end
end
-- Where: N = numerator, D = denominator, n = #bits, R = partial remainder, q(i) = bit #i of quotient
Non-performing restoring division is similar to restoring division except that the value of 2R is saved, so D does not need to be added back in for the case of R < 0.
Non-restoring division
[edit]Non-restoring division uses the digit set {−1, 1} for the quotient digits instead of {0, 1}. The algorithm is more complex, but has the advantage when implemented in hardware that there is only one decision and addition/subtraction per quotient bit; there is no restoring step after the subtraction,[7] which potentially cuts down the numbers of operations by up to half and lets it be executed faster.[8] The basic algorithm for binary (radix 2) non-restoring division of non-negative numbers is:[verification needed]
R := N
D := D << n -- R and D need twice the word width of N and Q
for i = n − 1 .. 0 do -- for example 31..0 for 32 bits
if R >= 0 then
q(i) := +1
R := 2 * R − D
else
q(i) := −1
R := 2 * R + D
end if
end
-- Note: N=numerator, D=denominator, n=#bits, R=partial remainder, q(i)=bit #i of quotient.
Following this algorithm, the quotient is in a non-standard form consisting of digits of −1 and +1. This form needs to be converted to binary to form the final quotient. Example:
| Convert the following quotient to the digit set {0,1}: | |
| Start: | |
| 1. Form the positive term: | |
| 2. Mask the negative term:[note 1] | |
| 3. Subtract: : | |
| |
If the −1 digits of are stored as zeros (0) as is common, then is and computing is trivial: perform a ones' complement (bit by bit complement) on the original .
Q := Q − bit.bnot(Q) -- Appropriate if −1 digits in Q are represented as zeros as is common.
Finally, quotients computed by this algorithm are always odd, and the remainder in R is in the range −D ≤ R < D. For example, 5 / 2 = 3 R −1. To convert to a positive remainder, do a single restoring step after Q is converted from non-standard form to standard form:
if R < 0 then
Q := Q − 1
R := R + D -- Needed only if the remainder is of interest.
end if
The actual remainder is R >> n. (As with restoring division, the low-order bits of R are used up at the same rate as bits of the quotient Q are produced, and it is common to use a single shift register for both.)
SRT division
[edit]SRT division is a popular method for division in many microprocessor implementations.[9][10] The algorithm is named after D. W. Sweeney of IBM, James E. Robertson of University of Illinois, and K. D. Tocher of Imperial College London. They all developed the algorithm independently at approximately the same time (published in February 1957, September 1958, and January 1958 respectively).[11][12][13]
SRT division is similar to non-restoring division, but it uses a lookup table based on the dividend and the divisor to determine each quotient digit.
The most significant difference is that a redundant representation is used for the quotient. For example, when implementing radix-4 SRT division, each quotient digit is chosen from five possibilities: −2, −1, 0, +1, or +2. Because of this, the choice of a quotient digit need not be perfect; later quotient digits can correct for slight errors. (For example, the quotient digit pairs (0, +2) and (1, −2) are equivalent, since 0 × 4 + 2 = 1 × 4 − 2.) This tolerance allows quotient digits to be selected using only a few most-significant bits of the dividend and divisor, rather than requiring a full-width subtraction. This simplification in turn allows a radix higher than 2 to be used.
Like non-restoring division, the final steps are a final full-width subtraction to resolve the last quotient bit, and conversion of the quotient to standard binary form.
The original Intel Pentium processor's infamous floating-point division bug was caused by an incorrectly coded lookup table. Pentium processors used a 2048-cell table, of which 1066 cells were to be populated, and values from five cells were mistakenly omitted.[14][15][16]
Fast division methods
[edit]Newton–Raphson division
[edit]Newton–Raphson uses Newton's method to find the reciprocal of and multiply that reciprocal by to find the final quotient .
The steps of Newton–Raphson division are:
- Calculate an estimate for the reciprocal of the divisor .
- Compute successively more accurate estimates of the reciprocal. This is where one employs the Newton–Raphson method as such.
- Compute the quotient by multiplying the dividend by the reciprocal of the divisor: .
In order to apply Newton's method to find the reciprocal of , it is necessary to find a function that has a zero at . The obvious such function is , but the Newton–Raphson iteration for this is unhelpful, since it cannot be computed without already knowing the reciprocal of (moreover it attempts to compute the exact reciprocal in one step, rather than allow for iterative improvements). A function that does work is , for which the Newton–Raphson iteration gives
which can be calculated from using only multiplication and subtraction, or using two fused multiply–adds.
From a computation point of view, the expressions and are not equivalent. To obtain a result with a precision of 2n bits while making use of the second expression, one must compute the product between and with double the given precision of (n bits).[citation needed] In contrast, the product between and need only be computed with a precision of n bits, because the leading n bits (after the binary point) of are zeros.
If the error is defined as , then:
This squaring of the error at each iteration step – the so-called quadratic convergence of Newton–Raphson's method – has the effect that the number of correct digits in the result roughly doubles for every iteration, a property that becomes extremely valuable when the numbers involved have many digits (e.g. in the large integer domain). But it also means that the initial convergence of the method can be comparatively slow, especially if the initial estimate is poorly chosen.
Initial estimate
[edit]For the subproblem of choosing an initial estimate , it is convenient to apply a bit-shift to the divisor D to scale it so that 0.5 ≤ D ≤ 1. Applying the same bit-shift to the numerator N ensures the quotient does not change. Once within a bounded range, a simple polynomial approximation can be used to find an initial estimate.
The linear approximation with minimum worst-case absolute error on the interval is:
The coefficients of the linear approximation are determined as follows. The absolute value of the error is . The minimum of the maximum absolute value of the error is determined by the Chebyshev equioscillation theorem applied to . The local minimum of occurs when , which has solution . The function at that minimum must be of opposite sign as the function at the endpoints, namely, . The two equations in the two unknowns have a unique solution and , and the maximum error is . Using this approximation, the absolute value of the error of the initial value is less than
The best quadratic fit to in the interval is
It is chosen to make the error equal to a re-scaled third order Chebyshev polynomial of the first kind, and gives an absolute value of the error less than or equal to 1/99. This improvement is equivalent to Newton–Raphson iterations, at a computational cost of less than one iteration.
It is possible to generate a polynomial fit of degree larger than 2, computing the coefficients using the Remez algorithm. The trade-off is that the initial guess requires more computational cycles but hopefully in exchange for fewer iterations of Newton–Raphson.
Since for this method the convergence is exactly quadratic, it follows that, from an initial error , iterations will give an answer accurate to
binary places. Typical values are:
| Iterations | |||||
|---|---|---|---|---|---|
| 0 | 1 | 2 | 3 | 4 | |
| 3.09 | 7.17 | 15.35 | 31.70 | 64.40 | |
| 5.63 | 12.26 | 25.52 | 52.03 | 105.07 | |
A quadratic initial estimate plus two iterations is accurate enough for IEEE single precision, but three iterations are marginal for double precision. A linear initial estimate plus four iterations is sufficient for both double and double extended formats.
Pseudocode
[edit]The following computes the quotient of N and D with a precision of P binary places:
Express D as M × 2e where 1 ≤ M < 2 (standard floating point representation)
D' := D / 2e+1 // scale between 0.5 and 1, can be performed with bit shift / exponent subtraction
N' := N / 2e+1
X := 48/17 − 32/17 × D' // precompute constants with same precision as D
repeat times // can be precomputed based on fixed P
X := X + X × (1 - D' × X)
end
return N' × X
For example, for a double-precision floating-point division, this method uses 10 multiplies, 9 adds, and 2 shifts.
Cubic iteration
[edit]There is an iteration which uses three multiplications to cube the error:
The Yiεi term is new.
Expanding out the above, can be written as
with the result that the error term
This is 3/2 the computation of the quadratic iteration, but achieves as much convergence, so is slightly more efficient. Put another way, two iterations of this method raise the error to the ninth power at the same computational cost as three quadratic iterations, which only raise the error to the eighth power.
The number of correct bits after iterations is
binary places. Typical values are:
| Iterations | ||||
|---|---|---|---|---|
| 0 | 1 | 2 | 3 | |
| 3.09 | 11.26 | 35.79 | 109.36 | |
| 5.63 | 18.89 | 58.66 | 177.99 | |
A quadratic initial estimate plus two cubic iterations provides ample precision for an IEEE double-precision result. It is also possible to use a mixture of quadratic and cubic iterations.
Using at least one quadratic iteration ensures that the error is positive, i.e. the reciprocal is underestimated.[17]: 370 This can simplify a following rounding step if an exactly-rounded quotient is required.
Using higher degree polynomials in either the initialization or the iteration results in a degradation of performance because the extra multiplications required would be better spent on doing more iterations.[citation needed]
Goldschmidt division
[edit]Goldschmidt division[18] (after Robert Elliott Goldschmidt)[19] uses an iterative process of repeatedly multiplying both the dividend and divisor by a common factor Fi, chosen such that the divisor converges to 1. This causes the dividend to converge to the sought quotient Q:
The steps for Goldschmidt division are:
- Generate an estimate for the multiplication factor Fi .
- Multiply the dividend and divisor by Fi .
- If the divisor is sufficiently close to 1, return the dividend, otherwise, loop to step 1.
Assuming N/D has been scaled so that 0 < D < 1, each Fi is based on D:
Multiplying the dividend and divisor by the factor yields:
After a sufficient number k of iterations .
The Goldschmidt method is used in AMD Athlon CPUs and later models.[20][21] It is also known as Anderson Earle Goldschmidt Powers (AEGP) algorithm and is implemented by various IBM processors.[22][23] Although it converges at the same rate as a Newton–Raphson implementation, one advantage of the Goldschmidt method is that the multiplications in the numerator and in the denominator can be done in parallel.[23]
Binomial theorem
[edit]The Goldschmidt method can be used with factors that allow simplifications by the binomial theorem. Assume has been scaled by a power of two such that . We choose and . This yields
- .
After n steps , the denominator can be rounded to 1 with a relative error
which is maximum at when , thus providing a minimum precision of binary digits.
Large-integer methods
[edit]Methods designed for hardware implementation generally do not scale to integers with thousands or millions of decimal digits; these frequently occur, for example, in modular reductions in cryptography. For these large integers, more efficient division algorithms transform the problem to use a small number of multiplications, which can then be done using an asymptotically efficient multiplication algorithm such as the Karatsuba algorithm, Toom–Cook multiplication or the Schönhage–Strassen algorithm. The result is that the computational complexity of the division is of the same order (up to a multiplicative constant) as that of the multiplication. Examples include reduction to multiplication by Newton's method as described above,[24] as well as the slightly faster Burnikel-Ziegler division,[25] Barrett reduction and Montgomery reduction algorithms.[26][verification needed] Newton's method is particularly efficient in scenarios where one must divide by the same divisor many times, since after the initial Newton inversion only one (truncated) multiplication is needed for each division.
Division by a constant
[edit]The division by a constant D is equivalent to the multiplication by its reciprocal. Since the denominator is constant, so is its reciprocal (1/D). Thus it is possible to compute the value of (1/D) once at compile time, and at run time perform the multiplication N·(1/D) rather than the division N/D. In floating-point arithmetic the use of (1/D) presents little problem,[a] but in integer arithmetic the reciprocal will always evaluate to zero (assuming |D| > 1).
It is not necessary to use specifically (1/D); any value (X/Y) that reduces to (1/D) may be used. For example, for division by 3, the factors 1/3, 2/6, 3/9, or 194/582 could be used. Consequently, if Y were a power of two the division step would reduce to a fast right bit shift. The effect of calculating N/D as (N·X)/Y replaces a division with a multiply and a shift. Note that the parentheses are important, as N·(X/Y) will evaluate to zero.
However, unless D itself is a power of two, there is no X and Y that satisfies the conditions above. Fortunately, (N·X)/Y gives exactly the same result as N/D in integer arithmetic even when (X/Y) is not exactly equal to 1/D, but "close enough" that the error introduced by the approximation is in the bits that are discarded by the shift operation.[27][28][29] Barrett reduction uses powers of 2 for the value of Y to make division by Y a simple right shift.[b]
As a concrete fixed-point arithmetic example, for 32-bit unsigned integers, division by 3 can be replaced with a multiply by 2863311531/233, a multiplication by 2863311531 (hexadecimal 0xAAAAAAAB) followed by a 33 right bit shift. The value of 2863311531 is calculated as 233/3, then rounded up. Likewise, division by 10 can be expressed as a multiplication by 3435973837 (0xCCCCCCCD) followed by division by 235 (or 35 right bit shift).[31]: p230-234 OEIS provides sequences of the constants for multiplication as A346495 and for the right shift as A346496.
For general x-bit unsigned integer division where the divisor D is not a power of 2, the following identity converts the division into two x-bit addition/subtraction, one x-bit by x-bit multiplication (where only the upper half of the result is used) and several shifts, after precomputing and :
In some cases, division by a constant can be accomplished in even less time by converting the "multiply by a constant" into a series of shifts and adds or subtracts.[32] Of particular interest is division by 10, for which the exact quotient is obtained, with remainder if required.[33]
Rounding error
[edit]This section needs expansion. You can help by adding to it. (September 2012) |
When a division operation is performed, the exact quotient and remainder are approximated to fit within the computer’s precision limits. The Division Algorithm states:
where .
In floating-point arithmetic, the quotient is represented as and the remainder as , introducing rounding errors and :
This rounding causes a small error, which can propagate and accumulate through subsequent calculations. Such errors are particularly pronounced in iterative processes and when subtracting nearly equal values - is told loss of significance. To mitigate these errors, techniques such as the use of guard digits or higher precision arithmetic are employed.[34][35]
See also
[edit]Notes
[edit]- ^ Despite how "little" problem the optimization causes, this reciprocal optimization is still usually hidden behind a "fast math" flag in modern compilers as it is inexact.
- ^ Modern compilers commonly perform this integer multiply-and-shift optimization; for a constant only known at run-time, however, the program must implement the optimization itself.[30]
References
[edit]- ^ Rodeheffer, Thomas L. (2008-08-26). Software Integer Division (PDF) (Technical report). Microsoft Research, Silicon Valley.
- ^ Compare: in procedure divide_unsigned,
denominatormust be strictly positive. - ^ Shepherdson, J.C.; Sturgis, H.E. (1963). "Computability of Recursive Functions". Journal of the Association for Computing Machinery. 10 (2): 217–255. doi:10.1145/321160.321170.
- ^ Cutland, Nigel (1980). Computability: An Introduction to Recursive Function Theory (PDF). Cambridge University Press. p. 12. ISBN 9780521223843. Retrieved 2025-09-16.
- ^ The code runs on "URM Simulator". Occidental College, Los Angeles.
Unlimited Register Machine (URM) simulator (emulator) -- a "virtual URM". It is modeled after the URM specification in Nigel J. Cutland's book, Computability, An introduction to recursive function theory, by Cambridge Press.
- ^ Morris, James E.; Iniewski, Krzysztof (2017-11-22). Nanoelectronic Device Applications Handbook. CRC Press. ISBN 978-1-351-83197-0.
- ^ Shaw, Robert F. (1950). "Arithmetic Operations in a Binary Computer". Review of Scientific Instruments. 21 (8): 690. Bibcode:1950RScI...21..687S. doi:10.1063/1.1745692. ISSN 0034-6748. Archived from the original on 2022-02-28. Retrieved 2022-02-28.
- ^ Flynn. "Stanford EE486 (Advanced Computer Arithmetic Division) – Chapter 5 Handout (Division)" (PDF). Stanford University. Archived (PDF) from the original on 2022-04-18. Retrieved 2019-06-24.
- ^ Harris, David L.; Oberman, Stuart F.; Horowitz, Mark A. (9 September 1998). SRT Division: Architectures, Models, and Implementations (PDF) (Technical report). Stanford University. Archived (PDF) from the original on 24 December 2016. Retrieved 23 December 2016.
- ^ McCann, Mark; Pippenger, Nicholas (2005). "SRT Division Algorithms as Dynamical Systems". SIAM Journal on Computing. 34 (6): 1279–1301. CiteSeerX 10.1.1.72.6993. doi:10.1137/S009753970444106X. hdl:2429/12179. Archived from the original on 2022-08-24. Retrieved 2022-08-24.
- ^ Cocke, John; Sweeney, D.W. (11 February 1957), High speed arithmetic in a parallel device (Company Memo), IBM, p. 20, archived from the original on 24 August 2022, retrieved 24 August 2022
{{citation}}: CS1 maint: location missing publisher (link) - ^ Robertson, James (1958-09-01). "A New Class of Digital Division Methods". IRE Transactions on Electronic Computers. EC-7 (3). IEEE: 218–222. doi:10.1109/TEC.1958.5222579. hdl:2027/uiuo.ark:/13960/t0gt7529c.
- ^ Tocher, K.D. (1958-01-01). "Techniques of Multiplication and Division for Automatic Binary Computers". The Quarterly Journal of Mechanics and Applied Mathematics. 11 (3): 364–384. doi:10.1093/qjmam/11.3.364. Archived from the original on 2022-08-24. Retrieved 2022-08-24.
- ^ "Statistical Analysis of Floating Point Flaw". Intel Corporation. 1994. Archived from the original on 23 October 2013. Retrieved 22 October 2013.
- ^ Oberman, Stuart F.; Flynn, Michael J. (July 1995). An Analysis of Division Algorithms and Implementations (PDF) (Technical report). Stanford University. CSL-TR-95-675. Archived (PDF) from the original on 2017-05-17. Retrieved 2016-12-23.
- ^ Shirriff, Ken (28 Dec 2024). "Intel's $475 million error: the silicon behind the Pentium division bug". Righto. Retrieved 30 Dec 2024.
- ^ Ercegovac, Miloš D.; Lang, Tomás (2004). "Chapter 7: Reciprocal. Division, Reciprocal Square Root, and Square Root by Iterative Approximation". Digital Arithmetic. Morgan Kaufmann. pp. 367–395. ISBN 1-55860-798-6.
- ^ Goldschmidt, Robert E. (1964). Applications of Division by Convergence (PDF) (Thesis). M.Sc. dissertation. M.I.T. OCLC 34136725. Archived (PDF) from the original on 2015-12-10. Retrieved 2015-09-15.
- ^ "Authors". IBM Journal of Research and Development. 11: 125–127. 1967. doi:10.1147/rd.111.0125. Archived from the original on 18 July 2018.
- ^ Oberman, Stuart F. (1999). "Floating point division and square root algorithms and implementation in the AMD-K7 Microprocessor" (PDF). Proceedings 14th IEEE Symposium on Computer Arithmetic (Cat. No.99CB36336). pp. 106–115. doi:10.1109/ARITH.1999.762835. ISBN 0-7695-0116-8. S2CID 12793819. Archived (PDF) from the original on 2015-11-29. Retrieved 2015-09-15.
- ^ Soderquist, Peter; Leeser, Miriam (July–August 1997). "Division and Square Root: Choosing the Right Implementation". IEEE Micro. 17 (4): 56–66. doi:10.1109/40.612224.
- ^ S. F. Anderson, J. G. Earle, R. E. Goldschmidt, D. M. Powers. The IBM 360/370 model 91: floating-point execution unit, IBM Journal of Research and Development, January 1997
- ^ a b Guy, Even; Peter, Siedel; Ferguson, Warren (1 February 2005). "A parametric error analysis of Goldschmidt's division algorithm". Journal of Computer and System Sciences. 70 (1): 118–139. doi:10.1016/j.jcss.2004.08.004.
- ^ Hasselström, Karl (2003). Fast Division of Large Integers: A Comparison of Algorithms (PDF) (M.Sc. in Computer Science thesis). Royal Institute of Technology. Archived from the original (PDF) on 8 July 2017. Retrieved 2017-07-08.
- ^ Joachim Ziegler, Christoph Burnikel (1998), Fast Recursive Division, Max-Planck-Institut für Informatik, archived from the original on 2011-04-26, retrieved 2021-09-10
{{citation}}: CS1 maint: location missing publisher (link) - ^ Barrett, Paul (1987). "Implementing the Rivest Shamir and Adleman public key encryption algorithm on a standard digital signal processor". Proceedings on Advances in cryptology---CRYPTO '86. London, UK: Springer-Verlag. pp. 311–323. ISBN 0-387-18047-8.
- ^ Granlund, Torbjörn; Montgomery, Peter L. (June 1994). "Division by Invariant Integers using Multiplication" (PDF). SIGPLAN Notices. 29 (6): 61–72. CiteSeerX 10.1.1.1.2556. doi:10.1145/773473.178249. Archived (PDF) from the original on 2019-06-06. Retrieved 2015-12-08.
- ^ Möller, Niels; Granlund, Torbjörn (February 2011). "Improved Division by Invariant Integers" (PDF). IEEE Transactions on Computers. 60 (2): 165–175. Bibcode:2011ITCmp..60..165M. doi:10.1109/TC.2010.143. S2CID 13347152. Archived (PDF) from the original on 2015-12-22. Retrieved 2015-12-08.
- ^ ridiculous_fish. "Labor of Division (Episode III): Faster Unsigned Division by Constants" Archived 2022-01-08 at the Wayback Machine. 2011.
- ^ ridiculous_fish. "libdivide, optimized integer division". Archived from the original on 23 November 2021. Retrieved 6 July 2021.
- ^ Warren Jr., Henry S. (2013). Hacker's Delight (2 ed.). Addison Wesley - Pearson Education, Inc. ISBN 978-0-321-84268-8.
- ^ LaBudde, Robert A.; Golovchenko, Nikolai; Newton, James; and Parker, David; Massmind: "Binary Division by a Constant" Archived 2022-01-09 at the Wayback Machine
- ^ Vowels, R. A. (1992). "Division by 10". Australian Computer Journal. 24 (3): 81–85.
- ^ L. Popyack, Jeffrey (June 2000). "Rounding Error". Drexel University.
- ^ "9. Machine Numbers, Rounding Error and Error Propagation". College of Charleston. 8 February 2021.
Further reading
[edit]- Savard, John J. G. (2018) [2006]. "Advanced Arithmetic Techniques". quadibloc. Archived from the original on 2018-07-03. Retrieved 2018-07-16.
Division algorithm
View on GrokipediaFundamental Concepts
Division by repeated subtraction
The division by repeated subtraction represents the most elementary approach to performing division, in which the divisor is iteratively subtracted from the dividend a specified number of times until the remaining value is less than the divisor itself; the count of subtractions yields the quotient, while the final remainder is what is left over.[6] This method directly captures the core idea of division as determining how many complete instances of the divisor can be accommodated within the dividend without exceeding it.[1] Historically, this technique dates back to ancient civilizations and was explicitly employed by the Greek mathematician Euclid around 300 BCE, well before the widespread adoption of positional numeral systems such as the Hindu-Arabic notation in the medieval period.[6] In Euclid's Elements, Book VII, Proposition 1, the process is described as a foundational step for more advanced number-theoretic proofs, underscoring its role in early mathematical reasoning.[7] Consider the example of dividing 23 by 5:- Begin with 23 and subtract 5 once: 23 - 5 = 18 (quotient count: 1).
- Subtract 5 again: 18 - 5 = 13 (count: 2).
- Subtract 5 again: 13 - 5 = 8 (count: 3).
- Subtract 5 again: 8 - 5 = 3 (count: 4).
- Now, 3 < 5, so stop; the quotient is 4 and the remainder is 3.
Long division for integers
The long division algorithm for integers is a systematic method for computing the quotient and remainder when dividing one integer by another, particularly suited for multi-digit numbers in base-10 representation. It operates by aligning the dividend (the number being divided) below a quotient line and the divisor to the left. The process starts with the leftmost digits of the dividend: estimate the largest digit (or multi-digit value up to the divisor's length) that the divisor can multiply into this partial dividend without exceeding it, record that as the next quotient digit above the line, multiply the divisor by this digit and subtract the product from the partial dividend to obtain a remainder, then bring down the next digit from the dividend to form a new partial dividend. This cycle repeats digit by digit across the entire dividend until all digits are incorporated, leaving a final remainder less than the divisor. The method leverages positional notation to group digits efficiently, avoiding the exhaustive subtractions required in simpler approaches.[8][9] An illustrative example of unsigned integer division with a remainder is dividing 12345 by 37:- Take the first three digits (123, since 37 has two digits). 37 goes into 123 exactly 3 times (37 × 3 = 111). Subtract: 123 - 111 = 12. Bring down the next digit (4), forming 124.
- 37 goes into 124 exactly 3 times (37 × 3 = 111). Subtract: 124 - 111 = 13. Bring down the next digit (5), forming 135.
- 37 goes into 135 exactly 3 times (37 × 3 = 111). Subtract: 135 - 111 = 24.
Bit-by-Bit Division Algorithms
Restoring division
Restoring division is a fundamental bit-by-bit algorithm used in computer hardware to perform binary integer division for unsigned numbers, analogous to the process of long division in decimal arithmetic. It operates by iteratively shifting the partial remainder left and attempting to subtract the divisor, restoring the partial remainder if the subtraction yields a negative result, thereby ensuring the partial remainder remains non-negative throughout the process. This method produces both the quotient and remainder, satisfying the division algorithm where dividend = divisor × quotient + remainder with 0 ≤ remainder < divisor.[12] The algorithm initializes the partial remainder (often stored in register A) to zero and loads the dividend into the quotient register (Q), with the divisor in register M, for n-bit operands. For each of the n iterations corresponding to the quotient bits from most to least significant: the combined A-Q register pair is shifted left by one bit (introducing a zero in the least significant bit of Q and shifting the most significant bit of Q into the least significant bit of A); the divisor M is subtracted from A; if the result in A is negative (detected by the most significant bit being 1, assuming two's complement representation for the test), the divisor is added back to restore A and the current quotient bit (least significant bit of Q) is set to 0; otherwise, A remains subtracted and the quotient bit is set to 1. After n iterations, Q holds the quotient and A holds the remainder. This process requires simple arithmetic logic unit (ALU) operations: shifts, subtractions, and conditional additions.[12][13] The following pseudocode illustrates the algorithm for n-bit unsigned division:Initialize:
A ← 0 (n bits)
Q ← dividend (n bits)
M ← divisor (n bits)
for i ← 1 to n do
// Shift A-Q left as a pair
temp ← MSB of Q
A ← (A << 1) | temp
Q ← Q << 1 // LSB of Q becomes 0
// Trial subtraction
A_temp ← A - M
if A_temp < 0 (MSB of A_temp == 1) then
A ← A_temp + M // Restore
LSB of Q ← 0
else
A ← A_temp
LSB of Q ← 1
end for
Return: quotient = Q, remainder = A
Initialize:
A ← 0 (n bits)
Q ← dividend (n bits)
M ← divisor (n bits)
for i ← 1 to n do
// Shift A-Q left as a pair
temp ← MSB of Q
A ← (A << 1) | temp
Q ← Q << 1 // LSB of Q becomes 0
// Trial subtraction
A_temp ← A - M
if A_temp < 0 (MSB of A_temp == 1) then
A ← A_temp + M // Restore
LSB of Q ← 0
else
A ← A_temp
LSB of Q ← 1
end for
Return: quotient = Q, remainder = A
- Initialization: A = 0000, Q = 1101, M = 0011
- Iteration 1: Shift: temp = 1 (MSB Q), A = (0000 << 1) | 1 = 0001, Q = 1101 << 1 = 1010. A_temp = 0001 - 0011 = 1110 (negative). Restore: A = 1110 + 0011 = 0001, LSB Q = 0 (Q = 1010).
- Iteration 2: Shift: temp = 1, A = (0001 << 1) | 1 = 0011, Q = 1010 << 1 = 0100. A_temp = 0011 - 0011 = 0000 (non-negative). Keep A = 0000, LSB Q = 1 (Q = 0101).
- Iteration 3: Shift: temp = 0, A = (0000 << 1) | 0 = 0000, Q = 0101 << 1 = 1010. A_temp = 0000 - 0011 = 1101 (negative). Restore: A = 1101 + 0011 = 0000, LSB Q = 0 (Q = 1010).
- Iteration 4: Shift: temp = 1, A = (0000 << 1) | 1 = 0001, Q = 1010 << 1 = 0100. A_temp = 0001 - 0011 = 1110 (negative). Restore: A = 1110 + 0011 = 0001, LSB Q = 0 (Q = 0100).
Non-restoring division
Non-restoring division is an optimization of the bit-by-bit division algorithm for binary integers that eliminates the restoration step required in the restoring method by conditionally adding the divisor instead of always subtracting and restoring negative partial remainders.[15] This approach uses signed-digit quotient values of 1 or −1 during the process, allowing the partial remainder to remain negative without immediate correction, which simplifies hardware implementation and reduces average latency.[15] Developed as an improvement over restoring division, it processes one bit per cycle while avoiding the add-back operation in cases where subtraction yields a negative result.[15] The algorithm operates on an n-bit dividend and divisor , producing an n-bit quotient and remainder such that with . It uses registers A (partial remainder, initialized to 0), Q (quotient, initialized to dividend), and M (divisor). For each iteration to :- Shift the A-Q pair left by one bit.
- If A ≥ 0, subtract from A; else add to A.
- If A ≥ 0 after the operation, set the LSB of Q to 1; else set to 0. After all iterations, if A < 0, add to A and increment Q (with carry propagation if necessary).[15]
- Initialization: A = 0000, Q = 1111, M = 0100
- Iteration 1: Shift: A = 0001, Q = 1110. A ≥ 0, so A = 0001 - 0100 = 1101. A < 0, set LSB Q = 0 (Q = 1110).
- Iteration 2: Shift: A = 1011, Q = 1100. A < 0, so A = 1011 + 0100 = 1111. A < 0, set LSB Q = 0 (Q = 1100).
- Iteration 3: Shift: A = 1111, Q = 1000. A < 0, so A = 1111 + 0100 = 0011 (modulo 16). A ≥ 0, set LSB Q = 1 (Q = 1001).
- Iteration 4: Shift: A = 0111, Q = 0010. A ≥ 0, so A = 0111 - 0100 = 0011. A ≥ 0, set LSB Q = 1 (Q = 0011).
SRT division
The SRT division algorithm extends the non-restoring division method to higher radices by employing small lookup tables to generate multiple quotient bits per iteration, enabling faster execution in hardware implementations.[16] The core idea involves overlapping a few most significant bits of the partial remainder and the divisor to select quotient digits from a redundant set, such as {-1, 0, 1} for radix-2 or {-2, -1, 0, 1, 2} for radix-4, ensuring the selection is approximate but correctable without full-width comparisons.[16] This redundancy allows the partial remainder to remain non-negative after subtraction, facilitating on-the-fly corrections and reducing the need for explicit remainder normalization between steps.[16] In the algorithm flow, the process begins with the partial remainder initialized to the dividend, typically represented in a redundant form like carry-save to avoid carry propagation delays. For each iteration, the quotient digit is determined via a lookup table based on the leading bits (e.g., 4-8 bits) of the partial remainder and divisor; the selected digit (q_j) is then used to compute the next partial remainder as P_{j+1} = r \cdot (P_j - q_j \cdot D), where r is the radix and D is the divisor, involving a shift left by log_2(r) bits, a multiplication by q_j (often just addition/subtraction due to small digit sets), and subtraction.[16] For radix-4, this retires two quotient bits per cycle, with the table ensuring the remainder stays within bounds [0, 2D) for non-redundant output after final conversion. The process repeats for n / \log_2(r) iterations, where n is the dividend bit length, yielding the exact quotient upon completion.[16] A representative example is radix-4 SRT division of 1627 by 35 (using 6-bit precision for illustration). The quotient digits selected are 1, 1, 0, 0, 0, -1, which after normalization (accounting for the -1 by adding 1 to the next higher digit position) yield quotient 46 (binary 101110), with remainder 17, since 35 × 46 + 17 = 1627. This completes in 6 iterations for the precision, demonstrating table-driven efficiency and redundancy handling.[17] SRT division was developed independently in the late 1950s by D. W. Sweeney at IBM, J. E. Robertson at the University of Illinois, and J. D. Tocher at the University of New South Wales, primarily to accelerate division in early mainframe computers; it was employed in processors like those in the IBM Stretch project and subsequent systems.[18] Seminal analyses by Atkins in 1968 formalized its correctness for higher radices, influencing its adoption in hardware designs through the 1960s.[16]Iterative Approximation Methods
Newton–Raphson division
The Newton–Raphson division method approximates the reciprocal of the divisor using an iterative root-finding technique and then multiplies the result by the dividend to obtain the quotient, making it efficient for floating-point operations in hardware due to its rapid convergence. This approach leverages the quadratic convergence property, where the error decreases quadratically, typically requiring only 3–5 iterations to achieve full precision in standard formats like IEEE 754 single or double precision.[19] The core iteration derives from applying the Newton–Raphson method to solve for the reciprocal , yielding the update formula where is the divisor and is an initial approximation close to . The quotient is then computed as , with the dividend and the converged reciprocal; quadratic convergence ensures the relative error squares each step, doubling correct digits iteratively.[19] Initial estimates are generated via a compact lookup table indexing the leading 8–11 bits of 's mantissa, providing accuracy within 0.5–1 ulp to minimize iterations; in IEEE 754, this often involves exponent adjustment plus table-based mantissa reciprocal approximation.[19] The following pseudocode illustrates a basic implementation, assuming fixed-point or floating-point multiplication and a convergence check (e.g., via bit count or residual):function reciprocal_newton_raphson(d, max_iter, tol):
x = initial_lookup(d) // Table-based estimate for 1/d
for k = 1 to max_iter:
temp = d * x
if |temp - 1| < tol: break
x = x * (2 - temp)
return x
quotient = dividend * reciprocal_newton_raphson(divisor, 5, 1e-10)
function reciprocal_newton_raphson(d, max_iter, tol):
x = initial_lookup(d) // Table-based estimate for 1/d
for k = 1 to max_iter:
temp = d * x
if |temp - 1| < tol: break
x = x * (2 - temp)
return x
quotient = dividend * reciprocal_newton_raphson(divisor, 5, 1e-10)
- ,
- ,
- .
