summaryrefslogtreecommitdiff
path: root/doc/08-residue.tex
diff options
context:
space:
mode:
authorLoren M. Lang <lorenl@north-winds.org>2017-11-11 02:14:35 -0800
committerLoren M. Lang <lorenl@north-winds.org>2017-11-11 02:14:35 -0800
commitc78405727f8c5fcc9d1a8d23d57f16fc4c7dface (patch)
tree050e7a6ed5c65fecd2c041a9cf5eef77cfa24458 /doc/08-residue.tex
parent10064bfdd51f7c59aa7724c206aae84b62def5e8 (diff)
downloadlibvorbis-git-c78405727f8c5fcc9d1a8d23d57f16fc4c7dface.tar.gz
Fixed error in Vorbis I specification for limiting residue vector size
The minimum between the encoded residue boundaries and actual block size needs to be used, otherwise it pushes the boundaries to the edge of the actual blocksize or beyond.
Diffstat (limited to 'doc/08-residue.tex')
-rw-r--r--doc/08-residue.tex4
1 files changed, 2 insertions, 2 deletions
diff --git a/doc/08-residue.tex b/doc/08-residue.tex
index 2c1da67e..ea382437 100644
--- a/doc/08-residue.tex
+++ b/doc/08-residue.tex
@@ -269,8 +269,8 @@ process.
1) [actual\_size] = current blocksize/2;
2) if residue encoding is format 2
3) [actual\_size] = [actual\_size] * [ch];
- 4) [limit\_residue\_begin] = maximum of ([residue\_begin],[actual\_size]);
- 5) [limit\_residue\_end] = maximum of ([residue\_end],[actual\_size]);
+ 4) [limit\_residue\_begin] = minimum of ([residue\_begin],[actual\_size]);
+ 5) [limit\_residue\_end] = minimum of ([residue\_end],[actual\_size]);
\end{programlisting}
The following convenience values are conceptually useful to clarifying