diff options
author | Loren M. Lang <lorenl@north-winds.org> | 2017-11-11 02:14:35 -0800 |
---|---|---|
committer | Loren M. Lang <lorenl@north-winds.org> | 2017-11-11 02:14:35 -0800 |
commit | c78405727f8c5fcc9d1a8d23d57f16fc4c7dface (patch) | |
tree | 050e7a6ed5c65fecd2c041a9cf5eef77cfa24458 /doc/08-residue.tex | |
parent | 10064bfdd51f7c59aa7724c206aae84b62def5e8 (diff) | |
download | libvorbis-git-c78405727f8c5fcc9d1a8d23d57f16fc4c7dface.tar.gz |
Fixed error in Vorbis I specification for limiting residue vector size
The minimum between the encoded residue boundaries and actual block size
needs to be used, otherwise it pushes the boundaries to the edge of the
actual blocksize or beyond.
Diffstat (limited to 'doc/08-residue.tex')
-rw-r--r-- | doc/08-residue.tex | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/doc/08-residue.tex b/doc/08-residue.tex index 2c1da67e..ea382437 100644 --- a/doc/08-residue.tex +++ b/doc/08-residue.tex @@ -269,8 +269,8 @@ process. 1) [actual\_size] = current blocksize/2; 2) if residue encoding is format 2 3) [actual\_size] = [actual\_size] * [ch]; - 4) [limit\_residue\_begin] = maximum of ([residue\_begin],[actual\_size]); - 5) [limit\_residue\_end] = maximum of ([residue\_end],[actual\_size]); + 4) [limit\_residue\_begin] = minimum of ([residue\_begin],[actual\_size]); + 5) [limit\_residue\_end] = minimum of ([residue\_end],[actual\_size]); \end{programlisting} The following convenience values are conceptually useful to clarifying |