Skip to content

Commit fc6282f

Browse files
committed
Move the line about eof token generation to the definition of 'next input token'.
--HG-- extra : rebase_source : e98eb394af2870baea1e670ae5004200e2ac52b0
1 parent 19fd8a6 commit fc6282f

2 files changed

Lines changed: 6 additions & 12 deletions

File tree

css3-syntax/Overview.html

Lines changed: 4 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -2050,11 +2050,6 @@ <h3 id=tree-construction><span class=secno>3.6. </span> Tree Construction</h3>
20502050
stylesheet). The "output" of this stage consists of dynamically modifying
20512051
or extending that stylesheet's CSSOM.
20522052

2053-
<p class=issue> Something about the fact that if the token stream is empty,
2054-
the <a href="#next-input-token"><i>next input token</i></a> is always the
2055-
eof token. This lets me simplify some algorithms by avoiding the need to
2056-
force the token to be reprocessed.
2057-
20582053
<div class=issue>
20592054
<p> TODO:
20602055

@@ -2084,7 +2079,10 @@ <h4 id=definitions0><span class=secno>3.6.2. </span> Definitions</h4>
20842079
<dt><dfn id=next-input-token>next input token</dfn>
20852080

20862081
<dd> The token following the <a href="#current-input-token"><i>current
2087-
input token</i></a> in the list of tokens produced by the tokenizer.
2082+
input token</i></a> in the list of tokens produced by the tokenizer. If
2083+
there isn't a token following the <a
2084+
href="#current-input-token"><i>current input token</i></a>, the <a
2085+
href="#next-input-token"><i>next input token</i></a> is an EOF token.
20882086

20892087
<dt><dfn id=stack-of-open-rules>stack of open rules</dfn>
20902088

css3-syntax/Overview.src.html

Lines changed: 2 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -2042,12 +2042,6 @@ <h3>
20422042
(sometimes a full CSSStyleSheet object, other times a "virtual" stylesheet).
20432043
The "output" of this stage consists of dynamically modifying or extending that stylesheet's CSSOM.
20442044

2045-
<p class='issue'>
2046-
Something about the fact that if the token stream is empty,
2047-
the <i>next input token</i> is always the eof token.
2048-
This lets me simplify some algorithms
2049-
by avoiding the need to force the token to be reprocessed.
2050-
20512045
<div class='issue'>
20522046
<p>
20532047
TODO:
@@ -2080,6 +2074,8 @@ <h4>
20802074
<dt><dfn>next input token</dfn>
20812075
<dd>
20822076
The token following the <i>current input token</i> in the list of tokens produced by the tokenizer.
2077+
If there isn't a token following the <i>current input token</i>,
2078+
the <i>next input token</i> is an EOF token.
20832079

20842080
<dt><dfn>stack of open rules</dfn>
20852081
<dd>

0 commit comments

Comments
 (0)