Darn, have to revert the last change to keep the tokenizer stateless. Also, add parse errors to badstrings that end on EOF.

Author: tabatkins

css3-syntax/parsing.html

@@ -181,9 +181,19 @@ <h4>
 
 		<dt>U+002B PLUS SIGN (+)
 		<dd>
-			Emit a delim token
-			with its value set to U+002B PLUS SIGN (+).
-			Switch to the <i>number state</i>.
+			If the <i>next input character</i> is
+			a <i>digit</i>,
+			or the <i title="next input character">next 2 input characters</i> are
+			U+002D HYPHEN-MINUS (-)
+			followed by a <i>digit</i>,
+			switch to the <i>number state</i>.
+			Set the "starts with plus" flag on the next number or dimension token you emit.
+
+			<p>
+				Otherwise,
+				emit a delim token
+				with its value set to U+002B PLUS SIGN (+).
+				Remain in this state</i>.
 
 		<dt>U+002D HYPHEN-MINUS (-)
 		<dd>
@@ -220,7 +230,7 @@ <h4>
 			<p>
 				Otherwise,
 				emit a delim token
-				with its value set to U+002D HYPHEN-MINUS.
+				with its value set to U+002D HYPHEN-MINUS (-).
 				Remain in this state.
 
 		<dt>U+002E FULL STOP (.)
@@ -266,6 +276,7 @@ <h4>
 			(!--),
 			consume them
 			and emit a cdo token.
+			Remain in this state.
 
 			<p>
 				Otherwise,
@@ -311,6 +322,7 @@ <h4>
 			If the <i>next input character</i> is
 			U+003D EQUALS SIGN (=),
 			emit a dash-match token.
+			Remain in this state.
 
 			<p>
 				Otherwise,
@@ -328,6 +340,7 @@ <h4>
 			If the <i>next input character</i> is
 			U+003D EQUALS SIGN (=),
 			emit an includes-match token.
+			Remain in this state.
 
 			<p>
 				Otherwise,
@@ -398,6 +411,7 @@ <h4>
 
 		<dt>EOF
 		<dd>
+			This is a <i>parse error</i>.
 			Emit the string token.
 			Switch to the <i>data state</i>.
 			Reconsume the <i>current input character</i>.
@@ -457,6 +471,7 @@ <h4>
 
 		<dt>EOF
 		<dd>
+			This is a <i>parse error</i>.
 			Emit the string token.
 			Switch to the <i>data state</i>.
 			Reconsume the <i>current input character</i>.