Remove the Selectors-specific tokens, per WG resolution.

Author: tabatkins

css-syntax/Overview.bs

@@ -441,12 +441,6 @@ Tokenization</h2>
 	<dfn>&lt;number-token></dfn>,
 	<dfn>&lt;percentage-token></dfn>,
 	<dfn>&lt;dimension-token></dfn>,
-	<dfn>&lt;include-match-token></dfn>,
-	<dfn>&lt;dash-match-token></dfn>,
-	<dfn>&lt;prefix-match-token></dfn>,
-	<dfn>&lt;suffix-match-token></dfn>,
-	<dfn>&lt;substring-match-token></dfn>,
-	<dfn>&lt;column-token></dfn>,
 	<dfn>&lt;whitespace-token></dfn>,
 	<dfn>&lt;CDO-token></dfn>,
 	<dfn>&lt;CDC-token></dfn>,
@@ -702,42 +696,6 @@ Token Railroad Diagrams</h3>
 			T: %
 			</pre>
 
-		<dt id="include-match-token-diagram"><<include-match-token>>
-		<dd>
-			<pre class='railroad'>
-			T: ~=
-			</pre>
-
-		<dt id="dash-match-token-diagram"><<dash-match-token>>
-		<dd>
-			<pre class='railroad'>
-			T: |=
-			</pre>
-
-		<dt id="prefix-match-token-diagram"><<prefix-match-token>>
-		<dd>
-			<pre class='railroad'>
-			T: ^=
-			</pre>
-
-		<dt id="suffix-match-token-diagram"><<suffix-match-token>>
-		<dd>
-			<pre class='railroad'>
-			T: $=
-			</pre>
-
-		<dt id="substring-match-token-diagram"><<substring-match-token>>
-		<dd>
-			<pre class='railroad'>
-			T: *=
-			</pre>
-
-		<dt id="column-token-diagram"><<column-token>>
-		<dd>
-			<pre class='railroad'>
-			T: ||
-			</pre>
-
 		<dt id="CDO-token-diagram"><<CDO-token>>
 		<dd>
 			<pre class='railroad'>
@@ -929,17 +887,6 @@ Consume a token</h4>
 			return a <<delim-token>>
 			with its value set to the <a>current input code point</a>.
 
-		<dt>U+0024 DOLLAR SIGN ($)
-		<dd>
-			If the <a>next input code point</a> is
-			U+003D EQUALS SIGN (=),
-			consume it
-			and return a <<suffix-match-token>>.
-
-			Otherwise,
-			emit a <<delim-token>>
-			with its value set to the <a>current input code point</a>.
-
 		<dt>U+0027 APOSTROPHE (&apos;)
 		<dd>
 			<a>Consume a string token</a>
@@ -953,17 +900,6 @@ Consume a token</h4>
 		<dd>
 			Return a <a href="#tokendef-close-paren">&lt;)-token></a>.
 
-		<dt>U+002A ASTERISK (*)
-		<dd>
-			If the <a>next input code point</a> is
-			U+003D EQUALS SIGN (=),
-			consume it
-			and return a <<substring-match-token>>.
-
-			Otherwise,
-			return a <<delim-token>>
-			with its value set to the <a>current input code point</a>.
-
 		<dt>U+002B PLUS SIGN (+)
 		<dd>
 			If the input stream <a>starts with a number</a>,
@@ -1069,17 +1005,6 @@ Consume a token</h4>
 		<dd>
 			Return a <a href="#tokendef-close-square">&lt;]-token></a>.
 
-		<dt>U+005E CIRCUMFLEX ACCENT (^)
-		<dd>
-			If the <a>next input code point</a> is
-			U+003D EQUALS SIGN (=),
-			consume it
-			and return a <<prefix-match-token>>.
-
-			Otherwise,
-			return a <<delim-token>>
-			with its value set to the <a>current input code point</a>.
-
 		<dt>U+007B LEFT CURLY BRACKET ({)
 		<dd>
 			Return a <a href="#tokendef-open-curly">&lt;{-token></a>.
@@ -1100,34 +1025,6 @@ Consume a token</h4>
 			<a>consume an ident-like token</a>,
 			and return it.
 
-		<dt>U+007C VERTICAL LINE (|)
-		<dd>
-			If the <a>next input code point</a> is
-			U+003D EQUALS SIGN (=),
-			consume it
-			and return a <<dash-match-token>>.
-
-			Otherwise,
-			if the <a>next input code point</a> is
-			U+007C VERTICAL LINE (|),
-			consume it
-			and return a <<column-token>>.
-
-			Otherwise,
-			return a <<delim-token>>
-			with its value set to the <a>current input code point</a>.
-
-		<dt>U+007E TILDE (~)
-		<dd>
-			If the <a>next input code point</a> is
-			U+003D EQUALS SIGN (=),
-			consume it
-			and return an <<include-match-token>>.
-
-			Otherwise,
-			return a <<delim-token>>
-			with its value set to the <a>current input code point</a>.
-
 		<dt>EOF
 		<dd>
 			Return an <<EOF-token>>.
@@ -3515,6 +3412,8 @@ Changes from the 20 February 2014 Candidate Recommendation</h3>
 
 	* Added the <<declaration-value>> and <<any-value>> productions.
 
+	* Removed the Selectors-specific tokens, per WG resolution.
+
 
 <h3 id="changes-WD-20131105">
 Changes from the 5 November 2013 Last Call Working Draft</h3>
@@ -3620,9 +3519,6 @@ Changes from CSS 2.1 and Selectors Level 3</h3>
 			and emit normal <<string-token>> and <<url-token>> rather than BAD_STRING or BAD_URI
 			on EOF.
 
-		<li>
-			<<prefix-match-token>>, <<suffix-match-token>>, and <<substring-match-token>> have been imported from Selectors 3.
-
 		<li>
 			The BAD_URI token (now <<bad-url-token>>) is "self-contained".
 			In other words, once the tokenizer realizes it's in a <<bad-url-token>> rather than a <<url-token>>,
@@ -3646,10 +3542,6 @@ Changes from CSS 2.1 and Selectors Level 3</h3>
 			Scientific notation is supported for numbers/percentages/dimensions to match SVG,
 			per WG resolution.
 
-		<li>
-			<<column-token>> has been added,
-			to keep Selectors parsing in single-token lookahead.
-
 		<li>
 			Hexadecimal escape for <a>surrogate code points</a> now emit a replacement character rather than the surrogate.
 			This allows implementations to safely use UTF-16 internally.