[css-scrollbar] Document test coverage

Author: frivoal

css-scrollbars-1/Overview.bs

@@ -21,11 +21,14 @@ Editor: Florian Rivoal, Invited Expert, https://florian.rivoal.net/, w3cid 43241
 Abstract: This CSS module defines properties
 	to influence the visual styling of scrollbars,
 	introducing controls for their color and width.
+WPT Path Prefix: css/css-scrollbars/
 </pre>
 
 <h2 id="intro">
 Introduction</h2>
 
+	<wpt title="This section is not normative, it does not need tests."></wpt>
+
 	<em>This section is non-normative.</em>
 
 	This CSS module introduces properties
@@ -36,6 +39,8 @@ Introduction</h2>
 <h3 id="scope">
 Scope</h3>
 
+	<wpt title="This section is not normative, it does not need tests."></wpt>
+
 	The CSS Scrollbars Module is specifically for styling scrollbar controls themselves,
 	e.g. their color &amp; width in Level 1, and not their layout nor whether any content is scrollable.
 	All layout impacts and content scrollability are specified in the
@@ -55,6 +60,29 @@ Scope</h3>
 <h4 id="out-of-scope">
 Out Of Scope</h4>
 
+	<wpt title="This section is not normative, it does not need tests."></wpt>
+
+	<wpt title="The following tests verify an undefined interraction with ::-webkit-scrollbar">
+		scrollbar-color-001.html
+		scrollbar-color-002.html
+		scrollbar-color-003.html
+		scrollbar-color-004.html
+		scrollbar-color-005.html
+		scrollbar-color-006.html
+		scrollbar-color-007.html
+		scrollbar-color-008.html
+		scrollbar-color-009.html
+		scrollbar-color-010.html
+
+		scrollbar-width-010.html
+		scrollbar-width-011.html
+		scrollbar-width-012.html
+		scrollbar-width-013.html
+		scrollbar-width-014.html
+		scrollbar-width-015.html
+		scrollbar-width-016.html
+	</wpt>
+
 	The internal structure, layout, and configuration of scrollbars,
 	as well as precise control over their coloring, is out of scope.
 	This is because different platforms have
@@ -77,6 +105,8 @@ Out Of Scope</h4>
 <h3 id="values">
 Value Definitions</h3>
 
+	<wpt title="This section does not introduce any new normative requirement, it does not need tests."></wpt>
+
 	This specification follows the <a href="https://www.w3.org/TR/CSS2/about.html#property-defs">CSS property definition conventions</a> from [[!CSS2]]
 	using the <a href="https://www.w3.org/TR/css-values-3/#value-defs">value definition syntax</a> from [[!CSS-VALUES-3]].
 	Value types not defined in this specification are defined in CSS Values &amp; Units [[!CSS-VALUES-3]].
@@ -89,6 +119,26 @@ Value Definitions</h3>
 
 <h2 id="scrollbar-color">Scrollbar Colors: the 'scrollbar-color' property</h2>
 
+	<wpt title="
+		This section has partial test coverage.
+
+		Missing:
+		* Tests checking that the property does anything
+		* Tests checking that the colors apply to the right parts
+		* Initial value
+		* Tests of animation type">
+	</wpt>
+
+	<wpt title="The following tests have no basis in the spec:
+		they assume that making the thumb and the track transparent must make the whole scollbar invisible.
+		This is not necessarily true:
+		* the scrollbar may have other parts, such as scroll up/down/left/right buttons
+		* the spec does not require that the thumb / track are painted solid with the specified colors">
+
+		scrollbar-color-012.html
+		transparent-on-root.html
+	</wpt>
+
 	<pre class="propdef">
 	Name: scrollbar-color
 	Value: auto | <<color>>{2}
@@ -100,13 +150,46 @@ Value Definitions</h3>
 	Percentages: n/a
 	</pre>
 
+	<wpt>
+		inheritance.html
+		scrollbar-color-parsing.html
+	</wpt>
+
 	This property allows the author to set colors of an element's scrollbars.
 
+	<wpt title="This test useful but insufficient: it checks what the property doesn't do, not what it does.">
+		input-scrollbar-color.html
+	</wpt>
+	<wpt title="This test useful but insufficient: it checks that *if* the property works, current-color works.">
+		scrollbar-color-011.html
+	</wpt>
+	<wpt title="These tests are useful but insufficient: *if* the property works at all, they check that it updates correctly.">
+		scrollbar-color-dynamic-1.html
+		scrollbar-color-dynamic-2.html
+		scrollbar-color-dynamic-3.html
+		scrollbar-color-dynamic-4.html
+		scrollbar-color-dynamic-5.html
+		scrollbar-color-dynamic-6.html
+		scrollbar-color-dynamic-7.html
+	</wpt>
+
 	UAs must apply the scrollbar-color value set on the root element to the viewport.
 
+	<wpt title="The following test about viewport propagation is useful but insufficient;
+			the test will pass if the property has no effect at all.
+			Also missing:
+			* tests that check the interaction with css-contain, and in particular that that disables propagation">
+
+		viewport-scrollbar.html
+	</wpt>
+
 	Note: Unlike 'overflow' (and overflow-*) properties,
 	scrollbar-color value set on the HTML body element are not propagated to the viewport.
 
+	<wpt>
+		viewport-scrollbar-body.html
+	</wpt>
+
 	<dl dfn-type="value" dfn-for="scrollbar-color">
 		<dt><dfn>auto</dfn>
 		<dd>
@@ -115,6 +198,17 @@ Value Definitions</h3>
 			but may adjust the colors in accordance with 'color-scheme'
 			or other contextual information
 			to better suit the page.
+
+			<wpt title="These tests check that
+				that if the scrollbar adjusts based on the color scheme,
+				then dynamic updates to the color scheme
+				do cause an update of the scrollbar's colors.">
+
+				scrollbar-color-scheme-dynamic-1.html
+				scrollbar-color-scheme-dynamic-2.html
+				scrollbar-color-scheme-dynamic-3.html
+				scrollbar-color-scheme-dynamic-4.html
+			</wpt>
 		<dt><dfn><<color>></dfn>
 		<dd>
 			The user agent should use the specified colors
@@ -181,6 +275,16 @@ Value Definitions</h3>
 
 <h2 id="scrollbar-width">Scrollbar Thickness: the 'scrollbar-width' property</h2>
 
+	<wpt title="
+		This section has partial test coverage.
+
+		Missing:
+		* Test that thin does something different fromm auto in at least some cases
+		* Test that none does not affect scrollability
+		* Initial value
+		* Tests of animation type">
+	</wpt>
+
 	<pre class="propdef">
 	Name: scrollbar-width
 	Value: auto | thin | none
@@ -192,9 +296,24 @@ Value Definitions</h3>
 	Percentages: n/a
 	</pre>
 
+	<wpt>
+		inheritance.html
+		scrollbar-width-parsing.html
+		textarea-scrollbar-width-none.html
+	</wpt>
+
 	This property allows the author to specify
 	the desired thickness of an element’s scrollbars.
 
+	<wpt>
+		scrollbar-width-paint-001.html
+		scrollbar-width-paint-002.html
+		scrollbar-width-paint-003.html
+		scrollbar-width-paint-004.html
+		scrollbar-width-paint-005.html
+		scrollbar-width-paint-006.html
+	</wpt>
+
 	<div class=advisement>
 		The primary purpose of this property is not
 		to allow authors to choose a particular scrollbar aesthetic for their pages,
@@ -231,6 +350,14 @@ Value Definitions</h3>
 			(Implementers may wish to consult
 			<a href="https://www.w3.org/TR/WCAG21/#target-size">WCAG 2.1 SC 2.5.5 Target Size</a>. [[WCAG21]])
 
+			<wpt>
+				scrollbar-width-keywords.html
+				scrollbar-width-001.html
+				scrollbar-width-002.html
+				scrollbar-width-003.html
+				scrollbar-width-004.html
+			</wpt>
+
 			Note: User agents can use various strategies
 			to ensure the usability of narrow scrollbars.
 			For instance, in the case of <a spec=css-overflow-3>overlay scrollbars</a>,
@@ -254,6 +381,16 @@ Value Definitions</h3>
 			Implementations must not display any scrollbar,
 			however the element's scrollability by other means is not affected.
 
+			<wpt>
+				textarea-scrollbar-width-none.html
+				scrollbar-width-keywords.html
+				scrollbar-width-001.html
+				scrollbar-width-002.html
+				scrollbar-width-003.html
+				scrollbar-width-004.html
+				scrollbar-width-007.html
+			</wpt>
+
 			<div class=advisement>
 				Using this value can prevent mouse-only users from being able to scroll.
 				Authors should ensure that mouse-only users can still reach hidden content,
@@ -282,15 +419,29 @@ Value Definitions</h3>
 
 	UAs must apply the 'scrollbar-width' value set on the root element to the viewport.
 
+	<wpt>
+		scrollbar-width-005.html
+		scrollbar-width-006.html
+		scrollbar-width-007.html
+	</wpt>
+
 	Note: Unlike the 'overflow' property (and its longhands),
 	a 'scrollbar-width' value set on the HTML <{body}> element is not propagated to the viewport.
 
+	<wpt>
+		scrollbar-width-008.html
+		scrollbar-width-009.html
+		scrollbar-width-014.html
+	</wpt>
+
 	Note: This specification does not define the exact position or shape of the scrollbar,
 	or any animation thereof, such as fading or sliding in/out of view.
 
 <h2 class="no-num" id="acknowledgments">
 Appendix A. Acknowledgments</h2>
 
+	<wpt title="This section is not normative, it does not need tests."></wpt>
+
 	This appendix is <em>non-normative</em>.
 
 	<p>
@@ -305,28 +456,38 @@ Appendix A. Acknowledgments</h2>
 <h2 class="no-num" id="changes">
 Appendix B. Changes</h2>
 
+	<wpt title="This section is not normative, it does not need tests."></wpt>
+
 	This appendix is <em>non-normative</em>.
 
 <h3 class="no-num" id="changes-since-2021-12-06">
 Changes since the <a href="https://www.w3.org/TR/2021/CR-css-scrollbars-1-20211206/">6 December 2021 Candidate Recommendation</a></h3>
 
+	<wpt title="This section is not normative, it does not need tests."></wpt>
+
 	* Switched the Animation type of 'scrollbar-width' to [=discrete=],
 		reflecting the fact that this property only takes keyword values.
 
 <h3 class="no-num" id="changes-since-2021-12-02">
 Changes since the <a href="https://www.w3.org/TR/css-scrollbars-1/">2021-12-02 Working Draft</a></h3>
 
+	<wpt title="This section is not normative, it does not need tests."></wpt>
+
 	* Boilerplate changes for CR
 
 <h3 class="no-num" id="changes-since-2021-08-05">
 Changes from the <a href="https://www.w3.org/TR/2021/WD-css-scrollbars-1-20210805/">2021-08-05 Working Draft</a></h3>
 
+	<wpt title="This section is not normative, it does not need tests."></wpt>
+
 	* Switched "should" to a "must" with regards to accessibility of narrow scrollbars.
 		(see <a href="https://github.com/w3c/csswg-drafts/issues/6675">Issue 6675</a>)
 
 <h3 class="no-num" id="changes-since-2018-09-25">
 Changes from the <a href="https://www.w3.org/TR/2018/WD-css-scrollbars-1-20180925/">2018-09-25 First Public Working Draft</a></h3>
 
+	<wpt title="This section is not normative, it does not need tests."></wpt>
+
 	<ul>
 		<li><a href="https://github.com/w3c/csswg-drafts/issues/6438">#6538</a>:
 			removed <css>light</css> and <css>dark</css> values of 'scrollbar-color'
@@ -346,21 +507,29 @@ Changes from the <a href="https://www.w3.org/TR/2018/WD-css-scrollbars-1-2018092
 <h2 class="no-num" id="security-privacy-considerations">
 Appendix C. Security and Privacy</h2>
 
+	<wpt title="This section is not normative, it does not need tests."></wpt>
+
 	This appendix is <em>non-normative</em>.
 
 <h3 class="no-num" id="security-considerations">
 Considerations for Security</h3>
 
+	<wpt title="This section is not normative, it does not need tests."></wpt>
+
 	No specific concerns regarding security have been identified for this specification.
 
 <h3 class="no-num" id="privacy-considerations">
 Considerations for Privacy</h3>
 
+	<wpt title="This section is not normative, it does not need tests."></wpt>
+
 	No specific concerns regarding privacy have been identified for this specification.
 
 <h3 class="no-num" id="security-privacy-self-review">
 Self-review questionnaire</h3>
 
+	<wpt title="This section is not normative, it does not need tests."></wpt>
+
 	Per the <a href="https://www.w3.org/TR/security-privacy-questionnaire/#questions">
 	Self-Review Questionnaire: Security and Privacy: Questions to Consider</a>
 
@@ -423,6 +592,8 @@ Self-review questionnaire</h3>
 <h2 class="no-num" id="accessibility-considerations">
 Appendix D. Considerations for accessibility</h2>
 
+	<wpt title="This section is not normative, it does not need tests."></wpt>
+
 	This appendix is <em>non-normative</em>.
 
 	<div class=informative>