← CLT Prep

CLT: Reading experiments, data, and limits in Collecting the Night

Interpret controlled comparisons, data units, causal limits and the evidence needed for broader reliability claims.

Updated October 2, 2026

Overview

The panel experiment produces useful results, but useful results can answer some questions while leaving others open. Read the design and display together to distinguish a measured comparison from a causal explanation or a citywide prediction.

Collecting the Night
Practice text; scenes, speakers, and study data are invented. Collecting the Night Paragraph 1 A city research group proposed collecting water from dew on the roofs of small garden sheds. The proposal attracted attention because it appeared to turn an idle surface into a resource without drawing from the water supply. Before estimating how many gardens it could serve, however, the group needed to discover which feature of a collector mattered most. Several volunteers favored a rough surface, reasoning that its hollows would give droplets places to gather. Others thought the surface's temperature after sunset would be more important than its texture. The disagreement was useful because it offered two explanations that could be tested separately. Paragraph 2 The researchers prepared smooth and textured panels of the same material, with equal areas and slopes. Half of each kind stood beneath removable shades during the afternoon; the others received sunlight. All shades were removed before evening measurements began, so every panel faced the same open night sky. On twenty dry, cloudless nights, the team recorded the panels' temperatures two hours after sunset and the water collected by morning. Positions were rotated between trials to prevent a sheltered corner from consistently favoring one treatment. The table reports averages across those nights, not the outcome of every individual trial. Paragraph 3 The results complicated the volunteers' original expectations. Textured panels collected slightly more water than smooth ones within each afternoon treatment, but shading corresponded to a much larger difference. The shaded panels were also cooler when the nighttime readings were taken. The team therefore considered temperature a promising explanation for most of the collection difference, while treating texture as a possible smaller influence. They did not claim that the table alone established every step in the process. A temperature reading made two hours after sunset could not reveal precisely when each panel had first begun collecting water. Paragraph 4 One volunteer wanted to multiply the best average yield by the city's entire roof area. The researchers resisted. Shed roofs differed in angle, surrounding vegetation, cleanliness, and exposure to wind, and the trial included neither cloudy nights nor rainy ones. Moreover, collected water would need testing before any use involving human consumption. Even for garden irrigation, a seasonal total would matter more than an attractive yield on favorable nights. The group could recommend a more extensive trial without claiming that the prototype had already solved a city's water problem. Refusing that claim was a way of preserving the experiment's usefulness rather than dismissing it. Paragraph 5 The next study would use sensors that recorded temperature continuously, together with collectors placed on working sheds throughout the city. Continuous records could connect changes in temperature with the onset of collection, while the varied sites would test how well the initial result traveled. These were different questions, and neither improvement would answer the other automatically. A precise account of one panel's behavior would not establish a dependable citywide supply; a large total from many roofs would not by itself explain why a particular texture worked. The original disagreement had thus produced more than a winning design. It had supplied a disciplined order in which to ask the next questions.
Night water collection by panel treatment

Invented trial averages across 20 nights; equal-area panels.

Night water collection by panel treatment
Afternoon treatmentSurfaceTemperature two hours after sunset (°C)Water by morning (mL)
ShadedSmooth15.314
ShadedTextured15.415
ExposedSmooth19.15
ExposedTextured196

Build a map of the investigation

The water-collection passage follows a sequence of questions rather than announcing a finished invention. Volunteers disagree about whether surface texture or temperature matters more. Researchers compare panels, observe a promising pattern, resist a citywide prediction, and plan two kinds of follow-up. A main-purpose answer should connect those stages. The experiment can guide further research without resolving every causal or practical question. Calling the passage a proof that one design can supply the city would skip the limits that motivate its second half.

Begin by separating the treatments from the controls. Smooth and textured surfaces vary, as does afternoon shading. Material, area, and slope are held equal. Removing every shade before evening keeps the night-sky exposure comparable. Rotating panel positions addresses another possible explanation: a sheltered location might favor whichever treatment happened to occupy it. Rotation is not a test of whether moving collectors improves yield, and it does not make their slopes different. It reduces the chance that a location advantage consistently masquerades as a treatment advantage.

This distinction gives you a practical reading map: what changed, what stayed comparable, what was measured, and what remained unknown. You do not need outside expertise about dew to construct it. The relevant information is supplied in the passage. As a check, explain why keeping all panels in fixed positions could weaken the comparison even if every panel had the same size. Equal size would control one possible cause, while unequal locations could still supply another. A control is useful for a particular competing explanation; it is not a general certificate that every uncertainty has disappeared.

Now test the organization by imagining an ending that proposes continuous readings only on the original panels during more dry, cloudless nights. This would answer part of the earlier problem more closely: a sequence can connect temperature changes with collection’s onset. It would not answer the objections about working roofs and other weather. More observations in a restricted setting remain observations of that setting. The original ending matters because it assigns separate follow-up methods to the process question and the transfer question. Removing one method leaves a specific earlier concern unanswered; it does not make the remaining method useless or turn it into evidence about unobserved sites.

Read the display through one comparison at a time

The display can answer several questions, but each requires holding something different constant. To examine shading, compare smooth shaded panels with smooth exposed panels: the average yields are 14 mL and 5 mL, a difference of 9 mL. Repeat within the textured surface: 15 mL compared with 6 mL again gives 9 mL. That supports the statement that shading is associated with 9 mL more average water within each surface type.

To examine texture instead, compare surfaces within the same afternoon treatment. Shaded textured panels average 15 mL and shaded smooth panels 14 mL. Exposed textured panels average 6 mL and exposed smooth panels 5 mL. Texture therefore corresponds to a 1 mL difference in each comparison, not the 9 mL shading difference. A distractor can quote a correct number while assigning it to the wrong comparison. Always name both the rows and the outcome column before calculating.

The temperature column requires the same care. A 9 mL difference in collected water is not a 9 °C difference in temperature. Units are part of the claim, not decoration. Also, these are averages across twenty nights. The table does not say that every panel produced the average on every trial. Check your interpretation by completing this sentence: “Among these treatments and over the observed nights, the average difference was…” That wording retains what the display establishes while avoiding claims about every individual result or an untested season.

Keep an association separate from a complete causal story

The shaded panels are cooler at the recorded time and collect more water. The researchers treat temperature as a promising explanation for much of the yield difference. That interpretation is stronger than saying the observations are irrelevant, but weaker than claiming a complete account of droplet formation. A reading made two hours after sunset cannot show precisely when collection began. The missing information concerns timing within the process, not whether a visible average difference exists.

The volunteer’s stronger causal claim must be checked against the controls, not accepted or rejected wholesale. Rotating positions weakens the explanation that a favored corner consistently benefits a treatment. Removing all shades before nightfall makes continuing physical cover an unlikely source of unequal night-sky exposure. Those are real gains in interpretability. Neither supplies the missing sequence from temperature change to collection onset. Nor does removing a shade erase any effect its earlier use may have had on the panel’s later temperature. The controls also do not require smooth and textured surfaces to have exactly equal temperatures before temperature can be a plausible contributor. Match each safeguard to the particular alternative it addresses, then ask which causal question still lacks an observation.

The final paragraph makes this distinction operational. Continuous temperature records could connect temperature changes with the onset of collection. Testing working sheds around the city would address how well the result “traveled”: whether it applies beyond the original setup. The word is figurative, so transporting panels or distributing collected water is beside the point. Those two improvements answer different questions. More precise timing at one site does not establish reliable citywide performance, while many successful sites do not by themselves explain the mechanism operating in one panel. Follow-up methods reveal which uncertainty the original evidence leaves open.

Evaluate the jump from a favorable trial to a practical claim

The volunteer who multiplies the best average yield by the city’s roof area performs an extrapolation. The multiplication might be arithmetically correct while its assumptions remain unsupported. Working roofs differ in angle, vegetation, cleanliness, and wind exposure; the trial includes neither cloudy nor rainy nights. A favorable nightly yield is therefore not yet a dependable seasonal supply. The author uses the proposal to expose that gap, not to accuse the volunteer of being unable to multiply.

For evidence about the missing year-round estimate, the sentence naming untested cloudy and rainy conditions is especially direct. The statement that the table contains averages limits claims about individual nights, but an average could still come from a representative year-long sample. Testing water before human consumption concerns safe use, not the amount collected over a year. A follow-up plan addresses future evidence without naming the particular seasonal omission as directly. These distinctions keep the quotation matched to the claim.

Try a counterfactual check. If the same panels had been observed across representative weather for a full year, would the current sentence about omitted weather still limit the seasonal estimate in the same way? No: that specific gap would be reduced, although site differences and safety questions could remain. Thinking this way helps you identify what evidence actually does. A limitation should have an identifiable target, and a proposed improvement should address that target rather than merely add more observations of the same restricted conditions.

Use controls and limits to reason by analogy

The concrete control analogy pairs rotating panel positions : consistent location advantage with concealing program labels : reviewer priming. Priming here means that first seeing the program’s labels could influence a reviewer’s supposedly separate judgment. Each first term is a safeguard against the misleading influence named second. Continuous temperature readings : collection onset connects a measurement method to a process it investigates, not an influence it removes. Observed panel yields : seasonal supply connects narrow evidence with a broader claim. Recorded harbor noise : missed calls connects a possible source of error with the error itself. The same scientific vocabulary can hide these different functions. State the relation as “this procedure weakens that alternative explanation.” Then check that both terms preserve the procedure-to-influence direction, rather than merely identifying two sensible research activities.

The second analogy runs from a narrow performance measure to a broader reliability claim. A favorable nightly average contributes evidence toward a seasonal supply estimate, but it does not establish that estimate. Reversing the pair into a general prediction and one test observation changes the direction. Calling the average irrelevant goes too far in the other direction: limited evidence can still be useful when its limits are understood.

Apply both ideas to an original situation. A class tests a solar-powered lamp on clear afternoons. The lamp works well, so the class proposes lighting a shaded courtyard all winter. A useful response would distinguish the observed performance from the proposed reliability claim and recommend testing conditions relevant to the courtyard. Merely repeating the sunny test more precisely would not settle winter performance. Conversely, testing many winter days might show reliability without explaining why a particular battery works better. End by writing two follow-up questions for the dew study, one about mechanism and one about transfer. If your questions could be answered by exactly the same evidence, revisit the final paragraph’s division of labor.

Practice question

Loading saved practice…

In your own words

How would you spot another research purpose synthesis question, and what would you do first?

Back to the course

Related Resources