Do we know what timings the agreement requires.

Seem like 2024 was the planning date when awarded, but planning date is not necessarily a requirement of the contract.
https://spacenews.com/nasa-selects-spacex-to-develop-crewed-lunar-lander/
"NASA announced April 16 that it awarded a contract to SpaceX for Option A of the Human Landing System (HLS) program, which covers development of a crewed lunar lander and a demonstration mission. The fixed-price, milestone-based contract has a total value of $2.89 billion."
...
“These human-rated system developments are very complex, and there is risk. The NASA team will have the insight into the progress that SpaceX is making,” he said. “If they’re hitting their milestones, we may have a shot at 2024.”

A planning date probably isn't a required date. Further as it is milestone based, it seems quite possible Spacex could deliver first flight in 2027 or later and this still may be ok according to the agreement.

So does this question go by 2025 date or by what is required by the contract?

If @ChukeeRamone is not around to answer, perhaps should be N/A'd?

What happens if other parts NASA needs for Artemis III have more of a delay than Starship? It might not even be clear whether Starship would have been ready on schedule.