It contains a list of all the subpages belonging to the website. These files help search engines to learn more about the structure of a website. This speeds up the crawl process and reduces the likelihood that the crawler will overlook subpages. In addition, the file can provide additional information about certain content, e.g.:
- Information about images or videos that can be found on a website or the duration of a video and its subject.
- General information about the website, e.g. when it was last updated.