Sitemap.xml: A complete guide to creating and optimizing it for SEO

Sitemap.xml is one of the key tools for technical SEO optimization, helping search engine crawlers find and index your website’s pages efficiently. Despite its apparent simplicity, creating and configuring a sitemap correctly requires a thorough understanding of how search engines work and the characteristics of different types of websites. In this article, we’ll cover all aspects of working with sitemap.xml, from basic principles to advanced optimization techniques.

What is sitemap.xml and why is it needed?

Sitemap.xml is an XML file that contains information about a website’s pages and how they relate to one another. It serves as a site map for search engine crawlers, helping them crawl and index all important pages efficiently. The sitemap was first introduced by Google in 2005 and has since become the de facto standard for all major search engines.

The main purpose of sitemap.xml is to speed up the indexing process for search engine crawlers. Without a sitemap, crawlers have to discover pages on their own by following links, which can take a considerable amount of time, especially on large websites. A sitemap provides search engines with a complete list of all pages, their priorities, and how often they are updated.

Benefits of using sitemap.xml

Using sitemap.xml offers many benefits for SEO and overall website performance:

Faster indexing: Search engine crawlers get a complete list of pages at once, which significantly speeds up the indexing process.

Improved coverage: A sitemap helps search engines find pages that may not be accessible through the website’s regular navigation.

Priority control: You can specify the relative importance of different pages, which affects how often crawlers visit them.

Update monitoring: Search engines can track changes to pages and update their index accordingly.

Support for different content types: A sitemap can include information about images, videos, news, and other types of content.

Sitemap.xml structure and syntax

Basic syntax

Sitemap.xml has a clearly defined XML structure that must comply with the sitemap protocol specification.

CodeXML

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <url>
    <loc>https://example.com/</loc>
    <lastmod>2025-07-18</lastmod>
    <changefreq>daily</changefreq>
    <priority>1.0</priority>
  </url>
  <url>
    <loc>https://example.com/about</loc>
    <lastmod>2025-07-15</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.8</priority>
  </url>
</urlset>

Required and optional elements

Each sitemap entry must contain the required <loc> element and may include optional elements with additional information.

Required elements:

<loc> — the page URL (must be absolute)

Optional elements:

<lastmod> — the date the page was last modified
<changefreq> — how often the page changes
<priority> — the page’s relative priority

Values for changefreq

The <changefreq> element can have the following values:

always — the page changes with every request
hourly — the page changes every hour
daily — the page changes daily
weekly — the page changes weekly
monthly — the page changes monthly
yearly — the page changes annually
never — the page never changes

Values for priority

The <priority> element accepts values from 0.0 to 1.0, where 1.0 is the highest priority. It is important to understand that this is a relative priority, not an absolute one.

Sitemap types for different kinds of content

Standard sitemap for pages

The standard sitemap.xml for HTML pages is the most common type.

CodeXML

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <url>
    <loc>https://example.com/</loc>
    <lastmod>2025-07-18T10:30:00+00:00</lastmod>
    <changefreq>daily</changefreq>
    <priority>1.0</priority>
  </url>
  <url>
    <loc>https://example.com/products</loc>
    <lastmod>2025-07-17T15:45:00+00:00</lastmod>
    <changefreq>weekly</changefreq>
    <priority>0.9</priority>
  </url>
</urlset>

Image sitemap

Google supports a special sitemap format for images that helps with image indexing.

CodeXML

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
        xmlns:image="http://www.google.com/schemas/sitemap-image/1.1">
  <url>
    <loc>https://example.com/products/phone</loc>
    <image:image>
      <image:loc>https://example.com/images/phone.jpg</image:loc>
      <image:title>Смартфон iPhone 15</image:title>
      <image:caption>Новый iPhone 15 с улучшенной камерой</image:caption>
    </image:image>
  </url>
</urlset>

Video sitemap

Websites with video content can use a special video sitemap.

CodeXML

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
        xmlns:video="http://www.google.com/schemas/sitemap-video/1.1">
  <url>
    <loc>https://example.com/videos/tutorial</loc>
    <video:video>
      <video:thumbnail_loc>https://example.com/thumbnails/tutorial.jpg</video:thumbnail_loc>
      <video:title>Учебник по программированию</video:title>
      <video:description>Подробный учебник по основам программирования</video:description>
      <video:content_loc>https://example.com/videos/tutorial.mp4</video:content_loc>
      <video:duration>1200</video:duration>
      <video:publication_date>2025-07-18T10:00:00+00:00</video:publication_date>
    </video:video>
  </url>
</urlset>

News sitemap

News websites can use a special news sitemap with additional metadata.

CodeXML

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
        xmlns:news="http://www.google.com/schemas/sitemap-news/0.9">
  <url>
    <loc>https://example.com/news/breaking-news</loc>
    <news:news>
      <news:publication>
        <news:name>Example News</news:name>
        <news:language>ru</news:language>
      </news:publication>
      <news:publication_date>2025-07-18T10:30:00+00:00</news:publication_date>
      <news:title>Важные новости дня</news:title>
      <news:keywords>новости, события, важное</news:keywords>
    </news:news>
  </url>
</urlset>

Creating sitemaps for different types of websites

Sitemap for a corporate website

Corporate websites usually have a clear structure with main sections.

CodeXML

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <!-- Главная страница -->
  <url>
    <loc>https://company.com/</loc>
    <lastmod>2025-07-18</lastmod>
    <changefreq>weekly</changefreq>
    <priority>1.0</priority>
  </url>
  
  <!-- О компании -->
  <url>
    <loc>https://company.com/about</loc>
    <lastmod>2025-07-15</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.8</priority>
  </url>
  
  <!-- Услуги -->
  <url>
    <loc>https://company.com/services</loc>
    <lastmod>2025-07-17</lastmod>
    <changefreq>weekly</changefreq>
    <priority>0.9</priority>
  </url>
  
  <!-- Контакты -->
  <url>
    <loc>https://company.com/contacts</loc>
    <lastmod>2025-07-10</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.7</priority>
  </url>
</urlset>

Sitemap for an online store

Online stores require a more complex sitemap structure that accounts for categories, products, and filters.

CodeXML

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <!-- Главная страница -->
  <url>
    <loc>https://shop.com/</loc>
    <lastmod>2025-07-18</lastmod>
    <changefreq>daily</changefreq>
    <priority>1.0</priority>
  </url>
  
  <!-- Категории товаров -->
  <url>
    <loc>https://shop.com/category/electronics</loc>
    <lastmod>2025-07-17</lastmod>
    <changefreq>daily</changefreq>
    <priority>0.9</priority>
  </url>
  
  <!-- Отдельные товары -->
  <url>
    <loc>https://shop.com/product/smartphone-iphone-15</loc>
    <lastmod>2025-07-16</lastmod>
    <changefreq>weekly</changefreq>
    <priority>0.8</priority>
  </url>
  
  <!-- Информационные страницы -->
  <url>
    <loc>https://shop.com/delivery</loc>
    <lastmod>2025-07-10</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.6</priority>
  </url>
</urlset>

Sitemap for a blog

Blogs need to update their sitemaps regularly as new articles are published.

CodeXML

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <!-- Главная страница блога -->
  <url>
    <loc>https://blog.com/</loc>
    <lastmod>2025-07-18</lastmod>
    <changefreq>daily</changefreq>
    <priority>1.0</priority>
  </url>
  
  <!-- Категории -->
  <url>
    <loc>https://blog.com/category/technology</loc>
    <lastmod>2025-07-18</lastmod>
    <changefreq>weekly</changefreq>
    <priority>0.8</priority>
  </url>
  
  <!-- Отдельные статьи -->
  <url>
    <loc>https://blog.com/article/new-technology-trends</loc>
    <lastmod>2025-07-18</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.7</priority>
  </url>
</urlset>

Automating sitemap creation

Generating a sitemap in PHP

For dynamic websites, it is important to automate sitemap creation.

CodePHP

<?php
class SitemapGenerator {
    private $baseUrl;
    private $urls = [];
    
    public function __construct($baseUrl) {
        $this->baseUrl = rtrim($baseUrl, '/');
    }
    
    public function addUrl($path, $lastmod = null, $changefreq = 'weekly', $priority = '0.5') {
        $this->urls[] = [
            'loc' => $this->baseUrl . '/' . ltrim($path, '/'),
            'lastmod' => $lastmod ?: date('Y-m-d'),
            'changefreq' => $changefreq,
            'priority' => $priority
        ];
    }
    
    public function generate() {
        $xml = '<?xml version="1.0" encoding="UTF-8"?>' . "\n";
        $xml .= '<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">' . "\n";
        
        foreach ($this->urls as $url) {
            $xml .= "  <url>\n";
            $xml .= "    <loc>" . htmlspecialchars($url['loc']) . "</loc>\n";
            $xml .= "    <lastmod>" . $url['lastmod'] . "</lastmod>\n";
            $xml .= "    <changefreq>" . $url['changefreq'] . "</changefreq>\n";
            $xml .= "    <priority>" . $url['priority'] . "</priority>\n";
            $xml .= "  </url>\n";
        }
        
        $xml .= '</urlset>';
        return $xml;
    }
    
    public function save($filename) {
        return file_put_contents($filename, $this->generate());
    }
}

// Пример использования
$generator = new SitemapGenerator('https://example.com');
$generator->addUrl('', date('Y-m-d'), 'daily', '1.0');
$generator->addUrl('about', date('Y-m-d', strtotime('-1 week')), 'monthly', '0.8');
$generator->addUrl('products', date('Y-m-d'), 'weekly', '0.9');
$generator->save('sitemap.xml');
?>

Generating a sitemap in Node.js

Specialized libraries can be used for Node.js applications.

CodeJavaScript

const { SitemapStream, streamToPromise } = require('sitemap');
const { createWriteStream } = require('fs');

async function generateSitemap() {
    const sitemap = new SitemapStream({ hostname: 'https://example.com' });
    
    // Добавляем URL
    sitemap.write({
        url: '/',
        changefreq: 'daily',
        priority: 1.0,
        lastmod: new Date()
    });
    
    sitemap.write({
        url: '/about',
        changefreq: 'monthly',
        priority: 0.8,
        lastmod: new Date(Date.now() - 7 * 24 * 60 * 60 * 1000)
    });
    
    sitemap.write({
        url: '/products',
        changefreq: 'weekly',
        priority: 0.9,
        lastmod: new Date()
    });
    
    sitemap.end();
    
    // Сохраняем файл
    const xml = await streamToPromise(sitemap);
    require('fs').writeFileSync('./sitemap.xml', xml);
}

generateSitemap().catch(console.error);

Automatically updating a sitemap

For dynamic websites, it is important to set up automatic sitemap updates.

CodeShell

#!/bin/bash
# Скрипт для автоматического обновления sitemap

# Переходим в директорию сайта
cd /var/www/example.com

# Генерируем новый sitemap
php generate-sitemap.php

# Проверяем, что файл создался
if [ -f "sitemap.xml" ]; then
    echo "Sitemap успешно обновлен: $(date)"
    
    # Отправляем уведомление в Google Search Console
    curl -X POST "https://www.google.com/ping?sitemap=https://example.com/sitemap.xml"
    
    # Отправляем уведомление в Bing Webmaster Tools
    curl -X POST "https://www.bing.com/ping?sitemap=https://example.com/sitemap.xml"
else
    echo "Ошибка при создании sitemap: $(date)"
fi

Optimizing sitemaps for large websites

Splitting a sitemap into multiple files

For websites with a large number of pages, it is recommended to split the sitemap into multiple files.

CodeXML

<!-- sitemap-index.xml -->
<?xml version="1.0" encoding="UTF-8"?>
<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <sitemap>
    <loc>https://example.com/sitemap-pages.xml</loc>
    <lastmod>2025-07-18</lastmod>
  </sitemap>
  <sitemap>
    <loc>https://example.com/sitemap-products.xml</loc>
    <lastmod>2025-07-18</lastmod>
  </sitemap>
  <sitemap>
    <loc>https://example.com/sitemap-news.xml</loc>
    <lastmod>2025-07-18</lastmod>
  </sitemap>
</sitemapindex>

Compressing a sitemap

For large sitemap files, gzip compression is recommended.

CodePHP

<?php
function compressSitemap($xmlContent, $filename) {
    // Сохраняем обычный XML
    file_put_contents($filename, $xmlContent);
    
    // Создаем сжатую версию
    $gzContent = gzencode($xmlContent, 9);
    file_put_contents($filename . '.gz', $gzContent);
    
    return [
        'xml' => $filename,
        'gz' => $filename . '.gz'
    ];
}

// Использование
$sitemap = $generator->generate();
$files = compressSitemap($sitemap, 'sitemap.xml');
echo "Созданы файлы: " . implode(', ', $files);
?>

Sitemap monitoring and analytics

Tracking indexing

It is important to track how search engines use your sitemap.

CodeJavaScript

// Скрипт для мониторинга индексации
async function monitorSitemapIndexing() {
    const sitemapUrl = 'https://example.com/sitemap.xml';
    
    try {
        // Проверяем доступность sitemap
        const response = await fetch(sitemapUrl);
        if (!response.ok) {
            console.error('Sitemap недоступен:', response.status);
            return;
        }
        
        // Анализируем содержимое
        const xml = await response.text();
        const urlCount = (xml.match(/<url>/g) || []).length;
        
        console.log(`Sitemap содержит ${urlCount} URL`);
        
        // Отправляем данные в аналитику
        sendAnalytics('sitemap_monitoring', {
            url_count: urlCount,
            last_checked: new Date().toISOString(),
            status: 'success'
        });
        
    } catch (error) {
        console.error('Ошибка при проверке sitemap:', error);
        sendAnalytics('sitemap_monitoring', {
            error: error.message,
            last_checked: new Date().toISOString(),
            status: 'error'
        });
    }
}

// Запускаем мониторинг ежедневно
setInterval(monitorSitemapIndexing, 24 * 60 * 60 * 1000);

Integration with Google Search Console

Google Search Console provides detailed information about sitemap usage.

CodeJavaScript

// Интеграция с Google Search Console API
async function submitSitemapToGSC(sitemapUrl) {
    const accessToken = 'your-access-token';
    
    try {
        const response = await fetch(
            `https://searchconsole.googleapis.com/v1/sites/https%3A%2F%2Fexample.com%2F/sitemaps/${encodeURIComponent(sitemapUrl)}`,
            {
                method: 'PUT',
                headers: {
                    'Authorization': `Bearer ${accessToken}`,
                    'Content-Type': 'application/json'
                }
            }
        );
        
        if (response.ok) {
            console.log('Sitemap успешно отправлен в Google Search Console');
        } else {
            console.error('Ошибка при отправке sitemap:', response.status);
        }
    } catch (error) {
        console.error('Ошибка API:', error);
    }
}

Conclusion

Sitemap.xml remains a critical tool for helping search engines index websites efficiently. Creating and configuring a sitemap correctly can significantly speed up the indexing process and improve a website’s visibility in search results.

It is important to remember that a sitemap is not a cure-all, but one of the tools in an SEO specialist’s toolkit. Its effectiveness depends on content quality, the website’s technical optimization, and other SEO factors.

Regularly updating the sitemap, monitoring its use by search engines, and optimizing it to reflect changes in the website’s structure can help maintain optimal indexing and improve search rankings.

🔗 Check your sitemap: rechecker.ru/services/sitemap

What is sitemap.xml and why is it needed?

Benefits of using sitemap.xml

Using sitemap.xml offers many benefits for SEO and overall website performance:

Faster indexing: Search engine crawlers get a complete list of pages at once, which significantly speeds up the indexing process.

Improved coverage: A sitemap helps search engines find pages that may not be accessible through the website’s regular navigation.

Priority control: You can specify the relative importance of different pages, which affects how often crawlers visit them.

Update monitoring: Search engines can track changes to pages and update their index accordingly.

Support for different content types: A sitemap can include information about images, videos, news, and other types of content.

Sitemap.xml structure and syntax

Basic syntax

Sitemap.xml has a clearly defined XML structure that must comply with the sitemap protocol specification.

CodeXML

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <url>
    <loc>https://example.com/</loc>
    <lastmod>2025-07-18</lastmod>
    <changefreq>daily</changefreq>
    <priority>1.0</priority>
  </url>
  <url>
    <loc>https://example.com/about</loc>
    <lastmod>2025-07-15</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.8</priority>
  </url>
</urlset>

Required and optional elements

Each sitemap entry must contain the required <loc> element and may include optional elements with additional information.

Required elements:

<loc> — the page URL (must be absolute)

Optional elements:

<lastmod> — the date the page was last modified
<changefreq> — how often the page changes
<priority> — the page’s relative priority

Values for changefreq

The <changefreq> element can have the following values:

always — the page changes with every request
hourly — the page changes every hour
daily — the page changes daily
weekly — the page changes weekly
monthly — the page changes monthly
yearly — the page changes annually
never — the page never changes

Values for priority

The <priority> element accepts values from 0.0 to 1.0, where 1.0 is the highest priority. It is important to understand that this is a relative priority, not an absolute one.

Sitemap types for different kinds of content

Standard sitemap for pages

The standard sitemap.xml for HTML pages is the most common type.

CodeXML

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <url>
    <loc>https://example.com/</loc>
    <lastmod>2025-07-18T10:30:00+00:00</lastmod>
    <changefreq>daily</changefreq>
    <priority>1.0</priority>
  </url>
  <url>
    <loc>https://example.com/products</loc>
    <lastmod>2025-07-17T15:45:00+00:00</lastmod>
    <changefreq>weekly</changefreq>
    <priority>0.9</priority>
  </url>
</urlset>

Image sitemap

Google supports a special sitemap format for images that helps with image indexing.

CodeXML

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
        xmlns:image="http://www.google.com/schemas/sitemap-image/1.1">
  <url>
    <loc>https://example.com/products/phone</loc>
    <image:image>
      <image:loc>https://example.com/images/phone.jpg</image:loc>
      <image:title>Смартфон iPhone 15</image:title>
      <image:caption>Новый iPhone 15 с улучшенной камерой</image:caption>
    </image:image>
  </url>
</urlset>

Video sitemap

Websites with video content can use a special video sitemap.

CodeXML

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
        xmlns:video="http://www.google.com/schemas/sitemap-video/1.1">
  <url>
    <loc>https://example.com/videos/tutorial</loc>
    <video:video>
      <video:thumbnail_loc>https://example.com/thumbnails/tutorial.jpg</video:thumbnail_loc>
      <video:title>Учебник по программированию</video:title>
      <video:description>Подробный учебник по основам программирования</video:description>
      <video:content_loc>https://example.com/videos/tutorial.mp4</video:content_loc>
      <video:duration>1200</video:duration>
      <video:publication_date>2025-07-18T10:00:00+00:00</video:publication_date>
    </video:video>
  </url>
</urlset>

News sitemap

News websites can use a special news sitemap with additional metadata.

CodeXML

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
        xmlns:news="http://www.google.com/schemas/sitemap-news/0.9">
  <url>
    <loc>https://example.com/news/breaking-news</loc>
    <news:news>
      <news:publication>
        <news:name>Example News</news:name>
        <news:language>ru</news:language>
      </news:publication>
      <news:publication_date>2025-07-18T10:30:00+00:00</news:publication_date>
      <news:title>Важные новости дня</news:title>
      <news:keywords>новости, события, важное</news:keywords>
    </news:news>
  </url>
</urlset>

Creating sitemaps for different types of websites

Sitemap for a corporate website

Corporate websites usually have a clear structure with main sections.

CodeXML

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <!-- Главная страница -->
  <url>
    <loc>https://company.com/</loc>
    <lastmod>2025-07-18</lastmod>
    <changefreq>weekly</changefreq>
    <priority>1.0</priority>
  </url>
  
  <!-- О компании -->
  <url>
    <loc>https://company.com/about</loc>
    <lastmod>2025-07-15</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.8</priority>
  </url>
  
  <!-- Услуги -->
  <url>
    <loc>https://company.com/services</loc>
    <lastmod>2025-07-17</lastmod>
    <changefreq>weekly</changefreq>
    <priority>0.9</priority>
  </url>
  
  <!-- Контакты -->
  <url>
    <loc>https://company.com/contacts</loc>
    <lastmod>2025-07-10</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.7</priority>
  </url>
</urlset>

Sitemap for an online store

Online stores require a more complex sitemap structure that accounts for categories, products, and filters.

CodeXML

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <!-- Главная страница -->
  <url>
    <loc>https://shop.com/</loc>
    <lastmod>2025-07-18</lastmod>
    <changefreq>daily</changefreq>
    <priority>1.0</priority>
  </url>
  
  <!-- Категории товаров -->
  <url>
    <loc>https://shop.com/category/electronics</loc>
    <lastmod>2025-07-17</lastmod>
    <changefreq>daily</changefreq>
    <priority>0.9</priority>
  </url>
  
  <!-- Отдельные товары -->
  <url>
    <loc>https://shop.com/product/smartphone-iphone-15</loc>
    <lastmod>2025-07-16</lastmod>
    <changefreq>weekly</changefreq>
    <priority>0.8</priority>
  </url>
  
  <!-- Информационные страницы -->
  <url>
    <loc>https://shop.com/delivery</loc>
    <lastmod>2025-07-10</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.6</priority>
  </url>
</urlset>

Sitemap for a blog

Blogs need to update their sitemaps regularly as new articles are published.

CodeXML

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <!-- Главная страница блога -->
  <url>
    <loc>https://blog.com/</loc>
    <lastmod>2025-07-18</lastmod>
    <changefreq>daily</changefreq>
    <priority>1.0</priority>
  </url>
  
  <!-- Категории -->
  <url>
    <loc>https://blog.com/category/technology</loc>
    <lastmod>2025-07-18</lastmod>
    <changefreq>weekly</changefreq>
    <priority>0.8</priority>
  </url>
  
  <!-- Отдельные статьи -->
  <url>
    <loc>https://blog.com/article/new-technology-trends</loc>
    <lastmod>2025-07-18</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.7</priority>
  </url>
</urlset>

Automating sitemap creation

Generating a sitemap in PHP

For dynamic websites, it is important to automate sitemap creation.

CodePHP

<?php
class SitemapGenerator {
    private $baseUrl;
    private $urls = [];
    
    public function __construct($baseUrl) {
        $this->baseUrl = rtrim($baseUrl, '/');
    }
    
    public function addUrl($path, $lastmod = null, $changefreq = 'weekly', $priority = '0.5') {
        $this->urls[] = [
            'loc' => $this->baseUrl . '/' . ltrim($path, '/'),
            'lastmod' => $lastmod ?: date('Y-m-d'),
            'changefreq' => $changefreq,
            'priority' => $priority
        ];
    }
    
    public function generate() {
        $xml = '<?xml version="1.0" encoding="UTF-8"?>' . "\n";
        $xml .= '<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">' . "\n";
        
        foreach ($this->urls as $url) {
            $xml .= "  <url>\n";
            $xml .= "    <loc>" . htmlspecialchars($url['loc']) . "</loc>\n";
            $xml .= "    <lastmod>" . $url['lastmod'] . "</lastmod>\n";
            $xml .= "    <changefreq>" . $url['changefreq'] . "</changefreq>\n";
            $xml .= "    <priority>" . $url['priority'] . "</priority>\n";
            $xml .= "  </url>\n";
        }
        
        $xml .= '</urlset>';
        return $xml;
    }
    
    public function save($filename) {
        return file_put_contents($filename, $this->generate());
    }
}

// Пример использования
$generator = new SitemapGenerator('https://example.com');
$generator->addUrl('', date('Y-m-d'), 'daily', '1.0');
$generator->addUrl('about', date('Y-m-d', strtotime('-1 week')), 'monthly', '0.8');
$generator->addUrl('products', date('Y-m-d'), 'weekly', '0.9');
$generator->save('sitemap.xml');
?>

Generating a sitemap in Node.js

Specialized libraries can be used for Node.js applications.

CodeJavaScript

const { SitemapStream, streamToPromise } = require('sitemap');
const { createWriteStream } = require('fs');

async function generateSitemap() {
    const sitemap = new SitemapStream({ hostname: 'https://example.com' });
    
    // Добавляем URL
    sitemap.write({
        url: '/',
        changefreq: 'daily',
        priority: 1.0,
        lastmod: new Date()
    });
    
    sitemap.write({
        url: '/about',
        changefreq: 'monthly',
        priority: 0.8,
        lastmod: new Date(Date.now() - 7 * 24 * 60 * 60 * 1000)
    });
    
    sitemap.write({
        url: '/products',
        changefreq: 'weekly',
        priority: 0.9,
        lastmod: new Date()
    });
    
    sitemap.end();
    
    // Сохраняем файл
    const xml = await streamToPromise(sitemap);
    require('fs').writeFileSync('./sitemap.xml', xml);
}

generateSitemap().catch(console.error);

Automatically updating a sitemap

For dynamic websites, it is important to set up automatic sitemap updates.

CodeShell

#!/bin/bash
# Скрипт для автоматического обновления sitemap

# Переходим в директорию сайта
cd /var/www/example.com

# Генерируем новый sitemap
php generate-sitemap.php

# Проверяем, что файл создался
if [ -f "sitemap.xml" ]; then
    echo "Sitemap успешно обновлен: $(date)"
    
    # Отправляем уведомление в Google Search Console
    curl -X POST "https://www.google.com/ping?sitemap=https://example.com/sitemap.xml"
    
    # Отправляем уведомление в Bing Webmaster Tools
    curl -X POST "https://www.bing.com/ping?sitemap=https://example.com/sitemap.xml"
else
    echo "Ошибка при создании sitemap: $(date)"
fi

Optimizing sitemaps for large websites

Splitting a sitemap into multiple files

For websites with a large number of pages, it is recommended to split the sitemap into multiple files.

CodeXML

<!-- sitemap-index.xml -->
<?xml version="1.0" encoding="UTF-8"?>
<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <sitemap>
    <loc>https://example.com/sitemap-pages.xml</loc>
    <lastmod>2025-07-18</lastmod>
  </sitemap>
  <sitemap>
    <loc>https://example.com/sitemap-products.xml</loc>
    <lastmod>2025-07-18</lastmod>
  </sitemap>
  <sitemap>
    <loc>https://example.com/sitemap-news.xml</loc>
    <lastmod>2025-07-18</lastmod>
  </sitemap>
</sitemapindex>

Compressing a sitemap

For large sitemap files, gzip compression is recommended.

CodePHP

<?php
function compressSitemap($xmlContent, $filename) {
    // Сохраняем обычный XML
    file_put_contents($filename, $xmlContent);
    
    // Создаем сжатую версию
    $gzContent = gzencode($xmlContent, 9);
    file_put_contents($filename . '.gz', $gzContent);
    
    return [
        'xml' => $filename,
        'gz' => $filename . '.gz'
    ];
}

// Использование
$sitemap = $generator->generate();
$files = compressSitemap($sitemap, 'sitemap.xml');
echo "Созданы файлы: " . implode(', ', $files);
?>

Sitemap monitoring and analytics

Tracking indexing

It is important to track how search engines use your sitemap.

CodeJavaScript

// Скрипт для мониторинга индексации
async function monitorSitemapIndexing() {
    const sitemapUrl = 'https://example.com/sitemap.xml';
    
    try {
        // Проверяем доступность sitemap
        const response = await fetch(sitemapUrl);
        if (!response.ok) {
            console.error('Sitemap недоступен:', response.status);
            return;
        }
        
        // Анализируем содержимое
        const xml = await response.text();
        const urlCount = (xml.match(/<url>/g) || []).length;
        
        console.log(`Sitemap содержит ${urlCount} URL`);
        
        // Отправляем данные в аналитику
        sendAnalytics('sitemap_monitoring', {
            url_count: urlCount,
            last_checked: new Date().toISOString(),
            status: 'success'
        });
        
    } catch (error) {
        console.error('Ошибка при проверке sitemap:', error);
        sendAnalytics('sitemap_monitoring', {
            error: error.message,
            last_checked: new Date().toISOString(),
            status: 'error'
        });
    }
}

// Запускаем мониторинг ежедневно
setInterval(monitorSitemapIndexing, 24 * 60 * 60 * 1000);

Integration with Google Search Console

Google Search Console provides detailed information about sitemap usage.

CodeJavaScript

// Интеграция с Google Search Console API
async function submitSitemapToGSC(sitemapUrl) {
    const accessToken = 'your-access-token';
    
    try {
        const response = await fetch(
            `https://searchconsole.googleapis.com/v1/sites/https%3A%2F%2Fexample.com%2F/sitemaps/${encodeURIComponent(sitemapUrl)}`,
            {
                method: 'PUT',
                headers: {
                    'Authorization': `Bearer ${accessToken}`,
                    'Content-Type': 'application/json'
                }
            }
        );
        
        if (response.ok) {
            console.log('Sitemap успешно отправлен в Google Search Console');
        } else {
            console.error('Ошибка при отправке sitemap:', response.status);
        }
    } catch (error) {
        console.error('Ошибка API:', error);
    }
}

Conclusion

Regularly updating the sitemap, monitoring its use by search engines, and optimizing it to reflect changes in the website’s structure can help maintain optimal indexing and improve search rankings.

🔗 Check your sitemap: rechecker.ru/services/sitemap

What is sitemap.xml and why is it needed?

Benefits of using sitemap.xml

Sitemap.xml structure and syntax

Basic syntax

Required and optional elements

Values for changefreq

Values for priority

Sitemap types for different kinds of content

Standard sitemap for pages

Image sitemap

Video sitemap

News sitemap

Creating sitemaps for different types of websites

Sitemap for a corporate website

Sitemap for an online store

Sitemap for a blog

Automating sitemap creation

Generating a sitemap in PHP

Generating a sitemap in Node.js

Automatically updating a sitemap

Optimizing sitemaps for large websites

Splitting a sitemap into multiple files

Compressing a sitemap

Sitemap monitoring and analytics

Tracking indexing

Integration with Google Search Console

Conclusion

The page doesn’t appear in search results

How to troubleshoot technical audit errors

Terms by topic

Robots.txt: what it is and why it’s needed

Sitemap: what it is and why you need one

XML Sitemap: What It Is and How to Create One

SEO audit: what it is and how to conduct one

Sitemap.xml errors: how to find and fix them

How to create a sitemap.xml: generators and plugins

PDF or HTML in search: how to choose the primary version

Check your website

Feedback

What is sitemap.xml and why is it needed?

Benefits of using sitemap.xml

Sitemap.xml structure and syntax

Basic syntax

Required and optional elements

Values for changefreq

Values for priority

Sitemap types for different kinds of content

Standard sitemap for pages

Image sitemap

Video sitemap

News sitemap

Creating sitemaps for different types of websites

Sitemap for a corporate website

Sitemap for an online store

Sitemap for a blog

Automating sitemap creation

Generating a sitemap in PHP

Generating a sitemap in Node.js

Automatically updating a sitemap

Optimizing sitemaps for large websites

Splitting a sitemap into multiple files

Compressing a sitemap

Sitemap monitoring and analytics

Tracking indexing

Integration with Google Search Console

Conclusion

The page doesn’t appear in search results

How to troubleshoot technical audit errors

Terms by topic

Robots.txt: what it is and why it’s needed

Sitemap: what it is and why you need one

XML Sitemap: What It Is and How to Create One

SEO audit: what it is and how to conduct one

Sitemap.xml errors: how to find and fix them

How to create a sitemap.xml: generators and plugins

PDF or HTML in search: how to choose the primary version

Check your website