WordPress.org

Bahasa Melayu

Get WordPress
WordPress.org

Plugin Directory

Plugin Tag: crawler

Plugin Tag: crawler

  • Email Address Encoder

    (160 jumlah taraf)

    A lightweight plugin that protects email addresses from email-harvesting robots, by encoding them into decimal and hexadecimal entities.

    Till Krüss 100,000+ pemasangan aktif Diuji dengan 7.0

  • Robots.txt Editor

    (8 jumlah taraf)

    Robots.txt for WordPress

    Processby 10,000+ pemasangan aktif Diuji dengan 5.6.17

  • No-Bot Registration

    (27 jumlah taraf)

    Prevent bots from creating accounts by blacklisting domains and usernames and present people with a human friendly security question.

    Arnan 2,000+ pemasangan aktif Diuji dengan 6.9.4

  • Robots.txt rewrite

    (2 jumlah taraf)

    Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

    Eugen Bobrowski 1,000+ pemasangan aktif Diuji dengan 4.7.33

  • Marquee image crawler

    (1 jumlah taraf)

    Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.

    gopiplus 700+ pemasangan aktif Diuji dengan 6.1.10

  • Mass Ping Tool for SEO – WordPress ping list to get indexed faster on Google, Yandex, …

    (4 jumlah taraf)

    Mass ping tool for SEO plugin is one of the fastest ways to get indexed by Google. After pinging, Google bots, crawlers will visit your website and in …

    Pagup 500+ pemasangan aktif Diuji dengan 7.0

  • Bisteinoff SEO Robots.txt

    (4 jumlah taraf)

    An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).

    Denis Bisteinov 500+ pemasangan aktif Diuji dengan 6.9.4

  • Block Archive.org via WordPress robots.txt

    (0 jumlah taraf)

    Blocks the archive.org bots through the WordPress virtual robots.txt file.

    apasionados 400+ pemasangan aktif Diuji dengan 6.9.4

  • Block Chat GPT via robots.txt

    (1 jumlah taraf)

    Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file

    apasionados 100+ pemasangan aktif Diuji dengan 6.3.8

  • bodi0`s Bots visits counter

    (5 jumlah taraf)

    Counts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings.

    Budiony Damyanov 100+ pemasangan aktif Diuji dengan 6.1.10

  • Block eCommerce Assets via robots.txt

    (0 jumlah taraf)

    Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

    apasionados 100+ pemasangan aktif Diuji dengan 6.3.8

  • Warmer – Cache Warmer and Cache Preload Crawler

    (6 jumlah taraf)

    Warm your WordPress cache with scheduled crawling, cache preloading, URL source control, logs, diagnostics, and WP-CLI.

    Atakan Oz 70+ pemasangan aktif Diuji dengan 7.0

  • AI Deny

    (1 jumlah taraf)

    Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.

    Code For Broke 60+ pemasangan aktif Diuji dengan 6.9.4

  • Findkit – Site Search

    (0 jumlah taraf)

    Powerful cloud based search engine for your website. Search as you type, real-time index updates, and embeddable UI. Free for small websites.

    Findkit Team 60+ pemasangan aktif Diuji dengan 6.9.0

  • Boring Cache Warmup Lite

    (2 jumlah taraf)

    A lightweight, privacy-friendly WordPress cache warmup tool. No external services, no drama.

    chriskubisch 30+ pemasangan aktif Diuji dengan 7.0

  • Block Common Crawl via robots.txt

    (0 jumlah taraf)

    Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

    apasionados 30+ pemasangan aktif Diuji dengan 6.3.8

  • Block Feed and Comments via robots.txt

    (0 jumlah taraf)

    Blocks some Feed and Comment resources in order to avoid spam bots

    apasionados 20+ pemasangan aktif Diuji dengan 6.3.8

  • EdgeShaping Lite

    (0 jumlah taraf)

    Observe which AI bots visit which pages and when. WordPress implementation of the EdgeShaping framework.

    mareinterno 20+ pemasangan aktif Diuji dengan 7.0

  • Adriano GEO Context and Crawl Monitor

    (0 jumlah taraf)

    Optimize your WordPress site for AI search engines. Serves a virtual AI context endpoint, injects JSON-LD schema, and tracks AI crawler visits.

    adriano 10+ pemasangan aktif Diuji dengan 7.0

  • Azayem Bots Tracker – Bot Visits Logger

    (0 jumlah taraf)

    A custom plugin to log search engine bot visits and analyze their crawl budget directly inside WordPress (no external services required).

    botstracker 10+ pemasangan aktif Diuji dengan 6.9.4