Unconfigured Ad Widget

Collapse

Attacked by Claude

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Marauder2003
    Waiting for Abs
    CGN Contributor - Lifetime
    • Aug 2010
    • 3148

    Attacked by Claude

    I have added some basic logging to my website. Took a partial log and fed it to ChatGPT to analyze. It told me that an IP tied to Claude has accessed the 2nd page of my site directly over 4500 times in less than 3 hours.

    I have a table of IPs that I block. If you are blocked you get a 403 error. Needless to say Claude is now blocked.

    I plan to add logic to the 2nd page that checks to see if you came from the first page. If not it sends you back to the first page.

    Today I plan to ask Claude to analyze the log and see what it says about it's activity.
    #NotMyPresident
    #ArrestFauci
    sigpic
  • #2
    Marauder2003
    Waiting for Abs
    CGN Contributor - Lifetime
    • Aug 2010
    • 3148

    Claude said this:

    Anthropic's Claude-SearchBot — ~5,000 requests over those two days, legitimate and self-identified.
    You.com's "YouBot" — ~1,800 requests, also a legitimate, self-identified AI search crawler.
    A large, disguised scraper — this is the interesting one. 5,397 requests spread across 568 different IPs, all using the exact same fake browser signature (Chrome/142.0.0.0 on Mac),

    Claude suggested adding Claude-SearchBot to robots.txt which I have done. Along with many others. Will see how activity changes.
    #NotMyPresident
    #ArrestFauci
    sigpic

    Comment

    • #3
      arrix
      Veteran Member
      • May 2012
      • 4901

      Use Clause to create a robots.txt file that filters out all of the IPs you found in your logs.
      There is no week nor day nor hour, when tyranny may not enter upon this country, if the people lose their supreme confidence in themselves -- and lose their roughness and spirit of defiance -- Tyranny may always enter -- there is no charm, no bar against it -- the only bar against it is a large resolute breed of men.

      -Walt Whitman

      Comment

      • #4
        hermosabeach
        I need a LIFE!!
        • Feb 2009
        • 19896

        can you run the same on cal guns to see who the "Guest" members are and IP address?
        Who's Online


        There are 154 member(s) and 12292 guest(s) online. Showing 1–10 of 12446 users.
        Rule 1- ALL GUNS ARE ALWAYS LOADED

        Rule 2 -NEVER LET THE MUZZLE COVER ANYTHING YOU ARE NOT PREPARED TO DESTROY (including your hands and legs)

        Rule 3 -KEEP YOUR FINGER OFF THE TRIGGER UNTIL YOUR SIGHTS ARE ON THE TARGET

        Rule 4 -BE SURE OF YOUR TARGET AND WHAT IS BEYOND IT
        (thanks to Jeff Cooper)

        Comment

        • #5
          sonofeugene
          Veteran Member
          • Oct 2013
          • 4759

          Yet more problems using AI…..

          I absolutely hate AI!!
          Let us not pray to be sheltered from dangers but to be fearless when facing them. - Rabindranath Tagore

          A mind all logic is like a knife all blade. It makes the hand bleed that uses it. - Rabindranath Tagore

          Talent hits a target no one else can hit. Genius hits a target no one else can see. - Arthur Schopenhaur

          Comment

          • #6
            Marauder2003
            Waiting for Abs
            CGN Contributor - Lifetime
            • Aug 2010
            • 3148

            Originally posted by arrix
            Use Clause to create a robots.txt file that filters out all of the IPs you found in your logs.
            Don’t think robots.txt can use IPs. It uses text in the agent field.
            #NotMyPresident
            #ArrestFauci
            sigpic

            Comment

            • #7
              TheGood
              Calguns Addict
              • Mar 2017
              • 6654

              I think this is the scourge of the CG errors, web crawling bots trying to data mine CG.

              Kestryll ll can the robots.txt blocking file be added to CG server??
              Leftists Call their own Marxism a far-right "Fascist Conspiracy Theory" <- Link to their playbook

              Comment

              • #8
                Marauder2003
                Waiting for Abs
                CGN Contributor - Lifetime
                • Aug 2010
                • 3148

                Originally posted by TheGood
                I think this is the scourge of the CG errors, web crawling bots trying to data mine CG.

                Kestryll ll can the robots.txt blocking file be added to CG server??
                There are a few problems with robots.txt. Robots, crawlers, etc can ignore it. You can block all unless the file is ignored. My current list is:

                # Anthropic (Claude)
                User-agent: ClaudeBot
                Disallow: /

                User-agent: Claude-SearchBot
                Disallow: /

                # OpenAI (ChatGPT)
                User-agent: GPTBot
                Disallow: /

                User-agent: ChatGPT-User
                Disallow: /

                User-agent: OAI-SearchBot
                Disallow: /

                # Google Gemini / AI training (separate from regular Googlebot search indexing)
                User-agent: Google-Extended
                Disallow: /

                # Perplexity AI
                User-agent: PerplexityBot
                Disallow: /

                # Common Crawl (dataset used by many AI labs for training)
                User-agent: CCBot
                Disallow: /

                # ByteDance / TikTok
                User-agent: Bytespider
                Disallow: /

                # You.com AI search
                User-agent: YouBot
                Disallow: /

                User-agent: anthropic-ai
                Disallow: /

                User-agent: meta-externalagent
                Disallow: /

                User-agent: Meta-ExternalAgent
                Disallow: /

                User-agent: Amazonbot
                Disallow: /

                User-agent: Baiduspider
                Disallow: /

                User-agent: DotBot
                Disallow: /

                User-agent: MJ12bot
                Disallow: /

                User-agent: AhrefsBot
                Disallow: /

                User-agent: Semrushbot
                Disallow: /

                User-agent: SERankingBacklinksBot Disallow: /

                User-agent: BacklinksExtendedBot Disallow: /

                User-agent: CanadianOrganizationDirectoryCrawlerV2
                Disallow: /

                #NotMyPresident
                #ArrestFauci
                sigpic

                Comment

                Working...
                UA-8071174-1