Erel B4X founder Staff member Licensed User Longtime User Nov 19, 2025 #1 It is almost impossible now to run a non-small site without CloudFlare, protecting and caching the data for all these bots. This is a new phenomena and I wasn't surprised to see that CloudFlare failing took down large parts of the internet yesterday.
It is almost impossible now to run a non-small site without CloudFlare, protecting and caching the data for all these bots. This is a new phenomena and I wasn't surprised to see that CloudFlare failing took down large parts of the internet yesterday.
Pendrush Well-Known Member Licensed User Longtime User Nov 19, 2025 #2 I'm also running website with about 400.000-450.000 unique visitors per day. Without Cloudflare, I'd probably need load balancing for the website to function. The number of bots hitting the site's pages is unreal. PS. CloudFlare fall explanation: https://blog.cloudflare.com/18-november-2025-outage/ Actually is one line (82) of code in Rust, as developers love to take shortcut(s) and use unwrap():
I'm also running website with about 400.000-450.000 unique visitors per day. Without Cloudflare, I'd probably need load balancing for the website to function. The number of bots hitting the site's pages is unreal. PS. CloudFlare fall explanation: https://blog.cloudflare.com/18-november-2025-outage/ Actually is one line (82) of code in Rust, as developers love to take shortcut(s) and use unwrap():
aeric Expert Licensed User Longtime User Nov 19, 2025 #3 Recently I heard some people want to rewrite Linux kernel with Rust and promote it is better in many ways compare to C or C++.
Recently I heard some people want to rewrite Linux kernel with Rust and promote it is better in many ways compare to C or C++.
Alessandro71 Well-Known Member Licensed User Longtime User Nov 19, 2025 #4 aeric said: Recently I heard some people want to rewrite Linux kernel with Rust and promote it is better in many ways compare to C or C++. Click to expand... looks like this is not an issue of memory corruption or something a safety feature of a language can prevent. programming errors are language-agnostic
aeric said: Recently I heard some people want to rewrite Linux kernel with Rust and promote it is better in many ways compare to C or C++. Click to expand... looks like this is not an issue of memory corruption or something a safety feature of a language can prevent. programming errors are language-agnostic
Sandman Expert Licensed User Longtime User Nov 19, 2025 #5 Erel said: View attachment 168456 It is almost impossible now to run a non-small site without CloudFlare, protecting and caching the data for all these bots. This is a new phenomena and I wasn't surprised to see that CloudFlare failing took down large parts of the internet yesterday. Click to expand... It doesn't seem unreasonable to only allow a small part of the forum to be public. (So newbies can see that there's activity in here.) For the full forum, one would need an account - which is simple and free to get. That should stop a lot of bot traffic, right?
Erel said: View attachment 168456 It is almost impossible now to run a non-small site without CloudFlare, protecting and caching the data for all these bots. This is a new phenomena and I wasn't surprised to see that CloudFlare failing took down large parts of the internet yesterday. Click to expand... It doesn't seem unreasonable to only allow a small part of the forum to be public. (So newbies can see that there's activity in here.) For the full forum, one would need an account - which is simple and free to get. That should stop a lot of bot traffic, right?
Erel B4X founder Staff member Licensed User Longtime User Nov 20, 2025 #6 Sandman said: That should stop a lot of bot traffic, right? Click to expand... Bot traffic is not inherently bad. I do want the data in the forum to be crawled by Google, ChatGPT and other well behaved bots.
Sandman said: That should stop a lot of bot traffic, right? Click to expand... Bot traffic is not inherently bad. I do want the data in the forum to be crawled by Google, ChatGPT and other well behaved bots.
Sandman Expert Licensed User Longtime User Nov 20, 2025 #7 Erel said: Bot traffic is not inherently bad. I do want the data in the forum to be crawled by Google, ChatGPT and other well behaved bots. Click to expand... Ah, fair enough. I didn't think of that case.
Erel said: Bot traffic is not inherently bad. I do want the data in the forum to be crawled by Google, ChatGPT and other well behaved bots. Click to expand... Ah, fair enough. I didn't think of that case.
Sandman Expert Licensed User Longtime User Nov 20, 2025 #8 I saw these a couple of days ago, thought I'd post here. I don't know if this is relevant for the forum, but generally speaking it seems like a good idea. Use the Accept Header to serve Markdown instead of HTML to LLMs Make your website accessible to LLM agents by serving plain Markdown when they request text/plain or text/markdown. Save tokens and improve agent experience with this simple Astro and Cloudflare Workers implementation. www.skeptrune.com GitHub - thekevinm/HTML-to-MD-AI: Lightweight tool that converts traditional HTML pages to Markdown when being invoked by AI Agents to reduce token usage and improve readability. Lightweight tool that converts traditional HTML pages to Markdown when being invoked by AI Agents to reduce token usage and improve readability. - thekevinm/HTML-to-MD-AI github.com Edit: I should have clarified that my thought was that perhaps XenForo have a plugin that serve Markdown instead of HTML if the content is being consumed by a bot. If not, perhaps they would be willing to make one, assuming there is interest from their customers.
I saw these a couple of days ago, thought I'd post here. I don't know if this is relevant for the forum, but generally speaking it seems like a good idea. Use the Accept Header to serve Markdown instead of HTML to LLMs Make your website accessible to LLM agents by serving plain Markdown when they request text/plain or text/markdown. Save tokens and improve agent experience with this simple Astro and Cloudflare Workers implementation. www.skeptrune.com GitHub - thekevinm/HTML-to-MD-AI: Lightweight tool that converts traditional HTML pages to Markdown when being invoked by AI Agents to reduce token usage and improve readability. Lightweight tool that converts traditional HTML pages to Markdown when being invoked by AI Agents to reduce token usage and improve readability. - thekevinm/HTML-to-MD-AI github.com Edit: I should have clarified that my thought was that perhaps XenForo have a plugin that serve Markdown instead of HTML if the content is being consumed by a bot. If not, perhaps they would be willing to make one, assuming there is interest from their customers.
Magma Expert Licensed User Longtime User Nov 21, 2025 #9 Erel said: View attachment 168456 It is almost impossible now to run a non-small site without CloudFlare, protecting and caching the data for all these bots. This is a new phenomena and I wasn't surprised to see that CloudFlare failing took down large parts of the internet yesterday. Click to expand... Will be nice a tutorial for CloudFlare using... some how to, suggests.... some screenshots... exchange ideas * for Chit Chat ofcourse not for Development Sections... (but also for those using jserver at production... some cloudflare knowledge will make the difference)
Erel said: View attachment 168456 It is almost impossible now to run a non-small site without CloudFlare, protecting and caching the data for all these bots. This is a new phenomena and I wasn't surprised to see that CloudFlare failing took down large parts of the internet yesterday. Click to expand... Will be nice a tutorial for CloudFlare using... some how to, suggests.... some screenshots... exchange ideas * for Chit Chat ofcourse not for Development Sections... (but also for those using jserver at production... some cloudflare knowledge will make the difference)
D Didier99 Member Licensed User Nov 24, 2025 #10 Erel said: Bot traffic is not inherently bad. I do want the data in the forum to be crawled by Google, ChatGPT and other well behaved bots. Click to expand... Interestingly, ChatGPT seems to be relatively proficient in B4X. It's not at the level of other more common languages but it was useful the couple of times I asked questions. Just hallucinating a bit, so don't expect everything to work immediately, but useful nonetheless Edit: I used Microsoft CoPilot today and it too was useful (my work only allows the CoPilot version tailored to our company, so that IP is not used to feed back the monster...) It had to do with Regex. The first pass did not completely work, but after refining my query, the second pass was a hit Edit 2: one thing that ChatGPT consistently misses is the Bit functions. It uses Code: Copy a And b instead of B4X: Copy Bit.And( a, b ) Last edited: Dec 10, 2025
Erel said: Bot traffic is not inherently bad. I do want the data in the forum to be crawled by Google, ChatGPT and other well behaved bots. Click to expand... Interestingly, ChatGPT seems to be relatively proficient in B4X. It's not at the level of other more common languages but it was useful the couple of times I asked questions. Just hallucinating a bit, so don't expect everything to work immediately, but useful nonetheless Edit: I used Microsoft CoPilot today and it too was useful (my work only allows the CoPilot version tailored to our company, so that IP is not used to feed back the monster...) It had to do with Regex. The first pass did not completely work, but after refining my query, the second pass was a hit Edit 2: one thing that ChatGPT consistently misses is the Bit functions. It uses Code: Copy a And b instead of B4X: Copy Bit.And( a, b )
aeric Expert Licensed User Longtime User Jun 27, 2026 #12 I saw the guests have reached almost 50,000! Even Elon Musk has joined us!
teddybear Well-Known Member Licensed User Jun 27, 2026 #14 aeric said: 72k! View attachment 172061 Click to expand... This might be a good thing for B4X, as many AI models may be learning from it. Recently, I tried developing a B4J project using AI. I didn't write a single line of code; everything from library wrapping to the demo project generation and interface design was done by AI, and it did an excellent job, far exceeding my expectations. I think the key to success depends on how we feed it data.
aeric said: 72k! View attachment 172061 Click to expand... This might be a good thing for B4X, as many AI models may be learning from it. Recently, I tried developing a B4J project using AI. I didn't write a single line of code; everything from library wrapping to the demo project generation and interface design was done by AI, and it did an excellent job, far exceeding my expectations. I think the key to success depends on how we feed it data.
Erel B4X founder Staff member Licensed User Longtime User Jun 28, 2026 #15 I agree. And the server load is kept low thanks to Cloudflare caching the "guest" (non-personalized) content.
I agree. And the server load is kept low thanks to Cloudflare caching the "guest" (non-personalized) content.
LucaMs Expert Licensed User Longtime User Jul 9, 2026 #16 aeric said: 72k! View attachment 172061 Click to expand... Now: Even bots go on vacation
teddybear Well-Known Member Licensed User Jul 9, 2026 #17 LucaMs said: Now: View attachment 172325 Even bots go on vacation Click to expand... They are watching the FIFA World Cup in the U.S., Canada, and Mexico.
LucaMs said: Now: View attachment 172325 Even bots go on vacation Click to expand... They are watching the FIFA World Cup in the U.S., Canada, and Mexico.
teddybear Well-Known Member Licensed User Sep 20, 2026 #19 LucaMs said: View attachment 173549 Click to expand... Just me here.
Magma Expert Licensed User Longtime User Sep 20, 2026 #20 May be a cloudflare turnstile or a technique-recaptcha-robot check help a little... before browsing forum url ?
May be a cloudflare turnstile or a technique-recaptcha-robot check help a little... before browsing forum url ?
