This Time Self-Hosted
dark mode light mode Search

The complexity of request validation

You might have read before that I use a complicated setup with ModSecurity to prevent spam on this blog — I have written about it before extensively, and I also published my rules so that they can be used by other sites (Videolan’s forums are using them as well).

Well, maintaining this ruleset is not that easy, if at all; the problem comes when new browsers are introduced into the mix that makes validating their validity difficult. This is what happened a few months ago when Google first published Chrome for their ICS — which I still don’t have access to, I think I’ll get an HTC One X as soon as I get to California. Well, they did it again with the new Chrome for iOS.

There are three different identifications Chrome can come in as: Chrome, CrMo (for Android) and Crios (for the iOS devices). This simply meant that any special case put in place for Chrome on Android didn’t get auto-extended to the new Chrome on iOS — which is probably intended given that Chrome on iOS has to use the standard WebKit engine of Safari, rather than come up with its own — the only reason to use it is to have synchronised bookmarks with your computer.

Now, though, is when the problems start cropping up: the new Chrome on iOS also has the same problem as the one on ICS: it doesn’t send an Accept header, which is customary for almost every other browser, including the main desktop Chrome builds. So it was a matter of adding Crios to the list of special cases, together with CrMo.

But there is one more issue: there is one feature in the Chrome for iOS interface that allows you to go back to the so-called “desktop interface” — as long as the browser decided to have different interfaces depending on the User-Agent value. What you would expect at that point is for the application to report Chrome as user agent, but it’s not the case. What it reports is instead Safari. The problem is that it still implements some particularity that is generally limited to Chrome, including SDCH, which is something I used to validate before.

So what I ended up doing was removing the support for validation of browsers supporting sdch as an encoding — although I kept the validation that if it reports it’s Chrome, it has to have sdch (unless of course it’s passing through a Proxy). This still makes it possible to workaround most of the non-sophisticated crawlers/tools that try to pass as a browser.

Comments 1
  1. I have the HTC Incredible 2. Runs 2.3.7 iirc Quite satisfied with it since doing 4GLTE is limited by area at best and a good wifi connection beats the cell phone uplinks by miles. And no contract was required. That allowed me to go with Page Plus as a provider and the fee is $55 per month with the same service Verizon offers for 80 a month upfront or 99 a month billed after the fact or on contract. HTC makes good stuffThe occasional screen lock while an app tries to sync or send data is very frustrating. Usually right when I need to make a call and often I just reboot the thing. Appalling since it is ostensibly a linuxI certainly miss the little ‘minimize, maximize, close’ buttons that I am accustomed to on a desktop.

Leave a Reply to user99Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.