From: Ryan Davis <ryand-ruby@...>
Date: 2011-11-24T07:21:09+09:00
Subject: Re: url normalization


On Nov 23, 2011, at 11:14 , rubix Rubix wrote:

> Hi,
> 
> I have a set of urls that I want to normalize but I can't find a regex
> to do that, this is an url sample:
> http://www.example.com/index.php?/topic/something/page__st__20__s__99590dc581fe8e7386051d6dfgdfg4eca4c/
> when I use a web browser I find that this url is equivalent of the
> following:
> http://www.example.com/index.php?/topic/something/page__st__20
> It is clear that the last part is a checksum but how can I detect that
> automatically

I think if you pay close attention you'll see that your browser goes to the first url and then gets redirected by the server to the second url. The proper thing to do would be to actually do the redirection, not munge the url directly.