From: "Abinoam Jr." <abinoam@...>
Date: 2012-09-05T10:39:59+09:00
Subject: Re: nokogiri/ruby and troublesome characters in url

Dear Sybren,

I've indented and fixed some quotes on your code.

https://gist.github.com/0d83e2487a0e955411d6

It runs, but there's no "paginering beneden" on the html retrieved by it.
So, the code fails at "pagination_links =
initial_page.css('.paginering.beneden a')"

Look:

initial_page.css('.paginering')  => []
initial_page.css('.beneden')  => []

But, as an example...
initial_page.css('.tekst-kleiner')
initial_page.css('a.tekst-kleiner')
initial_page.css('header').css('a.tekst-kleiner')

all returns...
 => [#<Nokogiri::XML::Element:0x109e3d0 name="a"
attributes=[#<Nokogiri::XML::Attr:0x109e358 name="href"
value="https://zoek.officielebekendmakingen.nl/zoeken/resultaat/?zkt=Uitgebreid&pst=ParlementaireDocumenten&grootte=2">,
#<Nokogiri::XML::Attr:0x109e344 name="class" value="tekst-kleiner">,
#<Nokogiri::XML::Attr:0x109e308 name="title" value="Schermteksten
verkleinen">] children=[#<Nokogiri::XML::Text:0x10a2854 "—">]>]

Look the html source of your url and you will see it.

Best regards,
Abinoam Jr.

On Wed, Aug 29, 2012 at 7:16 AM, Sybren Kooistra <lists@ruby-forum.com> wrote:
> Thanks for the reply Abinoam.
>
> With pagination_links = initial_page.css('.paginering.beneden a') I'm
> trying to recover <div class="paginering beneden"> and then <a
> href="...">, which refer to all the page-links. So apparently something
> is going wrong here aswell?..
>
> The bigger problem I'm dealing with is that ruby believes that letters
> following the question mark (in INITIAL_URL =
> "https://zoek.officielebekendmakingen.nl/zoeken/resultaat.?zkt=Uitgebreid&pst=ParlementaireDocumenten")
> should be interpreted as commands in stead of part of the entire string.
> So I get an error when simply trying to define INITIAL_URL with a
> url-string, because some of the characters in the url are interpreted as
> commands.
>
> --
> Posted via http://www.ruby-forum.com/.
>