response = urllib2.urlopen(request)
So, I'm looking for some ideas to solve this problem.
I've successfully done this in Java (I've used the Cobra toolkit http://lobobrowser.org/cobra.jsp)
Since you want to hack in python (always a good choice) I recommend these two options:
To give an example, I created a sample page with following HTML code. (link):
Scraping without JS support:
Scraping with JS support: