Post Reply 
ProxHTTPSProxy, a Proxomitron SSL Helper Program
May. 23, 2010, 09:59 PM
Post: #46
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
(May. 23, 2010 07:14 PM)JJoe Wrote:  
(May. 19, 2010 08:07 PM)ProxRocks Wrote:  admittedly, i haven't tried YET...
it's on my weekend-to-do-list...

And?

delayed temporarily Sad
it's still on the to-do-list...

never enough time, lol...
Add Thank You Quote this message in a reply
May. 23, 2010, 10:39 PM
Post: #47
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
(May. 23, 2010 07:47 PM)JJoe Wrote:  
(May. 23, 2010 09:10 AM)whenever Wrote:  Here is the version 0.2 that supports parent proxy.

It appears to...
I'm restarting all and running some test.
Back in a while... Suspicious

First off my Win7 appeared to have some weird proxy failover that was independent of settings. It was almost like, 'if there was a way...'

Version 0.2 works err worked for me.
Parent proxy feature also worked.
For POST to work, both http and https had to go through Proxo.

My Exceptions-U entry when using Tor

Code:
([^/]++:443& $SET(0=i_proxy:3.) $SETPROXY(127.0.0.1:8081))|$SET(0=i_proxy:3.) $SETPROXY(127.0.0.1:8118)

My Exceptions-U entry when not using Tor

Code:
[^/]++:443& $SET(0=i_proxy:3.) $SETPROXY(127.0.0.1:8081)

Remember to add the proxies to Proxomitron,

http://proxomitron.info/45/help/Matching...l#USEPROXY Wrote:$SETPROXY(remote.proxy.name[:port])
Restrictions: Match or replace
Filter Types: OUT header filters only

The $SETPROXY command will force a connection to use a particular proxy. It overrides both the "Use remote proxy" checkbox and the current proxy chosen in the proxy selector. It's useful for insuring a particular proxy is used in a given situation or with a particular URL.

The proxy to set must be one already entered into the External Proxy Selector list. This command simply looks up and sets a proxy from that list. It's usually only necessary type the first part of the proxy name - the first proxy matched in the list will be use. The partial match must be exact though (no wildcards).

http://proxomitron.info/45/help/External...ialog.html

Have fun

@whenever,

Thanks for the new toys, I think...
Add Thank You Quote this message in a reply
May. 24, 2010, 01:20 AM
Post: #48
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
(May. 23, 2010 10:39 PM)JJoe Wrote:  For POST to work, both http and https had to go through Proxo.

That's strange.

POST worked on my machine if the proxy of the browser is directly set to ProxHTTPSProxy without Proxo chained in the middle.

(May. 23, 2010 10:39 PM)JJoe Wrote:  My Exceptions-U entry when using Tor

Code:
([^/]++:443& $SET(0=i_proxy:3.) $SETPROXY(127.0.0.1:8081))|$SET(0=i_proxy:3.) $SETPROXY(127.0.0.1:8118)

My Exceptions-U entry when not using Tor

Code:
[^/]++:443& $SET(0=i_proxy:3.) $SETPROXY(127.0.0.1:8081)

I don't understand this too. I only need to modify ProxHTTPSProxy.py to make it work with a parent proxy.

(May. 23, 2010 10:39 PM)JJoe Wrote:  @whenever,

Thanks for the new toys, I think...

My pleasure.

It also free myself to get this done. I had been wishing and keeping searching for a solution for Proxo's SSL issue for years and now I don't need to bother with it any more. Wink
Add Thank You Quote this message in a reply
May. 24, 2010, 03:32 AM
Post: #49
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
(May. 24, 2010 01:20 AM)whenever Wrote:  
(May. 23, 2010 10:39 PM)JJoe Wrote:  For POST to work, both http and https had to go through Proxo.

That's strange.

POST worked on my machine if the proxy of the browser is directly set to ProxHTTPSProxy without Proxo chained in the middle.

A misunderstanding.
I meant:

Browser's HTTPS -> ProxHTTPSProxy
Browser's HTTP -> Proxo
POST fail

Browser's HTTPS -> Proxo
Browser's HTTP -> Proxo
POST success

I wanted to use the former.


(May. 24, 2010 01:20 AM)whenever Wrote:  I only need to modify ProxHTTPSProxy.py to make it work with a parent proxy.

Sure but...

My TOR uses the proxy Polipo.
([^/]++:443& $SET(0=i_proxy:3.) $SETPROXY(127.0.0.1:8081)) and modifying ProxHTTPSProxy.py to use Polipo, sends HTTPS to TOR.
|$SET(0=i_proxy:3.) $SETPROXY(127.0.0.1:8118), sends HTTP to TOR.

Unless... Can I remove Polipo?
I was in a hurry and didn't try it but will.

I haven't compared the files yet.
I'd like to know why this one works.

(May. 24, 2010 01:20 AM)whenever Wrote:  I had been wishing and keeping searching for a solution for Proxo's SSL issue for years and now I don't need to bother with it any more. Wink

I've been fortunate. I rarely have problems and am not worried by the old dlls. I too have spent too much time on this (and other issues), however.
When last looked at, Python didn't seem like a solution and while you and I may be able to make it work... A filtering proxy needs users' input (some more than others tho).

Now I may have reason and machine to play with Python.

Do you have any opinions of http://www.py2exe.org/ ?
Add Thank You Quote this message in a reply
May. 24, 2010, 07:23 AM
Post: #50
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
(May. 24, 2010 03:32 AM)JJoe Wrote:  I meant:

Browser's HTTPS -> ProxHTTPSProxy
Browser's HTTP -> Proxo
POST fail

What does your POST mean? If you mean the http METHOD, it worked on my side when setting the http/https proxy as above.

This is my log when do searching on https://ssl.scroogle.org.

ProxHTTPSProxy:
Code:
localhost - - [24/May/2010 14:43:42] "CONNECT ssl.scroogle.org:443 HTTP/1.0" 200 -
localhost - - [24/May/2010 14:43:47] "POST http://ssl.scroogle.org:443/cgi-bin/n
bbwssl.cgi HTTP/1.1" 200 -

Proxomitron:
Code:
+++GET 5393+++
Using Proxy - 127.0.0.1:8081
POST http://ssl.scroogle.org:443/cgi-bin/nbbwssl.cgi HTTP/1.1
Accept: image/gif, image/jpeg, image/pjpeg, image/pjpeg, application/msword, application/vnd.ms-excel, application/xaml+xml, application/vnd.ms-xpsdocument, application/x-ms-xbap, application/x-ms-application, application/x-shockwave-flash, */*
Content-Type: application/x-www-form-urlencoded
Accept-Encoding: gzip, deflate
User-Agent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)
Host: ssl.scroogle.org
Content-Length: 18
Connection: keep-alive
Posting 18 bytes...
RESP 5393 : Time: 14:43:47::812

+++RESP 5393+++
HTTP/1.1 200 OK
Server: ProxHTTPSProxy/0.2 Python/2.6.5
....

(May. 24, 2010 03:32 AM)JJoe Wrote:  Can I remove Polipo?

No. Currently ProxHTTPSProxy desn't know how to speak with socks proxy.

(May. 24, 2010 03:32 AM)JJoe Wrote:  I haven't compared the files yet.
I'd like to know why this one works.

I don't know. If you compared the files you will see I added/modified only 3-4 lines to add parent proxy support.

(May. 24, 2010 03:32 AM)JJoe Wrote:  Do you have any opinions of http://www.py2exe.org/ ?

I may consider to build an exe version for windows when I got enough reports that ProxHTTPSProxy worked on their machines, but I prefer people to install python so they can play with python and ProxHTTPSProxy themselves. Currently ProxHTTPSProxy is only around 100 lines and the code should be easy to read and understand.

(May. 24, 2010 03:32 AM)JJoe Wrote:  Now I may have reason and machine to play with Python.

Have fun with python. Wink
Add Thank You Quote this message in a reply
May. 24, 2010, 12:54 PM
Post: #51
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
(May. 24, 2010 03:32 AM)JJoe Wrote:  Do you have any opinions of http://www.py2exe.org/ ?

man, that to-do-list keeps growing, lol...

i know nothing about Python but will be installing later this morning or early this afternoon to "finally" test out the "SSL Helper" - sorry for it taking me so long, lol...


(about 40% of this thread is "over my head", but i'm sure i can catch up in due time...)
Add Thank You Quote this message in a reply
May. 24, 2010, 03:05 PM
Post: #52
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
(May. 24, 2010 07:23 AM)whenever Wrote:  If you mean the http METHOD, it worked on my side when setting the http/https proxy as above.

This may be browser/platform related

When I searched at scroogle with
Browser's HTTPS -> Proxo
Browser's HTTP -> Proxo
there was a alert about the change from https to http. I had to click ok.

When I tried search at scroogle with
Browser's HTTPS -> ProxHTTPSProxy
Browser's HTTP -> Proxo
the alert did not appear and the http page did not load.

(May. 24, 2010 07:23 AM)whenever Wrote:  
(May. 24, 2010 03:32 AM)JJoe Wrote:  I haven't compared the files yet.
I'd like to know why this one works.

I don't know. If you compared the files you will see I added/modified only 3-4 lines to add parent proxy support.

Windows 7... Well maybe I just haven't used it enough.

Some parts of Proxo don't always work on this machine. Maybe the ProxHTTPSProxy proxy entry in Proxo didn't take. I don't know if they always work while running as admin.

I don't see how a Python script can be run as admin. Maybe running the Python exe as admin but I tried that and ProxHTTPSProxy still didn't work.

I tried fixing ProxHTTPSProxy. Added some flags, etc. Sometimes a script would fail to run after seemingly insignificant changes. Well maybe I just haven't used it enough. Wink

Maybe the old ProxHTTPSProxy versions work now. I haven't checked.
Add Thank You Quote this message in a reply
May. 24, 2010, 03:29 PM
Post: #53
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
(May. 24, 2010 03:05 PM)JJoe Wrote:  When I tried search at scroogle with
Browser's HTTPS -> ProxHTTPSProxy
Browser's HTTP -> Proxo
the alert did not appear and the http page did not load.

I got the https to http alert.

You didn't get because something is wrong with the 307 redirect.

(May. 24, 2010 03:05 PM)JJoe Wrote:  I tried fixing ProxHTTPSProxy. Added some flags, etc. Sometimes a script would fail to run after seemingly insignificant changes. Well maybe I just haven't used it enough. Wink

Keep in mind that indentation is important in python.
Add Thank You Quote this message in a reply
May. 24, 2010, 04:38 PM
Post: #54
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
(May. 24, 2010 03:29 PM)whenever Wrote:  
(May. 24, 2010 03:05 PM)JJoe Wrote:  When I tried search at scroogle with
Browser's HTTPS -> ProxHTTPSProxy
Browser's HTTP -> Proxo
the alert did not appear and the http page did not load.

I got the https to http alert.

You didn't get because something is wrong with the 307 redirect.

I assumed some security feature somewhere prevented the switch.
Changing the HTTPS proxy to Proxo 'fixed' it.
Pretty sure I saw the behaviour with and without tor in more than one browser. The connection was shown as closed.

Works now in all browsers tested, however. Will see what happens.
I'll try to use more https.

(May. 24, 2010 03:29 PM)whenever Wrote:  
(May. 24, 2010 03:05 PM)JJoe Wrote:  I tried fixing ProxHTTPSProxy. Added some flags, etc. Sometimes a script would fail to run after seemingly insignificant changes. Well maybe I just haven't used it enough. Wink

Keep in mind that indentation is important in python.

Figured that out quickly.
Just found PythonWin. It shows just a line feed for eol.
PSPad shows a paragraph mark. I'm not sure what that means. Surely the correct eol is used.
I think I'll use PythonWin next time.

Too much fun. Wink
Add Thank You Quote this message in a reply
May. 24, 2010, 10:07 PM (This post was last modified: May. 25, 2010 12:33 AM by JJoe.)
Post: #55
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
(May. 24, 2010 03:05 PM)JJoe Wrote:  When I tried search at scroogle with
Browser's HTTPS -> ProxHTTPSProxy
Browser's HTTP -> Proxo
the alert did not appear and the http page did not load.

This one was my mistake, I hope. The 307 worked fine.
I think I forgot to forward the http://*:443/ to scroogle through ProxHTTPSProxy.
I just did something similar at another site while testing.
Scroogle usually answered tho...

I've been watching headers. Eventually, we may want some of those altered. I think our tricks may be too easily discovered.

Maybe a webfilter for the referer.

I expect to be back by Wednesday or Thursday, if absent.

Have fun
Add Thank You Quote this message in a reply
May. 24, 2010, 10:08 PM
Post: #56
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
yay, installed and running...
it "appears" to be running correctly...

anything "specific" you'd like me to "test"?
Add Thank You Quote this message in a reply
May. 24, 2010, 10:34 PM
Post: #57
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
(May. 24, 2010 10:08 PM)ProxRocks Wrote:  yay, installed and running...
it "appears" to be running correctly...

anything "specific" you'd like me to "test"?

Things that didn't work before.
Post info on things that it breaks, issues to be fixed or considered.
Try to help make it better and easier for people to use.
Be curious...

What are your browser's settings and list entry?
Add Thank You Quote this message in a reply
May. 24, 2010, 10:39 PM
Post: #58
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
i've got some "trial and error"-ing to do...

i don't think i have it set up properly - i want to test "unimportant" SSL sites before i try actually going to one of my "important" SSL sites...
Add Thank You Quote this message in a reply
May. 25, 2010, 02:49 AM
Post: #59
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
(May. 24, 2010 04:38 PM)JJoe Wrote:  I think I'll use PythonWin next time.

The IDLE comes with the python installation should be a good editor to start.

(May. 24, 2010 10:07 PM)JJoe Wrote:  I've been watching headers. Eventually, we may want some of those altered. I think our tricks may be too easily discovered.

Maybe a webfilter for the referer.

I found the referer header was not resent after 307 redirect, which might cause problems on some sites.

The 0.2a removes 'proxy-connection', 'keep-alive' and 'host' headers from the outgoing request now (I haven't checked but the correct 'host' header is supposed be added later by urllib2 when finally make the request). Please let me know if there are more need to remove.


Attached File(s)
.zip  ProxHTTPSProxy 0.2a.zip (Size: 1.56 KB / Downloads: 756)
Add Thank You Quote this message in a reply
May. 25, 2010, 05:32 AM
Post: #60
RE: ProxHTTPSProxy, a Proxomitron SSL Helper Program
(May. 25, 2010 02:49 AM)whenever Wrote:  Please let me know if there are more need to remove.

Haven't you had enough of me yet? Wink

Scroogle search with KMeleon set to
Browser's HTTPS -> ProxHTTPSProxy
Browser's HTTP -> Proxo
other browsers work with same settings.


.png  Scroogle1.png (Size: 34.56 KB / Downloads: 759)
.png  Scroogle2.png (Size: 60.64 KB / Downloads: 722)
.png  ProxHTTPSProxy.png (Size: 18.45 KB / Downloads: 805)
.png  KMeleon.png (Size: 18.48 KB / Downloads: 738)

The referer header that I think may indicate a need for a filter is shown in Proxo's log

Code:
GET /scget.html HTTP/1.1
Accept: application/x-ms-application, image/jpeg, application/xaml+xml, image/gif, image/pjpeg, application/x-ms-xbap, application/vnd.ms-excel, application/vnd.ms-powerpoint, application/msword, application/x-shockwave-flash, */*
Referer: http://ssl.scroogle.org:443/sslnote.html
Accept-Language: en-US
User-Agent: Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0)
Accept-Encoding: gzip,deflate
Host: www.scroogle.org
Connection: keep-alive

Proxo can hide us from /scget.html but what about http://ssl.scroogle.org:443/sslnote.html?
Couldn't a simple script detect us? document.location.href?

Enough for tonight.
Add Thank You Quote this message in a reply
Post Reply 


Forum Jump: