Post Reply 
ProxHTTPSProxyMII: Reloaded
Nov. 21, 2014, 09:41 PM
Post: #31
RE: ProxHTTPSProxyMII
There's a number of pages like that. Presumably then, badly set up servers. :-/ I must have collected a collection of them in my bookmarks. :-)

I tried *.* in the [SSL No-Verify] section of config.ini, but browserspy still gives the same error. :-(

Oh, I've got all the filters turned off in these tests, via Bypass Filters option.

Some sites it works like a dream - noth others. :-/
Add Thank You Quote this message in a reply
Nov. 21, 2014, 09:44 PM
Post: #32
RE: ProxHTTPSProxyMII
BTW, 'Use Proxy' is checked and the proxy is set on port 8081. Turn off 'Use Proxy' and the recalcitrant pages work. :-/ Well, browserspy and TUOPF do at least.
Add Thank You Quote this message in a reply
Nov. 22, 2014, 12:02 AM (This post was last modified: Nov. 22, 2014 12:03 AM by JJoe.)
Post: #33
RE: ProxHTTPSProxyMII
(Nov. 21, 2014 09:17 PM)laighleas Wrote:  I put in the "Bypass URLs that match this expression and can see from the log window that it is working:

$OHDR(Tagged:Proxomitron FrontProxy/*)$SETPROXY(127.0.0.1:8081)(^)

(Nov. 21, 2014 09:17 PM)laighleas Wrote:  I also put in the line for things that do *not* match: $OHDR(Tagged:Proxomitron FrontProxy/*)$SETPROXY(127.0.0.1:8081)(^)|

"I also"?... It is either or.

The default "Bypass URLs that match this expression" is

Code:
$LST(Bypass)

Assuming that this is also yours, your new expression should be

Code:
$OHDR(Tagged:Proxomitron FrontProxy/*)$SETPROXY(127.0.0.1:8081)(^)|$LST(Bypass)

(Nov. 21, 2014 09:17 PM)laighleas Wrote:  Oh, and "Use remote proxy" is set, and the proxy is set to port 8081.

(Nov. 21, 2014 09:44 PM)laighleas Wrote:  BTW, 'Use Proxy' is checked and the proxy is set on port 8081. Turn off 'Use Proxy' and the recalcitrant pages work.

"Use remote proxy" should be unchecked.

I'm attaching a modified version of the Proxomitron's default cfg.
Maybe it can help.


Attached File(s)
.cfg  default-ProxHTTPSProxyMII.cfg (Size: 17.59 KB / Downloads: 894)
Add Thank You Quote this message in a reply
Nov. 22, 2014, 01:06 AM
Post: #34
RE: ProxHTTPSProxyMII
Ah! Brilliant! :-) I shall check it tomorrow and see how it works. Right now it is 1 am.
Add Thank You Quote this message in a reply
Nov. 22, 2014, 12:04 PM
Post: #35
RE: ProxHTTPSProxyMII
OK, got it all set up. I hadn't realised that it had to be in the [Global] settings. :-( I'd put it as a header filter. As for Bypass lists, I've got a number for fine tuning, so it will have to have its own separate Bypass list. Generally, if I want to bypass all the filters for a particular site, I just turn them off at the GUI unless I'm regularly visiting said site.

Will double check things asap.
Add Thank You Quote this message in a reply
Nov. 22, 2014, 12:43 PM
Post: #36
RE: ProxHTTPSProxyMII
OK, all seems fine. Thanks for all the help. :-) A couple of sites are reporting SSL3 in use (as in the Poodle attack). I'm not overly worried about that because SSL3 is turned off at the browser, which now supports TLS 1.0 as the lowest level of encryption.

Right, now I'll have to take it out for a test drive, seriously throw it about, and generally hammer it. :-)
Add Thank You Quote this message in a reply
Dec. 02, 2014, 11:36 AM (This post was last modified: Dec. 02, 2014 11:37 AM by laighleas.)
Post: #37
RE: ProxHTTPSProxyMII
Got most of the bumps sorted out, thanks to JJoe. :-) I tried the Python version as well. It seems better behaved than the exe, and throws fewer error messages. All the ones I've seen so far indicate a problem with the site, rather than the program.

One persistent problem though. I'm using Privoxy to connect to Tor. The connection between ProxHTTPSProxy and Privoxy on 8118 often silently fails, with no warning anywhere, apart from the lack of animation on the Privoxy icon, or data obviously not going through on Tor's bandwidth graph. :-/ I'm not sure how one overcomes this. :-/ Nor, come to that, what's causing it. :-/ Any ideas?
Add Thank You Quote this message in a reply
Dec. 02, 2014, 11:42 AM
Post: #38
RE: ProxHTTPSProxyMII
This is a fairly typical error message. The Telegraph threw a number of these for different jpgs:

[11:06:08] [F] HTTPConnectionPool(host='localhost', port=8080): Max retries exceeded with url: http://secure.i.telegraph.co.uk/multimed...11287f.jpg (Caused by ProtocolError('Connection aborted.', BadStatusLine("''",))) on "GET https://secure.i.telegraph.co.uk/multime...11287f.jpg"

I *think* the problem is at the site, rather than at my end.
Add Thank You Quote this message in a reply
Dec. 02, 2014, 04:25 PM (This post was last modified: Dec. 02, 2014 06:04 PM by JJoe.)
Post: #39
RE: ProxHTTPSProxyMII
After https://secure.i.telegraph.co.uk/multime...11287f.jpg is requested, my Proxomitron's log window looks something like

Code:
+++GET 33879+++
Using Proxy - 127.0.0.1:8081
GET http://secure.i.telegraph.co.uk/multimedia/archive/03111/investment_propert_3111287f.jpg HTTP/1.1
Host: secure.i.telegraph.co.uk
Accept-Encoding: gzip, deflate
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.122 Safari/537.36
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8
Accept-Language: en-US,en;q=0.8
Tagged: Proxomitron FrontProxy/1.1 Python/3.4.2
Connection: keep-alive

+++RESP 33879+++
HTTP/1.1 301 Moved Permanently
Server: AkamaiGHost
Location:  http://i.telegraph.co.uk/multimedia/archive/03111/investment_propert_3111287f.jpg
Date: Tue, 02 Dec 2014 14:46:46 GMT
Content-Length: 0
Connection: close
+++CLOSE 33879+++

+++GET 33880+++
Using Proxy - 127.0.0.1:8118
GET http://i.telegraph.co.uk/multimedia/archive/03111/investment_propert_3111287f.jpg HTTP/1.1
Host: i.telegraph.co.uk
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.122 Safari/537.36
Accept-Encoding: gzip, deflate
Accept-Language: en-US,en;q=0.8
Connection: keep-alive

+++RESP 33880+++
HTTP/1.1 200 OK
Content-Length: 28225
ETag: "2dc45d2-6e41-5083591aca449"
Date: Tue, 02 Dec 2014 20:46:46 GMT
Last-Modified: Wed, 19 Nov 2014 18:44:13 GMT
Accept-Ranges: bytes
Content-Type: image/jpeg
Server: Apache
Connection: keep-alive
+++CLOSE 33880+++

The telegraph server is redirecting my https request to http.
Request is successful.

What do you see when your request fails?
Does it always fail?
Add Thank You Quote this message in a reply
Dec. 02, 2014, 09:12 PM (This post was last modified: Dec. 26, 2014 10:11 PM by JJoe.)
Post: #40
RE: ProxHTTPSProxyMII
It's fairly consistent. The following is what I get when loading the front page of the The Telegraph. The ProxHTTPSProxy log is complete. The Proxomitron one isn't - Proxomitron objected to me loading too much text from the log to the clipboard. :-(

I had only one page up, and clean log files, then hit reload. There's no blacklist running in ProxHTTPSProxy. The Proxomitron filters were all bypassed, and Noscript was disabled. I hadn't disabled HTTPS Everywhere. I shall try that on the next experiment.


Edit by JJoe: Logs attached


Attached File(s)
.txt  MIIlog.txt (Size: 10.96 KB / Downloads: 1030)
.txt  PROXlog.txt (Size: 34.1 KB / Downloads: 725)
Add Thank You Quote this message in a reply
Dec. 03, 2014, 03:19 AM (This post was last modified: Dec. 03, 2014 03:26 AM by JJoe.)
Post: #41
RE: ProxHTTPSProxyMII
(Dec. 02, 2014 09:12 PM)laighleas Wrote:  It's fairly consistent. The following is what I get when loading the front page of the The Telegraph. The ProxHTTPSProxy log is complete. The Proxomitron one isn't - Proxomitron objected to me loading too much text from the log to the clipboard. :-(

I had only one page up, and clean log files, then hit reload. There's no blacklist running in ProxHTTPSProxy. The Proxomitron filters were all bypassed, and Noscript was disabled. I hadn't disabled HTTPS Everywhere. I shall try that on the next experiment.

Wait... Lets start with just https://secure.i.telegraph.co.uk/multime...11287f.jpg

I'd like to see if you can reproduce

laighleas Wrote:[11:06:08] [F] HTTPConnectionPool(host='localhost', port=8080): Max retries exceeded with url: http://secure.i.telegraph.co.uk/multimed...11287f.jpg (Caused by ProtocolError('Connection aborted.', BadStatusLine("''",))) on "GET https://secure.i.telegraph.co.uk/multime...11287f.jpg"

laighleas log Wrote:('Connection aborted.', ConnectionRefusedError(10061, 'No connection could be made because the target machine actively refused it', None, 10061,None))

These could be servers saying 'No soup for you' but the associated urls are sometimes blocked by adblockers.
So the posted logs do not necessarily show any problems.
Add Thank You Quote this message in a reply
Dec. 03, 2014, 09:07 AM
Post: #42
RE: ProxHTTPSProxyMII
http://secure.i.telegraph.co.uk/multimed...11287f.jpg worked on my end too.

laighleas, I noticed you were using ver 1.0. Would you please use the latest ver 1.1? It might not help on this issue but at least it makes us on the same page.
Add Thank You Quote this message in a reply
Dec. 12, 2014, 11:39 AM
Post: #43
RE: ProxHTTPSProxyMII
JJoe, sorry I haven't been back. Got capacitor problems with main PC :-( and I have also had to reinstall everything on laptop. Just tidying up after the reinstall. Will check again soon as I can. I will eventually have both back up and running again. :-) <picks up soldering iron and glares at motherboard!> :-)

Whenever, I'll check for version 1.1 :-) Didn't realise that I hadn't got the latest one.
Add Thank You Quote this message in a reply
Dec. 18, 2014, 08:46 AM
Post: #44
RE: ProxHTTPSProxyMII
(Dec. 03, 2014 09:07 AM)whenever Wrote:  Would you please use the latest ver 1.1? It might not help on this issue but at least it makes us on the same page.

Do you have it in Python? I can only see it in exe form. :-(
Add Thank You Quote this message in a reply
Dec. 18, 2014, 03:56 PM
Post: #45
RE: ProxHTTPSProxyMII
"ProxHTTPSProxyMII_py 1.1b.zip" from
http://prxbx.com/forums/showthread.php?t...7#pid17737
appears to be the latest python version.
Add Thank You Quote this message in a reply
Post Reply 


Forum Jump: