Post Reply 
ProxHTTPSProxyMII: Reloaded
May. 07, 2019, 07:11 PM (This post was last modified: May. 07, 2019 07:12 PM by vlad_s.)
Post: #331
RE: ProxHTTPSProxyMII: Reloaded
(May. 07, 2019 04:27 PM)JJoe Wrote:  Something (firewall, anti-virus, Privoxy, etc.) is blocking POST requests.

No, this does not always happen. For example, with startpage.com, I just once again perform in the browser "refresh" and everything is fine.
Add Thank You Quote this message in a reply
May. 08, 2019, 03:11 AM
Post: #332
RE: ProxHTTPSProxyMII: Reloaded
(May. 07, 2019 07:11 PM)vlad_s Wrote:  For example, with startpage.com, I just once again perform in the browser "refresh" and everything is fine.

I have made this happen.

(May. 06, 2019 04:08 PM)vlad_s Wrote:  [18:19] 661 [F] ('Connection aborted.', ResponseNotReady('Request-sent',)) on "POST http://startpage.com/do/metasearch.pl"

http://startpage.com/do/metasearch.pl does not exist.
By now, your browser should automatically change this request to https.

Are you removing or modifying HTTP Strict-Transport-Security response headers or values, https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Strict-Transport-Security?

Does http://startpage.com/ return a redirect to https or go directly to https://startpage.com/?
Add Thank You Quote this message in a reply
May. 08, 2019, 06:43 AM (This post was last modified: May. 08, 2019 06:45 AM by pepak.)
Post: #333
RE: ProxHTTPSProxyMII: Reloaded
(May. 07, 2019 04:27 PM)JJoe Wrote:  Are you having this problem?

Yes. Usually if I am too fast with the next POST. With some sites it occurs more often that othes, e.g. logging in to https://forum.delphi.cz/ frequently leads to the error. Unfortunately, I wasn't able to figure out the cause, all the leads I had turned out to be false :-(

If someone wants to give it a try, I am attaching the file that I was trying to use. Just import it into the main script.


Attached File(s)
.zip  LibraryHacks.zip (Size: 938 bytes / Downloads: 3)
Add Thank You Quote this message in a reply
May. 08, 2019, 02:54 PM
Post: #334
RE: ProxHTTPSProxyMII: Reloaded
JJoe
startpage.com works fine. The error occurs once when viewing several (more than 10) pages in this search engine. Sometimes, when trying to find selected text through the right mouse button, a page with an error opens, instead of startpage.com. If you just press F5 in the browser, then the problem is usually solved. Most often, a problem arises when POST requests, for example, on the response page in a forum, when it is sent, this error may also occur, but not at another time. I generally do not exactly believe that the error is due to ProxHTTPSProxy. Here, too, there is a button "Post Reply", but here I have not yet seen the error. I think we have different reasons for the error with pepak.
Add Thank You Quote this message in a reply
May. 08, 2019, 04:04 PM (This post was last modified: May. 08, 2019 04:09 PM by vlad_s.)
Post: #335
RE: ProxHTTPSProxyMII: Reloaded
Here is a typical error:
ProxHTTPSProxyMII:
Code:
[18:54] 835 ProxHTTPSProxyMII RearProxy/v1.5 [Errno 32] Broken pipe
[18:54] 837 ProxHTTPSProxyMII RearProxy/v1.5 [Errno 32] Broken pipe
[18:54] 839 ProxHTTPSProxyMII RearProxy/v1.5 [Errno 32] Broken pipe
[18:55] 841 [F] ('Connection aborted.', ResponseNotReady('Request-sent',)) on "POST http://nnmclub.to/forum/posting.php"
[18:55] 841 ProxHTTPSProxyMII RearProxy/v1.5 [Errno 32] Broken pipe
[18:57] 846 ProxHTTPSProxyMII RearProxy/v1.5 [Errno 32] Broken pipe
[18:57] 847 ProxHTTPSProxyMII RearProxy/v1.5 [Errno 32] Broken pipe
[18:57] 848 [F] ('Connection aborted.', ResponseNotReady('Request-sent',)) on "POST http://nnmclub.to/forum/posting.php"
[18:57] 848 ProxHTTPSProxyMII RearProxy/v1.5 [Errno 32] Broken pipe
----------------------------------------
Exception happened during processing of request from ('127.0.0.1', 53830)
Traceback (most recent call last):
  File "/usr/lib/python3.6/socketserver.py", line 651, in process_request_thread
    self.finish_request(request, client_address)
  File "/usr/lib/python3.6/socketserver.py", line 361, in finish_request
    self.RequestHandlerClass(request, client_address, self)
  File "/usr/lib/python3.6/socketserver.py", line 721, in __init__
    self.handle()
  File "/usr/lib/python3.6/http/server.py", line 418, in handle
    self.handle_one_request()
  File "/opt/ProxHTTPSProxyMII/ProxyTool.py", line 115, in handle_one_request
    BaseHTTPRequestHandler.handle_one_request(self)
  File "/usr/lib/python3.6/http/server.py", line 406, in handle_one_request
    method()
  File "/opt/ProxHTTPSProxyMII/ProxHTTPSProxy.py", line 171, in do_CONNECT
    ssl_sock = ssl.wrap_socket(self.connection, keyfile=dummycert, certfile=dummycert, server_side=True)
  File "/usr/lib/python3.6/ssl.py", line 1158, in wrap_socket
    ciphers=ciphers)
  File "/usr/lib/python3.6/ssl.py", line 817, in __init__
    self.do_handshake()
  File "/usr/lib/python3.6/ssl.py", line 1077, in do_handshake
    self._sslobj.do_handshake()
  File "/usr/lib/python3.6/ssl.py", line 689, in do_handshake
    self._sslobj.do_handshake()
OSError: [Errno 0] Error
----------------------------------------

Privoxy (debug 1024)
Code:
2019-05-08 18:50:12.506 7fd0d2195700 Crunch: Blocked: http://counter.yadro.ru/hit?t52.10;rhttps%3A//nnmclub.to/forum/viewtopic.php%3Ft%3D1300644%26start%3D
2019-05-08 18:50:56.056 7fd0b2ffd700 Crunch: Forwarding failed: http://tracker.tfile.co/scrape.php?uk=LIryP9C276&&info_hash=
2019-05-08 18:53:25.894 7fd0d45bb700 Crunch: No server data received: http://open.touki.ru/scrape.php?info_hash=
2019-05-08 18:55:39.161 7fd0d2996700 Crunch: No server data received: http://open.touki.ru/announce.php?info_hash=
2019-05-08 18:55:59.442 7fd0b2ffd700 Crunch: No server data received: http://open.touki.ru/announce.php?info_hash=
2019-05-08 18:56:25.766 7fd0b37fe700 Crunch: Connection failure: http://tracker.openbittorrent.com/scrape?info_hash=
2019-05-08 18:57:31.742 7fd0d2996700 Crunch: Forwarding failed: http://tracker.openbittorrent.com/announce?info_hash=
2019-05-08 18:57:35.526 7fd0d35b9700 Crunch: Blocked: http://yastatic.net/pcode/adfox/loader.js
2019-05-08 18:57:35.545 7fd0d35b9700 Crunch: Blocked: http://www.google-analytics.com/ga.js
2019-05-08 18:57:35.549 7fd0d1193700 Crunch: Blocked: http://mc.yandex.ru/metrika/watch.js
2019-05-08 18:57:36.062 7fd0d45bb700 Crunch: Blocked: http://mc.yandex.ru/metrika/watch.js
2019-05-08 18:57:36.141 7fd0d1193700 Crunch: Blocked: http://assets.ipv6.nnm-club.ws/forum/images/spacer.gif
2019-05-08 18:57:36.316 7fd0d2195700 Crunch: Blocked: http://www.google-analytics.com/ga.js
2019-05-08 18:57:36.357 7fd0d35b9700 Crunch: Blocked: http://ssl.google-analytics.com/ga.js
2019-05-08 18:57:36.696 7fd0d3dba700 Crunch: Redirected: http://ajax.googleapis.com/ajax/libs/jquery/1.5.2/jquery.min.js
2019-05-08 18:57:37.543 7fd0b1ffb700 Crunch: Blocked: http://counter.yadro.ru/hit?t52.10;rhttps%3A//nnmclub.to/forum/viewtopic.php%3Ft%3D1300644%26start%3D
2019-05-08 18:57:54.150 7fd0d1994700 Crunch: Blocked: http://yastatic.net/pcode/adfox/loader.js
2019-05-08 18:57:54.194 7fd0d1994700 Crunch: Blocked: http://assets.ipv6.nnm-club.ws/forum/images/spacer.gif
2019-05-08 18:57:54.200 7fd0b3fff700 Crunch: CGI Call: http://config.privoxy.org/send-banner?type=auto
2019-05-08 18:57:54.207 7fd0d1994700 Crunch: Blocked: http://yastatic.net/share2/share.js
2019-05-08 18:57:54.208 7fd0b1ffb700 Crunch: Blocked: http://mc.yandex.ru/metrika/watch.js
2019-05-08 18:57:54.210 7fd0b3fff700 Crunch: Blocked: http://www.google-analytics.com/ga.js
2019-05-08 18:57:54.474 7fd0b3fff700 Crunch: Blocked: http://yastatic.net/pcode/adfox/loader.js
2019-05-08 18:57:54.666 7fd0b1ffb700 Crunch: Blocked: http://mc.yandex.ru/metrika/watch.js
2019-05-08 18:57:54.669 7fd0b3fff700 Crunch: Blocked: http://yastatic.net/share2/share.js
2019-05-08 18:57:54.700 7fd0b1ffb700 Crunch: Blocked: http://www.google-analytics.com/ga.js
2019-05-08 18:57:54.724 7fd0b1ffb700 Crunch: Blocked: http://ssl.google-analytics.com/ga.js
2019-05-08 18:57:55.001 7fd0b1ffb700 Crunch: Blocked: http://assets.ipv6.nnm-club.ws/forum/images/avatars/19868724364bcd5b1715951.gif
2019-05-08 18:57:55.009 7fd0d1994700 Crunch: Blocked: http://assets.ipv6.nnm-club.ws/forum/images/avatars/19133439095c291f0a4b5b7.gif
2019-05-08 18:57:55.012 7fd0d3dba700 Crunch: Blocked: http://assets.ipv6.nnm-club.ws/forum/images/avatars/17991207484fb11db3404af.gif
2019-05-08 18:57:55.042 7fd0d3dba700 Crunch: Blocked: http://counter.yadro.ru/hit?t52.10;rhttps%3A//nnmclub.to/;s2048*1152*24;uhttps%3A//nnmclub.to/forum/v
2019-05-08 18:58:02.389 7fd0b3fff700 Crunch: Blocked: http://yastatic.net/pcode/adfox/loader.js
2019-05-08 18:58:02.410 7fd0b1ffb700 Crunch: Blocked: http://www.google-analytics.com/ga.js
As you can see, the request was not blocked. And there is nothing else there, because it's just a router. An error occurs not often, but steadily.
Add Thank You Quote this message in a reply
May. 08, 2019, 04:11 PM (This post was last modified: May. 08, 2019 04:12 PM by vlad_s.)
Post: #336
RE: ProxHTTPSProxyMII: Reloaded
Here is a typical error:
ProxHTTPSProxyMII:
Code:
[18:54] 835 ProxHTTPSProxyMII RearProxy/v1.5 [Errno 32] Broken pipe
[18:54] 837 ProxHTTPSProxyMII RearProxy/v1.5 [Errno 32] Broken pipe
[18:54] 839 ProxHTTPSProxyMII RearProxy/v1.5 [Errno 32] Broken pipe
[18:55] 841 [F] ('Connection aborted.', ResponseNotReady('Request-sent',)) on "POST http://nnmclub.to/forum/posting.php"
[18:55] 841 ProxHTTPSProxyMII RearProxy/v1.5 [Errno 32] Broken pipe

Privoxy (debug 1024)
Code:
2019-05-08 18:50:12.506 7fd0d2195700 Crunch: Blocked: http://counter.yadro.ru/hit?t52.10;rhttps%3A//nnmclub.to/forum/viewtopic.php%3Ft%3D1300644%26start%3D
2019-05-08 18:50:56.056 7fd0b2ffd700 Crunch: Forwarding failed: http://tracker.tfile.co/scrape.php?uk=LIryP9C276&&info_hash=
2019-05-08 18:53:25.894 7fd0d45bb700 Crunch: No server data received: http://open.touki.ru/scrape.php?info_hash=
2019-05-08 18:55:39.161 7fd0d2996700 Crunch: No server data received: http://open.touki.ru/announce.php?info_hash=
2019-05-08 18:55:59.442 7fd0b2ffd700 Crunch: No server data received: http://open.touki.ru/announce.php?info_hash=
2019-05-08 18:56:25.766 7fd0b37fe700 Crunch: Connection failure: http://tracker.openbittorrent.com/scrape?info_hash=
As you can see, the request was not blocked. And there is nothing else there, because it's just a router. An error occurs not often, but steadily.
While trying to edit, even then an error occurred:
https://ibb.co/MGjTk9n
Code:
[19:05] 176 ProxHTTPSProxyMII RearProxy/v1.5 [Errno 32] Broken pipe
[19:09] 180 [F] ('Connection aborted.', ResponseNotReady('Request-sent',)) on "POST http://www.prxbx.com/forums/xmlhttp.php?action=edit_post&do=update_post
[19:09] 180 ProxHTTPSProxyMII RearProxy/v1.5 [Errno 32] Broken pipe
[19:10] 182 ProxHTTPSProxyMII RearProxy/v1.5 [Errno 32] Broken pipe
Add Thank You Quote this message in a reply
May. 17, 2019, 05:41 PM (This post was last modified: May. 18, 2019 10:49 AM by vlad_s.)
Post: #337
RE: ProxHTTPSProxyMII: Reloaded
After updating urllib3 to the latest version (>= 1.25), I get an error for my local server:
Code:
[20:25] 014 [R][D] "GET https://192.168.2.1/" HTTPSConnectionPool(host='192.168.2.1', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:847)'),))
[20:25] 015 [R][D] "GET https://192.168.2.1/favicon.ico" HTTPSConnectionPool(host='192.168.2.1', port=443): Max retries exceeded with url: /favicon.ico (Caused by SSLError(SSLError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:847)'),))
And it seems that in the config.ini file the [SSL No-Verify] section starts to be ignored, in which I just made an entry like 192.168.2.1:
Code:
[SSL No-Verify]
192.168.2.1
Add Thank You Quote this message in a reply
Post Reply 


Forum Jump: