XUProxy 0.1.0 released

[andrew_w]

I have finally released XUProxy 0.1.0. This is the second released version of XUProxy and the first to include Proxomitron-compatible header and content filters. This release is essentially an alpha (or beta if you want to be generous), and very likely has multiple bugs in the filtering code (I have written unit tests, and tested the filtering plugins on a few sites, but I still am not using them regularly). Also, there are no pre-built packages, and all dependencies must be installed separately. XUProxy is primarily written in Python, which is pre-installed on most Unices. In addition to Python, XUProxy depends on Twisted, twisted.web2, and pyparsing.

[whenever]

This is what I did to get XUProxy running:

1. Put all dependencies into "lib" directory and modify "bin/xuproxy" to make it look for "lib" for dependencies

2. Comment out line 29 of "lib/xuproxy/core/_platforms.py" to get rid of the "NameError: name 'xuproxy' is not defined" error. Those two variables are assigned value in "lib/xuproxy/core/main.py" at a later time

3. Modify "etc/xuproxy/xuproxy.conf" to make it listen on 8090, to not conflict with Proxomitron

4. Rename "bin/xuproxy" to "bin/xuproxy.py" so you can run it with your installed python interpreter

For those who are not familiar with python, I had put everything into a zip file, which is available at http://proxfilter.net/xuproxy-0.1.0.zip. Execute "bin/xuproxy.py" to get it up.

Of course, you still have to install python 2.x branch firstly.

I don't get enough time to test it but it seems rather slow on my machine and consume considerable CPU resource while proxying/filtering under default settings.

And I got below warning when XUProxy detected the first http request.

Code:

2010-07-12 23:31:19+0800 [HTTPServer,0,127.0.0.1] E:\Incoming\xuproxy-0.1.0.tar\
xuproxy-0.1.0\lib\xuproxy\core\filter_stack.py:48: exceptions.DeprecationWarning
: object.__init__() takes no parameters

Time to go to sleep.

[andrew_w]

(Jul. 12, 2010 04:03 PM)whenever Wrote:  I don't get enough time to test it but it seems rather slow on my machine and consume considerable CPU resource while proxying/filtering under default settings.

That's probably because you're not using the C version of the filtering engine, which is faster than the Python version, although it is nowhere near as fast as the Proxomitron yet. You need to build it with setup.py (obviously, you also need a C compiler installed in a way that Python can find it). After it is built, you either have to install XUProxy with setup.py, or copy the extension modules (they have the extension .so on most Unices, and .pyd on Windows) from the build directory to lib/xuproxy/proxo_filter.

[Siamesecat]

Are you saying that one has to compile the software oneself?

[whenever]

(Jul. 12, 2010 07:58 PM)andrew_w Wrote:  You need to build it with setup.py (obviously, you also need a C compiler installed in a way that Python can find it). After it is built, you either have to install XUProxy with setup.py, or copy the extension modules (they have the extension .so on most Unices, and .pyd on Windows) from the build directory to lib/xuproxy/proxo_filter.

Hello andrew_w, most Proxomitron users here use windows and are not programmers who know how to compile program from source, is there any chance you offer the compiled .pyd files? Many people would be interested in testing XUProxy if they could get it running.

[andrew_w]

(Jul. 13, 2010 03:56 PM)whenever Wrote:  

(Jul. 12, 2010 07:58 PM)andrew_w Wrote:  You need to build it with setup.py (obviously, you also need a C compiler installed in a way that Python can find it). After it is built, you either have to install XUProxy with setup.py, or copy the extension modules (they have the extension .so on most Unices, and .pyd on Windows) from the build directory to lib/xuproxy/proxo_filter.

Hello andrew_w, most Proxomitron users here use windows and are not programmers who know how to compile program from source, is there any chance you offer the compiled .pyd files? Many people would be interested in testing XUProxy if they could get it running.

I don't have a Windows C compiler at the moment, but I'll see if I can download one that will work to build Python modules.

[Siamesecat]

What about compiling one for Mac OS as well?

[anewuser]

Use Sphinx to create a nice page for it (like WebCleaner's).

[andrew_w]

I have released XUProxy 0.1.1. Anyone using 0.1.0 is strongly encouraged to upgrade because both the header filter (except for the URL part) and optimized matching code were completely broken in 0.1.0.

This version is available as a self-contained Windows package built with py2exe, which means that it is possible to just extract and run it on Windows, much like with the Proxomitron.

(Jul. 15, 2010 06:03 AM)Siamesecat Wrote:  What about compiling one for Mac OS as well?

My newest Mac is an iBook G4, so I don't think that I can build an x86 OS X version.

[defconnect]

Version 0.1.2 for Windows has been released 13-11-2010: http://sourceforge.net/projects/xuproxy/...z/download , but could not find change log in NEWS file.

[andrew_w]

(Nov. 29, 2010 03:55 PM)defconnect Wrote:  Version 0.1.2 for Windows has been released 13-11-2010: <a href="http://sourceforge.net/projects/xuproxy/files/xuproxy/0.1/xuproxy-0.1.2-windows.7z/download">http://sourceforge.net/projects/xuproxy/files/xuproxy/0.1/xuproxy-0.1.2-windows.7z/download</a> , but could not find change log in NEWS file.

The 0.1.2 source release should include the updated changelog. 0.1.2 is a bugfix release that changes numeric ranges to behave more like those of the Proxomitron, and fixes handling of match lengths of patterns internally implemented with joined literals (look-behind tests with the $LB command involving such patterns should work). Also included is another twisted.web2 patch that fixes a bug that causes a stack overflow when multiple chunks are received at once (the twisted.web2 included with the Windows version includes this patch). There are no other changes.

The next major version (0.2.0) will include faster Proxomitron-compatible filters (so far, I've removed most of the Python attribute accesses from the C matching code in the current development version, but I might be able to optimize it further), a basic web-based user interface implemented using a local pseudo-domain, and possibly HTTPS support.

[defconnect]

(Dec. 07, 2010 01:01 AM)andrew_w Wrote:  The next major version (0.2.0) will include faster Proxomitron-compatible filters (so far, I've removed most of the Python attribute accesses from the C matching code in the current development version, but I might be able to optimize it further), a basic web-based user interface implemented using a local pseudo-domain, and possibly HTTPS support.

[ProxRocks]

very cool indeed

[bugger]

So is this project still alive? I haven't see any updates for a while

[andrew_w]

(Sep. 12, 2011 02:08 PM)bugger Wrote:  So is this project still alive? I haven't see any updates for a while

Yes, it's still alive. In fact, I'm going to release 0.2.0 soon. It will include HTTPS support and a basic HTML user interface.