A news relay
------------

This is an experiment in both messing with the aio routines in FreeBSD and
an async-io based news relay for Unix.

These docs are far from complete, but with the source you should be able
to figure out what to do.

Some things to know:

In order to run this, YOU MUST BE RUNNING FREEBSD-CURRENT, WITH MY
ASYNC-IO PATCHES INSTALLED, AND WITH libc REBUILT and installed.  If you
see link errors referring to aio_waitcomplete, you didn't get the libc
rebuild done right. You need to apply the diffs, run sh makesyscalls.sh
syscalls.master, rebuild and install the kernel, copy the files from
/usr/src/sys/sys to /usr/include/sys, then rebuild libc (cd
/usr/src/lib/libc;make;make install).

WARNING: IF YOU DON'T GET THE LIBC BUILT CORRECTLY, AND YOU INSTALL IT,
NO APPLICATIONS WHICH DEPEND ON YOUR LIBC.SO.X WILL WORK.  MAKE A BACKUP
COPY FIRST.

Steps:

1) patch -p <aio-kernel-patch
2) cd /usr/src/sys/kern;sh makesyscalls.sh syscalls.master
3) rebuild your kernel and install it
4) cp /usr/src/sys/sys/* /usr/include/sys
5) cd /usr/src/lib/libc; make; make install
6) reboot
7) run 'make' for this package

Then:

You'll need to edit feeds.conf.sample and rename it to feeds.conf.  The
file is pretty self explanatory.

You must create the seen.idx, seen.dat, and feed.dat file since mmap won't
grow a file.  I use 'dd', like this:

dd if=/dev/zero of=/news/history/seen.dat bs=1m count=80 
dd if=/dev/zero of=/news/history/seen.idx bs=1m count=8
dd if=/dev/zero of=/news/feeddb/feed.dat bs=1m count=60

When specifying the count to dd, you can calculate on the following:

seen.dat = 1MB + 12 * SeenDataSize
seen.idx = 1MB + 4 * SeenTableSize
feed.dat = 1MB + FeedDataSize

Be sure that you convert the results data/table size multiplication to
megabytes.

The code will spew lots of info when run, stats are output every 5 seconds
for articles sent and received, every 30 seconds for all incoming and
outgoing feeds.