ssp ane entropy

Robert Connolly robert at linuxfromscratch.org
Sun Apr 25 14:13:11 PDT 2004


Please update these attached hints. Also please delete entropy_watch.c and 
replace it with this entropy_avail.sh. I think the winter/ and ssp/ 
directories in attachments/ can also be removed. I have no links pointing in 
there anymore, and the files there are no longer usefull.

Thanks :)
-------------- next part --------------
AUTHOR:		Robert Connolly <robert at linuxfromscratch dot org> (ashes)

DATE:		2004-04-25

LICENSE:	Public Domain

SYNOPSIS:	Random number generation

PRIMARY URL:	http://www.linuxfromscratch.org/hints/

DESCRIPTION:
Many system components including smashing stack protector, mkstemp,
cryptography, depend on a supply of random bits to ensure data integrity.
In the Linux kernel a combination of input devices are used to gather
randomness from. This includes the keyboard, mouse, and hard disc.
On an idle system none of these devices are receiving input, and the entropy
(randomness) of the system is easy to deplete, especially with cryptography.

Hardware random:
http://linuxcertified.com/hw_random.html
Some systems have hardware devices for random numbers. The kernel supports
many of them. For more information check the above web site. Also see:
http://sourceforge.net/projects/gkernel/

Fast and Economical Random number suite:
http://frandom.sourceforge.net/
Frandom uses an arcfour stream cipher of seed data from the kernel's internal
pool. The advantage to frandom is that 4 bytes of kernel entropy can be
expanded into gigabytes of random output. Ideal for wiping discs, and maybe
even for online gaming. A new addition to the frandom package is erandom.
Economical random uses the state of frandom as a seed, and its use does not
drain any kernel entropy. This is done very efficiently, completely in the
kernel. Erandom is ideal for Smashing Stack Protector. Frandom now also
supports sysctl so SSP can use it regardless if /dev/erandom exists or not.
This is slightly faster and works threw chroot.

audio/video entropy daemon:
http://www.vanheusden.com/aed/
http://www.vanheusden.com/ved/
This hint describes two daemons which use either the static noise from the
system audio, or the video frames from a video4linux device. These devices
have a never ending supply of randomness created by thermal fluctuation and
electric fields on the devices. These entropy gathering daemons depend on the
kernel driver for your hardware to work properly, be it your sound or video
card. These programs will re-seed the kernel entropy pool. The programs can
be used together in combination with the kernel's internal values to create
a very random pool from several different sources.

PREREQUISITES: None

HINT: 

Audio entropy daemon:
http://www.vanheusden.com/aed/
http://www.vanheusden.com/aed/audio-entropyd-0.0.6.tgz
http://www.linuxfromscratch.org/~robert/hlfs/hints/attachments/entropy/\
	audio-entropyd-0.0.6.tgz

make &&
install -g 0 -o 0 -m 755 audio-entropyd /usr/sbin/audio-entropyd

Edit your /etc/rc.d/init.d/random and start audio-entropyd just after seeding
urandom, and stop it just after saving random-seed. The pid file will be in
/var/run. You don't need to reboot to use it, but you do need your sound card
driver loaded, and be root.

Video entropy daemon:
http://www.vanheusden.com/ved/
http://www.vanheusden.com/ved/video_entropyd-0.7.tgz
http://www.linuxfromscratch.org/~robert/hlfs/hints/attachments/entropy/\
        video_entropyd-0.7.tgz

make &&
install -g 0 -o 0 -m 755 video_entropyd /usr/sbin/video_entropyd

Add this to root's crontab every minute or so. It can not run as a daemon
because it will lock the video device. Depends on video4linux. Using one or
both of these daemons should be adequate for sustained moderate-to-heavy use.

Nothing else needs to be done, applications can continue to use /dev/random
and /dev/urandom normally. You should notice crypto keys get made faster.

Frandom/erandom:
http://frandom.sourceforge.net/
http://www.linuxfromscratch.org/~robert/hlfs/hints/attachments/frandom/\
	frandom-0.8.tar.gz
http://www.linuxfromscratch.org/patches/downloads/linux/\
	linux-2.4.26-frandom-1.patch

You don't need the frandom-0.8 source, its presented so you can read more
about it if you want. The Linux kernel patch is all we need.
Frandom is built in by default with this patch. It can be found in the
character devices menu. Build and install the new kernel.

cd linux-2.4.26
patch -Np1 -i ../linux-2.4.26-frandom-1.patch
...
reboot

mknod /dev/frandom c 235 11
mknod /dev/erandom c 235 12

To use it for SSP use the glibc-ssp-frandom patch.
http://www.linuxfromscratch.org/hints/downloads/files/ssp.txt

 - Testing entropy
You should try to test this on an idle machine. Nothing compiling in
background, no updatedb running, etc. Moving/clicking the mouse, keyboard, and
even network traffic will create entropy in the pool, and affect results.
Todo: Have tests for entropy quality, not just quantity.

Fetch this:
http://www.linuxfromscratch.org/~robert/hlfs/hints/attachments/entropy/
	entropy_avail.sh

Open two windows with non-root login. This is easiest to do in X, else split
a console window in two. In one window do this:

sh ./entropy_avail.sh

In the next window do something like this:

dd if=/dev/{u,f,e}random of=/dev/null bs=1 count=1024

If one or both of the entropyd programs are running you should see the pool
being refilled. Kill the entropyd program(s) and you should see it does not
refill so quickly. Move the mouse and play with it if you like. If you use a
small count like count=512 the entropyd program(s) may not refill immedietly
because the pool is still large enough. This is to improve preformance.

You might want to delete entropy_avail.log when you're done.

ACKNOWLEDGMENTS:
* Thanks to Eli Billauer for the Frandom suite. -
	http://frandom.sourceforge.net/

CHANGELOG:
[2004-03-29]
* Initial post
[2004-03-30]
* Added test.
[2004-04-18]
* Added frandom/erandom.
[2004-04-25]
* Added hardware random url and notes.
* Switched the entropy_avail program to a more simple shell script.
-------------- next part --------------
AUTHOR:		Robert Connolly <robert at linuxfromscratch dot org> (ashes)

DATE:		2004-04-25

LICENSE:	Public Domain

SYNOPSIS:	Smashing Stack Protector and Libsafe

PRIMARY URL:	http://www.linuxfromscratch.org/~robert/winter/Linux/

DESCRIPTION:
Smashing Stack Protector is a C and C++ security extension for GCC.
Libsafe prevents format string attacks.

Based on StackGaurd, SSP was developed by IBM for protecting applications
from stack smashing attacks. This is the single largest class of attacks and
many security oriented vendors have added it to their default compiler. The
overhead lost to this type of guard is minimal. In practice if the entire
system is built with SSP users shouldn't notice any difference in preformance.

The official homepage for ProPolice Smashing Stack Srotector is at:
http://www.trl.ibm.com/projects/security/ssp/

http://www.usenix.org/events/sec01/full_papers/frantzen/frantzen_html/\
        node30.html
"Hiroaki Etoh's ProPolice is a modification to the GNU C compiler that places a
random canary between any stack allocated character buffers and the return
pointer [5]. It then validates that the canary has not been dirtied by an
overflowed buffer before the function returns. ProPolice can also reorder local
variables to protect local pointers from being overwritten in a buffer overflow.
"
Also see:
http://www.linuxfromscratch.org/hlfs/
http://www.linuxfromscratch.org/~robert/FreeBSD/freebsd-ssp.txt
http://www.linuxfromscratch.org/~robert/NetBSD/netbsd-ssp.txt
http://www.trusteddebian.org/
http://www.openbsd.org/

PREREQUISITES: LFS-5.0
The frandom kernel patch is now required for SSP. This provides the erandom
device and sysctl interface. Using erandom stops a serious entropy depletion
problem while still providing urandom quality random bytes. Idealy you should
reboot an frandom kernel before installing SSP, but SSP will build without it.
It will fallback to hardcoded values. Read this:
http://www.linuxfromscratch.org/hints/downloads/files/entropy.txt
You will need the header from the frandom patch installed to build glibc.

HINT:

=======
Context
=======

	Introduction
	Extras
		Extra security patches
		Libsafe
		Full Bounds Checking
	Installation
	Testing
	Feedback
	Acknowledgments

============
Introduction
============

Smashing Stack Protector

The GCC patch will add -fstack-protector-all, -fstack-protector, and
-fno-stack-protector to GCC extensions for C and C++; and
__guard_setup and __stack_smash_handler are defined in libgcc2.c. This code is
supplied by IBM, I have changed one definition to enable libc functions, and
added "ssp" to the version string. The gcc2 patch is only needed if you plan to
use gcc2 to build the kernel, and want stack protection in the kernel.

http://www.linuxfromscratch.org/patches/downloads/gcc/\
        gcc-3.3-ssp-2.patch # and/or
        gcc-2.95.3-ssp-1.patch

The libc patch will define __guard_setup and __stack_smash_handler in libc.so
so the kill function can be kept in a shared object. In the Glibc patch the
erandom device is used to gather a small amount of random bits for the gaurd
value. /dev/log will lso need to be present in chroot for syslog to log stack
overflows. It is reccomended intrusion detection systems monitor the system
logs for these alerts.

http://www.linuxfromscratch.org/patches/downloads/glibc/\
        glibc-2.3.{2,3}-ssp-frandom-2.patch # <- Recommended

The GCC Specs patch adds -fstack-protector-all to GCC's default compiler flags.
Filters prevent libraries and the kernel from being built with unnessesary
smash symbols. This patch will build all main executables with stack protection.
This patch makes using stack protector almost transparent. This gcc2 patch is
not nessesary for anyone using gcc3 as their main compiler, it is provided for
legacy.

http://www.linuxfromscratch.org/patches/downloads/gcc/\
	gcc-3.3-sspspecs-3.patch # and/or
	gcc-2.95.3-sspspecs-2.patch

The Linux kernel patch adds support to the Linux kernel for smash symbols. It
can only build with -fstack-protector, not -fstack-protector-all, and is
therefore excluded from the default specs in the sspspecs patch.

http://www.linuxfromscratch.org/patches/downloads/linux/\
        linux-2.4.26-ssp-1.patch # or
        linux-2.6.5-ssp-1.patch

This only works with linux-2.4 right now, untill its ported to 2.6.
http://www.linuxfromscratch.org/patches/downloads/linux/\
        linux-2.4.26-frandom-1.patch

The XFree86 patch disables stack protection for some modules. XFree86 4.4 is
not yet patched/supported.

http://www.linuxfromscratch.org/patches/downloads/XFree86/ \
        XFree86-4.3.0-ssp-1.patch

======
Extras
======
----------------------
Extra security patches
----------------------
This patch fixes a bug in both glibc-2.3.2 and glibc-2.3.3. This bug can be
reproduced by bind9's testsuite.
http://www.linuxfromscratch.org/patches/downloads/glibc/\
	glibc-2.3.3-got-fix-1.diff

This patch adds a sanity check to malloc. Backported from the Owl project.
(http://www.openwall.com/Owl/)
http://www.linuxfromscratch.org/patches/downloads/glibc/\
	glibc-2.3.3-owl-malloc-unlink-sanity-check-1.patch

--------
Libsafe
--------
Official site:
http://www.research.avayalabs.com/project/libsafe/src/libsafe-2.0-16.tgz
-The good news:

Libsafe was developed by Avaya Labs to protect against format string
vulnerabilities. Though not widely used it has been widely tested. This
protection can be installed on an already running system, using ld.so.preload
to watch applications at runtime for functions which are known to be vulnerable.
This of course only protects dynamically linked applications. There should not
be a noticeable performance decrease, and it also logs to syslog.

-The bad news:

Libsafe is obsolete, you can still use it if you wish.
We get some errors if we install Libsafe early in the build.
GCC
FAIL: g++.dg/expr/anew1.C execution test
FAIL: g++.dg/expr/anew2.C execution test
FAIL: g++.dg/expr/anew3.C execution test
FAIL: g++.dg/expr/anew4.C execution test

Binutils
FAIL: S-records
FAIL: S-records with constructors

To avoid these errors install Libsafe after gcc in chapter 6. Libsafe is
somewhat obsolete. Most modern software either doesn't use these strings, or
uses them properly. All of the example exploits in exploits/ will fail because
of SSP.

------------
Hardened GCC
------------
This is now sspspecs.patch.

--------------------
Full Bounds Checking
--------------------
This is an auditing tool to give verbose debugging. Applications built with this
will run very slowly. This is not intended for real world use, only for
debugging. -fbounds-checking is added to GCC extensions, and is not used by
default. You can also add this to the specs, but I don't reccomend it with
-fstack-protector with debugging if you want to get consistent results (read up
about /dev/urandom). Applications compiled with this will crash if any part of
the program goes out of bounds.

Official site (more versions are available):
http://web.inter.nl.net/hcc/Haj.Ten.Brugge/\
	bounds-checking-gcc-3.3.3-1.00.patch.bz2

=====================
Installation
=====================

---------
Chapter 5
---------
Kernel headers
(See under PREREQUISITES above)
patch -Npq -i ../linux-2.4.26-frandom-1.patch

 - GCC pass 1
If the host system has SSP in Glibc already, then you can patch gcc
here. Otherwise do not. If in doubt, wait until pass two.
 - Glibc
patch -Np1 -i ../glibc-2.3.2-ssp-frandom-2.patch

 - GCC pass 2
patch -Np1 -i ../gcc-3.3-ssp-2.patch
patch -Np1 -i ../gcc-3.3-sspspecs-3.patch

 - Binutils pass 2
Just for the testsuite.
make CFLAGS="-fno-stack-protector" check

---------
Chapter 6
---------
Make sure the frandom header get installed again.

 - Glibc
patch -Np1 -i ../glibc-2.3.2-ssp-frandom-2.patch

 - Binutils
make CFLAGS="-fno-stack-protector" check

 - GCC
hgcc -fa
patch -Np1 -i ../gcc-3.3-ssp-2.patch
patch -Np1 -i ../gcc-3.3-sspspecs-3.patch

 - Grub
CFLAGS="-fno-stack-protector" ./configure...

 - GCC 2.95.3
patch -Np1 -i ../gcc-2.95.3-ssp-1.patch

---------
Chapter 8
---------
Linux kernel

make mrproper &&
patch -Np1 -i ../linux-2.4.26-ssp-1.patch
patch -Np1 -i ../linux-2.4.26-frandom-1.patch

make menuconfig

make CC="/opt/gcc-2.95.3/bin/gcc -fstack-protector" dep
make CC="/opt/gcc-2.95.3/bin/gcc -fstack-protector" bzImage
...

========
Testing
========
There are a couple tests in this package which may also be usefull here.
http://pax.grsecurity.net/paxtest-0.9.5.tar.gz
There are also tests in the libsafe source.

This will test -fstack-protector-all

cat > fail.c << "EOF"
#include <stdio.h>
#include <unistd.h>

int foo(char *blah) {
  char buffer[7];
  sprintf(buffer, "12345678901234567890123456789012345678901234567890");
  return(1234);
}

int main(int argc, char **argv) {
  printf("before foo()\n");
  foo("blah");
  printf("after foo()\n");
}
EOF

gcc -fstack-protector-all -o fail fail.c &&
./fail

ACKNOWLEDGMENTS:

* Thanks to Hiroaki Etoh for providing the SSP patch to IBM
* Thanks to IBM for providing the SSP patch at
	http://www.research.ibm.com/trl/projects/security/ssp/
* Thanks to OpenBSD for their XFree86 code. http://www.openbsd.org/
* Thanks to netsys.com for this
	http://www.netsys.com/cgi-bin/display_article.cgi?1266
* Thanks to securityfocus.com and immunix.com for this
	http://www.securityfocus.com/archive/1/333986/2003-08-17/2003-08-23/2
* Thanks to adamantix.org for kernel patches. http://www.adamantix.org/
* Thanks to Avaya Labs for Libsafe
	http://www.research.avayalabs.com/project/libsafe/
* Thanks to Teemu Tervo for nptl hint
	http://www.linuxfromscratch.org/hints/downloads/files/nptl.txt
* Thanks to cross compiling hint
	http://www.linuxfromscratch.org/hints/downloads/files/ \
		crosscompiling-x86.txt
* Thanks to http://www.isecurelabs.com/news/64 for proof of concept tests.
* Thanks to Eli Billauer for the Frandom suite
        http://frandom.sourceforge.net/

CHANGELOG:
[2003-10-18]
* Debut
* Reformat hint
[2003-10-22]
* Reformatted the patches so they're much easier to apply.
* Edit/rewrite hint & synopsis.
[2003-10-24]
* Added caveat.
* Fixed URLS.
* Lite edit
[2003-10-25]
* New bugs found.
[2003-10-26]
* GCC 2.95.3 patches made.
[2003-10-27]
* XFree86-4.3.0 patch made.
* Hint is now Beta - Need more feedback.
[2003-11-03]
* Edit
* Reformatted patches.
[2003-11-12]
* Reformat patches.
* Update/edit hint.
* Add new example tests.
[2003-11-21]
* Reformat patches.
* Add homepage/mirror url.
* Small edit.
[2003-12-01]
* Added Glibc and kernel patches.
* Rewrote install procedure.
[2003-12-20]
* Try to be more informative.
* Removed Gentoo property.
* Added Libsafe.
* Added Pax.
* Added new versions of binutils and glibc.
* Added GCC PIE.
* Rename filename to winter.txt.
[2003-12-21]
* Do not use "Enforce non-executable pages"
* Spell check.
* Fixed URL.
[2003-12-22]
* Added LOPTS to Net-tools.
* Added LDFLAGS to Perl.
[2003-12-25]
* More cflags.
* New tests.
[2003-12-30]
* Renamed hint back to propolice.txt.
* Added back Gentoo property as optional.
[2004-01-01]
* Added HCC
[2004-01-17]
* Cleanup
[2004-02-08]
* Update urls
* Convert propolice to ssp
[2004-02-15]
* Update gcc-3.3.3 and linux-2.6.2 ssp patches
[2004-02-19]
* Update linux-2.6.3 patch and hgcc url
[2004-03-27]
* Add sspspecs patch. Update.
[2004-04-18]
* Added entropy.txt link for erandom.
[2004-04-25]
* Fix more/again for erandom.
* Update some patches.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: entropy_avail.sh
Type: application/x-shellscript
Size: 159 bytes
Desc: not available
URL: <http://lists.linuxfromscratch.org/pipermail/hints/attachments/20040425/cbe26896/attachment.bin>


More information about the hints mailing list