Consider keeping library binaries around

[aasmith]

Installing the libraries to a /tmp prefix and then nuking them helps on image size, but hinders usability. Would be nice to have access to the openssl and pcre binaries for version-specific testing.