libzdb-general

libzdb-general@tildeslash.com

154 discussions

master/slave
by Zbierski Christophe 04 Jan '11

04 Jan '11

Hello and Happy New Year. I use zdb to connect to two mysql databases (one master and one slave). I implement this management master/slave around zdb, but I think it would be preferable to implement this function directly into the library. Does this type of development is planned in the future, or I can propose a change on this point. Thank you Christophe Zbierski Ce message et les pièces jointes sont confidentiels et réservés à l'usage exclusif de ses destinataires. Il peut également être protégé par le secret professionnel. Si vous recevez ce message par erreur, merci d'en avertir immédiatement l'expéditeur et de le détruire. L'intégrité du message ne pouvant être assurée sur Internet, la responsabilité du groupe Atos Origin ne pourra être recherchée quant au contenu de ce message. Bien que les meilleurs efforts soient faits pour maintenir cette transmission exempte de tout virus, l'expéditeur ne donne aucune garantie à cet égard et sa responsabilité ne saurait être recherchée pour tout dommage résultant d'un virus transmis. This e-mail and the documents attached are confidential and intended solely for the addressee; it may also be privileged. If you receive this e-mail in error, please notify the sender immediately and destroy it. As its integrity cannot be secured on the Internet, the Atos Origin group liability cannot be triggered for the message content. Although the sender endeavours to maintain a computer virus-free network, the sender does not warrant that this transmission is virus-free and will not be liable for any damages resulting from any virus transmitted.

2 1

Dynamic loading of database driver
by Matthieu Verbert 08 Nov '10

08 Nov '10

Hi all, I implemented the feature noted in $subject on top of libzdb 2.7 (trunk@380). My initial goal was to produce a nicer package which would not require to install client libraries for database system I don't use. I made the feature optional (disabled by default in configure, new option '--enable-libdl'), and it is lightly tested (test/select still works after the 2 below patches are applied, both with the libdl enabled or not). The only extra-requirement is that the patch uses GCC non-standard "__attribute__ ((constructor))" to not have to modify any user. I didn't even try to implement driver unloading, although it is certainly possible too. Let me know what you think of it. Thanks, Matthieu >From 234b8f8145872ee6dc02d66e4aa6cd39c5a603b4 Mon Sep 17 00:00:00 2001 From: Matthieu Verbert <matthieu.verbert(a)aitb.org> Date: Sat, 6 Nov 2010 13:02:04 +0100 Subject: [PATCH 1/2] Update autotools to support multiple libs and libdl Create separate variables for each database 'driver', and add them only where they need to be used (Oracle untested). configure's behaviour is unchanged if libdl is not enabled, else multiple libraries will be created. Note that the test program breaks at link time if this option is enabled. --- Makefile.am | 76 +++++++++++++++++++++++++++++++++++++++--------- configure.ac | 90 ++++++++++++++++++++++++++++++++++++---------------------- 2 files changed, 117 insertions(+), 49 deletions(-) diff --git a/Makefile.am b/Makefile.am index 31d92cd..2061c3d 100644 --- a/Makefile.am +++ b/Makefile.am @@ -14,7 +14,7 @@ RE2C = @RE2C@ RE2CFLAGS = -b FILTERH = ./tools/bin/filterh -AM_CPPFLAGS = $(CPPFLAGS) $(DBCPPFLAGS) +AM_CPPFLAGS = INCLUDES = -Isrc -Isrc/util -Isrc/net -Isrc/db -Isrc/exceptions lib_LTLIBRARIES = libzdb.la @@ -23,29 +23,75 @@ libzdb_la_SOURCES = src/util/Util.c src/util/Str.c src/util/Mem.c \ src/db/Connection.c src/db/ResultSet.c \ src/db/PreparedStatement.c src/util/StringBuffer.c \ src/exceptions/assert.c src/exceptions/Exception.c - if ! WITH_ZILD libzdb_la_SOURCES += src/net/URL.c endif + +libzdb_la_LDFLAGS = +noinst_LTLIBRARIES = +libzdb_la_LIBADD = + +if WITH_LIBDL +libzdb_la_LDFLAGS += -ldl +endif + if WITH_MYSQL -libzdb_la_SOURCES += src/db/mysql/MysqlConnection.c \ - src/db/mysql/MysqlResultSet.c \ - src/db/mysql/MysqlPreparedStatement.c +if WITH_LIBDL +lib_LTLIBRARIES += libzdb-mysql.la +else +noinst_LTLIBRARIES += libzdb-mysql.la +libzdb_la_LIBADD += libzdb-mysql.la endif + +libzdb_mysql_la_SOURCES = src/db/mysql/MysqlConnection.c \ + src/db/mysql/MysqlResultSet.c \ + src/db/mysql/MysqlPreparedStatement.c +libzdb_mysql_la_CPPFLAGS = $(DB_MYSQL_CPPFLAGS) +libzdb_mysql_la_LDFLAGS = $(DB_MYSQL_LDFLAGS) +endif # WITH_MYSQL + if WITH_POSTGRESQL -libzdb_la_SOURCES += src/db/postgresql/PostgresqlConnection.c \ - src/db/postgresql/PostgresqlResultSet.c \ - src/db/postgresql/PostgresqlPreparedStatement.c +if WITH_LIBDL +lib_LTLIBRARIES += libzdb-postgresql.la +else +noinst_LTLIBRARIES += libzdb-postgresql.la +libzdb_la_LIBADD += libzdb-postgresql.la endif +libzdb_postgresql_la_SOURCES = src/db/postgresql/PostgresqlConnection.c \ + src/db/postgresql/PostgresqlResultSet.c \ + src/db/postgresql/PostgresqlPreparedStatement.c +libzdb_postgresql_la_CPPFLAGS = $(DB_POSTGRESQL_CPPFLAGS) +libzdb_postgresql_la_LDFLAGS = $(DB_POSTGRESQL_LDFLAGS) +endif # WITH_POSTGRESQL + if WITH_SQLITE -libzdb_la_SOURCES += src/db/sqlite/SQLiteConnection.c \ - src/db/sqlite/SQLiteResultSet.c \ - src/db/sqlite/SQLitePreparedStatement.c +if WITH_LIBDL +lib_LTLIBRARIES += libzdb-sqlite.la +else +noinst_LTLIBRARIES += libzdb-sqlite.la +libzdb_la_LIBADD += libzdb-sqlite.la endif + +libzdb_sqlite_la_SOURCES = src/db/sqlite/SQLiteConnection.c \ + src/db/sqlite/SQLiteResultSet.c \ + src/db/sqlite/SQLitePreparedStatement.c +libzdb_sqlite_la_CPPFLAGS = $(DB_SQLITE_CPPFLAGS) +libzdb_sqlite_la_LDFLAGS = $(DB_SQLITE_LDFLAGS) +endif # WITH_SQLITE + if WITH_ORACLE -libzdb_la_SOURCES += src/db/oracle/OracleConnection.c \ - src/db/oracle/OracleResultSet.c \ - src/db/oracle/OraclePreparedStatement.c +if WITH_LIBDL +lib_LTLIBRARIES += libzdb-oracle.la +else +noinst_LTLIBRARIES += libzdb-oracle.la +libzdb_la_LIBADD += libzdb-oracle.la +endif + +libzdb_oracle_la_SOURCES = src/db/oracle/OracleConnection.c \ + src/db/oracle/OracleResultSet.c \ + src/db/oracle/OraclePreparedStatement.c +libzdb_oracle_la_CPPFLAGS = $(DB_ORACLE_CPPFLAGS) +libzdb_oracle_la_LDFLAGS = $(DB_ORACLE_LDFLAGS) endif @@ -55,7 +101,7 @@ API_INTERFACES = src/zdb.h src/db/ConnectionPool.h src/db/Connection.h \ nobase_nodist_include_HEADERS = $(patsubst %, $(LIBRARY_NAME)/%, $(notdir $(API_INTERFACES))) -libzdb_la_LDFLAGS = $(DBLDFLAGS) -version-info 7:1:0 +AM_LDFLAGS = -version-info 7:1:0 BUILT_SOURCES = $(nobase_nodist_include_HEADERS) diff --git a/configure.ac b/configure.ac index f771cda..ac51435 100644 --- a/configure.ac +++ b/configure.ac @@ -109,6 +109,18 @@ AC_ARG_ENABLE(profiling, ] ) +AC_ARG_ENABLE(libdl, + AS_HELP_STRING([--enable-libdl], + [Use libdl to dynamic load database drivers]), + [AC_CHECK_LIB([dl], [dlopen], [libdl="yes"], [libdl="no"])], + [libdl="no"] +) +if test "xyes" = "x$libdl"; then + AC_DEFINE([HAVE_LIBDL], 1, [Define to 1 to enable libdl]) +fi + +AM_CONDITIONAL([WITH_LIBDL], test "xyes" = "x$libdl") + AC_ARG_ENABLE([openssl], AS_HELP_STRING([--enable-openssl(=<path>)], [Link libzdb with openssl. If database libraries were linked static, @@ -205,6 +217,7 @@ AC_ARG_WITH([mysql], if test "xyes" = "x$mysql"; then svd_CPPFLAGS=$CPPFLAGS svd_LDFLAGS=$LDFLAGS + svd_LIBS=$LIBS CPPFLAGS="`$MYSQLCONFIG --include` $CPPFLAGS" LDFLAGS="`$MYSQLCONFIG --libs` $LDFLAGS" AC_CHECK_HEADERS([mysql.h]) @@ -226,13 +239,15 @@ if test "xyes" = "x$mysql"; then fi ], [mysql="no"], [-lz]) if test "xyes" = "x$mysql"; then - DBCPPFLAGS="$DBCPPFLAGS `$MYSQLCONFIG --include`" - DBLDFLAGS="$DBLDFLAGS `$MYSQLCONFIG --libs`" + DB_MYSQL_CPPFLAGS="`$MYSQLCONFIG --include`" + DB_MYSQL_LDFLAGS="`$MYSQLCONFIG --libs` -lz" AC_DEFINE([HAVE_LIBMYSQLCLIENT], 1, [Define to 1 to enable mysql]) - else - CPPFLAGS=$svd_CPPFLAGS - LDFLAGS=$svd_LDFLAGS + AC_SUBST(DB_MYSQL_LDFLAGS) + AC_SUBST(DB_MYSQL_CPPFLAGS) fi + CPPFLAGS=$svd_CPPFLAGS + LDFLAGS=$svd_LDFLAGS + LIBS=$svd_LIBS fi AM_CONDITIONAL([WITH_MYSQL], test "xyes" = "x$mysql") @@ -273,13 +288,14 @@ if test "xyes" = "x$postgresql"; then LDFLAGS="-L`$PGCONFIG --libdir` $LDFLAGS" AC_CHECK_HEADERS([libpq-fe.h], [], [postgresql="no"]) if test "xyes" = "x$postgresql"; then - DBCPPFLAGS="$DBCPPFLAGS -I`$PGCONFIG --includedir`" - DBLDFLAGS="$DBLDFLAGS -L`$PGCONFIG --libdir` -lpq" + DB_POSTGRESQL_CPPFLAGS="-I`$PGCONFIG --includedir`" + DB_POSTGRESQL_LDFLAGS="-L`$PGCONFIG --libdir` -lpq" AC_DEFINE([HAVE_LIBPQ], 1, [Define to 1 to enable postgresql]) - else - CPPFLAGS=$svd_CPPFLAGS - LDFLAGS=$svd_LDFLAGS + AC_SUBST(DB_POSTGRESQL_LDFLAGS) + AC_SUBST(DB_POSTGRESQL_CPPFLAGS) fi + CPPFLAGS=$svd_CPPFLAGS + LDFLAGS=$svd_LDFLAGS fi AM_CONDITIONAL([WITH_POSTGRESQL], test "xyes" = "x$postgresql") @@ -294,51 +310,52 @@ AC_ARG_WITH([sqlite], sqlite="no" else AC_MSG_RESULT([yes]) - svd_LDFLAGS=$LDFLAGS - svd_CPPFLAGS=$CPPFLAGS - LDFLAGS="-L$with_sqlite/lib $LDFLAGS" - CPPFLAGS="-I$with_sqlite/include $CPPFLAGS" - AC_CHECK_HEADERS([sqlite3.h], [ - sqlite="yes" - if test -r "$with_sqlite/lib/libsqlite3.a"; then - DBCPPFLAGS="$DBCPPFLAGS -I$with_sqlite/include" - DBLDFLAGS="$DBLDFLAGS -L$with_sqlite/lib/ -lsqlite3" - else - sqlite="no" - fi - ], [sqlite="no"]) - LDFLAGS=$svd_LDFLAGS - CPPFLAGS=$svd_CPPFLAGS fi ], [ - AC_MSG_RESULT([yes]) - AC_CHECK_LIB([sqlite3], [sqlite3_open], [], [sqlite="no"]) + AC_MSG_RESULT([yes]) ]) + if test "xyes" = "x$sqlite"; then - AC_DEFINE([HAVE_LIBSQLITE3]) + svd_LDFLAGS=$LDFLAGS + svd_CPPFLAGS=$CPPFLAGS + svd_LIBS=$LIBS + CPPFLAGS="-I$with_sqlite/include $CPPFLAGS" + LDFLAGS="-L$with_sqlite/lib $LDFLAGS" + AC_CHECK_HEADERS([sqlite3.h], [sqlite="yes"], [sqlite="no"]) + AC_CHECK_LIB([sqlite3], [sqlite3_open], [], [sqlite="no"]) + if test "xyes" = "x$sqlite"; then + DB_SQLITE_CPPFLAGS="-I$with_sqlite/include" + DB_SQLITE_LDFLAGS="-L$with_sqlite/lib/ -lsqlite3" + AC_SUBST(DB_SQLITE_CPPFLAGS) + AC_SUBST(DB_SQLITE_LDFLAGS) + fi + LDFLAGS=$svd_LDFLAGS + CPPFLAGS=$svd_CPPFLAGS + LIBS=$svd_LIBS fi + AM_CONDITIONAL([WITH_SQLITE], test "xyes" = "x$sqlite") oracle="yes" AC_MSG_CHECKING(for oracle) AX_LIB_ORACLE_OCI if test -n "$ORACLE_OCI_CFLAGS" -a -n "$ORACLE_OCI_LDFLAGS"; then - DBCPPFLAGS="$DBCPPFLAGS $ORACLE_OCI_CFLAGS" - DBLDFLAGS="$DBLDFLAGS $ORACLE_OCI_LDFLAGS" + DB_ORACLE_CPPFLAGS="$ORACLE_OCI_CFLAGS" + DB_ORACLE_LDFLAGS="$ORACLE_OCI_LDFLAGS" AC_DEFINE([HAVE_ORACLE], 1, [Define to 1 to enable oracle]) + AC_SUBST(DB_ORACLE_CPPFLAGS) + AC_SUBST(DB_ORACLE_LDFLAGS) else oracle="no" fi AM_CONDITIONAL([WITH_ORACLE], test "xyes" = "x$oracle") # Test if any database system was found -if test "xno" = "x$postgresql" -a "xno" = "x$mysql" -a "xno" = "x$sqlite" -a "xno" = "x$oracle"; then - AC_MSG_ERROR([No available database found or selected. Try configure --help]) +if test "xno" = "x$postgresql" -a "xno" = "x$mysql" -a "xno" = "x$sqlite" -a "xno" = "x$oracle" -a "xno" = "x$libdl" ; then + AC_MSG_ERROR([No available database found or selected, and dynamic loading disabled. Try configure --help]) fi -AC_SUBST(DBLDFLAGS) -AC_SUBST(DBCPPFLAGS) # --------------------------------------------------------------------------- # Header files @@ -413,6 +430,11 @@ echo "| Profiling: DISABLED |" else echo "| Profiling: ENABLED |" fi +if test "xno" = "x$libdl"; then +echo "| Dynamically load drivers: DISABLED |" +else +echo "| Dynamically load drivers: ENABLED |" +fi if test "xfalse" = "x$zild_protect"; then echo "| Zild: DISABLED |" else -- 1.7.2.3 >From 462d869e0a7f563eab4129241fb5884480e6da2d Mon Sep 17 00:00:00 2001 From: Matthieu Verbert <matthieu.verbert(a)aitb.org> Date: Sat, 6 Nov 2010 21:11:33 +0100 Subject: [PATCH 2/2] Register 'driver' on library load Add new function ConnectionDelegate_register to add a new 'driver' dynamically. It is auto-loaded, so no need to modify any user. Oracle is not compile-tested, but the conversion is trivial. --- src/db/Connection.c | 65 +++++++++++++++-------------- src/db/ConnectionDelegate.h | 2 + src/db/mysql/MysqlConnection.c | 6 ++- src/db/oracle/OracleConnection.c | 6 ++- src/db/postgresql/PostgresqlConnection.c | 6 ++- src/db/sqlite/SQLiteConnection.c | 6 ++- 6 files changed, 56 insertions(+), 35 deletions(-) diff --git a/src/db/Connection.c b/src/db/Connection.c index cc27cf4..dcfd1e7 100644 --- a/src/db/Connection.c +++ b/src/db/Connection.c @@ -18,7 +18,9 @@ #include <stdio.h> #include <stdarg.h> +#include <dlfcn.h> +#include "StringBuffer.h" #include "URL.h" #include "Vector.h" #include "ResultSet.h" @@ -38,34 +40,11 @@ /* ----------------------------------------------------------- Definitions */ -#ifdef HAVE_LIBMYSQLCLIENT -extern const struct Cop_T mysqlcops; -#endif -#ifdef HAVE_LIBPQ -extern const struct Cop_T postgresqlcops; -#endif -#ifdef HAVE_LIBSQLITE3 -extern const struct Cop_T sqlite3cops; -#endif -#ifdef HAVE_ORACLE -extern const struct Cop_T oraclesqlcops; -#endif +static Vector_T cops; -static const struct Cop_T *cops[] = { -#ifdef HAVE_LIBMYSQLCLIENT - &mysqlcops, -#endif -#ifdef HAVE_LIBPQ - &postgresqlcops, -#endif -#ifdef HAVE_LIBSQLITE3 - &sqlite3cops, -#endif -#ifdef HAVE_ORACLE - &oraclesqlcops, -#endif - NULL -}; +static void __attribute__ ((constructor (200))) init_cops() { + cops = Vector_new(1); +} #define T Connection_T struct T { @@ -87,10 +66,28 @@ struct T { static Cop_T getOp(const char *protocol) { - for (int i = 0; cops[i]; i++) - if (Str_startsWith(protocol, cops[i]->name)) - return (Cop_T)cops[i]; - return NULL; + int e = 0; + do { + for (int i = 0; i < Vector_size(cops); i++) { + Cop_T op = (Cop_T) Vector_get(cops, i); + if (Str_startsWith(protocol, op->name)) + return op; + } + if (e > 0) + break; + { + StringBuffer_T fn = StringBuffer_new("libzdb-"); + StringBuffer_append(fn, protocol); + StringBuffer_append(fn, ".so"); + void * lib = dlopen(StringBuffer_toString(fn), RTLD_LAZY); + StringBuffer_free(&fn); + if (lib) + e++; + else + break; + } + } while (true); + return NULL; } @@ -343,3 +340,9 @@ int Connection_isSupported(const char *url) { return (url ? (getOp(url) != NULL) : false); } + + +void ConnectionDelegate_register(Cop_T op) { + Vector_push(cops, op); +} + diff --git a/src/db/ConnectionDelegate.h b/src/db/ConnectionDelegate.h index 88c959c..8ff485e 100644 --- a/src/db/ConnectionDelegate.h +++ b/src/db/ConnectionDelegate.h @@ -46,5 +46,7 @@ typedef struct Cop_T { const char *(*getLastError)(T C); } *Cop_T; +void ConnectionDelegate_register(Cop_T op); + #undef T #endif diff --git a/src/db/mysql/MysqlConnection.c b/src/db/mysql/MysqlConnection.c index 0f0e848..3159132 100644 --- a/src/db/mysql/MysqlConnection.c +++ b/src/db/mysql/MysqlConnection.c @@ -45,7 +45,7 @@ #define MYSQL_OK 0 -const struct Cop_T mysqlcops = { +static const struct Cop_T mysqlcops = { "mysql", MysqlConnection_new, MysqlConnection_free, @@ -63,6 +63,10 @@ const struct Cop_T mysqlcops = { MysqlConnection_getLastError }; +static void __attribute__ ((constructor (300))) register_mysql() { + ConnectionDelegate_register(&mysqlcops); +} + #define T ConnectionDelegate_T struct T { URL_T url; diff --git a/src/db/oracle/OracleConnection.c b/src/db/oracle/OracleConnection.c index 4d210ff..2267499 100644 --- a/src/db/oracle/OracleConnection.c +++ b/src/db/oracle/OracleConnection.c @@ -44,7 +44,7 @@ /* ----------------------------------------------------------- Definitions */ -const struct Cop_T oraclesqlcops = { +static const struct Cop_T oraclesqlcops = { "oracle", OracleConnection_new, OracleConnection_free, @@ -62,6 +62,10 @@ const struct Cop_T oraclesqlcops = { OracleConnection_getLastError }; +static void __attribute__ ((constructor (300))) register_oracle() { + ConnectionDelegate_register(&oraclesqlcops); +} + #define ERB_SIZE 152 #define ORACLE_TRANSACTION_PERIOD 10 diff --git a/src/db/postgresql/PostgresqlConnection.c b/src/db/postgresql/PostgresqlConnection.c index e477c73..0bdd854 100644 --- a/src/db/postgresql/PostgresqlConnection.c +++ b/src/db/postgresql/PostgresqlConnection.c @@ -41,7 +41,7 @@ /* ----------------------------------------------------------- Definitions */ -const struct Cop_T postgresqlcops = { +static const struct Cop_T postgresqlcops = { "postgresql", PostgresqlConnection_new, PostgresqlConnection_free, @@ -59,6 +59,10 @@ const struct Cop_T postgresqlcops = { PostgresqlConnection_getLastError }; +static void __attribute__ ((constructor (300))) register_postgresql() { + ConnectionDelegate_register(&postgresqlcops); +} + #define T ConnectionDelegate_T struct T { URL_T url; diff --git a/src/db/sqlite/SQLiteConnection.c b/src/db/sqlite/SQLiteConnection.c index ab102ae..175bb9b 100644 --- a/src/db/sqlite/SQLiteConnection.c +++ b/src/db/sqlite/SQLiteConnection.c @@ -39,7 +39,7 @@ /* ----------------------------------------------------------- Definitions */ -const struct Cop_T sqlite3cops = { +static const struct Cop_T sqlite3cops = { "sqlite", SQLiteConnection_new, SQLiteConnection_free, @@ -57,6 +57,10 @@ const struct Cop_T sqlite3cops = { SQLiteConnection_getLastError }; +static void __attribute__ ((constructor (300))) register_sqlite() { + ConnectionDelegate_register(&sqlite3cops); +} + #define T ConnectionDelegate_T struct T { URL_T url; -- 1.7.2.3

2 2

[Announce] libzdb 2.7
by Jan-Henrik Haukeland 14 Oct '10

14 Oct '10

"Good news, everyone!" Version 2.7 of Zild Database Library is available: Download: http://www.tildeslash.com/libzdb/dist/libzdb-2.7.tar.gz MD5 checksum: 8c7241e482c88076739df96dc578143d Change log: http://www.tildeslash.com/libzdb/dist/CHANGES.txt This is a feature and bug fix release which has been tested on the following platforms: * Linux 2.6 (x86 and x64) * Mac OS X Snow Leopard (Darwin 10.6.x i386/x86_64) * Mac OS X Leopard (Darwin 10.5.x ppc) * FreeBSD 6.x, 7.x and 8.x (x86 and x64) * Solaris 10 and Solaris Express (sparc and x86) * OpenBSD 4.x (x86 and x64) Release notes: -------------- This release brings tentative Oracle support to libzdb thanks to Volodymyr Tarasenko. If you already have Oracle installed on your system, then simply running configure should pick it up. Otherwise if you want to build libzdb with Oracle support, but don't have Oracle installed (like me) it is a bit more work. Here's what I did; download Instant Client (basic and sdk) from http://www.oracle.com/ Create a oci directory someplace and copy header files and libs into this directory. Then use this configure statement; ./configure --with-oci-include=/<path>/oci/include --with-oci-lib=/<path>/oci/lib The Oracle implementation is not quite yet production ready which emerge from the change log below, though for most practical purposes it should work - according to Volodymyr. If you want to help out testing and improving it, please do. The SQLite implementation has been further improved by adding a configure option to make SQLite release unused memory. This is very useful as SQLite does not care so much about releasing memory and its memory usage can grow considerably if left unchecked. Changes in this release: ------------------------ * Added tentative support for Oracle. Thanks to Volodymyr Tarasenko, and Sergey Pavlov for implementing this. This implementation does not support BLOB, though CLOB is supported. It will also not run all zdb unit tests, but should be useful for most purposes. It is released with the hope that others may still find it useful and help iron out any remaining issues. * Added new convenience zdb.h meta include file which can be used to include all required API interfaces * Internal optimizing changes and improvements - we simply adore refactoring * SQLite: Clear connection on rollback to prevent SQLite from issue an SQLITE_BUSY error if there are pending selects in progress. * SQLite: added a "heap_limit" URL property. Makes SQLite auto-release unused memory if memory usage goes above the specified limit [KB]. Require that SQLite is compiled with the SQLITE_ENABLE_MEMORY_MANAGEMENT option to take effect. Bug fixes: * SQLite: Ensure that the database file is specified in connection URL. Thanks to Bogdan Nicula. * PostgreSQL: Implemented Connection_setQueryTimeout()

3 4

Re: Configure/compile issues on Solaris SPARC
by Lou Picciano 11 Aug '10

11 Aug '10

Martin, Thanks for your response. the reason why postgresql library was not found by ldd on your system is, that the loader path is not set to it. You need to fix the loader path either using solaris' "crle" utility or setting LD_LIBRARY_PATH env. variable. We are well aware of the crle tool. It does offer some powerful utility for environment-wide runtime linking; but this is definitely not what we want to do. The preferred approach is to link the correct libraries - often different versions for different purposes - against specific binaries. We could fiddle with the runtime environment of each binary in any number of ways, but this is just 'bad practice'; to create one-off solutions to the runtime environment for each executable. This is a management nightmare! Regarding mysql version - the error is reported because mysql.h file contains invalid version. (I don't think it does, if your test is >= 4.1): # grep MYSQL_VERSION_ID /usr/local/mysql/include/mysql/mysql.h #if defined(EMBEDDED_LIBRARY) || defined(EMBEDDED_LIBRARY_COMPATIBLE) || MYSQL_VERSION_ID >= 50100 1.) attach config.log so we can check it 2.) provide output of "grep MYSQL_VERSION_ID /path/to/your/mysql.h" I just ran the whole process against against a freshly-downloaded source tree to provide you an empirical test. (FWIW, an # configure distclean left our previous source tree in an unconfigure-able state). I even added the LD_LIBRARY_PATH variable, in case you're testing for it in config. (Didn't see any evidence you were). ./configure \ CPPFLAGS='-I/usr/local/postgres/9b4/include/' \ LDFLAGS='-L/usr/local/postgres/9b4/lib/' \ LD_LIBRARY_PATH='/usr/local/postgres/9b4/lib/' \ PGCONFIG='/usr/local/postgres/9b4/bin/pg_config' \ --enable-optimized \ --enable-protected \ --enable-openssl=/usr/local/ssl \ --enable-sqliteunlock \ --with-mysql=/usr/local/mysql/bin/mysql_config \ --with-postgresql=/usr/local/postgres/9b4/bin/pg_config \ --with-sqlite=/usr/local Here's the result of configure: +------------------------------------------------------------+ | The Zild Database Library is configured as follows: | | | | Optimized: ENABLED | | Protected: ENABLED | | Profiling: DISABLED | | Zild: DISABLED | | Sqlite3 unlock notification API: ENABLED | | Unit Tests Build: DISABLED | | Openssl: ENABLED | |------------------------------------------------------------| | SQLite3: ENABLED | | MySQL: DISABLED | | PostgreSQL: ENABLED | +------------------------------------------------------------+ Here is the output of ldd: # ldd /usr/local/lib/libzdb.so libpq.so.5 => (file not found) libsqlite3.so.0 => /usr/local/lib/libsqlite3.so.0 (...etc) (this build does not link at all to any mysql client... As I've mentioned, I've been able to get a mysqlclient linked in by modifying the configure script) And the config.log is attached. Thanks for your ideas. Lou ----- Original Message ----- From: "Martin Pala" <martinp(a)tildeslash.com> To: "This is the libzdb general mailing list" <libzdb-general(a)tildeslash.com> Sent: Wednesday, August 11, 2010 3:28:44 PM Subject: Re: Configure/compile issues on Solaris SPARC Lou, the reason why postgresql library was not found by ldd on your system is, that the loader path is not set to it. You need to fix the loader path either using solaris' "crle" utility or setting LD_LIBRARY_PATH env. variable. Regarding mysql version - the error is reported because mysql.h file contains invalid version. Please: 1.) attach config.log so we can check it 2.) provide output of "grep MYSQL_VERSION_ID /path/to/your/mysql.h" On Aug 11, 2010, at 9:18 PM, Lou Picciano wrote: Paul, > let me guess. There is an older mysql.h somewhere other than /usr/local/mysql/include/ Indeed there is. In fact, there may be a few, as would be normal on these systems; different versions of not only MySQL, but of any number of tools, used in different ways for different objectives, or to test different variables. This is very common in our testing of multiple versions of OpenSSL, for example, and works flawlessly... But what's relevant in this case, I should think, is that the specific version of MySQL to which we point, using configure, --with-mysql=/usr/local/mysql/bin/mysql_config \ ...is indeed >= 4.1, as indicated by this note: # /usr/local/mysql/bin/mysql_config --version 5.0.51 In further testing, we were able to achieve the MySQL integration by 'manhandling' the configure script - shouldn't have to do this! - but cannot get the correct version of PostgreSQL recognized: # ldd /usr/local/lib/libzdb.so libpq.so.4 => /usr/lib/libpq.so.4 -- OR, Depending on configuration: ---- libpq.so.5 => (file not found) libsqlite3.so.0 => /usr/local/lib/libsqlite3.so.0 libmysqlclient.so.15 => /usr/local/mysql/lib/mysql/libmysqlclient.so.15 even though we're pointing to an instance of PostgreSQL in an entirely different location. --with-postgresql=/usr/local/postgres/9b4/bin/pg_config Are you maintaining the libzdb package, too? What do you think the answer is? Lou ----- Original Message ----- From: "Paul J Stevens" < paul(a)nfg.nl > To: "This is the libzdb general mailing list" < libzdb-general(a)tildeslash.com > Sent: Wednesday, August 11, 2010 2:26:39 PM Subject: Re: Configure/compile issues on Solaris SPARC Me again :-) Lou, let me guess. There is an older mysql.h somewhere other than /usr/local/mysql/include/ On 08/11/2010 06:57 PM, Lou Picciano wrote: > > # nm /usr/local/mysql/lib/mysql/libmysqlclient.so | grep mysql_init > 000300f0 T mysql_init > > ) > > Some pertinent output from configure: > > ... -- ________________________________________________________________ Paul Stevens paul at nfg.nl NET FACILITIES GROUP GPG/PGP: 1024D/11F8CD31 The Netherlands________________________________http://www.nfg.nl -- To unsubscribe: http://www.tildeslash.com/mailman/listinfo/libzdb-general -- To unsubscribe: http://www.tildeslash.com/mailman/listinfo/libzdb-general -- To unsubscribe: http://www.tildeslash.com/mailman/listinfo/libzdb-general

2 1

Re: Configure/compile issues on Solaris SPARC
by Lou Picciano 11 Aug '10

11 Aug '10

Paul, > let me guess. There is an older mysql.h somewhere other than /usr/local/mysql/include/ Indeed there is. In fact, there may be a few, as would be normal on these systems; different versions of not only MySQL, but of any number of tools, used in different ways for different objectives, or to test different variables. This is very common in our testing of multiple versions of OpenSSL, for example, and works flawlessly... But what's relevant in this case, I should think, is that the specific version of MySQL to which we point, using configure, --with-mysql=/usr/local/mysql/bin/mysql_config \ ...is indeed >= 4.1, as indicated by this note: # /usr/local/mysql/bin/mysql_config --version 5.0.51 In further testing, we were able to achieve the MySQL integration by 'manhandling' the configure script - shouldn't have to do this! - but cannot get the correct version of PostgreSQL recognized: # ldd /usr/local/lib/libzdb.so libpq.so.4 => /usr/lib/libpq.so.4 -- OR, Depending on configuration: ---- libpq.so.5 => (file not found) libsqlite3.so.0 => /usr/local/lib/libsqlite3.so.0 libmysqlclient.so.15 => /usr/local/mysql/lib/mysql/libmysqlclient.so.15 even though we're pointing to an instance of PostgreSQL in an entirely different location. --with-postgresql=/usr/local/postgres/9b4/bin/pg_config Are you maintaining the libzdb package, too? What do you think the answer is? Lou ----- Original Message ----- From: "Paul J Stevens" <paul(a)nfg.nl> To: "This is the libzdb general mailing list" <libzdb-general(a)tildeslash.com> Sent: Wednesday, August 11, 2010 2:26:39 PM Subject: Re: Configure/compile issues on Solaris SPARC Me again :-) Lou, let me guess. There is an older mysql.h somewhere other than /usr/local/mysql/include/ On 08/11/2010 06:57 PM, Lou Picciano wrote: > > # nm /usr/local/mysql/lib/mysql/libmysqlclient.so | grep mysql_init > 000300f0 T mysql_init > > ) > > Some pertinent output from configure: > > ... -- ________________________________________________________________ Paul Stevens paul at nfg.nl NET FACILITIES GROUP GPG/PGP: 1024D/11F8CD31 The Netherlands________________________________http://www.nfg.nl -- To unsubscribe: http://www.tildeslash.com/mailman/listinfo/libzdb-general

2 1

Configure/compile issues on Solaris SPARC
by Lou Picciano 11 Aug '10

11 Aug '10

Hello Listers! A question about building libzdb - against latest betas of PostgreSQL and MySQL... FWIW, PostgreSQL is by far our focus at the moment. We have been specifying the pg_config location with the --with-postgresql option. configure does find pg_config # ./configure \ LDFLAGS='-L/usr/local/postgres/9b4/lib/' \ --enable-optimized \ --enable-protected \ --enable-openssl=/usr/local/ssl \ --enable-sqliteunlock \ --with-mysql=/usr/local/mysql/bin/mysql_config \ --with-postgresql=/usr/local/postgres/9b4/bin/pg_config \ --with-sqlite=/usr/local (note: # /usr/local/postgres/9b4/bin/pg_config --version PostgreSQL 9.0beta4 # /usr/local/mysql/bin/mysql_config --version 5.0.51 # nm /usr/local/mysql/lib/mysql/libmysqlclient.so | grep mysql_init 000300f0 T mysql_init ) Some pertinent output from configure: ... checking for /usr/local/mysql/bin/mysql_config... yes checking mysql.h usability... yes checking mysql.h presence... yes checking for mysql.h... yes checking for mysql_init in -lmysqlclient... yes fail, >= 4.1 required checking for postgresql... yes checking for /usr/local/postgres/9b4/bin/pg_config... yes checking libpq-fe.h usability... yes checking libpq-fe.h presence... yes checking for libpq-fe.h... yes ... +------------------------------------------------------------+ | License: | | This is Open Source Software and use is subject to the GNU | | GENERAL PUBLIC LICENSE, available in this distribution in | | the file COPYING. | | | | By continuing this installation process, you are bound by | | the terms of this license agreement. If you do not agree | | with the terms of this license, you must abort the | | installation process at this point. | +------------------------------------------------------------+ | The Zild Database Library is configured as follows: | | | | Optimized: ENABLED | | Protected: ENABLED | | Profiling: DISABLED | | Zild: DISABLED | | Sqlite3 unlock notification API: ENABLED | | Unit Tests Build: DISABLED | | Openssl: ENABLED | |------------------------------------------------------------| | SQLite3: ENABLED | | MySQL: DISABLED | | PostgreSQL: ENABLED | +------------------------------------------------------------+ Platform is sun4u - Solaris SPARC E450 Any Ideas? We're off to try fiddling with the configure script... thanks! Lou

2 1

libzdb compilation with G++ compiler
by neo reeves 02 Dec '09

02 Dec '09

Hi All, I would like to link the zdb library with the existing CPP source code. So when I tried to compile the zdb library code with GNU cpp compiler, its not able to compile. Can anybody please let me know how to link or compile the zdb library with the CPP source code. Thanks in advance,- Neo The INTERNET now has a personality. YOURS! See your Yahoo! Homepage. http://in.yahoo.com/

1 0

[Announce] libzdb 2.6
by Jan-Henrik Haukeland 03 Jul '09

03 Jul '09

Version 2.6 of Zild Database Library is available: Download: http://www.tildeslash.com/libzdb/dist/libzdb-2.6.tar.gz MD5 checksum: 54eef941f130768d2d0a311873550e25 libzdb-2.6.tar.gz Change log: http://www.tildeslash.com/libzdb/dist/CHANGES.txt This is a feature and bug fix release which has been tested on the following platforms: * Linux 2.6 (x86 and x64) * Mac OS X Leopard (Darwin 10.5.x x86/ppc) * FreeBSD 6.x and 7.x (x86 and x64) * Solaris 10 and Solaris Express (sparc/x86) * OpenBSD 4.x (x64) Release notes: -------------- 1) This release greatly improves upon SQLite concurrency. We have tested libzdb with SQLite using up to 300 concurrent threads without experiencing lock problems. To achieve this, we use the experimental SQLite unlock notification API. To enable this API you need to first build and configure SQLite (version > 3.6.12) with the SQLITE_ENABLE_UNLOCK_NOTIFY preprocessor symbol like so: CFLAGS="$CFLAGS -DSQLITE_ENABLE_UNLOCK_NOTIFY" ./configure ... Then you need to enable this API in libzdb using the --enable- sqliteunlock configure switch when configuring and building libzdb. 2) For those using libzdb with the excellent DBMail (http://www.dbmail.org/ ) project it is strongly recommended to upgrade. This version of libzdb is tested by the DBMail project and should work with the latest DBMail release. Changes in this release: ------------------------ * Internal optimizing changes and improvements * Enable shared cache mode for SQLite >= 3.5 * Added new configure option --enable-sqliteunlock which enables SQLite unlock notification. This feature requires SQLite >= 3.6.12 compiled with the SQLITE_ENABLE_UNLOCK_NOTIFY C-preprocessor symbol. This option greately improves upon SQLite concurrency when libzdb and SQLite is used from a multi-threaded program. * Removed deprecated ResultSet_readData() from API Bug fixes: * PostgreSQL: Unescape values retrieved via ResultSet_getBlob() and via ResultSet_getBlobByName(). By an incurie, unescape was left out of libzdb version 2.5.

1 0

error in the configure script
by Gustavo Baratto 15 Apr '09

15 Apr '09

Hello there... I got this error in the configure script on 2.5: # ./configure --prefix=/opt/libzdb-2.5 --with-mysql=/opt/mysql/bin/mysql_config --without-postgresql --without-sqlite --enable-protected --enable-optimized checking for a BSD-compatible install... /usr/bin/ginstall -c checking whether build environment is sane... yes checking for a thread-safe mkdir -p... config/install-sh -c -d checking for gawk... gawk checking whether make sets $(MAKE)... yes checking for gcc... gcc checking for C compiler default output file name... a.out checking whether the C compiler works... yes checking whether we are cross compiling... no checking for suffix of executables... checking for suffix of object files... o checking whether we are using the GNU C compiler... yes checking whether gcc accepts -g... yes checking for gcc option to accept ISO C89... none needed checking for style of include used by make... GNU checking dependency style of gcc... none checking how to run the C preprocessor... gcc -E checking for grep that handles long lines and -e... /usr/bin/ggrep checking for egrep... /usr/bin/ggrep -E checking whether gcc needs -traditional... no checking for re2c... no checking for flex... /usr/bin/flex checking build system type... i386-pc-solaris2.11 checking host system type... i386-pc-solaris2.11 checking for a sed that does not truncate output... /usr/bin/gsed checking for ld used by gcc... /usr/ccs/bin/ld checking if the linker (/usr/ccs/bin/ld) is GNU ld... no checking for /usr/ccs/bin/ld option to reload object files... -r checking for BSD-compatible nm... /usr/bin/nm -p checking whether ln -s works... yes checking how to recognize dependent libraries... pass_all checking for ANSI C header files... yes checking for sys/types.h... yes checking for sys/stat.h... yes checking for stdlib.h... yes checking for string.h... yes checking for memory.h... yes checking for strings.h... yes checking for inttypes.h... yes checking for stdint.h... yes checking for unistd.h... yes checking dlfcn.h usability... yes checking dlfcn.h presence... yes checking for dlfcn.h... yes checking for g++... g++ checking whether we are using the GNU C++ compiler... yes checking whether g++ accepts -g... yes checking dependency style of g++... none checking how to run the C++ preprocessor... g++ -E checking for g77... g77 checking whether we are using the GNU Fortran 77 compiler... yes checking whether g77 accepts -g... yes checking the maximum length of command line arguments... 786240 checking command to parse /usr/bin/nm -p output from gcc object... ok checking for objdir... .libs checking for ar... ar checking for ranlib... ranlib checking for strip... strip checking if gcc supports -fno-rtti -fno-exceptions... no checking for gcc option to produce PIC... -fPIC checking if gcc PIC flag -fPIC works... yes checking if gcc static flag -static works... no checking if gcc supports -c -o file.o... yes checking whether the gcc linker (/usr/ccs/bin/ld) supports shared libraries... yes checking whether -lc should be explicitly linked in... yes checking dynamic linker characteristics... solaris2.11 ld.so checking how to hardcode library paths into programs... immediate checking whether stripping libraries is possible... no checking if libtool supports shared libraries... yes checking whether to build shared libraries... yes checking whether to build static libraries... yes configure: creating libtool appending configuration tag "CXX" to libtool checking for ld used by g++... /usr/ccs/bin/ld checking if the linker (/usr/ccs/bin/ld) is GNU ld... no checking whether the g++ linker (/usr/ccs/bin/ld) supports shared libraries... yes checking for g++ option to produce PIC... -fPIC checking if g++ PIC flag -fPIC works... yes checking if g++ static flag -static works... no checking if g++ supports -c -o file.o... yes checking whether the g++ linker (/usr/ccs/bin/ld) supports shared libraries... yes checking dynamic linker characteristics... solaris2.11 ld.so checking how to hardcode library paths into programs... immediate appending configuration tag "F77" to libtool checking if libtool supports shared libraries... yes checking whether to build shared libraries... yes checking whether to build static libraries... yes checking for g77 option to produce PIC... -fPIC checking if g77 PIC flag -fPIC works... yes checking if g77 static flag -static works... no checking if g77 supports -c -o file.o... yes checking whether the g77 linker (/usr/ccs/bin/ld) supports shared libraries... yes checking dynamic linker characteristics... solaris2.11 ld.so checking how to hardcode library paths into programs... immediate checking for pthread_create in -lpthread... yes checking for library containing crypt... none required checking for mysql... yes checking for /opt/mysql/bin/mysql_config... yes checking mysql.h usability... yes checking mysql.h presence... yes checking for mysql.h... yes checking for mysql_init in -lmysqlclient... yes fail, >= 4.1 required checking for postgresql... no checking for SQLite3... no configure: error: No available database found or selected. Try configure --help I created this patch, and now I don't get the error anymore: # diff -bu configure configure.new --- configure Tue Apr 14 21:59:50 2009 +++ configure.new Tue Apr 14 21:59:22 2009 @@ -20331,7 +20331,7 @@ sed 's/^/| /' conftest.$ac_ext >&5 ( exit $ac_status ) -mysql="no" +mysql="yes" fi rm -f core *.core core.conftest.* gmon.out bb.out conftest$ac_exeext conftest.$ac_objext conftest.$ac_ext fi -- g.

2 2

[Announce] libzdb 2.5
by Jan-Henrik Haukeland 05 Apr '09

05 Apr '09

Version 2.5 of Zild Database Library is available: Download: http://www.tildeslash.com/libzdb/dist/libzdb-2.5.tar.gz MD5 checksum: cf9406ce6505e6265a07ada4990b6526 libzdb-2.5.tar.gz Change log: http://www.tildeslash.com/libzdb/dist/CHANGES.txt This is a minor feature and bug fix release which has been tested on the following platforms: Darwin 9.6.0 [x86] Linux FC/U [x86/x64] FreeBSD 6/7 [x86/x64] Changes in this release: * PostgreSQL: Blob retrieval optimized * PostgreSQL: Added unix-socket parameter to connection URL * Removed GPL license exceptions. The library is now licensed under the GPL version 3 only. * Deprecated ResultSet_readData(). This function _is_ useful for MySQL, but not for other drivers where it has some overhead. * Added GCC __attribute__ printf checks where applicable * Internal optimizing changes and improvements We expect this release to be stable for some time. Just a FYI if you plan to package this release.

1 1

← Newer
1
...
9
10
11
12
13
14
15
16
Older →

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

libzdb-general