Librdkafka does not compile on OSX 10.7.5

[drdee]

Hey Magnus,

I am trying to compile Librdkafka on OSX with the following platform env:

Apple LLVM version 4.2 (clang-425.0.28) (based on LLVM 3.2svn)
Target: x86_64-apple-darwin11.4.2
Thread model: posix

A couple of issues showed up:

1. the -rdynamic switch is not supported on OSX
2. byteswap.h is not available on OSX, that can be fixed using the following:

if defined(APPLE)

include <libkern/OSByteOrder.h>

define le32toh OSSwapLittleToHostInt32

define htole32 OSSwapHostToLittleInt32

define bswap_32 OSSwapInt32

else

#include <byteswap.h>

endif

3. The TIMEVAL_TO_TIMESPEC from rdtime.h can be removed
4. OSX has an incompatible sys queue.h
5. replace strndupa with strndup

Best,
D

[edenhill]

Refresh your master and give it a go to verify.
Reopen if still an issue.

Thanks

[mumrah]

After a clean checkout, I'm getting a different error on 10.7.5

$ make all
cc -MD -MP -O2 -Wall -Werror -Wfloat-equal -Wpointer-arith -fPIC -I. -g -DSG -c rdkafka.c
In file included from rdkafka.c:37:
rdkafka_int.h: In function ‘rd_kafka_toppar_name’:
rdkafka_int.h:548: error: thread-local storage not supported for this target
In file included from rdkafka.c:42:
rdtime.h: In function ‘rd_ctime’:
rdtime.h:81: error: thread-local storage not supported for this target
rdkafka.c: In function ‘rd_kafka_err2str’:
rdkafka.c:432: error: thread-local storage not supported for this target
make: *** [rdkafka.o] Error 1

$ cc -v
Using built-in specs.
Target: i686-apple-darwin11
Configured with: /private/var/tmp/llvmgcc42/llvmgcc42-2336.1~22/src/configure --disable-checking --enable-werror --prefix=/Developer/usr/llvm-gcc-4.2 --mandir=/share/man --enable-languages=c,objc,c++,obj-c++ --program-prefix=llvm- --program-transform-name=/^[cg][^.-]*$/s/$/-4.2/ --with-slibdir=/usr/lib --build=i686-apple-darwin11 --enable-llvm=/private/var/tmp/llvmgcc42/llvmgcc42-2336.1~22/dst-llvmCore/Developer/usr/local --program-prefix=i686-apple-darwin11- --host=x86_64-apple-darwin11 --target=i686-apple-darwin11 --with-gxx-include-dir=/usr/include/c++/4.2.1
Thread model: posix
gcc version 4.2.1 (Based on Apple Inc. build 5658) (LLVM build 2336.1.00)

Any ideas?

[edenhill]

According to this link you need to upgrade to gcc 4.6:
http://www.ultimatepp.org/forum/index.php?t=msg&goto=33977&

[mumrah]

@edenhill thanks, that got me somewhere. Now I'm seeing:

$ CC=x86_64-apple-darwin11-gcc-4.8.2 make all
x86_64-apple-darwin11-gcc-4.8.2 -MD -MP -O2 -Wall -Werror -Wfloat-equal -Wpointer-arith -fPIC -I. -g -DSG -c rdkafka.c
x86_64-apple-darwin11-gcc-4.8.2 -MD -MP -O2 -Wall -Werror -Wfloat-equal -Wpointer-arith -fPIC -I. -g -DSG -c rdkafka_broker.c
x86_64-apple-darwin11-gcc-4.8.2 -MD -MP -O2 -Wall -Werror -Wfloat-equal -Wpointer-arith -fPIC -I. -g -DSG -c rdkafka_msg.c
x86_64-apple-darwin11-gcc-4.8.2 -MD -MP -O2 -Wall -Werror -Wfloat-equal -Wpointer-arith -fPIC -I. -g -DSG -c rdkafka_topic.c
x86_64-apple-darwin11-gcc-4.8.2 -MD -MP -O2 -Wall -Werror -Wfloat-equal -Wpointer-arith -fPIC -I. -g -DSG -c rdkafka_defaultconf.c
x86_64-apple-darwin11-gcc-4.8.2 -MD -MP -O2 -Wall -Werror -Wfloat-equal -Wpointer-arith -fPIC -I. -g -DSG -c rdcrc32.c
x86_64-apple-darwin11-gcc-4.8.2 -MD -MP -O2 -Wall -Werror -Wfloat-equal -Wpointer-arith -fPIC -I. -g -DSG -c rdgz.c
x86_64-apple-darwin11-gcc-4.8.2 -MD -MP -O2 -Wall -Werror -Wfloat-equal -Wpointer-arith -fPIC -I. -g -DSG -c rdaddr.c
x86_64-apple-darwin11-gcc-4.8.2 -MD -MP -O2 -Wall -Werror -Wfloat-equal -Wpointer-arith -fPIC -I. -g -DSG -c rdrand.c
x86_64-apple-darwin11-gcc-4.8.2 -MD -MP -O2 -Wall -Werror -Wfloat-equal -Wpointer-arith -fPIC -I. -g -DSG -c rdthread.c
x86_64-apple-darwin11-gcc-4.8.2 -MD -MP -O2 -Wall -Werror -Wfloat-equal -Wpointer-arith -fPIC -I. -g -DSG -c rdqueue.c
x86_64-apple-darwin11-gcc-4.8.2 -MD -MP -O2 -Wall -Werror -Wfloat-equal -Wpointer-arith -fPIC -I. -g -DSG -c rdlog.c
In file included from /usr/include/stdio.h:499:0,
                 from rd.h:33,
                 from rdlog.c:33:
rdlog.c: In function 'rdputs0':
rdlog.c:100:5: error: cast from pointer to integer of different size [-Werror=pointer-to-int-cast]
     (int)pthread_self());
     ^
cc1: all warnings being treated as errors
make: *** [rdlog.o] Error 1

@mumrah is not a C guy, so you'll have to bear with me ;)

[edenhill]

Pushed a fix for this to master 5 minutes ago! (for cygwin) :)
Update and try again

[mumrah]

Heh, indeed it's working now. Thanks!