Solaris x86 build

[winbatch]

Struggling to build on the above platform. I've tried setting CC to the sun studio compiler. Any ideas?

./configure

sed: illegal option -- E

grep: illegal option -- E

Usage: grep -hblcnsviw pattern file . . .

using cache file config.cache

checking for C compiler from CC env... ok

checking for C++ compiler from CXX env... ok

checking executable ld... ok (cached)

checking executable nm... ok (cached)

checking executable objdump... ok (cached)

checking executable strip... ok (cached)

checking for pkgconfig (by command)... ok (cached)

checking for install (by command)... ok (cached)

checking for PIC (by compile)... ok (cached)

checking for GNU-compatible linker options... ok (cached)

checking for __atomic_32 (by compile)... failed

checking for __atomic_32_lib (by compile)... failed

checking for __sync_32 (by compile)... ok (cached)

checking for __atomic_64 (by compile)... failed

checking for __atomic_64_lib (by compile)... failed

checking for __sync_64 (by compile)... ok (cached)

parsing version ''... failed (fail)

checking for libpthread (by pkg-config)... failed

checking for libpthread (by compile)... failed (fail)

checking for zlib (by pkg-config)... failed

checking for zlib (by compile)... failed (fail)

checking for librt (by pkg-config)... failed

checking for librt (by compile)... failed

checking executable otool... failed

checking for nm (by env NM)... ok (cached)

Configure failed

Accumulated failures:

parseversion ()

module: parseversion

action: fail

reason:

Version string is empty

libpthread ()

module: librdkafka

action: fail

reason:

compile check failed:

CC: CC

flags: -lpthread

/usr/bin/cc -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -Wall -Werror -lpthread _mkltmpXXXX.c -o _mkltmpXXXX.c.o -g:

cc: -W option with unknown program all

source:

zlib ()

module: librdkafka

action: fail

reason:

compile check failed:

CC: CC

flags: -lz

/usr/bin/cc -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -Wall -Werror -lz _mkltmpXXXX.c -o _mkltmpXXXX.c.o -g:

cc: -W option with unknown program all

source:

[edenhill]

Can you check out the solaris-build branch and give it a go?
Remember to use gmake instead of make. (and do ./configure --clean first too if reusing source dir).
This was tested on SunOS 5.11 Solaris 11.1 x86

[winbatch]

Will absolutely check it out. thanks for working on it. Note that I'm on SunOS 5.10. Hoping that doesn't make a difference. A couple of questions about the build:

• is it expected to use gcc or cc (from sunstudio)
• I had previously run into problems with it not finding byteswap.h - did you manage to find one that works or did you handcraft your own for all the byte swapping stuff?
• I had managed to hack a build together with the master branch, however it seemed to have trouble communicating with the brokers. Just wanted to confirm that rdkafka_example worked ok on this new build? or was that related to the MSG_DONTWAIT change?

On Monday, May 5, 2014, Magnus Edenhill notifications@github.com wrote:

Can you check out the solaris-build branch and give it a go?
Remember to use gmake instead of make. (and do ./configure --clean first
too if reusing source dir).
This was tested on SunOS 5.11 Solaris 11.1 x86

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/110#issuecomment-42164808
.

[winbatch]

Magnus- build didn't work for me.

• doesn't recognize AF_LOCAL. I replaced it with AF_UNIX to get passed it.
• I had to remove -Wall and -Werror
• it can't find htonll or ntohll. It doesn't seem to be passing -Dsun. I added it but it didn't help

[winbatch]

I managed to write htonll and ntohll and things seem to be working

[edenhill]

Can you provide the full output of a 'gmake -k' with '-Wall' still set?
Cant believe there are so many differences between 5.10 and 5.11 ... grmbl.

I only tested this with gcc (but solaris linker).
byteswapping was solved, but it seems that your system is missing the 64-bit swappers for some reason.

[winbatch]

You want me to put back the other fixes I made?

On Monday, May 5, 2014, Magnus Edenhill notifications@github.com wrote:

Can you provide the full output of a 'gmake -k' with '-Wall' still set?
Cant believe there are so many differences between 5.10 and 5.11 ... grmbl.

I only tested this with gcc (but solaris linker).
byteswapping was solved, but it seems that your system is missing the
64-bit swappers for some reason.

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/110#issuecomment-42226850
.

[edenhill]

Yeah, as vanilla as possible, but please share your fixes too.

[winbatch]

configure

checking for OS or distribution... ok (SunOS)

checking for C compiler from CC env... failed

checking for gcc (by command)... ok

checking for C++ compiler from CXX env... failed

checking for C++ compiler (g++)... ok

checking executable ld... ok

checking executable nm... ok

checking executable objdump... failed (disable)

checking executable strip... ok

checking for pkgconfig (by command)... ok

checking for GNU install... failed (ignore)

checking for install (by command)... failed

checking for PIC (by compile)... ok

checking for GNU-compatible linker options... ok

checking for GNU linker-script ld flag... failed

checking for Solaris linker-script ld flag... ok

checking for __atomic_32 (by compile)... ok

checking for __atomic_64 (by compile)... ok

checking for socket (by compile)... failed

checking for socket_nsl (by compile)... ok

parsing version '0x00080300'... ok (0.8.3)

checking for libpthread (by pkg-config)... failed

checking for libpthread (by compile)... ok

checking for zlib (by pkg-config)... failed

checking for zlib (by compile)... ok

checking for librt (by pkg-config)... failed

checking for librt (by compile)... ok

checking executable otool... failed

checking for nm (by env NM)... ok (cached)

Generated rdkafka.pc

Generated Makefile.config

Generated config.h



Configuration summary:

  prefix                   /usr/local

  ARCH                     i86pc

  CPU                      generic

  MKL_DISTRO               SunOS

  CC                       gcc

  CXX                      g++

  LD                       ld

  NM                       nm

  STRIP                    strip

  CPPFLAGS                 -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -D_POSIX_PTHREAD_SEMANTICS

  PKG_CONFIG               pkg-config

  INSTALL                  install

  LIB_LDFLAGS              -shared -Wl,-soname,$(LIBNAME).so.$(LIBVER)

 LDFLAG_LINKERSCRIPT      -Wl,-M

  LDFLAGS                  -g

  LIBS                     -lsocket -lnsl -lpthread -lz -lrt

  RDKAFKA_VERSION_STR      0.8.3

  CXXFLAGS                 -Wno-non-virtual-dtor

  SYMDUMPER                $(NM) -D

  exec_prefix              /usr/local

  bindir                   /usr/local/bin

  sbindir                  /usr/local/sbin

  libexecdir               /usr/local/libexec

  datadir                  /usr/local/share

  sysconfdir               /usr/local/etc

  sharedstatedir           /usr/local/com

  localstatedir            /usr/local/var

  libdir                   /usr/local/lib

  includedir               /usr/local/include

  infodir                  /usr/local/info

  mandir                   /usr/local/man

Generated config.cache



Now type 'make' to build





cd src

bash-3.2$ gmake -k

gcc -MD -MP -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -D_POSIX_PTHREAD_SEMANTICS  -c rdkafka.c -o rdkafka.o

In file included from rdkafka_int.h:40:0,

                 from rdkafka.c:39:

rdaddr.h: In function 'rd_family2str':

rdaddr.h:167:8: error: 'AF_LOCAL' undeclared (first use in this function)

rdaddr.h:167:8: note: each undeclared identifier is reported only once for each function it appears in

gmake: *** [rdkafka.o] Error 1

gcc -MD -MP -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -D_POSIX_PTHREAD_SEMANTICS  -c rdkafka_broker.c -o rdkafka_broker.o

In file included from rdkafka_int.h:40:0,

                 from rdkafka_broker.c:41:

rdaddr.h: In function 'rd_family2str':

rdaddr.h:167:8: error: 'AF_LOCAL' undeclared (first use in this function)

rdaddr.h:167:8: note: each undeclared identifier is reported only once for each function it appears in

In file included from rdkafka_broker.c:47:0:

rdthread.h: In function 'rd_currthread_get':

rdthread.h:141:44: error: cast to pointer from integer of different size [-Werror=int-to-pointer-cast]

rdkafka_broker.c: In function 'rd_kafka_buf_write_i64':

rdkafka_broker.c:218:9: error: implicit declaration of function 'htonll' [-Werror=implicit-function-declaration]

rdkafka_broker.c: In function 'rd_kafka_broker_buf_enq1':

rdkafka_broker.c:597:31: error: assignment from incompatible pointer type [-Werror]

rdkafka_broker.c:601:31: error: assignment from incompatible pointer type [-Werror]

rdkafka_broker.c: In function 'rd_kafka_recv':

rdkafka_broker.c:1364:32: error: assignment from incompatible pointer type [-Werror]

rdkafka_broker.c: In function 'rd_kafka_broker_produce_toppar':

rdkafka_broker.c:2118:18: error: pointer targets in assignment differ in signedness [-Werror=pointer-sign]

rdkafka_broker.c:2128:18: error: pointer targets in assignment differ in signedness [-Werror=pointer-sign]

rdkafka_broker.c:2244:13: error: pointer targets in passing argument 2 of 'rd_crc32_update' differ in signedness [-Werror=pointer-sign]

In file included from rdkafka_broker.c:48:0:

rdcrc32.h:75:12: note: expected 'const unsigned char *' but argument is of type 'caddr_t'

rdkafka_broker.c: In function 'rd_kafka_messageset_handle':

rdkafka_broker.c:2647:3: error: implicit declaration of function 'ntohll' [-Werror=implicit-function-declaration]

cc1: all warnings being treated as errors

gmake: *** [rdkafka_broker.o] Error 1

gcc -MD -MP -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -D_POSIX_PTHREAD_SEMANTICS  -c rdkafka_msg.c -o rdkafka_msg.o

In file included from rdkafka_int.h:40:0,

                 from rdkafka_msg.c:30:

rdaddr.h: In function 'rd_family2str':

rdaddr.h:167:8: error: 'AF_LOCAL' undeclared (first use in this function)

rdaddr.h:167:8: note: each undeclared identifier is reported only once for each function it appears in

gmake: *** [rdkafka_msg.o] Error 1

gcc -MD -MP -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -D_POSIX_PTHREAD_SEMANTICS  -c rdkafka_topic.c -o rdkafka_topic.o

In file included from rdkafka_int.h:40:0,

                 from rdkafka_topic.c:30:

rdaddr.h: In function 'rd_family2str':

rdaddr.h:167:8: error: 'AF_LOCAL' undeclared (first use in this function)

rdaddr.h:167:8: note: each undeclared identifier is reported only once for each function it appears in

gmake: *** [rdkafka_topic.o] Error 1

gcc -MD -MP -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -D_POSIX_PTHREAD_SEMANTICS  -c rdkafka_defaultconf.c -o rdkafka_defaultconf.o

In file included from rdkafka_int.h:40:0,

                 from rdkafka_defaultconf.c:35:

rdaddr.h: In function 'rd_family2str':

rdaddr.h:167:8: error: 'AF_LOCAL' undeclared (first use in this function)

rdaddr.h:167:8: note: each undeclared identifier is reported only once for each function it appears in

gmake: *** [rdkafka_defaultconf.o] Error 1

gcc -MD -MP -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -D_POSIX_PTHREAD_SEMANTICS  -c rdkafka_timer.c -o rdkafka_timer.o

In file included from rdkafka_int.h:40:0,

                 from rdkafka_timer.c:29:

rdaddr.h: In function 'rd_family2str':

rdaddr.h:167:8: error: 'AF_LOCAL' undeclared (first use in this function)

rdaddr.h:167:8: note: each undeclared identifier is reported only once for each function it appears in

gmake: *** [rdkafka_timer.o] Error 1

gcc -MD -MP -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -D_POSIX_PTHREAD_SEMANTICS  -c rdkafka_offset.c -o rdkafka_offset.o

In file included from rdkafka_int.h:40:0,

                 from rdkafka_offset.c:55:

rdaddr.h: In function 'rd_family2str':

rdaddr.h:167:8: error: 'AF_LOCAL' undeclared (first use in this function)

rdaddr.h:167:8: note: each undeclared identifier is reported only once for each function it appears in

gmake: *** [rdkafka_offset.o] Error 1

gcc -MD -MP -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -D_POSIX_PTHREAD_SEMANTICS  -c rdcrc32.c -o rdcrc32.o

gcc -MD -MP -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -D_POSIX_PTHREAD_SEMANTICS  -c rdgz.c -o rdgz.o

gcc -MD -MP -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -D_POSIX_PTHREAD_SEMANTICS  -c rdaddr.c -o rdaddr.o

In file included from rdaddr.c:30:0:

rdaddr.h: In function 'rd_family2str':

rdaddr.h:167:8: error: 'AF_LOCAL' undeclared (first use in this function)

rdaddr.h:167:8: note: each undeclared identifier is reported only once for each function it appears in

gmake: *** [rdaddr.o] Error 1

gcc -MD -MP -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -D_POSIX_PTHREAD_SEMANTICS  -c rdrand.c -o rdrand.o

gcc -MD -MP -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -D_POSIX_PTHREAD_SEMANTICS  -c rdthread.c -o rdthread.o

In file included from rdthread.c:30:0:

rdthread.h: In function 'rd_currthread_get':

rdthread.h:141:44: error: cast to pointer from integer of different size [-Werror=int-to-pointer-cast]

cc1: all warnings being treated as errors

gmake: *** [rdthread.o] Error 1

gcc -MD -MP -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -D_POSIX_PTHREAD_SEMANTICS  -c rdqueue.c -o rdqueue.o

In file included from rdqueue.c:30:0:

rdthread.h: In function 'rd_currthread_get':

rdthread.h:141:44: error: cast to pointer from integer of different size [-Werror=int-to-pointer-cast]

cc1: all warnings being treated as errors

gmake: *** [rdqueue.o] Error 1

gcc -MD -MP -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -D_POSIX_PTHREAD_SEMANTICS  -c rdlog.c -o rdlog.o

In file included from rdlog.c:34:0:

rdthread.h: In function 'rd_currthread_get':

rdthread.h:141:44: error: cast to pointer from integer of different size [-Werror=int-to-pointer-cast]

cc1: all warnings being treated as errors

gmake: *** [rdlog.o] Error 1

gcc -MD -MP -g -O2 -fPIC -Wall -Werror -Wfloat-equal -Wpointer-arith -D_POSIX_PTHREAD_SEMANTICS  -c snappy.c -o snappy.o

Generating linker script librdkafka.lds from rdkafka.h

/bin/sh: syntax error at line 12: `$' unexpected

gmake: *** [file-check] Error 2

gmake: Target `all' not remade because of errors.

[edenhill]

You will need perl installed too (for the linker script part), which Im guessing is the last problem in your output:

Generating linker script librdkafka.lds from rdkafka.h

/bin/sh: syntax error at line 12: `$' unexpected

[edenhill]

Some of the fixes should now be fixed.
I'm downloading a Solaris 10 image to fix the htonll stuff, but its taking long, I dont know which is slower, my rural wind torn DSL or oracle.com.

Can you share your htonll fix?

[winbatch]

I can't unfortunately. (Can't send code outside my company). In essence,
do 2 htonl calls on both halves (top and bottom) and swap as needed based
on endian-ness

On Monday, May 5, 2014, Magnus Edenhill notifications@github.com wrote:

Some of the fixes should now be fixed.
I'm downloading a Solaris 10 image to fix the htonll stuff, but its taking
long, I dont know which is slower, my rural wind torn DSL or oracle.com.

Can you share your htonll fix?

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/110#issuecomment-42231934
.