installing KenLM

[CapitalChi]

Running on OSX, boost 1.55
I'm essentially following the instructions in this document:
http://victor.chahuneau.fr/notes/2012/07/03/kenlm.html

Interestingly, everything worked once, but then stopped working. When I input ./bjam, I get a couple of errors, one involving a broken pipe, but the one I'm most concerned about is:

-bash: ./kenlm/bin/lmplz: No such file or directory

The output begins with: warning: No toolsets are configured.
warning: Configuring default toolset "darwin".
warning: If the default is wrong, your build may not work correctly.
warning: Use the "toolset=xxxxx" option to override our guess.
warning: For more configuration options, please consult
warning: http://boost.org/boost-build2/doc/html/bbv2/advanced/configuration.html
...patience...
...found 628 targets...
...updating 38 targets...

and at the end, the output is...

...failed darwin.link lm/bin/left_test.test/darwin-5.1.0/release/threading-multi/left_test...
...skipped <plm/bin/left_test.test/darwin-5.1.0/release/threading-multi>left_test.run for lack of <plm/bin/left_test.test/darwin-5.1.0/release/threading-multi>left_test...
...failed updating 23 targets...
...skipped 15 targets...

If I could attach the log I would but it's very long!

[kpu]

Can't do anything without the log. kenlm@kheafield.com

[CapitalChi]

Hi,
Thanks for taking a look. I didn’t see an attachment feature on the github page.
Rachel

From: Kenneth Heafield <notifications@github.commailto:notifications@github.com>
Reply-To: kpu/kenlm <reply@reply.github.commailto:reply@reply.github.com>
Date: Monday, June 22, 2015 at 3:52 PM
To: kpu/kenlm <kenlm@noreply.github.commailto:kenlm@noreply.github.com>
Cc: Rachel Vishnepolsky <rachel.vishnepolsky@capitalone.commailto:rachel.vishnepolsky@capitalone.com>
Subject: Re: [kenlm] installing KenLM (#35)

Can't do anything without the log. kenlm@kheafield.commailto:kenlm@kheafield.com

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/35#issuecomment-114259275.

---

The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.

warning: No toolsets are configured.
warning: Configuring default toolset "darwin".
warning: If the default is wrong, your build may not work correctly.
warning: Use the "toolset=xxxxx" option to override our guess.
warning: For more configuration options, please consult
warning: http://boost.org/boost-build2/doc/html/bbv2/advanced/configuration.html
...patience...
...found 628 targets...
...updating 38 targets...
darwin.link lm/bin/model_test.test/darwin-5.1.0/release/threading-multi/model_test
Undefined symbols for architecture x86_64:
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::reserve(unsigned long)", referenced from:
lm::ngram::(anonymous namespace)::ReadWords(int, lm::EnumerateVocab, unsigned int) [clone .constprop.113] in vocab.o
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::assign(char const)", referenced from:
lm::ngram::trie::TrieSearch<lm::ngram::SeparatelyQuantize, lm::ngram::trie::ArrayBhiksha>::InitializeFromARPA(char const, util::FilePiece&, std::vector<unsigned long long, std::allocator >&, lm::ngram::Config const&, lm::ngram::SortedVocabulary&, lm::ngram::Backing&) in search_trie.o
lm::ngram::trie::TrieSearch<lm::ngram::SeparatelyQuantize, lm::ngram::trie::DontBhiksha>::InitializeFromARPA(char const, util::FilePiece&, std::vector<unsigned long long, std::allocator >&, lm::ngram::Config const&, lm::ngram::SortedVocabulary&, lm::ngram::Backing&) in search_trie.o
lm::ngram::trie::TrieSearch<lm::ngram::DontQuantize, lm::ngram::trie::ArrayBhiksha>::InitializeFromARPA(char const_, util::FilePiece&, std::vector<unsigned long long, std::allocator >&, lm::ngram::Config const&, lm::ngram::SortedVocabulary&, lm::ngram::Backing&) in search_trie.o
lm::ngram::trie::TrieSearch<lm::ngram::DontQuantize, lm::ngram::trie::DontBhiksha>::InitializeFromARPA(char const_, util::FilePiece&, std::vector<unsigned long long, std::allocator >&, lm::ngram::Config const&, lm::ngram::SortedVocabulary&, lm::ngram::Backing&) in search_trie.o
"std::__cxx11::basic_stringbuf<char, std::char_traits, std::allocator >::str() const", referenced from:
lm::ReadNGramHeader(util::FilePiece&, unsigned int) in read_arpa.o
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_mutate(unsigned long, unsigned long, char const, unsigned long)", referenced from:
util::MakeTemp(std::cxx11::basic_string<char, std::char_traits, std::allocator > const&) in file.o
lm::ngram::(anonymous namespace)::ReadWords(int, lm::EnumerateVocab, unsigned int) [clone .constprop.113] in vocab.o
lm::ngram::WriteWordsWrapper::Add(unsigned int, StringPiece const&) in vocab.o
lm::ngram::ProbingVocabulary::ConfigureEnumerate(lm::EnumerateVocab, unsigned long) in vocab.o
lm::ngram::SortedVocabulary::ConfigureEnumerate(lm::EnumerateVocab, unsigned long) in vocab.o
"std::cxx11::basic_stringstream<char, std::char_traits, std::allocator >::~basic_stringstream()", referenced from:
util::Exception::Exception(util::Exception const&) in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
lm::ReadNGramHeader(util::FilePiece&, unsigned int) in read_arpa.o
lm::ReadARPACounts(util::FilePiece&, std::vector<unsigned long long, std::allocator >&) in read_arpa.o
"std::cxx11::basic_stringbuf<char, std::char_traits, std::allocator >::M_sync(char, unsigned long, unsigned long)", referenced from:
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
lm::ReadARPACounts(util::FilePiece&, std::vector<unsigned long long, std::allocator >&) in read_arpa.o
"VTT for std::cxx11::basic_ostringstream<char, std::char_traits, std::allocator >", referenced from:
bool boost::test_tools::tt_detail::check_frwd<boost::test_tools::check_is_close_t, double, double, boost::test_tools::percent_tolerance_t >(boost::test_tools::check_is_close_t, boost::unit_test::lazy_ostream const&, boost::unit_test::basic_cstring, unsigned long, boost::test_tools::tt_detail::tool_level, boost::test_tools::tt_detail::check_type, double const&, char const, double const&, char const, boost::test_tools::percent_tolerance_t const&, char const) [clone .constprop.241] in model_test.o
lm::ngram::(anonymous namespace)::rest_max::test_method() [clone .isra.91] in model_test.o
boost::detail::sp_counted_impl_pboost::basic_wrap_stringstream::dispose() in model_test.o
util::NameFromFDabi:cxx11 in file.o
"std::ctype::M_widen_init() const", referenced from:
util::ErsatzProgress::~ErsatzProgress() in ersatz_progress.o
util::ErsatzProgress::Milestone() in ersatz_progress.o
util::FilePiece::Initialize(char const, std::basic_ostream<char, std::char_traits >, unsigned long) in file_piece.o
lm::ngram::detail::ComplainAboutARPA(lm::ngram::Config const&, lm::ngram::ModelType) in binary_format.o
lm::PositiveProbWarn::Warn(float) in read_arpa.o
lm::ngram::MissingUnknown(lm::ngram::Config const&) in vocab.o
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::resize(unsigned long, char)", referenced from:
util::(anonymous namespace)::BZip::Read(void, unsigned long, util::ReadCompressed&) in read_compressed.o
util::NameFromFDabi:cxx11 in file.o
lm::ngram::(anonymous namespace)::ReadWords(int, lm::EnumerateVocab, unsigned int) [clone .constprop.113] in vocab.o
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_create(unsigned long&, unsigned long)", referenced from:
void std::_cxx11::basic_string<char, std::char_traits, std::allocator >::M_construct<char*>(char, char, std::forward_iterator_tag) [clone .isra.99] in model_test.o
boost::unit_test::lazy_ostream_impl<boost::unit_test::basic_cstring const&>::operator()(std::basic_ostream<char, std::char_traits >&) const in model_test.o
std::vector<std::__cxx11::basic_string<char, std::char_traits, std::allocator >, std::allocator<std::__cxx11::basic_string<char, std::char_traits, std::allocator > > >::M_insert_aux(__gnu_cxx::__normal_iterator<std::__cxx11::basic_string<char, std::char_traits, std::allocator >, std::vector<std::_cxx11::basic_string<char, std::char_traits, std::allocator >, std::allocator<std::cxx11::basic_string<char, std::char_traits, std::allocator > > > >, std::cxx11::basic_string<char, std::char_traits, std::allocator > const&) in model_test.o
util::(anonymous namespace)::BZip::Read(void, unsigned long, util::ReadCompressed&) in read_compressed.o
util::Exception::what() const in exception.o
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
...
"std::_cxx11::basic_string<char, std::char_traits, std::allocator >::M_assign(std::__cxx11::basic_string<char, std::char_traits, std::allocator > const&)", referenced from:
std::vector<std::__cxx11::basic_string<char, std::char_traits, std::allocator >, std::allocator<std::__cxx11::basic_string<char, std::char_traits, std::allocator > > >::M_insert_aux(__gnu_cxx::__normal_iterator<std::__cxx11::basic_string<char, std::char_traits, std::allocator >, std::vector<std::__cxx11::basic_string<char, std::char_traits, std::allocator >, std::allocator<std::cxx11::basic_string<char, std::char_traits, std::allocator > > > >, std::cxx11::basic_string<char, std::char_traits, std::allocator > const&) in model_test.o
util::Exception::what() const in exception.o
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
util::NameFromFDabi:cxx11 in file.o
lm::ReadNGramHeader(util::FilePiece&, unsigned int) in read_arpa.o
...
"boost::unit_test::ut_detail::normalize_test_case_name[abi:cxx11](boost::unit_test::basic_cstring<char const)", referenced from:
boost::unit_test::make_test_case(boost::unit_test::callback0boost::unit_test::ut_detail::unused const&, boost::unit_test::basic_cstring) in model_test.o
"vtable for std::_cxx11::basic_stringstream<char, std::char_traits, std::allocator >", referenced from:
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
...
NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
"boost::test_tools::print_log_value::operator()(std::basic_ostream<char, std::char_traits >&, unsigned char)", referenced from:
boost::unit_test::lazy_ostream_impl<boost::test_tools::tt_detail::print_helper_t const&>::operator()(std::basic_ostream<char, std::char_traits >&) const in model_test.o
"vtable for std::cxx11::basic_ostringstream<char, std::char_traits, std::allocator >", referenced from:
bool boost::test_tools::tt_detail::check_frwd<boost::test_tools::check_is_close_t, double, double, boost::test_tools::percent_tolerance_t >(boost::test_tools::check_is_close_t, boost::unit_test::lazy_ostream const&, boost::unit_test::basic_cstring, unsigned long, boost::test_tools::tt_detail::tool_level, boost::test_tools::tt_detail::check_type, double const&, char const, double const&, char const, boost::test_tools::percent_tolerance_t const&, char const) [clone .constprop.241] in model_test.o
lm::ngram::(anonymous namespace)::rest_max::test_method() [clone .isra.91] in model_test.o
boost::detail::sp_counted_impl_pboost::basic_wrap_stringstream::dispose() in model_test.o
util::NameFromFDabi:cxx11 in file.o
NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
"std::_cxx11::basic_ostringstream<char, std::char_traits, std::allocator >::~basic_ostringstream()", referenced from:
util::NameFromFDabi:cxx11 in file.o
"vtable for std::cxx11::basic_stringbuf<char, std::char_traits, std::allocator >", referenced from:
bool boost::test_tools::tt_detail::check_frwd<boost::test_tools::check_is_close_t, double, double, boost::test_tools::percent_tolerance_t >(boost::test_tools::check_is_close_t, boost::unit_test::lazy_ostream const&, boost::unit_test::basic_cstring, unsigned long, boost::test_tools::tt_detail::tool_level, boost::test_tools::tt_detail::check_type, double const&, char const, double const&, char const, boost::test_tools::percent_tolerance_t const&, char const) [clone .constprop.241] in model_test.o
lm::ngram::(anonymous namespace)::rest_max::test_method() [clone .isra.91] in model_test.o
boost::detail::sp_counted_impl_pboost::basic_wrap_stringstream::dispose() in model_test.o
std::__cxx11::basic_stringbuf<char, std::char_traits, std::allocator >::~basic_stringbuf() in model_test.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
...
NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
"VTT for std::__cxx11::basic_stringstream<char, std::char_traits, std::allocator >", referenced from:
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
...
"std::_cxx11::basic_string<char, std::char_traits, std::allocator >::compare(char const) const", referenced from:
lm::ngram::(anonymous namespace)::ExpectEnumerateVocab::Check(lm::base::Vocabulary const&) [clone .constprop.238] in model_test.o
"std::__cxx11::basic_string<char, std::char_traits, std::allocator >::M_append(char const, unsigned long)", referenced from:
util::MakeTemp(std::_cxx11::basic_string<char, std::char_traits, std::allocator > const&) in file.o
util::NameFromFDabi:cxx11 in file.o
util::FilePiece::FilePiece(int, char const, std::basic_ostream<char, std::char_traits >, unsigned long) in file_piece.o
util::FilePiece::FilePiece(char const, std::basic_ostream<char, std::char_traits >, unsigned long) in file_piece.o
lm::ngram::(anonymous namespace)::ReadWords(int, lm::EnumerateVocab, unsigned int) [clone .constprop.113] in vocab.o
lm::ngram::WriteWordsWrapper::Add(unsigned int, StringPiece const&) in vocab.o
lm::ngram::ProbingVocabulary::ConfigureEnumerate(lm::EnumerateVocab, unsigned long) in vocab.o
...
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_replace(unsigned long, unsigned long, char const, unsigned long)", referenced from:
init_unit_test() in model_test.o
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const_) in exception.o
util::NameFromFDabi:cxx11 in file.o
util::FilePiece::Initialize(char const_, std::basic_ostream<char, std::char_traits >, unsigned long) in file_piece.o
lm::ngram::trie::TrieSearch<lm::ngram::DontQuantize, lm::ngram::trie::ArrayBhiksha>::InitializeFromARPA(char const, util::FilePiece&, std::vector<unsigned long long, std::allocator >&, lm::ngram::Config const&, lm::ngram::SortedVocabulary&, lm::ngram::Backing&) in search_trie.o
lm::ngram::trie::TrieSearch<lm::ngram::DontQuantize, lm::ngram::trie::DontBhiksha>::InitializeFromARPA(char const_, util::FilePiece&, std::vector<unsigned long long, std::allocator >&, lm::ngram::Config const&, lm::ngram::SortedVocabulary&, lm::ngram::Backing&) in search_trie.o
ld: symbol(s) not found for architecture x86_64
collect2: error: ld returned 1 exit status

"g++"  -o "lm/bin/model_test.test/darwin-5.1.0/release/threading-multi/model_test" "lm/bin/model_test.test/darwin-5.1.0/release/threading-multi/model_test.o" "util/bin/darwin-5.1.0/release/threading-multi/read_compressed.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/bignum-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/bignum.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/cached-powers.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/diy-fp.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/double-conversion.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/fast-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/fixed-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/strtod.o" "util/bin/darwin-5.1.0/release/threading-multi/bit_packing.o" "util/bin/darwin-5.1.0/release/threading-multi/ersatz_progress.o" "util/bin/darwin-5.1.0/release/threading-multi/exception.o" "util/bin/darwin-5.1.0/release/threading-multi/file.o" "util/bin/darwin-5.1.0/release/threading-multi/file_piece.o" "util/bin/darwin-5.1.0/release/threading-multi/mmap.o" "util/bin/darwin-5.1.0/release/threading-multi/murmur_hash.o" "util/bin/darwin-5.1.0/release/threading-multi/pool.o" "util/bin/darwin-5.1.0/release/threading-multi/scoped.o" "util/bin/darwin-5.1.0/release/threading-multi/string_piece.o" "util/bin/darwin-5.1.0/release/threading-multi/usage.o" "lm/bin/darwin-5.1.0/release/threading-multi/bhiksha.o" "lm/bin/darwin-5.1.0/release/threading-multi/binary_format.o" "lm/bin/darwin-5.1.0/release/threading-multi/config.o" "lm/bin/darwin-5.1.0/release/threading-multi/lm_exception.o" "lm/bin/darwin-5.1.0/release/threading-multi/model.o" "lm/bin/darwin-5.1.0/release/threading-multi/quantize.o" "lm/bin/darwin-5.1.0/release/threading-multi/read_arpa.o" "lm/bin/darwin-5.1.0/release/threading-multi/search_hashed.o" "lm/bin/darwin-5.1.0/release/threading-multi/search_trie.o" "lm/bin/darwin-5.1.0/release/threading-multi/sizes.o" "lm/bin/darwin-5.1.0/release/threading-multi/trie.o" "lm/bin/darwin-5.1.0/release/threading-multi/trie_sort.o" "lm/bin/darwin-5.1.0/release/threading-multi/value_build.o" "lm/bin/darwin-5.1.0/release/threading-multi/virtual_interface.o" "lm/bin/darwin-5.1.0/release/threading-multi/vocab.o"   -lboost_unit_test_framework -lbz2 -lz    -Wl,-dead_strip -no_dead_strip_inits_and_terms 

...failed darwin.link lm/bin/model_test.test/darwin-5.1.0/release/threading-multi/model_test...
...skipped <plm/bin/model_test.test/darwin-5.1.0/release/threading-multi>model_test.run for lack of <plm/bin/model_test.test/darwin-5.1.0/release/threading-multi>model_test...
darwin.link lm/bin/partial_test.test/darwin-5.1.0/release/threading-multi/partial_test
Undefined symbols for architecture x86_64:
"std::_cxx11::basic_string<char, std::char_traits, std::allocator >::reserve(unsigned long)", referenced from:
lm::ngram::(anonymous namespace)::ReadWords(int, lm::EnumerateVocab, unsigned int) [clone .constprop.113] in vocab.o
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_mutate(unsigned long, unsigned long, char const, unsigned long)", referenced from:
lm::ngram::(anonymous namespace)::ReadWords(int, lm::EnumerateVocab, unsigned int) [clone .constprop.113] in vocab.o
lm::ngram::WriteWordsWrapper::Add(unsigned int, StringPiece const&) in vocab.o
lm::ngram::ProbingVocabulary::ConfigureEnumerate(lm::EnumerateVocab, unsigned long) in vocab.o
"std::__cxx11::basic_stringbuf<char, std::char_traits, std::allocator >::str() const", referenced from:
lm::ReadNGramHeader(util::FilePiece&, unsigned int) in read_arpa.o
"std::cxx11::basic_stringstream<char, std::char_traits, std::allocator >::~basic_stringstream()", referenced from:
util::Exception::Exception(util::Exception const&) in exception.o
lm::ReadNGramHeader(util::FilePiece&, unsigned int) in read_arpa.o
lm::ReadARPACounts(util::FilePiece&, std::vector<unsigned long long, std::allocator >&) in read_arpa.o
"std::cxx11::basic_stringbuf<char, std::char_traits, std::allocator >::M_sync(char, unsigned long, unsigned long)", referenced from:
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
lm::ReadARPACounts(util::FilePiece&, std::vector<unsigned long long, std::allocator >&) in read_arpa.o
"boost::test_tools::print_log_value::operator()(std::basic_ostream<char, std::char_traits >&, unsigned char)", referenced from:
boost::unit_test::lazy_ostream_impl<boost::test_tools::tt_detail::print_helper_t const&>::operator()(std::basic_ostream<char, std::char_traits >&) const in partial_test.o
"vtable for std::__cxx11::basic_stringstream<char, std::char_traits, std::allocator >", referenced from:
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::Exception() in exception.o
...
NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
"VTT for std::_cxx11::basic_stringstream<char, std::char_traits, std::allocator >", referenced from:
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::Exception() in exception.o
...
"VTT for std::cxx11::basic_ostringstream<char, std::char_traits, std::allocator >", referenced from:
bool boost::test_tools::tt_detail::check_frwd<boost::test_tools::check_is_close_t, double, float, boost::test_tools::percent_tolerance_t >(boost::test_tools::check_is_close_t, boost::unit_test::lazy_ostream const&, boost::unit_test::basic_cstring, unsigned long, boost::test_tools::tt_detail::tool_level, boost::test_tools::tt_detail::check_type, double const&, char const, float const&, char const, boost::test_tools::percent_tolerance_t const&, char const) [clone .constprop.120] in partial_test.o
lm::ngram::(anonymous namespace)::suite::AlsoWouldConsider_invoker() in partial_test.o
lm::ngram::(anonymous namespace)::suite::SimpleBefore::test_method() [clone .constprop.115] in partial_test.o
lm::ngram::(anonymous namespace)::suite::EndSentence_invoker() in partial_test.o
boost::detail::sp_counted_impl_pboost::basic_wrap_stringstream::dispose() in partial_test.o
util::NameFromFDabi:cxx11 in file.o
"std::ctype::M_widen_init() const", referenced from:
util::ErsatzProgress::~ErsatzProgress() in ersatz_progress.o
util::ErsatzProgress::Milestone() in ersatz_progress.o
util::FilePiece::Initialize(char const, std::basic_ostream<char, std::char_traits >, unsigned long) in file_piece.o
lm::ngram::detail::ComplainAboutARPA(lm::ngram::Config const&, lm::ngram::ModelType) in binary_format.o
lm::PositiveProbWarn::Warn(float) in read_arpa.o
lm::ngram::MissingUnknown(lm::ngram::Config const&) in vocab.o
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::resize(unsigned long, char)", referenced from:
util::(anonymous namespace)::BZip::Read(void, unsigned long, util::ReadCompressed&) in read_compressed.o
util::NameFromFDabi:cxx11 in file.o
lm::ngram::(anonymous namespace)::ReadWords(int, lm::EnumerateVocab, unsigned int) [clone .constprop.113] in vocab.o
"boost::unit_test::ut_detail::normalize_test_case_name[abi:cxx11](boost::unit_test::basic_cstring<char const)", referenced from:
boost::unit_test::make_test_case(boost::unit_test::callback0boost::unit_test::ut_detail::unused const&, boost::unit_test::basic_cstring) in partial_test.o
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_assign(std::cxx11::basic_string<char, std::char_traits, std::allocator > const&)", referenced from:
util::Exception::what() const in exception.o
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
util::NameFromFDabi:cxx11 in file.o
lm::ReadNGramHeader(util::FilePiece&, unsigned int) in read_arpa.o
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_create(unsigned long&, unsigned long)", referenced from:
boost::unit_test::lazy_ostream_impl<boost::unit_test::basic_cstring const&>::operator()(std::basic_ostream<char, std::char_traits >&) const in partial_test.o
util::(anonymous namespace)::BZip::Read(void, unsigned long, util::ReadCompressed&) in read_compressed.o
util::Exception::what() const in exception.o
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
util::NameFromFDabi:cxx11 in file.o
util::ResizeOrThrow(int, unsigned long long) in file.o
...
"vtable for std::cxx11::basic_ostringstream<char, std::char_traits, std::allocator >", referenced from:
bool boost::test_tools::tt_detail::check_frwd<boost::test_tools::check_is_close_t, double, float, boost::test_tools::percent_tolerance_t >(boost::test_tools::check_is_close_t, boost::unit_test::lazy_ostream const&, boost::unit_test::basic_cstring, unsigned long, boost::test_tools::tt_detail::tool_level, boost::test_tools::tt_detail::check_type, double const&, char const, float const&, char const, boost::test_tools::percent_tolerance_t const&, char const_) [clone .constprop.120] in partial_test.o
lm::ngram::(anonymous namespace)::suite::AlsoWouldConsider_invoker() in partial_test.o
lm::ngram::(anonymous namespace)::suite::SimpleBefore::test_method() [clone .constprop.115] in partial_test.o
lm::ngram::(anonymous namespace)::suite::EndSentence_invoker() in partial_test.o
boost::detail::sp_counted_impl_pboost::basic_wrap_stringstream::dispose() in partial_test.o
util::NameFromFDabi:cxx11 in file.o
NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
"std::_cxx11::basic_ostringstream<char, std::char_traits, std::allocator >::~basic_ostringstream()", referenced from:
util::NameFromFDabi:cxx11 in file.o
"vtable for std::cxx11::basic_stringbuf<char, std::char_traits, std::allocator >", referenced from:
bool boost::test_tools::tt_detail::check_frwd<boost::test_tools::check_is_close_t, double, float, boost::test_tools::percent_tolerance_t >(boost::test_tools::check_is_close_t, boost::unit_test::lazy_ostream const&, boost::unit_test::basic_cstring, unsigned long, boost::test_tools::tt_detail::tool_level, boost::test_tools::tt_detail::check_type, double const&, char const, float const&, char const, boost::test_tools::percent_tolerance_t const&, char const) [clone .constprop.120] in partial_test.o
lm::ngram::(anonymous namespace)::suite::AlsoWouldConsider_invoker() in partial_test.o
lm::ngram::(anonymous namespace)::suite::SimpleBefore::test_method() [clone .constprop.115] in partial_test.o
lm::ngram::(anonymous namespace)::suite::EndSentence_invoker() in partial_test.o
boost::detail::sp_counted_impl_pboost::basic_wrap_stringstream::dispose() in partial_test.o
std::__cxx11::basic_stringbuf<char, std::char_traits, std::allocator >::~basic_stringbuf() in partial_test.o
util::Exception::~Exception() in exception.o
...
NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
"std::_cxx11::basic_string<char, std::char_traits, std::allocator >::M_append(char const, unsigned long)", referenced from:
util::NameFromFDabi:cxx11 in file.o
util::FilePiece::FilePiece(int, char const, std::basic_ostream<char, std::char_traits >, unsigned long) in file_piece.o
util::FilePiece::FilePiece(char const, std::basic_ostream<char, std::char_traits >, unsigned long) in file_piece.o
lm::ngram::(anonymous namespace)::ReadWords(int, lm::EnumerateVocab, unsigned int) [clone .constprop.113] in vocab.o
lm::ngram::WriteWordsWrapper::Add(unsigned int, StringPiece const&) in vocab.o
lm::ngram::ProbingVocabulary::ConfigureEnumerate(lm::EnumerateVocab_, unsigned long) in vocab.o
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_replace(unsigned long, unsigned long, char const, unsigned long)", referenced from:
init_unit_test() in partial_test.o
util::Exception::SetLocation(char const, unsigned int, char const, char const_, char const_) in exception.o
util::NameFromFDabi:cxx11 in file.o
util::FilePiece::Initialize(char const_, std::basic_ostream<char, std::char_traits >*, unsigned long) in file_piece.o
ld: symbol(s) not found for architecture x86_64
collect2: error: ld returned 1 exit status

"g++"  -o "lm/bin/partial_test.test/darwin-5.1.0/release/threading-multi/partial_test" "lm/bin/partial_test.test/darwin-5.1.0/release/threading-multi/partial_test.o" "util/bin/darwin-5.1.0/release/threading-multi/read_compressed.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/bignum-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/bignum.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/cached-powers.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/diy-fp.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/double-conversion.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/fast-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/fixed-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/strtod.o" "util/bin/darwin-5.1.0/release/threading-multi/bit_packing.o" "util/bin/darwin-5.1.0/release/threading-multi/ersatz_progress.o" "util/bin/darwin-5.1.0/release/threading-multi/exception.o" "util/bin/darwin-5.1.0/release/threading-multi/file.o" "util/bin/darwin-5.1.0/release/threading-multi/file_piece.o" "util/bin/darwin-5.1.0/release/threading-multi/mmap.o" "util/bin/darwin-5.1.0/release/threading-multi/murmur_hash.o" "util/bin/darwin-5.1.0/release/threading-multi/pool.o" "util/bin/darwin-5.1.0/release/threading-multi/scoped.o" "util/bin/darwin-5.1.0/release/threading-multi/string_piece.o" "util/bin/darwin-5.1.0/release/threading-multi/usage.o" "lm/bin/darwin-5.1.0/release/threading-multi/bhiksha.o" "lm/bin/darwin-5.1.0/release/threading-multi/binary_format.o" "lm/bin/darwin-5.1.0/release/threading-multi/config.o" "lm/bin/darwin-5.1.0/release/threading-multi/lm_exception.o" "lm/bin/darwin-5.1.0/release/threading-multi/model.o" "lm/bin/darwin-5.1.0/release/threading-multi/quantize.o" "lm/bin/darwin-5.1.0/release/threading-multi/read_arpa.o" "lm/bin/darwin-5.1.0/release/threading-multi/search_hashed.o" "lm/bin/darwin-5.1.0/release/threading-multi/search_trie.o" "lm/bin/darwin-5.1.0/release/threading-multi/sizes.o" "lm/bin/darwin-5.1.0/release/threading-multi/trie.o" "lm/bin/darwin-5.1.0/release/threading-multi/trie_sort.o" "lm/bin/darwin-5.1.0/release/threading-multi/value_build.o" "lm/bin/darwin-5.1.0/release/threading-multi/virtual_interface.o" "lm/bin/darwin-5.1.0/release/threading-multi/vocab.o"   -lboost_unit_test_framework -lbz2 -lz    -Wl,-dead_strip -no_dead_strip_inits_and_terms 

...failed darwin.link lm/bin/partial_test.test/darwin-5.1.0/release/threading-multi/partial_test...
...skipped <plm/bin/partial_test.test/darwin-5.1.0/release/threading-multi>partial_test.run for lack of <plm/bin/partial_test.test/darwin-5.1.0/release/threading-multi>partial_test...
darwin.link util/bin/darwin-5.1.0/release/threading-multi/bit_packing_test
Undefined symbols for architecture x86_64:
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_create(unsigned long&, unsigned long)", referenced from:
util::Exception::what() const in exception.o
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const_) in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_assign(std::cxx11::basic_string<char, std::char_traits, std::allocator > const&)", referenced from:
util::Exception::what() const in exception.o
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
"std::cxx11::basic_stringbuf<char, std::char_traits, std::allocator >::M_sync(char, unsigned long, unsigned long)", referenced from:
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const_) in exception.o
"vtable for std::__cxx11::basic_stringstream<char, std::char_traits, std::allocator >", referenced from:
util::Exception::~Exception() in exception.o
util::Exception::~Exception() in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
util::Exception::Exception() in exception.o
NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
"VTT for std::__cxx11::basic_stringstream<char, std::char_traits, std::allocator >", referenced from:
util::Exception::~Exception() in exception.o
util::Exception::~Exception() in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
util::Exception::Exception() in exception.o
"std::__cxx11::basic_stringstream<char, std::char_traits, std::allocator >::~basic_stringstream()", referenced from:
util::Exception::Exception(util::Exception const&) in exception.o
"vtable for std::__cxx11::basic_stringbuf<char, std::char_traits, std::allocator >", referenced from:
util::Exception::~Exception() in exception.o
util::Exception::~Exception() in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
util::Exception::Exception() in exception.o
std::cxx11::basic_stringbuf<char, std::char_traits, std::allocator >::~basic_stringbuf() in exception.o
NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
"boost::unit_test::ut_detail::normalize_test_case_name[abi:cxx11](boost::unit_test::basic_cstring<char const)", referenced from:
boost::unit_test::make_test_case(boost::unit_test::callback0boost::unit_test::ut_detail::unused const&, boost::unit_test::basic_cstring) in bit_packing_test.o
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_replace(unsigned long, unsigned long, char const, unsigned long)", referenced from:
init_unit_test() in bit_packing_test.o
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
ld: symbol(s) not found for architecture x86_64
collect2: error: ld returned 1 exit status

"g++"  -o "util/bin/darwin-5.1.0/release/threading-multi/bit_packing_test" "util/bin/darwin-5.1.0/release/threading-multi/bit_packing_test.o" "util/bin/darwin-5.1.0/release/threading-multi/read_compressed.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/bignum-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/bignum.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/cached-powers.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/diy-fp.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/double-conversion.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/fast-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/fixed-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/strtod.o" "util/bin/darwin-5.1.0/release/threading-multi/bit_packing.o" "util/bin/darwin-5.1.0/release/threading-multi/ersatz_progress.o" "util/bin/darwin-5.1.0/release/threading-multi/exception.o" "util/bin/darwin-5.1.0/release/threading-multi/file.o" "util/bin/darwin-5.1.0/release/threading-multi/file_piece.o" "util/bin/darwin-5.1.0/release/threading-multi/mmap.o" "util/bin/darwin-5.1.0/release/threading-multi/murmur_hash.o" "util/bin/darwin-5.1.0/release/threading-multi/pool.o" "util/bin/darwin-5.1.0/release/threading-multi/scoped.o" "util/bin/darwin-5.1.0/release/threading-multi/string_piece.o" "util/bin/darwin-5.1.0/release/threading-multi/usage.o"   -lboost_unit_test_framework -lbz2 -lz    -Wl,-dead_strip -no_dead_strip_inits_and_terms 

...failed darwin.link util/bin/darwin-5.1.0/release/threading-multi/bit_packing_test...
...skipped <putil/bin/darwin-5.1.0/release/threading-multi>bit_packing_test.passed for lack of <putil/bin/darwin-5.1.0/release/threading-multi>bit_packing_test...
darwin.link util/bin/file_piece_test.test/darwin-5.1.0/release/threading-multi/file_piece_test
Undefined symbols for architecture x86_64:
"vtable for std::__cxx11::basic_ostringstream<char, std::char_traits, std::allocator >", referenced from:
util::NameFromFDabi:cxx11 in file.o
NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
"std::cxx11::basic_stringstream<char, std::char_traits, std::allocator >::~basic_stringstream()", referenced from:
util::Exception::Exception(util::Exception const&) in exception.o
"std::cxx11::basic_stringbuf<char, std::char_traits, std::allocator >::M_sync(char, unsigned long, unsigned long)", referenced from:
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
"std::basic_istream<char, std::char_traits >& std::getline<char, std::char_traits, std::allocator >(std::basic_istream<char, std::char_traits >&, std::__cxx11::basic_string<char, std::char_traits, std::allocator >&, char)", referenced from:
util::(anonymous namespace)::MMapReadLine::test_method() [clone .isra.48] in file_piece_test.o
util::(anonymous namespace)::IStream::test_method() [clone .isra.49] in file_piece_test.o
util::(anonymous namespace)::PlainZipReadLine::test_method() [clone .isra.53] in file_piece_test.o
"vtable for std::__cxx11::basic_stringstream<char, std::char_traits, std::allocator >", referenced from:
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::Exception() in exception.o
...
NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
"std::__cxx11::basic_ostringstream<char, std::char_traits, std::allocator >::~basic_ostringstream()", referenced from:
util::NameFromFDabi:cxx11 in file.o
"vtable for std::cxx11::basic_stringbuf<char, std::char_traits, std::allocator >", referenced from:
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::Exception() in exception.o
...
NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
"VTT for std::cxx11::basic_stringstream<char, std::char_traits, std::allocator >", referenced from:
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::Exception() in exception.o
...
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_create(unsigned long&, unsigned long)", referenced from:
util::(anonymous namespace)::FileLocation() in file_piece_test.o
util::(anonymous namespace)::PlainZipReadLine::test_method() [clone .isra.53] in file_piece_test.o
util::(anonymous namespace)::BZip::Read(void, unsigned long, util::ReadCompressed&) in read_compressed.o
util::Exception::what() const in exception.o
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
util::NameFromFDabi:cxx11 in file.o
...
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_assign(std::cxx11::basic_string<char, std::char_traits, std::allocator > const&)", referenced from:
util::Exception::what() const in exception.o
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
util::NameFromFDabi:cxx11 in file.o
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::resize(unsigned long, char)", referenced from:
util::(anonymous namespace)::BZip::Read(void, unsigned long, util::ReadCompressed&) in read_compressed.o
util::NameFromFDabi:cxx11 in file.o
"boost::unit_test::ut_detail::normalize_test_case_name[abi:cxx11](boost::unit_test::basic_cstring<char const)", referenced from:
boost::unit_test::make_test_case(boost::unit_test::callback0boost::unit_test::ut_detail::unused const&, boost::unit_test::basic_cstring) in file_piece_test.o
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_replace(unsigned long, unsigned long, char const, unsigned long)", referenced from:
init_unit_test() in file_piece_test.o
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
util::NameFromFDabi:cxx11 in file.o
util::FilePiece::FilePiece(std::basic_istream<char, std::char_traits >&, char const, unsigned long) in file_piece.o
util::FilePiece::Initialize(char const, std::basic_ostream<char, std::char_traits >, unsigned long) in file_piece.o
"std::_cxx11::basic_string<char, std::char_traits, std::allocator >::M_append(char const, unsigned long)", referenced from:
util::(anonymous namespace)::PlainZipReadLine::test_method() [clone .isra.53] in file_piece_test.o
util::NameFromFDabi:cxx11 in file.o
util::FilePiece::FilePiece(char const, std::basic_ostream<char, std::char_traits >, unsigned long) in file_piece.o
"VTT for std::__cxx11::basic_ostringstream<char, std::char_traits, std::allocator >", referenced from:
util::NameFromFDabi:cxx11 in file.o
"std::ctype::M_widen_init() const", referenced from:
util::(anonymous namespace)::MMapReadLine::test_method() [clone .isra.48] in file_piece_test.o
util::(anonymous namespace)::IStream::test_method() [clone .isra.49] in file_piece_test.o
util::(anonymous namespace)::PlainZipReadLine::test_method() [clone .isra.53] in file_piece_test.o
util::ErsatzProgress::~ErsatzProgress() in ersatz_progress.o
util::ErsatzProgress::Milestone() in ersatz_progress.o
util::FilePiece::Initialize(char const, std::basic_ostream<char, std::char_traits >_, unsigned long) in file_piece.o
ld: symbol(s) not found for architecture x86_64
collect2: error: ld returned 1 exit status

"g++"  -o "util/bin/file_piece_test.test/darwin-5.1.0/release/threading-multi/file_piece_test" "util/bin/darwin-5.1.0/release/threading-multi/file_piece_test.o" "util/bin/darwin-5.1.0/release/threading-multi/read_compressed.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/bignum-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/bignum.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/cached-powers.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/diy-fp.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/double-conversion.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/fast-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/fixed-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/strtod.o" "util/bin/darwin-5.1.0/release/threading-multi/bit_packing.o" "util/bin/darwin-5.1.0/release/threading-multi/ersatz_progress.o" "util/bin/darwin-5.1.0/release/threading-multi/exception.o" "util/bin/darwin-5.1.0/release/threading-multi/file.o" "util/bin/darwin-5.1.0/release/threading-multi/file_piece.o" "util/bin/darwin-5.1.0/release/threading-multi/mmap.o" "util/bin/darwin-5.1.0/release/threading-multi/murmur_hash.o" "util/bin/darwin-5.1.0/release/threading-multi/pool.o" "util/bin/darwin-5.1.0/release/threading-multi/scoped.o" "util/bin/darwin-5.1.0/release/threading-multi/string_piece.o" "util/bin/darwin-5.1.0/release/threading-multi/usage.o"   -lboost_unit_test_framework -lbz2 -lz    -Wl,-dead_strip -no_dead_strip_inits_and_terms 

...failed darwin.link util/bin/file_piece_test.test/darwin-5.1.0/release/threading-multi/file_piece_test...
...skipped <putil/bin/file_piece_test.test/darwin-5.1.0/release/threading-multi>file_piece_test.run for lack of <putil/bin/file_piece_test.test/darwin-5.1.0/release/threading-multi>file_piece_test...
darwin.link util/bin/darwin-5.1.0/release/threading-multi/read_compressed_test
Undefined symbols for architecture x86_64:
"vtable for std::__cxx11::basic_ostringstream<char, std::char_traits, std::allocator >", referenced from:
util::NameFromFDabi:cxx11 in file.o
NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
"VTT for std::cxx11::basic_ostringstream<char, std::char_traits, std::allocator >", referenced from:
util::NameFromFDabi:cxx11 in file.o
"std::cxx11::basic_stringbuf<char, std::char_traits, std::allocator >::M_sync(char, unsigned long, unsigned long)", referenced from:
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
"vtable for std::__cxx11::basic_stringstream<char, std::char_traits, std::allocator >", referenced from:
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::Exception() in exception.o
...
NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
"std::__cxx11::basic_stringstream<char, std::char_traits, std::allocator >::~basic_stringstream()", referenced from:
util::Exception::Exception(util::Exception const&) in exception.o
"std::__cxx11::basic_ostringstream<char, std::char_traits, std::allocator >::~basic_ostringstream()", referenced from:
util::NameFromFDabi:cxx11 in file.o
"vtable for std::_cxx11::basic_stringbuf<char, std::char_traits, std::allocator >", referenced from:
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::Exception() in exception.o
...
NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
"VTT for std::cxx11::basic_stringstream<char, std::char_traits, std::allocator >", referenced from:
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::Exception() in exception.o
...
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_create(unsigned long&, unsigned long)", referenced from:
util::(anonymous namespace)::WriteRandom() in read_compressed_test.o
util::(anonymous namespace)::TestRandom(char const) in read_compressed_test.o
boost::unit_test::lazy_ostream_impl<boost::unit_test::basic_cstring const&>::operator()(std::basic_ostream<char, std::char_traits >&) const in read_compressed_test.o
util::(anonymous namespace)::BZip::Read(void, unsigned long, util::ReadCompressed&) in read_compressed.o
util::Exception::what() const in exception.o
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
...
"std::_cxx11::basic_string<char, std::char_traits, std::allocator >::M_assign(std::cxx11::basic_string<char, std::char_traits, std::allocator > const&)", referenced from:
util::Exception::what() const in exception.o
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
util::NameFromFDabi:cxx11 in file.o
"std::_cxx11::basic_string<char, std::char_traits, std::allocator >::resize(unsigned long, char)", referenced from:
util::(anonymous namespace)::BZip::Read(void, unsigned long, util::ReadCompressed&) in read_compressed.o
util::NameFromFDabi:cxx11 in file.o
"boost::unit_test::ut_detail::normalize_test_case_name[abi:cxx11](boost::unit_test::basic_cstring<char const)", referenced from:
boost::unit_test::make_test_case(boost::unit_test::callback0boost::unit_test::ut_detail::unused const&, boost::unit_test::basic_cstring) in read_compressed_test.o
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_append(char const, unsigned long)", referenced from:
util::(anonymous namespace)::TestRandom(char const) in read_compressed_test.o
util::NameFromFDabi:cxx11 in file.o
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_replace(unsigned long, unsigned long, char const, unsigned long)", referenced from:
init_unit_test() in read_compressed_test.o
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const*) in exception.o
util::NameFromFDabi:cxx11 in file.o
ld: symbol(s) not found for architecture x86_64
collect2: error: ld returned 1 exit status

"g++"  -o "util/bin/darwin-5.1.0/release/threading-multi/read_compressed_test" "util/bin/darwin-5.1.0/release/threading-multi/read_compressed_test.o" "util/bin/darwin-5.1.0/release/threading-multi/read_compressed.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/bignum-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/bignum.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/cached-powers.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/diy-fp.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/double-conversion.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/fast-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/fixed-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/strtod.o" "util/bin/darwin-5.1.0/release/threading-multi/bit_packing.o" "util/bin/darwin-5.1.0/release/threading-multi/ersatz_progress.o" "util/bin/darwin-5.1.0/release/threading-multi/exception.o" "util/bin/darwin-5.1.0/release/threading-multi/file.o" "util/bin/darwin-5.1.0/release/threading-multi/file_piece.o" "util/bin/darwin-5.1.0/release/threading-multi/mmap.o" "util/bin/darwin-5.1.0/release/threading-multi/murmur_hash.o" "util/bin/darwin-5.1.0/release/threading-multi/pool.o" "util/bin/darwin-5.1.0/release/threading-multi/scoped.o" "util/bin/darwin-5.1.0/release/threading-multi/string_piece.o" "util/bin/darwin-5.1.0/release/threading-multi/usage.o"   -lboost_unit_test_framework -lbz2 -lz    -Wl,-dead_strip -no_dead_strip_inits_and_terms 

...failed darwin.link util/bin/darwin-5.1.0/release/threading-multi/read_compressed_test...
...skipped <putil/bin/darwin-5.1.0/release/threading-multi>read_compressed_test.passed for lack of <putil/bin/darwin-5.1.0/release/threading-multi>read_compressed_test...
darwin.link util/bin/darwin-5.1.0/release/threading-multi/joint_sort_test
Undefined symbols for architecture x86_64:
"boost::unit_test::ut_detail::normalize_test_case_name[abi:cxx11](boost::unit_test::basic_cstring<char const)", referenced from:
boost::unit_test::make_test_case(boost::unit_test::callback0boost::unit_test::ut_detail::unused const&, boost::unit_test::basic_cstring) in joint_sort_test.o
"boost::test_tools::print_log_value::operator()(std::basic_ostream<char, std::char_traits >&, char)", referenced from:
boost::unit_test::lazy_ostream_implboost::test_tools::tt_detail::print_helper_t<char const&>::operator()(std::basic_ostream<char, std::char_traits >&) const in joint_sort_test.o
"std::__cxx11::basic_string<char, std::char_traits, std::allocator >::_M_replace(unsigned long, unsigned long, char const*, unsigned long)", referenced from:
init_unit_test() in joint_sort_test.o
ld: symbol(s) not found for architecture x86_64
collect2: error: ld returned 1 exit status

"g++"  -o "util/bin/darwin-5.1.0/release/threading-multi/joint_sort_test" "util/bin/darwin-5.1.0/release/threading-multi/joint_sort_test.o" "util/bin/darwin-5.1.0/release/threading-multi/read_compressed.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/bignum-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/bignum.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/cached-powers.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/diy-fp.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/double-conversion.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/fast-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/fixed-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/strtod.o" "util/bin/darwin-5.1.0/release/threading-multi/bit_packing.o" "util/bin/darwin-5.1.0/release/threading-multi/ersatz_progress.o" "util/bin/darwin-5.1.0/release/threading-multi/exception.o" "util/bin/darwin-5.1.0/release/threading-multi/file.o" "util/bin/darwin-5.1.0/release/threading-multi/file_piece.o" "util/bin/darwin-5.1.0/release/threading-multi/mmap.o" "util/bin/darwin-5.1.0/release/threading-multi/murmur_hash.o" "util/bin/darwin-5.1.0/release/threading-multi/pool.o" "util/bin/darwin-5.1.0/release/threading-multi/scoped.o" "util/bin/darwin-5.1.0/release/threading-multi/string_piece.o" "util/bin/darwin-5.1.0/release/threading-multi/usage.o"   -lboost_unit_test_framework -lbz2 -lz    -Wl,-dead_strip -no_dead_strip_inits_and_terms 

...failed darwin.link util/bin/darwin-5.1.0/release/threading-multi/joint_sort_test...
...skipped <putil/bin/darwin-5.1.0/release/threading-multi>joint_sort_test.passed for lack of <putil/bin/darwin-5.1.0/release/threading-multi>joint_sort_test...
darwin.link util/bin/darwin-5.1.0/release/threading-multi/probing_hash_table_test
Undefined symbols for architecture x86_64:
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_assign(std::cxx11::basic_string<char, std::char_traits, std::allocator > const&)", referenced from:
util::Exception::what() const in exception.o
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
"std::cxx11::basic_stringbuf<char, std::char_traits, std::allocator >::M_sync(char, unsigned long, unsigned long)", referenced from:
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const_) in exception.o
"vtable for std::__cxx11::basic_stringstream<char, std::char_traits, std::allocator >", referenced from:
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
...
NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
"std::__cxx11::basic_stringstream<char, std::char_traits, std::allocator >::~basic_stringstream()", referenced from:
util::Exception::Exception(util::Exception const&) in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
"vtable for std::_cxx11::basic_stringbuf<char, std::char_traits, std::allocator >", referenced from:
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
...
NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
"boost::unit_test::ut_detail::normalize_test_case_name[abi:cxx11](boost::unit_test::basic_cstring<char const)", referenced from:
boost::unit_test::make_test_case(boost::unit_test::callback0boost::unit_test::ut_detail::unused const&, boost::unit_test::basic_cstring) in probing_hash_table_test.o
"VTT for std::cxx11::basic_stringstream<char, std::char_traits, std::allocator >", referenced from:
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::~Exception() in exception.o
util::ErrnoException::~ErrnoException() in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
...
"boost::test_tools::print_log_value::operator()(std::basic_ostream<char, std::char_traits >&, unsigned char)", referenced from:
boost::unit_test::lazy_ostream_impl<boost::test_tools::tt_detail::print_helper_t const&>::operator()(std::basic_ostream<char, std::char_traits >&) const in probing_hash_table_test.o
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_create(unsigned long&, unsigned long)", referenced from:
boost::unit_test::lazy_ostream_impl<boost::unit_test::basic_cstring const&>::operator()(std::basic_ostream<char, std::char_traits >&) const in probing_hash_table_test.o
util::Exception::what() const in exception.o
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
util::Exception::Exception(util::Exception const&) in exception.o
"std::cxx11::basic_string<char, std::char_traits, std::allocator >::M_replace(unsigned long, unsigned long, char const, unsigned long)", referenced from:
init_unit_test() in probing_hash_table_test.o
util::Exception::SetLocation(char const, unsigned int, char const, char const, char const) in exception.o
ld: symbol(s) not found for architecture x86_64
collect2: error: ld returned 1 exit status

"g++"  -o "util/bin/darwin-5.1.0/release/threading-multi/probing_hash_table_test" "util/bin/darwin-5.1.0/release/threading-multi/probing_hash_table_test.o" "util/bin/darwin-5.1.0/release/threading-multi/read_compressed.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/bignum-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/bignum.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/cached-powers.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/diy-fp.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/double-conversion.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/fast-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/fixed-dtoa.o" "util/double-conversion/bin/darwin-5.1.0/release/threading-multi/strtod.o" "util/bin/darwin-5.1.0/release/threading-multi/bit_packing.o" "util/bin/darwin-5.1.0/release/threading-multi/ersatz_progress.o" "util/bin/darwin-5.1.0/release/threading-multi/exception.o" "util/bin/darwin-5.1.0/release/threading-multi/file.o" "util/bin/darwin-5.1.0/release/threading-multi/file_piece.o" "util/bin/darwin-5.1.0/release/threading-multi/mmap.o" "util/bin/darwin-5.1.0/release/threading-multi/murmur_hash.o" "util/bin/darwin-5.1.0/release/threading-multi/pool.o" "util/bin/darwin-5.1.0/release/threading-multi/scoped.o" "util/bin/darwin-5.1.0/release/threading-multi/string_piece.o" "util/bin/darwin-5.1.0/release/threading-multi/usage.o"   -lboost_unit_test_framework -lbz2 -lz    -Wl,-dead_strip -no_dead_strip_inits_and_terms 

...failed darwin.link util/bin/darwin-5.1.0/release/threading-multi/probing_hash_table_test...
...skipped <putil/bin/darwin-5.1.0/release/threading-multi>probing_hash_table_test.passed for lack of <putil/bin/darwin-5.1.0/release/threading-multi>probing_hash_table_test...
darwin.link util/bin/darwin-5.1.0/release/threading-multi/sorted_uniform_test
Undefined symbols for architecture x86_64:
"boost::unit_test::ut_detail::normalize_test_case_name[abi:cxx11](boost::unit_test::basic_cstring<char const)", referenced from:
boost::unit_test::make_test_case(boost::unit_test::callback0boost::unit_test::ut_detail::unused const&, boost::unit_test::basic_cstring) in sorted_uniform_test.o
"boost::test_tools::print_log_value::operator()(std::basic_ostream<char, std::char_traits >&, unsigned char)", referenced from:
boost::unit_test::lazy_ostream_impl<boost::test_tools::tt_detail::pr

[kpu]

Thanks for the log Rachel!

It looks like the code is being compiled as C++11 but being linked as C++98? For example, the code is looking for C++11 libraries but not finding them:

Undefined symbols for architecture x86_64:
"std::__cxx11::basic_string<char, std::char_traits, std::allocator >::reserve(unsigned long)",

Does your CFLAGS or CXXFLAGS contain "-std=c++11" ? Things to try:

1. LDFLAGS="-std=c++11" and rerun
   or
2. Pure C++98: remove -std=c++11 from the CFLAGS and CXXFLAGS.

[kpu]

Are you compiling this within Moses or from github.com/kpu/kenlm? Moses recently turned C++11 on, but the kenlm git repo uses C++98 by default. You can also email me directly at kenlm@kheafield.com.

[hieuhoang]

you might also want to compile with the following argument
toolset=clang
I've successfully compiled, the only things that breaks are the unit test, due to linking issues that have been seen in moses before. This is my exact command
./bjam --with-boost=/Users/hieu/workspace/boost/boost_1_56_0.clang/ -j4 toolset=clang
....
lm/bin/left_test.test/clang-darwin-4.2.1/release/link-static/threading-multi/left_test
ld: warning: directory not found for option '-L/Users/hieu/workspace/boost/boost_1_56_0.clang/lib'
Undefined symbols for architecture x86_64:
"boost::unit_test::unit_test_main(bool ()(), int, char*)", referenced from:
_main in left_test.o
ld: symbol(s) not found for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
......

[dowobeha]

The current kenlm master compiles cleanly (all unit tests pass) for me on Mac OS X 10.10.3 Yosemite, using boost 1.58 (installed using fink) with the command ./bjam --with-boost=/sw/opt/boost-1_58.

My g++ --version returns the following:
Apple LLVM version 6.1.0 (clang-602.0.53) (based on LLVM 3.6.0svn)

What versions of Mac OS X and g++ are you using?

[kpu]

Looks like clang 5.1.0?

[CapitalChi]

Hi everyone, sorry for not responding earlier, and I am very happy that you are taking the time to respond. Let me try your suggestions now.

[CapitalChi]

Also, I am compiling from github.com/kpu/kenlm, not using moses.

[CapitalChi]

My g++ --version gives me:
g++ (GCC) 5.1.0
Copyright (C) 2015 Free Software Foundation, Inc.

Mac OSX Yosemite 10.10.3

[kpu]

Oh, real gcc on OS X. Try adding the argument toolset=gcc ? Still confused as to why it's doing C++11 stuff though. Does a simple C++ program that uses std::string compile and link with -std=c++11?

[hieuhoang]

did u install gcc yourself? imo, it's a bad idea unless you're willing to deal with library/header issues like this. you're on a mac, use clang, get over it

[CapitalChi]

Hi everyone, just adding -toolset=clang did the trick for compiling. (I got over it; used Clang :) )

The only error that seems to remain now is importing kenlm in Python.

import kenlm
Traceback (most recent call last):
File "", line 1, in
ImportError: dlopen(/Users/jir955/klm/lib/python2.7/site-packages/kenlm.so, 2): Symbol not found: __ZTINSt8ios_base7failureB5cxx11E
Referenced from: /Users/jir955/klm/lib/python2.7/site-packages/kenlm.so
Expected in: dynamic lookup

Any ideas?

[kpu]

Looks like gcc being used to compile the python library? Try taking the setup.py commands and substituting clang. I don't know where Python gets the compiler from. setup.py does have g++ in it, but that's only a test.

[CapitalChi]

Hi Ken,
I've tried modifying the setup.py file in various ways (below)-- for example, setting up an environment, adding extra compiling arguments, doing both at the same time, everything I can think of. Also tried adding export CC=clang to my bashrc file. All of these produce the same error as before. I did check that the kenlm.so file exists.

Just to be clear, lmplz produce a correct-looking arpa file. It's the import kenlm that doesn't work (i.e. the python module).
Also, I brew uninstalled gcc in case that was causing the problem.

setup.py:

from distutils.core import setup
from distutils.extension import Extension
import glob
import platform
import os

os.environ["CC"] = "/usr/bin/clang"
os.environ["CXX"] = "/usr/bin/clang"

FILES = glob.glob('util/.cc') + glob.glob('lm/.cc') + glob.glob('util/double-conversion/*.cc')
FILES = [fn for fn in FILES if not (fn.endswith('main.cc') or fn.endswith('test.cc'))]

LIBS = ['z', 'stdc++']
if platform.system() != 'Darwin':
LIBS.append('rt')

ext_modules = [
Extension(name='kenlm',
sources=FILES + ['python/kenlm.cpp'],
language='C++',
include_dirs=['.'],
libraries=LIBS,
extra_compile_args=['-O3', '-DNDEBUG', '-DKENLM_MAX_ORDER=6','-toolset=/usr/bin/clang'])
]

setup(
name='kenlm',
ext_modules=ext_modules
)