llava-cli fails to build on M2 due to symbol(s) not found for architecture arm64

[Laz4rz]

Running:

make llava-cli 

results in:

(mc) ➜  llava git:(master) make llava-cli
cc   llava-cli.o   -o llava-cli
Undefined symbols for architecture arm64:
  "llama_tokenize(llama_context const*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, bool, bool)", referenced from:
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      eval_string(llama_context*, char const*, int, int*, bool) in llava-cli.o
  "gpt_print_usage(int, char**, gpt_params const&)", referenced from:
      _main in llava-cli.o
  "gpt_params_parse(int, char**, gpt_params&)", referenced from:
      _main in llava-cli.o
  "get_math_cpu_count()", referenced from:
      gpt_params::gpt_params() in llava-cli.o
  "llama_sampling_free(llama_sampling_context*)", referenced from:
      _main in llava-cli.o
  "llama_sampling_init(llama_sampling_params const&)", referenced from:
      _main in llava-cli.o
  "llama_token_to_piece(llama_context const*, int, bool)", referenced from:
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      ...
  "llama_sampling_accept(llama_sampling_context*, llama_context*, int, bool)", referenced from:
      _main in llava-cli.o
  "llama_sampling_sample(llama_sampling_context*, llama_context*, llama_context*, int)", referenced from:
      _main in llava-cli.o
  "llama_model_params_from_gpt_params(gpt_params const&)", referenced from:
      _main in llava-cli.o
  "llama_context_params_from_gpt_params(gpt_params const&)", referenced from:
      _main in llava-cli.o
  "std::runtime_error::what() const", referenced from:
      vtable for base64_error in llava-cli.o
  "std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>::find(char, unsigned long) const", referenced from:
      log_dump_cmdline_impl(int, char**) in llava-cli.o
  "std::__1::basic_stringbuf<char, std::__1::char_traits<char>, std::__1::allocator<char>>::str() const", referenced from:
      log_filename_generator_impl(LogTriState, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) in llava-cli.o
      log_dump_cmdline_impl(int, char**) in llava-cli.o
      log_get_pid() in llava-cli.o
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
  "std::__1::locale::use_facet(std::__1::locale::id&) const", referenced from:
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::__put_character_sequence[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, char const*, unsigned long) in llava-cli.o
  "std::__1::ios_base::getloc() const", referenced from:
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::__put_character_sequence[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, char const*, unsigned long) in llava-cli.o
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
  "std::logic_error::logic_error(char const*)", referenced from:
      std::length_error::length_error[abi:ue170006](char const*) in llava-cli.o
      std::out_of_range::out_of_range[abi:ue170006](char const*) in llava-cli.o
  "std::length_error::~length_error()", referenced from:
      std::__1::__throw_length_error[abi:ue170006](char const*) in llava-cli.o
  "std::out_of_range::~out_of_range()", referenced from:
      std::__1::__throw_out_of_range[abi:ue170006](char const*) in llava-cli.o
  "std::runtime_error::runtime_error(char const*)", referenced from:
      base64_error::base64_error(char const*) in llava-cli.o
  "std::runtime_error::~runtime_error()", referenced from:
      base64_error::~base64_error() in llava-cli.o
      base64_error::~base64_error() in llava-cli.o
  "std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>::append(char const*)", referenced from:
      _main in llava-cli.o
  "std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>::append(char const*, unsigned long)", referenced from:
      _main in llava-cli.o
  "std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>::assign(char const*)", referenced from:
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
  "std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>::basic_string(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&)", referenced from:
      log_handler1_impl(bool, LogTriState, LogTriState, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, __sFILE*) in llava-cli.o
  "std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>::~basic_string()", referenced from:
      _main in llava-cli.o
      log_handler1_impl(bool, LogTriState, LogTriState, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, __sFILE*) in llava-cli.o
      log_get_pid() in llava-cli.o
  "std::__1::basic_ostream<char, std::__1::char_traits<char>>::sentry::sentry(std::__1::basic_ostream<char, std::__1::char_traits<char>>&)", referenced from:
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::__put_character_sequence[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, char const*, unsigned long) in llava-cli.o
  "std::__1::basic_ostream<char, std::__1::char_traits<char>>::sentry::~sentry()", referenced from:
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::__put_character_sequence[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, char const*, unsigned long) in llava-cli.o
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::__put_character_sequence[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, char const*, unsigned long) in llava-cli.o
  "std::__1::basic_ostream<char, std::__1::char_traits<char>>::~basic_ostream()", referenced from:
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
      std::__1::basic_ostringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>::~basic_ostringstream() in llava-cli.o
  "std::__1::basic_ostream<char, std::__1::char_traits<char>>::operator<<(void const*)", referenced from:
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
  "std::__1::basic_iostream<char, std::__1::char_traits<char>>::~basic_iostream()", referenced from:
      log_filename_generator_impl(LogTriState, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) in llava-cli.o
      log_dump_cmdline_impl(int, char**) in llava-cli.o
      std::__1::basic_stringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>::basic_stringstream[abi:ue170006]() in llava-cli.o
      log_get_pid() in llava-cli.o
      std::__1::basic_stringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>::~basic_stringstream() in llava-cli.o
  "std::__1::basic_streambuf<char, std::__1::char_traits<char>>::basic_streambuf()", referenced from:
      std::__1::basic_stringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>::basic_stringstream[abi:ue170006]() in llava-cli.o
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
  "std::__1::basic_streambuf<char, std::__1::char_traits<char>>::~basic_streambuf()", referenced from:
      log_filename_generator_impl(LogTriState, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) in llava-cli.o
      log_dump_cmdline_impl(int, char**) in llava-cli.o
      log_get_pid() in llava-cli.o
      std::__1::basic_stringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>::~basic_stringstream() in llava-cli.o
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
      std::__1::basic_ostringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>::~basic_ostringstream() in llava-cli.o
  "std::__1::ctype<char>::id", referenced from:
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::__put_character_sequence[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, char const*, unsigned long) in llava-cli.o
  "std::__1::chrono::system_clock::now()", referenced from:
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      ...
  "std::__1::locale::classic()", referenced from:
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
  "std::__1::locale::locale(std::__1::locale const&)", referenced from:
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
  "std::__1::locale::~locale()", referenced from:
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::__put_character_sequence[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, char const*, unsigned long) in llava-cli.o
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::__put_character_sequence[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, char const*, unsigned long) in llava-cli.o
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
  "std::__1::locale::operator=(std::__1::locale const&)", referenced from:
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
  "std::__1::ios_base::__set_badbit_and_consider_rethrow()", referenced from:
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::__put_character_sequence[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, char const*, unsigned long) in llava-cli.o
  "std::__1::ios_base::init(void*)", referenced from:
      std::__1::basic_stringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>::basic_stringstream[abi:ue170006]() in llava-cli.o
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
  "std::__1::ios_base::clear(unsigned int)", referenced from:
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::__put_character_sequence[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, char const*, unsigned long) in llava-cli.o
  "std::__1::ios_base::imbue(std::__1::locale const&)", referenced from:
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
  "std::__1::basic_ios<char, std::__1::char_traits<char>>::~basic_ios()", referenced from:
      log_filename_generator_impl(LogTriState, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) in llava-cli.o
      log_dump_cmdline_impl(int, char**) in llava-cli.o
      std::__1::basic_stringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>::basic_stringstream[abi:ue170006]() in llava-cli.o
      log_get_pid() in llava-cli.o
      std::__1::basic_stringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>::~basic_stringstream() in llava-cli.o
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
      ...
  "std::terminate()", referenced from:
      ___clang_call_terminate in llava-cli.o
  "typeinfo for std::length_error", referenced from:
      std::__1::__throw_length_error[abi:ue170006](char const*) in llava-cli.o
  "typeinfo for std::out_of_range", referenced from:
      std::__1::__throw_out_of_range[abi:ue170006](char const*) in llava-cli.o
  "typeinfo for std::runtime_error", referenced from:
      typeinfo for base64_error in llava-cli.o
  "VTT for std::__1::basic_stringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>", referenced from:
      log_filename_generator_impl(LogTriState, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) in llava-cli.o
      log_dump_cmdline_impl(int, char**) in llava-cli.o
      std::__1::basic_stringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>::basic_stringstream[abi:ue170006]() in llava-cli.o
      log_get_pid() in llava-cli.o
      std::__1::basic_stringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>::~basic_stringstream() in llava-cli.o
  "VTT for std::__1::basic_ostringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>", referenced from:
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
      std::__1::basic_ostringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>::~basic_ostringstream() in llava-cli.o
  "vtable for __cxxabiv1::__si_class_type_info", referenced from:
      typeinfo for base64_error in llava-cli.o
   NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
  "vtable for std::__1::basic_stringbuf<char, std::__1::char_traits<char>, std::__1::allocator<char>>", referenced from:
      log_filename_generator_impl(LogTriState, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) in llava-cli.o
      log_dump_cmdline_impl(int, char**) in llava-cli.o
      std::__1::basic_stringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>::basic_stringstream[abi:ue170006]() in llava-cli.o
      log_get_pid() in llava-cli.o
      std::__1::basic_stringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>::~basic_stringstream() in llava-cli.o
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
      std::__1::basic_ostringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>::~basic_ostringstream() in llava-cli.o
      ...
   NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
  "vtable for std::__1::basic_stringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>", referenced from:
      std::__1::basic_stringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>::basic_stringstream[abi:ue170006]() in llava-cli.o
   NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
  "vtable for std::__1::basic_ostringstream<char, std::__1::char_traits<char>, std::__1::allocator<char>>", referenced from:
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::operator<<[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, std::__1::__thread_id) in llava-cli.o
   NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
  "vtable for std::length_error", referenced from:
      std::length_error::length_error[abi:ue170006](char const*) in llava-cli.o
   NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
  "vtable for std::out_of_range", referenced from:
      std::out_of_range::out_of_range[abi:ue170006](char const*) in llava-cli.o
   NOTE: a missing vtable usually means the first non-inline virtual member function has no definition.
  "operator delete(void*)", referenced from:
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      ...
  "operator new(unsigned long)", referenced from:
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      _main in llava-cli.o
      ...
  "___cxa_allocate_exception", referenced from:
      std::__1::__throw_length_error[abi:ue170006](char const*) in llava-cli.o
      std::__1::__wrap_iter<unsigned char*> base64::decode<std::__1::__wrap_iter<char*>, std::__1::__wrap_iter<unsigned char*>>(std::__1::__wrap_iter<char*>, std::__1::__wrap_iter<char*>, std::__1::__wrap_iter<unsigned char*>, base64::alphabet, base64::decoding_behavior) in llava-cli.o
      std::__1::__throw_out_of_range[abi:ue170006](char const*) in llava-cli.o
      base64::_base64_value(base64::alphabet&, char) in llava-cli.o
  "___cxa_begin_catch", referenced from:
      ___clang_call_terminate in llava-cli.o
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::__put_character_sequence[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, char const*, unsigned long) in llava-cli.o
  "___cxa_end_catch", referenced from:
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::__put_character_sequence[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, char const*, unsigned long) in llava-cli.o
      std::__1::basic_ostream<char, std::__1::char_traits<char>>& std::__1::__put_character_sequence[abi:ue170006]<char, std::__1::char_traits<char>>(std::__1::basic_ostream<char, std::__1::char_traits<char>>&, char const*, unsigned long) in llava-cli.o
  "___cxa_free_exception", referenced from:
      std::__1::__throw_length_error[abi:ue170006](char const*) in llava-cli.o
      std::__1::__wrap_iter<unsigned char*> base64::decode<std::__1::__wrap_iter<char*>, std::__1::__wrap_iter<unsigned char*>>(std::__1::__wrap_iter<char*>, std::__1::__wrap_iter<char*>, std::__1::__wrap_iter<unsigned char*>, base64::alphabet, base64::decoding_behavior) in llava-cli.o
      std::__1::__throw_out_of_range[abi:ue170006](char const*) in llava-cli.o
      base64::_base64_value(base64::alphabet&, char) in llava-cli.o
  "___cxa_guard_abort", referenced from:
      log_handler1_impl(bool, LogTriState, LogTriState, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, __sFILE*) in llava-cli.o
  "___cxa_guard_acquire", referenced from:
      _main in llava-cli.o
      log_handler1_impl(bool, LogTriState, LogTriState, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, __sFILE*) in llava-cli.o
      log_handler1_impl(bool, LogTriState, LogTriState, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, __sFILE*) in llava-cli.o
      log_handler1_impl(bool, LogTriState, LogTriState, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, __sFILE*) in llava-cli.o
      log_get_pid() in llava-cli.o
  "___cxa_guard_release", referenced from:
      _main in llava-cli.o
      log_handler1_impl(bool, LogTriState, LogTriState, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, __sFILE*) in llava-cli.o
      log_handler1_impl(bool, LogTriState, LogTriState, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, __sFILE*) in llava-cli.o
      log_handler1_impl(bool, LogTriState, LogTriState, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, __sFILE*) in llava-cli.o
      log_get_pid() in llava-cli.o
  "___cxa_throw", referenced from:
      std::__1::__throw_length_error[abi:ue170006](char const*) in llava-cli.o
      std::__1::__wrap_iter<unsigned char*> base64::decode<std::__1::__wrap_iter<char*>, std::__1::__wrap_iter<unsigned char*>>(std::__1::__wrap_iter<char*>, std::__1::__wrap_iter<char*>, std::__1::__wrap_iter<unsigned char*>, base64::alphabet, base64::decoding_behavior) in llava-cli.o
      std::__1::__throw_out_of_range[abi:ue170006](char const*) in llava-cli.o
      base64::_base64_value(base64::alphabet&, char) in llava-cli.o
  "___gxx_personality_v0", referenced from:
      /Users/mikolajboronski/github/llama.cpp/examples/llava/llava-cli.o
  "_clip_free", referenced from:
      _main in llava-cli.o
  "_clip_model_load", referenced from:
      _main in llava-cli.o
  "_ggml_time_init", referenced from:
      _main in llava-cli.o
  "_llama_backend_free", referenced from:
      _main in llava-cli.o
  "_llama_backend_init", referenced from:
      _main in llava-cli.o
  "_llama_batch_get_one", referenced from:
      eval_tokens(llama_context*, std::__1::vector<int, std::__1::allocator<int>>, int, int*) in llava-cli.o
  "_llama_decode", referenced from:
      eval_tokens(llama_context*, std::__1::vector<int, std::__1::allocator<int>>, int, int*) in llava-cli.o
  "_llama_free", referenced from:
      _main in llava-cli.o
  "_llama_free_model", referenced from:
      _main in llava-cli.o
  "_llama_get_model", referenced from:
      _main in llava-cli.o
  "_llama_load_model_from_file", referenced from:
      _main in llava-cli.o
  "_llama_log_set", referenced from:
      _main in llava-cli.o
  "_llama_new_context_with_model", referenced from:
      _main in llava-cli.o
  "_llama_numa_init", referenced from:
      _main in llava-cli.o
  "_llama_print_timings", referenced from:
      _main in llava-cli.o
  "_llama_token_is_eog", referenced from:
      _main in llava-cli.o
  "_llava_eval_image_embed", referenced from:
      _main in llava-cli.o
  "_llava_image_embed_free", referenced from:
      _main in llava-cli.o
  "_llava_image_embed_make_with_bytes", referenced from:
      _main in llava-cli.o
  "_llava_image_embed_make_with_filename", referenced from:
      _main in llava-cli.o
ld: symbol(s) not found for architecture arm64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make: *** [<builtin>: llava-cli] Error 1

I tried updating clang and make. Doesn't change the outcome. Can make llama normally.

(mc) ➜  llava git:(master) make --version
GNU Make 4.4.1
Built for aarch64-apple-darwin23.0.0
Copyright (C) 1988-2023 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <https://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.

(mc) ➜  llava git:(master) clang --version
Apple clang version 15.0.0 (clang-1500.3.9.4)
Target: arm64-apple-darwin23.4.0
Thread model: posix
InstalledDir: /Library/Developer/CommandLineTools/usr/bin

[arnfaldur]

Are you still having this issue?

Does it occur on the current head of the master branch with a clean repo?

Does it occur if you just run make instead of make llava-cli? Just running make should also make llava-cli.

[github-actions[bot]]

This issue was closed because it has been inactive for 14 days since being marked as stale.