Saliya's Blogs

Mostly technical stuff with some interesting moments of life

GLIBCXX_3.4.9 Could Not Be Found with Apache Spark

If you encounter an error similar to the following, which complains that GLIBCXX_3.4.9 could not be found, while running an application with Apache Spark you can avoid this by switching Spark's compression method from snappy to something such aslzf.
Caused by: java.lang.UnsatisfiedLinkError: .../ /usr/lib64/ version `GLIBCXX_3.4.9' not found (required by.../
There are a few ways how one can pass configuration options to Spark. The naive way seems to be through command line as,
--conf ""
On a side note, you can find what GLIBC versions are available by running strings /usr/lib/ | grep GLIBC


Post a Comment