NodeManager, ResourceManager를 실행한 이후, Port 확인을 해보니 실행이 안되어 있음.
[hadoop@localhost ~]$ jps
25168 DataNode
28067 Jps
25050 NameNode
25390 SecondaryNameNode
로그를 확인해 보니 오류가 발생함.
2020-04-08 00:23:03,168 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager
org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server
.
.
.
생략
.
.
.
Caused by: java.lang.ClassNotFoundException: javax.activation.DataSource
at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:521)
** 조치방안
jdk 11 버전에는 없는 activation 라이브러리를 추가
/share/hadoop/mapreduce/lib 하위에 라이브러리 추가
[hadoop@localhost ~/hadoop-3.2.1/share/hadoop/mapreduce/lib]$ ls -al
합계 288
drwxr-xr-x. 2 hadoop hadoop 57 9월 11 2019 .
drwxr-xr-x. 6 hadoop hadoop 4096 9월 11 2019 ..
-rw-r--r--. 1 hadoop hadoop 45024 9월 11 2019 hamcrest-core-1.3.jar
-rw-r--r--. 1 hadoop hadoop 245039 9월 11 2019 junit-4.11.jar
[hadoop@localhost ~/hadoop-3.2.1/share/hadoop/mapreduce/lib]$ wget https://repo1.maven.org/maven2/javax/activation/activation/1.1.1/activation-1.1.1.jar
--2020-04-08 00:41:32-- https://repo1.maven.org/maven2/javax/activation/activation/1.1.1/activation-1.1.1.jar
Resolving repo1.maven.org (repo1.maven.org)... 151.101.24.209
Connecting to repo1.maven.org (repo1.maven.org)|151.101.24.209|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 69409 (68K) [application/java-archive]
Saving to: ‘activation-1.1.1.jar’
100%[===================================================================================================================>] 69,409 230KB/s in 0.3s
2020-04-08 00:41:33 (230 KB/s) - ‘activation-1.1.1.jar’ saved [69409/69409]
[hadoop@localhost ~/hadoop-3.2.1/share/hadoop/mapreduce/lib]$ l
합계 356
drwxr-xr-x. 2 hadoop hadoop 85 4월 8 00:41 .
drwxr-xr-x. 6 hadoop hadoop 4096 9월 11 2019 ..
-rw-rw-r--. 1 hadoop hadoop 69409 10월 24 2009 activation-1.1.1.jar
-rw-r--r--. 1 hadoop hadoop 45024 9월 11 2019 hamcrest-core-1.3.jar
-rw-r--r--. 1 hadoop hadoop 245039 9월 11 2019 junit-4.11.jar
** YARN 재실행
[hadoop@localhost ~/hadoop-3.2.1/share/hadoop/mapreduce/lib]$ stop-yarn.sh
Stopping nodemanagers
Stopping resourcemanager
[hadoop@localhost ~/hadoop-3.2.1/share/hadoop/mapreduce/lib]$ start-yarn.sh
Starting resourcemanager
Starting nodemanagers
[hadoop@localhost ~/hadoop-3.2.1/share/hadoop/mapreduce/lib]$ jps
25168 DataNode
28723 NodeManager
29094 Jps
25050 NameNode
25390 SecondaryNameNode
28606 ResourceManager