인프런 커뮤니티 질문&답변

일단은 위 그림처럼 워크플로우가 실패하고요 

1번에서 테이블은 생성되고 select결과는 이상없는데

리눅스에 item-buy-list 디렉터리가 만들어지지도 않고 000000_0파일도 안만들어져요 ㅠㅠ

워크플로우 처음부터 다시 만들어보고 모든 프로그램 재시작도 해보고 서버 재시작도 해봤는데 똑같습니다 ㅠ

2번 잡이 자꾸 오류나는데 정확한 오류 내용은 아래와 같습니다.!

-default

Main Class [org.apache.oozie.action.hadoop.Hive2Main], exit code [2]

-stdout

~생략~
=================================================================

>>> Invoking Beeline command line now >>>


<<< Invocation of Beeline command completed <<<

Hadoop Job IDs executed by Beeline: job_1620654879222_0005

java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.oozie.action.hadoop.LauncherAM.runActionMain(LauncherAM.java:410)
	at org.apache.oozie.action.hadoop.LauncherAM.access$300(LauncherAM.java:55)
	at org.apache.oozie.action.hadoop.LauncherAM$2.run(LauncherAM.java:223)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875)
	at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:217)
	at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:153)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875)
	at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:141)
Caused by: java.lang.SecurityException: Intercepted System.exit(2)
	at org.apache.oozie.action.hadoop.security.LauncherSecurityManager.checkExit(LauncherSecurityManager.java:57)
	at java.lang.Runtime.exit(Runtime.java:107)
	at java.lang.System.exit(System.java:971)
	at org.apache.oozie.action.hadoop.Hive2Main.runBeeline(Hive2Main.java:273)
	at org.apache.oozie.action.hadoop.Hive2Main.run(Hive2Main.java:250)
	at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:104)
	at org.apache.oozie.action.hadoop.Hive2Main.main(Hive2Main.java:65)
	... 16 more
Intercepting System.exit(2)
Failing Oozie Launcher, Main Class [org.apache.oozie.action.hadoop.Hive2Main], exit code [2]
Oozie Launcher, uploading action data to HDFS sequence file: hdfs://server01.hadoop.com:8020/user/admin/oozie-oozi/0000000-210510225532555-oozie-oozi-W/hive-ae83--hive2/action-data.seq
Stopping AM
Callback notification attempts left 0
Callback notification trying http://server02.hadoop.com:11000/oozie/callback?id=0000000-210510225532555-oozie-oozi-W@hive-ae83&status=FAILED
Callback notification to http://server02.hadoop.com:11000/oozie/callback?id=0000000-210510225532555-oozie-oozi-W@hive-ae83&status=FAILED succeeded
Callback notification succeeded

-stderr

~생략~
INFO  : 2021-05-10 22:59:59,830 Stage-1 map = 0%,  reduce = 0%
INFO  : 2021-05-10 23:00:08,289 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 2.29 sec
INFO  : 2021-05-10 23:00:22,236 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 5.16 sec
INFO  : MapReduce Total cumulative CPU time: 5 seconds 160 msec
INFO  : Ended Job = job_1620654879222_0005
INFO  : Starting task [Stage-0:MOVE] in serial mode
INFO  : Moving data to local directory /home/pilot-pjt/item-buy-list from hdfs://server01.hadoop.com:8020/tmp/hive/admin/f218517c-6d76-45de-8e87-84b71fc23367/hive_2021-05-10_22-59-45_407_3168538147024318726-3/-mr-10000
ERROR : FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. Unable to move source hdfs://server01.hadoop.com:8020/tmp/hive/admin/f218517c-6d76-45de-8e87-84b71fc23367/hive_2021-05-10_22-59-45_407_3168538147024318726-3/-mr-10000 to destination /home/pilot-pjt/item-buy-list
INFO  : MapReduce Jobs Launched: 
INFO  : Stage-Stage-1: Map: 1  Reduce: 1   Cumulative CPU: 5.16 sec   HDFS Read: 5659317 HDFS Write: 490938 HDFS EC Read: 0 SUCCESS
INFO  : Total MapReduce CPU Time Spent: 5 seconds 160 msec
INFO  : Completed executing command(queryId=hive_20210510225945_c6f3077a-4f98-4f93-9c78-bfde752cbb1d); Time taken: 37.539 seconds
Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. Unable to move source hdfs://server01.hadoop.com:8020/tmp/hive/admin/f218517c-6d76-45de-8e87-84b71fc23367/hive_2021-05-10_22-59-45_407_3168538147024318726-3/-mr-10000 to destination /home/pilot-pjt/item-buy-list (state=08S01,code=1)
Closing: 0: jdbc:hive2://server02.hadoop.com:10000/default

-syslog

            Unable to locate 'syslog' log for container container_1620654879222_0004_01_000001

참고로 하이브쿼리는 선생님 코드 모두 복붙했고요 워크플로우는 아래와 같습니다!

가르침주시면 감사하겠습니다 ㅎㅎ