인프런 커뮤니티 질문&답변

안녕하세요 선생님!

어찌저찌 해서 문제는 해결 되었습니다

보내주신 workflow 로 교체를 해도 이전 내용으로 원복되는 현상이 있었어요

그래서 생성했던 workflow 와 예약을 제거하고 재생성해서 해결을 했습니다....

어리둥절 하네요

문제 해결에 고민 같이 해주셔서 감사드립니다

남은 주말 즐겁게 보내세요!!

선생님 안녕하세요!

workflow-app 태그에 name 속성에 특수문자가 있는 것은

요 에디터로 붙여넣기 하면서 생긴 것 같습니다

실제 파일에는 특수문자가 없습니다..ㅠㅠ

그래도 혹시나 싶어서 xml 파일의 name 속성의 값을 완전히 지우고 다시 입력한 뒤에

실행읋 해보았지만 동일한 에러가 나타나네요...ㅠㅠ

다른 방법이 있을까요...??

좋은하루 보내세요~!

감사합니다.

안녕하세요 선생님!

말씀해주신 내용들 보내드립니다

다만 .sql 파일이 2개가 아닌 3개가 생성되어 있어서.. 일단은 다 보내드립니다!

(workflow.xml 을 보면 2개만 사용하는 거 같긴 하지만 혹시 몰라서요ㅎㅎ)

좋은 밤 되세요!

workflow.xml

<workflow-app name="Subject3 - Workflow" xmlns="uri:oozie:workflow:0.5">
    <start to="hive-a283"/>
    <kill name="Kill">
        <message>작업 실패, 오류 메시지[${wf:errorMessage(wf:lastErrorNode())}]</message>
    </kill>
    <action name="hive-a283" cred="hive2">
        <hive2 xmlns="uri:oozie:hive2-action:0.1">
            <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode}</name-node>
            <jdbc-url>jdbc:hive2://server02.hadoop.com:10000/default</jdbc-url>
            <script>${wf:appPath()}/hive-a283.sql</script>
        </hive2>
        <ok to="hive-340f"/>
        <error to="Kill"/>
    </action>
    <action name="hive-340f" cred="hive2">
        <hive2 xmlns="uri:oozie:hive2-action:0.1">
            <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode}</name-node>
            <jdbc-url>jdbc:hive2://server02.hadoop.com:10000/default</jdbc-url>
            <script>${wf:appPath()}/hive-340f.sql</script>
              <param>working_day=20200322</param>
        </hive2>
        <ok to="End"/>
        <error to="Kill"/>
    </action>
    <end name="End"/>
</workflow-app>

hive-207f.sql

USE default;

insert into table Managed_SmartCar_Symptom_Info
select
    t1.car_number,
    t1.speed_p_avg_by_carnum,
    case
        when (abs((t1.speed_p_avg_by_carnum - t3.speed_p_avg) / t4.speed_p_std)) > 2
            then 'abnormal'
        else 'normal'
    end
    as speed_p_symptom_score,
    t1.break_p_avg_by_carnum,
    case
        when (abs((t1.break_p_avg_by_carnum - t3.break_p_avg) / t4.break_p_std)) > 2
            then 'abnormal'
        else 'normal'
    end
    as break_p_symptom_score,
    t2.steer_a_count,
    case
        when (t2.steer_a_count) > 2000
            then 'abnormal'
        else 'normal'
    end
    as steer_p_symptom_score,
    t1.biz_date
from 
    (select car_number,
            biz_date,
            avg(speed_pedal) as speed_p_avg_by_carnum,
            avg(break_pedal) as break_p_avg_by_carnum
    from managed_smartcar_drive_info
    where biz_date = '${working_day}'
    group by car_number, biz_date) t1
join
    (select car_number,
            count(*) as steer_a_count
    from managed_smartcar_drive_info
    where steer_angle in ('L2', 'L3', 'R2', 'R3') and
            biz_date = '${working_day}'
    group by car_number) t2
on
    t1.car_number = t2.car_number,
    (select avg(speed_pedal) as speed_p_avg,
            avg(break_pedal) as break_p_avg
    from managed_smartcar_drive_info) t3,
    (select stddev_pop(s.speed_p_avg_by_carnum) as speed_p_std,
            stddev_pop(s.break_p_avg_by_carnum) as break_p_std
    from (select car_number,
                 avg(speed_pedal) as speed_p_avg_by_carnum,
                 avg(break_pedal) as break_p_avg_by_carnum
         from managed_smartcar_drive_info
         group by car_number) s) t4

hive-340f.sql

USE default;

insert into table Managed_SmartCar_Symptom_Info
select
    t1.car_number,
    t1.speed_p_avg_by_carnum,
    case
        when (abs((t1.speed_p_avg_by_carnum - t3.speed_p_avg) / t4.speed_p_std)) > 2
            then 'abnormal'
        else 'normal'
    end
    as speed_p_symptom_score,
    t1.break_p_avg_by_carnum,
    case
        when (abs((t1.break_p_avg_by_carnum - t3.break_p_avg) / t4.break_p_std)) > 2
            then 'abnormal'
        else 'normal'
    end
    as break_p_symptom_score,
    t2.steer_a_count,
    case
        when (t2.steer_a_count) > 2000
            then 'abnormal'
        else 'normal'
    end
    as steer_p_symptom_score,
    t1.biz_date
from 
    (select car_number,
            biz_date,
            avg(speed_pedal) as speed_p_avg_by_carnum,
            avg(break_pedal) as break_p_avg_by_carnum
    from managed_smartcar_drive_info
    where biz_date = '${working_day}'
    group by car_number, biz_date) t1
join
    (select car_number,
            count(*) as steer_a_count
    from managed_smartcar_drive_info
    where steer_angle in ('L2', 'L3', 'R2', 'R3') and
            biz_date = '${working_day}'
    group by car_number) t2
on
    t1.car_number = t2.car_number,
    (select avg(speed_pedal) as speed_p_avg,
            avg(break_pedal) as break_p_avg
    from managed_smartcar_drive_info) t3,
    (select stddev_pop(s.speed_p_avg_by_carnum) as speed_p_std,
            stddev_pop(s.break_p_avg_by_carnum) as break_p_std
    from (select car_number,
                 avg(speed_pedal) as speed_p_avg_by_carnum,
                 avg(break_pedal) as break_p_avg_by_carnum
         from managed_smartcar_drive_info
         group by car_number) s) t4;

hive-a283.sql

USE default;

create table if not exists Managed_SmartCar_Symptom_Info (
    car_number string,
    speed_p_avg string,
    speed_p_symptom string,
    break_p_avg string,
    break_p_symptom string,
    steer_a_cnt string,
    steer_p_symptom string,
    biz_date string
)
row format delimited
fields terminated by ','
stored as textfile;

안녕하세요 선생님!

요청해주신 워크플로우 스샷을 캡쳐해서 보내드립니다!

좋은 하루 보내세요!

감사합니다

안녕하세요! "chul kim"님!

올려주신 내용만으로 문제의 원인 파악이 어려워 보입니다. ^^;;;

혹시 작성하신 주제영역3의 워크플로우를 캡쳐해서 올려 주실 수 있는지요?! - 빅디 드림