kafka consumer에서 데이터를 못 읽는데요.

car-batch-log 폴더에 SmartCarStatusInfo_20160101.txt 를 mv 하면 삭제되는데 왜 그럴까요?

kafka consumer에서 데이터를 못 읽는데요.

왜 반복해서 mv 해도 삭제가 될까요? ---------------------------------------------------- [root@server02 driver-realtime-log]# mv /home/pilot-pjt/working/SmartCar/SmartCarStatusInfo_20160101.txt /home/pilot-pjt/working/car-batch-log/ [root@server02 driver-realtime-log]# cd /home/pilot-pjt/working/car-batch-log/ [root@server02 car-batch-log]# ls -ltr total 0

Hbase에 데이터 적재가 되지 않습니다...

위에 가이드대로 진행해보면 --------------------------------------------------- $ zookeeper-client [zk: ...] ls /brokers/topics/SmartCar-Topic/partitions/ 위 SmartCar-Topic Z노드가 확인이 되었으면 큰 문제는 없습니다. 그냥 아래 순서대로 스톰 토폴로지를 재배포 후 테스트 해보시기 바랍니다. => 아래와 같이 메시지 나옵니다. [zk: localhost:2181(CONNECTED) 0] ls /brokers/topics/SmartCar-Topic/partitions/ Command failed: java.lang.IllegalArgumentException: Path must not end with / character --------------------------------------------------------- 8. 스톰 토폴로지 배포 => 아래와 같이 메시지 나옵니다. [root@server02 working]# storm jar bigdata.smartcar.storm-1.0.jar com.wikibook.bigdata.smartcar.storm.SmartCarTopology DriverCarInfo SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/pilot-pjt/apache-storm-1.2.3/lib/log4j-slf4j-impl-2.8.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/pilot-pjt/working/bigdata.smartcar.storm-1.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Running: java -client -Ddaemon.name= -Dstorm.options= -Dstorm.home=/home/pilot-pjt/apache-storm-1.2.3 -Dstorm.log.dir=/home/pilot-pjt/apache-storm-1.2.3/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /home/pilot-pjt/apache-storm-1.2.3/*:/home/pilot-pjt/apache-storm-1.2.3/lib/*:/home/pilot-pjt/apache-storm-1.2.3/extlib/*:bigdata.smartcar.storm-1.0.jar:/home/pilot-pjt/storm/conf:/home/pilot-pjt/apache-storm-1.2.3/bin -Dstorm.jar=bigdata.smartcar.storm-1.0.jar -Dstorm.dependency.jars= -Dstorm.dependency.artifacts={} com.wikibook.bigdata.smartcar.storm.SmartCarTopology DriverCarInfo Error: Could not find or load main class com.wikibook.bigdata.smartcar.storm.SmartCarTopology

Hbase에 데이터 적재가 되지 않습니다...

저도 동일 증상인데 위에 가이드 3번의 Storm UI 에서 보면 카운트가 증가하지 않는것 같고 4번의 데이터도 안들어오는것 같습니다.

install: cannot stat `redis-server': No such file or directory

교육자료의 아래 내용을 실행해도 동일합니다. Tip. yum install 명령시 "removing mirrorlist with no valid mirrors:.." 발생하면 아래 명령 실행 $ rm /etc/yum.repos.d/cloudera-manager.repo $ echo "http://vault.centos.org/6.10/os/x86_64/" > /var/cache/yum/x86_64/6/base/mirrorlist.txt $ echo "http://vault.centos.org/6.10/extras/x86_64/" > /var/cache/yum/x86_64/6/extras/mirrorlist.txt $ echo "http://vault.centos.org/6.10/updates/x86_64/" > /var/cache/yum/x86_64/6/updates/mirrorlist.txt

install: cannot stat `redis-server': No such file or directory

Redis 설치시 오류납니다. ----------------------------------------------------- login as: root root@192.168.56.102's password: Last login: Wed Aug 11 17:04:22 2021 from 192.168.56.1 [root@server02 ~]# yum install -y gcc* Loaded plugins: fastestmirror, refresh-packagekit, security Setting up Install Process Determining fastest mirrors YumRepo Error: All mirror URLs are not using ftp, http[s] or file. Eg. Invalid release/repo/arch combination/ removing mirrorlist with no valid mirrors: /var/cache/yum/x86_64/6/updates/mirrorlist.txt Error: Cannot find a valid baseurl for repo: updates [root@server02 ~]#