special thanks to my lovely students 👨🏻🎓* appreciate it, believe you'll do well anywhere 👩🏻🎓
데이터 처리 이론 및 실습 빅데이터 파이프라인의 핵심!
안녕하세요, J.PHIL 입니다 🙇🏻 좋은 기회를 맞이하여 인프런에서 첫 강의로 빅데이터 시스템 구축 및 분석에 관심있는 입문자를 위해 ‘데이터 처리 이론 및 실습’ 강의를 진행하게 되었습니다.
한눈에 보는 핵심 키워드
Mastering Big Data Processing: Tools and Techniques for Success
Distributed System
Apache Spark
HDFS
Elasticsearch
Logstash
Kibana
Crawler
Scraping
Selenium
AWS S3
Node.js
Docker
우리는 왜 이 강의를 들어야 할까요? 📚
최근 약 10년 동안의 급진적인 기술 발전으로 인해 다양한 플랫폼과 서비스가 생겨나고, 다양한 고객들이 그 위에서 질 높은 삶을 영위하고 있습니다. 이에 우후죽순으로 발생하는 데이터 가운데 많은 기업들이 그 중에서 가치 있는 데이터를 발굴하고 추출하여 BM(Business Model)을 설계함으로써 좀 더 우리에게 가치있는 삶을 제공하고 있습니다.
이런 환경에서 저희 엔지니어들👷🏻이 “감히 미래를 예측하고 대응한다면” What and How 준비해야 할까요? 바로 데이터를 관리하고 다루는 능력을 길러야 합니다. 역으로 여러분이 데이터를 잘 다루게 되고 더불어 잘 표현까지 할 수 있다면, 산업에 어떤 점들을 기여할 수 있을까요?
Data-driven decision-making
💡 빅데이터 분석을 통해 조직은 데이터 중심 의사 결정을 내릴 수 있으며, 이를 통해 비즈니스 결과를 개선할 수 있습니다.
Increased efficiency and productivity
💡 빅데이터 분석을 통해 조직은 운영을 간소화하고, 비용을 절감하며, 생산성을 높일 수 있습니다.
Innovation
💡 빅데이터 분석은 기업이 새로운 제품과 서비스를 개발하고, 기존 제품과 서비스를 개선하고, 새로운 비즈니스 모델을 만들 수 있도록 함으로써 혁신을 촉진할 수 있습니다.
그래서 이 강의는 어떻게 구성되어 있나요? 📑
📝
Data Top-Tier Conference 논문을 땀흘려 쓴 경험
👨🏻💼
현업에서 얻은 값진 빅데이터 시스템 구축 및 분석 경험
🧑🏻🏫
오랫동안 대학교에서 좋은 제자들을 양성한 경험
이처럼 값진 경험을 바탕으로, “이 분야에 관심있는 어느 누구에게나” 좋은 출발점이 될 수 있도록 빅데이터 프로세스의 4가지 단계에 대해 14주차 이상의 폭넓으면서도 알찬 과정으로 강의를 구성하였습니다 📚
여러분들은 위에 소개된 기술들을 이용하여 데이터 수집 ▶ 데이터 저장 ▶ 데이터 분석 ▶ 표현에 대하여 이론 30% 및 실습 70%의 코드랩 형식으로 학습합니다. 약 6년 동안 훌륭한 제자들의 소중한 피드백들 💌 회고하고 반영해, 최대한 쉽고 질 좋은 컨텐츠로 강의를 구성한 만큼 입문자 분들에게 반드시 큰 도움이 되실 겁니다.
아! 참고로 강의 자료는 추후 다양한 Reference를 찾거나 이 기회를 통해 Research 분야나 더 좋은 기업으로 가실때 도움을 드리기 위해 최대한 영문으로 작성했습니다 🧗🏻♀️
저희는 무엇을 배우나요? 🧑🏻🏫
위 Big Data Processing 4 Steps을 기반으로, 아래와 같이 커리큘럼을 구성하였습니다. (1주차 무료영상 참고)
빅데이터 파이프라인에 관심 있는 누구나 수강하실 수 있습니다 🧑🏻🎓
Python 및 Linux 명령어, 데이터베이스에 대한 기초 지식만 알고 있다면 누구나 수강할 수 있습니다.
[프로모션] 학생, 취준생분들께 강의 금액을 지원해드립니다 💪
수입이 없는 학생분 또는 취준생분에게약 20%할인을 제공합니다. 아래 링크로 신청해주시고 원활한 comm. 위해, 꼭 수강전 문의 탭에 " ${자기소개} 학생/취준생 [프로모션] 신청했습니다" 와 같이 로그 남겨주세요 :)
Hello teacher!
I graduated from business administration and wanted to work on the field, so I have been studying development for over a year. I hear the words big data and big data processing a lot every day around me, so I want to know, but it is burdensome... Through this lecture, I covered each cycle in detail, so I think I learned a lot about data pipelines.
First of all, since the time given was not much, I listened as much as I could, but I will review it during the remaining period and proceed with my own project based on it~~~!!! Please give me a lot of advice. Thank you~~!!
Hello Mac,
As a non-major developer, you must have had a hard time at first, but thank you for taking the class despite the hardships. Thanks to you, I will also be inspired and work even harder to create better content. I hope that Mac will become a better developer in the future and show even more value.
Thank you.
Big data was something I had only vaguely felt, but after listening to the lecture, I began to understand the concept and imagine how to use it.
The instructor has good diction and the lecture curriculum flows well in sequence.
Thank you for the great lecture!
Hello, Developer Dev,
I am glad that you found it helpful as I have organized and lectured on the content that I have meaningfully experienced.
Please listen comfortably when you review later and let me know if you have any questions.
I took this course because I had a vague curiosity about big data while working as a developer.
While taking the course, I was able to understand it more easily because it didn't just explain the theory, but also gave a general background lecture. It was also great because it led practical exercises in detail in between!!
If you still don't know what big data is and are starting out with a vague curiosity as a developer, I think this course will be very helpful!
Hello TY,
Thank you for your valuable feedback. I hope you will take the remaining lectures diligently and gain a lot from them! I will come back with an even better image in the future.
Instructor. Thank you for the fun lecture.
I haven't seen Inflearn lectures lately, but I'm watching the current lecture more interestingly than Mid.
I think it's a lecture that condenses the know-how that was packed into a small amount of time as much as possible.
If you make a more in-depth lecture next time (project-oriented, HDFS/Spark, AWS data analytics, etc.) it would be perfect.
The current lecture was also very helpful. I thought it would be boring, but it's fun.
I recommend this lecture to developers who want to know how to utilize the overall data platform.
I don't usually write articles like this, but I'm writing this because it was helpful.
Personally, one thing that's a bit disappointing is that the period is 4 months... I'm very disappointed that I can't watch it again when I want to. (I wonder if there's an extension event, Instructor Nam. -_-;;;)
I watch it in detail once and watch it again a few months later.
That way, it's imprinted in my head and I don't forget it.
Hello jason.king,
Thank you for your valuable and detailed course review. Since you said it was more fun than American dramas, I remember studying English on my own ten years ago by watching How I Met Your Mother.
The reason why it was set to 4 months was because it was initially set to one semester at the time of production, so that students could focus and listen. We are running a partial extension promotion for those who are diligently taking the lecture, so please let us know when the deadline is approaching or has passed.
Thank you for your feedback, I am glad that the lecture will be more widely known, and I hope you have a warm and enjoyable weekend.
I am currently running an interior startup! In the past, I didn't need to know about server operation and data analysis, but recently, I thought I needed to know about the perspective and direction of data operation, so I happened to listen to it on the recommendation of an acquaintance. It is very helpful because the lecturer considers the other person's perspective. HDFS may be a big hurdle for me, so I am taking other lectures first. I should recommend it to my acquaintances. I hope you continue to launch good lectures and your business goes well!!!!!
Hello, Mr. Commania CEO,
Thank you for coming all this way to listen to my lecture. I know that you must have a lot to worry about while running a company, but it is not easy to take an interest in designing pipelines and get into practice. I hope we can get through this difficult time together. If there is anything I can help you with, please feel free to contact me or post a question here. Fighting!