MewwSikk
article thumbnail
[๋…ผ๋ฌธ ๋ฆฌ๋ทฐ] Focal Loss

Table of Content 1. Focal Loss์˜ ํ•„์š”์„ฑ 2. Focal Loss 1. Crossentropy Loss๋ฅผ ์“ฐ์ง€ ์•Š๊ณ  Focal Loss๋ฅผ ์“ฐ๋Š” ์ด์œ  2. Balanced Cross Entropy Loss๋ฅผ ์“ฐ์ง€ ์•Š๊ณ  Focal Loss๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ์ด์œ  3. Focal Loss์˜ ์ ์šฉ Object Detection์ด๋ž€? ์—ฌ๋Ÿฌ object๋“ค์„ Bounding Box๋ฅผ ํ†ตํ•ด Localization(์œ„์น˜ ์ฐพ๊ธฐ)ํ•˜๊ณ , Classification(์–ด๋–ค ๋ฌผ์ฒด์ธ์ง€ ๋ถ„๋ฅ˜)ํ•˜๋Š” ์ž‘์—…์ž…๋‹ˆ๋‹ค. Object Detection์˜ 2๊ฐ€์ง€ ์ข…๋ฅ˜์˜ ์•Œ๊ณ ๋ฆฌ์ฆ˜ 1. R-CNN ๊ณ„์—ด์˜ two-stage detector 2. YOLO, SSD ๊ณ„์—ด์˜ one stage detector SSD๊ด€๋ จ ๋…ผ๋ฌธ ๋ฆฌ๋ทฐ: https:..

article thumbnail
[Tensorflow] Gradient Tape์„ ์ด์šฉํ•œ ์ž๋™ ๋ฏธ๋ถ„๊ณผ ์˜ค์ฐจ ์—ญ์ „ํŒŒ

์ด์ „์— ์˜ฌ๋ฆฐ Barlow Twins Architecture๋ฅผ ๊ตฌํ˜„ํ•˜๋ฉด์„œ tensorflow.keras.Model์˜ train_step() ํ•จ์ˆ˜๋ฅผ ๊ฑด๋“œ๋ฆด ์ผ์ด ์ƒ๊ฒผ๋Š”๋ฐ ํ•ด๋‹น ํ•จ์ˆ˜์—์„œ Gradient Tape๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ์ ์„ ๋ณด๊ณ  ๊ณต๋ถ€ํ•˜๋ฉฐ ์•„๋ž˜์˜ ๋ธ”๋กœ๊ทธ๋ฅผ ํ•„์‚ฌํ–ˆ์Šต๋‹ˆ๋‹ค. https://rfriend.tistory.com/556 [TensorFlow] Gradient Tape์„ ์ด์šฉํ•œ ์ž๋™ ๋ฏธ๋ถ„๊ณผ ์˜ค์ฐจ์—ญ์ „ํŒŒ ์ž๋™๋ฏธ๋ถ„(Automatic differentiation, Algorithmic differentiation, computational differentiation, auto-differentiation, ๋˜๋Š” ์ค„์—ฌ์„œ ๊ฐ„๋‹จํžˆ auto-diff) ์€ ์ปดํ“จํ„ฐ ํ”„๋กœ๊ทธ๋žจ์— ์˜ํ•ด์„œ ๊ตฌ์ฒดํ™”๋œ ํ•จ์ˆ˜์˜ ๋ฏธ๋ถ„์„ ์‚ฐ์ˆ ์ ์œผ๋กœ ๊ณ„..

article thumbnail
[๋…ผ๋ฌธ ๋ฆฌ๋ทฐ] Barlow Twins (Self-Supervised Learning via Redundancy Reduction)

์ด๋ฒˆ ํฌ์ŠคํŠธ์—์„œ๋Š” Object Detection์„ ์ง„ํ–‰ํ•  ๋•Œ ํ”„๋ ˆ์ž„ ๊ฐ„ ๊ฐ์ฒด๊ฐ€ ๋™์ผํ•œ ๊ฐ์ฒด์ธ์ง€ ์•„๋‹Œ์ง€์— ๋Œ€ํ•œ ํŒ๋‹จ์„ ์ง„ํ–‰ํ•  ์ˆ˜ ์žˆ๋Š” ๋ชจ๋ธ์ธ Barlow Twins๋ผ๋Š” ๋ชจ๋ธ์— ๋Œ€ํ•œ ๋…ผ๋ฌธ๋ฆฌ๋ทฐ๋ฅผ ์ง„ํ–‰ํ•ด ๋ณด๋ ค ํ•ฉ๋‹ˆ๋‹ค. ๋ณด์™„ํ•  ๋ถ€๋ถ„์ด ์žˆ๋‹ค๋ฉด ๋Œ“๊ธ€์— ์ฒจ์–ธํ•ด ์ฃผ์‹œ๋ฉด ๊ฐ์‚ฌํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค. ๋…ผ๋ฌธ ๋งํฌ: https://arxiv.org/abs/2103.03230 Abstraction Self-Supervised Learning(SSL)์€ ์ž…๋ ฅ ์ƒ˜ํ”Œ์„ ์™œ๊ณกํ–ˆ์„ ๋•Œ, ๊ทธ๋Ÿฐ ์™œ๊ณก์— ๋Œ€ํ•œ ๋ถˆ๋ณ€ํ•œ ์ž„๋ฒ ๋”ฉ์„ ๋งŒ๋“ฆ์œผ๋กœ์จ Supervised Learning๊ณผ์˜ ๊ฒฉ์ฐจ๋ฅผ ๋น ๋ฅด๊ฒŒ ์ค„์—ฌ๊ฐ€๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. (SSL์ด๋ž€ ์ •๋‹ต ๋ฐ์ดํ„ฐ ์—†์ด, ์ž…๋ ฅ ๋ฐ์ดํ„ฐ๋งŒ์œผ๋กœ ํ•™์Šตํ•˜๋Š” ๊ธฐ๋ฒ•์„ ๋งํ•ฉ๋‹ˆ๋‹ค.) ๊ทธ๋Ÿฌ๋‚˜ ์ด๋Ÿฐ ์ ‘๊ทผ๋ฒ•์˜ ๋ฐ˜๋ณต๋˜๋Š” ๋ฌธ์ œ๋Š” ํŠน์ • ํ•™์Šต ๋ฐ์ดํ„ฐ์— ๋Œ€ํ•ด์„œ ๋™์ผํ•œ..

article thumbnail
[๋…ผ๋ฌธ ๋ฆฌ๋ทฐ] DeepLab V3+ model

ํ•ด๋‹น ๋ธ”๋กœ๊ทธ๋Š” ๊ณต๋ถ€๋ฅผ ๋ชฉ์ ์œผ๋กœ https://kuklife.tistory.com/121 ๋ธ”๋กœ๊ทธ๋ฅผ ํ•„์‚ฌํ•˜๋ฉฐ ์“ด ๊ธ€์ž…๋‹ˆ๋‹ค. paper Link: https://arxiv.org/pdf/1802.02611.pdf ########################### DeepLab V3+ ๋…ผ๋ฌธ์€ 2018๋…„ 8์›” ๊ฒฝ ๊ตฌ๊ธ€์—์„œ ์ž‘์„ฑ๋œ ๋…ผ๋ฌธ์ž…๋‹ˆ๋‹ค. Semantic Segmentation์„ ํ•ด๊ฒฐํ•˜๊ธฐ ์œ„ํ•œ ๋ฐฉ๋ฒ•๋ก ์€ ์—ฌ๋Ÿฌ ๊ฐ€์ง€๊ฐ€ ์กด์žฌํ•˜์ง€๋งŒ ๊ทธ์ค‘ DeepLab ์‹œ๋ฆฌ์ฆˆ๋Š” ์—ฌ๋Ÿฌ Segmentation model ์ค‘ ์„œ๋Šฅ์ด ์ƒ์œ„๊ถŒ์— ๋งŽ์ด ํฌ์ง„๋˜์–ด ์žˆ๋Š” model๋“ค์ž…๋‹ˆ๋‹ค. ๊ทธ์ค‘์—์„œ๋„ ๊ฐ€์žฅ ์„ฑ๋Šฅ์ด ๋†’์œผ๋ฉฐ DeepLab์‹œ๋ฆฌ์ฆˆ ์ค‘ ๊ฐ€์žฅ ์ตœ๊ทผ์— ๋‚˜์˜จ DeepLab V3+์— ๋Œ€ํ•ด์„œ ์‚ดํŽด๋ณด๊ฒ ์Šต๋‹ˆ๋‹ค. ์ „์ฒด์ ์œผ๋กœ DeepLab์€ semantic s..

article thumbnail
TIF ํŒŒ์ผ์ด๋ž€?

์ด๋ฏธ์ง€ ํŒŒ์ผ ํ˜•์‹์—๋Š” BMP, JPEG, PNG ๋“ฑ ์—ฌ๋Ÿฌ ๊ฐ€์ง€ ์œ ํ˜•์ด ์กด์žฌํ•˜๊ณ  TIF(TIFF)๋„ ์ด๋ฏธ์ง€ ํ˜•์‹ ์ค‘ ํ•˜๋‚˜์ž…๋‹ˆ๋‹ค. TIF ํŒŒ์ผ์ด๋ž€? tif๋Š” TIFF ํ˜•์‹์˜ ์ด๋ฏธ์ง€ ํŒŒ์ผ์— ๋Œ€ํ•œ ํ™•์žฅ์ž ์ž…๋‹ˆ๋‹ค. TIFF๋Š” Tag Image File Format์˜ ์•ฝ์ž์ด๋ฉฐ windows๋‚˜ mac์— ๊ด€๊ณ„์—†์ด ์ฝ๊ณ  ์“ฐ๊ธฐ ๊ฐ€๋Šฅํ•œ ์ด๋ฏธ์ง€ ํŒŒ์ผ์„ ๋œปํ•ฉ๋‹ˆ๋‹ค. ์—ฌ๋Ÿฌ ์ด๋ฏธ์ง€ ํŒŒ์ผ ํ˜•์‹๋“ค์ด ์žˆ์ง€๋งŒ TIFF๋„ ๊ทธ ์ค‘ ํ•˜๋‚˜์ž…๋‹ˆ๋‹ค. ์˜ˆ๋ฅผ ๋“ค์–ด, "์Šค์บ๋„ˆ๋กœ ์Šค์บ”ํ•œ ํŒŒ์ผ"์€ ์ข…์ข… tif ํ˜•์‹์ž…๋‹ˆ๋‹ค. ๋˜ํ•œ ์ผ๋ถ€ ๋””์ง€ํ„ธ ์นด๋ฉ”๋ผ์—์„œ๋„ TIFF ์ด๋ฏธ์ง€๋กœ ๋ฐ์ดํ„ฐ ์ €์žฅ์— ๋Œ€์‘ํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. tiff์˜ ํ™•์žฅ์ž๋กœ๋Š” ๋”๋ณด๊ธฐ .tif .tiff ๋ผ๋Š” 2๊ฐ€์ง€์˜ ์ข…๋ฅ˜๊ฐ€ ์žˆ์œผ๋ฉฐ, ์ด ๋‘ ์ข…๋ฅ˜ ๋ชจ๋‘ ๊ฐ™์€ ํŒŒ์ผ ํ™•์žฅ์ž ์ž…๋‹ˆ๋‹ค. TIFF ํŒŒ์ผ ํŠน์ง• ์ด ํŒŒ์ผ์€ ๊ณ ํ•ด..

article thumbnail
[๋…ผ๋ฌธ ๋ฆฌ๋ทฐ] Keypoint-wise Adaptive Loss for Whole Body Human Pose Estimation

https://www.researchgate.net/publication/368336170_Keypoint-wise_Adaptive_Loss_for_Whole-Body_Human_Pose_Estimation/link/63e35d76c002331f72600e02/download ๋…ผ๋ฌธ์ด ๊ถ๊ธˆํ•˜๋‹ค๋ฉด ์œ„ ๋งํฌ์—์„œ ๋‹ค์šด์ด ๊ฐ€๋Šฅํ•ฉ๋‹ˆ๋‹ค. ์ด ๋…ผ๋ฌธ์€ AAAI 2023์— ์†Œ๊ฐœ๋œ Keypoint-wise Adaptive Loss for Whole-Body Human Pose Estimation์ด๋ผ๋Š” ๋…ผ๋ฌธ์ž…๋‹ˆ๋‹ค. ABSTRACT ์ด ๋…ผ๋ฌธ์€ dense ๋ฐ coarse keypoint์˜ mixed charateristic์„ ๋ถ„์„ํ•˜์—ฌ whole-body pose estimation์„ ์ˆ˜ํ–‰ํ•ฉ๋‹ˆ๋‹ค. whole body๋ฅผ ์ถ”์ •ํ•˜๋Š” ๊ฒƒ..